-- Logs begin at Tue 2022-09-13 17:19:58 UTC, end at Tue 2022-09-13 18:21:15 UTC. -- Sep 13 17:52:51.354162 dv-cinder-852009-8-iscsi systemd[1]: Starting Devstack devstack@n-api.service... Sep 13 17:52:51.363808 dv-cinder-852009-8-iscsi devstack@n-api.service[105511]: [uWSGI] getting INI configuration from /etc/nova/nova-api-uwsgi.ini Sep 13 17:52:51.365302 dv-cinder-852009-8-iscsi devstack@n-api.service[105511]: *** Starting uWSGI 2.0.18-debian (64bit) on [Tue Sep 13 17:52:51 2022] *** Sep 13 17:52:51.365302 dv-cinder-852009-8-iscsi devstack@n-api.service[105511]: compiled with version: 10.0.1 20200405 (experimental) [master revision 0be9efad938:fcb98e4978a:705510a708d3642c9c962beb663c476167e4e8a4] on 11 April 2020 11:15:55 Sep 13 17:52:51.365302 dv-cinder-852009-8-iscsi devstack@n-api.service[105511]: os: Linux-5.4.0-72-generic #80-Ubuntu SMP Mon Apr 12 17:35:00 UTC 2021 Sep 13 17:52:51.365302 dv-cinder-852009-8-iscsi devstack@n-api.service[105511]: nodename: dv-cinder-852009-8-iscsi Sep 13 17:52:51.365302 dv-cinder-852009-8-iscsi devstack@n-api.service[105511]: machine: x86_64 Sep 13 17:52:51.365302 dv-cinder-852009-8-iscsi devstack@n-api.service[105511]: clock source: unix Sep 13 17:52:51.365302 dv-cinder-852009-8-iscsi devstack@n-api.service[105511]: pcre jit disabled Sep 13 17:52:51.365302 dv-cinder-852009-8-iscsi devstack@n-api.service[105511]: detected number of CPU cores: 4 Sep 13 17:52:51.365302 dv-cinder-852009-8-iscsi devstack@n-api.service[105511]: current working directory: / Sep 13 17:52:51.365302 dv-cinder-852009-8-iscsi devstack@n-api.service[105511]: detected binary path: /usr/bin/uwsgi-core Sep 13 17:52:51.365302 dv-cinder-852009-8-iscsi devstack@n-api.service[105511]: your processes number limit is 47680 Sep 13 17:52:51.365302 dv-cinder-852009-8-iscsi devstack@n-api.service[105511]: your memory page size is 4096 bytes Sep 13 17:52:51.365302 dv-cinder-852009-8-iscsi devstack@n-api.service[105511]: detected max file descriptor number: 2048 Sep 13 17:52:51.365302 dv-cinder-852009-8-iscsi devstack@n-api.service[105511]: lock engine: pthread robust mutexes Sep 13 17:52:51.366663 dv-cinder-852009-8-iscsi devstack@n-api.service[105511]: thunder lock: enabled Sep 13 17:52:51.366663 dv-cinder-852009-8-iscsi devstack@n-api.service[105511]: uwsgi socket 0 bound to UNIX address /var/run/uwsgi/nova-api-wsgi.socket fd 4 Sep 13 17:52:51.366663 dv-cinder-852009-8-iscsi devstack@n-api.service[105511]: Python version: 3.8.10 (default, Jun 22 2022, 20:18:18) [GCC 9.4.0] Sep 13 17:52:51.405021 dv-cinder-852009-8-iscsi devstack@n-api.service[105511]: Python main interpreter initialized at 0x55871ba559c0 Sep 13 17:52:51.405021 dv-cinder-852009-8-iscsi devstack@n-api.service[105511]: python threads support enabled Sep 13 17:52:51.405021 dv-cinder-852009-8-iscsi devstack@n-api.service[105511]: your server socket listen backlog is limited to 100 connections Sep 13 17:52:51.405021 dv-cinder-852009-8-iscsi devstack@n-api.service[105511]: your mercy for graceful operations on workers is 90 seconds Sep 13 17:52:51.405527 dv-cinder-852009-8-iscsi devstack@n-api.service[105511]: mapped 403077 bytes (393 KB) for 2 cores Sep 13 17:52:51.405527 dv-cinder-852009-8-iscsi devstack@n-api.service[105511]: *** Operational MODE: preforking *** Sep 13 17:52:51.405717 dv-cinder-852009-8-iscsi devstack@n-api.service[105511]: *** uWSGI is running in multiple interpreter mode *** Sep 13 17:52:51.405717 dv-cinder-852009-8-iscsi devstack@n-api.service[105511]: spawned uWSGI master process (pid: 105511) Sep 13 17:52:51.405976 dv-cinder-852009-8-iscsi systemd[1]: Started Devstack devstack@n-api.service. Sep 13 17:52:51.407150 dv-cinder-852009-8-iscsi devstack@n-api.service[105511]: spawned uWSGI worker 1 (pid: 105512, cores: 1) Sep 13 17:52:51.407150 dv-cinder-852009-8-iscsi devstack@n-api.service[105511]: spawned uWSGI worker 2 (pid: 105513, cores: 1) Sep 13 17:52:51.407150 dv-cinder-852009-8-iscsi devstack@n-api.service[105511]: running "unix_signal:15 gracefully_kill_them_all" (master-start)... Sep 13 17:52:52.078203 dv-cinder-852009-8-iscsi devstack@n-api.service[105513]: Modules with known eventlet monkey patching issues were imported prior to eventlet monkey patching: urllib3. This warning can usually be ignored if the caller is only importing and not executing nova code. Sep 13 17:52:52.084150 dv-cinder-852009-8-iscsi devstack@n-api.service[105512]: Modules with known eventlet monkey patching issues were imported prior to eventlet monkey patching: urllib3. This warning can usually be ignored if the caller is only importing and not executing nova code. Sep 13 17:52:53.156968 dv-cinder-852009-8-iscsi devstack@n-api.service[105513]: /usr/lib/python3/dist-packages/secretstorage/dhcrypto.py:15: CryptographyDeprecationWarning: int_from_bytes is deprecated, use int.from_bytes instead Sep 13 17:52:53.156968 dv-cinder-852009-8-iscsi devstack@n-api.service[105513]: from cryptography.utils import int_from_bytes Sep 13 17:52:53.157601 dv-cinder-852009-8-iscsi devstack@n-api.service[105513]: /usr/lib/python3/dist-packages/secretstorage/util.py:19: CryptographyDeprecationWarning: int_from_bytes is deprecated, use int.from_bytes instead Sep 13 17:52:53.157601 dv-cinder-852009-8-iscsi devstack@n-api.service[105513]: from cryptography.utils import int_from_bytes Sep 13 17:52:53.164391 dv-cinder-852009-8-iscsi devstack@n-api.service[105512]: /usr/lib/python3/dist-packages/secretstorage/dhcrypto.py:15: CryptographyDeprecationWarning: int_from_bytes is deprecated, use int.from_bytes instead Sep 13 17:52:53.164391 dv-cinder-852009-8-iscsi devstack@n-api.service[105512]: from cryptography.utils import int_from_bytes Sep 13 17:52:53.164910 dv-cinder-852009-8-iscsi devstack@n-api.service[105512]: /usr/lib/python3/dist-packages/secretstorage/util.py:19: CryptographyDeprecationWarning: int_from_bytes is deprecated, use int.from_bytes instead Sep 13 17:52:53.164910 dv-cinder-852009-8-iscsi devstack@n-api.service[105512]: from cryptography.utils import int_from_bytes Sep 13 17:52:55.617219 dv-cinder-852009-8-iscsi devstack@n-api.service[105512]: DEBUG nova.api.openstack.wsgi_app [-] ******************************************************************************** {{(pid=105512) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2589}} Sep 13 17:52:55.617927 dv-cinder-852009-8-iscsi devstack@n-api.service[105512]: DEBUG nova.api.openstack.wsgi_app [-] Configuration options gathered from: {{(pid=105512) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2590}} Sep 13 17:52:55.618036 dv-cinder-852009-8-iscsi devstack@n-api.service[105512]: DEBUG nova.api.openstack.wsgi_app [-] command line args: [] {{(pid=105512) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2591}} Sep 13 17:52:55.618281 dv-cinder-852009-8-iscsi devstack@n-api.service[105513]: DEBUG nova.api.openstack.wsgi_app [-] ******************************************************************************** {{(pid=105513) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2589}} Sep 13 17:52:55.618713 dv-cinder-852009-8-iscsi devstack@n-api.service[105512]: DEBUG nova.api.openstack.wsgi_app [-] config files: ['/etc/nova/api-paste.ini', '/etc/nova/nova.conf'] {{(pid=105512) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2592}} Sep 13 17:52:55.618830 dv-cinder-852009-8-iscsi devstack@n-api.service[105513]: DEBUG nova.api.openstack.wsgi_app [-] Configuration options gathered from: {{(pid=105513) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2590}} Sep 13 17:52:55.618919 dv-cinder-852009-8-iscsi devstack@n-api.service[105512]: DEBUG nova.api.openstack.wsgi_app [-] ================================================================================ {{(pid=105512) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2594}} Sep 13 17:52:55.618919 dv-cinder-852009-8-iscsi devstack@n-api.service[105512]: DEBUG nova.api.openstack.wsgi_app [-] allow_resize_to_same_host = True {{(pid=105512) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 13 17:52:55.619051 dv-cinder-852009-8-iscsi devstack@n-api.service[105513]: DEBUG nova.api.openstack.wsgi_app [-] command line args: [] {{(pid=105513) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2591}} Sep 13 17:52:55.619268 dv-cinder-852009-8-iscsi devstack@n-api.service[105512]: DEBUG nova.api.openstack.wsgi_app [-] arq_binding_timeout = 300 {{(pid=105512) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 13 17:52:55.619402 dv-cinder-852009-8-iscsi devstack@n-api.service[105513]: DEBUG nova.api.openstack.wsgi_app [-] config files: ['/etc/nova/api-paste.ini', '/etc/nova/nova.conf'] {{(pid=105513) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2592}} Sep 13 17:52:55.619552 dv-cinder-852009-8-iscsi devstack@n-api.service[105512]: DEBUG nova.api.openstack.wsgi_app [-] block_device_allocate_retries = 60 {{(pid=105512) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 13 17:52:55.619644 dv-cinder-852009-8-iscsi devstack@n-api.service[105513]: DEBUG nova.api.openstack.wsgi_app [-] ================================================================================ {{(pid=105513) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2594}} Sep 13 17:52:55.619901 dv-cinder-852009-8-iscsi devstack@n-api.service[105512]: DEBUG nova.api.openstack.wsgi_app [-] block_device_allocate_retries_interval = 3 {{(pid=105512) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 13 17:52:55.620052 dv-cinder-852009-8-iscsi devstack@n-api.service[105513]: DEBUG nova.api.openstack.wsgi_app [-] allow_resize_to_same_host = True {{(pid=105513) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 13 17:52:55.620232 dv-cinder-852009-8-iscsi devstack@n-api.service[105512]: DEBUG nova.api.openstack.wsgi_app [-] cert = self.pem {{(pid=105512) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 13 17:52:55.620376 dv-cinder-852009-8-iscsi devstack@n-api.service[105513]: DEBUG nova.api.openstack.wsgi_app [-] arq_binding_timeout = 300 {{(pid=105513) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 13 17:52:55.620588 dv-cinder-852009-8-iscsi devstack@n-api.service[105512]: DEBUG nova.api.openstack.wsgi_app [-] compute_driver = None {{(pid=105512) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 13 17:52:55.620740 dv-cinder-852009-8-iscsi devstack@n-api.service[105513]: DEBUG nova.api.openstack.wsgi_app [-] block_device_allocate_retries = 60 {{(pid=105513) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 13 17:52:55.620889 dv-cinder-852009-8-iscsi devstack@n-api.service[105512]: DEBUG nova.api.openstack.wsgi_app [-] compute_monitors = [] {{(pid=105512) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 13 17:52:55.621008 dv-cinder-852009-8-iscsi devstack@n-api.service[105513]: DEBUG nova.api.openstack.wsgi_app [-] block_device_allocate_retries_interval = 3 {{(pid=105513) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 13 17:52:55.621216 dv-cinder-852009-8-iscsi devstack@n-api.service[105512]: DEBUG nova.api.openstack.wsgi_app [-] config_dir = [] {{(pid=105512) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 13 17:52:55.621350 dv-cinder-852009-8-iscsi devstack@n-api.service[105513]: DEBUG nova.api.openstack.wsgi_app [-] cert = self.pem {{(pid=105513) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 13 17:52:55.621547 dv-cinder-852009-8-iscsi devstack@n-api.service[105512]: DEBUG nova.api.openstack.wsgi_app [-] config_drive_format = iso9660 {{(pid=105512) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 13 17:52:55.621748 dv-cinder-852009-8-iscsi devstack@n-api.service[105513]: DEBUG nova.api.openstack.wsgi_app [-] compute_driver = None {{(pid=105513) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 13 17:52:55.621849 dv-cinder-852009-8-iscsi devstack@n-api.service[105512]: DEBUG nova.api.openstack.wsgi_app [-] config_file = ['/etc/nova/api-paste.ini', '/etc/nova/nova.conf'] {{(pid=105512) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 13 17:52:55.621932 dv-cinder-852009-8-iscsi devstack@n-api.service[105513]: DEBUG nova.api.openstack.wsgi_app [-] compute_monitors = [] {{(pid=105513) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 13 17:52:55.622061 dv-cinder-852009-8-iscsi devstack@n-api.service[105512]: DEBUG nova.api.openstack.wsgi_app [-] config_source = [] {{(pid=105512) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 13 17:52:55.622247 dv-cinder-852009-8-iscsi devstack@n-api.service[105513]: DEBUG nova.api.openstack.wsgi_app [-] config_dir = [] {{(pid=105513) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 13 17:52:55.622396 dv-cinder-852009-8-iscsi devstack@n-api.service[105512]: DEBUG nova.api.openstack.wsgi_app [-] console_host = dv-cinder-852009-8-iscsi {{(pid=105512) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 13 17:52:55.622582 dv-cinder-852009-8-iscsi devstack@n-api.service[105513]: DEBUG nova.api.openstack.wsgi_app [-] config_drive_format = iso9660 {{(pid=105513) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 13 17:52:55.622736 dv-cinder-852009-8-iscsi devstack@n-api.service[105512]: DEBUG nova.api.openstack.wsgi_app [-] control_exchange = nova {{(pid=105512) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 13 17:52:55.622895 dv-cinder-852009-8-iscsi devstack@n-api.service[105513]: DEBUG nova.api.openstack.wsgi_app [-] config_file = ['/etc/nova/api-paste.ini', '/etc/nova/nova.conf'] {{(pid=105513) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 13 17:52:55.622985 dv-cinder-852009-8-iscsi devstack@n-api.service[105512]: DEBUG nova.api.openstack.wsgi_app [-] cpu_allocation_ratio = None {{(pid=105512) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 13 17:52:55.623151 dv-cinder-852009-8-iscsi devstack@n-api.service[105513]: DEBUG nova.api.openstack.wsgi_app [-] config_source = [] {{(pid=105513) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 13 17:52:55.623318 dv-cinder-852009-8-iscsi devstack@n-api.service[105512]: DEBUG nova.api.openstack.wsgi_app [-] daemon = False {{(pid=105512) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 13 17:52:55.623471 dv-cinder-852009-8-iscsi devstack@n-api.service[105513]: DEBUG nova.api.openstack.wsgi_app [-] console_host = dv-cinder-852009-8-iscsi {{(pid=105513) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 13 17:52:55.623565 dv-cinder-852009-8-iscsi devstack@n-api.service[105512]: DEBUG nova.api.openstack.wsgi_app [-] debug = True {{(pid=105512) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 13 17:52:55.623786 dv-cinder-852009-8-iscsi devstack@n-api.service[105513]: DEBUG nova.api.openstack.wsgi_app [-] control_exchange = nova {{(pid=105513) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 13 17:52:55.623886 dv-cinder-852009-8-iscsi devstack@n-api.service[105512]: DEBUG nova.api.openstack.wsgi_app [-] default_access_ip_network_name = None {{(pid=105512) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 13 17:52:55.624112 dv-cinder-852009-8-iscsi devstack@n-api.service[105513]: DEBUG nova.api.openstack.wsgi_app [-] cpu_allocation_ratio = None {{(pid=105513) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 13 17:52:55.624295 dv-cinder-852009-8-iscsi devstack@n-api.service[105512]: DEBUG nova.api.openstack.wsgi_app [-] default_availability_zone = nova {{(pid=105512) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 13 17:52:55.624386 dv-cinder-852009-8-iscsi devstack@n-api.service[105513]: DEBUG nova.api.openstack.wsgi_app [-] daemon = False {{(pid=105513) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 13 17:52:55.624492 dv-cinder-852009-8-iscsi devstack@n-api.service[105512]: DEBUG nova.api.openstack.wsgi_app [-] default_ephemeral_format = None {{(pid=105512) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 13 17:52:55.624743 dv-cinder-852009-8-iscsi devstack@n-api.service[105513]: DEBUG nova.api.openstack.wsgi_app [-] debug = True {{(pid=105513) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 13 17:52:55.624971 dv-cinder-852009-8-iscsi devstack@n-api.service[105512]: DEBUG nova.api.openstack.wsgi_app [-] default_log_levels = ['amqp=WARN', 'amqplib=WARN', 'boto=WARN', 'qpid=WARN', 'sqlalchemy=WARN', 'suds=INFO', 'oslo.messaging=INFO', 'oslo_messaging=INFO', 'iso8601=WARN', 'requests.packages.urllib3.connectionpool=WARN', 'urllib3.connectionpool=WARN', 'websocket=WARN', 'requests.packages.urllib3.util.retry=WARN', 'urllib3.util.retry=WARN', 'keystonemiddleware=WARN', 'routes.middleware=WARN', 'stevedore=WARN', 'taskflow=WARN', 'keystoneauth=WARN', 'oslo.cache=INFO', 'oslo_policy=INFO', 'dogpile.core.dogpile=INFO', 'glanceclient=WARN', 'oslo.privsep.daemon=INFO'] {{(pid=105512) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 13 17:52:55.625091 dv-cinder-852009-8-iscsi devstack@n-api.service[105513]: DEBUG nova.api.openstack.wsgi_app [-] default_access_ip_network_name = None {{(pid=105513) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 13 17:52:55.625361 dv-cinder-852009-8-iscsi devstack@n-api.service[105513]: DEBUG nova.api.openstack.wsgi_app [-] default_availability_zone = nova {{(pid=105513) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 13 17:52:55.625528 dv-cinder-852009-8-iscsi devstack@n-api.service[105512]: DEBUG nova.api.openstack.wsgi_app [-] default_schedule_zone = None {{(pid=105512) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 13 17:52:55.625709 dv-cinder-852009-8-iscsi devstack@n-api.service[105513]: DEBUG nova.api.openstack.wsgi_app [-] default_ephemeral_format = None {{(pid=105513) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 13 17:52:55.625827 dv-cinder-852009-8-iscsi devstack@n-api.service[105512]: DEBUG nova.api.openstack.wsgi_app [-] disk_allocation_ratio = None {{(pid=105512) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 13 17:52:55.625991 dv-cinder-852009-8-iscsi devstack@n-api.service[105512]: DEBUG nova.api.openstack.wsgi_app [-] enable_new_services = True {{(pid=105512) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 13 17:52:55.626172 dv-cinder-852009-8-iscsi devstack@n-api.service[105513]: DEBUG nova.api.openstack.wsgi_app [-] default_log_levels = ['amqp=WARN', 'amqplib=WARN', 'boto=WARN', 'qpid=WARN', 'sqlalchemy=WARN', 'suds=INFO', 'oslo.messaging=INFO', 'oslo_messaging=INFO', 'iso8601=WARN', 'requests.packages.urllib3.connectionpool=WARN', 'urllib3.connectionpool=WARN', 'websocket=WARN', 'requests.packages.urllib3.util.retry=WARN', 'urllib3.util.retry=WARN', 'keystonemiddleware=WARN', 'routes.middleware=WARN', 'stevedore=WARN', 'taskflow=WARN', 'keystoneauth=WARN', 'oslo.cache=INFO', 'oslo_policy=INFO', 'dogpile.core.dogpile=INFO', 'glanceclient=WARN', 'oslo.privsep.daemon=INFO'] {{(pid=105513) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 13 17:52:55.626302 dv-cinder-852009-8-iscsi devstack@n-api.service[105512]: DEBUG nova.api.openstack.wsgi_app [-] enabled_apis = ['osapi_compute'] {{(pid=105512) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 13 17:52:55.626481 dv-cinder-852009-8-iscsi devstack@n-api.service[105513]: DEBUG nova.api.openstack.wsgi_app [-] default_schedule_zone = None {{(pid=105513) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 13 17:52:55.626632 dv-cinder-852009-8-iscsi devstack@n-api.service[105512]: DEBUG nova.api.openstack.wsgi_app [-] enabled_ssl_apis = [] {{(pid=105512) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 13 17:52:55.626941 dv-cinder-852009-8-iscsi devstack@n-api.service[105513]: DEBUG nova.api.openstack.wsgi_app [-] disk_allocation_ratio = None {{(pid=105513) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 13 17:52:55.627252 dv-cinder-852009-8-iscsi devstack@n-api.service[105513]: DEBUG nova.api.openstack.wsgi_app [-] enable_new_services = True {{(pid=105513) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 13 17:52:55.627598 dv-cinder-852009-8-iscsi devstack@n-api.service[105513]: DEBUG nova.api.openstack.wsgi_app [-] enabled_apis = ['osapi_compute'] {{(pid=105513) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 13 17:52:55.627980 dv-cinder-852009-8-iscsi devstack@n-api.service[105513]: DEBUG nova.api.openstack.wsgi_app [-] enabled_ssl_apis = [] {{(pid=105513) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 13 17:52:55.628089 dv-cinder-852009-8-iscsi devstack@n-api.service[105512]: DEBUG nova.api.openstack.wsgi_app [-] flat_injected = False {{(pid=105512) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 13 17:52:55.628235 dv-cinder-852009-8-iscsi devstack@n-api.service[105513]: DEBUG nova.api.openstack.wsgi_app [-] flat_injected = False {{(pid=105513) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 13 17:52:55.628381 dv-cinder-852009-8-iscsi devstack@n-api.service[105512]: DEBUG nova.api.openstack.wsgi_app [-] force_config_drive = True {{(pid=105512) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 13 17:52:55.628585 dv-cinder-852009-8-iscsi devstack@n-api.service[105513]: DEBUG nova.api.openstack.wsgi_app [-] force_config_drive = True {{(pid=105513) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 13 17:52:55.628689 dv-cinder-852009-8-iscsi devstack@n-api.service[105512]: DEBUG nova.api.openstack.wsgi_app [-] force_raw_images = True {{(pid=105512) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 13 17:52:55.628899 dv-cinder-852009-8-iscsi devstack@n-api.service[105513]: DEBUG nova.api.openstack.wsgi_app [-] force_raw_images = True {{(pid=105513) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 13 17:52:55.629023 dv-cinder-852009-8-iscsi devstack@n-api.service[105512]: DEBUG nova.api.openstack.wsgi_app [-] graceful_shutdown_timeout = 5 {{(pid=105512) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 13 17:52:55.629225 dv-cinder-852009-8-iscsi devstack@n-api.service[105513]: DEBUG nova.api.openstack.wsgi_app [-] graceful_shutdown_timeout = 5 {{(pid=105513) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 13 17:52:55.629318 dv-cinder-852009-8-iscsi devstack@n-api.service[105512]: DEBUG nova.api.openstack.wsgi_app [-] heal_instance_info_cache_interval = 60 {{(pid=105512) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 13 17:52:55.629544 dv-cinder-852009-8-iscsi devstack@n-api.service[105513]: DEBUG nova.api.openstack.wsgi_app [-] heal_instance_info_cache_interval = 60 {{(pid=105513) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 13 17:52:55.629704 dv-cinder-852009-8-iscsi devstack@n-api.service[105512]: DEBUG nova.api.openstack.wsgi_app [-] host = dv-cinder-852009-8-iscsi {{(pid=105512) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 13 17:52:55.629938 dv-cinder-852009-8-iscsi devstack@n-api.service[105513]: DEBUG nova.api.openstack.wsgi_app [-] host = dv-cinder-852009-8-iscsi {{(pid=105513) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 13 17:52:55.630030 dv-cinder-852009-8-iscsi devstack@n-api.service[105512]: DEBUG nova.api.openstack.wsgi_app [-] initial_cpu_allocation_ratio = 16.0 {{(pid=105512) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 13 17:52:55.630259 dv-cinder-852009-8-iscsi devstack@n-api.service[105513]: DEBUG nova.api.openstack.wsgi_app [-] initial_cpu_allocation_ratio = 16.0 {{(pid=105513) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 13 17:52:55.630395 dv-cinder-852009-8-iscsi devstack@n-api.service[105512]: DEBUG nova.api.openstack.wsgi_app [-] initial_disk_allocation_ratio = 1.0 {{(pid=105512) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 13 17:52:55.630571 dv-cinder-852009-8-iscsi devstack@n-api.service[105513]: DEBUG nova.api.openstack.wsgi_app [-] initial_disk_allocation_ratio = 1.0 {{(pid=105513) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 13 17:52:55.630661 dv-cinder-852009-8-iscsi devstack@n-api.service[105512]: DEBUG nova.api.openstack.wsgi_app [-] initial_ram_allocation_ratio = 1.5 {{(pid=105512) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 13 17:52:55.630913 dv-cinder-852009-8-iscsi devstack@n-api.service[105513]: DEBUG nova.api.openstack.wsgi_app [-] initial_ram_allocation_ratio = 1.5 {{(pid=105513) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 13 17:52:55.631068 dv-cinder-852009-8-iscsi devstack@n-api.service[105512]: DEBUG nova.api.openstack.wsgi_app [-] injected_network_template = /opt/stack/nova/nova/virt/interfaces.template {{(pid=105512) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 13 17:52:55.631332 dv-cinder-852009-8-iscsi devstack@n-api.service[105513]: DEBUG nova.api.openstack.wsgi_app [-] injected_network_template = /opt/stack/nova/nova/virt/interfaces.template {{(pid=105513) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 13 17:52:55.631432 dv-cinder-852009-8-iscsi devstack@n-api.service[105512]: DEBUG nova.api.openstack.wsgi_app [-] instance_build_timeout = 0 {{(pid=105512) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 13 17:52:55.631649 dv-cinder-852009-8-iscsi devstack@n-api.service[105513]: DEBUG nova.api.openstack.wsgi_app [-] instance_build_timeout = 0 {{(pid=105513) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 13 17:52:55.631814 dv-cinder-852009-8-iscsi devstack@n-api.service[105512]: DEBUG nova.api.openstack.wsgi_app [-] instance_delete_interval = 300 {{(pid=105512) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 13 17:52:55.631964 dv-cinder-852009-8-iscsi devstack@n-api.service[105513]: DEBUG nova.api.openstack.wsgi_app [-] instance_delete_interval = 300 {{(pid=105513) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 13 17:52:55.632056 dv-cinder-852009-8-iscsi devstack@n-api.service[105512]: DEBUG nova.api.openstack.wsgi_app [-] instance_format = [instance: %(uuid)s] {{(pid=105512) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 13 17:52:55.632277 dv-cinder-852009-8-iscsi devstack@n-api.service[105512]: DEBUG nova.api.openstack.wsgi_app [-] instance_name_template = instance-%08x {{(pid=105512) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 13 17:52:55.632382 dv-cinder-852009-8-iscsi devstack@n-api.service[105513]: DEBUG nova.api.openstack.wsgi_app [-] instance_format = [instance: %(uuid)s] {{(pid=105513) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 13 17:52:55.632592 dv-cinder-852009-8-iscsi devstack@n-api.service[105512]: DEBUG nova.api.openstack.wsgi_app [-] instance_usage_audit = False {{(pid=105512) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 13 17:52:55.632679 dv-cinder-852009-8-iscsi devstack@n-api.service[105513]: DEBUG nova.api.openstack.wsgi_app [-] instance_name_template = instance-%08x {{(pid=105513) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 13 17:52:55.632908 dv-cinder-852009-8-iscsi devstack@n-api.service[105513]: DEBUG nova.api.openstack.wsgi_app [-] instance_usage_audit = False {{(pid=105513) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 13 17:52:55.633001 dv-cinder-852009-8-iscsi devstack@n-api.service[105512]: DEBUG nova.api.openstack.wsgi_app [-] instance_usage_audit_period = month {{(pid=105512) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 13 17:52:55.633237 dv-cinder-852009-8-iscsi devstack@n-api.service[105513]: DEBUG nova.api.openstack.wsgi_app [-] instance_usage_audit_period = month {{(pid=105513) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 13 17:52:55.633335 dv-cinder-852009-8-iscsi devstack@n-api.service[105512]: DEBUG nova.api.openstack.wsgi_app [-] instance_uuid_format = [instance: %(uuid)s] {{(pid=105512) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 13 17:52:55.633550 dv-cinder-852009-8-iscsi devstack@n-api.service[105512]: DEBUG nova.api.openstack.wsgi_app [-] instances_path = /opt/stack/data/nova/instances {{(pid=105512) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 13 17:52:55.633645 dv-cinder-852009-8-iscsi devstack@n-api.service[105513]: DEBUG nova.api.openstack.wsgi_app [-] instance_uuid_format = [instance: %(uuid)s] {{(pid=105513) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 13 17:52:55.633868 dv-cinder-852009-8-iscsi devstack@n-api.service[105513]: DEBUG nova.api.openstack.wsgi_app [-] instances_path = /opt/stack/data/nova/instances {{(pid=105513) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 13 17:52:55.633954 dv-cinder-852009-8-iscsi devstack@n-api.service[105512]: DEBUG nova.api.openstack.wsgi_app [-] internal_service_availability_zone = internal {{(pid=105512) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 13 17:52:55.634166 dv-cinder-852009-8-iscsi devstack@n-api.service[105512]: DEBUG nova.api.openstack.wsgi_app [-] key = None {{(pid=105512) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 13 17:52:55.634304 dv-cinder-852009-8-iscsi devstack@n-api.service[105513]: DEBUG nova.api.openstack.wsgi_app [-] internal_service_availability_zone = internal {{(pid=105513) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 13 17:52:55.634474 dv-cinder-852009-8-iscsi devstack@n-api.service[105512]: DEBUG nova.api.openstack.wsgi_app [-] live_migration_retry_count = 30 {{(pid=105512) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 13 17:52:55.634560 dv-cinder-852009-8-iscsi devstack@n-api.service[105513]: DEBUG nova.api.openstack.wsgi_app [-] key = None {{(pid=105513) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 13 17:52:55.634782 dv-cinder-852009-8-iscsi devstack@n-api.service[105513]: DEBUG nova.api.openstack.wsgi_app [-] live_migration_retry_count = 30 {{(pid=105513) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 13 17:52:55.634867 dv-cinder-852009-8-iscsi devstack@n-api.service[105512]: DEBUG nova.api.openstack.wsgi_app [-] log_config_append = None {{(pid=105512) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 13 17:52:55.635092 dv-cinder-852009-8-iscsi devstack@n-api.service[105512]: DEBUG nova.api.openstack.wsgi_app [-] log_date_format = %Y-%m-%d %H:%M:%S {{(pid=105512) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 13 17:52:55.635193 dv-cinder-852009-8-iscsi devstack@n-api.service[105513]: DEBUG nova.api.openstack.wsgi_app [-] log_config_append = None {{(pid=105513) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 13 17:52:55.635509 dv-cinder-852009-8-iscsi devstack@n-api.service[105512]: DEBUG nova.api.openstack.wsgi_app [-] log_dir = None {{(pid=105512) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 13 17:52:55.635613 dv-cinder-852009-8-iscsi devstack@n-api.service[105513]: DEBUG nova.api.openstack.wsgi_app [-] log_date_format = %Y-%m-%d %H:%M:%S {{(pid=105513) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 13 17:52:55.635804 dv-cinder-852009-8-iscsi devstack@n-api.service[105512]: DEBUG nova.api.openstack.wsgi_app [-] log_file = None {{(pid=105512) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 13 17:52:55.635902 dv-cinder-852009-8-iscsi devstack@n-api.service[105513]: DEBUG nova.api.openstack.wsgi_app [-] log_dir = None {{(pid=105513) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 13 17:52:55.635995 dv-cinder-852009-8-iscsi devstack@n-api.service[105512]: DEBUG nova.api.openstack.wsgi_app [-] log_options = True {{(pid=105512) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 13 17:52:55.636077 dv-cinder-852009-8-iscsi devstack@n-api.service[105513]: DEBUG nova.api.openstack.wsgi_app [-] log_file = None {{(pid=105513) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 13 17:52:55.636219 dv-cinder-852009-8-iscsi devstack@n-api.service[105512]: DEBUG nova.api.openstack.wsgi_app [-] log_rotate_interval = 1 {{(pid=105512) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 13 17:52:55.636305 dv-cinder-852009-8-iscsi devstack@n-api.service[105513]: DEBUG nova.api.openstack.wsgi_app [-] log_options = True {{(pid=105513) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 13 17:52:55.636554 dv-cinder-852009-8-iscsi devstack@n-api.service[105513]: DEBUG nova.api.openstack.wsgi_app [-] log_rotate_interval = 1 {{(pid=105513) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 13 17:52:55.636644 dv-cinder-852009-8-iscsi devstack@n-api.service[105512]: DEBUG nova.api.openstack.wsgi_app [-] log_rotate_interval_type = days {{(pid=105512) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 13 17:52:55.636873 dv-cinder-852009-8-iscsi devstack@n-api.service[105512]: DEBUG nova.api.openstack.wsgi_app [-] log_rotation_type = none {{(pid=105512) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 13 17:52:55.636962 dv-cinder-852009-8-iscsi devstack@n-api.service[105513]: DEBUG nova.api.openstack.wsgi_app [-] log_rotate_interval_type = days {{(pid=105513) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 13 17:52:55.637192 dv-cinder-852009-8-iscsi devstack@n-api.service[105512]: DEBUG nova.api.openstack.wsgi_app [-] logging_context_format_string = %(color)s%(levelname)s %(name)s [%(global_request_id)s %(request_id)s %(project_name)s %(user_name)s%(color)s] %(instance)s%(color)s%(message)s {{(pid=105512) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 13 17:52:55.637638 dv-cinder-852009-8-iscsi devstack@n-api.service[105513]: DEBUG nova.api.openstack.wsgi_app [-] log_rotation_type = none {{(pid=105513) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 13 17:52:55.637790 dv-cinder-852009-8-iscsi devstack@n-api.service[105512]: DEBUG nova.api.openstack.wsgi_app [-] logging_debug_format_suffix = {{(pid=%(process)d) %(funcName)s %(pathname)s:%(lineno)d}} {{(pid=105512) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 13 17:52:55.637973 dv-cinder-852009-8-iscsi devstack@n-api.service[105513]: DEBUG nova.api.openstack.wsgi_app [-] logging_context_format_string = %(color)s%(levelname)s %(name)s [%(global_request_id)s %(request_id)s %(project_name)s %(user_name)s%(color)s] %(instance)s%(color)s%(message)s {{(pid=105513) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 13 17:52:55.638116 dv-cinder-852009-8-iscsi devstack@n-api.service[105512]: DEBUG nova.api.openstack.wsgi_app [-] logging_default_format_string = %(color)s%(levelname)s %(name)s [-%(color)s] %(instance)s%(color)s%(message)s {{(pid=105512) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 13 17:52:55.638224 dv-cinder-852009-8-iscsi devstack@n-api.service[105513]: DEBUG nova.api.openstack.wsgi_app [-] logging_debug_format_suffix = {{(pid=%(process)d) %(funcName)s %(pathname)s:%(lineno)d}} {{(pid=105513) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 13 17:52:55.638339 dv-cinder-852009-8-iscsi devstack@n-api.service[105512]: DEBUG nova.api.openstack.wsgi_app [-] logging_exception_prefix = ERROR %(name)s %(instance)s {{(pid=105512) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 13 17:52:55.638427 dv-cinder-852009-8-iscsi devstack@n-api.service[105513]: DEBUG nova.api.openstack.wsgi_app [-] logging_default_format_string = %(color)s%(levelname)s %(name)s [-%(color)s] %(instance)s%(color)s%(message)s {{(pid=105513) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 13 17:52:55.638656 dv-cinder-852009-8-iscsi devstack@n-api.service[105512]: DEBUG nova.api.openstack.wsgi_app [-] logging_user_identity_format = %(user)s %(project)s %(domain)s %(system_scope)s %(user_domain)s %(project_domain)s {{(pid=105512) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 13 17:52:55.638758 dv-cinder-852009-8-iscsi devstack@n-api.service[105513]: DEBUG nova.api.openstack.wsgi_app [-] logging_exception_prefix = ERROR %(name)s %(instance)s {{(pid=105513) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 13 17:52:55.638963 dv-cinder-852009-8-iscsi devstack@n-api.service[105512]: DEBUG nova.api.openstack.wsgi_app [-] long_rpc_timeout = 1800 {{(pid=105512) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 13 17:52:55.639050 dv-cinder-852009-8-iscsi devstack@n-api.service[105513]: DEBUG nova.api.openstack.wsgi_app [-] logging_user_identity_format = %(user)s %(project)s %(domain)s %(system_scope)s %(user_domain)s %(project_domain)s {{(pid=105513) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 13 17:52:55.639269 dv-cinder-852009-8-iscsi devstack@n-api.service[105512]: DEBUG nova.api.openstack.wsgi_app [-] max_concurrent_builds = 10 {{(pid=105512) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 13 17:52:55.639355 dv-cinder-852009-8-iscsi devstack@n-api.service[105513]: DEBUG nova.api.openstack.wsgi_app [-] long_rpc_timeout = 1800 {{(pid=105513) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 13 17:52:55.639574 dv-cinder-852009-8-iscsi devstack@n-api.service[105512]: DEBUG nova.api.openstack.wsgi_app [-] max_concurrent_live_migrations = 1 {{(pid=105512) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 13 17:52:55.639677 dv-cinder-852009-8-iscsi devstack@n-api.service[105513]: DEBUG nova.api.openstack.wsgi_app [-] max_concurrent_builds = 10 {{(pid=105513) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 13 17:52:55.639877 dv-cinder-852009-8-iscsi devstack@n-api.service[105512]: DEBUG nova.api.openstack.wsgi_app [-] max_concurrent_snapshots = 5 {{(pid=105512) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 13 17:52:55.639973 dv-cinder-852009-8-iscsi devstack@n-api.service[105513]: DEBUG nova.api.openstack.wsgi_app [-] max_concurrent_live_migrations = 1 {{(pid=105513) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 13 17:52:55.640180 dv-cinder-852009-8-iscsi devstack@n-api.service[105512]: DEBUG nova.api.openstack.wsgi_app [-] max_local_block_devices = 3 {{(pid=105512) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 13 17:52:55.640267 dv-cinder-852009-8-iscsi devstack@n-api.service[105513]: DEBUG nova.api.openstack.wsgi_app [-] max_concurrent_snapshots = 5 {{(pid=105513) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 13 17:52:55.640507 dv-cinder-852009-8-iscsi devstack@n-api.service[105513]: DEBUG nova.api.openstack.wsgi_app [-] max_local_block_devices = 3 {{(pid=105513) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 13 17:52:55.640612 dv-cinder-852009-8-iscsi devstack@n-api.service[105512]: DEBUG nova.api.openstack.wsgi_app [-] max_logfile_count = 30 {{(pid=105512) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 13 17:52:55.640813 dv-cinder-852009-8-iscsi devstack@n-api.service[105512]: DEBUG nova.api.openstack.wsgi_app [-] max_logfile_size_mb = 200 {{(pid=105512) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 13 17:52:55.640908 dv-cinder-852009-8-iscsi devstack@n-api.service[105513]: DEBUG nova.api.openstack.wsgi_app [-] max_logfile_count = 30 {{(pid=105513) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 13 17:52:55.641211 dv-cinder-852009-8-iscsi devstack@n-api.service[105512]: DEBUG nova.api.openstack.wsgi_app [-] maximum_instance_delete_attempts = 5 {{(pid=105512) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 13 17:52:55.641313 dv-cinder-852009-8-iscsi devstack@n-api.service[105513]: DEBUG nova.api.openstack.wsgi_app [-] max_logfile_size_mb = 200 {{(pid=105513) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 13 17:52:55.641432 dv-cinder-852009-8-iscsi devstack@n-api.service[105513]: DEBUG nova.api.openstack.wsgi_app [-] maximum_instance_delete_attempts = 5 {{(pid=105513) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 13 17:52:55.641521 dv-cinder-852009-8-iscsi devstack@n-api.service[105512]: DEBUG nova.api.openstack.wsgi_app [-] metadata_listen = 0.0.0.0 {{(pid=105512) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 13 17:52:55.641724 dv-cinder-852009-8-iscsi devstack@n-api.service[105513]: DEBUG nova.api.openstack.wsgi_app [-] metadata_listen = 0.0.0.0 {{(pid=105513) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 13 17:52:55.641827 dv-cinder-852009-8-iscsi devstack@n-api.service[105512]: DEBUG nova.api.openstack.wsgi_app [-] metadata_listen_port = 8775 {{(pid=105512) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 13 17:52:55.642037 dv-cinder-852009-8-iscsi devstack@n-api.service[105512]: DEBUG nova.api.openstack.wsgi_app [-] metadata_workers = 2 {{(pid=105512) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 13 17:52:55.642140 dv-cinder-852009-8-iscsi devstack@n-api.service[105513]: DEBUG nova.api.openstack.wsgi_app [-] metadata_listen_port = 8775 {{(pid=105513) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 13 17:52:55.642341 dv-cinder-852009-8-iscsi devstack@n-api.service[105512]: DEBUG nova.api.openstack.wsgi_app [-] migrate_max_retries = -1 {{(pid=105512) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 13 17:52:55.642428 dv-cinder-852009-8-iscsi devstack@n-api.service[105513]: DEBUG nova.api.openstack.wsgi_app [-] metadata_workers = 2 {{(pid=105513) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 13 17:52:55.642653 dv-cinder-852009-8-iscsi devstack@n-api.service[105513]: DEBUG nova.api.openstack.wsgi_app [-] migrate_max_retries = -1 {{(pid=105513) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 13 17:52:55.642738 dv-cinder-852009-8-iscsi devstack@n-api.service[105512]: DEBUG nova.api.openstack.wsgi_app [-] mkisofs_cmd = genisoimage {{(pid=105512) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 13 17:52:55.642977 dv-cinder-852009-8-iscsi devstack@n-api.service[105513]: DEBUG nova.api.openstack.wsgi_app [-] mkisofs_cmd = genisoimage {{(pid=105513) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 13 17:52:55.643087 dv-cinder-852009-8-iscsi devstack@n-api.service[105512]: DEBUG nova.api.openstack.wsgi_app [-] my_block_storage_ip = 10.222.0.43 {{(pid=105512) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 13 17:52:55.643281 dv-cinder-852009-8-iscsi devstack@n-api.service[105512]: DEBUG nova.api.openstack.wsgi_app [-] my_ip = 10.222.0.43 {{(pid=105512) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 13 17:52:55.643375 dv-cinder-852009-8-iscsi devstack@n-api.service[105513]: DEBUG nova.api.openstack.wsgi_app [-] my_block_storage_ip = 10.222.0.43 {{(pid=105513) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 13 17:52:55.643589 dv-cinder-852009-8-iscsi devstack@n-api.service[105512]: DEBUG nova.api.openstack.wsgi_app [-] network_allocate_retries = 0 {{(pid=105512) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 13 17:52:55.643678 dv-cinder-852009-8-iscsi devstack@n-api.service[105513]: DEBUG nova.api.openstack.wsgi_app [-] my_ip = 10.222.0.43 {{(pid=105513) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 13 17:52:55.643908 dv-cinder-852009-8-iscsi devstack@n-api.service[105513]: DEBUG nova.api.openstack.wsgi_app [-] network_allocate_retries = 0 {{(pid=105513) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 13 17:52:55.644004 dv-cinder-852009-8-iscsi devstack@n-api.service[105512]: DEBUG nova.api.openstack.wsgi_app [-] non_inheritable_image_properties = ['cache_in_nova', 'bittorrent'] {{(pid=105512) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 13 17:52:55.644226 dv-cinder-852009-8-iscsi devstack@n-api.service[105512]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_listen = 0.0.0.0 {{(pid=105512) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 13 17:52:55.644311 dv-cinder-852009-8-iscsi devstack@n-api.service[105513]: DEBUG nova.api.openstack.wsgi_app [-] non_inheritable_image_properties = ['cache_in_nova', 'bittorrent'] {{(pid=105513) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 13 17:52:55.644555 dv-cinder-852009-8-iscsi devstack@n-api.service[105512]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_listen_port = 8774 {{(pid=105512) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 13 17:52:55.644647 dv-cinder-852009-8-iscsi devstack@n-api.service[105513]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_listen = 0.0.0.0 {{(pid=105513) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 13 17:52:55.644872 dv-cinder-852009-8-iscsi devstack@n-api.service[105512]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_unique_server_name_scope = {{(pid=105512) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 13 17:52:55.644973 dv-cinder-852009-8-iscsi devstack@n-api.service[105513]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_listen_port = 8774 {{(pid=105513) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 13 17:52:55.645191 dv-cinder-852009-8-iscsi devstack@n-api.service[105513]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_unique_server_name_scope = {{(pid=105513) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 13 17:52:55.645276 dv-cinder-852009-8-iscsi devstack@n-api.service[105512]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_workers = 2 {{(pid=105512) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 13 17:52:55.645491 dv-cinder-852009-8-iscsi devstack@n-api.service[105512]: DEBUG nova.api.openstack.wsgi_app [-] password_length = 12 {{(pid=105512) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 13 17:52:55.645575 dv-cinder-852009-8-iscsi devstack@n-api.service[105513]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_workers = 2 {{(pid=105513) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 13 17:52:55.645796 dv-cinder-852009-8-iscsi devstack@n-api.service[105512]: DEBUG nova.api.openstack.wsgi_app [-] periodic_enable = True {{(pid=105512) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 13 17:52:55.645888 dv-cinder-852009-8-iscsi devstack@n-api.service[105513]: DEBUG nova.api.openstack.wsgi_app [-] password_length = 12 {{(pid=105513) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 13 17:52:55.646099 dv-cinder-852009-8-iscsi devstack@n-api.service[105512]: DEBUG nova.api.openstack.wsgi_app [-] periodic_fuzzy_delay = 60 {{(pid=105512) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 13 17:52:55.646200 dv-cinder-852009-8-iscsi devstack@n-api.service[105513]: DEBUG nova.api.openstack.wsgi_app [-] periodic_enable = True {{(pid=105513) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 13 17:52:55.646406 dv-cinder-852009-8-iscsi devstack@n-api.service[105513]: DEBUG nova.api.openstack.wsgi_app [-] periodic_fuzzy_delay = 60 {{(pid=105513) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 13 17:52:55.646705 dv-cinder-852009-8-iscsi devstack@n-api.service[105512]: DEBUG nova.api.openstack.wsgi_app [-] pointer_model = usbtablet {{(pid=105512) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 13 17:52:55.646811 dv-cinder-852009-8-iscsi devstack@n-api.service[105512]: DEBUG nova.api.openstack.wsgi_app [-] preallocate_images = none {{(pid=105512) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 13 17:52:55.646893 dv-cinder-852009-8-iscsi devstack@n-api.service[105513]: DEBUG nova.api.openstack.wsgi_app [-] pointer_model = usbtablet {{(pid=105513) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 13 17:52:55.647080 dv-cinder-852009-8-iscsi devstack@n-api.service[105512]: DEBUG nova.api.openstack.wsgi_app [-] publish_errors = False {{(pid=105512) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 13 17:52:55.647167 dv-cinder-852009-8-iscsi devstack@n-api.service[105513]: DEBUG nova.api.openstack.wsgi_app [-] preallocate_images = none {{(pid=105513) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 13 17:52:55.647336 dv-cinder-852009-8-iscsi devstack@n-api.service[105512]: DEBUG nova.api.openstack.wsgi_app [-] pybasedir = /opt/stack/nova {{(pid=105512) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 13 17:52:55.647449 dv-cinder-852009-8-iscsi devstack@n-api.service[105513]: DEBUG nova.api.openstack.wsgi_app [-] publish_errors = False {{(pid=105513) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 13 17:52:55.647637 dv-cinder-852009-8-iscsi devstack@n-api.service[105512]: DEBUG nova.api.openstack.wsgi_app [-] ram_allocation_ratio = None {{(pid=105512) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 13 17:52:55.647726 dv-cinder-852009-8-iscsi devstack@n-api.service[105513]: DEBUG nova.api.openstack.wsgi_app [-] pybasedir = /opt/stack/nova {{(pid=105513) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 13 17:52:55.647946 dv-cinder-852009-8-iscsi devstack@n-api.service[105512]: DEBUG nova.api.openstack.wsgi_app [-] rate_limit_burst = 0 {{(pid=105512) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 13 17:52:55.648064 dv-cinder-852009-8-iscsi devstack@n-api.service[105513]: DEBUG nova.api.openstack.wsgi_app [-] ram_allocation_ratio = None {{(pid=105513) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 13 17:52:55.648257 dv-cinder-852009-8-iscsi devstack@n-api.service[105513]: DEBUG nova.api.openstack.wsgi_app [-] rate_limit_burst = 0 {{(pid=105513) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 13 17:52:55.648355 dv-cinder-852009-8-iscsi devstack@n-api.service[105512]: DEBUG nova.api.openstack.wsgi_app [-] rate_limit_except_level = CRITICAL {{(pid=105512) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 13 17:52:55.648580 dv-cinder-852009-8-iscsi devstack@n-api.service[105512]: DEBUG nova.api.openstack.wsgi_app [-] rate_limit_interval = 0 {{(pid=105512) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 13 17:52:55.648668 dv-cinder-852009-8-iscsi devstack@n-api.service[105513]: DEBUG nova.api.openstack.wsgi_app [-] rate_limit_except_level = CRITICAL {{(pid=105513) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 13 17:52:55.648886 dv-cinder-852009-8-iscsi devstack@n-api.service[105512]: DEBUG nova.api.openstack.wsgi_app [-] reboot_timeout = 0 {{(pid=105512) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 13 17:52:55.648971 dv-cinder-852009-8-iscsi devstack@n-api.service[105513]: DEBUG nova.api.openstack.wsgi_app [-] rate_limit_interval = 0 {{(pid=105513) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 13 17:52:55.649191 dv-cinder-852009-8-iscsi devstack@n-api.service[105512]: DEBUG nova.api.openstack.wsgi_app [-] reclaim_instance_interval = 0 {{(pid=105512) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 13 17:52:55.649276 dv-cinder-852009-8-iscsi devstack@n-api.service[105513]: DEBUG nova.api.openstack.wsgi_app [-] reboot_timeout = 0 {{(pid=105513) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 13 17:52:55.649493 dv-cinder-852009-8-iscsi devstack@n-api.service[105512]: DEBUG nova.api.openstack.wsgi_app [-] record = None {{(pid=105512) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 13 17:52:55.649594 dv-cinder-852009-8-iscsi devstack@n-api.service[105513]: DEBUG nova.api.openstack.wsgi_app [-] reclaim_instance_interval = 0 {{(pid=105513) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 13 17:52:55.649796 dv-cinder-852009-8-iscsi devstack@n-api.service[105513]: DEBUG nova.api.openstack.wsgi_app [-] record = None {{(pid=105513) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 13 17:52:55.649881 dv-cinder-852009-8-iscsi devstack@n-api.service[105512]: DEBUG nova.api.openstack.wsgi_app [-] reimage_timeout_per_gb = 20 {{(pid=105512) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 13 17:52:55.650098 dv-cinder-852009-8-iscsi devstack@n-api.service[105512]: DEBUG nova.api.openstack.wsgi_app [-] report_interval = 10 {{(pid=105512) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 13 17:52:55.650192 dv-cinder-852009-8-iscsi devstack@n-api.service[105513]: DEBUG nova.api.openstack.wsgi_app [-] reimage_timeout_per_gb = 20 {{(pid=105513) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 13 17:52:55.650402 dv-cinder-852009-8-iscsi devstack@n-api.service[105513]: DEBUG nova.api.openstack.wsgi_app [-] report_interval = 10 {{(pid=105513) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 13 17:52:55.650496 dv-cinder-852009-8-iscsi devstack@n-api.service[105512]: DEBUG nova.api.openstack.wsgi_app [-] rescue_timeout = 0 {{(pid=105512) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 13 17:52:55.650703 dv-cinder-852009-8-iscsi devstack@n-api.service[105512]: DEBUG nova.api.openstack.wsgi_app [-] reserved_host_cpus = 0 {{(pid=105512) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 13 17:52:55.650799 dv-cinder-852009-8-iscsi devstack@n-api.service[105513]: DEBUG nova.api.openstack.wsgi_app [-] rescue_timeout = 0 {{(pid=105513) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 13 17:52:55.651006 dv-cinder-852009-8-iscsi devstack@n-api.service[105512]: DEBUG nova.api.openstack.wsgi_app [-] reserved_host_disk_mb = 0 {{(pid=105512) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 13 17:52:55.651174 dv-cinder-852009-8-iscsi devstack@n-api.service[105513]: DEBUG nova.api.openstack.wsgi_app [-] reserved_host_cpus = 0 {{(pid=105513) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 13 17:52:55.651311 dv-cinder-852009-8-iscsi devstack@n-api.service[105512]: DEBUG nova.api.openstack.wsgi_app [-] reserved_host_memory_mb = 512 {{(pid=105512) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 13 17:52:55.651397 dv-cinder-852009-8-iscsi devstack@n-api.service[105513]: DEBUG nova.api.openstack.wsgi_app [-] reserved_host_disk_mb = 0 {{(pid=105513) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 13 17:52:55.651612 dv-cinder-852009-8-iscsi devstack@n-api.service[105512]: DEBUG nova.api.openstack.wsgi_app [-] reserved_huge_pages = None {{(pid=105512) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 13 17:52:55.651709 dv-cinder-852009-8-iscsi devstack@n-api.service[105513]: DEBUG nova.api.openstack.wsgi_app [-] reserved_host_memory_mb = 512 {{(pid=105513) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 13 17:52:55.651914 dv-cinder-852009-8-iscsi devstack@n-api.service[105513]: DEBUG nova.api.openstack.wsgi_app [-] reserved_huge_pages = None {{(pid=105513) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 13 17:52:55.652052 dv-cinder-852009-8-iscsi devstack@n-api.service[105512]: DEBUG nova.api.openstack.wsgi_app [-] resize_confirm_window = 0 {{(pid=105512) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 13 17:52:55.652212 dv-cinder-852009-8-iscsi devstack@n-api.service[105512]: DEBUG nova.api.openstack.wsgi_app [-] resize_fs_using_block_device = False {{(pid=105512) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 13 17:52:55.652298 dv-cinder-852009-8-iscsi devstack@n-api.service[105513]: DEBUG nova.api.openstack.wsgi_app [-] resize_confirm_window = 0 {{(pid=105513) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 13 17:52:55.652539 dv-cinder-852009-8-iscsi devstack@n-api.service[105512]: DEBUG nova.api.openstack.wsgi_app [-] resume_guests_state_on_host_boot = False {{(pid=105512) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 13 17:52:55.652645 dv-cinder-852009-8-iscsi devstack@n-api.service[105513]: DEBUG nova.api.openstack.wsgi_app [-] resize_fs_using_block_device = False {{(pid=105513) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 13 17:52:55.652846 dv-cinder-852009-8-iscsi devstack@n-api.service[105513]: DEBUG nova.api.openstack.wsgi_app [-] resume_guests_state_on_host_boot = False {{(pid=105513) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 13 17:52:55.652945 dv-cinder-852009-8-iscsi devstack@n-api.service[105512]: DEBUG nova.api.openstack.wsgi_app [-] rootwrap_config = /etc/nova/rootwrap.conf {{(pid=105512) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 13 17:52:55.653162 dv-cinder-852009-8-iscsi devstack@n-api.service[105512]: DEBUG nova.api.openstack.wsgi_app [-] running_deleted_instance_action = reap {{(pid=105512) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 13 17:52:55.653247 dv-cinder-852009-8-iscsi devstack@n-api.service[105513]: DEBUG nova.api.openstack.wsgi_app [-] rootwrap_config = /etc/nova/rootwrap.conf {{(pid=105513) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 13 17:52:55.653470 dv-cinder-852009-8-iscsi devstack@n-api.service[105512]: DEBUG nova.api.openstack.wsgi_app [-] running_deleted_instance_poll_interval = 1800 {{(pid=105512) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 13 17:52:55.653558 dv-cinder-852009-8-iscsi devstack@n-api.service[105513]: DEBUG nova.api.openstack.wsgi_app [-] running_deleted_instance_action = reap {{(pid=105513) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 13 17:52:55.653775 dv-cinder-852009-8-iscsi devstack@n-api.service[105513]: DEBUG nova.api.openstack.wsgi_app [-] running_deleted_instance_poll_interval = 1800 {{(pid=105513) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 13 17:52:55.653870 dv-cinder-852009-8-iscsi devstack@n-api.service[105512]: DEBUG nova.api.openstack.wsgi_app [-] running_deleted_instance_timeout = 0 {{(pid=105512) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 13 17:52:55.654080 dv-cinder-852009-8-iscsi devstack@n-api.service[105512]: DEBUG nova.api.openstack.wsgi_app [-] scheduler_instance_sync_interval = 120 {{(pid=105512) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 13 17:52:55.654180 dv-cinder-852009-8-iscsi devstack@n-api.service[105513]: DEBUG nova.api.openstack.wsgi_app [-] running_deleted_instance_timeout = 0 {{(pid=105513) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 13 17:52:55.654385 dv-cinder-852009-8-iscsi devstack@n-api.service[105513]: DEBUG nova.api.openstack.wsgi_app [-] scheduler_instance_sync_interval = 120 {{(pid=105513) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 13 17:52:55.654478 dv-cinder-852009-8-iscsi devstack@n-api.service[105512]: DEBUG nova.api.openstack.wsgi_app [-] service_down_time = 60 {{(pid=105512) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 13 17:52:55.654707 dv-cinder-852009-8-iscsi devstack@n-api.service[105513]: DEBUG nova.api.openstack.wsgi_app [-] service_down_time = 60 {{(pid=105513) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 13 17:52:55.654807 dv-cinder-852009-8-iscsi devstack@n-api.service[105512]: DEBUG nova.api.openstack.wsgi_app [-] servicegroup_driver = db {{(pid=105512) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 13 17:52:55.654992 dv-cinder-852009-8-iscsi devstack@n-api.service[105512]: DEBUG nova.api.openstack.wsgi_app [-] shelved_offload_time = 0 {{(pid=105512) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 13 17:52:55.655089 dv-cinder-852009-8-iscsi devstack@n-api.service[105513]: DEBUG nova.api.openstack.wsgi_app [-] servicegroup_driver = db {{(pid=105513) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 13 17:52:55.655293 dv-cinder-852009-8-iscsi devstack@n-api.service[105512]: DEBUG nova.api.openstack.wsgi_app [-] shelved_poll_interval = 3600 {{(pid=105512) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 13 17:52:55.655379 dv-cinder-852009-8-iscsi devstack@n-api.service[105513]: DEBUG nova.api.openstack.wsgi_app [-] shelved_offload_time = 0 {{(pid=105513) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 13 17:52:55.655600 dv-cinder-852009-8-iscsi devstack@n-api.service[105513]: DEBUG nova.api.openstack.wsgi_app [-] shelved_poll_interval = 3600 {{(pid=105513) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 13 17:52:55.655694 dv-cinder-852009-8-iscsi devstack@n-api.service[105512]: DEBUG nova.api.openstack.wsgi_app [-] shutdown_timeout = 0 {{(pid=105512) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 13 17:52:55.655905 dv-cinder-852009-8-iscsi devstack@n-api.service[105512]: DEBUG nova.api.openstack.wsgi_app [-] source_is_ipv6 = False {{(pid=105512) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 13 17:52:55.655990 dv-cinder-852009-8-iscsi devstack@n-api.service[105513]: DEBUG nova.api.openstack.wsgi_app [-] shutdown_timeout = 0 {{(pid=105513) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 13 17:52:55.656209 dv-cinder-852009-8-iscsi devstack@n-api.service[105512]: DEBUG nova.api.openstack.wsgi_app [-] ssl_only = False {{(pid=105512) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 13 17:52:55.656303 dv-cinder-852009-8-iscsi devstack@n-api.service[105513]: DEBUG nova.api.openstack.wsgi_app [-] source_is_ipv6 = False {{(pid=105513) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 13 17:52:55.656539 dv-cinder-852009-8-iscsi devstack@n-api.service[105513]: DEBUG nova.api.openstack.wsgi_app [-] ssl_only = False {{(pid=105513) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 13 17:52:55.656641 dv-cinder-852009-8-iscsi devstack@n-api.service[105512]: DEBUG nova.api.openstack.wsgi_app [-] state_path = /opt/stack/data/nova {{(pid=105512) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 13 17:52:55.656846 dv-cinder-852009-8-iscsi devstack@n-api.service[105512]: DEBUG nova.api.openstack.wsgi_app [-] sync_power_state_interval = 600 {{(pid=105512) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 13 17:52:55.656931 dv-cinder-852009-8-iscsi devstack@n-api.service[105513]: DEBUG nova.api.openstack.wsgi_app [-] state_path = /opt/stack/data/nova {{(pid=105513) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 13 17:52:55.657152 dv-cinder-852009-8-iscsi devstack@n-api.service[105512]: DEBUG nova.api.openstack.wsgi_app [-] sync_power_state_pool_size = 1000 {{(pid=105512) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 13 17:52:55.657238 dv-cinder-852009-8-iscsi devstack@n-api.service[105513]: DEBUG nova.api.openstack.wsgi_app [-] sync_power_state_interval = 600 {{(pid=105513) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 13 17:52:55.657460 dv-cinder-852009-8-iscsi devstack@n-api.service[105513]: DEBUG nova.api.openstack.wsgi_app [-] sync_power_state_pool_size = 1000 {{(pid=105513) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 13 17:52:55.657547 dv-cinder-852009-8-iscsi devstack@n-api.service[105512]: DEBUG nova.api.openstack.wsgi_app [-] syslog_log_facility = LOG_USER {{(pid=105512) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 13 17:52:55.657759 dv-cinder-852009-8-iscsi devstack@n-api.service[105512]: DEBUG nova.api.openstack.wsgi_app [-] tempdir = None {{(pid=105512) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 13 17:52:55.657890 dv-cinder-852009-8-iscsi devstack@n-api.service[105513]: DEBUG nova.api.openstack.wsgi_app [-] syslog_log_facility = LOG_USER {{(pid=105513) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 13 17:52:55.658065 dv-cinder-852009-8-iscsi devstack@n-api.service[105512]: DEBUG nova.api.openstack.wsgi_app [-] timeout_nbd = 10 {{(pid=105512) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 13 17:52:55.658160 dv-cinder-852009-8-iscsi devstack@n-api.service[105513]: DEBUG nova.api.openstack.wsgi_app [-] tempdir = None {{(pid=105513) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 13 17:52:55.658371 dv-cinder-852009-8-iscsi devstack@n-api.service[105513]: DEBUG nova.api.openstack.wsgi_app [-] timeout_nbd = 10 {{(pid=105513) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 13 17:52:55.658457 dv-cinder-852009-8-iscsi devstack@n-api.service[105512]: DEBUG nova.api.openstack.wsgi_app [-] transport_url = **** {{(pid=105512) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 13 17:52:55.658675 dv-cinder-852009-8-iscsi devstack@n-api.service[105512]: DEBUG nova.api.openstack.wsgi_app [-] update_resources_interval = 0 {{(pid=105512) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 13 17:52:55.658759 dv-cinder-852009-8-iscsi devstack@n-api.service[105513]: DEBUG nova.api.openstack.wsgi_app [-] transport_url = **** {{(pid=105513) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 13 17:52:55.658981 dv-cinder-852009-8-iscsi devstack@n-api.service[105512]: DEBUG nova.api.openstack.wsgi_app [-] use_cow_images = True {{(pid=105512) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 13 17:52:55.659067 dv-cinder-852009-8-iscsi devstack@n-api.service[105513]: DEBUG nova.api.openstack.wsgi_app [-] update_resources_interval = 0 {{(pid=105513) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 13 17:52:55.659285 dv-cinder-852009-8-iscsi devstack@n-api.service[105513]: DEBUG nova.api.openstack.wsgi_app [-] use_cow_images = True {{(pid=105513) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 13 17:52:55.659379 dv-cinder-852009-8-iscsi devstack@n-api.service[105512]: DEBUG nova.api.openstack.wsgi_app [-] use_eventlog = False {{(pid=105512) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 13 17:52:55.659586 dv-cinder-852009-8-iscsi devstack@n-api.service[105512]: DEBUG nova.api.openstack.wsgi_app [-] use_journal = False {{(pid=105512) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 13 17:52:55.659674 dv-cinder-852009-8-iscsi devstack@n-api.service[105513]: DEBUG nova.api.openstack.wsgi_app [-] use_eventlog = False {{(pid=105513) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 13 17:52:55.659889 dv-cinder-852009-8-iscsi devstack@n-api.service[105513]: DEBUG nova.api.openstack.wsgi_app [-] use_journal = False {{(pid=105513) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 13 17:52:55.659976 dv-cinder-852009-8-iscsi devstack@n-api.service[105512]: DEBUG nova.api.openstack.wsgi_app [-] use_json = False {{(pid=105512) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 13 17:52:55.660191 dv-cinder-852009-8-iscsi devstack@n-api.service[105512]: DEBUG nova.api.openstack.wsgi_app [-] use_rootwrap_daemon = False {{(pid=105512) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 13 17:52:55.660285 dv-cinder-852009-8-iscsi devstack@n-api.service[105513]: DEBUG nova.api.openstack.wsgi_app [-] use_json = False {{(pid=105513) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 13 17:52:55.660517 dv-cinder-852009-8-iscsi devstack@n-api.service[105512]: DEBUG nova.api.openstack.wsgi_app [-] use_stderr = False {{(pid=105512) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 13 17:52:55.660609 dv-cinder-852009-8-iscsi devstack@n-api.service[105513]: DEBUG nova.api.openstack.wsgi_app [-] use_rootwrap_daemon = False {{(pid=105513) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 13 17:52:55.660823 dv-cinder-852009-8-iscsi devstack@n-api.service[105512]: DEBUG nova.api.openstack.wsgi_app [-] use_syslog = False {{(pid=105512) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 13 17:52:55.660925 dv-cinder-852009-8-iscsi devstack@n-api.service[105513]: DEBUG nova.api.openstack.wsgi_app [-] use_stderr = False {{(pid=105513) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 13 17:52:55.661123 dv-cinder-852009-8-iscsi devstack@n-api.service[105512]: DEBUG nova.api.openstack.wsgi_app [-] vcpu_pin_set = None {{(pid=105512) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 13 17:52:55.661209 dv-cinder-852009-8-iscsi devstack@n-api.service[105513]: DEBUG nova.api.openstack.wsgi_app [-] use_syslog = False {{(pid=105513) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 13 17:52:55.661422 dv-cinder-852009-8-iscsi devstack@n-api.service[105513]: DEBUG nova.api.openstack.wsgi_app [-] vcpu_pin_set = None {{(pid=105513) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 13 17:52:55.661507 dv-cinder-852009-8-iscsi devstack@n-api.service[105512]: DEBUG nova.api.openstack.wsgi_app [-] vif_plugging_is_fatal = True {{(pid=105512) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 13 17:52:55.661742 dv-cinder-852009-8-iscsi devstack@n-api.service[105512]: DEBUG nova.api.openstack.wsgi_app [-] vif_plugging_timeout = 300 {{(pid=105512) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 13 17:52:55.661835 dv-cinder-852009-8-iscsi devstack@n-api.service[105513]: DEBUG nova.api.openstack.wsgi_app [-] vif_plugging_is_fatal = True {{(pid=105513) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 13 17:52:55.662054 dv-cinder-852009-8-iscsi devstack@n-api.service[105512]: DEBUG nova.api.openstack.wsgi_app [-] virt_mkfs = [] {{(pid=105512) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 13 17:52:55.662364 dv-cinder-852009-8-iscsi devstack@n-api.service[105513]: DEBUG nova.api.openstack.wsgi_app [-] vif_plugging_timeout = 300 {{(pid=105513) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 13 17:52:55.662451 dv-cinder-852009-8-iscsi devstack@n-api.service[105512]: DEBUG nova.api.openstack.wsgi_app [-] volume_usage_poll_interval = 0 {{(pid=105512) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 13 17:52:55.662530 dv-cinder-852009-8-iscsi devstack@n-api.service[105513]: DEBUG nova.api.openstack.wsgi_app [-] virt_mkfs = [] {{(pid=105513) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 13 17:52:55.662683 dv-cinder-852009-8-iscsi devstack@n-api.service[105512]: DEBUG nova.api.openstack.wsgi_app [-] watch_log_file = False {{(pid=105512) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 13 17:52:55.662785 dv-cinder-852009-8-iscsi devstack@n-api.service[105513]: DEBUG nova.api.openstack.wsgi_app [-] volume_usage_poll_interval = 0 {{(pid=105513) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 13 17:52:55.662986 dv-cinder-852009-8-iscsi devstack@n-api.service[105513]: DEBUG nova.api.openstack.wsgi_app [-] watch_log_file = False {{(pid=105513) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 13 17:52:55.663073 dv-cinder-852009-8-iscsi devstack@n-api.service[105512]: DEBUG nova.api.openstack.wsgi_app [-] web = /usr/share/spice-html5 {{(pid=105512) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 13 17:52:55.663307 dv-cinder-852009-8-iscsi devstack@n-api.service[105513]: DEBUG nova.api.openstack.wsgi_app [-] web = /usr/share/spice-html5 {{(pid=105513) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 13 17:52:55.663392 dv-cinder-852009-8-iscsi devstack@n-api.service[105512]: DEBUG nova.api.openstack.wsgi_app [-] oslo_concurrency.disable_process_locking = False {{(pid=105512) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 17:52:55.663649 dv-cinder-852009-8-iscsi devstack@n-api.service[105512]: DEBUG nova.api.openstack.wsgi_app [-] oslo_concurrency.lock_path = /opt/stack/data/nova {{(pid=105512) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 17:52:55.663744 dv-cinder-852009-8-iscsi devstack@n-api.service[105513]: DEBUG nova.api.openstack.wsgi_app [-] oslo_concurrency.disable_process_locking = False {{(pid=105513) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 17:52:55.663982 dv-cinder-852009-8-iscsi devstack@n-api.service[105513]: DEBUG nova.api.openstack.wsgi_app [-] oslo_concurrency.lock_path = /opt/stack/data/nova {{(pid=105513) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 17:52:55.664066 dv-cinder-852009-8-iscsi devstack@n-api.service[105512]: DEBUG nova.api.openstack.wsgi_app [-] api.auth_strategy = keystone {{(pid=105512) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 17:52:55.664294 dv-cinder-852009-8-iscsi devstack@n-api.service[105512]: DEBUG nova.api.openstack.wsgi_app [-] api.compute_link_prefix = None {{(pid=105512) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 17:52:55.664379 dv-cinder-852009-8-iscsi devstack@n-api.service[105513]: DEBUG nova.api.openstack.wsgi_app [-] api.auth_strategy = keystone {{(pid=105513) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 17:52:55.664661 dv-cinder-852009-8-iscsi devstack@n-api.service[105513]: DEBUG nova.api.openstack.wsgi_app [-] api.compute_link_prefix = None {{(pid=105513) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 17:52:55.664751 dv-cinder-852009-8-iscsi devstack@n-api.service[105512]: DEBUG nova.api.openstack.wsgi_app [-] api.config_drive_skip_versions = 1.0 2007-01-19 2007-03-01 2007-08-29 2007-10-10 2007-12-15 2008-02-01 2008-09-01 {{(pid=105512) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 17:52:55.664992 dv-cinder-852009-8-iscsi devstack@n-api.service[105512]: DEBUG nova.api.openstack.wsgi_app [-] api.dhcp_domain = novalocal {{(pid=105512) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 17:52:55.665077 dv-cinder-852009-8-iscsi devstack@n-api.service[105513]: DEBUG nova.api.openstack.wsgi_app [-] api.config_drive_skip_versions = 1.0 2007-01-19 2007-03-01 2007-08-29 2007-10-10 2007-12-15 2008-02-01 2008-09-01 {{(pid=105513) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 17:52:55.665312 dv-cinder-852009-8-iscsi devstack@n-api.service[105512]: DEBUG nova.api.openstack.wsgi_app [-] api.enable_instance_password = True {{(pid=105512) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 17:52:55.665398 dv-cinder-852009-8-iscsi devstack@n-api.service[105513]: DEBUG nova.api.openstack.wsgi_app [-] api.dhcp_domain = novalocal {{(pid=105513) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 17:52:55.665626 dv-cinder-852009-8-iscsi devstack@n-api.service[105512]: DEBUG nova.api.openstack.wsgi_app [-] api.glance_link_prefix = None {{(pid=105512) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 17:52:55.665720 dv-cinder-852009-8-iscsi devstack@n-api.service[105513]: DEBUG nova.api.openstack.wsgi_app [-] api.enable_instance_password = True {{(pid=105513) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 17:52:55.665939 dv-cinder-852009-8-iscsi devstack@n-api.service[105513]: DEBUG nova.api.openstack.wsgi_app [-] api.glance_link_prefix = None {{(pid=105513) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 17:52:55.666025 dv-cinder-852009-8-iscsi devstack@n-api.service[105512]: DEBUG nova.api.openstack.wsgi_app [-] api.instance_list_cells_batch_fixed_size = 100 {{(pid=105512) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 17:52:55.666258 dv-cinder-852009-8-iscsi devstack@n-api.service[105513]: DEBUG nova.api.openstack.wsgi_app [-] api.instance_list_cells_batch_fixed_size = 100 {{(pid=105513) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 17:52:55.666344 dv-cinder-852009-8-iscsi devstack@n-api.service[105512]: DEBUG nova.api.openstack.wsgi_app [-] api.instance_list_cells_batch_strategy = distributed {{(pid=105512) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 17:52:55.666567 dv-cinder-852009-8-iscsi devstack@n-api.service[105512]: DEBUG nova.api.openstack.wsgi_app [-] api.instance_list_per_project_cells = False {{(pid=105512) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 17:52:55.666652 dv-cinder-852009-8-iscsi devstack@n-api.service[105513]: DEBUG nova.api.openstack.wsgi_app [-] api.instance_list_cells_batch_strategy = distributed {{(pid=105513) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 17:52:55.666877 dv-cinder-852009-8-iscsi devstack@n-api.service[105512]: DEBUG nova.api.openstack.wsgi_app [-] api.list_records_by_skipping_down_cells = True {{(pid=105512) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 17:52:55.666962 dv-cinder-852009-8-iscsi devstack@n-api.service[105513]: DEBUG nova.api.openstack.wsgi_app [-] api.instance_list_per_project_cells = False {{(pid=105513) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 17:52:55.667187 dv-cinder-852009-8-iscsi devstack@n-api.service[105513]: DEBUG nova.api.openstack.wsgi_app [-] api.list_records_by_skipping_down_cells = True {{(pid=105513) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 17:52:55.667280 dv-cinder-852009-8-iscsi devstack@n-api.service[105512]: DEBUG nova.api.openstack.wsgi_app [-] api.local_metadata_per_cell = False {{(pid=105512) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 17:52:55.667501 dv-cinder-852009-8-iscsi devstack@n-api.service[105512]: DEBUG nova.api.openstack.wsgi_app [-] api.max_limit = 1000 {{(pid=105512) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 17:52:55.667586 dv-cinder-852009-8-iscsi devstack@n-api.service[105513]: DEBUG nova.api.openstack.wsgi_app [-] api.local_metadata_per_cell = False {{(pid=105513) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 17:52:55.667819 dv-cinder-852009-8-iscsi devstack@n-api.service[105513]: DEBUG nova.api.openstack.wsgi_app [-] api.max_limit = 1000 {{(pid=105513) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 17:52:55.667919 dv-cinder-852009-8-iscsi devstack@n-api.service[105512]: DEBUG nova.api.openstack.wsgi_app [-] api.metadata_cache_expiration = 15 {{(pid=105512) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 17:52:55.668144 dv-cinder-852009-8-iscsi devstack@n-api.service[105513]: DEBUG nova.api.openstack.wsgi_app [-] api.metadata_cache_expiration = 15 {{(pid=105513) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 17:52:55.668230 dv-cinder-852009-8-iscsi devstack@n-api.service[105512]: DEBUG nova.api.openstack.wsgi_app [-] api.neutron_default_tenant_id = default {{(pid=105512) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 17:52:55.668508 dv-cinder-852009-8-iscsi devstack@n-api.service[105512]: DEBUG nova.api.openstack.wsgi_app [-] api.use_forwarded_for = False {{(pid=105512) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 17:52:55.668612 dv-cinder-852009-8-iscsi devstack@n-api.service[105513]: DEBUG nova.api.openstack.wsgi_app [-] api.neutron_default_tenant_id = default {{(pid=105513) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 17:52:55.668801 dv-cinder-852009-8-iscsi devstack@n-api.service[105512]: DEBUG nova.api.openstack.wsgi_app [-] api.use_neutron_default_nets = False {{(pid=105512) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 17:52:55.668889 dv-cinder-852009-8-iscsi devstack@n-api.service[105513]: DEBUG nova.api.openstack.wsgi_app [-] api.use_forwarded_for = False {{(pid=105513) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 17:52:55.669122 dv-cinder-852009-8-iscsi devstack@n-api.service[105512]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_connect_timeout = 5 {{(pid=105512) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 17:52:55.669279 dv-cinder-852009-8-iscsi devstack@n-api.service[105513]: DEBUG nova.api.openstack.wsgi_app [-] api.use_neutron_default_nets = False {{(pid=105513) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 17:52:55.669437 dv-cinder-852009-8-iscsi devstack@n-api.service[105512]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_failure_fatal = False {{(pid=105512) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 17:52:55.669527 dv-cinder-852009-8-iscsi devstack@n-api.service[105513]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_connect_timeout = 5 {{(pid=105513) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 17:52:55.669751 dv-cinder-852009-8-iscsi devstack@n-api.service[105513]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_failure_fatal = False {{(pid=105513) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 17:52:55.669850 dv-cinder-852009-8-iscsi devstack@n-api.service[105512]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_read_timeout = 5 {{(pid=105512) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 17:52:55.670075 dv-cinder-852009-8-iscsi devstack@n-api.service[105513]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_read_timeout = 5 {{(pid=105513) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 17:52:55.670172 dv-cinder-852009-8-iscsi devstack@n-api.service[105512]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_ssl_certfile = {{(pid=105512) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 17:52:55.670395 dv-cinder-852009-8-iscsi devstack@n-api.service[105512]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_targets = [] {{(pid=105512) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 17:52:55.670495 dv-cinder-852009-8-iscsi devstack@n-api.service[105513]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_ssl_certfile = {{(pid=105513) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 17:52:55.670710 dv-cinder-852009-8-iscsi devstack@n-api.service[105512]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_jsonfile_path = None {{(pid=105512) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 17:52:55.670799 dv-cinder-852009-8-iscsi devstack@n-api.service[105513]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_targets = [] {{(pid=105513) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 17:52:55.671021 dv-cinder-852009-8-iscsi devstack@n-api.service[105513]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_jsonfile_path = None {{(pid=105513) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 17:52:55.671123 dv-cinder-852009-8-iscsi devstack@n-api.service[105512]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_providers = ['StaticJSON'] {{(pid=105512) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 17:52:55.671369 dv-cinder-852009-8-iscsi devstack@n-api.service[105513]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_providers = ['StaticJSON'] {{(pid=105513) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 17:52:55.671458 dv-cinder-852009-8-iscsi devstack@n-api.service[105512]: DEBUG nova.api.openstack.wsgi_app [-] cache.backend = dogpile.cache.memcached {{(pid=105512) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 17:52:55.671696 dv-cinder-852009-8-iscsi devstack@n-api.service[105512]: DEBUG nova.api.openstack.wsgi_app [-] cache.backend_argument = **** {{(pid=105512) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 17:52:55.671802 dv-cinder-852009-8-iscsi devstack@n-api.service[105513]: DEBUG nova.api.openstack.wsgi_app [-] cache.backend = dogpile.cache.memcached {{(pid=105513) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 17:52:55.672017 dv-cinder-852009-8-iscsi devstack@n-api.service[105512]: DEBUG nova.api.openstack.wsgi_app [-] cache.config_prefix = cache.oslo {{(pid=105512) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 17:52:55.672201 dv-cinder-852009-8-iscsi devstack@n-api.service[105513]: DEBUG nova.api.openstack.wsgi_app [-] cache.backend_argument = **** {{(pid=105513) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 17:52:55.672341 dv-cinder-852009-8-iscsi devstack@n-api.service[105513]: DEBUG nova.api.openstack.wsgi_app [-] cache.config_prefix = cache.oslo {{(pid=105513) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 17:52:55.672450 dv-cinder-852009-8-iscsi devstack@n-api.service[105512]: DEBUG nova.api.openstack.wsgi_app [-] cache.dead_timeout = 60.0 {{(pid=105512) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 17:52:55.672679 dv-cinder-852009-8-iscsi devstack@n-api.service[105512]: DEBUG nova.api.openstack.wsgi_app [-] cache.debug_cache_backend = False {{(pid=105512) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 17:52:55.672767 dv-cinder-852009-8-iscsi devstack@n-api.service[105513]: DEBUG nova.api.openstack.wsgi_app [-] cache.dead_timeout = 60.0 {{(pid=105513) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 17:52:55.672991 dv-cinder-852009-8-iscsi devstack@n-api.service[105512]: DEBUG nova.api.openstack.wsgi_app [-] cache.enable_retry_client = False {{(pid=105512) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 17:52:55.673088 dv-cinder-852009-8-iscsi devstack@n-api.service[105513]: DEBUG nova.api.openstack.wsgi_app [-] cache.debug_cache_backend = False {{(pid=105513) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 17:52:55.673302 dv-cinder-852009-8-iscsi devstack@n-api.service[105512]: DEBUG nova.api.openstack.wsgi_app [-] cache.enable_socket_keepalive = False {{(pid=105512) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 17:52:55.673431 dv-cinder-852009-8-iscsi devstack@n-api.service[105513]: DEBUG nova.api.openstack.wsgi_app [-] cache.enable_retry_client = False {{(pid=105513) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 17:52:55.673614 dv-cinder-852009-8-iscsi devstack@n-api.service[105513]: DEBUG nova.api.openstack.wsgi_app [-] cache.enable_socket_keepalive = False {{(pid=105513) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 17:52:55.673702 dv-cinder-852009-8-iscsi devstack@n-api.service[105512]: DEBUG nova.api.openstack.wsgi_app [-] cache.enabled = True {{(pid=105512) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 17:52:55.673957 dv-cinder-852009-8-iscsi devstack@n-api.service[105512]: DEBUG nova.api.openstack.wsgi_app [-] cache.expiration_time = 600 {{(pid=105512) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 17:52:55.674045 dv-cinder-852009-8-iscsi devstack@n-api.service[105513]: DEBUG nova.api.openstack.wsgi_app [-] cache.enabled = True {{(pid=105513) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 17:52:55.674269 dv-cinder-852009-8-iscsi devstack@n-api.service[105513]: DEBUG nova.api.openstack.wsgi_app [-] cache.expiration_time = 600 {{(pid=105513) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 17:52:55.674364 dv-cinder-852009-8-iscsi devstack@n-api.service[105512]: DEBUG nova.api.openstack.wsgi_app [-] cache.hashclient_retry_attempts = 2 {{(pid=105512) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 17:52:55.674582 dv-cinder-852009-8-iscsi devstack@n-api.service[105512]: DEBUG nova.api.openstack.wsgi_app [-] cache.hashclient_retry_delay = 1.0 {{(pid=105512) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 17:52:55.674676 dv-cinder-852009-8-iscsi devstack@n-api.service[105513]: DEBUG nova.api.openstack.wsgi_app [-] cache.hashclient_retry_attempts = 2 {{(pid=105513) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 17:52:55.674896 dv-cinder-852009-8-iscsi devstack@n-api.service[105512]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_dead_retry = 300 {{(pid=105512) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 17:52:55.674985 dv-cinder-852009-8-iscsi devstack@n-api.service[105513]: DEBUG nova.api.openstack.wsgi_app [-] cache.hashclient_retry_delay = 1.0 {{(pid=105513) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 17:52:55.675209 dv-cinder-852009-8-iscsi devstack@n-api.service[105513]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_dead_retry = 300 {{(pid=105513) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 17:52:55.675297 dv-cinder-852009-8-iscsi devstack@n-api.service[105512]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_password = {{(pid=105512) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 17:52:55.675520 dv-cinder-852009-8-iscsi devstack@n-api.service[105512]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_connection_get_timeout = 10 {{(pid=105512) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 17:52:55.675607 dv-cinder-852009-8-iscsi devstack@n-api.service[105513]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_password = {{(pid=105513) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 17:52:55.675834 dv-cinder-852009-8-iscsi devstack@n-api.service[105512]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_flush_on_reconnect = False {{(pid=105512) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 17:52:55.675923 dv-cinder-852009-8-iscsi devstack@n-api.service[105513]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_connection_get_timeout = 10 {{(pid=105513) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 17:52:55.676147 dv-cinder-852009-8-iscsi devstack@n-api.service[105513]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_flush_on_reconnect = False {{(pid=105513) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 17:52:55.676276 dv-cinder-852009-8-iscsi devstack@n-api.service[105512]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_maxsize = 10 {{(pid=105512) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 17:52:55.676538 dv-cinder-852009-8-iscsi devstack@n-api.service[105512]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_unused_timeout = 60 {{(pid=105512) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 17:52:55.676637 dv-cinder-852009-8-iscsi devstack@n-api.service[105513]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_maxsize = 10 {{(pid=105513) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 17:52:55.676786 dv-cinder-852009-8-iscsi devstack@n-api.service[105512]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_sasl_enabled = False {{(pid=105512) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 17:52:55.676884 dv-cinder-852009-8-iscsi devstack@n-api.service[105513]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_unused_timeout = 60 {{(pid=105513) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 17:52:55.677100 dv-cinder-852009-8-iscsi devstack@n-api.service[105513]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_sasl_enabled = False {{(pid=105513) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 17:52:55.677187 dv-cinder-852009-8-iscsi devstack@n-api.service[105512]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_servers = ['localhost:11211'] {{(pid=105512) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 17:52:55.677443 dv-cinder-852009-8-iscsi devstack@n-api.service[105512]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_socket_timeout = 1.0 {{(pid=105512) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 17:52:55.677566 dv-cinder-852009-8-iscsi devstack@n-api.service[105513]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_servers = ['localhost:11211'] {{(pid=105513) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 17:52:55.677848 dv-cinder-852009-8-iscsi devstack@n-api.service[105513]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_socket_timeout = 1.0 {{(pid=105513) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 17:52:55.677980 dv-cinder-852009-8-iscsi devstack@n-api.service[105512]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_username = {{(pid=105512) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 17:52:55.678179 dv-cinder-852009-8-iscsi devstack@n-api.service[105512]: DEBUG nova.api.openstack.wsgi_app [-] cache.proxies = [] {{(pid=105512) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 17:52:55.678306 dv-cinder-852009-8-iscsi devstack@n-api.service[105513]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_username = {{(pid=105513) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 17:52:55.678516 dv-cinder-852009-8-iscsi devstack@n-api.service[105513]: DEBUG nova.api.openstack.wsgi_app [-] cache.proxies = [] {{(pid=105513) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 17:52:55.678769 dv-cinder-852009-8-iscsi devstack@n-api.service[105512]: DEBUG nova.api.openstack.wsgi_app [-] cache.retry_attempts = 2 {{(pid=105512) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 17:52:55.678855 dv-cinder-852009-8-iscsi devstack@n-api.service[105513]: DEBUG nova.api.openstack.wsgi_app [-] cache.retry_attempts = 2 {{(pid=105513) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 17:52:55.679096 dv-cinder-852009-8-iscsi devstack@n-api.service[105512]: DEBUG nova.api.openstack.wsgi_app [-] cache.retry_delay = 0.0 {{(pid=105512) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 17:52:55.679182 dv-cinder-852009-8-iscsi devstack@n-api.service[105513]: DEBUG nova.api.openstack.wsgi_app [-] cache.retry_delay = 0.0 {{(pid=105513) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 17:52:55.679416 dv-cinder-852009-8-iscsi devstack@n-api.service[105512]: DEBUG nova.api.openstack.wsgi_app [-] cache.socket_keepalive_count = 1 {{(pid=105512) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 17:52:55.679494 dv-cinder-852009-8-iscsi devstack@n-api.service[105513]: DEBUG nova.api.openstack.wsgi_app [-] cache.socket_keepalive_count = 1 {{(pid=105513) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 17:52:55.679733 dv-cinder-852009-8-iscsi devstack@n-api.service[105512]: DEBUG nova.api.openstack.wsgi_app [-] cache.socket_keepalive_idle = 1 {{(pid=105512) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 17:52:55.679812 dv-cinder-852009-8-iscsi devstack@n-api.service[105513]: DEBUG nova.api.openstack.wsgi_app [-] cache.socket_keepalive_idle = 1 {{(pid=105513) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 17:52:55.680050 dv-cinder-852009-8-iscsi devstack@n-api.service[105513]: DEBUG nova.api.openstack.wsgi_app [-] cache.socket_keepalive_interval = 1 {{(pid=105513) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 17:52:55.680136 dv-cinder-852009-8-iscsi devstack@n-api.service[105512]: DEBUG nova.api.openstack.wsgi_app [-] cache.socket_keepalive_interval = 1 {{(pid=105512) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 17:52:55.680357 dv-cinder-852009-8-iscsi devstack@n-api.service[105512]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_allowed_ciphers = None {{(pid=105512) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 17:52:55.680473 dv-cinder-852009-8-iscsi devstack@n-api.service[105513]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_allowed_ciphers = None {{(pid=105513) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 17:52:55.680700 dv-cinder-852009-8-iscsi devstack@n-api.service[105513]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_cafile = None {{(pid=105513) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 17:52:55.680792 dv-cinder-852009-8-iscsi devstack@n-api.service[105512]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_cafile = None {{(pid=105512) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 17:52:55.681007 dv-cinder-852009-8-iscsi devstack@n-api.service[105512]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_certfile = None {{(pid=105512) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 17:52:55.681083 dv-cinder-852009-8-iscsi devstack@n-api.service[105513]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_certfile = None {{(pid=105513) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 17:52:55.683556 dv-cinder-852009-8-iscsi devstack@n-api.service[105512]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_enabled = False {{(pid=105512) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 17:52:55.683764 dv-cinder-852009-8-iscsi devstack@n-api.service[105513]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_enabled = False {{(pid=105513) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 17:52:55.683764 dv-cinder-852009-8-iscsi devstack@n-api.service[105513]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_keyfile = None {{(pid=105513) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 17:52:55.683944 dv-cinder-852009-8-iscsi devstack@n-api.service[105512]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_keyfile = None {{(pid=105512) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 17:52:55.683944 dv-cinder-852009-8-iscsi devstack@n-api.service[105512]: DEBUG nova.api.openstack.wsgi_app [-] cinder.auth_section = None {{(pid=105512) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 17:52:55.684075 dv-cinder-852009-8-iscsi devstack@n-api.service[105513]: DEBUG nova.api.openstack.wsgi_app [-] cinder.auth_section = None {{(pid=105513) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 17:52:55.684156 dv-cinder-852009-8-iscsi devstack@n-api.service[105512]: DEBUG nova.api.openstack.wsgi_app [-] cinder.auth_type = password {{(pid=105512) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 17:52:55.684250 dv-cinder-852009-8-iscsi devstack@n-api.service[105513]: DEBUG nova.api.openstack.wsgi_app [-] cinder.auth_type = password {{(pid=105513) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 17:52:55.684332 dv-cinder-852009-8-iscsi devstack@n-api.service[105512]: DEBUG nova.api.openstack.wsgi_app [-] cinder.cafile = None {{(pid=105512) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 17:52:55.684470 dv-cinder-852009-8-iscsi devstack@n-api.service[105513]: DEBUG nova.api.openstack.wsgi_app [-] cinder.cafile = None {{(pid=105513) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 17:52:55.684570 dv-cinder-852009-8-iscsi devstack@n-api.service[105512]: DEBUG nova.api.openstack.wsgi_app [-] cinder.catalog_info = volumev3::publicURL {{(pid=105512) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 17:52:55.684654 dv-cinder-852009-8-iscsi devstack@n-api.service[105513]: DEBUG nova.api.openstack.wsgi_app [-] cinder.catalog_info = volumev3::publicURL {{(pid=105513) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 17:52:55.684722 dv-cinder-852009-8-iscsi devstack@n-api.service[105512]: DEBUG nova.api.openstack.wsgi_app [-] cinder.certfile = None {{(pid=105512) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 17:52:55.684797 dv-cinder-852009-8-iscsi devstack@n-api.service[105513]: DEBUG nova.api.openstack.wsgi_app [-] cinder.certfile = None {{(pid=105513) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 17:52:55.684879 dv-cinder-852009-8-iscsi devstack@n-api.service[105512]: DEBUG nova.api.openstack.wsgi_app [-] cinder.collect_timing = False {{(pid=105512) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 17:52:55.684958 dv-cinder-852009-8-iscsi devstack@n-api.service[105513]: DEBUG nova.api.openstack.wsgi_app [-] cinder.collect_timing = False {{(pid=105513) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 17:52:55.684958 dv-cinder-852009-8-iscsi devstack@n-api.service[105513]: DEBUG nova.api.openstack.wsgi_app [-] cinder.cross_az_attach = True {{(pid=105513) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 17:52:55.685126 dv-cinder-852009-8-iscsi devstack@n-api.service[105512]: DEBUG nova.api.openstack.wsgi_app [-] cinder.cross_az_attach = True {{(pid=105512) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 17:52:55.685207 dv-cinder-852009-8-iscsi devstack@n-api.service[105513]: DEBUG nova.api.openstack.wsgi_app [-] cinder.debug = False {{(pid=105513) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 17:52:55.685295 dv-cinder-852009-8-iscsi devstack@n-api.service[105512]: DEBUG nova.api.openstack.wsgi_app [-] cinder.debug = False {{(pid=105512) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 17:52:55.685295 dv-cinder-852009-8-iscsi devstack@n-api.service[105512]: DEBUG nova.api.openstack.wsgi_app [-] cinder.endpoint_template = None {{(pid=105512) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 17:52:55.685450 dv-cinder-852009-8-iscsi devstack@n-api.service[105513]: DEBUG nova.api.openstack.wsgi_app [-] cinder.endpoint_template = None {{(pid=105513) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 17:52:55.685531 dv-cinder-852009-8-iscsi devstack@n-api.service[105512]: DEBUG nova.api.openstack.wsgi_app [-] cinder.http_retries = 3 {{(pid=105512) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 17:52:55.685609 dv-cinder-852009-8-iscsi devstack@n-api.service[105513]: DEBUG nova.api.openstack.wsgi_app [-] cinder.http_retries = 3 {{(pid=105513) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 17:52:55.685687 dv-cinder-852009-8-iscsi devstack@n-api.service[105512]: DEBUG nova.api.openstack.wsgi_app [-] cinder.insecure = False {{(pid=105512) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 17:52:55.685779 dv-cinder-852009-8-iscsi devstack@n-api.service[105513]: DEBUG nova.api.openstack.wsgi_app [-] cinder.insecure = False {{(pid=105513) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 17:52:55.685868 dv-cinder-852009-8-iscsi devstack@n-api.service[105512]: DEBUG nova.api.openstack.wsgi_app [-] cinder.keyfile = None {{(pid=105512) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 17:52:55.685950 dv-cinder-852009-8-iscsi devstack@n-api.service[105513]: DEBUG nova.api.openstack.wsgi_app [-] cinder.keyfile = None {{(pid=105513) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 17:52:55.686036 dv-cinder-852009-8-iscsi devstack@n-api.service[105512]: DEBUG nova.api.openstack.wsgi_app [-] cinder.os_region_name = RegionOne {{(pid=105512) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 17:52:55.686117 dv-cinder-852009-8-iscsi devstack@n-api.service[105513]: DEBUG nova.api.openstack.wsgi_app [-] cinder.os_region_name = RegionOne {{(pid=105513) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 17:52:55.686205 dv-cinder-852009-8-iscsi devstack@n-api.service[105512]: DEBUG nova.api.openstack.wsgi_app [-] cinder.split_loggers = False {{(pid=105512) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 17:52:55.686286 dv-cinder-852009-8-iscsi devstack@n-api.service[105513]: DEBUG nova.api.openstack.wsgi_app [-] cinder.split_loggers = False {{(pid=105513) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 17:52:55.686372 dv-cinder-852009-8-iscsi devstack@n-api.service[105512]: DEBUG nova.api.openstack.wsgi_app [-] cinder.timeout = None {{(pid=105512) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 17:52:55.686466 dv-cinder-852009-8-iscsi devstack@n-api.service[105513]: DEBUG nova.api.openstack.wsgi_app [-] cinder.timeout = None {{(pid=105513) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 17:52:55.686597 dv-cinder-852009-8-iscsi devstack@n-api.service[105512]: DEBUG nova.api.openstack.wsgi_app [-] compute.consecutive_build_service_disable_threshold = 10 {{(pid=105512) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 17:52:55.686729 dv-cinder-852009-8-iscsi devstack@n-api.service[105513]: DEBUG nova.api.openstack.wsgi_app [-] compute.consecutive_build_service_disable_threshold = 10 {{(pid=105513) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 17:52:55.686835 dv-cinder-852009-8-iscsi devstack@n-api.service[105512]: DEBUG nova.api.openstack.wsgi_app [-] compute.cpu_dedicated_set = None {{(pid=105512) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 17:52:55.686918 dv-cinder-852009-8-iscsi devstack@n-api.service[105513]: DEBUG nova.api.openstack.wsgi_app [-] compute.cpu_dedicated_set = None {{(pid=105513) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 17:52:55.687142 dv-cinder-852009-8-iscsi devstack@n-api.service[105512]: DEBUG nova.api.openstack.wsgi_app [-] compute.cpu_shared_set = None {{(pid=105512) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 17:52:55.687299 dv-cinder-852009-8-iscsi devstack@n-api.service[105513]: DEBUG nova.api.openstack.wsgi_app [-] compute.cpu_shared_set = None {{(pid=105513) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 17:52:55.687434 dv-cinder-852009-8-iscsi devstack@n-api.service[105512]: DEBUG nova.api.openstack.wsgi_app [-] compute.image_type_exclude_list = [] {{(pid=105512) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 17:52:55.687609 dv-cinder-852009-8-iscsi devstack@n-api.service[105513]: DEBUG nova.api.openstack.wsgi_app [-] compute.image_type_exclude_list = [] {{(pid=105513) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 17:52:55.687784 dv-cinder-852009-8-iscsi devstack@n-api.service[105513]: DEBUG nova.api.openstack.wsgi_app [-] compute.live_migration_wait_for_vif_plug = True {{(pid=105513) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 17:52:55.687926 dv-cinder-852009-8-iscsi devstack@n-api.service[105512]: DEBUG nova.api.openstack.wsgi_app [-] compute.live_migration_wait_for_vif_plug = True {{(pid=105512) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 17:52:55.688089 dv-cinder-852009-8-iscsi devstack@n-api.service[105512]: DEBUG nova.api.openstack.wsgi_app [-] compute.max_concurrent_disk_ops = 0 {{(pid=105512) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 17:52:55.688240 dv-cinder-852009-8-iscsi devstack@n-api.service[105513]: DEBUG nova.api.openstack.wsgi_app [-] compute.max_concurrent_disk_ops = 0 {{(pid=105513) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 17:52:55.688407 dv-cinder-852009-8-iscsi devstack@n-api.service[105513]: DEBUG nova.api.openstack.wsgi_app [-] compute.max_disk_devices_to_attach = -1 {{(pid=105513) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 17:52:55.688574 dv-cinder-852009-8-iscsi devstack@n-api.service[105512]: DEBUG nova.api.openstack.wsgi_app [-] compute.max_disk_devices_to_attach = -1 {{(pid=105512) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 17:52:55.688701 dv-cinder-852009-8-iscsi devstack@n-api.service[105512]: DEBUG nova.api.openstack.wsgi_app [-] compute.packing_host_numa_cells_allocation_strategy = False {{(pid=105512) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 17:52:55.688838 dv-cinder-852009-8-iscsi devstack@n-api.service[105513]: DEBUG nova.api.openstack.wsgi_app [-] compute.packing_host_numa_cells_allocation_strategy = False {{(pid=105513) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 17:52:55.689063 dv-cinder-852009-8-iscsi devstack@n-api.service[105512]: DEBUG nova.api.openstack.wsgi_app [-] compute.provider_config_location = /etc/nova/provider_config/ {{(pid=105512) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 17:52:55.689200 dv-cinder-852009-8-iscsi devstack@n-api.service[105513]: DEBUG nova.api.openstack.wsgi_app [-] compute.provider_config_location = /etc/nova/provider_config/ {{(pid=105513) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 17:52:55.689377 dv-cinder-852009-8-iscsi devstack@n-api.service[105512]: DEBUG nova.api.openstack.wsgi_app [-] compute.resource_provider_association_refresh = 300 {{(pid=105512) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 17:52:55.689528 dv-cinder-852009-8-iscsi devstack@n-api.service[105513]: DEBUG nova.api.openstack.wsgi_app [-] compute.resource_provider_association_refresh = 300 {{(pid=105513) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 17:52:55.689698 dv-cinder-852009-8-iscsi devstack@n-api.service[105513]: DEBUG nova.api.openstack.wsgi_app [-] compute.shutdown_retry_interval = 10 {{(pid=105513) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 17:52:55.689832 dv-cinder-852009-8-iscsi devstack@n-api.service[105512]: DEBUG nova.api.openstack.wsgi_app [-] compute.shutdown_retry_interval = 10 {{(pid=105512) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 17:52:55.690030 dv-cinder-852009-8-iscsi devstack@n-api.service[105512]: DEBUG nova.api.openstack.wsgi_app [-] conductor.workers = 2 {{(pid=105512) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 17:52:55.690164 dv-cinder-852009-8-iscsi devstack@n-api.service[105513]: DEBUG nova.api.openstack.wsgi_app [-] conductor.workers = 2 {{(pid=105513) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 17:52:55.690377 dv-cinder-852009-8-iscsi devstack@n-api.service[105512]: DEBUG nova.api.openstack.wsgi_app [-] console.allowed_origins = [] {{(pid=105512) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 17:52:55.690534 dv-cinder-852009-8-iscsi devstack@n-api.service[105513]: DEBUG nova.api.openstack.wsgi_app [-] console.allowed_origins = [] {{(pid=105513) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 17:52:55.690636 dv-cinder-852009-8-iscsi devstack@n-api.service[105513]: DEBUG nova.api.openstack.wsgi_app [-] console.ssl_ciphers = None {{(pid=105513) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 17:52:55.690720 dv-cinder-852009-8-iscsi devstack@n-api.service[105512]: DEBUG nova.api.openstack.wsgi_app [-] console.ssl_ciphers = None {{(pid=105512) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 17:52:55.690992 dv-cinder-852009-8-iscsi devstack@n-api.service[105512]: DEBUG nova.api.openstack.wsgi_app [-] console.ssl_minimum_version = default {{(pid=105512) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 17:52:55.691127 dv-cinder-852009-8-iscsi devstack@n-api.service[105513]: DEBUG nova.api.openstack.wsgi_app [-] console.ssl_minimum_version = default {{(pid=105513) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 17:52:55.691318 dv-cinder-852009-8-iscsi devstack@n-api.service[105512]: DEBUG nova.api.openstack.wsgi_app [-] consoleauth.token_ttl = 600 {{(pid=105512) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 17:52:55.691519 dv-cinder-852009-8-iscsi devstack@n-api.service[105513]: DEBUG nova.api.openstack.wsgi_app [-] consoleauth.token_ttl = 600 {{(pid=105513) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 17:52:55.691627 dv-cinder-852009-8-iscsi devstack@n-api.service[105513]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.cafile = None {{(pid=105513) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 17:52:55.691722 dv-cinder-852009-8-iscsi devstack@n-api.service[105512]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.cafile = None {{(pid=105512) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 17:52:55.691904 dv-cinder-852009-8-iscsi devstack@n-api.service[105512]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.certfile = None {{(pid=105512) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 17:52:55.692038 dv-cinder-852009-8-iscsi devstack@n-api.service[105513]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.certfile = None {{(pid=105513) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 17:52:55.692238 dv-cinder-852009-8-iscsi devstack@n-api.service[105512]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.collect_timing = False {{(pid=105512) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 17:52:55.692389 dv-cinder-852009-8-iscsi devstack@n-api.service[105513]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.collect_timing = False {{(pid=105513) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 17:52:55.692590 dv-cinder-852009-8-iscsi devstack@n-api.service[105512]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.connect_retries = None {{(pid=105512) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 17:52:55.692678 dv-cinder-852009-8-iscsi devstack@n-api.service[105513]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.connect_retries = None {{(pid=105513) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 17:52:55.692868 dv-cinder-852009-8-iscsi devstack@n-api.service[105512]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.connect_retry_delay = None {{(pid=105512) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 17:52:55.693045 dv-cinder-852009-8-iscsi devstack@n-api.service[105513]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.connect_retry_delay = None {{(pid=105513) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 17:52:55.693165 dv-cinder-852009-8-iscsi devstack@n-api.service[105513]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.endpoint_override = None {{(pid=105513) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 17:52:55.693252 dv-cinder-852009-8-iscsi devstack@n-api.service[105512]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.endpoint_override = None {{(pid=105512) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 17:52:55.693516 dv-cinder-852009-8-iscsi devstack@n-api.service[105512]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.insecure = False {{(pid=105512) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 17:52:55.693666 dv-cinder-852009-8-iscsi devstack@n-api.service[105513]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.insecure = False {{(pid=105513) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 17:52:55.693826 dv-cinder-852009-8-iscsi devstack@n-api.service[105513]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.keyfile = None {{(pid=105513) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 17:52:55.693961 dv-cinder-852009-8-iscsi devstack@n-api.service[105512]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.keyfile = None {{(pid=105512) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 17:52:55.694105 dv-cinder-852009-8-iscsi devstack@n-api.service[105512]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.max_version = None {{(pid=105512) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 17:52:55.694213 dv-cinder-852009-8-iscsi devstack@n-api.service[105513]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.max_version = None {{(pid=105513) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 17:52:55.694435 dv-cinder-852009-8-iscsi devstack@n-api.service[105513]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.min_version = None {{(pid=105513) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 17:52:55.694633 dv-cinder-852009-8-iscsi devstack@n-api.service[105512]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.min_version = None {{(pid=105512) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 17:52:55.694730 dv-cinder-852009-8-iscsi devstack@n-api.service[105512]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.region_name = None {{(pid=105512) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 17:52:55.694799 dv-cinder-852009-8-iscsi devstack@n-api.service[105513]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.region_name = None {{(pid=105513) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 17:52:55.695024 dv-cinder-852009-8-iscsi devstack@n-api.service[105512]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.service_name = None {{(pid=105512) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 17:52:55.695160 dv-cinder-852009-8-iscsi devstack@n-api.service[105513]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.service_name = None {{(pid=105513) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 17:52:55.695355 dv-cinder-852009-8-iscsi devstack@n-api.service[105512]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.service_type = accelerator {{(pid=105512) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 17:52:55.695492 dv-cinder-852009-8-iscsi devstack@n-api.service[105513]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.service_type = accelerator {{(pid=105513) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 17:52:55.695676 dv-cinder-852009-8-iscsi devstack@n-api.service[105512]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.split_loggers = False {{(pid=105512) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 17:52:55.695812 dv-cinder-852009-8-iscsi devstack@n-api.service[105513]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.split_loggers = False {{(pid=105513) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 17:52:55.695943 dv-cinder-852009-8-iscsi devstack@n-api.service[105512]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.status_code_retries = None {{(pid=105512) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 17:52:55.696050 dv-cinder-852009-8-iscsi devstack@n-api.service[105513]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.status_code_retries = None {{(pid=105513) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 17:52:55.696278 dv-cinder-852009-8-iscsi devstack@n-api.service[105512]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.status_code_retry_delay = None {{(pid=105512) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 17:52:55.696454 dv-cinder-852009-8-iscsi devstack@n-api.service[105513]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.status_code_retry_delay = None {{(pid=105513) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 17:52:55.696590 dv-cinder-852009-8-iscsi devstack@n-api.service[105512]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.timeout = None {{(pid=105512) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 17:52:55.696714 dv-cinder-852009-8-iscsi devstack@n-api.service[105513]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.timeout = None {{(pid=105513) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 17:52:55.696962 dv-cinder-852009-8-iscsi devstack@n-api.service[105512]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.valid_interfaces = ['internal', 'public'] {{(pid=105512) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 17:52:55.697098 dv-cinder-852009-8-iscsi devstack@n-api.service[105513]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.valid_interfaces = ['internal', 'public'] {{(pid=105513) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 17:52:55.697269 dv-cinder-852009-8-iscsi devstack@n-api.service[105512]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.version = None {{(pid=105512) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 17:52:55.697405 dv-cinder-852009-8-iscsi devstack@n-api.service[105513]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.version = None {{(pid=105513) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 17:52:55.697616 dv-cinder-852009-8-iscsi devstack@n-api.service[105512]: DEBUG nova.api.openstack.wsgi_app [-] database.backend = sqlalchemy {{(pid=105512) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 17:52:55.697780 dv-cinder-852009-8-iscsi devstack@n-api.service[105513]: DEBUG nova.api.openstack.wsgi_app [-] database.backend = sqlalchemy {{(pid=105513) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 17:52:55.697946 dv-cinder-852009-8-iscsi devstack@n-api.service[105512]: DEBUG nova.api.openstack.wsgi_app [-] database.connection = **** {{(pid=105512) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 17:52:55.698047 dv-cinder-852009-8-iscsi devstack@n-api.service[105513]: DEBUG nova.api.openstack.wsgi_app [-] database.connection = **** {{(pid=105513) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 17:52:55.698283 dv-cinder-852009-8-iscsi devstack@n-api.service[105513]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_debug = 0 {{(pid=105513) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 17:52:55.698372 dv-cinder-852009-8-iscsi devstack@n-api.service[105512]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_debug = 0 {{(pid=105512) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 17:52:55.698623 dv-cinder-852009-8-iscsi devstack@n-api.service[105513]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_parameters = {{(pid=105513) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 17:52:55.698721 dv-cinder-852009-8-iscsi devstack@n-api.service[105512]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_parameters = {{(pid=105512) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 17:52:55.698934 dv-cinder-852009-8-iscsi devstack@n-api.service[105512]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_recycle_time = 3600 {{(pid=105512) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 17:52:55.699033 dv-cinder-852009-8-iscsi devstack@n-api.service[105513]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_recycle_time = 3600 {{(pid=105513) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 17:52:55.699255 dv-cinder-852009-8-iscsi devstack@n-api.service[105513]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_trace = False {{(pid=105513) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 17:52:55.699342 dv-cinder-852009-8-iscsi devstack@n-api.service[105512]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_trace = False {{(pid=105512) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 17:52:55.699570 dv-cinder-852009-8-iscsi devstack@n-api.service[105513]: DEBUG nova.api.openstack.wsgi_app [-] database.db_inc_retry_interval = True {{(pid=105513) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 17:52:55.699673 dv-cinder-852009-8-iscsi devstack@n-api.service[105512]: DEBUG nova.api.openstack.wsgi_app [-] database.db_inc_retry_interval = True {{(pid=105512) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 17:52:55.699925 dv-cinder-852009-8-iscsi devstack@n-api.service[105513]: DEBUG nova.api.openstack.wsgi_app [-] database.db_max_retries = 20 {{(pid=105513) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 17:52:55.700065 dv-cinder-852009-8-iscsi devstack@n-api.service[105512]: DEBUG nova.api.openstack.wsgi_app [-] database.db_max_retries = 20 {{(pid=105512) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 17:52:55.700244 dv-cinder-852009-8-iscsi devstack@n-api.service[105513]: DEBUG nova.api.openstack.wsgi_app [-] database.db_max_retry_interval = 10 {{(pid=105513) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 17:52:55.700343 dv-cinder-852009-8-iscsi devstack@n-api.service[105512]: DEBUG nova.api.openstack.wsgi_app [-] database.db_max_retry_interval = 10 {{(pid=105512) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 17:52:55.700590 dv-cinder-852009-8-iscsi devstack@n-api.service[105513]: DEBUG nova.api.openstack.wsgi_app [-] database.db_retry_interval = 1 {{(pid=105513) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 17:52:55.700685 dv-cinder-852009-8-iscsi devstack@n-api.service[105512]: DEBUG nova.api.openstack.wsgi_app [-] database.db_retry_interval = 1 {{(pid=105512) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 17:52:55.700921 dv-cinder-852009-8-iscsi devstack@n-api.service[105513]: DEBUG nova.api.openstack.wsgi_app [-] database.max_overflow = 50 {{(pid=105513) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 17:52:55.701003 dv-cinder-852009-8-iscsi devstack@n-api.service[105512]: DEBUG nova.api.openstack.wsgi_app [-] database.max_overflow = 50 {{(pid=105512) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 17:52:55.701234 dv-cinder-852009-8-iscsi devstack@n-api.service[105512]: DEBUG nova.api.openstack.wsgi_app [-] database.max_pool_size = 5 {{(pid=105512) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 17:52:55.701324 dv-cinder-852009-8-iscsi devstack@n-api.service[105513]: DEBUG nova.api.openstack.wsgi_app [-] database.max_pool_size = 5 {{(pid=105513) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 17:52:55.701555 dv-cinder-852009-8-iscsi devstack@n-api.service[105513]: DEBUG nova.api.openstack.wsgi_app [-] database.max_retries = 10 {{(pid=105513) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 17:52:55.701691 dv-cinder-852009-8-iscsi devstack@n-api.service[105512]: DEBUG nova.api.openstack.wsgi_app [-] database.max_retries = 10 {{(pid=105512) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 17:52:55.701874 dv-cinder-852009-8-iscsi devstack@n-api.service[105513]: DEBUG nova.api.openstack.wsgi_app [-] database.mysql_enable_ndb = False {{(pid=105513) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 17:52:55.701978 dv-cinder-852009-8-iscsi devstack@n-api.service[105512]: DEBUG nova.api.openstack.wsgi_app [-] database.mysql_enable_ndb = False {{(pid=105512) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 17:52:55.702213 dv-cinder-852009-8-iscsi devstack@n-api.service[105513]: DEBUG nova.api.openstack.wsgi_app [-] database.mysql_sql_mode = TRADITIONAL {{(pid=105513) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 17:52:55.702363 dv-cinder-852009-8-iscsi devstack@n-api.service[105512]: DEBUG nova.api.openstack.wsgi_app [-] database.mysql_sql_mode = TRADITIONAL {{(pid=105512) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 17:52:55.702532 dv-cinder-852009-8-iscsi devstack@n-api.service[105513]: DEBUG nova.api.openstack.wsgi_app [-] database.pool_timeout = None {{(pid=105513) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 17:52:55.702780 dv-cinder-852009-8-iscsi devstack@n-api.service[105512]: DEBUG nova.api.openstack.wsgi_app [-] database.pool_timeout = None {{(pid=105512) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 17:52:55.702932 dv-cinder-852009-8-iscsi devstack@n-api.service[105513]: DEBUG nova.api.openstack.wsgi_app [-] database.retry_interval = 10 {{(pid=105513) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 17:52:55.703108 dv-cinder-852009-8-iscsi devstack@n-api.service[105512]: DEBUG nova.api.openstack.wsgi_app [-] database.retry_interval = 10 {{(pid=105512) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 17:52:55.703196 dv-cinder-852009-8-iscsi devstack@n-api.service[105513]: DEBUG nova.api.openstack.wsgi_app [-] database.slave_connection = **** {{(pid=105513) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 17:52:55.703423 dv-cinder-852009-8-iscsi devstack@n-api.service[105512]: DEBUG nova.api.openstack.wsgi_app [-] database.slave_connection = **** {{(pid=105512) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 17:52:55.703538 dv-cinder-852009-8-iscsi devstack@n-api.service[105513]: DEBUG nova.api.openstack.wsgi_app [-] database.sqlite_synchronous = True {{(pid=105513) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 17:52:55.703790 dv-cinder-852009-8-iscsi devstack@n-api.service[105513]: DEBUG nova.api.openstack.wsgi_app [-] api_database.backend = sqlalchemy {{(pid=105513) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 17:52:55.703928 dv-cinder-852009-8-iscsi devstack@n-api.service[105512]: DEBUG nova.api.openstack.wsgi_app [-] database.sqlite_synchronous = True {{(pid=105512) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 17:52:55.704131 dv-cinder-852009-8-iscsi devstack@n-api.service[105513]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection = **** {{(pid=105513) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 17:52:55.704229 dv-cinder-852009-8-iscsi devstack@n-api.service[105512]: DEBUG nova.api.openstack.wsgi_app [-] api_database.backend = sqlalchemy {{(pid=105512) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 17:52:55.704480 dv-cinder-852009-8-iscsi devstack@n-api.service[105513]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_debug = 0 {{(pid=105513) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 17:52:55.704592 dv-cinder-852009-8-iscsi devstack@n-api.service[105512]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection = **** {{(pid=105512) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 17:52:55.704808 dv-cinder-852009-8-iscsi devstack@n-api.service[105513]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_parameters = {{(pid=105513) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 17:52:55.704952 dv-cinder-852009-8-iscsi devstack@n-api.service[105512]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_debug = 0 {{(pid=105512) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 17:52:55.705126 dv-cinder-852009-8-iscsi devstack@n-api.service[105513]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_recycle_time = 3600 {{(pid=105513) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 17:52:55.705221 dv-cinder-852009-8-iscsi devstack@n-api.service[105512]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_parameters = {{(pid=105512) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 17:52:55.705445 dv-cinder-852009-8-iscsi devstack@n-api.service[105513]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_trace = False {{(pid=105513) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 17:52:55.705541 dv-cinder-852009-8-iscsi devstack@n-api.service[105512]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_recycle_time = 3600 {{(pid=105512) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 17:52:55.705760 dv-cinder-852009-8-iscsi devstack@n-api.service[105513]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_inc_retry_interval = True {{(pid=105513) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 17:52:55.705846 dv-cinder-852009-8-iscsi devstack@n-api.service[105512]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_trace = False {{(pid=105512) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 17:52:55.706071 dv-cinder-852009-8-iscsi devstack@n-api.service[105512]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_inc_retry_interval = True {{(pid=105512) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 17:52:55.706157 dv-cinder-852009-8-iscsi devstack@n-api.service[105513]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_max_retries = 20 {{(pid=105513) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 17:52:55.706383 dv-cinder-852009-8-iscsi devstack@n-api.service[105513]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_max_retry_interval = 10 {{(pid=105513) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 17:52:55.706470 dv-cinder-852009-8-iscsi devstack@n-api.service[105512]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_max_retries = 20 {{(pid=105512) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 17:52:55.706693 dv-cinder-852009-8-iscsi devstack@n-api.service[105512]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_max_retry_interval = 10 {{(pid=105512) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 17:52:55.706780 dv-cinder-852009-8-iscsi devstack@n-api.service[105513]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_retry_interval = 1 {{(pid=105513) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 17:52:55.707013 dv-cinder-852009-8-iscsi devstack@n-api.service[105513]: DEBUG nova.api.openstack.wsgi_app [-] api_database.max_overflow = 50 {{(pid=105513) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 17:52:55.707107 dv-cinder-852009-8-iscsi devstack@n-api.service[105512]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_retry_interval = 1 {{(pid=105512) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 17:52:55.707329 dv-cinder-852009-8-iscsi devstack@n-api.service[105513]: DEBUG nova.api.openstack.wsgi_app [-] api_database.max_pool_size = 5 {{(pid=105513) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 17:52:55.707418 dv-cinder-852009-8-iscsi devstack@n-api.service[105512]: DEBUG nova.api.openstack.wsgi_app [-] api_database.max_overflow = 50 {{(pid=105512) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 17:52:55.707636 dv-cinder-852009-8-iscsi devstack@n-api.service[105512]: DEBUG nova.api.openstack.wsgi_app [-] api_database.max_pool_size = 5 {{(pid=105512) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 17:52:55.707730 dv-cinder-852009-8-iscsi devstack@n-api.service[105513]: DEBUG nova.api.openstack.wsgi_app [-] api_database.max_retries = 10 {{(pid=105513) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 17:52:55.707953 dv-cinder-852009-8-iscsi devstack@n-api.service[105513]: DEBUG nova.api.openstack.wsgi_app [-] api_database.mysql_enable_ndb = False {{(pid=105513) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 17:52:55.708102 dv-cinder-852009-8-iscsi devstack@n-api.service[105512]: DEBUG nova.api.openstack.wsgi_app [-] api_database.max_retries = 10 {{(pid=105512) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 17:52:55.708262 dv-cinder-852009-8-iscsi devstack@n-api.service[105512]: DEBUG nova.api.openstack.wsgi_app [-] api_database.mysql_enable_ndb = False {{(pid=105512) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 17:52:55.708357 dv-cinder-852009-8-iscsi devstack@n-api.service[105513]: DEBUG nova.api.openstack.wsgi_app [-] api_database.mysql_sql_mode = TRADITIONAL {{(pid=105513) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 17:52:55.708622 dv-cinder-852009-8-iscsi devstack@n-api.service[105512]: DEBUG nova.api.openstack.wsgi_app [-] api_database.mysql_sql_mode = TRADITIONAL {{(pid=105512) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 17:52:55.708710 dv-cinder-852009-8-iscsi devstack@n-api.service[105513]: DEBUG nova.api.openstack.wsgi_app [-] api_database.pool_timeout = None {{(pid=105513) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 17:52:55.708936 dv-cinder-852009-8-iscsi devstack@n-api.service[105512]: DEBUG nova.api.openstack.wsgi_app [-] api_database.pool_timeout = None {{(pid=105512) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 17:52:55.709159 dv-cinder-852009-8-iscsi devstack@n-api.service[105513]: DEBUG nova.api.openstack.wsgi_app [-] api_database.retry_interval = 10 {{(pid=105513) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 17:52:55.709358 dv-cinder-852009-8-iscsi devstack@n-api.service[105513]: DEBUG nova.api.openstack.wsgi_app [-] api_database.slave_connection = **** {{(pid=105513) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 17:52:55.709500 dv-cinder-852009-8-iscsi devstack@n-api.service[105512]: DEBUG nova.api.openstack.wsgi_app [-] api_database.retry_interval = 10 {{(pid=105512) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 17:52:55.709660 dv-cinder-852009-8-iscsi devstack@n-api.service[105512]: DEBUG nova.api.openstack.wsgi_app [-] api_database.slave_connection = **** {{(pid=105512) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 17:52:55.709755 dv-cinder-852009-8-iscsi devstack@n-api.service[105513]: DEBUG nova.api.openstack.wsgi_app [-] api_database.sqlite_synchronous = True {{(pid=105513) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 17:52:55.709980 dv-cinder-852009-8-iscsi devstack@n-api.service[105512]: DEBUG nova.api.openstack.wsgi_app [-] api_database.sqlite_synchronous = True {{(pid=105512) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 17:52:55.710078 dv-cinder-852009-8-iscsi devstack@n-api.service[105513]: DEBUG nova.api.openstack.wsgi_app [-] devices.enabled_mdev_types = [] {{(pid=105513) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 17:52:55.710317 dv-cinder-852009-8-iscsi devstack@n-api.service[105512]: DEBUG nova.api.openstack.wsgi_app [-] devices.enabled_mdev_types = [] {{(pid=105512) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 17:52:55.710406 dv-cinder-852009-8-iscsi devstack@n-api.service[105513]: DEBUG nova.api.openstack.wsgi_app [-] ephemeral_storage_encryption.cipher = aes-xts-plain64 {{(pid=105513) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 17:52:55.710630 dv-cinder-852009-8-iscsi devstack@n-api.service[105513]: DEBUG nova.api.openstack.wsgi_app [-] ephemeral_storage_encryption.enabled = False {{(pid=105513) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 17:52:55.710717 dv-cinder-852009-8-iscsi devstack@n-api.service[105512]: DEBUG nova.api.openstack.wsgi_app [-] ephemeral_storage_encryption.cipher = aes-xts-plain64 {{(pid=105512) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 17:52:55.710947 dv-cinder-852009-8-iscsi devstack@n-api.service[105513]: DEBUG nova.api.openstack.wsgi_app [-] ephemeral_storage_encryption.key_size = 512 {{(pid=105513) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 17:52:55.711043 dv-cinder-852009-8-iscsi devstack@n-api.service[105512]: DEBUG nova.api.openstack.wsgi_app [-] ephemeral_storage_encryption.enabled = False {{(pid=105512) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 17:52:55.711256 dv-cinder-852009-8-iscsi devstack@n-api.service[105512]: DEBUG nova.api.openstack.wsgi_app [-] ephemeral_storage_encryption.key_size = 512 {{(pid=105512) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 17:52:55.711342 dv-cinder-852009-8-iscsi devstack@n-api.service[105513]: DEBUG nova.api.openstack.wsgi_app [-] glance.api_servers = None {{(pid=105513) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 17:52:55.711573 dv-cinder-852009-8-iscsi devstack@n-api.service[105513]: DEBUG nova.api.openstack.wsgi_app [-] glance.cafile = None {{(pid=105513) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 17:52:55.711659 dv-cinder-852009-8-iscsi devstack@n-api.service[105512]: DEBUG nova.api.openstack.wsgi_app [-] glance.api_servers = None {{(pid=105512) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 17:52:55.711883 dv-cinder-852009-8-iscsi devstack@n-api.service[105512]: DEBUG nova.api.openstack.wsgi_app [-] glance.cafile = None {{(pid=105512) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 17:52:55.711987 dv-cinder-852009-8-iscsi devstack@n-api.service[105513]: DEBUG nova.api.openstack.wsgi_app [-] glance.certfile = None {{(pid=105513) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 17:52:55.712194 dv-cinder-852009-8-iscsi devstack@n-api.service[105513]: DEBUG nova.api.openstack.wsgi_app [-] glance.collect_timing = False {{(pid=105513) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 17:52:55.712281 dv-cinder-852009-8-iscsi devstack@n-api.service[105512]: DEBUG nova.api.openstack.wsgi_app [-] glance.certfile = None {{(pid=105512) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 17:52:55.712529 dv-cinder-852009-8-iscsi devstack@n-api.service[105512]: DEBUG nova.api.openstack.wsgi_app [-] glance.collect_timing = False {{(pid=105512) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 17:52:55.712620 dv-cinder-852009-8-iscsi devstack@n-api.service[105513]: DEBUG nova.api.openstack.wsgi_app [-] glance.connect_retries = None {{(pid=105513) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 17:52:55.712839 dv-cinder-852009-8-iscsi devstack@n-api.service[105513]: DEBUG nova.api.openstack.wsgi_app [-] glance.connect_retry_delay = None {{(pid=105513) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 17:52:55.712963 dv-cinder-852009-8-iscsi devstack@n-api.service[105512]: DEBUG nova.api.openstack.wsgi_app [-] glance.connect_retries = None {{(pid=105512) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 17:52:55.713143 dv-cinder-852009-8-iscsi devstack@n-api.service[105512]: DEBUG nova.api.openstack.wsgi_app [-] glance.connect_retry_delay = None {{(pid=105512) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 17:52:55.713228 dv-cinder-852009-8-iscsi devstack@n-api.service[105513]: DEBUG nova.api.openstack.wsgi_app [-] glance.debug = False {{(pid=105513) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 17:52:55.713457 dv-cinder-852009-8-iscsi devstack@n-api.service[105512]: DEBUG nova.api.openstack.wsgi_app [-] glance.debug = False {{(pid=105512) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 17:52:55.713546 dv-cinder-852009-8-iscsi devstack@n-api.service[105513]: DEBUG nova.api.openstack.wsgi_app [-] glance.default_trusted_certificate_ids = [] {{(pid=105513) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 17:52:55.713767 dv-cinder-852009-8-iscsi devstack@n-api.service[105513]: DEBUG nova.api.openstack.wsgi_app [-] glance.enable_certificate_validation = False {{(pid=105513) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 17:52:55.713862 dv-cinder-852009-8-iscsi devstack@n-api.service[105512]: DEBUG nova.api.openstack.wsgi_app [-] glance.default_trusted_certificate_ids = [] {{(pid=105512) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 17:52:55.714080 dv-cinder-852009-8-iscsi devstack@n-api.service[105513]: DEBUG nova.api.openstack.wsgi_app [-] glance.enable_rbd_download = False {{(pid=105513) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 17:52:55.714168 dv-cinder-852009-8-iscsi devstack@n-api.service[105512]: DEBUG nova.api.openstack.wsgi_app [-] glance.enable_certificate_validation = False {{(pid=105512) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 17:52:55.714387 dv-cinder-852009-8-iscsi devstack@n-api.service[105512]: DEBUG nova.api.openstack.wsgi_app [-] glance.enable_rbd_download = False {{(pid=105512) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 17:52:55.714479 dv-cinder-852009-8-iscsi devstack@n-api.service[105513]: DEBUG nova.api.openstack.wsgi_app [-] glance.endpoint_override = None {{(pid=105513) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 17:52:55.714691 dv-cinder-852009-8-iscsi devstack@n-api.service[105512]: DEBUG nova.api.openstack.wsgi_app [-] glance.endpoint_override = None {{(pid=105512) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 17:52:55.714788 dv-cinder-852009-8-iscsi devstack@n-api.service[105513]: DEBUG nova.api.openstack.wsgi_app [-] glance.insecure = False {{(pid=105513) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 17:52:55.714998 dv-cinder-852009-8-iscsi devstack@n-api.service[105513]: DEBUG nova.api.openstack.wsgi_app [-] glance.keyfile = None {{(pid=105513) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 17:52:55.715084 dv-cinder-852009-8-iscsi devstack@n-api.service[105512]: DEBUG nova.api.openstack.wsgi_app [-] glance.insecure = False {{(pid=105512) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 17:52:55.715302 dv-cinder-852009-8-iscsi devstack@n-api.service[105512]: DEBUG nova.api.openstack.wsgi_app [-] glance.keyfile = None {{(pid=105512) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 17:52:55.715386 dv-cinder-852009-8-iscsi devstack@n-api.service[105513]: DEBUG nova.api.openstack.wsgi_app [-] glance.max_version = None {{(pid=105513) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 17:52:55.715610 dv-cinder-852009-8-iscsi devstack@n-api.service[105513]: DEBUG nova.api.openstack.wsgi_app [-] glance.min_version = None {{(pid=105513) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 17:52:55.715697 dv-cinder-852009-8-iscsi devstack@n-api.service[105512]: DEBUG nova.api.openstack.wsgi_app [-] glance.max_version = None {{(pid=105512) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 17:52:55.715910 dv-cinder-852009-8-iscsi devstack@n-api.service[105512]: DEBUG nova.api.openstack.wsgi_app [-] glance.min_version = None {{(pid=105512) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 17:52:55.715995 dv-cinder-852009-8-iscsi devstack@n-api.service[105513]: DEBUG nova.api.openstack.wsgi_app [-] glance.num_retries = 3 {{(pid=105513) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 17:52:55.716224 dv-cinder-852009-8-iscsi devstack@n-api.service[105512]: DEBUG nova.api.openstack.wsgi_app [-] glance.num_retries = 3 {{(pid=105512) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 17:52:55.716321 dv-cinder-852009-8-iscsi devstack@n-api.service[105513]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_ceph_conf = {{(pid=105513) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 17:52:55.716580 dv-cinder-852009-8-iscsi devstack@n-api.service[105512]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_ceph_conf = {{(pid=105512) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 17:52:55.716670 dv-cinder-852009-8-iscsi devstack@n-api.service[105513]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_connect_timeout = 5 {{(pid=105513) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 17:52:55.716893 dv-cinder-852009-8-iscsi devstack@n-api.service[105512]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_connect_timeout = 5 {{(pid=105512) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 17:52:55.716979 dv-cinder-852009-8-iscsi devstack@n-api.service[105513]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_pool = {{(pid=105513) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 17:52:55.717213 dv-cinder-852009-8-iscsi devstack@n-api.service[105513]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_user = {{(pid=105513) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 17:52:55.717317 dv-cinder-852009-8-iscsi devstack@n-api.service[105512]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_pool = {{(pid=105512) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 17:52:55.717522 dv-cinder-852009-8-iscsi devstack@n-api.service[105513]: DEBUG nova.api.openstack.wsgi_app [-] glance.region_name = None {{(pid=105513) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 17:52:55.717608 dv-cinder-852009-8-iscsi devstack@n-api.service[105512]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_user = {{(pid=105512) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 17:52:55.717822 dv-cinder-852009-8-iscsi devstack@n-api.service[105512]: DEBUG nova.api.openstack.wsgi_app [-] glance.region_name = None {{(pid=105512) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 17:52:55.717907 dv-cinder-852009-8-iscsi devstack@n-api.service[105513]: DEBUG nova.api.openstack.wsgi_app [-] glance.service_name = None {{(pid=105513) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 17:52:55.718127 dv-cinder-852009-8-iscsi devstack@n-api.service[105512]: DEBUG nova.api.openstack.wsgi_app [-] glance.service_name = None {{(pid=105512) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 17:52:55.718272 dv-cinder-852009-8-iscsi devstack@n-api.service[105513]: DEBUG nova.api.openstack.wsgi_app [-] glance.service_type = image {{(pid=105513) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 17:52:55.718449 dv-cinder-852009-8-iscsi devstack@n-api.service[105512]: DEBUG nova.api.openstack.wsgi_app [-] glance.service_type = image {{(pid=105512) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 17:52:55.718537 dv-cinder-852009-8-iscsi devstack@n-api.service[105513]: DEBUG nova.api.openstack.wsgi_app [-] glance.split_loggers = False {{(pid=105513) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 17:52:55.718756 dv-cinder-852009-8-iscsi devstack@n-api.service[105513]: DEBUG nova.api.openstack.wsgi_app [-] glance.status_code_retries = None {{(pid=105513) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 17:52:55.718842 dv-cinder-852009-8-iscsi devstack@n-api.service[105512]: DEBUG nova.api.openstack.wsgi_app [-] glance.split_loggers = False {{(pid=105512) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 17:52:55.719058 dv-cinder-852009-8-iscsi devstack@n-api.service[105512]: DEBUG nova.api.openstack.wsgi_app [-] glance.status_code_retries = None {{(pid=105512) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 17:52:55.719153 dv-cinder-852009-8-iscsi devstack@n-api.service[105513]: DEBUG nova.api.openstack.wsgi_app [-] glance.status_code_retry_delay = None {{(pid=105513) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 17:52:55.719363 dv-cinder-852009-8-iscsi devstack@n-api.service[105513]: DEBUG nova.api.openstack.wsgi_app [-] glance.timeout = None {{(pid=105513) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 17:52:55.719450 dv-cinder-852009-8-iscsi devstack@n-api.service[105512]: DEBUG nova.api.openstack.wsgi_app [-] glance.status_code_retry_delay = None {{(pid=105512) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 17:52:55.719663 dv-cinder-852009-8-iscsi devstack@n-api.service[105512]: DEBUG nova.api.openstack.wsgi_app [-] glance.timeout = None {{(pid=105512) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 17:52:55.719749 dv-cinder-852009-8-iscsi devstack@n-api.service[105513]: DEBUG nova.api.openstack.wsgi_app [-] glance.valid_interfaces = ['internal', 'public'] {{(pid=105513) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 17:52:55.720011 dv-cinder-852009-8-iscsi devstack@n-api.service[105512]: DEBUG nova.api.openstack.wsgi_app [-] glance.valid_interfaces = ['internal', 'public'] {{(pid=105512) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 17:52:55.720107 dv-cinder-852009-8-iscsi devstack@n-api.service[105513]: DEBUG nova.api.openstack.wsgi_app [-] glance.verify_glance_signatures = False {{(pid=105513) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 17:52:55.720314 dv-cinder-852009-8-iscsi devstack@n-api.service[105513]: DEBUG nova.api.openstack.wsgi_app [-] glance.version = None {{(pid=105513) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 17:52:55.720400 dv-cinder-852009-8-iscsi devstack@n-api.service[105512]: DEBUG nova.api.openstack.wsgi_app [-] glance.verify_glance_signatures = False {{(pid=105512) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 17:52:55.720650 dv-cinder-852009-8-iscsi devstack@n-api.service[105512]: DEBUG nova.api.openstack.wsgi_app [-] glance.version = None {{(pid=105512) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 17:52:55.720737 dv-cinder-852009-8-iscsi devstack@n-api.service[105513]: DEBUG nova.api.openstack.wsgi_app [-] guestfs.debug = False {{(pid=105513) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 17:52:55.720972 dv-cinder-852009-8-iscsi devstack@n-api.service[105512]: DEBUG nova.api.openstack.wsgi_app [-] guestfs.debug = False {{(pid=105512) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 17:52:55.721061 dv-cinder-852009-8-iscsi devstack@n-api.service[105513]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.config_drive_cdrom = False {{(pid=105513) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 17:52:55.721291 dv-cinder-852009-8-iscsi devstack@n-api.service[105513]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.config_drive_inject_password = False {{(pid=105513) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 17:52:55.721379 dv-cinder-852009-8-iscsi devstack@n-api.service[105512]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.config_drive_cdrom = False {{(pid=105512) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 17:52:55.721600 dv-cinder-852009-8-iscsi devstack@n-api.service[105512]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.config_drive_inject_password = False {{(pid=105512) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 17:52:55.721685 dv-cinder-852009-8-iscsi devstack@n-api.service[105513]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.dynamic_memory_ratio = 1.0 {{(pid=105513) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 17:52:55.721916 dv-cinder-852009-8-iscsi devstack@n-api.service[105513]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.enable_instance_metrics_collection = False {{(pid=105513) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 17:52:55.722004 dv-cinder-852009-8-iscsi devstack@n-api.service[105512]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.dynamic_memory_ratio = 1.0 {{(pid=105512) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 17:52:55.722224 dv-cinder-852009-8-iscsi devstack@n-api.service[105512]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.enable_instance_metrics_collection = False {{(pid=105512) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 17:52:55.722309 dv-cinder-852009-8-iscsi devstack@n-api.service[105513]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.enable_remotefx = False {{(pid=105513) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 17:52:55.722534 dv-cinder-852009-8-iscsi devstack@n-api.service[105512]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.enable_remotefx = False {{(pid=105512) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 17:52:55.722621 dv-cinder-852009-8-iscsi devstack@n-api.service[105513]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.instances_path_share = {{(pid=105513) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 17:52:55.722860 dv-cinder-852009-8-iscsi devstack@n-api.service[105513]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.iscsi_initiator_list = [] {{(pid=105513) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 17:52:55.722962 dv-cinder-852009-8-iscsi devstack@n-api.service[105512]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.instances_path_share = {{(pid=105512) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 17:52:55.723172 dv-cinder-852009-8-iscsi devstack@n-api.service[105513]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.limit_cpu_features = False {{(pid=105513) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 17:52:55.723281 dv-cinder-852009-8-iscsi devstack@n-api.service[105512]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.iscsi_initiator_list = [] {{(pid=105512) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 17:52:55.723489 dv-cinder-852009-8-iscsi devstack@n-api.service[105513]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.mounted_disk_query_retry_count = 10 {{(pid=105513) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 17:52:55.723610 dv-cinder-852009-8-iscsi devstack@n-api.service[105512]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.limit_cpu_features = False {{(pid=105512) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 17:52:55.723803 dv-cinder-852009-8-iscsi devstack@n-api.service[105513]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.mounted_disk_query_retry_interval = 5 {{(pid=105513) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 17:52:55.723893 dv-cinder-852009-8-iscsi devstack@n-api.service[105512]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.mounted_disk_query_retry_count = 10 {{(pid=105512) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 17:52:55.724117 dv-cinder-852009-8-iscsi devstack@n-api.service[105513]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.power_state_check_timeframe = 60 {{(pid=105513) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 17:52:55.724246 dv-cinder-852009-8-iscsi devstack@n-api.service[105512]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.mounted_disk_query_retry_interval = 5 {{(pid=105512) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 17:52:55.724463 dv-cinder-852009-8-iscsi devstack@n-api.service[105513]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.power_state_event_polling_interval = 2 {{(pid=105513) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 17:52:55.724597 dv-cinder-852009-8-iscsi devstack@n-api.service[105512]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.power_state_check_timeframe = 60 {{(pid=105512) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 17:52:55.724819 dv-cinder-852009-8-iscsi devstack@n-api.service[105512]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.power_state_event_polling_interval = 2 {{(pid=105512) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 17:52:55.724904 dv-cinder-852009-8-iscsi devstack@n-api.service[105513]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.qemu_img_cmd = qemu-img.exe {{(pid=105513) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 17:52:55.725151 dv-cinder-852009-8-iscsi devstack@n-api.service[105512]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.qemu_img_cmd = qemu-img.exe {{(pid=105512) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 17:52:55.725283 dv-cinder-852009-8-iscsi devstack@n-api.service[105513]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.use_multipath_io = False {{(pid=105513) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 17:52:55.725465 dv-cinder-852009-8-iscsi devstack@n-api.service[105513]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.volume_attach_retry_count = 10 {{(pid=105513) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 17:52:55.725582 dv-cinder-852009-8-iscsi devstack@n-api.service[105512]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.use_multipath_io = False {{(pid=105512) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 17:52:55.725776 dv-cinder-852009-8-iscsi devstack@n-api.service[105512]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.volume_attach_retry_count = 10 {{(pid=105512) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 17:52:55.725862 dv-cinder-852009-8-iscsi devstack@n-api.service[105513]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.volume_attach_retry_interval = 5 {{(pid=105513) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 17:52:55.726081 dv-cinder-852009-8-iscsi devstack@n-api.service[105513]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.vswitch_name = None {{(pid=105513) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 17:52:55.726168 dv-cinder-852009-8-iscsi devstack@n-api.service[105512]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.volume_attach_retry_interval = 5 {{(pid=105512) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 17:52:55.726381 dv-cinder-852009-8-iscsi devstack@n-api.service[105512]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.vswitch_name = None {{(pid=105512) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 17:52:55.726482 dv-cinder-852009-8-iscsi devstack@n-api.service[105513]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.wait_soft_reboot_seconds = 60 {{(pid=105513) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 17:52:55.726694 dv-cinder-852009-8-iscsi devstack@n-api.service[105512]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.wait_soft_reboot_seconds = 60 {{(pid=105512) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 17:52:55.726780 dv-cinder-852009-8-iscsi devstack@n-api.service[105513]: DEBUG nova.api.openstack.wsgi_app [-] mks.enabled = False {{(pid=105513) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 17:52:55.727013 dv-cinder-852009-8-iscsi devstack@n-api.service[105512]: DEBUG nova.api.openstack.wsgi_app [-] mks.enabled = False {{(pid=105512) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 17:52:55.727292 dv-cinder-852009-8-iscsi devstack@n-api.service[105513]: DEBUG nova.api.openstack.wsgi_app [-] mks.mksproxy_base_url = http://127.0.0.1:6090/ {{(pid=105513) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 17:52:55.727605 dv-cinder-852009-8-iscsi devstack@n-api.service[105512]: DEBUG nova.api.openstack.wsgi_app [-] mks.mksproxy_base_url = http://127.0.0.1:6090/ {{(pid=105512) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 17:52:55.727708 dv-cinder-852009-8-iscsi devstack@n-api.service[105513]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.manager_interval = 2400 {{(pid=105513) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 17:52:55.727943 dv-cinder-852009-8-iscsi devstack@n-api.service[105512]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.manager_interval = 2400 {{(pid=105512) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 17:52:55.728071 dv-cinder-852009-8-iscsi devstack@n-api.service[105513]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.precache_concurrency = 1 {{(pid=105513) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 17:52:55.728263 dv-cinder-852009-8-iscsi devstack@n-api.service[105512]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.precache_concurrency = 1 {{(pid=105512) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 17:52:55.728378 dv-cinder-852009-8-iscsi devstack@n-api.service[105513]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.remove_unused_base_images = True {{(pid=105513) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 17:52:55.728616 dv-cinder-852009-8-iscsi devstack@n-api.service[105512]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.remove_unused_base_images = True {{(pid=105512) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 17:52:55.728735 dv-cinder-852009-8-iscsi devstack@n-api.service[105513]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.remove_unused_original_minimum_age_seconds = 86400 {{(pid=105513) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 17:52:55.728965 dv-cinder-852009-8-iscsi devstack@n-api.service[105512]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.remove_unused_original_minimum_age_seconds = 86400 {{(pid=105512) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 17:52:55.729174 dv-cinder-852009-8-iscsi devstack@n-api.service[105513]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.remove_unused_resized_minimum_age_seconds = 3600 {{(pid=105513) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 17:52:55.729344 dv-cinder-852009-8-iscsi devstack@n-api.service[105512]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.remove_unused_resized_minimum_age_seconds = 3600 {{(pid=105512) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 17:52:55.729505 dv-cinder-852009-8-iscsi devstack@n-api.service[105513]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.subdirectory_name = _base {{(pid=105513) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 17:52:55.729619 dv-cinder-852009-8-iscsi devstack@n-api.service[105512]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.subdirectory_name = _base {{(pid=105512) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 17:52:55.729725 dv-cinder-852009-8-iscsi devstack@n-api.service[105513]: DEBUG nova.api.openstack.wsgi_app [-] ironic.api_max_retries = 60 {{(pid=105513) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 17:52:55.729928 dv-cinder-852009-8-iscsi devstack@n-api.service[105512]: DEBUG nova.api.openstack.wsgi_app [-] ironic.api_max_retries = 60 {{(pid=105512) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 17:52:55.730053 dv-cinder-852009-8-iscsi devstack@n-api.service[105513]: DEBUG nova.api.openstack.wsgi_app [-] ironic.api_retry_interval = 2 {{(pid=105513) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 17:52:55.730242 dv-cinder-852009-8-iscsi devstack@n-api.service[105513]: DEBUG nova.api.openstack.wsgi_app [-] ironic.auth_section = None {{(pid=105513) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 17:52:55.730355 dv-cinder-852009-8-iscsi devstack@n-api.service[105512]: DEBUG nova.api.openstack.wsgi_app [-] ironic.api_retry_interval = 2 {{(pid=105512) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 17:52:55.730548 dv-cinder-852009-8-iscsi devstack@n-api.service[105512]: DEBUG nova.api.openstack.wsgi_app [-] ironic.auth_section = None {{(pid=105512) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 17:52:55.730672 dv-cinder-852009-8-iscsi devstack@n-api.service[105513]: DEBUG nova.api.openstack.wsgi_app [-] ironic.auth_type = None {{(pid=105513) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 17:52:55.730857 dv-cinder-852009-8-iscsi devstack@n-api.service[105513]: DEBUG nova.api.openstack.wsgi_app [-] ironic.cafile = None {{(pid=105513) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 17:52:55.730979 dv-cinder-852009-8-iscsi devstack@n-api.service[105512]: DEBUG nova.api.openstack.wsgi_app [-] ironic.auth_type = None {{(pid=105512) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 17:52:55.731166 dv-cinder-852009-8-iscsi devstack@n-api.service[105512]: DEBUG nova.api.openstack.wsgi_app [-] ironic.cafile = None {{(pid=105512) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 17:52:55.731279 dv-cinder-852009-8-iscsi devstack@n-api.service[105513]: DEBUG nova.api.openstack.wsgi_app [-] ironic.certfile = None {{(pid=105513) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 17:52:55.731467 dv-cinder-852009-8-iscsi devstack@n-api.service[105512]: DEBUG nova.api.openstack.wsgi_app [-] ironic.certfile = None {{(pid=105512) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 17:52:55.731585 dv-cinder-852009-8-iscsi devstack@n-api.service[105513]: DEBUG nova.api.openstack.wsgi_app [-] ironic.collect_timing = False {{(pid=105513) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 17:52:55.731775 dv-cinder-852009-8-iscsi devstack@n-api.service[105513]: DEBUG nova.api.openstack.wsgi_app [-] ironic.connect_retries = None {{(pid=105513) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 17:52:55.731896 dv-cinder-852009-8-iscsi devstack@n-api.service[105512]: DEBUG nova.api.openstack.wsgi_app [-] ironic.collect_timing = False {{(pid=105512) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 17:52:55.732075 dv-cinder-852009-8-iscsi devstack@n-api.service[105512]: DEBUG nova.api.openstack.wsgi_app [-] ironic.connect_retries = None {{(pid=105512) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 17:52:55.732187 dv-cinder-852009-8-iscsi devstack@n-api.service[105513]: DEBUG nova.api.openstack.wsgi_app [-] ironic.connect_retry_delay = None {{(pid=105513) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 17:52:55.732379 dv-cinder-852009-8-iscsi devstack@n-api.service[105512]: DEBUG nova.api.openstack.wsgi_app [-] ironic.connect_retry_delay = None {{(pid=105512) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 17:52:55.732566 dv-cinder-852009-8-iscsi devstack@n-api.service[105513]: DEBUG nova.api.openstack.wsgi_app [-] ironic.endpoint_override = None {{(pid=105513) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 17:52:55.732722 dv-cinder-852009-8-iscsi devstack@n-api.service[105512]: DEBUG nova.api.openstack.wsgi_app [-] ironic.endpoint_override = None {{(pid=105512) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 17:52:55.732869 dv-cinder-852009-8-iscsi devstack@n-api.service[105513]: DEBUG nova.api.openstack.wsgi_app [-] ironic.insecure = False {{(pid=105513) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 17:52:55.733534 dv-cinder-852009-8-iscsi devstack@n-api.service[105513]: DEBUG nova.api.openstack.wsgi_app [-] ironic.keyfile = None {{(pid=105513) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 17:52:55.733608 dv-cinder-852009-8-iscsi devstack@n-api.service[105512]: DEBUG nova.api.openstack.wsgi_app [-] ironic.insecure = False {{(pid=105512) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 17:52:55.733608 dv-cinder-852009-8-iscsi devstack@n-api.service[105512]: DEBUG nova.api.openstack.wsgi_app [-] ironic.keyfile = None {{(pid=105512) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 17:52:55.733739 dv-cinder-852009-8-iscsi devstack@n-api.service[105513]: DEBUG nova.api.openstack.wsgi_app [-] ironic.max_version = None {{(pid=105513) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 17:52:55.733739 dv-cinder-852009-8-iscsi devstack@n-api.service[105513]: DEBUG nova.api.openstack.wsgi_app [-] ironic.min_version = None {{(pid=105513) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 17:52:55.733904 dv-cinder-852009-8-iscsi devstack@n-api.service[105512]: DEBUG nova.api.openstack.wsgi_app [-] ironic.max_version = None {{(pid=105512) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 17:52:55.734033 dv-cinder-852009-8-iscsi devstack@n-api.service[105513]: DEBUG nova.api.openstack.wsgi_app [-] ironic.partition_key = None {{(pid=105513) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 17:52:55.734131 dv-cinder-852009-8-iscsi devstack@n-api.service[105512]: DEBUG nova.api.openstack.wsgi_app [-] ironic.min_version = None {{(pid=105512) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 17:52:55.734215 dv-cinder-852009-8-iscsi devstack@n-api.service[105512]: DEBUG nova.api.openstack.wsgi_app [-] ironic.partition_key = None {{(pid=105512) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 17:52:55.734290 dv-cinder-852009-8-iscsi devstack@n-api.service[105513]: DEBUG nova.api.openstack.wsgi_app [-] ironic.peer_list = [] {{(pid=105513) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 17:52:55.734509 dv-cinder-852009-8-iscsi devstack@n-api.service[105512]: DEBUG nova.api.openstack.wsgi_app [-] ironic.peer_list = [] {{(pid=105512) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 17:52:55.734600 dv-cinder-852009-8-iscsi devstack@n-api.service[105513]: DEBUG nova.api.openstack.wsgi_app [-] ironic.region_name = None {{(pid=105513) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 17:52:55.734808 dv-cinder-852009-8-iscsi devstack@n-api.service[105512]: DEBUG nova.api.openstack.wsgi_app [-] ironic.region_name = None {{(pid=105512) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 17:52:55.734902 dv-cinder-852009-8-iscsi devstack@n-api.service[105513]: DEBUG nova.api.openstack.wsgi_app [-] ironic.serial_console_state_timeout = 10 {{(pid=105513) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 17:52:55.735124 dv-cinder-852009-8-iscsi devstack@n-api.service[105513]: DEBUG nova.api.openstack.wsgi_app [-] ironic.service_name = None {{(pid=105513) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 17:52:55.735211 dv-cinder-852009-8-iscsi devstack@n-api.service[105512]: DEBUG nova.api.openstack.wsgi_app [-] ironic.serial_console_state_timeout = 10 {{(pid=105512) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 17:52:55.735446 dv-cinder-852009-8-iscsi devstack@n-api.service[105512]: DEBUG nova.api.openstack.wsgi_app [-] ironic.service_name = None {{(pid=105512) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 17:52:55.735582 dv-cinder-852009-8-iscsi devstack@n-api.service[105513]: DEBUG nova.api.openstack.wsgi_app [-] ironic.service_type = baremetal {{(pid=105513) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 17:52:55.735754 dv-cinder-852009-8-iscsi devstack@n-api.service[105512]: DEBUG nova.api.openstack.wsgi_app [-] ironic.service_type = baremetal {{(pid=105512) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 17:52:55.735845 dv-cinder-852009-8-iscsi devstack@n-api.service[105513]: DEBUG nova.api.openstack.wsgi_app [-] ironic.split_loggers = False {{(pid=105513) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 17:52:55.736062 dv-cinder-852009-8-iscsi devstack@n-api.service[105513]: DEBUG nova.api.openstack.wsgi_app [-] ironic.status_code_retries = None {{(pid=105513) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 17:52:55.736148 dv-cinder-852009-8-iscsi devstack@n-api.service[105512]: DEBUG nova.api.openstack.wsgi_app [-] ironic.split_loggers = False {{(pid=105512) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 17:52:55.736362 dv-cinder-852009-8-iscsi devstack@n-api.service[105512]: DEBUG nova.api.openstack.wsgi_app [-] ironic.status_code_retries = None {{(pid=105512) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 17:52:55.736479 dv-cinder-852009-8-iscsi devstack@n-api.service[105513]: DEBUG nova.api.openstack.wsgi_app [-] ironic.status_code_retry_delay = None {{(pid=105513) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 17:52:55.736697 dv-cinder-852009-8-iscsi devstack@n-api.service[105512]: DEBUG nova.api.openstack.wsgi_app [-] ironic.status_code_retry_delay = None {{(pid=105512) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 17:52:55.736784 dv-cinder-852009-8-iscsi devstack@n-api.service[105513]: DEBUG nova.api.openstack.wsgi_app [-] ironic.timeout = None {{(pid=105513) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 17:52:55.737003 dv-cinder-852009-8-iscsi devstack@n-api.service[105512]: DEBUG nova.api.openstack.wsgi_app [-] ironic.timeout = None {{(pid=105512) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 17:52:55.737091 dv-cinder-852009-8-iscsi devstack@n-api.service[105513]: DEBUG nova.api.openstack.wsgi_app [-] ironic.valid_interfaces = ['internal', 'public'] {{(pid=105513) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 17:52:55.737339 dv-cinder-852009-8-iscsi devstack@n-api.service[105513]: DEBUG nova.api.openstack.wsgi_app [-] ironic.version = None {{(pid=105513) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 17:52:55.737424 dv-cinder-852009-8-iscsi devstack@n-api.service[105512]: DEBUG nova.api.openstack.wsgi_app [-] ironic.valid_interfaces = ['internal', 'public'] {{(pid=105512) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 17:52:55.737642 dv-cinder-852009-8-iscsi devstack@n-api.service[105512]: DEBUG nova.api.openstack.wsgi_app [-] ironic.version = None {{(pid=105512) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 17:52:55.737727 dv-cinder-852009-8-iscsi devstack@n-api.service[105513]: DEBUG nova.api.openstack.wsgi_app [-] key_manager.backend = nova.keymgr.conf_key_mgr.ConfKeyManager {{(pid=105513) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 17:52:55.737997 dv-cinder-852009-8-iscsi devstack@n-api.service[105512]: DEBUG nova.api.openstack.wsgi_app [-] key_manager.backend = nova.keymgr.conf_key_mgr.ConfKeyManager {{(pid=105512) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 17:52:55.738135 dv-cinder-852009-8-iscsi devstack@n-api.service[105513]: DEBUG nova.api.openstack.wsgi_app [-] key_manager.fixed_key = **** {{(pid=105513) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 17:52:55.738313 dv-cinder-852009-8-iscsi devstack@n-api.service[105512]: DEBUG nova.api.openstack.wsgi_app [-] key_manager.fixed_key = **** {{(pid=105512) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 17:52:55.738411 dv-cinder-852009-8-iscsi devstack@n-api.service[105513]: DEBUG nova.api.openstack.wsgi_app [-] barbican.auth_endpoint = http://localhost/identity/v3 {{(pid=105513) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 17:52:55.738637 dv-cinder-852009-8-iscsi devstack@n-api.service[105513]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_api_version = None {{(pid=105513) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 17:52:55.738741 dv-cinder-852009-8-iscsi devstack@n-api.service[105512]: DEBUG nova.api.openstack.wsgi_app [-] barbican.auth_endpoint = http://localhost/identity/v3 {{(pid=105512) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 17:52:55.738955 dv-cinder-852009-8-iscsi devstack@n-api.service[105513]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_endpoint = None {{(pid=105513) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 17:52:55.739042 dv-cinder-852009-8-iscsi devstack@n-api.service[105512]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_api_version = None {{(pid=105512) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 17:52:55.739257 dv-cinder-852009-8-iscsi devstack@n-api.service[105512]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_endpoint = None {{(pid=105512) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 17:52:55.739341 dv-cinder-852009-8-iscsi devstack@n-api.service[105513]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_endpoint_type = public {{(pid=105513) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 17:52:55.739587 dv-cinder-852009-8-iscsi devstack@n-api.service[105512]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_endpoint_type = public {{(pid=105512) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 17:52:55.739734 dv-cinder-852009-8-iscsi devstack@n-api.service[105513]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_region_name = None {{(pid=105513) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 17:52:55.739894 dv-cinder-852009-8-iscsi devstack@n-api.service[105513]: DEBUG nova.api.openstack.wsgi_app [-] barbican.cafile = None {{(pid=105513) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 17:52:55.739981 dv-cinder-852009-8-iscsi devstack@n-api.service[105512]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_region_name = None {{(pid=105512) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 17:52:55.740194 dv-cinder-852009-8-iscsi devstack@n-api.service[105512]: DEBUG nova.api.openstack.wsgi_app [-] barbican.cafile = None {{(pid=105512) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 17:52:55.740343 dv-cinder-852009-8-iscsi devstack@n-api.service[105513]: DEBUG nova.api.openstack.wsgi_app [-] barbican.certfile = None {{(pid=105513) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 17:52:55.740598 dv-cinder-852009-8-iscsi devstack@n-api.service[105512]: DEBUG nova.api.openstack.wsgi_app [-] barbican.certfile = None {{(pid=105512) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 17:52:55.740705 dv-cinder-852009-8-iscsi devstack@n-api.service[105513]: DEBUG nova.api.openstack.wsgi_app [-] barbican.collect_timing = False {{(pid=105513) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 17:52:55.740912 dv-cinder-852009-8-iscsi devstack@n-api.service[105512]: DEBUG nova.api.openstack.wsgi_app [-] barbican.collect_timing = False {{(pid=105512) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 17:52:55.741006 dv-cinder-852009-8-iscsi devstack@n-api.service[105513]: DEBUG nova.api.openstack.wsgi_app [-] barbican.insecure = False {{(pid=105513) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 17:52:55.741222 dv-cinder-852009-8-iscsi devstack@n-api.service[105512]: DEBUG nova.api.openstack.wsgi_app [-] barbican.insecure = False {{(pid=105512) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 17:52:55.741310 dv-cinder-852009-8-iscsi devstack@n-api.service[105513]: DEBUG nova.api.openstack.wsgi_app [-] barbican.keyfile = None {{(pid=105513) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 17:52:55.741530 dv-cinder-852009-8-iscsi devstack@n-api.service[105512]: DEBUG nova.api.openstack.wsgi_app [-] barbican.keyfile = None {{(pid=105512) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 17:52:55.741628 dv-cinder-852009-8-iscsi devstack@n-api.service[105513]: DEBUG nova.api.openstack.wsgi_app [-] barbican.number_of_retries = 60 {{(pid=105513) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 17:52:55.741839 dv-cinder-852009-8-iscsi devstack@n-api.service[105512]: DEBUG nova.api.openstack.wsgi_app [-] barbican.number_of_retries = 60 {{(pid=105512) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 17:52:55.741933 dv-cinder-852009-8-iscsi devstack@n-api.service[105513]: DEBUG nova.api.openstack.wsgi_app [-] barbican.retry_delay = 1 {{(pid=105513) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 17:52:55.742150 dv-cinder-852009-8-iscsi devstack@n-api.service[105512]: DEBUG nova.api.openstack.wsgi_app [-] barbican.retry_delay = 1 {{(pid=105512) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 17:52:55.742237 dv-cinder-852009-8-iscsi devstack@n-api.service[105513]: DEBUG nova.api.openstack.wsgi_app [-] barbican.send_service_user_token = False {{(pid=105513) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 17:52:55.742461 dv-cinder-852009-8-iscsi devstack@n-api.service[105512]: DEBUG nova.api.openstack.wsgi_app [-] barbican.send_service_user_token = False {{(pid=105512) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 17:52:55.742556 dv-cinder-852009-8-iscsi devstack@n-api.service[105513]: DEBUG nova.api.openstack.wsgi_app [-] barbican.split_loggers = False {{(pid=105513) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 17:52:55.742767 dv-cinder-852009-8-iscsi devstack@n-api.service[105513]: DEBUG nova.api.openstack.wsgi_app [-] barbican.timeout = None {{(pid=105513) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 17:52:55.742867 dv-cinder-852009-8-iscsi devstack@n-api.service[105512]: DEBUG nova.api.openstack.wsgi_app [-] barbican.split_loggers = False {{(pid=105512) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 17:52:55.743067 dv-cinder-852009-8-iscsi devstack@n-api.service[105512]: DEBUG nova.api.openstack.wsgi_app [-] barbican.timeout = None {{(pid=105512) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 17:52:55.743161 dv-cinder-852009-8-iscsi devstack@n-api.service[105513]: DEBUG nova.api.openstack.wsgi_app [-] barbican.verify_ssl = True {{(pid=105513) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 17:52:55.743374 dv-cinder-852009-8-iscsi devstack@n-api.service[105513]: DEBUG nova.api.openstack.wsgi_app [-] barbican.verify_ssl_path = None {{(pid=105513) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 17:52:55.743517 dv-cinder-852009-8-iscsi devstack@n-api.service[105512]: DEBUG nova.api.openstack.wsgi_app [-] barbican.verify_ssl = True {{(pid=105512) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 17:52:55.743681 dv-cinder-852009-8-iscsi devstack@n-api.service[105512]: DEBUG nova.api.openstack.wsgi_app [-] barbican.verify_ssl_path = None {{(pid=105512) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 17:52:55.743801 dv-cinder-852009-8-iscsi devstack@n-api.service[105513]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.auth_section = None {{(pid=105513) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 17:52:55.743999 dv-cinder-852009-8-iscsi devstack@n-api.service[105513]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.auth_type = None {{(pid=105513) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 17:52:55.744093 dv-cinder-852009-8-iscsi devstack@n-api.service[105512]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.auth_section = None {{(pid=105512) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 17:52:55.744303 dv-cinder-852009-8-iscsi devstack@n-api.service[105512]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.auth_type = None {{(pid=105512) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 17:52:55.744389 dv-cinder-852009-8-iscsi devstack@n-api.service[105513]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.cafile = None {{(pid=105513) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 17:52:55.744637 dv-cinder-852009-8-iscsi devstack@n-api.service[105512]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.cafile = None {{(pid=105512) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 17:52:55.744735 dv-cinder-852009-8-iscsi devstack@n-api.service[105513]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.certfile = None {{(pid=105513) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 17:52:55.744937 dv-cinder-852009-8-iscsi devstack@n-api.service[105512]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.certfile = None {{(pid=105512) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 17:52:55.745024 dv-cinder-852009-8-iscsi devstack@n-api.service[105513]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.collect_timing = False {{(pid=105513) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 17:52:55.745247 dv-cinder-852009-8-iscsi devstack@n-api.service[105512]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.collect_timing = False {{(pid=105512) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 17:52:55.745336 dv-cinder-852009-8-iscsi devstack@n-api.service[105513]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.insecure = False {{(pid=105513) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 17:52:55.745551 dv-cinder-852009-8-iscsi devstack@n-api.service[105513]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.keyfile = None {{(pid=105513) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 17:52:55.745649 dv-cinder-852009-8-iscsi devstack@n-api.service[105512]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.insecure = False {{(pid=105512) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 17:52:55.745849 dv-cinder-852009-8-iscsi devstack@n-api.service[105512]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.keyfile = None {{(pid=105512) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 17:52:55.745944 dv-cinder-852009-8-iscsi devstack@n-api.service[105513]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.split_loggers = False {{(pid=105513) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 17:52:55.746159 dv-cinder-852009-8-iscsi devstack@n-api.service[105512]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.split_loggers = False {{(pid=105512) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 17:52:55.746245 dv-cinder-852009-8-iscsi devstack@n-api.service[105513]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.timeout = None {{(pid=105513) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 17:52:55.746463 dv-cinder-852009-8-iscsi devstack@n-api.service[105512]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.timeout = None {{(pid=105512) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 17:52:55.746551 dv-cinder-852009-8-iscsi devstack@n-api.service[105513]: DEBUG nova.api.openstack.wsgi_app [-] vault.approle_role_id = None {{(pid=105513) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 17:52:55.746770 dv-cinder-852009-8-iscsi devstack@n-api.service[105513]: DEBUG nova.api.openstack.wsgi_app [-] vault.approle_secret_id = None {{(pid=105513) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 17:52:55.746864 dv-cinder-852009-8-iscsi devstack@n-api.service[105512]: DEBUG nova.api.openstack.wsgi_app [-] vault.approle_role_id = None {{(pid=105512) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 17:52:55.747069 dv-cinder-852009-8-iscsi devstack@n-api.service[105512]: DEBUG nova.api.openstack.wsgi_app [-] vault.approle_secret_id = None {{(pid=105512) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 17:52:55.747155 dv-cinder-852009-8-iscsi devstack@n-api.service[105513]: DEBUG nova.api.openstack.wsgi_app [-] vault.cafile = None {{(pid=105513) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 17:52:55.747373 dv-cinder-852009-8-iscsi devstack@n-api.service[105512]: DEBUG nova.api.openstack.wsgi_app [-] vault.cafile = None {{(pid=105512) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 17:52:55.747459 dv-cinder-852009-8-iscsi devstack@n-api.service[105513]: DEBUG nova.api.openstack.wsgi_app [-] vault.certfile = None {{(pid=105513) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 17:52:55.747679 dv-cinder-852009-8-iscsi devstack@n-api.service[105512]: DEBUG nova.api.openstack.wsgi_app [-] vault.certfile = None {{(pid=105512) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 17:52:55.747774 dv-cinder-852009-8-iscsi devstack@n-api.service[105513]: DEBUG nova.api.openstack.wsgi_app [-] vault.collect_timing = False {{(pid=105513) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 17:52:55.747988 dv-cinder-852009-8-iscsi devstack@n-api.service[105513]: DEBUG nova.api.openstack.wsgi_app [-] vault.insecure = False {{(pid=105513) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 17:52:55.748084 dv-cinder-852009-8-iscsi devstack@n-api.service[105512]: DEBUG nova.api.openstack.wsgi_app [-] vault.collect_timing = False {{(pid=105512) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 17:52:55.748294 dv-cinder-852009-8-iscsi devstack@n-api.service[105512]: DEBUG nova.api.openstack.wsgi_app [-] vault.insecure = False {{(pid=105512) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 17:52:55.748379 dv-cinder-852009-8-iscsi devstack@n-api.service[105513]: DEBUG nova.api.openstack.wsgi_app [-] vault.keyfile = None {{(pid=105513) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 17:52:55.748621 dv-cinder-852009-8-iscsi devstack@n-api.service[105512]: DEBUG nova.api.openstack.wsgi_app [-] vault.keyfile = None {{(pid=105512) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 17:52:55.748724 dv-cinder-852009-8-iscsi devstack@n-api.service[105513]: DEBUG nova.api.openstack.wsgi_app [-] vault.kv_mountpoint = secret {{(pid=105513) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 17:52:55.748950 dv-cinder-852009-8-iscsi devstack@n-api.service[105512]: DEBUG nova.api.openstack.wsgi_app [-] vault.kv_mountpoint = secret {{(pid=105512) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 17:52:55.749038 dv-cinder-852009-8-iscsi devstack@n-api.service[105513]: DEBUG nova.api.openstack.wsgi_app [-] vault.kv_version = 2 {{(pid=105513) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 17:52:55.749254 dv-cinder-852009-8-iscsi devstack@n-api.service[105513]: DEBUG nova.api.openstack.wsgi_app [-] vault.namespace = None {{(pid=105513) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 17:52:55.749348 dv-cinder-852009-8-iscsi devstack@n-api.service[105512]: DEBUG nova.api.openstack.wsgi_app [-] vault.kv_version = 2 {{(pid=105512) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 17:52:55.749553 dv-cinder-852009-8-iscsi devstack@n-api.service[105512]: DEBUG nova.api.openstack.wsgi_app [-] vault.namespace = None {{(pid=105512) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 17:52:55.749648 dv-cinder-852009-8-iscsi devstack@n-api.service[105513]: DEBUG nova.api.openstack.wsgi_app [-] vault.root_token_id = None {{(pid=105513) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 17:52:55.749856 dv-cinder-852009-8-iscsi devstack@n-api.service[105512]: DEBUG nova.api.openstack.wsgi_app [-] vault.root_token_id = None {{(pid=105512) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 17:52:55.749942 dv-cinder-852009-8-iscsi devstack@n-api.service[105513]: DEBUG nova.api.openstack.wsgi_app [-] vault.split_loggers = False {{(pid=105513) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 17:52:55.750161 dv-cinder-852009-8-iscsi devstack@n-api.service[105513]: DEBUG nova.api.openstack.wsgi_app [-] vault.ssl_ca_crt_file = None {{(pid=105513) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 17:52:55.750247 dv-cinder-852009-8-iscsi devstack@n-api.service[105512]: DEBUG nova.api.openstack.wsgi_app [-] vault.split_loggers = False {{(pid=105512) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 17:52:55.750461 dv-cinder-852009-8-iscsi devstack@n-api.service[105512]: DEBUG nova.api.openstack.wsgi_app [-] vault.ssl_ca_crt_file = None {{(pid=105512) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 17:52:55.750548 dv-cinder-852009-8-iscsi devstack@n-api.service[105513]: DEBUG nova.api.openstack.wsgi_app [-] vault.timeout = None {{(pid=105513) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 17:52:55.750763 dv-cinder-852009-8-iscsi devstack@n-api.service[105512]: DEBUG nova.api.openstack.wsgi_app [-] vault.timeout = None {{(pid=105512) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 17:52:55.750851 dv-cinder-852009-8-iscsi devstack@n-api.service[105513]: DEBUG nova.api.openstack.wsgi_app [-] vault.use_ssl = False {{(pid=105513) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 17:52:55.751074 dv-cinder-852009-8-iscsi devstack@n-api.service[105512]: DEBUG nova.api.openstack.wsgi_app [-] vault.use_ssl = False {{(pid=105512) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 17:52:55.751169 dv-cinder-852009-8-iscsi devstack@n-api.service[105513]: DEBUG nova.api.openstack.wsgi_app [-] vault.vault_url = http://127.0.0.1:8200 {{(pid=105513) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 17:52:55.751393 dv-cinder-852009-8-iscsi devstack@n-api.service[105513]: DEBUG nova.api.openstack.wsgi_app [-] keystone.cafile = None {{(pid=105513) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 17:52:55.751493 dv-cinder-852009-8-iscsi devstack@n-api.service[105512]: DEBUG nova.api.openstack.wsgi_app [-] vault.vault_url = http://127.0.0.1:8200 {{(pid=105512) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 17:52:55.751702 dv-cinder-852009-8-iscsi devstack@n-api.service[105513]: DEBUG nova.api.openstack.wsgi_app [-] keystone.certfile = None {{(pid=105513) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 17:52:55.751789 dv-cinder-852009-8-iscsi devstack@n-api.service[105512]: DEBUG nova.api.openstack.wsgi_app [-] keystone.cafile = None {{(pid=105512) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 17:52:55.752004 dv-cinder-852009-8-iscsi devstack@n-api.service[105512]: DEBUG nova.api.openstack.wsgi_app [-] keystone.certfile = None {{(pid=105512) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 17:52:55.752096 dv-cinder-852009-8-iscsi devstack@n-api.service[105513]: DEBUG nova.api.openstack.wsgi_app [-] keystone.collect_timing = False {{(pid=105513) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 17:52:55.752310 dv-cinder-852009-8-iscsi devstack@n-api.service[105513]: DEBUG nova.api.openstack.wsgi_app [-] keystone.connect_retries = None {{(pid=105513) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 17:52:55.752397 dv-cinder-852009-8-iscsi devstack@n-api.service[105512]: DEBUG nova.api.openstack.wsgi_app [-] keystone.collect_timing = False {{(pid=105512) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 17:52:55.752637 dv-cinder-852009-8-iscsi devstack@n-api.service[105512]: DEBUG nova.api.openstack.wsgi_app [-] keystone.connect_retries = None {{(pid=105512) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 17:52:55.752736 dv-cinder-852009-8-iscsi devstack@n-api.service[105513]: DEBUG nova.api.openstack.wsgi_app [-] keystone.connect_retry_delay = None {{(pid=105513) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 17:52:55.752942 dv-cinder-852009-8-iscsi devstack@n-api.service[105512]: DEBUG nova.api.openstack.wsgi_app [-] keystone.connect_retry_delay = None {{(pid=105512) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 17:52:55.753038 dv-cinder-852009-8-iscsi devstack@n-api.service[105513]: DEBUG nova.api.openstack.wsgi_app [-] keystone.endpoint_override = None {{(pid=105513) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 17:52:55.753245 dv-cinder-852009-8-iscsi devstack@n-api.service[105512]: DEBUG nova.api.openstack.wsgi_app [-] keystone.endpoint_override = None {{(pid=105512) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 17:52:55.753333 dv-cinder-852009-8-iscsi devstack@n-api.service[105513]: DEBUG nova.api.openstack.wsgi_app [-] keystone.insecure = False {{(pid=105513) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 17:52:55.753548 dv-cinder-852009-8-iscsi devstack@n-api.service[105513]: DEBUG nova.api.openstack.wsgi_app [-] keystone.keyfile = None {{(pid=105513) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 17:52:55.753681 dv-cinder-852009-8-iscsi devstack@n-api.service[105512]: DEBUG nova.api.openstack.wsgi_app [-] keystone.insecure = False {{(pid=105512) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 17:52:55.753848 dv-cinder-852009-8-iscsi devstack@n-api.service[105512]: DEBUG nova.api.openstack.wsgi_app [-] keystone.keyfile = None {{(pid=105512) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 17:52:55.753943 dv-cinder-852009-8-iscsi devstack@n-api.service[105513]: DEBUG nova.api.openstack.wsgi_app [-] keystone.max_version = None {{(pid=105513) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 17:52:55.754152 dv-cinder-852009-8-iscsi devstack@n-api.service[105512]: DEBUG nova.api.openstack.wsgi_app [-] keystone.max_version = None {{(pid=105512) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 17:52:55.754238 dv-cinder-852009-8-iscsi devstack@n-api.service[105513]: DEBUG nova.api.openstack.wsgi_app [-] keystone.min_version = None {{(pid=105513) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 17:52:55.754457 dv-cinder-852009-8-iscsi devstack@n-api.service[105513]: DEBUG nova.api.openstack.wsgi_app [-] keystone.region_name = None {{(pid=105513) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 17:52:55.754541 dv-cinder-852009-8-iscsi devstack@n-api.service[105512]: DEBUG nova.api.openstack.wsgi_app [-] keystone.min_version = None {{(pid=105512) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 17:52:55.754771 dv-cinder-852009-8-iscsi devstack@n-api.service[105512]: DEBUG nova.api.openstack.wsgi_app [-] keystone.region_name = None {{(pid=105512) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 17:52:55.754960 dv-cinder-852009-8-iscsi devstack@n-api.service[105513]: DEBUG nova.api.openstack.wsgi_app [-] keystone.service_name = None {{(pid=105513) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 17:52:55.755054 dv-cinder-852009-8-iscsi devstack@n-api.service[105512]: DEBUG nova.api.openstack.wsgi_app [-] keystone.service_name = None {{(pid=105512) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 17:52:55.755273 dv-cinder-852009-8-iscsi devstack@n-api.service[105513]: DEBUG nova.api.openstack.wsgi_app [-] keystone.service_type = identity {{(pid=105513) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 17:52:55.755370 dv-cinder-852009-8-iscsi devstack@n-api.service[105512]: DEBUG nova.api.openstack.wsgi_app [-] keystone.service_type = identity {{(pid=105512) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 17:52:55.755593 dv-cinder-852009-8-iscsi devstack@n-api.service[105513]: DEBUG nova.api.openstack.wsgi_app [-] keystone.split_loggers = False {{(pid=105513) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 17:52:55.755695 dv-cinder-852009-8-iscsi devstack@n-api.service[105512]: DEBUG nova.api.openstack.wsgi_app [-] keystone.split_loggers = False {{(pid=105512) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 17:52:55.755945 dv-cinder-852009-8-iscsi devstack@n-api.service[105513]: DEBUG nova.api.openstack.wsgi_app [-] keystone.status_code_retries = None {{(pid=105513) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 17:52:55.756043 dv-cinder-852009-8-iscsi devstack@n-api.service[105512]: DEBUG nova.api.openstack.wsgi_app [-] keystone.status_code_retries = None {{(pid=105512) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 17:52:55.756256 dv-cinder-852009-8-iscsi devstack@n-api.service[105513]: DEBUG nova.api.openstack.wsgi_app [-] keystone.status_code_retry_delay = None {{(pid=105513) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 17:52:55.756343 dv-cinder-852009-8-iscsi devstack@n-api.service[105512]: DEBUG nova.api.openstack.wsgi_app [-] keystone.status_code_retry_delay = None {{(pid=105512) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 17:52:55.756589 dv-cinder-852009-8-iscsi devstack@n-api.service[105513]: DEBUG nova.api.openstack.wsgi_app [-] keystone.timeout = None {{(pid=105513) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 17:52:55.756697 dv-cinder-852009-8-iscsi devstack@n-api.service[105512]: DEBUG nova.api.openstack.wsgi_app [-] keystone.timeout = None {{(pid=105512) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 17:52:55.756943 dv-cinder-852009-8-iscsi devstack@n-api.service[105513]: DEBUG nova.api.openstack.wsgi_app [-] keystone.valid_interfaces = ['internal', 'public'] {{(pid=105513) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 17:52:55.757030 dv-cinder-852009-8-iscsi devstack@n-api.service[105512]: DEBUG nova.api.openstack.wsgi_app [-] keystone.valid_interfaces = ['internal', 'public'] {{(pid=105512) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 17:52:55.757244 dv-cinder-852009-8-iscsi devstack@n-api.service[105512]: DEBUG nova.api.openstack.wsgi_app [-] keystone.version = None {{(pid=105512) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 17:52:55.757329 dv-cinder-852009-8-iscsi devstack@n-api.service[105513]: DEBUG nova.api.openstack.wsgi_app [-] keystone.version = None {{(pid=105513) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 17:52:55.757602 dv-cinder-852009-8-iscsi devstack@n-api.service[105512]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.connection_uri = {{(pid=105512) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 17:52:55.757698 dv-cinder-852009-8-iscsi devstack@n-api.service[105513]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.connection_uri = {{(pid=105513) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 17:52:55.757907 dv-cinder-852009-8-iscsi devstack@n-api.service[105513]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.cpu_mode = None {{(pid=105513) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 17:52:55.757993 dv-cinder-852009-8-iscsi devstack@n-api.service[105512]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.cpu_mode = None {{(pid=105512) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 17:52:55.758218 dv-cinder-852009-8-iscsi devstack@n-api.service[105512]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.cpu_model_extra_flags = [] {{(pid=105512) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 17:52:55.758303 dv-cinder-852009-8-iscsi devstack@n-api.service[105513]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.cpu_model_extra_flags = [] {{(pid=105513) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 17:52:55.758540 dv-cinder-852009-8-iscsi devstack@n-api.service[105512]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.cpu_models = [] {{(pid=105512) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 17:52:55.758637 dv-cinder-852009-8-iscsi devstack@n-api.service[105513]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.cpu_models = [] {{(pid=105513) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 17:52:55.758854 dv-cinder-852009-8-iscsi devstack@n-api.service[105513]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.device_detach_attempts = 8 {{(pid=105513) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 17:52:55.758940 dv-cinder-852009-8-iscsi devstack@n-api.service[105512]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.device_detach_attempts = 8 {{(pid=105512) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 17:52:55.759162 dv-cinder-852009-8-iscsi devstack@n-api.service[105512]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.device_detach_timeout = 20 {{(pid=105512) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 17:52:55.759256 dv-cinder-852009-8-iscsi devstack@n-api.service[105513]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.device_detach_timeout = 20 {{(pid=105513) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 17:52:55.759475 dv-cinder-852009-8-iscsi devstack@n-api.service[105513]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.disk_cachemodes = [] {{(pid=105513) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 17:52:55.759577 dv-cinder-852009-8-iscsi devstack@n-api.service[105512]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.disk_cachemodes = [] {{(pid=105512) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 17:52:55.759775 dv-cinder-852009-8-iscsi devstack@n-api.service[105512]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.disk_prefix = None {{(pid=105512) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 17:52:55.759983 dv-cinder-852009-8-iscsi devstack@n-api.service[105513]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.disk_prefix = None {{(pid=105513) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 17:52:55.760083 dv-cinder-852009-8-iscsi devstack@n-api.service[105512]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.enabled_perf_events = [] {{(pid=105512) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 17:52:55.760165 dv-cinder-852009-8-iscsi devstack@n-api.service[105513]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.enabled_perf_events = [] {{(pid=105513) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 17:52:55.760385 dv-cinder-852009-8-iscsi devstack@n-api.service[105512]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.file_backed_memory = 0 {{(pid=105512) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 17:52:55.760523 dv-cinder-852009-8-iscsi devstack@n-api.service[105513]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.file_backed_memory = 0 {{(pid=105513) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 17:52:55.760721 dv-cinder-852009-8-iscsi devstack@n-api.service[105512]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.gid_maps = [] {{(pid=105512) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 17:52:55.760810 dv-cinder-852009-8-iscsi devstack@n-api.service[105513]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.gid_maps = [] {{(pid=105513) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 17:52:55.761027 dv-cinder-852009-8-iscsi devstack@n-api.service[105513]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.hw_disk_discard = None {{(pid=105513) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 17:52:55.761114 dv-cinder-852009-8-iscsi devstack@n-api.service[105512]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.hw_disk_discard = None {{(pid=105512) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 17:52:55.761326 dv-cinder-852009-8-iscsi devstack@n-api.service[105512]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.hw_machine_type = None {{(pid=105512) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 17:52:55.761413 dv-cinder-852009-8-iscsi devstack@n-api.service[105513]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.hw_machine_type = None {{(pid=105513) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 17:52:55.761647 dv-cinder-852009-8-iscsi devstack@n-api.service[105513]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_ceph_conf = {{(pid=105513) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 17:52:55.761732 dv-cinder-852009-8-iscsi devstack@n-api.service[105512]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_ceph_conf = {{(pid=105512) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 17:52:55.761955 dv-cinder-852009-8-iscsi devstack@n-api.service[105512]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_glance_copy_poll_interval = 15 {{(pid=105512) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 17:52:55.762040 dv-cinder-852009-8-iscsi devstack@n-api.service[105513]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_glance_copy_poll_interval = 15 {{(pid=105513) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 17:52:55.762622 dv-cinder-852009-8-iscsi devstack@n-api.service[105513]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_glance_copy_timeout = 600 {{(pid=105513) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 17:52:55.762715 dv-cinder-852009-8-iscsi devstack@n-api.service[105512]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_glance_copy_timeout = 600 {{(pid=105512) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 17:52:55.762942 dv-cinder-852009-8-iscsi devstack@n-api.service[105512]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_glance_store_name = {{(pid=105512) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 17:52:55.763034 dv-cinder-852009-8-iscsi devstack@n-api.service[105513]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_glance_store_name = {{(pid=105513) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 17:52:55.763264 dv-cinder-852009-8-iscsi devstack@n-api.service[105512]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_pool = rbd {{(pid=105512) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 17:52:55.763351 dv-cinder-852009-8-iscsi devstack@n-api.service[105513]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_pool = rbd {{(pid=105513) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 17:52:55.763594 dv-cinder-852009-8-iscsi devstack@n-api.service[105513]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_type = default {{(pid=105513) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 17:52:55.763687 dv-cinder-852009-8-iscsi devstack@n-api.service[105512]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_type = default {{(pid=105512) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 17:52:55.763892 dv-cinder-852009-8-iscsi devstack@n-api.service[105512]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_volume_group = None {{(pid=105512) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 17:52:55.764018 dv-cinder-852009-8-iscsi devstack@n-api.service[105513]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_volume_group = None {{(pid=105513) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 17:52:55.764201 dv-cinder-852009-8-iscsi devstack@n-api.service[105513]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.inject_key = False {{(pid=105513) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 17:52:55.764295 dv-cinder-852009-8-iscsi devstack@n-api.service[105512]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.inject_key = False {{(pid=105512) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 17:52:55.764536 dv-cinder-852009-8-iscsi devstack@n-api.service[105512]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.inject_partition = -2 {{(pid=105512) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 17:52:55.764627 dv-cinder-852009-8-iscsi devstack@n-api.service[105513]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.inject_partition = -2 {{(pid=105513) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 17:52:55.764845 dv-cinder-852009-8-iscsi devstack@n-api.service[105512]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.inject_password = False {{(pid=105512) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 17:52:55.764932 dv-cinder-852009-8-iscsi devstack@n-api.service[105513]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.inject_password = False {{(pid=105513) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 17:52:55.765154 dv-cinder-852009-8-iscsi devstack@n-api.service[105513]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.iscsi_iface = None {{(pid=105513) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 17:52:55.765261 dv-cinder-852009-8-iscsi devstack@n-api.service[105512]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.iscsi_iface = None {{(pid=105512) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 17:52:55.765460 dv-cinder-852009-8-iscsi devstack@n-api.service[105512]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.iser_use_multipath = False {{(pid=105512) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 17:52:55.765553 dv-cinder-852009-8-iscsi devstack@n-api.service[105513]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.iser_use_multipath = False {{(pid=105513) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 17:52:55.765781 dv-cinder-852009-8-iscsi devstack@n-api.service[105513]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_bandwidth = 0 {{(pid=105513) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 17:52:55.765919 dv-cinder-852009-8-iscsi devstack@n-api.service[105512]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_bandwidth = 0 {{(pid=105512) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 17:52:55.766079 dv-cinder-852009-8-iscsi devstack@n-api.service[105512]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_completion_timeout = 800 {{(pid=105512) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 17:52:55.766176 dv-cinder-852009-8-iscsi devstack@n-api.service[105513]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_completion_timeout = 800 {{(pid=105513) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 17:52:55.766389 dv-cinder-852009-8-iscsi devstack@n-api.service[105513]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_downtime = 500 {{(pid=105513) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 17:52:55.766474 dv-cinder-852009-8-iscsi devstack@n-api.service[105512]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_downtime = 500 {{(pid=105512) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 17:52:55.766694 dv-cinder-852009-8-iscsi devstack@n-api.service[105512]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_downtime_delay = 75 {{(pid=105512) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 17:52:55.766780 dv-cinder-852009-8-iscsi devstack@n-api.service[105513]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_downtime_delay = 75 {{(pid=105513) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 17:52:55.767004 dv-cinder-852009-8-iscsi devstack@n-api.service[105513]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_downtime_steps = 10 {{(pid=105513) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 17:52:55.767098 dv-cinder-852009-8-iscsi devstack@n-api.service[105512]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_downtime_steps = 10 {{(pid=105512) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 17:52:55.767307 dv-cinder-852009-8-iscsi devstack@n-api.service[105512]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_inbound_addr = None {{(pid=105512) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 17:52:55.767392 dv-cinder-852009-8-iscsi devstack@n-api.service[105513]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_inbound_addr = None {{(pid=105513) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 17:52:55.767617 dv-cinder-852009-8-iscsi devstack@n-api.service[105512]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_permit_auto_converge = False {{(pid=105512) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 17:52:55.767705 dv-cinder-852009-8-iscsi devstack@n-api.service[105513]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_permit_auto_converge = False {{(pid=105513) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 17:52:55.767924 dv-cinder-852009-8-iscsi devstack@n-api.service[105512]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_permit_post_copy = False {{(pid=105512) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 17:52:55.768026 dv-cinder-852009-8-iscsi devstack@n-api.service[105513]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_permit_post_copy = False {{(pid=105513) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 17:52:55.768226 dv-cinder-852009-8-iscsi devstack@n-api.service[105513]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_scheme = None {{(pid=105513) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 17:52:55.768313 dv-cinder-852009-8-iscsi devstack@n-api.service[105512]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_scheme = None {{(pid=105512) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 17:52:55.768576 dv-cinder-852009-8-iscsi devstack@n-api.service[105512]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_timeout_action = abort {{(pid=105512) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 17:52:55.768673 dv-cinder-852009-8-iscsi devstack@n-api.service[105513]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_timeout_action = abort {{(pid=105513) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 17:52:55.768884 dv-cinder-852009-8-iscsi devstack@n-api.service[105513]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_tunnelled = False {{(pid=105513) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 17:52:55.768973 dv-cinder-852009-8-iscsi devstack@n-api.service[105512]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_tunnelled = False {{(pid=105512) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 17:52:55.769184 dv-cinder-852009-8-iscsi devstack@n-api.service[105512]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_uri = None {{(pid=105512) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 17:52:55.769278 dv-cinder-852009-8-iscsi devstack@n-api.service[105513]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_uri = None {{(pid=105513) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 17:52:55.769491 dv-cinder-852009-8-iscsi devstack@n-api.service[105513]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_with_native_tls = False {{(pid=105513) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 17:52:55.769588 dv-cinder-852009-8-iscsi devstack@n-api.service[105512]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_with_native_tls = False {{(pid=105512) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 17:52:55.769793 dv-cinder-852009-8-iscsi devstack@n-api.service[105512]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.max_queues = None {{(pid=105512) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 17:52:55.769881 dv-cinder-852009-8-iscsi devstack@n-api.service[105513]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.max_queues = None {{(pid=105513) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 17:52:55.770106 dv-cinder-852009-8-iscsi devstack@n-api.service[105512]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.mem_stats_period_seconds = 10 {{(pid=105512) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 17:52:55.770206 dv-cinder-852009-8-iscsi devstack@n-api.service[105513]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.mem_stats_period_seconds = 10 {{(pid=105513) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 17:52:55.770405 dv-cinder-852009-8-iscsi devstack@n-api.service[105513]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.nfs_mount_options = None {{(pid=105513) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 17:52:55.770493 dv-cinder-852009-8-iscsi devstack@n-api.service[105512]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.nfs_mount_options = None {{(pid=105512) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 17:52:55.770843 dv-cinder-852009-8-iscsi devstack@n-api.service[105512]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.nfs_mount_point_base = /opt/stack/data/nova/mnt {{(pid=105512) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 17:52:55.770931 dv-cinder-852009-8-iscsi devstack@n-api.service[105513]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.nfs_mount_point_base = /opt/stack/data/nova/mnt {{(pid=105513) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 17:52:55.771153 dv-cinder-852009-8-iscsi devstack@n-api.service[105512]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_aoe_discover_tries = 3 {{(pid=105512) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 17:52:55.771249 dv-cinder-852009-8-iscsi devstack@n-api.service[105513]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_aoe_discover_tries = 3 {{(pid=105513) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 17:52:55.771485 dv-cinder-852009-8-iscsi devstack@n-api.service[105513]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_iser_scan_tries = 5 {{(pid=105513) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 17:52:55.771612 dv-cinder-852009-8-iscsi devstack@n-api.service[105512]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_iser_scan_tries = 5 {{(pid=105512) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 17:52:55.771820 dv-cinder-852009-8-iscsi devstack@n-api.service[105512]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_memory_encrypted_guests = None {{(pid=105512) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 17:52:55.771907 dv-cinder-852009-8-iscsi devstack@n-api.service[105513]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_memory_encrypted_guests = None {{(pid=105513) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 17:52:55.772130 dv-cinder-852009-8-iscsi devstack@n-api.service[105512]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_nvme_discover_tries = 5 {{(pid=105512) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 17:52:55.772217 dv-cinder-852009-8-iscsi devstack@n-api.service[105513]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_nvme_discover_tries = 5 {{(pid=105513) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 17:52:55.772457 dv-cinder-852009-8-iscsi devstack@n-api.service[105513]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_pcie_ports = 0 {{(pid=105513) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 17:52:55.772596 dv-cinder-852009-8-iscsi devstack@n-api.service[105512]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_pcie_ports = 0 {{(pid=105512) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 17:52:55.772818 dv-cinder-852009-8-iscsi devstack@n-api.service[105512]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_volume_scan_tries = 5 {{(pid=105512) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 17:52:55.772965 dv-cinder-852009-8-iscsi devstack@n-api.service[105513]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_volume_scan_tries = 5 {{(pid=105513) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 17:52:55.773126 dv-cinder-852009-8-iscsi devstack@n-api.service[105512]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.pmem_namespaces = [] {{(pid=105512) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 17:52:55.773233 dv-cinder-852009-8-iscsi devstack@n-api.service[105513]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.pmem_namespaces = [] {{(pid=105513) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 17:52:55.773432 dv-cinder-852009-8-iscsi devstack@n-api.service[105513]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.quobyte_client_cfg = None {{(pid=105513) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 17:52:55.773526 dv-cinder-852009-8-iscsi devstack@n-api.service[105512]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.quobyte_client_cfg = None {{(pid=105512) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 17:52:55.773853 dv-cinder-852009-8-iscsi devstack@n-api.service[105513]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.quobyte_mount_point_base = /opt/stack/data/nova/mnt {{(pid=105513) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 17:52:55.773941 dv-cinder-852009-8-iscsi devstack@n-api.service[105512]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.quobyte_mount_point_base = /opt/stack/data/nova/mnt {{(pid=105512) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 17:52:55.774163 dv-cinder-852009-8-iscsi devstack@n-api.service[105512]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_connect_timeout = 5 {{(pid=105512) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 17:52:55.774269 dv-cinder-852009-8-iscsi devstack@n-api.service[105513]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_connect_timeout = 5 {{(pid=105513) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 17:52:55.774475 dv-cinder-852009-8-iscsi devstack@n-api.service[105513]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_destroy_volume_retries = 12 {{(pid=105513) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 17:52:55.774572 dv-cinder-852009-8-iscsi devstack@n-api.service[105512]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_destroy_volume_retries = 12 {{(pid=105512) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 17:52:55.774782 dv-cinder-852009-8-iscsi devstack@n-api.service[105512]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_destroy_volume_retry_interval = 5 {{(pid=105512) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 17:52:55.774869 dv-cinder-852009-8-iscsi devstack@n-api.service[105513]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_destroy_volume_retry_interval = 5 {{(pid=105513) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 17:52:55.775087 dv-cinder-852009-8-iscsi devstack@n-api.service[105513]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_secret_uuid = None {{(pid=105513) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 17:52:55.775173 dv-cinder-852009-8-iscsi devstack@n-api.service[105512]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_secret_uuid = None {{(pid=105512) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 17:52:55.775385 dv-cinder-852009-8-iscsi devstack@n-api.service[105512]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_user = None {{(pid=105512) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 17:52:55.775495 dv-cinder-852009-8-iscsi devstack@n-api.service[105513]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_user = None {{(pid=105513) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 17:52:55.775708 dv-cinder-852009-8-iscsi devstack@n-api.service[105512]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.realtime_scheduler_priority = 1 {{(pid=105512) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 17:52:55.775797 dv-cinder-852009-8-iscsi devstack@n-api.service[105513]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.realtime_scheduler_priority = 1 {{(pid=105513) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 17:52:55.776018 dv-cinder-852009-8-iscsi devstack@n-api.service[105513]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.remote_filesystem_transport = ssh {{(pid=105513) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 17:52:55.776130 dv-cinder-852009-8-iscsi devstack@n-api.service[105512]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.remote_filesystem_transport = ssh {{(pid=105512) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 17:52:55.776316 dv-cinder-852009-8-iscsi devstack@n-api.service[105512]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rescue_image_id = None {{(pid=105512) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 17:52:55.776405 dv-cinder-852009-8-iscsi devstack@n-api.service[105513]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rescue_image_id = None {{(pid=105513) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 17:52:55.776645 dv-cinder-852009-8-iscsi devstack@n-api.service[105512]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rescue_kernel_id = None {{(pid=105512) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 17:52:55.776737 dv-cinder-852009-8-iscsi devstack@n-api.service[105513]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rescue_kernel_id = None {{(pid=105513) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 17:52:55.776949 dv-cinder-852009-8-iscsi devstack@n-api.service[105512]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rescue_ramdisk_id = None {{(pid=105512) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 17:52:55.777036 dv-cinder-852009-8-iscsi devstack@n-api.service[105513]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rescue_ramdisk_id = None {{(pid=105513) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 17:52:55.777269 dv-cinder-852009-8-iscsi devstack@n-api.service[105513]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rng_dev_path = /dev/urandom {{(pid=105513) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 17:52:55.777365 dv-cinder-852009-8-iscsi devstack@n-api.service[105512]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rng_dev_path = /dev/urandom {{(pid=105512) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 17:52:55.777568 dv-cinder-852009-8-iscsi devstack@n-api.service[105512]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rx_queue_size = None {{(pid=105512) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 17:52:55.777654 dv-cinder-852009-8-iscsi devstack@n-api.service[105513]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rx_queue_size = None {{(pid=105513) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 17:52:55.777884 dv-cinder-852009-8-iscsi devstack@n-api.service[105512]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.smbfs_mount_options = {{(pid=105512) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 17:52:55.777971 dv-cinder-852009-8-iscsi devstack@n-api.service[105513]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.smbfs_mount_options = {{(pid=105513) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 17:52:55.778300 dv-cinder-852009-8-iscsi devstack@n-api.service[105513]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.smbfs_mount_point_base = /opt/stack/data/nova/mnt {{(pid=105513) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 17:52:55.778387 dv-cinder-852009-8-iscsi devstack@n-api.service[105512]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.smbfs_mount_point_base = /opt/stack/data/nova/mnt {{(pid=105512) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 17:52:55.778610 dv-cinder-852009-8-iscsi devstack@n-api.service[105512]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.snapshot_compression = False {{(pid=105512) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 17:52:55.778697 dv-cinder-852009-8-iscsi devstack@n-api.service[105513]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.snapshot_compression = False {{(pid=105513) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 17:52:55.778916 dv-cinder-852009-8-iscsi devstack@n-api.service[105512]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.snapshot_image_format = None {{(pid=105512) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 17:52:55.779016 dv-cinder-852009-8-iscsi devstack@n-api.service[105513]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.snapshot_image_format = None {{(pid=105513) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 17:52:55.779332 dv-cinder-852009-8-iscsi devstack@n-api.service[105513]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.snapshots_directory = /opt/stack/data/nova/instances/snapshots {{(pid=105513) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 17:52:55.779443 dv-cinder-852009-8-iscsi devstack@n-api.service[105512]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.snapshots_directory = /opt/stack/data/nova/instances/snapshots {{(pid=105512) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 17:52:55.779641 dv-cinder-852009-8-iscsi devstack@n-api.service[105512]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.sparse_logical_volumes = False {{(pid=105512) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 17:52:55.779728 dv-cinder-852009-8-iscsi devstack@n-api.service[105513]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.sparse_logical_volumes = False {{(pid=105513) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 17:52:55.779950 dv-cinder-852009-8-iscsi devstack@n-api.service[105513]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.swtpm_enabled = False {{(pid=105513) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 17:52:55.780065 dv-cinder-852009-8-iscsi devstack@n-api.service[105512]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.swtpm_enabled = False {{(pid=105512) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 17:52:55.780269 dv-cinder-852009-8-iscsi devstack@n-api.service[105512]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.swtpm_group = tss {{(pid=105512) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 17:52:55.780367 dv-cinder-852009-8-iscsi devstack@n-api.service[105513]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.swtpm_group = tss {{(pid=105513) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 17:52:55.780616 dv-cinder-852009-8-iscsi devstack@n-api.service[105512]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.swtpm_user = tss {{(pid=105512) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 17:52:55.780706 dv-cinder-852009-8-iscsi devstack@n-api.service[105513]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.swtpm_user = tss {{(pid=105513) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 17:52:55.780943 dv-cinder-852009-8-iscsi devstack@n-api.service[105513]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.sysinfo_serial = unique {{(pid=105513) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 17:52:55.781041 dv-cinder-852009-8-iscsi devstack@n-api.service[105512]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.sysinfo_serial = unique {{(pid=105512) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 17:52:55.781247 dv-cinder-852009-8-iscsi devstack@n-api.service[105512]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.tx_queue_size = None {{(pid=105512) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 17:52:55.781342 dv-cinder-852009-8-iscsi devstack@n-api.service[105513]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.tx_queue_size = None {{(pid=105513) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 17:52:55.781561 dv-cinder-852009-8-iscsi devstack@n-api.service[105513]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.uid_maps = [] {{(pid=105513) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 17:52:55.781657 dv-cinder-852009-8-iscsi devstack@n-api.service[105512]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.uid_maps = [] {{(pid=105512) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 17:52:55.781867 dv-cinder-852009-8-iscsi devstack@n-api.service[105512]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.use_virtio_for_bridges = True {{(pid=105512) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 17:52:55.781961 dv-cinder-852009-8-iscsi devstack@n-api.service[105513]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.use_virtio_for_bridges = True {{(pid=105513) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 17:52:55.782201 dv-cinder-852009-8-iscsi devstack@n-api.service[105512]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.virt_type = kvm {{(pid=105512) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 17:52:55.782338 dv-cinder-852009-8-iscsi devstack@n-api.service[105513]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.virt_type = kvm {{(pid=105513) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 17:52:55.782512 dv-cinder-852009-8-iscsi devstack@n-api.service[105513]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.volume_clear = zero {{(pid=105513) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 17:52:55.782607 dv-cinder-852009-8-iscsi devstack@n-api.service[105512]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.volume_clear = zero {{(pid=105512) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 17:52:55.782819 dv-cinder-852009-8-iscsi devstack@n-api.service[105512]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.volume_clear_size = 0 {{(pid=105512) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 17:52:55.782914 dv-cinder-852009-8-iscsi devstack@n-api.service[105513]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.volume_clear_size = 0 {{(pid=105513) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 17:52:55.783135 dv-cinder-852009-8-iscsi devstack@n-api.service[105513]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.volume_use_multipath = False {{(pid=105513) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 17:52:55.783244 dv-cinder-852009-8-iscsi devstack@n-api.service[105512]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.volume_use_multipath = False {{(pid=105512) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 17:52:55.783433 dv-cinder-852009-8-iscsi devstack@n-api.service[105512]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_cache_path = None {{(pid=105512) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 17:52:55.783523 dv-cinder-852009-8-iscsi devstack@n-api.service[105513]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_cache_path = None {{(pid=105513) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 17:52:55.783753 dv-cinder-852009-8-iscsi devstack@n-api.service[105513]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_log_path = /var/log/vstorage/%(cluster_name)s/nova.log.gz {{(pid=105513) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 17:52:55.783851 dv-cinder-852009-8-iscsi devstack@n-api.service[105512]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_log_path = /var/log/vstorage/%(cluster_name)s/nova.log.gz {{(pid=105512) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 17:52:55.784069 dv-cinder-852009-8-iscsi devstack@n-api.service[105512]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_group = qemu {{(pid=105512) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 17:52:55.784157 dv-cinder-852009-8-iscsi devstack@n-api.service[105513]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_group = qemu {{(pid=105513) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 17:52:55.784382 dv-cinder-852009-8-iscsi devstack@n-api.service[105512]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_opts = [] {{(pid=105512) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 17:52:55.784583 dv-cinder-852009-8-iscsi devstack@n-api.service[105513]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_opts = [] {{(pid=105513) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 17:52:55.784725 dv-cinder-852009-8-iscsi devstack@n-api.service[105512]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_perms = 0770 {{(pid=105512) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 17:52:55.784823 dv-cinder-852009-8-iscsi devstack@n-api.service[105513]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_perms = 0770 {{(pid=105513) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 17:52:55.785140 dv-cinder-852009-8-iscsi devstack@n-api.service[105512]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_point_base = /opt/stack/data/nova/mnt {{(pid=105512) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 17:52:55.785229 dv-cinder-852009-8-iscsi devstack@n-api.service[105513]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_point_base = /opt/stack/data/nova/mnt {{(pid=105513) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 17:52:55.785462 dv-cinder-852009-8-iscsi devstack@n-api.service[105512]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_user = stack {{(pid=105512) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 17:52:55.785548 dv-cinder-852009-8-iscsi devstack@n-api.service[105513]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_user = stack {{(pid=105513) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 17:52:55.785772 dv-cinder-852009-8-iscsi devstack@n-api.service[105513]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.wait_soft_reboot_seconds = 120 {{(pid=105513) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 17:52:55.785914 dv-cinder-852009-8-iscsi devstack@n-api.service[105512]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.wait_soft_reboot_seconds = 120 {{(pid=105512) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 17:52:55.786099 dv-cinder-852009-8-iscsi devstack@n-api.service[105512]: DEBUG nova.api.openstack.wsgi_app [-] neutron.auth_section = None {{(pid=105512) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 17:52:55.786197 dv-cinder-852009-8-iscsi devstack@n-api.service[105513]: DEBUG nova.api.openstack.wsgi_app [-] neutron.auth_section = None {{(pid=105513) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 17:52:55.786416 dv-cinder-852009-8-iscsi devstack@n-api.service[105512]: DEBUG nova.api.openstack.wsgi_app [-] neutron.auth_type = password {{(pid=105512) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 17:52:55.786514 dv-cinder-852009-8-iscsi devstack@n-api.service[105513]: DEBUG nova.api.openstack.wsgi_app [-] neutron.auth_type = password {{(pid=105513) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 17:52:55.786723 dv-cinder-852009-8-iscsi devstack@n-api.service[105513]: DEBUG nova.api.openstack.wsgi_app [-] neutron.cafile = None {{(pid=105513) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 17:52:55.786817 dv-cinder-852009-8-iscsi devstack@n-api.service[105512]: DEBUG nova.api.openstack.wsgi_app [-] neutron.cafile = None {{(pid=105512) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 17:52:55.787026 dv-cinder-852009-8-iscsi devstack@n-api.service[105512]: DEBUG nova.api.openstack.wsgi_app [-] neutron.certfile = None {{(pid=105512) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 17:52:55.787158 dv-cinder-852009-8-iscsi devstack@n-api.service[105513]: DEBUG nova.api.openstack.wsgi_app [-] neutron.certfile = None {{(pid=105513) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 17:52:55.787367 dv-cinder-852009-8-iscsi devstack@n-api.service[105512]: DEBUG nova.api.openstack.wsgi_app [-] neutron.collect_timing = False {{(pid=105512) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 17:52:55.787456 dv-cinder-852009-8-iscsi devstack@n-api.service[105513]: DEBUG nova.api.openstack.wsgi_app [-] neutron.collect_timing = False {{(pid=105513) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 17:52:55.787672 dv-cinder-852009-8-iscsi devstack@n-api.service[105512]: DEBUG nova.api.openstack.wsgi_app [-] neutron.connect_retries = None {{(pid=105512) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 17:52:55.787768 dv-cinder-852009-8-iscsi devstack@n-api.service[105513]: DEBUG nova.api.openstack.wsgi_app [-] neutron.connect_retries = None {{(pid=105513) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 17:52:55.787977 dv-cinder-852009-8-iscsi devstack@n-api.service[105512]: DEBUG nova.api.openstack.wsgi_app [-] neutron.connect_retry_delay = None {{(pid=105512) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 17:52:55.788298 dv-cinder-852009-8-iscsi devstack@n-api.service[105512]: DEBUG nova.api.openstack.wsgi_app [-] neutron.default_floating_pool = public {{(pid=105512) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 17:52:55.788416 dv-cinder-852009-8-iscsi devstack@n-api.service[105513]: DEBUG nova.api.openstack.wsgi_app [-] neutron.connect_retry_delay = None {{(pid=105513) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 17:52:55.788628 dv-cinder-852009-8-iscsi devstack@n-api.service[105512]: DEBUG nova.api.openstack.wsgi_app [-] neutron.endpoint_override = None {{(pid=105512) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 17:52:55.788716 dv-cinder-852009-8-iscsi devstack@n-api.service[105513]: DEBUG nova.api.openstack.wsgi_app [-] neutron.default_floating_pool = public {{(pid=105513) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 17:52:55.788941 dv-cinder-852009-8-iscsi devstack@n-api.service[105512]: DEBUG nova.api.openstack.wsgi_app [-] neutron.extension_sync_interval = 600 {{(pid=105512) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 17:52:55.789039 dv-cinder-852009-8-iscsi devstack@n-api.service[105513]: DEBUG nova.api.openstack.wsgi_app [-] neutron.endpoint_override = None {{(pid=105513) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 17:52:55.789252 dv-cinder-852009-8-iscsi devstack@n-api.service[105512]: DEBUG nova.api.openstack.wsgi_app [-] neutron.http_retries = 3 {{(pid=105512) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 17:52:55.789340 dv-cinder-852009-8-iscsi devstack@n-api.service[105513]: DEBUG nova.api.openstack.wsgi_app [-] neutron.extension_sync_interval = 600 {{(pid=105513) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 17:52:55.789560 dv-cinder-852009-8-iscsi devstack@n-api.service[105512]: DEBUG nova.api.openstack.wsgi_app [-] neutron.insecure = False {{(pid=105512) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 17:52:55.789647 dv-cinder-852009-8-iscsi devstack@n-api.service[105513]: DEBUG nova.api.openstack.wsgi_app [-] neutron.http_retries = 3 {{(pid=105513) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 17:52:55.789863 dv-cinder-852009-8-iscsi devstack@n-api.service[105512]: DEBUG nova.api.openstack.wsgi_app [-] neutron.keyfile = None {{(pid=105512) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 17:52:55.789952 dv-cinder-852009-8-iscsi devstack@n-api.service[105513]: DEBUG nova.api.openstack.wsgi_app [-] neutron.insecure = False {{(pid=105513) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 17:52:55.790164 dv-cinder-852009-8-iscsi devstack@n-api.service[105512]: DEBUG nova.api.openstack.wsgi_app [-] neutron.max_version = None {{(pid=105512) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 17:52:55.790251 dv-cinder-852009-8-iscsi devstack@n-api.service[105513]: DEBUG nova.api.openstack.wsgi_app [-] neutron.keyfile = None {{(pid=105513) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 17:52:55.790470 dv-cinder-852009-8-iscsi devstack@n-api.service[105513]: DEBUG nova.api.openstack.wsgi_app [-] neutron.max_version = None {{(pid=105513) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 17:52:55.790557 dv-cinder-852009-8-iscsi devstack@n-api.service[105512]: DEBUG nova.api.openstack.wsgi_app [-] neutron.metadata_proxy_shared_secret = **** {{(pid=105512) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 17:52:55.790774 dv-cinder-852009-8-iscsi devstack@n-api.service[105512]: DEBUG nova.api.openstack.wsgi_app [-] neutron.min_version = None {{(pid=105512) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 17:52:55.790868 dv-cinder-852009-8-iscsi devstack@n-api.service[105513]: DEBUG nova.api.openstack.wsgi_app [-] neutron.metadata_proxy_shared_secret = **** {{(pid=105513) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 17:52:55.791128 dv-cinder-852009-8-iscsi devstack@n-api.service[105513]: DEBUG nova.api.openstack.wsgi_app [-] neutron.min_version = None {{(pid=105513) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 17:52:55.791230 dv-cinder-852009-8-iscsi devstack@n-api.service[105512]: DEBUG nova.api.openstack.wsgi_app [-] neutron.ovs_bridge = br-int {{(pid=105512) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 17:52:55.791436 dv-cinder-852009-8-iscsi devstack@n-api.service[105512]: DEBUG nova.api.openstack.wsgi_app [-] neutron.physnets = [] {{(pid=105512) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 17:52:55.791547 dv-cinder-852009-8-iscsi devstack@n-api.service[105513]: DEBUG nova.api.openstack.wsgi_app [-] neutron.ovs_bridge = br-int {{(pid=105513) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 17:52:55.791720 dv-cinder-852009-8-iscsi devstack@n-api.service[105512]: DEBUG nova.api.openstack.wsgi_app [-] neutron.region_name = RegionOne {{(pid=105512) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 17:52:55.791817 dv-cinder-852009-8-iscsi devstack@n-api.service[105513]: DEBUG nova.api.openstack.wsgi_app [-] neutron.physnets = [] {{(pid=105513) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 17:52:55.792042 dv-cinder-852009-8-iscsi devstack@n-api.service[105512]: DEBUG nova.api.openstack.wsgi_app [-] neutron.service_metadata_proxy = True {{(pid=105512) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 17:52:55.792141 dv-cinder-852009-8-iscsi devstack@n-api.service[105513]: DEBUG nova.api.openstack.wsgi_app [-] neutron.region_name = RegionOne {{(pid=105513) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 17:52:55.792342 dv-cinder-852009-8-iscsi devstack@n-api.service[105512]: DEBUG nova.api.openstack.wsgi_app [-] neutron.service_name = None {{(pid=105512) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 17:52:55.792459 dv-cinder-852009-8-iscsi devstack@n-api.service[105513]: DEBUG nova.api.openstack.wsgi_app [-] neutron.service_metadata_proxy = True {{(pid=105513) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 17:52:55.792685 dv-cinder-852009-8-iscsi devstack@n-api.service[105512]: DEBUG nova.api.openstack.wsgi_app [-] neutron.service_type = network {{(pid=105512) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 17:52:55.792773 dv-cinder-852009-8-iscsi devstack@n-api.service[105513]: DEBUG nova.api.openstack.wsgi_app [-] neutron.service_name = None {{(pid=105513) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 17:52:55.792993 dv-cinder-852009-8-iscsi devstack@n-api.service[105512]: DEBUG nova.api.openstack.wsgi_app [-] neutron.split_loggers = False {{(pid=105512) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 17:52:55.793081 dv-cinder-852009-8-iscsi devstack@n-api.service[105513]: DEBUG nova.api.openstack.wsgi_app [-] neutron.service_type = network {{(pid=105513) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 17:52:55.793296 dv-cinder-852009-8-iscsi devstack@n-api.service[105512]: DEBUG nova.api.openstack.wsgi_app [-] neutron.status_code_retries = None {{(pid=105512) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 17:52:55.793402 dv-cinder-852009-8-iscsi devstack@n-api.service[105513]: DEBUG nova.api.openstack.wsgi_app [-] neutron.split_loggers = False {{(pid=105513) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 17:52:55.793600 dv-cinder-852009-8-iscsi devstack@n-api.service[105513]: DEBUG nova.api.openstack.wsgi_app [-] neutron.status_code_retries = None {{(pid=105513) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 17:52:55.793686 dv-cinder-852009-8-iscsi devstack@n-api.service[105512]: DEBUG nova.api.openstack.wsgi_app [-] neutron.status_code_retry_delay = None {{(pid=105512) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 17:52:55.793954 dv-cinder-852009-8-iscsi devstack@n-api.service[105512]: DEBUG nova.api.openstack.wsgi_app [-] neutron.timeout = None {{(pid=105512) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 17:52:55.794055 dv-cinder-852009-8-iscsi devstack@n-api.service[105513]: DEBUG nova.api.openstack.wsgi_app [-] neutron.status_code_retry_delay = None {{(pid=105513) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 17:52:55.794205 dv-cinder-852009-8-iscsi devstack@n-api.service[105513]: DEBUG nova.api.openstack.wsgi_app [-] neutron.timeout = None {{(pid=105513) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 17:52:55.794303 dv-cinder-852009-8-iscsi devstack@n-api.service[105512]: DEBUG nova.api.openstack.wsgi_app [-] neutron.valid_interfaces = ['internal', 'public'] {{(pid=105512) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 17:52:55.794530 dv-cinder-852009-8-iscsi devstack@n-api.service[105512]: DEBUG nova.api.openstack.wsgi_app [-] neutron.version = None {{(pid=105512) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 17:52:55.794663 dv-cinder-852009-8-iscsi devstack@n-api.service[105513]: DEBUG nova.api.openstack.wsgi_app [-] neutron.valid_interfaces = ['internal', 'public'] {{(pid=105513) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 17:52:55.794848 dv-cinder-852009-8-iscsi devstack@n-api.service[105513]: DEBUG nova.api.openstack.wsgi_app [-] neutron.version = None {{(pid=105513) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 17:52:55.794946 dv-cinder-852009-8-iscsi devstack@n-api.service[105512]: DEBUG nova.api.openstack.wsgi_app [-] notifications.bdms_in_notifications = False {{(pid=105512) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 17:52:55.795173 dv-cinder-852009-8-iscsi devstack@n-api.service[105513]: DEBUG nova.api.openstack.wsgi_app [-] notifications.bdms_in_notifications = False {{(pid=105513) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 17:52:55.795263 dv-cinder-852009-8-iscsi devstack@n-api.service[105512]: DEBUG nova.api.openstack.wsgi_app [-] notifications.default_level = INFO {{(pid=105512) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 17:52:55.795497 dv-cinder-852009-8-iscsi devstack@n-api.service[105512]: DEBUG nova.api.openstack.wsgi_app [-] notifications.notification_format = unversioned {{(pid=105512) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 17:52:55.795584 dv-cinder-852009-8-iscsi devstack@n-api.service[105513]: DEBUG nova.api.openstack.wsgi_app [-] notifications.default_level = INFO {{(pid=105513) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 17:52:55.795807 dv-cinder-852009-8-iscsi devstack@n-api.service[105512]: DEBUG nova.api.openstack.wsgi_app [-] notifications.notify_on_state_change = None {{(pid=105512) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 17:52:55.795894 dv-cinder-852009-8-iscsi devstack@n-api.service[105513]: DEBUG nova.api.openstack.wsgi_app [-] notifications.notification_format = unversioned {{(pid=105513) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 17:52:55.796138 dv-cinder-852009-8-iscsi devstack@n-api.service[105512]: DEBUG nova.api.openstack.wsgi_app [-] notifications.versioned_notifications_topics = ['versioned_notifications'] {{(pid=105512) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 17:52:55.796227 dv-cinder-852009-8-iscsi devstack@n-api.service[105513]: DEBUG nova.api.openstack.wsgi_app [-] notifications.notify_on_state_change = None {{(pid=105513) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 17:52:55.796484 dv-cinder-852009-8-iscsi devstack@n-api.service[105512]: DEBUG nova.api.openstack.wsgi_app [-] pci.alias = [] {{(pid=105512) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 17:52:55.796588 dv-cinder-852009-8-iscsi devstack@n-api.service[105513]: DEBUG nova.api.openstack.wsgi_app [-] notifications.versioned_notifications_topics = ['versioned_notifications'] {{(pid=105513) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 17:52:55.796807 dv-cinder-852009-8-iscsi devstack@n-api.service[105512]: DEBUG nova.api.openstack.wsgi_app [-] pci.device_spec = [] {{(pid=105512) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 17:52:55.796902 dv-cinder-852009-8-iscsi devstack@n-api.service[105513]: DEBUG nova.api.openstack.wsgi_app [-] pci.alias = [] {{(pid=105513) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 17:52:55.797115 dv-cinder-852009-8-iscsi devstack@n-api.service[105512]: DEBUG nova.api.openstack.wsgi_app [-] pci.report_in_placement = False {{(pid=105512) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 17:52:55.797211 dv-cinder-852009-8-iscsi devstack@n-api.service[105513]: DEBUG nova.api.openstack.wsgi_app [-] pci.device_spec = [] {{(pid=105513) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 17:52:55.797434 dv-cinder-852009-8-iscsi devstack@n-api.service[105512]: DEBUG nova.api.openstack.wsgi_app [-] placement.auth_section = None {{(pid=105512) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 17:52:55.797566 dv-cinder-852009-8-iscsi devstack@n-api.service[105513]: DEBUG nova.api.openstack.wsgi_app [-] pci.report_in_placement = False {{(pid=105513) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 17:52:55.797758 dv-cinder-852009-8-iscsi devstack@n-api.service[105512]: DEBUG nova.api.openstack.wsgi_app [-] placement.auth_type = password {{(pid=105512) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 17:52:55.797845 dv-cinder-852009-8-iscsi devstack@n-api.service[105513]: DEBUG nova.api.openstack.wsgi_app [-] placement.auth_section = None {{(pid=105513) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 17:52:55.798124 dv-cinder-852009-8-iscsi devstack@n-api.service[105512]: DEBUG nova.api.openstack.wsgi_app [-] placement.cafile = None {{(pid=105512) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 17:52:55.798260 dv-cinder-852009-8-iscsi devstack@n-api.service[105513]: DEBUG nova.api.openstack.wsgi_app [-] placement.auth_type = password {{(pid=105513) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 17:52:55.798365 dv-cinder-852009-8-iscsi devstack@n-api.service[105512]: DEBUG nova.api.openstack.wsgi_app [-] placement.certfile = None {{(pid=105512) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 17:52:55.798454 dv-cinder-852009-8-iscsi devstack@n-api.service[105513]: DEBUG nova.api.openstack.wsgi_app [-] placement.cafile = None {{(pid=105513) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 17:52:55.798673 dv-cinder-852009-8-iscsi devstack@n-api.service[105512]: DEBUG nova.api.openstack.wsgi_app [-] placement.collect_timing = False {{(pid=105512) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 17:52:55.798776 dv-cinder-852009-8-iscsi devstack@n-api.service[105513]: DEBUG nova.api.openstack.wsgi_app [-] placement.certfile = None {{(pid=105513) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 17:52:55.798978 dv-cinder-852009-8-iscsi devstack@n-api.service[105512]: DEBUG nova.api.openstack.wsgi_app [-] placement.connect_retries = None {{(pid=105512) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 17:52:55.799065 dv-cinder-852009-8-iscsi devstack@n-api.service[105513]: DEBUG nova.api.openstack.wsgi_app [-] placement.collect_timing = False {{(pid=105513) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 17:52:55.799282 dv-cinder-852009-8-iscsi devstack@n-api.service[105513]: DEBUG nova.api.openstack.wsgi_app [-] placement.connect_retries = None {{(pid=105513) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 17:52:55.799367 dv-cinder-852009-8-iscsi devstack@n-api.service[105512]: DEBUG nova.api.openstack.wsgi_app [-] placement.connect_retry_delay = None {{(pid=105512) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 17:52:55.799583 dv-cinder-852009-8-iscsi devstack@n-api.service[105512]: DEBUG nova.api.openstack.wsgi_app [-] placement.endpoint_override = None {{(pid=105512) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 17:52:55.799679 dv-cinder-852009-8-iscsi devstack@n-api.service[105513]: DEBUG nova.api.openstack.wsgi_app [-] placement.connect_retry_delay = None {{(pid=105513) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 17:52:55.799887 dv-cinder-852009-8-iscsi devstack@n-api.service[105513]: DEBUG nova.api.openstack.wsgi_app [-] placement.endpoint_override = None {{(pid=105513) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 17:52:55.799973 dv-cinder-852009-8-iscsi devstack@n-api.service[105512]: DEBUG nova.api.openstack.wsgi_app [-] placement.insecure = False {{(pid=105512) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 17:52:55.800187 dv-cinder-852009-8-iscsi devstack@n-api.service[105512]: DEBUG nova.api.openstack.wsgi_app [-] placement.keyfile = None {{(pid=105512) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 17:52:55.800312 dv-cinder-852009-8-iscsi devstack@n-api.service[105513]: DEBUG nova.api.openstack.wsgi_app [-] placement.insecure = False {{(pid=105513) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 17:52:55.800515 dv-cinder-852009-8-iscsi devstack@n-api.service[105513]: DEBUG nova.api.openstack.wsgi_app [-] placement.keyfile = None {{(pid=105513) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 17:52:55.800620 dv-cinder-852009-8-iscsi devstack@n-api.service[105512]: DEBUG nova.api.openstack.wsgi_app [-] placement.max_version = None {{(pid=105512) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 17:52:55.800819 dv-cinder-852009-8-iscsi devstack@n-api.service[105512]: DEBUG nova.api.openstack.wsgi_app [-] placement.min_version = None {{(pid=105512) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 17:52:55.800906 dv-cinder-852009-8-iscsi devstack@n-api.service[105513]: DEBUG nova.api.openstack.wsgi_app [-] placement.max_version = None {{(pid=105513) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 17:52:55.801122 dv-cinder-852009-8-iscsi devstack@n-api.service[105513]: DEBUG nova.api.openstack.wsgi_app [-] placement.min_version = None {{(pid=105513) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 17:52:55.801207 dv-cinder-852009-8-iscsi devstack@n-api.service[105512]: DEBUG nova.api.openstack.wsgi_app [-] placement.region_name = RegionOne {{(pid=105512) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 17:52:55.801429 dv-cinder-852009-8-iscsi devstack@n-api.service[105512]: DEBUG nova.api.openstack.wsgi_app [-] placement.service_name = None {{(pid=105512) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 17:52:55.801525 dv-cinder-852009-8-iscsi devstack@n-api.service[105513]: DEBUG nova.api.openstack.wsgi_app [-] placement.region_name = RegionOne {{(pid=105513) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 17:52:55.801740 dv-cinder-852009-8-iscsi devstack@n-api.service[105513]: DEBUG nova.api.openstack.wsgi_app [-] placement.service_name = None {{(pid=105513) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 17:52:55.801825 dv-cinder-852009-8-iscsi devstack@n-api.service[105512]: DEBUG nova.api.openstack.wsgi_app [-] placement.service_type = placement {{(pid=105512) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 17:52:55.802045 dv-cinder-852009-8-iscsi devstack@n-api.service[105512]: DEBUG nova.api.openstack.wsgi_app [-] placement.split_loggers = False {{(pid=105512) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 17:52:55.802131 dv-cinder-852009-8-iscsi devstack@n-api.service[105513]: DEBUG nova.api.openstack.wsgi_app [-] placement.service_type = placement {{(pid=105513) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 17:52:55.802351 dv-cinder-852009-8-iscsi devstack@n-api.service[105512]: DEBUG nova.api.openstack.wsgi_app [-] placement.status_code_retries = None {{(pid=105512) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 17:52:55.802441 dv-cinder-852009-8-iscsi devstack@n-api.service[105513]: DEBUG nova.api.openstack.wsgi_app [-] placement.split_loggers = False {{(pid=105513) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 17:52:55.802657 dv-cinder-852009-8-iscsi devstack@n-api.service[105513]: DEBUG nova.api.openstack.wsgi_app [-] placement.status_code_retries = None {{(pid=105513) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 17:52:55.802792 dv-cinder-852009-8-iscsi devstack@n-api.service[105512]: DEBUG nova.api.openstack.wsgi_app [-] placement.status_code_retry_delay = None {{(pid=105512) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 17:52:55.803017 dv-cinder-852009-8-iscsi devstack@n-api.service[105512]: DEBUG nova.api.openstack.wsgi_app [-] placement.timeout = None {{(pid=105512) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 17:52:55.803104 dv-cinder-852009-8-iscsi devstack@n-api.service[105513]: DEBUG nova.api.openstack.wsgi_app [-] placement.status_code_retry_delay = None {{(pid=105513) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 17:52:55.803319 dv-cinder-852009-8-iscsi devstack@n-api.service[105513]: DEBUG nova.api.openstack.wsgi_app [-] placement.timeout = None {{(pid=105513) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 17:52:55.803407 dv-cinder-852009-8-iscsi devstack@n-api.service[105512]: DEBUG nova.api.openstack.wsgi_app [-] placement.valid_interfaces = ['internal', 'public'] {{(pid=105512) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 17:52:55.803650 dv-cinder-852009-8-iscsi devstack@n-api.service[105512]: DEBUG nova.api.openstack.wsgi_app [-] placement.version = None {{(pid=105512) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 17:52:55.803744 dv-cinder-852009-8-iscsi devstack@n-api.service[105513]: DEBUG nova.api.openstack.wsgi_app [-] placement.valid_interfaces = ['internal', 'public'] {{(pid=105513) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 17:52:55.803972 dv-cinder-852009-8-iscsi devstack@n-api.service[105513]: DEBUG nova.api.openstack.wsgi_app [-] placement.version = None {{(pid=105513) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 17:52:55.804070 dv-cinder-852009-8-iscsi devstack@n-api.service[105512]: DEBUG nova.api.openstack.wsgi_app [-] quota.cores = 20 {{(pid=105512) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 17:52:55.804273 dv-cinder-852009-8-iscsi devstack@n-api.service[105512]: DEBUG nova.api.openstack.wsgi_app [-] quota.count_usage_from_placement = False {{(pid=105512) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 17:52:55.804360 dv-cinder-852009-8-iscsi devstack@n-api.service[105513]: DEBUG nova.api.openstack.wsgi_app [-] quota.cores = 20 {{(pid=105513) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 17:52:55.804619 dv-cinder-852009-8-iscsi devstack@n-api.service[105513]: DEBUG nova.api.openstack.wsgi_app [-] quota.count_usage_from_placement = False {{(pid=105513) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 17:52:55.804709 dv-cinder-852009-8-iscsi devstack@n-api.service[105512]: DEBUG nova.api.openstack.wsgi_app [-] quota.driver = nova.quota.DbQuotaDriver {{(pid=105512) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 17:52:55.804937 dv-cinder-852009-8-iscsi devstack@n-api.service[105512]: DEBUG nova.api.openstack.wsgi_app [-] quota.injected_file_content_bytes = 10240 {{(pid=105512) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 17:52:55.805023 dv-cinder-852009-8-iscsi devstack@n-api.service[105513]: DEBUG nova.api.openstack.wsgi_app [-] quota.driver = nova.quota.DbQuotaDriver {{(pid=105513) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 17:52:55.805254 dv-cinder-852009-8-iscsi devstack@n-api.service[105512]: DEBUG nova.api.openstack.wsgi_app [-] quota.injected_file_path_length = 255 {{(pid=105512) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 17:52:55.805342 dv-cinder-852009-8-iscsi devstack@n-api.service[105513]: DEBUG nova.api.openstack.wsgi_app [-] quota.injected_file_content_bytes = 10240 {{(pid=105513) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 17:52:55.805569 dv-cinder-852009-8-iscsi devstack@n-api.service[105513]: DEBUG nova.api.openstack.wsgi_app [-] quota.injected_file_path_length = 255 {{(pid=105513) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 17:52:55.805654 dv-cinder-852009-8-iscsi devstack@n-api.service[105512]: DEBUG nova.api.openstack.wsgi_app [-] quota.injected_files = 5 {{(pid=105512) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 17:52:55.805882 dv-cinder-852009-8-iscsi devstack@n-api.service[105512]: DEBUG nova.api.openstack.wsgi_app [-] quota.instances = 10 {{(pid=105512) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 17:52:55.805976 dv-cinder-852009-8-iscsi devstack@n-api.service[105513]: DEBUG nova.api.openstack.wsgi_app [-] quota.injected_files = 5 {{(pid=105513) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 17:52:55.806200 dv-cinder-852009-8-iscsi devstack@n-api.service[105513]: DEBUG nova.api.openstack.wsgi_app [-] quota.instances = 10 {{(pid=105513) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 17:52:55.806287 dv-cinder-852009-8-iscsi devstack@n-api.service[105512]: DEBUG nova.api.openstack.wsgi_app [-] quota.key_pairs = 100 {{(pid=105512) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 17:52:55.806513 dv-cinder-852009-8-iscsi devstack@n-api.service[105512]: DEBUG nova.api.openstack.wsgi_app [-] quota.metadata_items = 128 {{(pid=105512) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 17:52:55.806599 dv-cinder-852009-8-iscsi devstack@n-api.service[105513]: DEBUG nova.api.openstack.wsgi_app [-] quota.key_pairs = 100 {{(pid=105513) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 17:52:55.806830 dv-cinder-852009-8-iscsi devstack@n-api.service[105513]: DEBUG nova.api.openstack.wsgi_app [-] quota.metadata_items = 128 {{(pid=105513) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 17:52:55.806929 dv-cinder-852009-8-iscsi devstack@n-api.service[105512]: DEBUG nova.api.openstack.wsgi_app [-] quota.ram = 51200 {{(pid=105512) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 17:52:55.807136 dv-cinder-852009-8-iscsi devstack@n-api.service[105512]: DEBUG nova.api.openstack.wsgi_app [-] quota.recheck_quota = True {{(pid=105512) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 17:52:55.807221 dv-cinder-852009-8-iscsi devstack@n-api.service[105513]: DEBUG nova.api.openstack.wsgi_app [-] quota.ram = 51200 {{(pid=105513) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 17:52:55.807449 dv-cinder-852009-8-iscsi devstack@n-api.service[105513]: DEBUG nova.api.openstack.wsgi_app [-] quota.recheck_quota = True {{(pid=105513) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 17:52:55.807543 dv-cinder-852009-8-iscsi devstack@n-api.service[105512]: DEBUG nova.api.openstack.wsgi_app [-] quota.server_group_members = 10 {{(pid=105512) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 17:52:55.807758 dv-cinder-852009-8-iscsi devstack@n-api.service[105512]: DEBUG nova.api.openstack.wsgi_app [-] quota.server_groups = 10 {{(pid=105512) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 17:52:55.807854 dv-cinder-852009-8-iscsi devstack@n-api.service[105513]: DEBUG nova.api.openstack.wsgi_app [-] quota.server_group_members = 10 {{(pid=105513) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 17:52:55.808071 dv-cinder-852009-8-iscsi devstack@n-api.service[105513]: DEBUG nova.api.openstack.wsgi_app [-] quota.server_groups = 10 {{(pid=105513) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 17:52:55.808156 dv-cinder-852009-8-iscsi devstack@n-api.service[105512]: DEBUG nova.api.openstack.wsgi_app [-] rdp.enabled = False {{(pid=105512) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 17:52:55.808398 dv-cinder-852009-8-iscsi devstack@n-api.service[105513]: DEBUG nova.api.openstack.wsgi_app [-] rdp.enabled = False {{(pid=105513) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 17:52:55.808670 dv-cinder-852009-8-iscsi devstack@n-api.service[105512]: DEBUG nova.api.openstack.wsgi_app [-] rdp.html5_proxy_base_url = http://127.0.0.1:6083/ {{(pid=105512) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 17:52:55.808990 dv-cinder-852009-8-iscsi devstack@n-api.service[105513]: DEBUG nova.api.openstack.wsgi_app [-] rdp.html5_proxy_base_url = http://127.0.0.1:6083/ {{(pid=105513) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 17:52:55.809089 dv-cinder-852009-8-iscsi devstack@n-api.service[105512]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.discover_hosts_in_cells_interval = -1 {{(pid=105512) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 17:52:55.809308 dv-cinder-852009-8-iscsi devstack@n-api.service[105512]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.enable_isolated_aggregate_filtering = False {{(pid=105512) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 17:52:55.809394 dv-cinder-852009-8-iscsi devstack@n-api.service[105513]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.discover_hosts_in_cells_interval = -1 {{(pid=105513) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 17:52:55.809624 dv-cinder-852009-8-iscsi devstack@n-api.service[105512]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.image_metadata_prefilter = False {{(pid=105512) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 17:52:55.809712 dv-cinder-852009-8-iscsi devstack@n-api.service[105513]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.enable_isolated_aggregate_filtering = False {{(pid=105513) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 17:52:55.809938 dv-cinder-852009-8-iscsi devstack@n-api.service[105513]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.image_metadata_prefilter = False {{(pid=105513) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 17:52:55.810036 dv-cinder-852009-8-iscsi devstack@n-api.service[105512]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.limit_tenants_to_placement_aggregate = False {{(pid=105512) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 17:52:55.810250 dv-cinder-852009-8-iscsi devstack@n-api.service[105512]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.max_attempts = 3 {{(pid=105512) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 17:52:55.810336 dv-cinder-852009-8-iscsi devstack@n-api.service[105513]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.limit_tenants_to_placement_aggregate = False {{(pid=105513) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 17:52:55.810564 dv-cinder-852009-8-iscsi devstack@n-api.service[105513]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.max_attempts = 3 {{(pid=105513) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 17:52:55.810657 dv-cinder-852009-8-iscsi devstack@n-api.service[105512]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.max_placement_results = 1000 {{(pid=105512) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 17:52:55.810877 dv-cinder-852009-8-iscsi devstack@n-api.service[105512]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.placement_aggregate_required_for_tenants = False {{(pid=105512) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 17:52:55.810965 dv-cinder-852009-8-iscsi devstack@n-api.service[105513]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.max_placement_results = 1000 {{(pid=105513) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 17:52:55.811187 dv-cinder-852009-8-iscsi devstack@n-api.service[105513]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.placement_aggregate_required_for_tenants = False {{(pid=105513) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 17:52:55.811280 dv-cinder-852009-8-iscsi devstack@n-api.service[105512]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.query_placement_for_availability_zone = True {{(pid=105512) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 17:52:55.811497 dv-cinder-852009-8-iscsi devstack@n-api.service[105512]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.query_placement_for_image_type_support = False {{(pid=105512) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 17:52:55.811587 dv-cinder-852009-8-iscsi devstack@n-api.service[105513]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.query_placement_for_availability_zone = True {{(pid=105513) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 17:52:55.811808 dv-cinder-852009-8-iscsi devstack@n-api.service[105513]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.query_placement_for_image_type_support = False {{(pid=105513) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 17:52:55.811896 dv-cinder-852009-8-iscsi devstack@n-api.service[105512]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.query_placement_for_routed_network_aggregates = False {{(pid=105512) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 17:52:55.812122 dv-cinder-852009-8-iscsi devstack@n-api.service[105513]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.query_placement_for_routed_network_aggregates = False {{(pid=105513) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 17:52:55.812209 dv-cinder-852009-8-iscsi devstack@n-api.service[105512]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.workers = 2 {{(pid=105512) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 17:52:55.812457 dv-cinder-852009-8-iscsi devstack@n-api.service[105512]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.aggregate_image_properties_isolation_namespace = None {{(pid=105512) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 17:52:55.812560 dv-cinder-852009-8-iscsi devstack@n-api.service[105513]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.workers = 2 {{(pid=105513) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 17:52:55.812786 dv-cinder-852009-8-iscsi devstack@n-api.service[105512]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.aggregate_image_properties_isolation_separator = . {{(pid=105512) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 17:52:55.812873 dv-cinder-852009-8-iscsi devstack@n-api.service[105513]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.aggregate_image_properties_isolation_namespace = None {{(pid=105513) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 17:52:55.813113 dv-cinder-852009-8-iscsi devstack@n-api.service[105513]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.aggregate_image_properties_isolation_separator = . {{(pid=105513) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 17:52:55.813199 dv-cinder-852009-8-iscsi devstack@n-api.service[105512]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.available_filters = ['nova.scheduler.filters.all_filters'] {{(pid=105512) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 17:52:55.813477 dv-cinder-852009-8-iscsi devstack@n-api.service[105512]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.build_failure_weight_multiplier = 1000000.0 {{(pid=105512) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 17:52:55.813589 dv-cinder-852009-8-iscsi devstack@n-api.service[105513]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.available_filters = ['nova.scheduler.filters.all_filters'] {{(pid=105513) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 17:52:55.813758 dv-cinder-852009-8-iscsi devstack@n-api.service[105512]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.cpu_weight_multiplier = 1.0 {{(pid=105512) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 17:52:55.813847 dv-cinder-852009-8-iscsi devstack@n-api.service[105513]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.build_failure_weight_multiplier = 1000000.0 {{(pid=105513) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 17:52:55.814169 dv-cinder-852009-8-iscsi devstack@n-api.service[105513]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.cpu_weight_multiplier = 1.0 {{(pid=105513) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 17:52:55.814270 dv-cinder-852009-8-iscsi devstack@n-api.service[105512]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.cross_cell_move_weight_multiplier = 1000000.0 {{(pid=105512) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 17:52:55.814388 dv-cinder-852009-8-iscsi devstack@n-api.service[105512]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.disk_weight_multiplier = 1.0 {{(pid=105512) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 17:52:55.814484 dv-cinder-852009-8-iscsi devstack@n-api.service[105513]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.cross_cell_move_weight_multiplier = 1000000.0 {{(pid=105513) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 17:52:55.814706 dv-cinder-852009-8-iscsi devstack@n-api.service[105513]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.disk_weight_multiplier = 1.0 {{(pid=105513) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 17:52:55.814803 dv-cinder-852009-8-iscsi devstack@n-api.service[105512]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.enabled_filters = ['AvailabilityZoneFilter', 'ComputeFilter', 'ComputeCapabilitiesFilter', 'ImagePropertiesFilter', 'ServerGroupAntiAffinityFilter', 'ServerGroupAffinityFilter', 'SameHostFilter', 'DifferentHostFilter'] {{(pid=105512) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 17:52:55.815050 dv-cinder-852009-8-iscsi devstack@n-api.service[105512]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.host_subset_size = 1 {{(pid=105512) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 17:52:55.815137 dv-cinder-852009-8-iscsi devstack@n-api.service[105513]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.enabled_filters = ['AvailabilityZoneFilter', 'ComputeFilter', 'ComputeCapabilitiesFilter', 'ImagePropertiesFilter', 'ServerGroupAntiAffinityFilter', 'ServerGroupAffinityFilter', 'SameHostFilter', 'DifferentHostFilter'] {{(pid=105513) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 17:52:55.815360 dv-cinder-852009-8-iscsi devstack@n-api.service[105512]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.image_properties_default_architecture = None {{(pid=105512) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 17:52:55.815526 dv-cinder-852009-8-iscsi devstack@n-api.service[105513]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.host_subset_size = 1 {{(pid=105513) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 17:52:55.815668 dv-cinder-852009-8-iscsi devstack@n-api.service[105513]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.image_properties_default_architecture = None {{(pid=105513) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 17:52:55.815755 dv-cinder-852009-8-iscsi devstack@n-api.service[105512]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.io_ops_weight_multiplier = -1.0 {{(pid=105512) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 17:52:55.815981 dv-cinder-852009-8-iscsi devstack@n-api.service[105512]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.isolated_hosts = [] {{(pid=105512) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 17:52:55.816081 dv-cinder-852009-8-iscsi devstack@n-api.service[105513]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.io_ops_weight_multiplier = -1.0 {{(pid=105513) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 17:52:55.816297 dv-cinder-852009-8-iscsi devstack@n-api.service[105512]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.isolated_images = [] {{(pid=105512) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 17:52:55.816384 dv-cinder-852009-8-iscsi devstack@n-api.service[105513]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.isolated_hosts = [] {{(pid=105513) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 17:52:55.816640 dv-cinder-852009-8-iscsi devstack@n-api.service[105513]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.isolated_images = [] {{(pid=105513) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 17:52:55.816731 dv-cinder-852009-8-iscsi devstack@n-api.service[105512]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.max_instances_per_host = 50 {{(pid=105512) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 17:52:55.816949 dv-cinder-852009-8-iscsi devstack@n-api.service[105512]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.max_io_ops_per_host = 8 {{(pid=105512) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 17:52:55.817054 dv-cinder-852009-8-iscsi devstack@n-api.service[105513]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.max_instances_per_host = 50 {{(pid=105513) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 17:52:55.817261 dv-cinder-852009-8-iscsi devstack@n-api.service[105513]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.max_io_ops_per_host = 8 {{(pid=105513) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 17:52:55.817357 dv-cinder-852009-8-iscsi devstack@n-api.service[105512]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.pci_weight_multiplier = 1.0 {{(pid=105512) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 17:52:55.817571 dv-cinder-852009-8-iscsi devstack@n-api.service[105512]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.ram_weight_multiplier = 1.0 {{(pid=105512) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 17:52:55.817665 dv-cinder-852009-8-iscsi devstack@n-api.service[105513]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.pci_weight_multiplier = 1.0 {{(pid=105513) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 17:52:55.817883 dv-cinder-852009-8-iscsi devstack@n-api.service[105512]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.restrict_isolated_hosts_to_isolated_images = True {{(pid=105512) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 17:52:55.817980 dv-cinder-852009-8-iscsi devstack@n-api.service[105513]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.ram_weight_multiplier = 1.0 {{(pid=105513) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 17:52:55.818193 dv-cinder-852009-8-iscsi devstack@n-api.service[105512]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.shuffle_best_same_weighed_hosts = False {{(pid=105512) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 17:52:55.818280 dv-cinder-852009-8-iscsi devstack@n-api.service[105513]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.restrict_isolated_hosts_to_isolated_images = True {{(pid=105513) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 17:52:55.818534 dv-cinder-852009-8-iscsi devstack@n-api.service[105513]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.shuffle_best_same_weighed_hosts = False {{(pid=105513) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 17:52:55.818629 dv-cinder-852009-8-iscsi devstack@n-api.service[105512]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.soft_affinity_weight_multiplier = 1.0 {{(pid=105512) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 17:52:55.818845 dv-cinder-852009-8-iscsi devstack@n-api.service[105512]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.soft_anti_affinity_weight_multiplier = 1.0 {{(pid=105512) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 17:52:55.818940 dv-cinder-852009-8-iscsi devstack@n-api.service[105513]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.soft_affinity_weight_multiplier = 1.0 {{(pid=105513) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 17:52:55.819158 dv-cinder-852009-8-iscsi devstack@n-api.service[105513]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.soft_anti_affinity_weight_multiplier = 1.0 {{(pid=105513) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 17:52:55.819245 dv-cinder-852009-8-iscsi devstack@n-api.service[105512]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.track_instance_changes = False {{(pid=105512) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 17:52:55.819489 dv-cinder-852009-8-iscsi devstack@n-api.service[105513]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.track_instance_changes = False {{(pid=105513) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 17:52:55.819581 dv-cinder-852009-8-iscsi devstack@n-api.service[105512]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.weight_classes = ['nova.scheduler.weights.all_weighers'] {{(pid=105512) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 17:52:55.819805 dv-cinder-852009-8-iscsi devstack@n-api.service[105512]: DEBUG nova.api.openstack.wsgi_app [-] metrics.required = True {{(pid=105512) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 17:52:55.819901 dv-cinder-852009-8-iscsi devstack@n-api.service[105513]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.weight_classes = ['nova.scheduler.weights.all_weighers'] {{(pid=105513) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 17:52:55.820120 dv-cinder-852009-8-iscsi devstack@n-api.service[105512]: DEBUG nova.api.openstack.wsgi_app [-] metrics.weight_multiplier = 1.0 {{(pid=105512) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 17:52:55.820214 dv-cinder-852009-8-iscsi devstack@n-api.service[105513]: DEBUG nova.api.openstack.wsgi_app [-] metrics.required = True {{(pid=105513) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 17:52:55.820512 dv-cinder-852009-8-iscsi devstack@n-api.service[105512]: DEBUG nova.api.openstack.wsgi_app [-] metrics.weight_of_unavailable = -10000.0 {{(pid=105512) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 17:52:55.820618 dv-cinder-852009-8-iscsi devstack@n-api.service[105513]: DEBUG nova.api.openstack.wsgi_app [-] metrics.weight_multiplier = 1.0 {{(pid=105513) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 17:52:55.820771 dv-cinder-852009-8-iscsi devstack@n-api.service[105512]: DEBUG nova.api.openstack.wsgi_app [-] metrics.weight_setting = [] {{(pid=105512) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 17:52:55.820867 dv-cinder-852009-8-iscsi devstack@n-api.service[105513]: DEBUG nova.api.openstack.wsgi_app [-] metrics.weight_of_unavailable = -10000.0 {{(pid=105513) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 17:52:55.821085 dv-cinder-852009-8-iscsi devstack@n-api.service[105513]: DEBUG nova.api.openstack.wsgi_app [-] metrics.weight_setting = [] {{(pid=105513) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 17:52:55.821294 dv-cinder-852009-8-iscsi devstack@n-api.service[105512]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.base_url = ws://127.0.0.1:6083/ {{(pid=105512) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 17:52:55.821607 dv-cinder-852009-8-iscsi devstack@n-api.service[105512]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.enabled = False {{(pid=105512) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 17:52:55.821693 dv-cinder-852009-8-iscsi devstack@n-api.service[105513]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.base_url = ws://127.0.0.1:6083/ {{(pid=105513) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 17:52:55.821926 dv-cinder-852009-8-iscsi devstack@n-api.service[105513]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.enabled = False {{(pid=105513) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 17:52:55.822019 dv-cinder-852009-8-iscsi devstack@n-api.service[105512]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.port_range = 10000:20000 {{(pid=105512) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 17:52:55.822247 dv-cinder-852009-8-iscsi devstack@n-api.service[105512]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.proxyclient_address = 127.0.0.1 {{(pid=105512) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 17:52:55.822333 dv-cinder-852009-8-iscsi devstack@n-api.service[105513]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.port_range = 10000:20000 {{(pid=105513) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 17:52:55.822570 dv-cinder-852009-8-iscsi devstack@n-api.service[105512]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.serialproxy_host = 0.0.0.0 {{(pid=105512) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 17:52:55.822668 dv-cinder-852009-8-iscsi devstack@n-api.service[105513]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.proxyclient_address = 127.0.0.1 {{(pid=105513) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 17:52:55.822887 dv-cinder-852009-8-iscsi devstack@n-api.service[105512]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.serialproxy_port = 6083 {{(pid=105512) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 17:52:55.822974 dv-cinder-852009-8-iscsi devstack@n-api.service[105513]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.serialproxy_host = 0.0.0.0 {{(pid=105513) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 17:52:55.823207 dv-cinder-852009-8-iscsi devstack@n-api.service[105512]: DEBUG nova.api.openstack.wsgi_app [-] service_user.auth_section = None {{(pid=105512) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 17:52:55.823293 dv-cinder-852009-8-iscsi devstack@n-api.service[105513]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.serialproxy_port = 6083 {{(pid=105513) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 17:52:55.823587 dv-cinder-852009-8-iscsi devstack@n-api.service[105512]: DEBUG nova.api.openstack.wsgi_app [-] service_user.auth_type = password {{(pid=105512) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 17:52:55.823701 dv-cinder-852009-8-iscsi devstack@n-api.service[105513]: DEBUG nova.api.openstack.wsgi_app [-] service_user.auth_section = None {{(pid=105513) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 17:52:55.823850 dv-cinder-852009-8-iscsi devstack@n-api.service[105512]: DEBUG nova.api.openstack.wsgi_app [-] service_user.cafile = None {{(pid=105512) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 17:52:55.823938 dv-cinder-852009-8-iscsi devstack@n-api.service[105513]: DEBUG nova.api.openstack.wsgi_app [-] service_user.auth_type = password {{(pid=105513) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 17:52:55.824155 dv-cinder-852009-8-iscsi devstack@n-api.service[105512]: DEBUG nova.api.openstack.wsgi_app [-] service_user.certfile = None {{(pid=105512) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 17:52:55.824345 dv-cinder-852009-8-iscsi devstack@n-api.service[105513]: DEBUG nova.api.openstack.wsgi_app [-] service_user.cafile = None {{(pid=105513) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 17:52:55.824509 dv-cinder-852009-8-iscsi devstack@n-api.service[105512]: DEBUG nova.api.openstack.wsgi_app [-] service_user.collect_timing = False {{(pid=105512) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 17:52:55.824614 dv-cinder-852009-8-iscsi devstack@n-api.service[105513]: DEBUG nova.api.openstack.wsgi_app [-] service_user.certfile = None {{(pid=105513) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 17:52:55.824790 dv-cinder-852009-8-iscsi devstack@n-api.service[105512]: DEBUG nova.api.openstack.wsgi_app [-] service_user.insecure = False {{(pid=105512) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 17:52:55.824886 dv-cinder-852009-8-iscsi devstack@n-api.service[105513]: DEBUG nova.api.openstack.wsgi_app [-] service_user.collect_timing = False {{(pid=105513) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 17:52:55.825094 dv-cinder-852009-8-iscsi devstack@n-api.service[105512]: DEBUG nova.api.openstack.wsgi_app [-] service_user.keyfile = None {{(pid=105512) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 17:52:55.825181 dv-cinder-852009-8-iscsi devstack@n-api.service[105513]: DEBUG nova.api.openstack.wsgi_app [-] service_user.insecure = False {{(pid=105513) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 17:52:55.825417 dv-cinder-852009-8-iscsi devstack@n-api.service[105512]: DEBUG nova.api.openstack.wsgi_app [-] service_user.send_service_user_token = True {{(pid=105512) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 17:52:55.825513 dv-cinder-852009-8-iscsi devstack@n-api.service[105513]: DEBUG nova.api.openstack.wsgi_app [-] service_user.keyfile = None {{(pid=105513) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 17:52:55.825727 dv-cinder-852009-8-iscsi devstack@n-api.service[105512]: DEBUG nova.api.openstack.wsgi_app [-] service_user.split_loggers = False {{(pid=105512) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 17:52:55.825814 dv-cinder-852009-8-iscsi devstack@n-api.service[105513]: DEBUG nova.api.openstack.wsgi_app [-] service_user.send_service_user_token = True {{(pid=105513) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 17:52:55.826030 dv-cinder-852009-8-iscsi devstack@n-api.service[105512]: DEBUG nova.api.openstack.wsgi_app [-] service_user.timeout = None {{(pid=105512) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 17:52:55.826117 dv-cinder-852009-8-iscsi devstack@n-api.service[105513]: DEBUG nova.api.openstack.wsgi_app [-] service_user.split_loggers = False {{(pid=105513) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 17:52:55.826336 dv-cinder-852009-8-iscsi devstack@n-api.service[105513]: DEBUG nova.api.openstack.wsgi_app [-] service_user.timeout = None {{(pid=105513) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 17:52:55.826423 dv-cinder-852009-8-iscsi devstack@n-api.service[105512]: DEBUG nova.api.openstack.wsgi_app [-] spice.agent_enabled = True {{(pid=105512) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 17:52:55.826651 dv-cinder-852009-8-iscsi devstack@n-api.service[105512]: DEBUG nova.api.openstack.wsgi_app [-] spice.enabled = False {{(pid=105512) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 17:52:55.826753 dv-cinder-852009-8-iscsi devstack@n-api.service[105513]: DEBUG nova.api.openstack.wsgi_app [-] spice.agent_enabled = True {{(pid=105513) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 17:52:55.826957 dv-cinder-852009-8-iscsi devstack@n-api.service[105513]: DEBUG nova.api.openstack.wsgi_app [-] spice.enabled = False {{(pid=105513) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 17:52:55.827176 dv-cinder-852009-8-iscsi devstack@n-api.service[105512]: DEBUG nova.api.openstack.wsgi_app [-] spice.html5proxy_base_url = http://127.0.0.1:6082/spice_auto.html {{(pid=105512) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 17:52:55.827504 dv-cinder-852009-8-iscsi devstack@n-api.service[105513]: DEBUG nova.api.openstack.wsgi_app [-] spice.html5proxy_base_url = http://127.0.0.1:6082/spice_auto.html {{(pid=105513) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 17:52:55.827608 dv-cinder-852009-8-iscsi devstack@n-api.service[105512]: DEBUG nova.api.openstack.wsgi_app [-] spice.html5proxy_host = 0.0.0.0 {{(pid=105512) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 17:52:55.827824 dv-cinder-852009-8-iscsi devstack@n-api.service[105512]: DEBUG nova.api.openstack.wsgi_app [-] spice.html5proxy_port = 6082 {{(pid=105512) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 17:52:55.827951 dv-cinder-852009-8-iscsi devstack@n-api.service[105513]: DEBUG nova.api.openstack.wsgi_app [-] spice.html5proxy_host = 0.0.0.0 {{(pid=105513) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 17:52:55.828146 dv-cinder-852009-8-iscsi devstack@n-api.service[105513]: DEBUG nova.api.openstack.wsgi_app [-] spice.html5proxy_port = 6082 {{(pid=105513) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 17:52:55.828232 dv-cinder-852009-8-iscsi devstack@n-api.service[105512]: DEBUG nova.api.openstack.wsgi_app [-] spice.server_listen = 127.0.0.1 {{(pid=105512) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 17:52:55.828494 dv-cinder-852009-8-iscsi devstack@n-api.service[105512]: DEBUG nova.api.openstack.wsgi_app [-] spice.server_proxyclient_address = 127.0.0.1 {{(pid=105512) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 17:52:55.828586 dv-cinder-852009-8-iscsi devstack@n-api.service[105513]: DEBUG nova.api.openstack.wsgi_app [-] spice.server_listen = 127.0.0.1 {{(pid=105513) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 17:52:55.828814 dv-cinder-852009-8-iscsi devstack@n-api.service[105512]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.baseapi = None {{(pid=105512) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 17:52:55.828904 dv-cinder-852009-8-iscsi devstack@n-api.service[105513]: DEBUG nova.api.openstack.wsgi_app [-] spice.server_proxyclient_address = 127.0.0.1 {{(pid=105513) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 17:52:55.829120 dv-cinder-852009-8-iscsi devstack@n-api.service[105512]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.cert = None {{(pid=105512) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 17:52:55.829206 dv-cinder-852009-8-iscsi devstack@n-api.service[105513]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.baseapi = None {{(pid=105513) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 17:52:55.829428 dv-cinder-852009-8-iscsi devstack@n-api.service[105513]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.cert = None {{(pid=105513) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 17:52:55.829515 dv-cinder-852009-8-iscsi devstack@n-api.service[105512]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.compute = auto {{(pid=105512) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 17:52:55.829734 dv-cinder-852009-8-iscsi devstack@n-api.service[105512]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.conductor = None {{(pid=105512) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 17:52:55.829826 dv-cinder-852009-8-iscsi devstack@n-api.service[105513]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.compute = auto {{(pid=105513) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 17:52:55.830038 dv-cinder-852009-8-iscsi devstack@n-api.service[105512]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.scheduler = None {{(pid=105512) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 17:52:55.830134 dv-cinder-852009-8-iscsi devstack@n-api.service[105513]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.conductor = None {{(pid=105513) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 17:52:55.830345 dv-cinder-852009-8-iscsi devstack@n-api.service[105513]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.scheduler = None {{(pid=105513) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 17:52:55.830431 dv-cinder-852009-8-iscsi devstack@n-api.service[105512]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.auth_section = None {{(pid=105512) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 17:52:55.830653 dv-cinder-852009-8-iscsi devstack@n-api.service[105512]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.auth_type = None {{(pid=105512) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 17:52:55.830739 dv-cinder-852009-8-iscsi devstack@n-api.service[105513]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.auth_section = None {{(pid=105513) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 17:52:55.830957 dv-cinder-852009-8-iscsi devstack@n-api.service[105512]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.cafile = None {{(pid=105512) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 17:52:55.831055 dv-cinder-852009-8-iscsi devstack@n-api.service[105513]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.auth_type = None {{(pid=105513) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 17:52:55.831263 dv-cinder-852009-8-iscsi devstack@n-api.service[105513]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.cafile = None {{(pid=105513) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 17:52:55.831348 dv-cinder-852009-8-iscsi devstack@n-api.service[105512]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.certfile = None {{(pid=105512) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 17:52:55.831570 dv-cinder-852009-8-iscsi devstack@n-api.service[105512]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.collect_timing = False {{(pid=105512) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 17:52:55.831654 dv-cinder-852009-8-iscsi devstack@n-api.service[105513]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.certfile = None {{(pid=105513) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 17:52:55.831880 dv-cinder-852009-8-iscsi devstack@n-api.service[105513]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.collect_timing = False {{(pid=105513) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 17:52:55.831975 dv-cinder-852009-8-iscsi devstack@n-api.service[105512]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.insecure = False {{(pid=105512) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 17:52:55.832178 dv-cinder-852009-8-iscsi devstack@n-api.service[105512]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.keyfile = None {{(pid=105512) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 17:52:55.832263 dv-cinder-852009-8-iscsi devstack@n-api.service[105513]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.insecure = False {{(pid=105513) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 17:52:55.832509 dv-cinder-852009-8-iscsi devstack@n-api.service[105513]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.keyfile = None {{(pid=105513) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 17:52:55.832596 dv-cinder-852009-8-iscsi devstack@n-api.service[105512]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.split_loggers = False {{(pid=105512) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 17:52:55.832815 dv-cinder-852009-8-iscsi devstack@n-api.service[105512]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.timeout = None {{(pid=105512) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 17:52:55.832914 dv-cinder-852009-8-iscsi devstack@n-api.service[105513]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.split_loggers = False {{(pid=105513) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 17:52:55.833120 dv-cinder-852009-8-iscsi devstack@n-api.service[105513]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.timeout = None {{(pid=105513) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 17:52:55.833207 dv-cinder-852009-8-iscsi devstack@n-api.service[105512]: DEBUG nova.api.openstack.wsgi_app [-] vmware.api_retry_count = 10 {{(pid=105512) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 17:52:55.833433 dv-cinder-852009-8-iscsi devstack@n-api.service[105512]: DEBUG nova.api.openstack.wsgi_app [-] vmware.ca_file = None {{(pid=105512) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 17:52:55.833518 dv-cinder-852009-8-iscsi devstack@n-api.service[105513]: DEBUG nova.api.openstack.wsgi_app [-] vmware.api_retry_count = 10 {{(pid=105513) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 17:52:55.833745 dv-cinder-852009-8-iscsi devstack@n-api.service[105513]: DEBUG nova.api.openstack.wsgi_app [-] vmware.ca_file = None {{(pid=105513) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 17:52:55.833831 dv-cinder-852009-8-iscsi devstack@n-api.service[105512]: DEBUG nova.api.openstack.wsgi_app [-] vmware.cache_prefix = None {{(pid=105512) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 17:52:55.834101 dv-cinder-852009-8-iscsi devstack@n-api.service[105512]: DEBUG nova.api.openstack.wsgi_app [-] vmware.cluster_name = None {{(pid=105512) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 17:52:55.834192 dv-cinder-852009-8-iscsi devstack@n-api.service[105513]: DEBUG nova.api.openstack.wsgi_app [-] vmware.cache_prefix = None {{(pid=105513) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 17:52:55.834411 dv-cinder-852009-8-iscsi devstack@n-api.service[105513]: DEBUG nova.api.openstack.wsgi_app [-] vmware.cluster_name = None {{(pid=105513) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 17:52:55.834504 dv-cinder-852009-8-iscsi devstack@n-api.service[105512]: DEBUG nova.api.openstack.wsgi_app [-] vmware.connection_pool_size = 10 {{(pid=105512) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 17:52:55.834714 dv-cinder-852009-8-iscsi devstack@n-api.service[105512]: DEBUG nova.api.openstack.wsgi_app [-] vmware.console_delay_seconds = None {{(pid=105512) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 17:52:55.834801 dv-cinder-852009-8-iscsi devstack@n-api.service[105513]: DEBUG nova.api.openstack.wsgi_app [-] vmware.connection_pool_size = 10 {{(pid=105513) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 17:52:55.835019 dv-cinder-852009-8-iscsi devstack@n-api.service[105512]: DEBUG nova.api.openstack.wsgi_app [-] vmware.datastore_regex = None {{(pid=105512) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 17:52:55.835122 dv-cinder-852009-8-iscsi devstack@n-api.service[105513]: DEBUG nova.api.openstack.wsgi_app [-] vmware.console_delay_seconds = None {{(pid=105513) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 17:52:55.835323 dv-cinder-852009-8-iscsi devstack@n-api.service[105512]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_ip = None {{(pid=105512) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 17:52:55.835411 dv-cinder-852009-8-iscsi devstack@n-api.service[105513]: DEBUG nova.api.openstack.wsgi_app [-] vmware.datastore_regex = None {{(pid=105513) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 17:52:55.835625 dv-cinder-852009-8-iscsi devstack@n-api.service[105512]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_password = **** {{(pid=105512) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 17:52:55.835752 dv-cinder-852009-8-iscsi devstack@n-api.service[105513]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_ip = None {{(pid=105513) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 17:52:55.835928 dv-cinder-852009-8-iscsi devstack@n-api.service[105513]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_password = **** {{(pid=105513) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 17:52:55.836015 dv-cinder-852009-8-iscsi devstack@n-api.service[105512]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_port = 443 {{(pid=105512) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 17:52:55.836226 dv-cinder-852009-8-iscsi devstack@n-api.service[105512]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_username = None {{(pid=105512) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 17:52:55.836311 dv-cinder-852009-8-iscsi devstack@n-api.service[105513]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_port = 443 {{(pid=105513) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 17:52:55.836561 dv-cinder-852009-8-iscsi devstack@n-api.service[105513]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_username = None {{(pid=105513) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 17:52:55.836652 dv-cinder-852009-8-iscsi devstack@n-api.service[105512]: DEBUG nova.api.openstack.wsgi_app [-] vmware.insecure = False {{(pid=105512) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 17:52:55.836876 dv-cinder-852009-8-iscsi devstack@n-api.service[105513]: DEBUG nova.api.openstack.wsgi_app [-] vmware.insecure = False {{(pid=105513) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 17:52:55.836979 dv-cinder-852009-8-iscsi devstack@n-api.service[105512]: DEBUG nova.api.openstack.wsgi_app [-] vmware.integration_bridge = None {{(pid=105512) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 17:52:55.837186 dv-cinder-852009-8-iscsi devstack@n-api.service[105513]: DEBUG nova.api.openstack.wsgi_app [-] vmware.integration_bridge = None {{(pid=105513) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 17:52:55.837282 dv-cinder-852009-8-iscsi devstack@n-api.service[105512]: DEBUG nova.api.openstack.wsgi_app [-] vmware.maximum_objects = 100 {{(pid=105512) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 17:52:55.837502 dv-cinder-852009-8-iscsi devstack@n-api.service[105513]: DEBUG nova.api.openstack.wsgi_app [-] vmware.maximum_objects = 100 {{(pid=105513) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 17:52:55.837589 dv-cinder-852009-8-iscsi devstack@n-api.service[105512]: DEBUG nova.api.openstack.wsgi_app [-] vmware.pbm_default_policy = None {{(pid=105512) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 17:52:55.837858 dv-cinder-852009-8-iscsi devstack@n-api.service[105512]: DEBUG nova.api.openstack.wsgi_app [-] vmware.pbm_enabled = False {{(pid=105512) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 17:52:55.837944 dv-cinder-852009-8-iscsi devstack@n-api.service[105513]: DEBUG nova.api.openstack.wsgi_app [-] vmware.pbm_default_policy = None {{(pid=105513) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 17:52:55.838183 dv-cinder-852009-8-iscsi devstack@n-api.service[105512]: DEBUG nova.api.openstack.wsgi_app [-] vmware.pbm_wsdl_location = None {{(pid=105512) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 17:52:55.838293 dv-cinder-852009-8-iscsi devstack@n-api.service[105513]: DEBUG nova.api.openstack.wsgi_app [-] vmware.pbm_enabled = False {{(pid=105513) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 17:52:55.838471 dv-cinder-852009-8-iscsi devstack@n-api.service[105513]: DEBUG nova.api.openstack.wsgi_app [-] vmware.pbm_wsdl_location = None {{(pid=105513) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 17:52:55.838558 dv-cinder-852009-8-iscsi devstack@n-api.service[105512]: DEBUG nova.api.openstack.wsgi_app [-] vmware.serial_log_dir = /opt/vmware/vspc {{(pid=105512) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 17:52:55.838774 dv-cinder-852009-8-iscsi devstack@n-api.service[105512]: DEBUG nova.api.openstack.wsgi_app [-] vmware.serial_port_proxy_uri = None {{(pid=105512) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 17:52:55.838869 dv-cinder-852009-8-iscsi devstack@n-api.service[105513]: DEBUG nova.api.openstack.wsgi_app [-] vmware.serial_log_dir = /opt/vmware/vspc {{(pid=105513) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 17:52:55.839077 dv-cinder-852009-8-iscsi devstack@n-api.service[105512]: DEBUG nova.api.openstack.wsgi_app [-] vmware.serial_port_service_uri = None {{(pid=105512) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 17:52:55.839248 dv-cinder-852009-8-iscsi devstack@n-api.service[105513]: DEBUG nova.api.openstack.wsgi_app [-] vmware.serial_port_proxy_uri = None {{(pid=105513) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 17:52:55.839395 dv-cinder-852009-8-iscsi devstack@n-api.service[105513]: DEBUG nova.api.openstack.wsgi_app [-] vmware.serial_port_service_uri = None {{(pid=105513) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 17:52:55.839481 dv-cinder-852009-8-iscsi devstack@n-api.service[105512]: DEBUG nova.api.openstack.wsgi_app [-] vmware.task_poll_interval = 0.5 {{(pid=105512) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 17:52:55.839694 dv-cinder-852009-8-iscsi devstack@n-api.service[105512]: DEBUG nova.api.openstack.wsgi_app [-] vmware.use_linked_clone = True {{(pid=105512) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 17:52:55.839779 dv-cinder-852009-8-iscsi devstack@n-api.service[105513]: DEBUG nova.api.openstack.wsgi_app [-] vmware.task_poll_interval = 0.5 {{(pid=105513) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 17:52:55.840008 dv-cinder-852009-8-iscsi devstack@n-api.service[105513]: DEBUG nova.api.openstack.wsgi_app [-] vmware.use_linked_clone = True {{(pid=105513) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 17:52:55.840104 dv-cinder-852009-8-iscsi devstack@n-api.service[105512]: DEBUG nova.api.openstack.wsgi_app [-] vmware.vnc_keymap = en-us {{(pid=105512) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 17:52:55.840317 dv-cinder-852009-8-iscsi devstack@n-api.service[105512]: DEBUG nova.api.openstack.wsgi_app [-] vmware.vnc_port = 5900 {{(pid=105512) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 17:52:55.840412 dv-cinder-852009-8-iscsi devstack@n-api.service[105513]: DEBUG nova.api.openstack.wsgi_app [-] vmware.vnc_keymap = en-us {{(pid=105513) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 17:52:55.840652 dv-cinder-852009-8-iscsi devstack@n-api.service[105512]: DEBUG nova.api.openstack.wsgi_app [-] vmware.vnc_port_total = 10000 {{(pid=105512) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 17:52:55.840740 dv-cinder-852009-8-iscsi devstack@n-api.service[105513]: DEBUG nova.api.openstack.wsgi_app [-] vmware.vnc_port = 5900 {{(pid=105513) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 17:52:55.840965 dv-cinder-852009-8-iscsi devstack@n-api.service[105513]: DEBUG nova.api.openstack.wsgi_app [-] vmware.vnc_port_total = 10000 {{(pid=105513) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 17:52:55.841053 dv-cinder-852009-8-iscsi devstack@n-api.service[105512]: DEBUG nova.api.openstack.wsgi_app [-] vnc.auth_schemes = ['none'] {{(pid=105512) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 17:52:55.841302 dv-cinder-852009-8-iscsi devstack@n-api.service[105512]: DEBUG nova.api.openstack.wsgi_app [-] vnc.enabled = True {{(pid=105512) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 17:52:55.841395 dv-cinder-852009-8-iscsi devstack@n-api.service[105513]: DEBUG nova.api.openstack.wsgi_app [-] vnc.auth_schemes = ['none'] {{(pid=105513) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 17:52:55.841622 dv-cinder-852009-8-iscsi devstack@n-api.service[105513]: DEBUG nova.api.openstack.wsgi_app [-] vnc.enabled = True {{(pid=105513) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 17:52:55.841853 dv-cinder-852009-8-iscsi devstack@n-api.service[105512]: DEBUG nova.api.openstack.wsgi_app [-] vnc.novncproxy_base_url = http://127.0.0.1:6080/vnc_auto.html {{(pid=105512) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 17:52:55.842174 dv-cinder-852009-8-iscsi devstack@n-api.service[105513]: DEBUG nova.api.openstack.wsgi_app [-] vnc.novncproxy_base_url = http://127.0.0.1:6080/vnc_auto.html {{(pid=105513) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 17:52:55.842263 dv-cinder-852009-8-iscsi devstack@n-api.service[105512]: DEBUG nova.api.openstack.wsgi_app [-] vnc.novncproxy_host = 0.0.0.0 {{(pid=105512) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 17:52:55.842494 dv-cinder-852009-8-iscsi devstack@n-api.service[105512]: DEBUG nova.api.openstack.wsgi_app [-] vnc.novncproxy_port = 6080 {{(pid=105512) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 17:52:55.842580 dv-cinder-852009-8-iscsi devstack@n-api.service[105513]: DEBUG nova.api.openstack.wsgi_app [-] vnc.novncproxy_host = 0.0.0.0 {{(pid=105513) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 17:52:55.842824 dv-cinder-852009-8-iscsi devstack@n-api.service[105513]: DEBUG nova.api.openstack.wsgi_app [-] vnc.novncproxy_port = 6080 {{(pid=105513) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 17:52:55.842909 dv-cinder-852009-8-iscsi devstack@n-api.service[105512]: DEBUG nova.api.openstack.wsgi_app [-] vnc.server_listen = 127.0.0.1 {{(pid=105512) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 17:52:55.843151 dv-cinder-852009-8-iscsi devstack@n-api.service[105512]: DEBUG nova.api.openstack.wsgi_app [-] vnc.server_proxyclient_address = 127.0.0.1 {{(pid=105512) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 17:52:55.843238 dv-cinder-852009-8-iscsi devstack@n-api.service[105513]: DEBUG nova.api.openstack.wsgi_app [-] vnc.server_listen = 127.0.0.1 {{(pid=105513) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 17:52:55.843460 dv-cinder-852009-8-iscsi devstack@n-api.service[105512]: DEBUG nova.api.openstack.wsgi_app [-] vnc.vencrypt_ca_certs = None {{(pid=105512) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 17:52:55.843549 dv-cinder-852009-8-iscsi devstack@n-api.service[105513]: DEBUG nova.api.openstack.wsgi_app [-] vnc.server_proxyclient_address = 127.0.0.1 {{(pid=105513) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 17:52:55.843771 dv-cinder-852009-8-iscsi devstack@n-api.service[105512]: DEBUG nova.api.openstack.wsgi_app [-] vnc.vencrypt_client_cert = None {{(pid=105512) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 17:52:55.843857 dv-cinder-852009-8-iscsi devstack@n-api.service[105513]: DEBUG nova.api.openstack.wsgi_app [-] vnc.vencrypt_ca_certs = None {{(pid=105513) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 17:52:55.844077 dv-cinder-852009-8-iscsi devstack@n-api.service[105513]: DEBUG nova.api.openstack.wsgi_app [-] vnc.vencrypt_client_cert = None {{(pid=105513) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 17:52:55.844164 dv-cinder-852009-8-iscsi devstack@n-api.service[105512]: DEBUG nova.api.openstack.wsgi_app [-] vnc.vencrypt_client_key = None {{(pid=105512) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 17:52:55.844386 dv-cinder-852009-8-iscsi devstack@n-api.service[105513]: DEBUG nova.api.openstack.wsgi_app [-] vnc.vencrypt_client_key = None {{(pid=105513) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 17:52:55.844545 dv-cinder-852009-8-iscsi devstack@n-api.service[105512]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_compute_service_check_for_ffu = False {{(pid=105512) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 17:52:55.844728 dv-cinder-852009-8-iscsi devstack@n-api.service[105512]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_fallback_pcpu_query = False {{(pid=105512) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 17:52:55.844823 dv-cinder-852009-8-iscsi devstack@n-api.service[105513]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_compute_service_check_for_ffu = False {{(pid=105513) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 17:52:55.845039 dv-cinder-852009-8-iscsi devstack@n-api.service[105513]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_fallback_pcpu_query = False {{(pid=105513) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 17:52:55.845124 dv-cinder-852009-8-iscsi devstack@n-api.service[105512]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_group_policy_check_upcall = False {{(pid=105512) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 17:52:55.845345 dv-cinder-852009-8-iscsi devstack@n-api.service[105512]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_libvirt_livesnapshot = False {{(pid=105512) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 17:52:55.845439 dv-cinder-852009-8-iscsi devstack@n-api.service[105513]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_group_policy_check_upcall = False {{(pid=105513) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 17:52:55.845655 dv-cinder-852009-8-iscsi devstack@n-api.service[105512]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_rootwrap = False {{(pid=105512) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 17:52:55.845756 dv-cinder-852009-8-iscsi devstack@n-api.service[105513]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_libvirt_livesnapshot = False {{(pid=105513) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 17:52:55.845964 dv-cinder-852009-8-iscsi devstack@n-api.service[105512]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.enable_numa_live_migration = False {{(pid=105512) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 17:52:55.846059 dv-cinder-852009-8-iscsi devstack@n-api.service[105513]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_rootwrap = False {{(pid=105513) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 17:52:55.846272 dv-cinder-852009-8-iscsi devstack@n-api.service[105512]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.enable_qemu_monitor_announce_self = False {{(pid=105512) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 17:52:55.846415 dv-cinder-852009-8-iscsi devstack@n-api.service[105513]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.enable_numa_live_migration = False {{(pid=105513) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 17:52:55.846582 dv-cinder-852009-8-iscsi devstack@n-api.service[105512]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.ensure_libvirt_rbd_instance_dir_cleanup = False {{(pid=105512) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 17:52:55.846687 dv-cinder-852009-8-iscsi devstack@n-api.service[105513]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.enable_qemu_monitor_announce_self = False {{(pid=105513) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 17:52:55.846890 dv-cinder-852009-8-iscsi devstack@n-api.service[105513]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.ensure_libvirt_rbd_instance_dir_cleanup = False {{(pid=105513) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 17:52:55.846978 dv-cinder-852009-8-iscsi devstack@n-api.service[105512]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.handle_virt_lifecycle_events = True {{(pid=105512) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 17:52:55.847196 dv-cinder-852009-8-iscsi devstack@n-api.service[105512]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.libvirt_disable_apic = False {{(pid=105512) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 17:52:55.847281 dv-cinder-852009-8-iscsi devstack@n-api.service[105513]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.handle_virt_lifecycle_events = True {{(pid=105513) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 17:52:55.847512 dv-cinder-852009-8-iscsi devstack@n-api.service[105513]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.libvirt_disable_apic = False {{(pid=105513) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 17:52:55.847605 dv-cinder-852009-8-iscsi devstack@n-api.service[105512]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.never_download_image_if_on_rbd = False {{(pid=105512) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 17:52:55.847817 dv-cinder-852009-8-iscsi devstack@n-api.service[105512]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.reserve_disk_resource_for_image_cache = False {{(pid=105512) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 17:52:55.847903 dv-cinder-852009-8-iscsi devstack@n-api.service[105513]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.never_download_image_if_on_rbd = False {{(pid=105513) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 17:52:55.848127 dv-cinder-852009-8-iscsi devstack@n-api.service[105513]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.reserve_disk_resource_for_image_cache = False {{(pid=105513) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 17:52:55.848220 dv-cinder-852009-8-iscsi devstack@n-api.service[105512]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.skip_cpu_compare_on_dest = False {{(pid=105512) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 17:52:55.848449 dv-cinder-852009-8-iscsi devstack@n-api.service[105512]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.skip_hypervisor_version_check_on_lm = False {{(pid=105512) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 17:52:55.848540 dv-cinder-852009-8-iscsi devstack@n-api.service[105513]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.skip_cpu_compare_on_dest = False {{(pid=105513) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 17:52:55.848769 dv-cinder-852009-8-iscsi devstack@n-api.service[105512]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.unified_limits_count_pcpu_as_vcpu = False {{(pid=105512) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 17:52:55.848865 dv-cinder-852009-8-iscsi devstack@n-api.service[105513]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.skip_hypervisor_version_check_on_lm = False {{(pid=105513) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 17:52:55.849077 dv-cinder-852009-8-iscsi devstack@n-api.service[105513]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.unified_limits_count_pcpu_as_vcpu = False {{(pid=105513) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 17:52:55.849162 dv-cinder-852009-8-iscsi devstack@n-api.service[105512]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.wait_for_vif_plugged_event_during_hard_reboot = [] {{(pid=105512) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 17:52:55.849395 dv-cinder-852009-8-iscsi devstack@n-api.service[105513]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.wait_for_vif_plugged_event_during_hard_reboot = [] {{(pid=105513) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 17:52:55.849484 dv-cinder-852009-8-iscsi devstack@n-api.service[105512]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.api_paste_config = /etc/nova/api-paste.ini {{(pid=105512) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 17:52:55.849756 dv-cinder-852009-8-iscsi devstack@n-api.service[105512]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.client_socket_timeout = 900 {{(pid=105512) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 17:52:55.849846 dv-cinder-852009-8-iscsi devstack@n-api.service[105513]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.api_paste_config = /etc/nova/api-paste.ini {{(pid=105513) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 17:52:55.850077 dv-cinder-852009-8-iscsi devstack@n-api.service[105512]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.default_pool_size = 1000 {{(pid=105512) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 17:52:55.850173 dv-cinder-852009-8-iscsi devstack@n-api.service[105513]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.client_socket_timeout = 900 {{(pid=105513) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 17:52:55.850394 dv-cinder-852009-8-iscsi devstack@n-api.service[105513]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.default_pool_size = 1000 {{(pid=105513) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 17:52:55.850480 dv-cinder-852009-8-iscsi devstack@n-api.service[105512]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.keep_alive = True {{(pid=105512) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 17:52:55.850709 dv-cinder-852009-8-iscsi devstack@n-api.service[105512]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.max_header_line = 16384 {{(pid=105512) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 17:52:55.850794 dv-cinder-852009-8-iscsi devstack@n-api.service[105513]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.keep_alive = True {{(pid=105513) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 17:52:55.851021 dv-cinder-852009-8-iscsi devstack@n-api.service[105512]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.secure_proxy_ssl_header = None {{(pid=105512) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 17:52:55.851123 dv-cinder-852009-8-iscsi devstack@n-api.service[105513]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.max_header_line = 16384 {{(pid=105513) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 17:52:55.851329 dv-cinder-852009-8-iscsi devstack@n-api.service[105513]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.secure_proxy_ssl_header = None {{(pid=105513) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 17:52:55.851421 dv-cinder-852009-8-iscsi devstack@n-api.service[105512]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.ssl_ca_file = None {{(pid=105512) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 17:52:55.851635 dv-cinder-852009-8-iscsi devstack@n-api.service[105512]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.ssl_cert_file = None {{(pid=105512) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 17:52:55.851721 dv-cinder-852009-8-iscsi devstack@n-api.service[105513]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.ssl_ca_file = None {{(pid=105513) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 17:52:55.851945 dv-cinder-852009-8-iscsi devstack@n-api.service[105513]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.ssl_cert_file = None {{(pid=105513) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 17:52:55.852041 dv-cinder-852009-8-iscsi devstack@n-api.service[105512]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.ssl_key_file = None {{(pid=105512) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 17:52:55.852259 dv-cinder-852009-8-iscsi devstack@n-api.service[105513]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.ssl_key_file = None {{(pid=105513) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 17:52:55.852395 dv-cinder-852009-8-iscsi devstack@n-api.service[105512]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.tcp_keepidle = 600 {{(pid=105512) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 17:52:55.852607 dv-cinder-852009-8-iscsi devstack@n-api.service[105513]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.tcp_keepidle = 600 {{(pid=105513) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 17:52:55.852699 dv-cinder-852009-8-iscsi devstack@n-api.service[105512]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.wsgi_log_format = %(client_ip)s "%(request_line)s" status: %(status_code)s len: %(body_length)s time: %(wall_seconds).7f {{(pid=105512) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 17:52:55.852920 dv-cinder-852009-8-iscsi devstack@n-api.service[105512]: DEBUG nova.api.openstack.wsgi_app [-] zvm.ca_file = None {{(pid=105512) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 17:52:55.853017 dv-cinder-852009-8-iscsi devstack@n-api.service[105513]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.wsgi_log_format = %(client_ip)s "%(request_line)s" status: %(status_code)s len: %(body_length)s time: %(wall_seconds).7f {{(pid=105513) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 17:52:55.853229 dv-cinder-852009-8-iscsi devstack@n-api.service[105512]: DEBUG nova.api.openstack.wsgi_app [-] zvm.cloud_connector_url = None {{(pid=105512) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 17:52:55.853316 dv-cinder-852009-8-iscsi devstack@n-api.service[105513]: DEBUG nova.api.openstack.wsgi_app [-] zvm.ca_file = None {{(pid=105513) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 17:52:55.853538 dv-cinder-852009-8-iscsi devstack@n-api.service[105513]: DEBUG nova.api.openstack.wsgi_app [-] zvm.cloud_connector_url = None {{(pid=105513) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 17:52:55.853955 dv-cinder-852009-8-iscsi devstack@n-api.service[105512]: DEBUG nova.api.openstack.wsgi_app [-] zvm.image_tmp_path = /opt/stack/data/nova/images {{(pid=105512) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 17:52:55.854268 dv-cinder-852009-8-iscsi devstack@n-api.service[105513]: DEBUG nova.api.openstack.wsgi_app [-] zvm.image_tmp_path = /opt/stack/data/nova/images {{(pid=105513) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 17:52:55.854358 dv-cinder-852009-8-iscsi devstack@n-api.service[105512]: DEBUG nova.api.openstack.wsgi_app [-] zvm.reachable_timeout = 300 {{(pid=105512) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 17:52:55.854593 dv-cinder-852009-8-iscsi devstack@n-api.service[105512]: DEBUG nova.api.openstack.wsgi_app [-] oslo_versionedobjects.fatal_exception_format_errors = False {{(pid=105512) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 17:52:55.854724 dv-cinder-852009-8-iscsi devstack@n-api.service[105513]: DEBUG nova.api.openstack.wsgi_app [-] zvm.reachable_timeout = 300 {{(pid=105513) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 17:52:55.854911 dv-cinder-852009-8-iscsi devstack@n-api.service[105512]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_buffer_size = 1000 {{(pid=105512) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 17:52:55.855056 dv-cinder-852009-8-iscsi devstack@n-api.service[105513]: DEBUG nova.api.openstack.wsgi_app [-] oslo_versionedobjects.fatal_exception_format_errors = False {{(pid=105513) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 17:52:55.855222 dv-cinder-852009-8-iscsi devstack@n-api.service[105512]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_enabled = False {{(pid=105512) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 17:52:55.855311 dv-cinder-852009-8-iscsi devstack@n-api.service[105513]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_buffer_size = 1000 {{(pid=105513) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 17:52:55.855548 dv-cinder-852009-8-iscsi devstack@n-api.service[105513]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_enabled = False {{(pid=105513) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 17:52:55.855639 dv-cinder-852009-8-iscsi devstack@n-api.service[105512]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_process_name = {{(pid=105512) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 17:52:55.855866 dv-cinder-852009-8-iscsi devstack@n-api.service[105512]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_socket_file = /var/tmp/metrics_collector.sock {{(pid=105512) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 17:52:55.855968 dv-cinder-852009-8-iscsi devstack@n-api.service[105513]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_process_name = {{(pid=105513) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 17:52:55.856177 dv-cinder-852009-8-iscsi devstack@n-api.service[105512]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_thread_stop_timeout = 10 {{(pid=105512) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 17:52:55.856265 dv-cinder-852009-8-iscsi devstack@n-api.service[105513]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_socket_file = /var/tmp/metrics_collector.sock {{(pid=105513) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 17:52:55.856522 dv-cinder-852009-8-iscsi devstack@n-api.service[105513]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_thread_stop_timeout = 10 {{(pid=105513) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 17:52:55.856615 dv-cinder-852009-8-iscsi devstack@n-api.service[105512]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.enforce_new_defaults = False {{(pid=105512) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 17:52:55.856834 dv-cinder-852009-8-iscsi devstack@n-api.service[105512]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.enforce_scope = False {{(pid=105512) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 17:52:55.856981 dv-cinder-852009-8-iscsi devstack@n-api.service[105513]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.enforce_new_defaults = False {{(pid=105513) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 17:52:55.857152 dv-cinder-852009-8-iscsi devstack@n-api.service[105513]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.enforce_scope = False {{(pid=105513) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 17:52:55.857241 dv-cinder-852009-8-iscsi devstack@n-api.service[105512]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.policy_default_rule = default {{(pid=105512) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 17:52:55.857488 dv-cinder-852009-8-iscsi devstack@n-api.service[105513]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.policy_default_rule = default {{(pid=105513) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 17:52:55.857575 dv-cinder-852009-8-iscsi devstack@n-api.service[105512]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.policy_dirs = ['policy.d'] {{(pid=105512) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 17:52:55.857814 dv-cinder-852009-8-iscsi devstack@n-api.service[105512]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.policy_file = policy.yaml {{(pid=105512) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 17:52:55.857915 dv-cinder-852009-8-iscsi devstack@n-api.service[105513]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.policy_dirs = ['policy.d'] {{(pid=105513) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 17:52:55.858141 dv-cinder-852009-8-iscsi devstack@n-api.service[105512]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_content_type = application/x-www-form-urlencoded {{(pid=105512) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 17:52:55.858269 dv-cinder-852009-8-iscsi devstack@n-api.service[105513]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.policy_file = policy.yaml {{(pid=105513) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 17:52:55.858447 dv-cinder-852009-8-iscsi devstack@n-api.service[105512]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_ca_crt_file = None {{(pid=105512) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 17:52:55.858537 dv-cinder-852009-8-iscsi devstack@n-api.service[105513]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_content_type = application/x-www-form-urlencoded {{(pid=105513) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 17:52:55.858752 dv-cinder-852009-8-iscsi devstack@n-api.service[105512]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_client_crt_file = None {{(pid=105512) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 17:52:55.858848 dv-cinder-852009-8-iscsi devstack@n-api.service[105513]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_ca_crt_file = None {{(pid=105513) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 17:52:55.859058 dv-cinder-852009-8-iscsi devstack@n-api.service[105512]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_client_key_file = None {{(pid=105512) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 17:52:55.859144 dv-cinder-852009-8-iscsi devstack@n-api.service[105513]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_client_crt_file = None {{(pid=105513) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 17:52:55.859362 dv-cinder-852009-8-iscsi devstack@n-api.service[105513]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_client_key_file = None {{(pid=105513) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 17:52:55.859462 dv-cinder-852009-8-iscsi devstack@n-api.service[105512]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_verify_server_crt = False {{(pid=105512) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 17:52:55.859677 dv-cinder-852009-8-iscsi devstack@n-api.service[105512]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.auth_section = None {{(pid=105512) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 17:52:55.859765 dv-cinder-852009-8-iscsi devstack@n-api.service[105513]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_verify_server_crt = False {{(pid=105513) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 17:52:55.859988 dv-cinder-852009-8-iscsi devstack@n-api.service[105512]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.auth_type = None {{(pid=105512) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 17:52:55.860084 dv-cinder-852009-8-iscsi devstack@n-api.service[105513]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.auth_section = None {{(pid=105513) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 17:52:55.860294 dv-cinder-852009-8-iscsi devstack@n-api.service[105512]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.cafile = None {{(pid=105512) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 17:52:55.860382 dv-cinder-852009-8-iscsi devstack@n-api.service[105513]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.auth_type = None {{(pid=105513) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 17:52:55.860624 dv-cinder-852009-8-iscsi devstack@n-api.service[105512]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.certfile = None {{(pid=105512) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 17:52:55.860714 dv-cinder-852009-8-iscsi devstack@n-api.service[105513]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.cafile = None {{(pid=105513) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 17:52:55.860937 dv-cinder-852009-8-iscsi devstack@n-api.service[105512]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.collect_timing = False {{(pid=105512) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 17:52:55.861025 dv-cinder-852009-8-iscsi devstack@n-api.service[105513]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.certfile = None {{(pid=105513) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 17:52:55.861243 dv-cinder-852009-8-iscsi devstack@n-api.service[105512]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.connect_retries = None {{(pid=105512) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 17:52:55.861331 dv-cinder-852009-8-iscsi devstack@n-api.service[105513]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.collect_timing = False {{(pid=105513) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 17:52:55.861548 dv-cinder-852009-8-iscsi devstack@n-api.service[105512]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.connect_retry_delay = None {{(pid=105512) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 17:52:55.861644 dv-cinder-852009-8-iscsi devstack@n-api.service[105513]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.connect_retries = None {{(pid=105513) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 17:52:55.861851 dv-cinder-852009-8-iscsi devstack@n-api.service[105512]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.endpoint_id = None {{(pid=105512) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 17:52:55.861946 dv-cinder-852009-8-iscsi devstack@n-api.service[105513]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.connect_retry_delay = None {{(pid=105513) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 17:52:55.862153 dv-cinder-852009-8-iscsi devstack@n-api.service[105512]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.endpoint_override = None {{(pid=105512) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 17:52:55.862250 dv-cinder-852009-8-iscsi devstack@n-api.service[105513]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.endpoint_id = None {{(pid=105513) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 17:52:55.862456 dv-cinder-852009-8-iscsi devstack@n-api.service[105513]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.endpoint_override = None {{(pid=105513) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 17:52:55.862542 dv-cinder-852009-8-iscsi devstack@n-api.service[105512]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.insecure = False {{(pid=105512) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 17:52:55.862752 dv-cinder-852009-8-iscsi devstack@n-api.service[105512]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.keyfile = None {{(pid=105512) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 17:52:55.862838 dv-cinder-852009-8-iscsi devstack@n-api.service[105513]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.insecure = False {{(pid=105513) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 17:52:55.863055 dv-cinder-852009-8-iscsi devstack@n-api.service[105512]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.max_version = None {{(pid=105512) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 17:52:55.863150 dv-cinder-852009-8-iscsi devstack@n-api.service[105513]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.keyfile = None {{(pid=105513) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 17:52:55.863359 dv-cinder-852009-8-iscsi devstack@n-api.service[105512]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.min_version = None {{(pid=105512) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 17:52:55.863476 dv-cinder-852009-8-iscsi devstack@n-api.service[105513]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.max_version = None {{(pid=105513) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 17:52:55.863671 dv-cinder-852009-8-iscsi devstack@n-api.service[105513]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.min_version = None {{(pid=105513) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 17:52:55.863758 dv-cinder-852009-8-iscsi devstack@n-api.service[105512]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.region_name = None {{(pid=105512) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 17:52:55.863970 dv-cinder-852009-8-iscsi devstack@n-api.service[105512]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.service_name = None {{(pid=105512) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 17:52:55.864116 dv-cinder-852009-8-iscsi devstack@n-api.service[105513]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.region_name = None {{(pid=105513) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 17:52:55.864273 dv-cinder-852009-8-iscsi devstack@n-api.service[105513]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.service_name = None {{(pid=105513) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 17:52:55.864359 dv-cinder-852009-8-iscsi devstack@n-api.service[105512]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.service_type = None {{(pid=105512) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 17:52:55.864602 dv-cinder-852009-8-iscsi devstack@n-api.service[105512]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.split_loggers = False {{(pid=105512) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 17:52:55.864731 dv-cinder-852009-8-iscsi devstack@n-api.service[105513]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.service_type = None {{(pid=105513) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 17:52:55.864906 dv-cinder-852009-8-iscsi devstack@n-api.service[105512]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.status_code_retries = None {{(pid=105512) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 17:52:55.865005 dv-cinder-852009-8-iscsi devstack@n-api.service[105513]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.split_loggers = False {{(pid=105513) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 17:52:55.865234 dv-cinder-852009-8-iscsi devstack@n-api.service[105512]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.status_code_retry_delay = None {{(pid=105512) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 17:52:55.865352 dv-cinder-852009-8-iscsi devstack@n-api.service[105513]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.status_code_retries = None {{(pid=105513) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 17:52:55.865575 dv-cinder-852009-8-iscsi devstack@n-api.service[105513]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.status_code_retry_delay = None {{(pid=105513) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 17:52:55.865662 dv-cinder-852009-8-iscsi devstack@n-api.service[105512]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.timeout = None {{(pid=105512) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 17:52:55.865876 dv-cinder-852009-8-iscsi devstack@n-api.service[105512]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.valid_interfaces = None {{(pid=105512) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 17:52:55.865973 dv-cinder-852009-8-iscsi devstack@n-api.service[105513]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.timeout = None {{(pid=105513) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 17:52:55.866178 dv-cinder-852009-8-iscsi devstack@n-api.service[105512]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.version = None {{(pid=105512) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 17:52:55.866265 dv-cinder-852009-8-iscsi devstack@n-api.service[105513]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.valid_interfaces = None {{(pid=105513) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 17:52:55.866480 dv-cinder-852009-8-iscsi devstack@n-api.service[105513]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.version = None {{(pid=105513) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 17:52:55.866567 dv-cinder-852009-8-iscsi devstack@n-api.service[105512]: DEBUG nova.api.openstack.wsgi_app [-] oslo_middleware.http_basic_auth_user_file = /etc/htpasswd {{(pid=105512) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 17:52:55.866812 dv-cinder-852009-8-iscsi devstack@n-api.service[105513]: DEBUG nova.api.openstack.wsgi_app [-] oslo_middleware.http_basic_auth_user_file = /etc/htpasswd {{(pid=105513) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 17:52:55.866902 dv-cinder-852009-8-iscsi devstack@n-api.service[105512]: DEBUG nova.api.openstack.wsgi_app [-] profiler.connection_string = messaging:// {{(pid=105512) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 17:52:55.867129 dv-cinder-852009-8-iscsi devstack@n-api.service[105512]: DEBUG nova.api.openstack.wsgi_app [-] profiler.enabled = False {{(pid=105512) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 17:52:55.867292 dv-cinder-852009-8-iscsi devstack@n-api.service[105513]: DEBUG nova.api.openstack.wsgi_app [-] profiler.connection_string = messaging:// {{(pid=105513) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 17:52:55.867445 dv-cinder-852009-8-iscsi devstack@n-api.service[105512]: DEBUG nova.api.openstack.wsgi_app [-] profiler.es_doc_type = notification {{(pid=105512) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 17:52:55.867538 dv-cinder-852009-8-iscsi devstack@n-api.service[105513]: DEBUG nova.api.openstack.wsgi_app [-] profiler.enabled = False {{(pid=105513) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 17:52:55.867755 dv-cinder-852009-8-iscsi devstack@n-api.service[105512]: DEBUG nova.api.openstack.wsgi_app [-] profiler.es_scroll_size = 10000 {{(pid=105512) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 17:52:55.867844 dv-cinder-852009-8-iscsi devstack@n-api.service[105513]: DEBUG nova.api.openstack.wsgi_app [-] profiler.es_doc_type = notification {{(pid=105513) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 17:52:55.868073 dv-cinder-852009-8-iscsi devstack@n-api.service[105512]: DEBUG nova.api.openstack.wsgi_app [-] profiler.es_scroll_time = 2m {{(pid=105512) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 17:52:55.868162 dv-cinder-852009-8-iscsi devstack@n-api.service[105513]: DEBUG nova.api.openstack.wsgi_app [-] profiler.es_scroll_size = 10000 {{(pid=105513) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 17:52:55.868382 dv-cinder-852009-8-iscsi devstack@n-api.service[105512]: DEBUG nova.api.openstack.wsgi_app [-] profiler.filter_error_trace = False {{(pid=105512) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 17:52:55.868503 dv-cinder-852009-8-iscsi devstack@n-api.service[105513]: DEBUG nova.api.openstack.wsgi_app [-] profiler.es_scroll_time = 2m {{(pid=105513) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 17:52:55.868727 dv-cinder-852009-8-iscsi devstack@n-api.service[105512]: DEBUG nova.api.openstack.wsgi_app [-] profiler.hmac_keys = SECRET_KEY {{(pid=105512) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 17:52:55.868820 dv-cinder-852009-8-iscsi devstack@n-api.service[105513]: DEBUG nova.api.openstack.wsgi_app [-] profiler.filter_error_trace = False {{(pid=105513) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 17:52:55.869046 dv-cinder-852009-8-iscsi devstack@n-api.service[105512]: DEBUG nova.api.openstack.wsgi_app [-] profiler.sentinel_service_name = mymaster {{(pid=105512) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 17:52:55.869145 dv-cinder-852009-8-iscsi devstack@n-api.service[105513]: DEBUG nova.api.openstack.wsgi_app [-] profiler.hmac_keys = SECRET_KEY {{(pid=105513) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 17:52:55.869364 dv-cinder-852009-8-iscsi devstack@n-api.service[105512]: DEBUG nova.api.openstack.wsgi_app [-] profiler.socket_timeout = 0.1 {{(pid=105512) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 17:52:55.869494 dv-cinder-852009-8-iscsi devstack@n-api.service[105513]: DEBUG nova.api.openstack.wsgi_app [-] profiler.sentinel_service_name = mymaster {{(pid=105513) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 17:52:55.869681 dv-cinder-852009-8-iscsi devstack@n-api.service[105512]: DEBUG nova.api.openstack.wsgi_app [-] profiler.trace_sqlalchemy = False {{(pid=105512) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 17:52:55.869770 dv-cinder-852009-8-iscsi devstack@n-api.service[105513]: DEBUG nova.api.openstack.wsgi_app [-] profiler.socket_timeout = 0.1 {{(pid=105513) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 17:52:55.869985 dv-cinder-852009-8-iscsi devstack@n-api.service[105513]: DEBUG nova.api.openstack.wsgi_app [-] profiler.trace_sqlalchemy = False {{(pid=105513) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 17:52:55.870071 dv-cinder-852009-8-iscsi devstack@n-api.service[105512]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.amqp_auto_delete = False {{(pid=105512) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 17:52:55.870302 dv-cinder-852009-8-iscsi devstack@n-api.service[105512]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.amqp_durable_queues = False {{(pid=105512) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 17:52:55.870403 dv-cinder-852009-8-iscsi devstack@n-api.service[105513]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.amqp_auto_delete = False {{(pid=105513) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 17:52:55.870613 dv-cinder-852009-8-iscsi devstack@n-api.service[105512]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.conn_pool_min_size = 2 {{(pid=105512) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 17:52:55.870702 dv-cinder-852009-8-iscsi devstack@n-api.service[105513]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.amqp_durable_queues = False {{(pid=105513) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 17:52:55.870925 dv-cinder-852009-8-iscsi devstack@n-api.service[105512]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.conn_pool_ttl = 1200 {{(pid=105512) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 17:52:55.871013 dv-cinder-852009-8-iscsi devstack@n-api.service[105513]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.conn_pool_min_size = 2 {{(pid=105513) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 17:52:55.871235 dv-cinder-852009-8-iscsi devstack@n-api.service[105512]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.direct_mandatory_flag = True {{(pid=105512) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 17:52:55.871334 dv-cinder-852009-8-iscsi devstack@n-api.service[105513]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.conn_pool_ttl = 1200 {{(pid=105513) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 17:52:55.871542 dv-cinder-852009-8-iscsi devstack@n-api.service[105512]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.enable_cancel_on_failover = False {{(pid=105512) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 17:52:55.871639 dv-cinder-852009-8-iscsi devstack@n-api.service[105513]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.direct_mandatory_flag = True {{(pid=105513) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 17:52:55.871852 dv-cinder-852009-8-iscsi devstack@n-api.service[105513]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.enable_cancel_on_failover = False {{(pid=105513) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 17:52:55.871938 dv-cinder-852009-8-iscsi devstack@n-api.service[105512]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.heartbeat_in_pthread = False {{(pid=105512) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 17:52:55.872166 dv-cinder-852009-8-iscsi devstack@n-api.service[105513]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.heartbeat_in_pthread = False {{(pid=105513) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 17:52:55.872264 dv-cinder-852009-8-iscsi devstack@n-api.service[105512]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.heartbeat_rate = 3 {{(pid=105512) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 17:52:55.872522 dv-cinder-852009-8-iscsi devstack@n-api.service[105513]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.heartbeat_rate = 3 {{(pid=105513) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 17:52:55.872614 dv-cinder-852009-8-iscsi devstack@n-api.service[105512]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.heartbeat_timeout_threshold = 600 {{(pid=105512) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 17:52:55.872832 dv-cinder-852009-8-iscsi devstack@n-api.service[105512]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_compression = None {{(pid=105512) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 17:52:55.872918 dv-cinder-852009-8-iscsi devstack@n-api.service[105513]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.heartbeat_timeout_threshold = 600 {{(pid=105513) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 17:52:55.873151 dv-cinder-852009-8-iscsi devstack@n-api.service[105513]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_compression = None {{(pid=105513) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 17:52:55.873239 dv-cinder-852009-8-iscsi devstack@n-api.service[105512]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_failover_strategy = round-robin {{(pid=105512) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 17:52:55.873470 dv-cinder-852009-8-iscsi devstack@n-api.service[105512]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_missing_consumer_retry_timeout = 60 {{(pid=105512) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 17:52:55.873556 dv-cinder-852009-8-iscsi devstack@n-api.service[105513]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_failover_strategy = round-robin {{(pid=105513) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 17:52:55.873788 dv-cinder-852009-8-iscsi devstack@n-api.service[105513]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_missing_consumer_retry_timeout = 60 {{(pid=105513) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 17:52:55.873882 dv-cinder-852009-8-iscsi devstack@n-api.service[105512]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_reconnect_delay = 1.0 {{(pid=105512) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 17:52:55.874107 dv-cinder-852009-8-iscsi devstack@n-api.service[105512]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_ha_queues = False {{(pid=105512) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 17:52:55.874238 dv-cinder-852009-8-iscsi devstack@n-api.service[105513]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_reconnect_delay = 1.0 {{(pid=105513) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 17:52:55.874420 dv-cinder-852009-8-iscsi devstack@n-api.service[105512]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_interval_max = 30 {{(pid=105512) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 17:52:55.874556 dv-cinder-852009-8-iscsi devstack@n-api.service[105513]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_ha_queues = False {{(pid=105513) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 17:52:55.874731 dv-cinder-852009-8-iscsi devstack@n-api.service[105513]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_interval_max = 30 {{(pid=105513) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 17:52:55.874866 dv-cinder-852009-8-iscsi devstack@n-api.service[105512]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_login_method = AMQPLAIN {{(pid=105512) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 17:52:55.875047 dv-cinder-852009-8-iscsi devstack@n-api.service[105512]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_qos_prefetch_count = 0 {{(pid=105512) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 17:52:55.875181 dv-cinder-852009-8-iscsi devstack@n-api.service[105513]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_login_method = AMQPLAIN {{(pid=105513) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 17:52:55.875359 dv-cinder-852009-8-iscsi devstack@n-api.service[105512]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_quorum_delivery_limit = 0 {{(pid=105512) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 17:52:55.875508 dv-cinder-852009-8-iscsi devstack@n-api.service[105513]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_qos_prefetch_count = 0 {{(pid=105513) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 17:52:55.875686 dv-cinder-852009-8-iscsi devstack@n-api.service[105512]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_quorum_queue = False {{(pid=105512) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 17:52:55.875803 dv-cinder-852009-8-iscsi devstack@n-api.service[105513]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_quorum_delivery_limit = 0 {{(pid=105513) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 17:52:55.875961 dv-cinder-852009-8-iscsi devstack@n-api.service[105512]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_quroum_max_memory_bytes = 0 {{(pid=105512) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 17:52:55.876058 dv-cinder-852009-8-iscsi devstack@n-api.service[105513]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_quorum_queue = False {{(pid=105513) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 17:52:55.876269 dv-cinder-852009-8-iscsi devstack@n-api.service[105513]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_quroum_max_memory_bytes = 0 {{(pid=105513) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 17:52:55.876356 dv-cinder-852009-8-iscsi devstack@n-api.service[105512]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_quroum_max_memory_length = 0 {{(pid=105512) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 17:52:55.876610 dv-cinder-852009-8-iscsi devstack@n-api.service[105513]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_quroum_max_memory_length = 0 {{(pid=105513) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 17:52:55.876715 dv-cinder-852009-8-iscsi devstack@n-api.service[105512]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_retry_backoff = 2 {{(pid=105512) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 17:52:55.876920 dv-cinder-852009-8-iscsi devstack@n-api.service[105512]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_retry_interval = 1 {{(pid=105512) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 17:52:55.877006 dv-cinder-852009-8-iscsi devstack@n-api.service[105513]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_retry_backoff = 2 {{(pid=105513) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 17:52:55.877235 dv-cinder-852009-8-iscsi devstack@n-api.service[105513]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_retry_interval = 1 {{(pid=105513) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 17:52:55.877399 dv-cinder-852009-8-iscsi devstack@n-api.service[105512]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_transient_queues_ttl = 1800 {{(pid=105512) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 17:52:55.877544 dv-cinder-852009-8-iscsi devstack@n-api.service[105513]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_transient_queues_ttl = 1800 {{(pid=105513) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 17:52:55.877669 dv-cinder-852009-8-iscsi devstack@n-api.service[105512]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rpc_conn_pool_size = 30 {{(pid=105512) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 17:52:55.877855 dv-cinder-852009-8-iscsi devstack@n-api.service[105512]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl = False {{(pid=105512) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 17:52:55.877946 dv-cinder-852009-8-iscsi devstack@n-api.service[105513]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rpc_conn_pool_size = 30 {{(pid=105513) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 17:52:55.878169 dv-cinder-852009-8-iscsi devstack@n-api.service[105513]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl = False {{(pid=105513) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 17:52:55.878263 dv-cinder-852009-8-iscsi devstack@n-api.service[105512]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_ca_file = {{(pid=105512) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 17:52:55.878503 dv-cinder-852009-8-iscsi devstack@n-api.service[105512]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_cert_file = {{(pid=105512) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 17:52:55.878591 dv-cinder-852009-8-iscsi devstack@n-api.service[105513]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_ca_file = {{(pid=105513) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 17:52:55.878815 dv-cinder-852009-8-iscsi devstack@n-api.service[105512]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_enforce_fips_mode = False {{(pid=105512) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 17:52:55.878911 dv-cinder-852009-8-iscsi devstack@n-api.service[105513]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_cert_file = {{(pid=105513) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 17:52:55.879131 dv-cinder-852009-8-iscsi devstack@n-api.service[105513]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_enforce_fips_mode = False {{(pid=105513) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 17:52:55.879218 dv-cinder-852009-8-iscsi devstack@n-api.service[105512]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_key_file = {{(pid=105512) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 17:52:55.879453 dv-cinder-852009-8-iscsi devstack@n-api.service[105512]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_version = {{(pid=105512) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 17:52:55.879546 dv-cinder-852009-8-iscsi devstack@n-api.service[105513]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_key_file = {{(pid=105513) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 17:52:55.879778 dv-cinder-852009-8-iscsi devstack@n-api.service[105513]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_version = {{(pid=105513) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 17:52:55.879864 dv-cinder-852009-8-iscsi devstack@n-api.service[105512]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.driver = ['messagingv2'] {{(pid=105512) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 17:52:55.880101 dv-cinder-852009-8-iscsi devstack@n-api.service[105512]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.retry = -1 {{(pid=105512) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 17:52:55.880187 dv-cinder-852009-8-iscsi devstack@n-api.service[105513]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.driver = ['messagingv2'] {{(pid=105513) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 17:52:55.880501 dv-cinder-852009-8-iscsi devstack@n-api.service[105513]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.retry = -1 {{(pid=105513) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 17:52:55.880594 dv-cinder-852009-8-iscsi devstack@n-api.service[105512]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.topics = ['notifications'] {{(pid=105512) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 17:52:55.880793 dv-cinder-852009-8-iscsi devstack@n-api.service[105512]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.transport_url = **** {{(pid=105512) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 17:52:55.880931 dv-cinder-852009-8-iscsi devstack@n-api.service[105513]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.topics = ['notifications'] {{(pid=105513) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 17:52:55.881184 dv-cinder-852009-8-iscsi devstack@n-api.service[105513]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.transport_url = **** {{(pid=105513) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 17:52:55.881291 dv-cinder-852009-8-iscsi devstack@n-api.service[105512]: DEBUG nova.api.openstack.wsgi_app [-] oslo_reports.file_event_handler = None {{(pid=105512) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 17:52:55.881499 dv-cinder-852009-8-iscsi devstack@n-api.service[105512]: DEBUG nova.api.openstack.wsgi_app [-] oslo_reports.file_event_handler_interval = 1 {{(pid=105512) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 17:52:55.881584 dv-cinder-852009-8-iscsi devstack@n-api.service[105513]: DEBUG nova.api.openstack.wsgi_app [-] oslo_reports.file_event_handler = None {{(pid=105513) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 17:52:55.881806 dv-cinder-852009-8-iscsi devstack@n-api.service[105512]: DEBUG nova.api.openstack.wsgi_app [-] oslo_reports.log_dir = None {{(pid=105512) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 17:52:55.881894 dv-cinder-852009-8-iscsi devstack@n-api.service[105513]: DEBUG nova.api.openstack.wsgi_app [-] oslo_reports.file_event_handler_interval = 1 {{(pid=105513) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 17:52:55.882052 dv-cinder-852009-8-iscsi devstack@n-api.service[105512]: DEBUG nova.api.openstack.wsgi_app [-] ******************************************************************************** {{(pid=105512) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2613}} Sep 13 17:52:55.882182 dv-cinder-852009-8-iscsi devstack@n-api.service[105513]: DEBUG nova.api.openstack.wsgi_app [-] oslo_reports.log_dir = None {{(pid=105513) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 17:52:55.882344 dv-cinder-852009-8-iscsi devstack@n-api.service[105513]: DEBUG nova.api.openstack.wsgi_app [-] ******************************************************************************** {{(pid=105513) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2613}} Sep 13 17:52:56.039252 dv-cinder-852009-8-iscsi devstack@n-api.service[105513]: INFO dbcounter [None req-14d9acb2-9bc4-4613-b2cc-7daa8facd5b1 None None] Registered counter for database nova_api Sep 13 17:52:56.039504 dv-cinder-852009-8-iscsi devstack@n-api.service[105512]: INFO dbcounter [None req-ad10bae8-820d-4ab6-a92c-757ba23a3e58 None None] Registered counter for database nova_api Sep 13 17:52:56.060189 dv-cinder-852009-8-iscsi devstack@n-api.service[105512]: DEBUG oslo_db.sqlalchemy.engines [None req-ad10bae8-820d-4ab6-a92c-757ba23a3e58 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=105512) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Sep 13 17:52:56.063181 dv-cinder-852009-8-iscsi devstack@n-api.service[105513]: DEBUG oslo_db.sqlalchemy.engines [None req-14d9acb2-9bc4-4613-b2cc-7daa8facd5b1 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=105513) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Sep 13 17:52:56.067324 dv-cinder-852009-8-iscsi devstack@n-api.service[105512]: DEBUG dbcounter [-] [105512] Writer thread running {{(pid=105512) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:99}} Sep 13 17:52:56.070236 dv-cinder-852009-8-iscsi devstack@n-api.service[105513]: DEBUG dbcounter [-] [105513] Writer thread running {{(pid=105513) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:99}} Sep 13 17:52:56.124709 dv-cinder-852009-8-iscsi devstack@n-api.service[105512]: DEBUG nova.context [None req-ad10bae8-820d-4ab6-a92c-757ba23a3e58 None None] Found 2 cells: 00000000-0000-0000-0000-000000000000(cell0),1daf4f4c-0e4a-4779-b53a-78c48397ea2f(cell1) {{(pid=105512) load_cells /opt/stack/nova/nova/context.py:464}} Sep 13 17:52:56.127141 dv-cinder-852009-8-iscsi devstack@n-api.service[105513]: DEBUG nova.context [None req-14d9acb2-9bc4-4613-b2cc-7daa8facd5b1 None None] Found 2 cells: 00000000-0000-0000-0000-000000000000(cell0),1daf4f4c-0e4a-4779-b53a-78c48397ea2f(cell1) {{(pid=105513) load_cells /opt/stack/nova/nova/context.py:464}} Sep 13 17:52:56.128648 dv-cinder-852009-8-iscsi devstack@n-api.service[105512]: DEBUG oslo_concurrency.lockutils [None req-ad10bae8-820d-4ab6-a92c-757ba23a3e58 None None] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=105512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 17:52:56.129144 dv-cinder-852009-8-iscsi devstack@n-api.service[105512]: DEBUG oslo_concurrency.lockutils [None req-ad10bae8-820d-4ab6-a92c-757ba23a3e58 None None] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=105512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 17:52:56.130725 dv-cinder-852009-8-iscsi devstack@n-api.service[105512]: DEBUG oslo_concurrency.lockutils [None req-ad10bae8-820d-4ab6-a92c-757ba23a3e58 None None] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=105512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 17:52:56.131160 dv-cinder-852009-8-iscsi devstack@n-api.service[105513]: DEBUG oslo_concurrency.lockutils [None req-14d9acb2-9bc4-4613-b2cc-7daa8facd5b1 None None] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=105513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 17:52:56.131503 dv-cinder-852009-8-iscsi devstack@n-api.service[105512]: DEBUG oslo_concurrency.lockutils [None req-ad10bae8-820d-4ab6-a92c-757ba23a3e58 None None] Acquiring lock "1daf4f4c-0e4a-4779-b53a-78c48397ea2f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=105512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 17:52:56.131652 dv-cinder-852009-8-iscsi devstack@n-api.service[105513]: DEBUG oslo_concurrency.lockutils [None req-14d9acb2-9bc4-4613-b2cc-7daa8facd5b1 None None] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=105513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 17:52:56.131925 dv-cinder-852009-8-iscsi devstack@n-api.service[105512]: DEBUG oslo_concurrency.lockutils [None req-ad10bae8-820d-4ab6-a92c-757ba23a3e58 None None] Lock "1daf4f4c-0e4a-4779-b53a-78c48397ea2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=105512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 17:52:56.133253 dv-cinder-852009-8-iscsi devstack@n-api.service[105513]: DEBUG oslo_concurrency.lockutils [None req-14d9acb2-9bc4-4613-b2cc-7daa8facd5b1 None None] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=105513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 17:52:56.133974 dv-cinder-852009-8-iscsi devstack@n-api.service[105513]: DEBUG oslo_concurrency.lockutils [None req-14d9acb2-9bc4-4613-b2cc-7daa8facd5b1 None None] Acquiring lock "1daf4f4c-0e4a-4779-b53a-78c48397ea2f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=105513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 17:52:56.134111 dv-cinder-852009-8-iscsi devstack@n-api.service[105512]: DEBUG oslo_concurrency.lockutils [None req-ad10bae8-820d-4ab6-a92c-757ba23a3e58 None None] Lock "1daf4f4c-0e4a-4779-b53a-78c48397ea2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=105512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 17:52:56.134412 dv-cinder-852009-8-iscsi devstack@n-api.service[105513]: DEBUG oslo_concurrency.lockutils [None req-14d9acb2-9bc4-4613-b2cc-7daa8facd5b1 None None] Lock "1daf4f4c-0e4a-4779-b53a-78c48397ea2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=105513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 17:52:56.136047 dv-cinder-852009-8-iscsi devstack@n-api.service[105512]: INFO dbcounter [None req-ad10bae8-820d-4ab6-a92c-757ba23a3e58 None None] Registered counter for database nova_cell0 Sep 13 17:52:56.138617 dv-cinder-852009-8-iscsi devstack@n-api.service[105513]: DEBUG oslo_concurrency.lockutils [None req-14d9acb2-9bc4-4613-b2cc-7daa8facd5b1 None None] Lock "1daf4f4c-0e4a-4779-b53a-78c48397ea2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=105513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 17:52:56.140712 dv-cinder-852009-8-iscsi devstack@n-api.service[105512]: INFO dbcounter [None req-ad10bae8-820d-4ab6-a92c-757ba23a3e58 None None] Registered counter for database nova_cell1 Sep 13 17:52:56.140852 dv-cinder-852009-8-iscsi devstack@n-api.service[105513]: INFO dbcounter [None req-14d9acb2-9bc4-4613-b2cc-7daa8facd5b1 None None] Registered counter for database nova_cell0 Sep 13 17:52:56.145065 dv-cinder-852009-8-iscsi devstack@n-api.service[105513]: INFO dbcounter [None req-14d9acb2-9bc4-4613-b2cc-7daa8facd5b1 None None] Registered counter for database nova_cell1 Sep 13 17:52:56.149065 dv-cinder-852009-8-iscsi devstack@n-api.service[105512]: DEBUG oslo_db.sqlalchemy.engines [None req-ad10bae8-820d-4ab6-a92c-757ba23a3e58 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=105512) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Sep 13 17:52:56.151931 dv-cinder-852009-8-iscsi devstack@n-api.service[105512]: DEBUG oslo_db.sqlalchemy.engines [None req-ad10bae8-820d-4ab6-a92c-757ba23a3e58 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=105512) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Sep 13 17:52:56.153004 dv-cinder-852009-8-iscsi devstack@n-api.service[105513]: DEBUG oslo_db.sqlalchemy.engines [None req-14d9acb2-9bc4-4613-b2cc-7daa8facd5b1 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=105513) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Sep 13 17:52:56.155850 dv-cinder-852009-8-iscsi devstack@n-api.service[105513]: DEBUG oslo_db.sqlalchemy.engines [None req-14d9acb2-9bc4-4613-b2cc-7daa8facd5b1 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=105513) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Sep 13 17:52:56.156923 dv-cinder-852009-8-iscsi devstack@n-api.service[105512]: DEBUG dbcounter [-] [105512] Writer thread running {{(pid=105512) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:99}} Sep 13 17:52:56.159742 dv-cinder-852009-8-iscsi devstack@n-api.service[105513]: DEBUG dbcounter [-] [105513] Writer thread running {{(pid=105513) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:99}} Sep 13 17:52:56.160009 dv-cinder-852009-8-iscsi devstack@n-api.service[105512]: DEBUG dbcounter [-] [105512] Writer thread running {{(pid=105512) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:99}} Sep 13 17:52:56.305199 dv-cinder-852009-8-iscsi devstack@n-api.service[105512]: INFO dbcounter [None req-ad10bae8-820d-4ab6-a92c-757ba23a3e58 None None] Registered counter for database nova_cell0 Sep 13 17:52:56.312276 dv-cinder-852009-8-iscsi devstack@n-api.service[105512]: DEBUG oslo_db.sqlalchemy.engines [None req-ad10bae8-820d-4ab6-a92c-757ba23a3e58 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=105512) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Sep 13 17:52:56.317078 dv-cinder-852009-8-iscsi devstack@n-api.service[105513]: DEBUG dbcounter [-] [105513] Writer thread running {{(pid=105513) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:99}} Sep 13 17:52:56.317599 dv-cinder-852009-8-iscsi devstack@n-api.service[105512]: DEBUG dbcounter [-] [105512] Writer thread running {{(pid=105512) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:99}} Sep 13 17:52:56.327139 dv-cinder-852009-8-iscsi devstack@n-api.service[105513]: INFO dbcounter [None req-14d9acb2-9bc4-4613-b2cc-7daa8facd5b1 None None] Registered counter for database nova_cell0 Sep 13 17:52:56.336261 dv-cinder-852009-8-iscsi devstack@n-api.service[105513]: DEBUG oslo_db.sqlalchemy.engines [None req-14d9acb2-9bc4-4613-b2cc-7daa8facd5b1 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=105513) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Sep 13 17:52:56.341402 dv-cinder-852009-8-iscsi devstack@n-api.service[105513]: DEBUG dbcounter [-] [105513] Writer thread running {{(pid=105513) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:99}} Sep 13 17:52:56.652396 dv-cinder-852009-8-iscsi devstack@n-api.service[105512]: WARNING keystonemiddleware.auth_token [None req-ad10bae8-820d-4ab6-a92c-757ba23a3e58 None None] AuthToken middleware is set with keystone_authtoken.service_token_roles_required set to False. This is backwards compatible but deprecated behaviour. Please set this to True. Sep 13 17:52:56.659804 dv-cinder-852009-8-iscsi devstack@n-api.service[105512]: WARNING keystonemiddleware.auth_token [None req-ad10bae8-820d-4ab6-a92c-757ba23a3e58 None None] Configuring www_authenticate_uri to point to the public identity endpoint is required; clients may not be able to authenticate against an admin endpoint Sep 13 17:52:56.675034 dv-cinder-852009-8-iscsi devstack@n-api.service[105513]: WARNING keystonemiddleware.auth_token [None req-14d9acb2-9bc4-4613-b2cc-7daa8facd5b1 None None] AuthToken middleware is set with keystone_authtoken.service_token_roles_required set to False. This is backwards compatible but deprecated behaviour. Please set this to True. Sep 13 17:52:56.683258 dv-cinder-852009-8-iscsi devstack@n-api.service[105513]: WARNING keystonemiddleware.auth_token [None req-14d9acb2-9bc4-4613-b2cc-7daa8facd5b1 None None] Configuring www_authenticate_uri to point to the public identity endpoint is required; clients may not be able to authenticate against an admin endpoint Sep 13 17:52:57.002704 dv-cinder-852009-8-iscsi devstack@n-api.service[105512]: WARNING keystonemiddleware.auth_token [None req-ad10bae8-820d-4ab6-a92c-757ba23a3e58 None None] AuthToken middleware is set with keystone_authtoken.service_token_roles_required set to False. This is backwards compatible but deprecated behaviour. Please set this to True. Sep 13 17:52:57.008798 dv-cinder-852009-8-iscsi devstack@n-api.service[105512]: WARNING keystonemiddleware.auth_token [None req-ad10bae8-820d-4ab6-a92c-757ba23a3e58 None None] Configuring www_authenticate_uri to point to the public identity endpoint is required; clients may not be able to authenticate against an admin endpoint Sep 13 17:52:57.014774 dv-cinder-852009-8-iscsi devstack@n-api.service[105512]: WSGI app 0 (mountpoint='') ready in 6 seconds on interpreter 0x55871ba559c0 pid: 105512 (default app) Sep 13 17:52:57.016878 dv-cinder-852009-8-iscsi devstack@n-api.service[105512]: DEBUG nova.api.openstack.wsgi [None req-ad10bae8-820d-4ab6-a92c-757ba23a3e58 None None] Calling method '>' {{(pid=105512) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 17:52:57.018076 dv-cinder-852009-8-iscsi devstack@n-api.service[105512]: INFO nova.api.openstack.requestlog [None req-ad10bae8-820d-4ab6-a92c-757ba23a3e58 None None] 10.222.0.43 "GET /compute/v2.1/" status: 200 len: 388 microversion: 2.1 time: 0.001778 Sep 13 17:52:57.018490 dv-cinder-852009-8-iscsi devstack@n-api.service[105512]: [pid: 105512|app: 0|req: 1/1] 10.222.0.43 () {50 vars in 788 bytes} [Tue Sep 13 17:52:57 2022] GET /compute/v2.1/ => generated 388 bytes in 3 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 13 17:52:57.034881 dv-cinder-852009-8-iscsi devstack@n-api.service[105513]: WARNING keystonemiddleware.auth_token [None req-14d9acb2-9bc4-4613-b2cc-7daa8facd5b1 None None] AuthToken middleware is set with keystone_authtoken.service_token_roles_required set to False. This is backwards compatible but deprecated behaviour. Please set this to True. Sep 13 17:52:57.041158 dv-cinder-852009-8-iscsi devstack@n-api.service[105513]: WARNING keystonemiddleware.auth_token [None req-14d9acb2-9bc4-4613-b2cc-7daa8facd5b1 None None] Configuring www_authenticate_uri to point to the public identity endpoint is required; clients may not be able to authenticate against an admin endpoint Sep 13 17:52:57.046509 dv-cinder-852009-8-iscsi devstack@n-api.service[105513]: WSGI app 0 (mountpoint='') ready in 6 seconds on interpreter 0x55871ba559c0 pid: 105513 (default app) Sep 13 17:54:24.983399 dv-cinder-852009-8-iscsi devstack@n-api.service[105512]: DEBUG nova.api.openstack.wsgi [None req-ad10bae8-820d-4ab6-a92c-757ba23a3e58 None None] Calling method '>' {{(pid=105512) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 17:54:24.984643 dv-cinder-852009-8-iscsi devstack@n-api.service[105512]: INFO nova.api.openstack.requestlog [None req-ad10bae8-820d-4ab6-a92c-757ba23a3e58 None None] 10.222.0.43 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001604 Sep 13 17:54:24.985236 dv-cinder-852009-8-iscsi devstack@n-api.service[105512]: [pid: 105512|app: 0|req: 2/2] 10.222.0.43 () {54 vars in 931 bytes} [Tue Sep 13 17:54:24 2022] GET /compute/v2.1 => generated 388 bytes in 3 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 13 17:54:24.997920 dv-cinder-852009-8-iscsi devstack@n-api.service[105513]: DEBUG dbcounter [-] [105513] Writing DB stats nova_api:SELECT=3 {{(pid=105513) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 17:54:24.999523 dv-cinder-852009-8-iscsi devstack@n-api.service[105513]: DEBUG dbcounter [-] [105513] Writing DB stats nova_cell0:SELECT=3 {{(pid=105513) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 17:54:25.000591 dv-cinder-852009-8-iscsi devstack@n-api.service[105513]: DEBUG dbcounter [-] [105513] Writing DB stats nova_cell1:SELECT=3 {{(pid=105513) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 17:54:25.001665 dv-cinder-852009-8-iscsi devstack@n-api.service[105513]: DEBUG dbcounter [-] [105513] Writing DB stats nova_cell0:SELECT=3 {{(pid=105513) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 17:54:26.202529 dv-cinder-852009-8-iscsi devstack@n-api.service[105513]: DEBUG nova.api.openstack.wsgi [None req-5013a41d-78f6-418d-b419-e88665cd67cc admin admin] Calling method '>' {{(pid=105513) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 17:54:26.258527 dv-cinder-852009-8-iscsi devstack@n-api.service[105513]: INFO nova.api.openstack.requestlog [None req-5013a41d-78f6-418d-b419-e88665cd67cc admin admin] 10.222.0.43 "GET /compute/v2.1/flavors/detail?is_public=True" status: 200 len: 15 microversion: 2.61 time: 1.266042 Sep 13 17:54:26.260464 dv-cinder-852009-8-iscsi devstack@n-api.service[105513]: [pid: 105513|app: 0|req: 1/3] 10.222.0.43 () {60 vars in 1292 bytes} [Tue Sep 13 17:54:24 2022] GET /compute/v2.1/flavors/detail?is_public=True => generated 15 bytes in 1268 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 13 17:54:29.486777 dv-cinder-852009-8-iscsi devstack@n-api.service[105512]: DEBUG nova.api.openstack.wsgi [None req-ad10bae8-820d-4ab6-a92c-757ba23a3e58 None None] Calling method '>' {{(pid=105512) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 17:54:29.487870 dv-cinder-852009-8-iscsi devstack@n-api.service[105512]: INFO nova.api.openstack.requestlog [None req-ad10bae8-820d-4ab6-a92c-757ba23a3e58 None None] 10.222.0.43 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001574 Sep 13 17:54:29.488279 dv-cinder-852009-8-iscsi devstack@n-api.service[105512]: [pid: 105512|app: 0|req: 3/4] 10.222.0.43 () {54 vars in 931 bytes} [Tue Sep 13 17:54:29 2022] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 13 17:54:30.049835 dv-cinder-852009-8-iscsi devstack@n-api.service[105513]: DEBUG nova.api.openstack.wsgi [None req-1941ea45-48ef-428d-9c3d-7883d75e78c0 admin admin] Action: 'create', calling method: >, body: {"flavor": {"vcpus": 1, "OS-FLV-EXT-DATA:ephemeral": 0, "swap": 0, "disk": 1, "os-flavor-access:is_public": true, "name": "cirros256", "rxtx_factor": 1.0, "id": "c1", "ram": 256}} {{(pid=105513) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 13 17:54:30.127326 dv-cinder-852009-8-iscsi devstack@n-api.service[105513]: INFO nova.api.openstack.requestlog [None req-1941ea45-48ef-428d-9c3d-7883d75e78c0 admin admin] 10.222.0.43 "POST /compute/v2.1/flavors" status: 200 len: 407 microversion: 2.61 time: 0.631368 Sep 13 17:54:30.127916 dv-cinder-852009-8-iscsi devstack@n-api.service[105513]: [pid: 105513|app: 0|req: 2/5] 10.222.0.43 () {64 vars in 1283 bytes} [Tue Sep 13 17:54:29 2022] POST /compute/v2.1/flavors => generated 407 bytes in 633 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Sep 13 17:54:30.142784 dv-cinder-852009-8-iscsi devstack@n-api.service[105512]: DEBUG dbcounter [-] [105512] Writing DB stats nova_api:SELECT=3 {{(pid=105512) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 17:54:30.144048 dv-cinder-852009-8-iscsi devstack@n-api.service[105512]: DEBUG dbcounter [-] [105512] Writing DB stats nova_cell1:SELECT=3 {{(pid=105512) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 17:54:30.146235 dv-cinder-852009-8-iscsi devstack@n-api.service[105512]: DEBUG dbcounter [-] [105512] Writing DB stats nova_cell0:SELECT=3 {{(pid=105512) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 17:54:30.147006 dv-cinder-852009-8-iscsi devstack@n-api.service[105512]: DEBUG dbcounter [-] [105512] Writing DB stats nova_cell0:SELECT=6,nova_cell0:INSERT=1 {{(pid=105512) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 17:54:30.390946 dv-cinder-852009-8-iscsi devstack@n-api.service[105512]: DEBUG nova.api.openstack.wsgi [None req-43bf16d0-11aa-4472-9124-638eacd1ab7c admin admin] Action: 'create', calling method: >, body: {"extra_specs": {"hw_rng:allowed": "True"}} {{(pid=105512) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 13 17:54:30.497603 dv-cinder-852009-8-iscsi devstack@n-api.service[105512]: INFO nova.api.openstack.requestlog [None req-43bf16d0-11aa-4472-9124-638eacd1ab7c admin admin] 10.222.0.43 "POST /compute/v2.1/flavors/c1/os-extra_specs" status: 200 len: 43 microversion: 2.61 time: 0.359878 Sep 13 17:54:30.499148 dv-cinder-852009-8-iscsi devstack@n-api.service[105512]: [pid: 105512|app: 0|req: 4/6] 10.222.0.43 () {64 vars in 1336 bytes} [Tue Sep 13 17:54:30 2022] POST /compute/v2.1/flavors/c1/os-extra_specs => generated 43 bytes in 362 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 13 17:54:33.226978 dv-cinder-852009-8-iscsi devstack@n-api.service[105513]: DEBUG nova.api.openstack.wsgi [None req-1941ea45-48ef-428d-9c3d-7883d75e78c0 admin admin] Calling method '>' {{(pid=105513) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 17:54:33.228022 dv-cinder-852009-8-iscsi devstack@n-api.service[105513]: INFO nova.api.openstack.requestlog [None req-1941ea45-48ef-428d-9c3d-7883d75e78c0 admin admin] 10.222.0.43 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001508 Sep 13 17:54:33.229086 dv-cinder-852009-8-iscsi devstack@n-api.service[105513]: [pid: 105513|app: 0|req: 3/7] 10.222.0.43 () {54 vars in 931 bytes} [Tue Sep 13 17:54:33 2022] GET /compute/v2.1 => generated 388 bytes in 3 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 13 17:54:33.976623 dv-cinder-852009-8-iscsi devstack@n-api.service[105512]: DEBUG nova.api.openstack.wsgi [None req-73fe877b-2659-4067-b7c0-1ac07c08fd86 admin admin] Action: 'create', calling method: >, body: {"flavor": {"OS-FLV-EXT-DATA:ephemeral": 0, "vcpus": 1, "name": "ds512M", "swap": 0, "id": "d1", "rxtx_factor": 1.0, "disk": 5, "ram": 512, "os-flavor-access:is_public": true}} {{(pid=105512) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 13 17:54:34.020057 dv-cinder-852009-8-iscsi devstack@n-api.service[105512]: INFO nova.api.openstack.requestlog [None req-73fe877b-2659-4067-b7c0-1ac07c08fd86 admin admin] 10.222.0.43 "POST /compute/v2.1/flavors" status: 200 len: 404 microversion: 2.61 time: 0.784664 Sep 13 17:54:34.020986 dv-cinder-852009-8-iscsi devstack@n-api.service[105512]: [pid: 105512|app: 0|req: 5/8] 10.222.0.43 () {64 vars in 1283 bytes} [Tue Sep 13 17:54:33 2022] POST /compute/v2.1/flavors => generated 404 bytes in 786 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Sep 13 17:54:34.033378 dv-cinder-852009-8-iscsi devstack@n-api.service[105513]: DEBUG nova.api.openstack.wsgi [None req-0028c3ba-fd3d-41fc-8dc9-ec236caf71ab admin admin] Action: 'create', calling method: >, body: {"extra_specs": {"hw_rng:allowed": "True"}} {{(pid=105513) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 13 17:54:34.077293 dv-cinder-852009-8-iscsi devstack@n-api.service[105513]: INFO nova.api.openstack.requestlog [None req-0028c3ba-fd3d-41fc-8dc9-ec236caf71ab admin admin] 10.222.0.43 "POST /compute/v2.1/flavors/d1/os-extra_specs" status: 200 len: 43 microversion: 2.61 time: 0.047363 Sep 13 17:54:34.078223 dv-cinder-852009-8-iscsi devstack@n-api.service[105513]: [pid: 105513|app: 0|req: 4/9] 10.222.0.43 () {64 vars in 1336 bytes} [Tue Sep 13 17:54:34 2022] POST /compute/v2.1/flavors/d1/os-extra_specs => generated 43 bytes in 49 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 13 17:54:36.907101 dv-cinder-852009-8-iscsi devstack@n-api.service[105512]: DEBUG nova.api.openstack.wsgi [None req-73fe877b-2659-4067-b7c0-1ac07c08fd86 admin admin] Calling method '>' {{(pid=105512) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 17:54:36.908170 dv-cinder-852009-8-iscsi devstack@n-api.service[105512]: INFO nova.api.openstack.requestlog [None req-73fe877b-2659-4067-b7c0-1ac07c08fd86 admin admin] 10.222.0.43 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001551 Sep 13 17:54:36.908596 dv-cinder-852009-8-iscsi devstack@n-api.service[105512]: [pid: 105512|app: 0|req: 6/10] 10.222.0.43 () {54 vars in 931 bytes} [Tue Sep 13 17:54:36 2022] GET /compute/v2.1 => generated 388 bytes in 3 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 13 17:54:37.349053 dv-cinder-852009-8-iscsi devstack@n-api.service[105513]: DEBUG nova.api.openstack.wsgi [None req-912f5b49-8b3e-4a90-8f63-8eba53c4dac7 admin admin] Action: 'create', calling method: >, body: {"flavor": {"os-flavor-access:is_public": true, "OS-FLV-EXT-DATA:ephemeral": 0, "rxtx_factor": 1.0, "swap": 0, "id": "d2", "disk": 10, "name": "ds1G", "ram": 1024, "vcpus": 1}} {{(pid=105513) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 13 17:54:37.371231 dv-cinder-852009-8-iscsi devstack@n-api.service[105513]: INFO nova.api.openstack.requestlog [None req-912f5b49-8b3e-4a90-8f63-8eba53c4dac7 admin admin] 10.222.0.43 "POST /compute/v2.1/flavors" status: 200 len: 404 microversion: 2.61 time: 0.456160 Sep 13 17:54:37.371804 dv-cinder-852009-8-iscsi devstack@n-api.service[105513]: [pid: 105513|app: 0|req: 5/11] 10.222.0.43 () {64 vars in 1283 bytes} [Tue Sep 13 17:54:36 2022] POST /compute/v2.1/flavors => generated 404 bytes in 457 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Sep 13 17:54:37.384854 dv-cinder-852009-8-iscsi devstack@n-api.service[105512]: DEBUG nova.api.openstack.wsgi [None req-3706c5a9-4f21-422d-9d4f-448236febd43 admin admin] Action: 'create', calling method: >, body: {"extra_specs": {"hw_rng:allowed": "True"}} {{(pid=105512) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 13 17:54:37.413839 dv-cinder-852009-8-iscsi devstack@n-api.service[105512]: INFO nova.api.openstack.requestlog [None req-3706c5a9-4f21-422d-9d4f-448236febd43 admin admin] 10.222.0.43 "POST /compute/v2.1/flavors/d2/os-extra_specs" status: 200 len: 43 microversion: 2.61 time: 0.033249 Sep 13 17:54:37.414433 dv-cinder-852009-8-iscsi devstack@n-api.service[105512]: [pid: 105512|app: 0|req: 7/12] 10.222.0.43 () {64 vars in 1336 bytes} [Tue Sep 13 17:54:37 2022] POST /compute/v2.1/flavors/d2/os-extra_specs => generated 43 bytes in 35 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 13 17:54:40.142670 dv-cinder-852009-8-iscsi devstack@n-api.service[105513]: DEBUG nova.api.openstack.wsgi [None req-912f5b49-8b3e-4a90-8f63-8eba53c4dac7 admin admin] Calling method '>' {{(pid=105513) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 17:54:40.143724 dv-cinder-852009-8-iscsi devstack@n-api.service[105513]: INFO nova.api.openstack.requestlog [None req-912f5b49-8b3e-4a90-8f63-8eba53c4dac7 admin admin] 10.222.0.43 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001519 Sep 13 17:54:40.144376 dv-cinder-852009-8-iscsi devstack@n-api.service[105513]: [pid: 105513|app: 0|req: 6/13] 10.222.0.43 () {54 vars in 931 bytes} [Tue Sep 13 17:54:40 2022] GET /compute/v2.1 => generated 388 bytes in 3 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 13 17:54:40.833031 dv-cinder-852009-8-iscsi devstack@n-api.service[105512]: DEBUG nova.api.openstack.wsgi [None req-936c706f-1245-43b5-ae3e-24a28d3bc721 admin admin] Action: 'create', calling method: >, body: {"flavor": {"os-flavor-access:is_public": true, "name": "ds2G", "rxtx_factor": 1.0, "OS-FLV-EXT-DATA:ephemeral": 0, "disk": 10, "swap": 0, "vcpus": 2, "ram": 2048, "id": "d3"}} {{(pid=105512) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 13 17:54:40.863862 dv-cinder-852009-8-iscsi devstack@n-api.service[105512]: INFO nova.api.openstack.requestlog [None req-936c706f-1245-43b5-ae3e-24a28d3bc721 admin admin] 10.222.0.43 "POST /compute/v2.1/flavors" status: 200 len: 404 microversion: 2.61 time: 0.712171 Sep 13 17:54:40.868463 dv-cinder-852009-8-iscsi devstack@n-api.service[105512]: [pid: 105512|app: 0|req: 8/14] 10.222.0.43 () {64 vars in 1283 bytes} [Tue Sep 13 17:54:40 2022] POST /compute/v2.1/flavors => generated 404 bytes in 718 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Sep 13 17:54:40.883699 dv-cinder-852009-8-iscsi devstack@n-api.service[105513]: DEBUG nova.api.openstack.wsgi [None req-175687ad-347c-41ae-bb0f-080fb0124859 admin admin] Action: 'create', calling method: >, body: {"extra_specs": {"hw_rng:allowed": "True"}} {{(pid=105513) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 13 17:54:40.927434 dv-cinder-852009-8-iscsi devstack@n-api.service[105513]: INFO nova.api.openstack.requestlog [None req-175687ad-347c-41ae-bb0f-080fb0124859 admin admin] 10.222.0.43 "POST /compute/v2.1/flavors/d3/os-extra_specs" status: 200 len: 43 microversion: 2.61 time: 0.049707 Sep 13 17:54:40.928397 dv-cinder-852009-8-iscsi devstack@n-api.service[105513]: [pid: 105513|app: 0|req: 7/15] 10.222.0.43 () {64 vars in 1336 bytes} [Tue Sep 13 17:54:40 2022] POST /compute/v2.1/flavors/d3/os-extra_specs => generated 43 bytes in 52 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 13 17:54:44.119658 dv-cinder-852009-8-iscsi devstack@n-api.service[105512]: DEBUG nova.api.openstack.wsgi [None req-936c706f-1245-43b5-ae3e-24a28d3bc721 admin admin] Calling method '>' {{(pid=105512) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 17:54:44.122129 dv-cinder-852009-8-iscsi devstack@n-api.service[105512]: INFO nova.api.openstack.requestlog [None req-936c706f-1245-43b5-ae3e-24a28d3bc721 admin admin] 10.222.0.43 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.002979 Sep 13 17:54:44.122823 dv-cinder-852009-8-iscsi devstack@n-api.service[105512]: [pid: 105512|app: 0|req: 9/16] 10.222.0.43 () {54 vars in 931 bytes} [Tue Sep 13 17:54:44 2022] GET /compute/v2.1 => generated 388 bytes in 5 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 13 17:54:44.670898 dv-cinder-852009-8-iscsi devstack@n-api.service[105513]: DEBUG nova.api.openstack.wsgi [None req-6ed8c8da-c0a5-48cd-a872-a6b338794f6a admin admin] Action: 'create', calling method: >, body: {"flavor": {"vcpus": 4, "os-flavor-access:is_public": true, "swap": 0, "ram": 4096, "disk": 20, "name": "ds4G", "id": "d4", "rxtx_factor": 1.0, "OS-FLV-EXT-DATA:ephemeral": 0}} {{(pid=105513) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 13 17:54:44.693688 dv-cinder-852009-8-iscsi devstack@n-api.service[105513]: INFO nova.api.openstack.requestlog [None req-6ed8c8da-c0a5-48cd-a872-a6b338794f6a admin admin] 10.222.0.43 "POST /compute/v2.1/flavors" status: 200 len: 404 microversion: 2.61 time: 0.561552 Sep 13 17:54:44.694274 dv-cinder-852009-8-iscsi devstack@n-api.service[105513]: [pid: 105513|app: 0|req: 8/17] 10.222.0.43 () {64 vars in 1283 bytes} [Tue Sep 13 17:54:44 2022] POST /compute/v2.1/flavors => generated 404 bytes in 563 msecs (HTTP/1.1 200) 9 headers in 359 bytes (2 switches on core 0) Sep 13 17:54:44.708815 dv-cinder-852009-8-iscsi devstack@n-api.service[105512]: DEBUG nova.api.openstack.wsgi [None req-a28b34fc-8ba3-4b9a-a958-7b916271726b admin admin] Action: 'create', calling method: >, body: {"extra_specs": {"hw_rng:allowed": "True"}} {{(pid=105512) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 13 17:54:44.740484 dv-cinder-852009-8-iscsi devstack@n-api.service[105512]: INFO nova.api.openstack.requestlog [None req-a28b34fc-8ba3-4b9a-a958-7b916271726b admin admin] 10.222.0.43 "POST /compute/v2.1/flavors/d4/os-extra_specs" status: 200 len: 43 microversion: 2.61 time: 0.036947 Sep 13 17:54:44.741438 dv-cinder-852009-8-iscsi devstack@n-api.service[105512]: [pid: 105512|app: 0|req: 10/18] 10.222.0.43 () {64 vars in 1336 bytes} [Tue Sep 13 17:54:44 2022] POST /compute/v2.1/flavors/d4/os-extra_specs => generated 43 bytes in 39 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 13 17:54:47.581203 dv-cinder-852009-8-iscsi devstack@n-api.service[105513]: DEBUG nova.api.openstack.wsgi [None req-6ed8c8da-c0a5-48cd-a872-a6b338794f6a admin admin] Calling method '>' {{(pid=105513) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 17:54:47.582282 dv-cinder-852009-8-iscsi devstack@n-api.service[105513]: INFO nova.api.openstack.requestlog [None req-6ed8c8da-c0a5-48cd-a872-a6b338794f6a admin admin] 10.222.0.43 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001899 Sep 13 17:54:47.582717 dv-cinder-852009-8-iscsi devstack@n-api.service[105513]: [pid: 105513|app: 0|req: 9/19] 10.222.0.43 () {54 vars in 931 bytes} [Tue Sep 13 17:54:47 2022] GET /compute/v2.1 => generated 388 bytes in 3 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 13 17:54:48.091339 dv-cinder-852009-8-iscsi devstack@n-api.service[105512]: DEBUG nova.api.openstack.wsgi [None req-ad6a3795-a035-47e6-b0bf-487b4a265bc3 admin admin] Calling method '>' {{(pid=105512) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 17:54:48.117950 dv-cinder-852009-8-iscsi devstack@n-api.service[105512]: INFO nova.api.openstack.requestlog [None req-ad6a3795-a035-47e6-b0bf-487b4a265bc3 admin admin] 10.222.0.43 "GET /compute/v2.1/flavors/detail?is_public=True" status: 200 len: 2106 microversion: 2.61 time: 0.527309 Sep 13 17:54:48.119113 dv-cinder-852009-8-iscsi devstack@n-api.service[105512]: [pid: 105512|app: 0|req: 11/20] 10.222.0.43 () {60 vars in 1292 bytes} [Tue Sep 13 17:54:47 2022] GET /compute/v2.1/flavors/detail?is_public=True => generated 2106 bytes in 529 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Sep 13 17:54:50.946181 dv-cinder-852009-8-iscsi devstack@n-api.service[105513]: DEBUG nova.api.openstack.wsgi [None req-6ed8c8da-c0a5-48cd-a872-a6b338794f6a admin admin] Calling method '>' {{(pid=105513) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 17:54:50.947154 dv-cinder-852009-8-iscsi devstack@n-api.service[105513]: INFO nova.api.openstack.requestlog [None req-6ed8c8da-c0a5-48cd-a872-a6b338794f6a admin admin] 10.222.0.43 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001743 Sep 13 17:54:50.947572 dv-cinder-852009-8-iscsi devstack@n-api.service[105513]: [pid: 105513|app: 0|req: 10/21] 10.222.0.43 () {54 vars in 931 bytes} [Tue Sep 13 17:54:50 2022] GET /compute/v2.1 => generated 388 bytes in 3 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Sep 13 17:54:51.406097 dv-cinder-852009-8-iscsi devstack@n-api.service[105512]: DEBUG nova.api.openstack.wsgi [None req-0c707ff7-96d3-4060-8059-4f97416470ba admin admin] Action: 'create', calling method: >, body: {"flavor": {"swap": 0, "id": "1", "vcpus": 1, "ram": 512, "disk": 1, "rxtx_factor": 1.0, "OS-FLV-EXT-DATA:ephemeral": 0, "name": "m1.tiny", "os-flavor-access:is_public": true}} {{(pid=105512) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 13 17:54:51.430002 dv-cinder-852009-8-iscsi devstack@n-api.service[105512]: INFO nova.api.openstack.requestlog [None req-0c707ff7-96d3-4060-8059-4f97416470ba admin admin] 10.222.0.43 "POST /compute/v2.1/flavors" status: 200 len: 402 microversion: 2.61 time: 0.474790 Sep 13 17:54:51.430609 dv-cinder-852009-8-iscsi devstack@n-api.service[105512]: [pid: 105512|app: 0|req: 12/22] 10.222.0.43 () {64 vars in 1283 bytes} [Tue Sep 13 17:54:50 2022] POST /compute/v2.1/flavors => generated 402 bytes in 476 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Sep 13 17:54:51.444028 dv-cinder-852009-8-iscsi devstack@n-api.service[105513]: DEBUG nova.api.openstack.wsgi [None req-a610c628-323e-4747-8301-e886c9137b05 admin admin] Action: 'create', calling method: >, body: {"extra_specs": {"hw_rng:allowed": "True"}} {{(pid=105513) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 13 17:54:51.476166 dv-cinder-852009-8-iscsi devstack@n-api.service[105513]: INFO nova.api.openstack.requestlog [None req-a610c628-323e-4747-8301-e886c9137b05 admin admin] 10.222.0.43 "POST /compute/v2.1/flavors/1/os-extra_specs" status: 200 len: 43 microversion: 2.61 time: 0.036346 Sep 13 17:54:51.476830 dv-cinder-852009-8-iscsi devstack@n-api.service[105513]: [pid: 105513|app: 0|req: 11/23] 10.222.0.43 () {64 vars in 1333 bytes} [Tue Sep 13 17:54:51 2022] POST /compute/v2.1/flavors/1/os-extra_specs => generated 43 bytes in 38 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 13 17:54:54.394876 dv-cinder-852009-8-iscsi devstack@n-api.service[105512]: DEBUG nova.api.openstack.wsgi [None req-0c707ff7-96d3-4060-8059-4f97416470ba admin admin] Calling method '>' {{(pid=105512) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 17:54:54.396026 dv-cinder-852009-8-iscsi devstack@n-api.service[105512]: INFO nova.api.openstack.requestlog [None req-0c707ff7-96d3-4060-8059-4f97416470ba admin admin] 10.222.0.43 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001647 Sep 13 17:54:54.396544 dv-cinder-852009-8-iscsi devstack@n-api.service[105512]: [pid: 105512|app: 0|req: 13/24] 10.222.0.43 () {54 vars in 931 bytes} [Tue Sep 13 17:54:54 2022] GET /compute/v2.1 => generated 388 bytes in 3 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 13 17:54:54.798610 dv-cinder-852009-8-iscsi devstack@n-api.service[105513]: DEBUG nova.api.openstack.wsgi [None req-8f22c046-ee0e-491f-b158-538acb21de38 admin admin] Action: 'create', calling method: >, body: {"flavor": {"OS-FLV-EXT-DATA:ephemeral": 0, "name": "m1.small", "vcpus": 1, "rxtx_factor": 1.0, "os-flavor-access:is_public": true, "swap": 0, "id": "2", "ram": 2048, "disk": 20}} {{(pid=105513) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 13 17:54:54.819288 dv-cinder-852009-8-iscsi devstack@n-api.service[105513]: INFO nova.api.openstack.requestlog [None req-8f22c046-ee0e-491f-b158-538acb21de38 admin admin] 10.222.0.43 "POST /compute/v2.1/flavors" status: 200 len: 405 microversion: 2.61 time: 0.416139 Sep 13 17:54:54.819843 dv-cinder-852009-8-iscsi devstack@n-api.service[105513]: [pid: 105513|app: 0|req: 12/25] 10.222.0.43 () {64 vars in 1283 bytes} [Tue Sep 13 17:54:54 2022] POST /compute/v2.1/flavors => generated 405 bytes in 417 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Sep 13 17:54:54.832511 dv-cinder-852009-8-iscsi devstack@n-api.service[105512]: DEBUG nova.api.openstack.wsgi [None req-09bf4ff5-8417-44d1-839d-759a534c214a admin admin] Action: 'create', calling method: >, body: {"extra_specs": {"hw_rng:allowed": "True"}} {{(pid=105512) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 13 17:54:54.856727 dv-cinder-852009-8-iscsi devstack@n-api.service[105512]: INFO nova.api.openstack.requestlog [None req-09bf4ff5-8417-44d1-839d-759a534c214a admin admin] 10.222.0.43 "POST /compute/v2.1/flavors/2/os-extra_specs" status: 200 len: 43 microversion: 2.61 time: 0.028302 Sep 13 17:54:54.857455 dv-cinder-852009-8-iscsi devstack@n-api.service[105512]: [pid: 105512|app: 0|req: 14/26] 10.222.0.43 () {64 vars in 1333 bytes} [Tue Sep 13 17:54:54 2022] POST /compute/v2.1/flavors/2/os-extra_specs => generated 43 bytes in 30 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 13 17:54:57.548575 dv-cinder-852009-8-iscsi devstack@n-api.service[105513]: DEBUG nova.api.openstack.wsgi [None req-8f22c046-ee0e-491f-b158-538acb21de38 admin admin] Calling method '>' {{(pid=105513) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 17:54:57.550548 dv-cinder-852009-8-iscsi devstack@n-api.service[105513]: INFO nova.api.openstack.requestlog [None req-8f22c046-ee0e-491f-b158-538acb21de38 admin admin] 10.222.0.43 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.002432 Sep 13 17:54:57.551031 dv-cinder-852009-8-iscsi devstack@n-api.service[105513]: [pid: 105513|app: 0|req: 13/27] 10.222.0.43 () {54 vars in 931 bytes} [Tue Sep 13 17:54:57 2022] GET /compute/v2.1 => generated 388 bytes in 3 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 13 17:54:58.062607 dv-cinder-852009-8-iscsi devstack@n-api.service[105512]: DEBUG nova.api.openstack.wsgi [None req-d9826c21-bbbb-4da7-b576-ce1714d035c4 admin admin] Action: 'create', calling method: >, body: {"flavor": {"disk": 40, "name": "m1.medium", "id": "3", "os-flavor-access:is_public": true, "OS-FLV-EXT-DATA:ephemeral": 0, "swap": 0, "rxtx_factor": 1.0, "ram": 4096, "vcpus": 2}} {{(pid=105512) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 13 17:54:58.090311 dv-cinder-852009-8-iscsi devstack@n-api.service[105512]: INFO nova.api.openstack.requestlog [None req-d9826c21-bbbb-4da7-b576-ce1714d035c4 admin admin] 10.222.0.43 "POST /compute/v2.1/flavors" status: 200 len: 406 microversion: 2.61 time: 0.531811 Sep 13 17:54:58.090843 dv-cinder-852009-8-iscsi devstack@n-api.service[105512]: [pid: 105512|app: 0|req: 15/28] 10.222.0.43 () {64 vars in 1283 bytes} [Tue Sep 13 17:54:57 2022] POST /compute/v2.1/flavors => generated 406 bytes in 533 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Sep 13 17:54:58.103275 dv-cinder-852009-8-iscsi devstack@n-api.service[105513]: DEBUG nova.api.openstack.wsgi [None req-907d80d2-c1b1-4222-bde8-e498a5bc3a2b admin admin] Action: 'create', calling method: >, body: {"extra_specs": {"hw_rng:allowed": "True"}} {{(pid=105513) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 13 17:54:58.108486 dv-cinder-852009-8-iscsi devstack@n-api.service[105513]: DEBUG dbcounter [-] [105513] Writing DB stats nova_api:SELECT=33,nova_api:INSERT=7,nova_api:SAVEPOINT=3,nova_api:RELEASE=3 {{(pid=105513) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 17:54:58.144124 dv-cinder-852009-8-iscsi devstack@n-api.service[105513]: INFO nova.api.openstack.requestlog [None req-907d80d2-c1b1-4222-bde8-e498a5bc3a2b admin admin] 10.222.0.43 "POST /compute/v2.1/flavors/3/os-extra_specs" status: 200 len: 43 microversion: 2.61 time: 0.043303 Sep 13 17:54:58.156882 dv-cinder-852009-8-iscsi devstack@n-api.service[105513]: [pid: 105513|app: 0|req: 14/29] 10.222.0.43 () {64 vars in 1333 bytes} [Tue Sep 13 17:54:58 2022] POST /compute/v2.1/flavors/3/os-extra_specs => generated 43 bytes in 58 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 13 17:55:00.986610 dv-cinder-852009-8-iscsi devstack@n-api.service[105512]: DEBUG nova.api.openstack.wsgi [None req-d9826c21-bbbb-4da7-b576-ce1714d035c4 admin admin] Calling method '>' {{(pid=105512) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 17:55:00.988261 dv-cinder-852009-8-iscsi devstack@n-api.service[105512]: INFO nova.api.openstack.requestlog [None req-d9826c21-bbbb-4da7-b576-ce1714d035c4 admin admin] 10.222.0.43 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.002100 Sep 13 17:55:00.990833 dv-cinder-852009-8-iscsi devstack@n-api.service[105512]: [pid: 105512|app: 0|req: 16/30] 10.222.0.43 () {54 vars in 931 bytes} [Tue Sep 13 17:55:00 2022] GET /compute/v2.1 => generated 388 bytes in 4 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 13 17:55:01.549947 dv-cinder-852009-8-iscsi devstack@n-api.service[105513]: DEBUG nova.api.openstack.wsgi [None req-eb27a7d6-67db-420d-9479-2772af3cb35f admin admin] Action: 'create', calling method: >, body: {"flavor": {"OS-FLV-EXT-DATA:ephemeral": 0, "disk": 80, "swap": 0, "rxtx_factor": 1.0, "ram": 8192, "name": "m1.large", "id": "4", "vcpus": 4, "os-flavor-access:is_public": true}} {{(pid=105513) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 13 17:55:01.597193 dv-cinder-852009-8-iscsi devstack@n-api.service[105513]: INFO nova.api.openstack.requestlog [None req-eb27a7d6-67db-420d-9479-2772af3cb35f admin admin] 10.222.0.43 "POST /compute/v2.1/flavors" status: 200 len: 405 microversion: 2.61 time: 0.599358 Sep 13 17:55:01.598407 dv-cinder-852009-8-iscsi devstack@n-api.service[105513]: [pid: 105513|app: 0|req: 15/31] 10.222.0.43 () {64 vars in 1283 bytes} [Tue Sep 13 17:55:00 2022] POST /compute/v2.1/flavors => generated 405 bytes in 602 msecs (HTTP/1.1 200) 9 headers in 359 bytes (2 switches on core 0) Sep 13 17:55:01.612133 dv-cinder-852009-8-iscsi devstack@n-api.service[105512]: DEBUG nova.api.openstack.wsgi [None req-98f9814f-f39f-4490-9f2d-666264c02d2d admin admin] Action: 'create', calling method: >, body: {"extra_specs": {"hw_rng:allowed": "True"}} {{(pid=105512) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 13 17:55:01.617767 dv-cinder-852009-8-iscsi devstack@n-api.service[105512]: DEBUG dbcounter [-] [105512] Writing DB stats nova_api:SELECT=39,nova_api:SAVEPOINT=4,nova_api:INSERT=8,nova_api:RELEASE=4 {{(pid=105512) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 17:55:01.659466 dv-cinder-852009-8-iscsi devstack@n-api.service[105512]: INFO nova.api.openstack.requestlog [None req-98f9814f-f39f-4490-9f2d-666264c02d2d admin admin] 10.222.0.43 "POST /compute/v2.1/flavors/4/os-extra_specs" status: 200 len: 43 microversion: 2.61 time: 0.052238 Sep 13 17:55:01.660223 dv-cinder-852009-8-iscsi devstack@n-api.service[105512]: [pid: 105512|app: 0|req: 17/32] 10.222.0.43 () {64 vars in 1333 bytes} [Tue Sep 13 17:55:01 2022] POST /compute/v2.1/flavors/4/os-extra_specs => generated 43 bytes in 54 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 13 17:55:04.694988 dv-cinder-852009-8-iscsi devstack@n-api.service[105513]: DEBUG nova.api.openstack.wsgi [None req-eb27a7d6-67db-420d-9479-2772af3cb35f admin admin] Calling method '>' {{(pid=105513) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 17:55:04.696483 dv-cinder-852009-8-iscsi devstack@n-api.service[105513]: INFO nova.api.openstack.requestlog [None req-eb27a7d6-67db-420d-9479-2772af3cb35f admin admin] 10.222.0.43 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.002614 Sep 13 17:55:04.697269 dv-cinder-852009-8-iscsi devstack@n-api.service[105513]: [pid: 105513|app: 0|req: 16/33] 10.222.0.43 () {54 vars in 931 bytes} [Tue Sep 13 17:55:04 2022] GET /compute/v2.1 => generated 388 bytes in 4 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 13 17:55:05.225067 dv-cinder-852009-8-iscsi devstack@n-api.service[105512]: DEBUG nova.api.openstack.wsgi [None req-9aa6d871-18b1-4eb8-bc22-ba693dcab169 admin admin] Action: 'create', calling method: >, body: {"flavor": {"OS-FLV-EXT-DATA:ephemeral": 0, "vcpus": 8, "swap": 0, "disk": 160, "os-flavor-access:is_public": true, "name": "m1.xlarge", "ram": 16384, "rxtx_factor": 1.0, "id": "5"}} {{(pid=105512) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 13 17:55:05.247287 dv-cinder-852009-8-iscsi devstack@n-api.service[105512]: INFO nova.api.openstack.requestlog [None req-9aa6d871-18b1-4eb8-bc22-ba693dcab169 admin admin] 10.222.0.43 "POST /compute/v2.1/flavors" status: 200 len: 408 microversion: 2.61 time: 0.543421 Sep 13 17:55:05.248150 dv-cinder-852009-8-iscsi devstack@n-api.service[105512]: [pid: 105512|app: 0|req: 18/34] 10.222.0.43 () {64 vars in 1283 bytes} [Tue Sep 13 17:55:04 2022] POST /compute/v2.1/flavors => generated 408 bytes in 545 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Sep 13 17:55:05.261326 dv-cinder-852009-8-iscsi devstack@n-api.service[105513]: DEBUG nova.api.openstack.wsgi [None req-061f7481-1cd9-4574-b32c-97acd7eea006 admin admin] Action: 'create', calling method: >, body: {"extra_specs": {"hw_rng:allowed": "True"}} {{(pid=105513) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 13 17:55:05.306667 dv-cinder-852009-8-iscsi devstack@n-api.service[105513]: INFO nova.api.openstack.requestlog [None req-061f7481-1cd9-4574-b32c-97acd7eea006 admin admin] 10.222.0.43 "POST /compute/v2.1/flavors/5/os-extra_specs" status: 200 len: 43 microversion: 2.61 time: 0.049514 Sep 13 17:55:05.307253 dv-cinder-852009-8-iscsi devstack@n-api.service[105513]: [pid: 105513|app: 0|req: 17/35] 10.222.0.43 () {64 vars in 1333 bytes} [Tue Sep 13 17:55:05 2022] POST /compute/v2.1/flavors/5/os-extra_specs => generated 43 bytes in 51 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 13 17:55:24.068518 dv-cinder-852009-8-iscsi devstack@n-api.service[105512]: DEBUG nova.api.openstack.wsgi [None req-9aa6d871-18b1-4eb8-bc22-ba693dcab169 admin admin] Calling method '>' {{(pid=105512) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 17:55:24.069553 dv-cinder-852009-8-iscsi devstack@n-api.service[105512]: INFO nova.api.openstack.requestlog [None req-9aa6d871-18b1-4eb8-bc22-ba693dcab169 admin admin] 10.222.0.43 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001532 Sep 13 17:55:24.069965 dv-cinder-852009-8-iscsi devstack@n-api.service[105512]: [pid: 105512|app: 0|req: 19/36] 10.222.0.43 () {54 vars in 931 bytes} [Tue Sep 13 17:55:24 2022] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 13 17:55:24.085947 dv-cinder-852009-8-iscsi devstack@n-api.service[105513]: DEBUG dbcounter [-] [105513] Writing DB stats nova_api:SELECT=14,nova_api:SAVEPOINT=2,nova_api:INSERT=3,nova_api:RELEASE=2 {{(pid=105513) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 17:55:24.505563 dv-cinder-852009-8-iscsi devstack@n-api.service[105513]: DEBUG nova.api.openstack.wsgi [None req-ef7a62ce-ea12-4cc8-aa61-0bcde0b7df12 admin admin] Calling method '>' {{(pid=105513) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 17:55:24.524482 dv-cinder-852009-8-iscsi devstack@n-api.service[105513]: INFO nova.api.openstack.requestlog [None req-ef7a62ce-ea12-4cc8-aa61-0bcde0b7df12 admin admin] 10.222.0.43 "GET /compute/v2.1/flavors/detail?is_public=True" status: 200 len: 4202 microversion: 2.61 time: 0.444468 Sep 13 17:55:24.525056 dv-cinder-852009-8-iscsi devstack@n-api.service[105513]: [pid: 105513|app: 0|req: 18/37] 10.222.0.43 () {60 vars in 1292 bytes} [Tue Sep 13 17:55:24 2022] GET /compute/v2.1/flavors/detail?is_public=True => generated 4202 bytes in 446 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 13 17:55:25.859782 dv-cinder-852009-8-iscsi devstack@n-api.service[105512]: DEBUG nova.api.openstack.wsgi [None req-9aa6d871-18b1-4eb8-bc22-ba693dcab169 admin admin] Calling method '>' {{(pid=105512) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 17:55:25.860955 dv-cinder-852009-8-iscsi devstack@n-api.service[105512]: INFO nova.api.openstack.requestlog [None req-9aa6d871-18b1-4eb8-bc22-ba693dcab169 admin admin] 10.222.0.43 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001481 Sep 13 17:55:25.861370 dv-cinder-852009-8-iscsi devstack@n-api.service[105512]: [pid: 105512|app: 0|req: 20/38] 10.222.0.43 () {56 vars in 1074 bytes} [Tue Sep 13 17:55:25 2022] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 13 17:55:26.431215 dv-cinder-852009-8-iscsi devstack@n-api.service[105513]: DEBUG nova.api.openstack.wsgi [None req-344a385a-31b6-4061-b6ed-00b3d3d3d005 admin admin] Calling method '>' {{(pid=105513) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 17:55:26.437312 dv-cinder-852009-8-iscsi devstack@n-api.service[105513]: INFO nova.api.openstack.wsgi [None req-344a385a-31b6-4061-b6ed-00b3d3d3d005 admin admin] HTTP exception thrown: Flavor 42 could not be found. Sep 13 17:55:26.440674 dv-cinder-852009-8-iscsi devstack@n-api.service[105513]: DEBUG nova.api.openstack.wsgi [None req-344a385a-31b6-4061-b6ed-00b3d3d3d005 admin admin] Request method failure captured: Sep 13 17:55:26.440674 dv-cinder-852009-8-iscsi devstack@n-api.service[105513]: request: GET /compute/v2.1/flavors/42 HTTP/1.1 Sep 13 17:55:26.440674 dv-cinder-852009-8-iscsi devstack@n-api.service[105513]: Accept: application/json Sep 13 17:55:26.440674 dv-cinder-852009-8-iscsi devstack@n-api.service[105513]: Accept-Encoding: gzip, deflate Sep 13 17:55:26.440674 dv-cinder-852009-8-iscsi devstack@n-api.service[105513]: Connection: keep-alive Sep 13 17:55:26.440674 dv-cinder-852009-8-iscsi devstack@n-api.service[105513]: Content-Length: 0 Sep 13 17:55:26.440674 dv-cinder-852009-8-iscsi devstack@n-api.service[105513]: Host: 10.222.0.43 Sep 13 17:55:26.440674 dv-cinder-852009-8-iscsi devstack@n-api.service[105513]: Openstack-Api-Version: compute 2.92 Sep 13 17:55:26.440674 dv-cinder-852009-8-iscsi devstack@n-api.service[105513]: Openstack-System-Scope: None Sep 13 17:55:26.440674 dv-cinder-852009-8-iscsi devstack@n-api.service[105513]: User-Agent: python-novaclient Sep 13 17:55:26.440674 dv-cinder-852009-8-iscsi devstack@n-api.service[105513]: X-Auth-Token: gAAAAABjIMQNc1ZTVczjVmu4BgwYqacAeHmEfWcgB8fZk5NSR5xuK219v2l3QewvOFj_RU9oS5zB1GkZLYIrONEyct7ktjWo3f5ALvvIRBwz_b_6m1QTRp9gFPFIxycPHmMmTmZcdGIgXF15vlgv1wmFCQbTq17bfYLeJO07etbE86BNjk6cWLc Sep 13 17:55:26.440674 dv-cinder-852009-8-iscsi devstack@n-api.service[105513]: X-Domain-Id: None Sep 13 17:55:26.440674 dv-cinder-852009-8-iscsi devstack@n-api.service[105513]: X-Domain-Name: None Sep 13 17:55:26.440674 dv-cinder-852009-8-iscsi devstack@n-api.service[105513]: X-Identity-Status: Confirmed Sep 13 17:55:26.440674 dv-cinder-852009-8-iscsi devstack@n-api.service[105513]: X-Is-Admin-Project: True Sep 13 17:55:26.440674 dv-cinder-852009-8-iscsi devstack@n-api.service[105513]: X-Openstack-Nova-Api-Version: 2.92 Sep 13 17:55:26.440674 dv-cinder-852009-8-iscsi devstack@n-api.service[105513]: X-Project-Domain-Id: default Sep 13 17:55:26.440674 dv-cinder-852009-8-iscsi devstack@n-api.service[105513]: X-Project-Domain-Name: Default Sep 13 17:55:26.440674 dv-cinder-852009-8-iscsi devstack@n-api.service[105513]: X-Project-Id: c326683f56fe42d09b126fc368517cb3 Sep 13 17:55:26.440674 dv-cinder-852009-8-iscsi devstack@n-api.service[105513]: X-Project-Name: admin Sep 13 17:55:26.440674 dv-cinder-852009-8-iscsi devstack@n-api.service[105513]: X-Role: admin,reader,member Sep 13 17:55:26.440674 dv-cinder-852009-8-iscsi devstack@n-api.service[105513]: X-Roles: admin,reader,member Sep 13 17:55:26.442279 dv-cinder-852009-8-iscsi devstack@n-api.service[105513]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/identity"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/compute/v2/c326683f56fe42d09b126fc368517cb3"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.43:8080", "publicURL": "http://10.222.0.43:8080/v1/AUTH_c326683f56fe42d09b126fc368517cb3"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43:9696/networking"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/volume/v3/c326683f56fe42d09b126fc368517cb3"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/compute/v2.1"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/placement"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/volume/v3/c326683f56fe42d09b126fc368517cb3"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/image"}]}] Sep 13 17:55:26.442279 dv-cinder-852009-8-iscsi devstack@n-api.service[105513]: X-Tenant: admin Sep 13 17:55:26.442279 dv-cinder-852009-8-iscsi devstack@n-api.service[105513]: X-Tenant-Id: c326683f56fe42d09b126fc368517cb3 Sep 13 17:55:26.442279 dv-cinder-852009-8-iscsi devstack@n-api.service[105513]: X-Tenant-Name: admin Sep 13 17:55:26.442279 dv-cinder-852009-8-iscsi devstack@n-api.service[105513]: X-User: admin Sep 13 17:55:26.442279 dv-cinder-852009-8-iscsi devstack@n-api.service[105513]: X-User-Domain-Id: default Sep 13 17:55:26.442279 dv-cinder-852009-8-iscsi devstack@n-api.service[105513]: X-User-Domain-Name: Default Sep 13 17:55:26.442279 dv-cinder-852009-8-iscsi devstack@n-api.service[105513]: X-User-Id: bb561c12b9c44bd29f9bae620dc33608 Sep 13 17:55:26.442279 dv-cinder-852009-8-iscsi devstack@n-api.service[105513]: X-User-Name: admin Sep 13 17:55:26.442279 dv-cinder-852009-8-iscsi devstack@n-api.service[105513]: method: > Sep 13 17:55:26.442279 dv-cinder-852009-8-iscsi devstack@n-api.service[105513]: exception: Flavor 42 could not be found. Sep 13 17:55:26.442279 dv-cinder-852009-8-iscsi devstack@n-api.service[105513]: action_args: {'id': '42'} Sep 13 17:55:26.442279 dv-cinder-852009-8-iscsi devstack@n-api.service[105513]: {{(pid=105513) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 13 17:55:26.442279 dv-cinder-852009-8-iscsi devstack@n-api.service[105513]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 13 17:55:26.443229 dv-cinder-852009-8-iscsi devstack@n-api.service[105513]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/flavors.py", line 66, in show Sep 13 17:55:26.443229 dv-cinder-852009-8-iscsi devstack@n-api.service[105513]: ERROR nova.api.openstack.wsgi flavor = flavors.get_flavor_by_flavor_id(id, ctxt=context) Sep 13 17:55:26.443229 dv-cinder-852009-8-iscsi devstack@n-api.service[105513]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/flavors.py", line 139, in get_flavor_by_flavor_id Sep 13 17:55:26.443229 dv-cinder-852009-8-iscsi devstack@n-api.service[105513]: ERROR nova.api.openstack.wsgi return objects.Flavor.get_by_flavor_id(ctxt, flavorid, read_deleted) Sep 13 17:55:26.443229 dv-cinder-852009-8-iscsi devstack@n-api.service[105513]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_versionedobjects/base.py", line 184, in wrapper Sep 13 17:55:26.443229 dv-cinder-852009-8-iscsi devstack@n-api.service[105513]: ERROR nova.api.openstack.wsgi result = fn(cls, context, *args, **kwargs) Sep 13 17:55:26.443229 dv-cinder-852009-8-iscsi devstack@n-api.service[105513]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/flavor.py", line 390, in get_by_flavor_id Sep 13 17:55:26.443229 dv-cinder-852009-8-iscsi devstack@n-api.service[105513]: ERROR nova.api.openstack.wsgi db_flavor = cls._flavor_get_by_flavor_id_from_db(context, Sep 13 17:55:26.443229 dv-cinder-852009-8-iscsi devstack@n-api.service[105513]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/db/utils.py", line 35, in wrapper Sep 13 17:55:26.443229 dv-cinder-852009-8-iscsi devstack@n-api.service[105513]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 13 17:55:26.443229 dv-cinder-852009-8-iscsi devstack@n-api.service[105513]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/flavor.py", line 317, in _flavor_get_by_flavor_id_from_db Sep 13 17:55:26.443229 dv-cinder-852009-8-iscsi devstack@n-api.service[105513]: ERROR nova.api.openstack.wsgi raise exception.FlavorNotFound(flavor_id=flavor_id) Sep 13 17:55:26.443229 dv-cinder-852009-8-iscsi devstack@n-api.service[105513]: ERROR nova.api.openstack.wsgi nova.exception.FlavorNotFound: Flavor 42 could not be found. Sep 13 17:55:26.443229 dv-cinder-852009-8-iscsi devstack@n-api.service[105513]: ERROR nova.api.openstack.wsgi Sep 13 17:55:26.443229 dv-cinder-852009-8-iscsi devstack@n-api.service[105513]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 13 17:55:26.443229 dv-cinder-852009-8-iscsi devstack@n-api.service[105513]: ERROR nova.api.openstack.wsgi Sep 13 17:55:26.443229 dv-cinder-852009-8-iscsi devstack@n-api.service[105513]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 13 17:55:26.443229 dv-cinder-852009-8-iscsi devstack@n-api.service[105513]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 13 17:55:26.443229 dv-cinder-852009-8-iscsi devstack@n-api.service[105513]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 13 17:55:26.444665 dv-cinder-852009-8-iscsi devstack@n-api.service[105513]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 13 17:55:26.444665 dv-cinder-852009-8-iscsi devstack@n-api.service[105513]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 13 17:55:26.444665 dv-cinder-852009-8-iscsi devstack@n-api.service[105513]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 13 17:55:26.444665 dv-cinder-852009-8-iscsi devstack@n-api.service[105513]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 13 17:55:26.444665 dv-cinder-852009-8-iscsi devstack@n-api.service[105513]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/flavors.py", line 68, in show Sep 13 17:55:26.444665 dv-cinder-852009-8-iscsi devstack@n-api.service[105513]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPNotFound(explanation=e.format_message()) Sep 13 17:55:26.444665 dv-cinder-852009-8-iscsi devstack@n-api.service[105513]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Flavor 42 could not be found. Sep 13 17:55:26.444665 dv-cinder-852009-8-iscsi devstack@n-api.service[105513]: ERROR nova.api.openstack.wsgi Sep 13 17:55:26.444665 dv-cinder-852009-8-iscsi devstack@n-api.service[105513]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 13 17:55:26.444665 dv-cinder-852009-8-iscsi devstack@n-api.service[105513]: ERROR nova.api.openstack.wsgi Sep 13 17:55:26.444665 dv-cinder-852009-8-iscsi devstack@n-api.service[105513]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 13 17:55:26.444665 dv-cinder-852009-8-iscsi devstack@n-api.service[105513]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 13 17:55:26.444665 dv-cinder-852009-8-iscsi devstack@n-api.service[105513]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 13 17:55:26.444665 dv-cinder-852009-8-iscsi devstack@n-api.service[105513]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 13 17:55:26.444665 dv-cinder-852009-8-iscsi devstack@n-api.service[105513]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 13 17:55:26.444665 dv-cinder-852009-8-iscsi devstack@n-api.service[105513]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Flavor 42 could not be found. Sep 13 17:55:26.444665 dv-cinder-852009-8-iscsi devstack@n-api.service[105513]: ERROR nova.api.openstack.wsgi Sep 13 17:55:26.444665 dv-cinder-852009-8-iscsi devstack@n-api.service[105513]: DEBUG nova.api.openstack.wsgi [None req-344a385a-31b6-4061-b6ed-00b3d3d3d005 admin admin] Returning 404 to user: Flavor 42 could not be found. {{(pid=105513) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 13 17:55:26.445920 dv-cinder-852009-8-iscsi devstack@n-api.service[105513]: INFO nova.api.openstack.requestlog [None req-344a385a-31b6-4061-b6ed-00b3d3d3d005 admin admin] 10.222.0.43 "GET /compute/v2.1/flavors/42" status: 404 len: 75 microversion: 2.92 time: 0.442986 Sep 13 17:55:26.445920 dv-cinder-852009-8-iscsi devstack@n-api.service[105513]: [pid: 105513|app: 0|req: 19/39] 10.222.0.43 () {60 vars in 1190 bytes} [Tue Sep 13 17:55:25 2022] GET /compute/v2.1/flavors/42 => generated 75 bytes in 444 msecs (HTTP/1.1 404) 9 headers in 380 bytes (1 switches on core 0) Sep 13 17:55:26.454029 dv-cinder-852009-8-iscsi devstack@n-api.service[105512]: DEBUG nova.api.openstack.wsgi [None req-7915a68f-c61a-48ba-8626-696fccfcda6b admin admin] Calling method '>' {{(pid=105512) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 17:55:26.458359 dv-cinder-852009-8-iscsi devstack@n-api.service[105512]: DEBUG dbcounter [-] [105512] Writing DB stats nova_api:SELECT=8,nova_api:SAVEPOINT=1,nova_api:INSERT=2,nova_api:RELEASE=1 {{(pid=105512) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 17:55:26.479016 dv-cinder-852009-8-iscsi devstack@n-api.service[105512]: INFO nova.api.openstack.requestlog [None req-7915a68f-c61a-48ba-8626-696fccfcda6b admin admin] 10.222.0.43 "GET /compute/v2.1/flavors?is_public=None" status: 200 len: 2056 microversion: 2.92 time: 0.028927 Sep 13 17:55:26.479596 dv-cinder-852009-8-iscsi devstack@n-api.service[105512]: [pid: 105512|app: 0|req: 21/40] 10.222.0.43 () {60 vars in 1210 bytes} [Tue Sep 13 17:55:26 2022] GET /compute/v2.1/flavors?is_public=None => generated 2056 bytes in 30 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 13 17:55:26.492076 dv-cinder-852009-8-iscsi devstack@n-api.service[105513]: DEBUG nova.api.openstack.wsgi [None req-b21a8b39-5e4f-4506-ad59-406a1c13e2cc admin admin] Calling method '>' {{(pid=105513) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 17:55:26.515640 dv-cinder-852009-8-iscsi devstack@n-api.service[105513]: INFO nova.api.openstack.requestlog [None req-b21a8b39-5e4f-4506-ad59-406a1c13e2cc admin admin] 10.222.0.43 "GET /compute/v2.1/flavors?is_public=None" status: 200 len: 2056 microversion: 2.92 time: 0.028907 Sep 13 17:55:26.516213 dv-cinder-852009-8-iscsi devstack@n-api.service[105513]: [pid: 105513|app: 0|req: 20/41] 10.222.0.43 () {60 vars in 1210 bytes} [Tue Sep 13 17:55:26 2022] GET /compute/v2.1/flavors?is_public=None => generated 2056 bytes in 30 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 13 17:55:26.526676 dv-cinder-852009-8-iscsi devstack@n-api.service[105512]: DEBUG nova.api.openstack.wsgi [None req-3da6d886-7b71-4ca2-9895-40b0ecb49b61 admin admin] Calling method '>' {{(pid=105512) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 17:55:26.532683 dv-cinder-852009-8-iscsi devstack@n-api.service[105512]: INFO nova.api.openstack.wsgi [None req-3da6d886-7b71-4ca2-9895-40b0ecb49b61 admin admin] HTTP exception thrown: Flavor 42 could not be found. Sep 13 17:55:26.536027 dv-cinder-852009-8-iscsi devstack@n-api.service[105512]: DEBUG nova.api.openstack.wsgi [None req-3da6d886-7b71-4ca2-9895-40b0ecb49b61 admin admin] Request method failure captured: Sep 13 17:55:26.536027 dv-cinder-852009-8-iscsi devstack@n-api.service[105512]: request: GET /compute/v2.1/flavors/42 HTTP/1.1 Sep 13 17:55:26.536027 dv-cinder-852009-8-iscsi devstack@n-api.service[105512]: Accept: application/json Sep 13 17:55:26.536027 dv-cinder-852009-8-iscsi devstack@n-api.service[105512]: Accept-Encoding: gzip, deflate Sep 13 17:55:26.536027 dv-cinder-852009-8-iscsi devstack@n-api.service[105512]: Connection: keep-alive Sep 13 17:55:26.536027 dv-cinder-852009-8-iscsi devstack@n-api.service[105512]: Content-Length: 0 Sep 13 17:55:26.536027 dv-cinder-852009-8-iscsi devstack@n-api.service[105512]: Host: 10.222.0.43 Sep 13 17:55:26.536027 dv-cinder-852009-8-iscsi devstack@n-api.service[105512]: Openstack-Api-Version: compute 2.92 Sep 13 17:55:26.536027 dv-cinder-852009-8-iscsi devstack@n-api.service[105512]: Openstack-System-Scope: None Sep 13 17:55:26.536027 dv-cinder-852009-8-iscsi devstack@n-api.service[105512]: User-Agent: python-novaclient Sep 13 17:55:26.536027 dv-cinder-852009-8-iscsi devstack@n-api.service[105512]: X-Auth-Token: gAAAAABjIMQNc1ZTVczjVmu4BgwYqacAeHmEfWcgB8fZk5NSR5xuK219v2l3QewvOFj_RU9oS5zB1GkZLYIrONEyct7ktjWo3f5ALvvIRBwz_b_6m1QTRp9gFPFIxycPHmMmTmZcdGIgXF15vlgv1wmFCQbTq17bfYLeJO07etbE86BNjk6cWLc Sep 13 17:55:26.536027 dv-cinder-852009-8-iscsi devstack@n-api.service[105512]: X-Domain-Id: None Sep 13 17:55:26.536027 dv-cinder-852009-8-iscsi devstack@n-api.service[105512]: X-Domain-Name: None Sep 13 17:55:26.536027 dv-cinder-852009-8-iscsi devstack@n-api.service[105512]: X-Identity-Status: Confirmed Sep 13 17:55:26.536027 dv-cinder-852009-8-iscsi devstack@n-api.service[105512]: X-Is-Admin-Project: True Sep 13 17:55:26.536027 dv-cinder-852009-8-iscsi devstack@n-api.service[105512]: X-Openstack-Nova-Api-Version: 2.92 Sep 13 17:55:26.536027 dv-cinder-852009-8-iscsi devstack@n-api.service[105512]: X-Project-Domain-Id: default Sep 13 17:55:26.536027 dv-cinder-852009-8-iscsi devstack@n-api.service[105512]: X-Project-Domain-Name: Default Sep 13 17:55:26.536027 dv-cinder-852009-8-iscsi devstack@n-api.service[105512]: X-Project-Id: c326683f56fe42d09b126fc368517cb3 Sep 13 17:55:26.536027 dv-cinder-852009-8-iscsi devstack@n-api.service[105512]: X-Project-Name: admin Sep 13 17:55:26.536027 dv-cinder-852009-8-iscsi devstack@n-api.service[105512]: X-Role: admin,reader,member Sep 13 17:55:26.536027 dv-cinder-852009-8-iscsi devstack@n-api.service[105512]: X-Roles: admin,reader,member Sep 13 17:55:26.537367 dv-cinder-852009-8-iscsi devstack@n-api.service[105512]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/identity"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/compute/v2/c326683f56fe42d09b126fc368517cb3"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.43:8080", "publicURL": "http://10.222.0.43:8080/v1/AUTH_c326683f56fe42d09b126fc368517cb3"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43:9696/networking"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/volume/v3/c326683f56fe42d09b126fc368517cb3"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/compute/v2.1"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/placement"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/volume/v3/c326683f56fe42d09b126fc368517cb3"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/image"}]}] Sep 13 17:55:26.537367 dv-cinder-852009-8-iscsi devstack@n-api.service[105512]: X-Tenant: admin Sep 13 17:55:26.537367 dv-cinder-852009-8-iscsi devstack@n-api.service[105512]: X-Tenant-Id: c326683f56fe42d09b126fc368517cb3 Sep 13 17:55:26.537367 dv-cinder-852009-8-iscsi devstack@n-api.service[105512]: X-Tenant-Name: admin Sep 13 17:55:26.537367 dv-cinder-852009-8-iscsi devstack@n-api.service[105512]: X-User: admin Sep 13 17:55:26.537367 dv-cinder-852009-8-iscsi devstack@n-api.service[105512]: X-User-Domain-Id: default Sep 13 17:55:26.537367 dv-cinder-852009-8-iscsi devstack@n-api.service[105512]: X-User-Domain-Name: Default Sep 13 17:55:26.537367 dv-cinder-852009-8-iscsi devstack@n-api.service[105512]: X-User-Id: bb561c12b9c44bd29f9bae620dc33608 Sep 13 17:55:26.537367 dv-cinder-852009-8-iscsi devstack@n-api.service[105512]: X-User-Name: admin Sep 13 17:55:26.537367 dv-cinder-852009-8-iscsi devstack@n-api.service[105512]: method: > Sep 13 17:55:26.537367 dv-cinder-852009-8-iscsi devstack@n-api.service[105512]: exception: Flavor 42 could not be found. Sep 13 17:55:26.537367 dv-cinder-852009-8-iscsi devstack@n-api.service[105512]: action_args: {'id': '42'} Sep 13 17:55:26.537367 dv-cinder-852009-8-iscsi devstack@n-api.service[105512]: {{(pid=105512) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 13 17:55:26.537367 dv-cinder-852009-8-iscsi devstack@n-api.service[105512]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 13 17:55:26.538175 dv-cinder-852009-8-iscsi devstack@n-api.service[105512]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/flavors.py", line 66, in show Sep 13 17:55:26.538175 dv-cinder-852009-8-iscsi devstack@n-api.service[105512]: ERROR nova.api.openstack.wsgi flavor = flavors.get_flavor_by_flavor_id(id, ctxt=context) Sep 13 17:55:26.538175 dv-cinder-852009-8-iscsi devstack@n-api.service[105512]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/flavors.py", line 139, in get_flavor_by_flavor_id Sep 13 17:55:26.538175 dv-cinder-852009-8-iscsi devstack@n-api.service[105512]: ERROR nova.api.openstack.wsgi return objects.Flavor.get_by_flavor_id(ctxt, flavorid, read_deleted) Sep 13 17:55:26.538175 dv-cinder-852009-8-iscsi devstack@n-api.service[105512]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_versionedobjects/base.py", line 184, in wrapper Sep 13 17:55:26.538175 dv-cinder-852009-8-iscsi devstack@n-api.service[105512]: ERROR nova.api.openstack.wsgi result = fn(cls, context, *args, **kwargs) Sep 13 17:55:26.538175 dv-cinder-852009-8-iscsi devstack@n-api.service[105512]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/flavor.py", line 390, in get_by_flavor_id Sep 13 17:55:26.538175 dv-cinder-852009-8-iscsi devstack@n-api.service[105512]: ERROR nova.api.openstack.wsgi db_flavor = cls._flavor_get_by_flavor_id_from_db(context, Sep 13 17:55:26.538175 dv-cinder-852009-8-iscsi devstack@n-api.service[105512]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/db/utils.py", line 35, in wrapper Sep 13 17:55:26.538175 dv-cinder-852009-8-iscsi devstack@n-api.service[105512]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 13 17:55:26.538175 dv-cinder-852009-8-iscsi devstack@n-api.service[105512]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/flavor.py", line 317, in _flavor_get_by_flavor_id_from_db Sep 13 17:55:26.538175 dv-cinder-852009-8-iscsi devstack@n-api.service[105512]: ERROR nova.api.openstack.wsgi raise exception.FlavorNotFound(flavor_id=flavor_id) Sep 13 17:55:26.538175 dv-cinder-852009-8-iscsi devstack@n-api.service[105512]: ERROR nova.api.openstack.wsgi nova.exception.FlavorNotFound: Flavor 42 could not be found. Sep 13 17:55:26.538175 dv-cinder-852009-8-iscsi devstack@n-api.service[105512]: ERROR nova.api.openstack.wsgi Sep 13 17:55:26.538175 dv-cinder-852009-8-iscsi devstack@n-api.service[105512]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 13 17:55:26.538175 dv-cinder-852009-8-iscsi devstack@n-api.service[105512]: ERROR nova.api.openstack.wsgi Sep 13 17:55:26.538175 dv-cinder-852009-8-iscsi devstack@n-api.service[105512]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 13 17:55:26.538175 dv-cinder-852009-8-iscsi devstack@n-api.service[105512]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 13 17:55:26.538175 dv-cinder-852009-8-iscsi devstack@n-api.service[105512]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 13 17:55:26.539261 dv-cinder-852009-8-iscsi devstack@n-api.service[105512]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 13 17:55:26.539261 dv-cinder-852009-8-iscsi devstack@n-api.service[105512]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 13 17:55:26.539261 dv-cinder-852009-8-iscsi devstack@n-api.service[105512]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 13 17:55:26.539261 dv-cinder-852009-8-iscsi devstack@n-api.service[105512]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 13 17:55:26.539261 dv-cinder-852009-8-iscsi devstack@n-api.service[105512]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/flavors.py", line 68, in show Sep 13 17:55:26.539261 dv-cinder-852009-8-iscsi devstack@n-api.service[105512]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPNotFound(explanation=e.format_message()) Sep 13 17:55:26.539261 dv-cinder-852009-8-iscsi devstack@n-api.service[105512]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Flavor 42 could not be found. Sep 13 17:55:26.539261 dv-cinder-852009-8-iscsi devstack@n-api.service[105512]: ERROR nova.api.openstack.wsgi Sep 13 17:55:26.539261 dv-cinder-852009-8-iscsi devstack@n-api.service[105512]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 13 17:55:26.539261 dv-cinder-852009-8-iscsi devstack@n-api.service[105512]: ERROR nova.api.openstack.wsgi Sep 13 17:55:26.539261 dv-cinder-852009-8-iscsi devstack@n-api.service[105512]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 13 17:55:26.539261 dv-cinder-852009-8-iscsi devstack@n-api.service[105512]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 13 17:55:26.539261 dv-cinder-852009-8-iscsi devstack@n-api.service[105512]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 13 17:55:26.539261 dv-cinder-852009-8-iscsi devstack@n-api.service[105512]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 13 17:55:26.539261 dv-cinder-852009-8-iscsi devstack@n-api.service[105512]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 13 17:55:26.539261 dv-cinder-852009-8-iscsi devstack@n-api.service[105512]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Flavor 42 could not be found. Sep 13 17:55:26.539261 dv-cinder-852009-8-iscsi devstack@n-api.service[105512]: ERROR nova.api.openstack.wsgi Sep 13 17:55:26.539261 dv-cinder-852009-8-iscsi devstack@n-api.service[105512]: DEBUG nova.api.openstack.wsgi [None req-3da6d886-7b71-4ca2-9895-40b0ecb49b61 admin admin] Returning 404 to user: Flavor 42 could not be found. {{(pid=105512) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 13 17:55:26.540658 dv-cinder-852009-8-iscsi devstack@n-api.service[105512]: INFO nova.api.openstack.requestlog [None req-3da6d886-7b71-4ca2-9895-40b0ecb49b61 admin admin] 10.222.0.43 "GET /compute/v2.1/flavors/42" status: 404 len: 75 microversion: 2.92 time: 0.014679 Sep 13 17:55:26.540658 dv-cinder-852009-8-iscsi devstack@n-api.service[105512]: [pid: 105512|app: 0|req: 22/42] 10.222.0.43 () {60 vars in 1190 bytes} [Tue Sep 13 17:55:26 2022] GET /compute/v2.1/flavors/42 => generated 75 bytes in 16 msecs (HTTP/1.1 404) 9 headers in 380 bytes (1 switches on core 0) Sep 13 17:55:27.794481 dv-cinder-852009-8-iscsi devstack@n-api.service[105513]: DEBUG nova.api.openstack.wsgi [None req-b21a8b39-5e4f-4506-ad59-406a1c13e2cc admin admin] Calling method '>' {{(pid=105513) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 17:55:27.795499 dv-cinder-852009-8-iscsi devstack@n-api.service[105513]: INFO nova.api.openstack.requestlog [None req-b21a8b39-5e4f-4506-ad59-406a1c13e2cc admin admin] 10.222.0.43 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001507 Sep 13 17:55:27.795884 dv-cinder-852009-8-iscsi devstack@n-api.service[105513]: [pid: 105513|app: 0|req: 21/43] 10.222.0.43 () {56 vars in 1074 bytes} [Tue Sep 13 17:55:27 2022] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 13 17:55:28.358182 dv-cinder-852009-8-iscsi devstack@n-api.service[105512]: DEBUG nova.api.openstack.wsgi [None req-1e0ad018-e07a-44ef-b744-ad39221303e9 admin admin] Calling method '>' {{(pid=105512) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 17:55:28.363607 dv-cinder-852009-8-iscsi devstack@n-api.service[105512]: INFO nova.api.openstack.wsgi [None req-1e0ad018-e07a-44ef-b744-ad39221303e9 admin admin] HTTP exception thrown: Flavor 84 could not be found. Sep 13 17:55:28.365294 dv-cinder-852009-8-iscsi devstack@n-api.service[105512]: DEBUG nova.api.openstack.wsgi [None req-1e0ad018-e07a-44ef-b744-ad39221303e9 admin admin] Request method failure captured: Sep 13 17:55:28.365294 dv-cinder-852009-8-iscsi devstack@n-api.service[105512]: request: GET /compute/v2.1/flavors/84 HTTP/1.1 Sep 13 17:55:28.365294 dv-cinder-852009-8-iscsi devstack@n-api.service[105512]: Accept: application/json Sep 13 17:55:28.365294 dv-cinder-852009-8-iscsi devstack@n-api.service[105512]: Accept-Encoding: gzip, deflate Sep 13 17:55:28.365294 dv-cinder-852009-8-iscsi devstack@n-api.service[105512]: Connection: keep-alive Sep 13 17:55:28.365294 dv-cinder-852009-8-iscsi devstack@n-api.service[105512]: Content-Length: 0 Sep 13 17:55:28.365294 dv-cinder-852009-8-iscsi devstack@n-api.service[105512]: Host: 10.222.0.43 Sep 13 17:55:28.365294 dv-cinder-852009-8-iscsi devstack@n-api.service[105512]: Openstack-Api-Version: compute 2.92 Sep 13 17:55:28.365294 dv-cinder-852009-8-iscsi devstack@n-api.service[105512]: Openstack-System-Scope: None Sep 13 17:55:28.365294 dv-cinder-852009-8-iscsi devstack@n-api.service[105512]: User-Agent: python-novaclient Sep 13 17:55:28.365294 dv-cinder-852009-8-iscsi devstack@n-api.service[105512]: X-Auth-Token: gAAAAABjIMQPz2UpH051tbwbQjYe3trCVu5RrGtFHn81Ir4p5LXuucLM7-4XosF_HCFREQyaeBPaxlNq5QGu--rCoItrTOQe-SeYi88NC5WI8snAVHA4rMHO2aYeQ3Uz2w9NjUXDnCUK1RJphz7vIJhcuhLGbEXceIQDeavU4Nlf5W0c8noQvJk Sep 13 17:55:28.365294 dv-cinder-852009-8-iscsi devstack@n-api.service[105512]: X-Domain-Id: None Sep 13 17:55:28.365294 dv-cinder-852009-8-iscsi devstack@n-api.service[105512]: X-Domain-Name: None Sep 13 17:55:28.365294 dv-cinder-852009-8-iscsi devstack@n-api.service[105512]: X-Identity-Status: Confirmed Sep 13 17:55:28.365294 dv-cinder-852009-8-iscsi devstack@n-api.service[105512]: X-Is-Admin-Project: True Sep 13 17:55:28.365294 dv-cinder-852009-8-iscsi devstack@n-api.service[105512]: X-Openstack-Nova-Api-Version: 2.92 Sep 13 17:55:28.365294 dv-cinder-852009-8-iscsi devstack@n-api.service[105512]: X-Project-Domain-Id: default Sep 13 17:55:28.365294 dv-cinder-852009-8-iscsi devstack@n-api.service[105512]: X-Project-Domain-Name: Default Sep 13 17:55:28.365294 dv-cinder-852009-8-iscsi devstack@n-api.service[105512]: X-Project-Id: c326683f56fe42d09b126fc368517cb3 Sep 13 17:55:28.365294 dv-cinder-852009-8-iscsi devstack@n-api.service[105512]: X-Project-Name: admin Sep 13 17:55:28.365294 dv-cinder-852009-8-iscsi devstack@n-api.service[105512]: X-Role: admin,reader,member Sep 13 17:55:28.365294 dv-cinder-852009-8-iscsi devstack@n-api.service[105512]: X-Roles: admin,reader,member Sep 13 17:55:28.366910 dv-cinder-852009-8-iscsi devstack@n-api.service[105512]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/identity"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/compute/v2/c326683f56fe42d09b126fc368517cb3"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.43:8080", "publicURL": "http://10.222.0.43:8080/v1/AUTH_c326683f56fe42d09b126fc368517cb3"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43:9696/networking"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/volume/v3/c326683f56fe42d09b126fc368517cb3"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/compute/v2.1"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/placement"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/volume/v3/c326683f56fe42d09b126fc368517cb3"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/image"}]}] Sep 13 17:55:28.366910 dv-cinder-852009-8-iscsi devstack@n-api.service[105512]: X-Tenant: admin Sep 13 17:55:28.366910 dv-cinder-852009-8-iscsi devstack@n-api.service[105512]: X-Tenant-Id: c326683f56fe42d09b126fc368517cb3 Sep 13 17:55:28.366910 dv-cinder-852009-8-iscsi devstack@n-api.service[105512]: X-Tenant-Name: admin Sep 13 17:55:28.366910 dv-cinder-852009-8-iscsi devstack@n-api.service[105512]: X-User: admin Sep 13 17:55:28.366910 dv-cinder-852009-8-iscsi devstack@n-api.service[105512]: X-User-Domain-Id: default Sep 13 17:55:28.366910 dv-cinder-852009-8-iscsi devstack@n-api.service[105512]: X-User-Domain-Name: Default Sep 13 17:55:28.366910 dv-cinder-852009-8-iscsi devstack@n-api.service[105512]: X-User-Id: bb561c12b9c44bd29f9bae620dc33608 Sep 13 17:55:28.366910 dv-cinder-852009-8-iscsi devstack@n-api.service[105512]: X-User-Name: admin Sep 13 17:55:28.366910 dv-cinder-852009-8-iscsi devstack@n-api.service[105512]: method: > Sep 13 17:55:28.366910 dv-cinder-852009-8-iscsi devstack@n-api.service[105512]: exception: Flavor 84 could not be found. Sep 13 17:55:28.366910 dv-cinder-852009-8-iscsi devstack@n-api.service[105512]: action_args: {'id': '84'} Sep 13 17:55:28.366910 dv-cinder-852009-8-iscsi devstack@n-api.service[105512]: {{(pid=105512) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 13 17:55:28.366910 dv-cinder-852009-8-iscsi devstack@n-api.service[105512]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 13 17:55:28.367916 dv-cinder-852009-8-iscsi devstack@n-api.service[105512]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/flavors.py", line 66, in show Sep 13 17:55:28.367916 dv-cinder-852009-8-iscsi devstack@n-api.service[105512]: ERROR nova.api.openstack.wsgi flavor = flavors.get_flavor_by_flavor_id(id, ctxt=context) Sep 13 17:55:28.367916 dv-cinder-852009-8-iscsi devstack@n-api.service[105512]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/flavors.py", line 139, in get_flavor_by_flavor_id Sep 13 17:55:28.367916 dv-cinder-852009-8-iscsi devstack@n-api.service[105512]: ERROR nova.api.openstack.wsgi return objects.Flavor.get_by_flavor_id(ctxt, flavorid, read_deleted) Sep 13 17:55:28.367916 dv-cinder-852009-8-iscsi devstack@n-api.service[105512]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_versionedobjects/base.py", line 184, in wrapper Sep 13 17:55:28.367916 dv-cinder-852009-8-iscsi devstack@n-api.service[105512]: ERROR nova.api.openstack.wsgi result = fn(cls, context, *args, **kwargs) Sep 13 17:55:28.367916 dv-cinder-852009-8-iscsi devstack@n-api.service[105512]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/flavor.py", line 390, in get_by_flavor_id Sep 13 17:55:28.367916 dv-cinder-852009-8-iscsi devstack@n-api.service[105512]: ERROR nova.api.openstack.wsgi db_flavor = cls._flavor_get_by_flavor_id_from_db(context, Sep 13 17:55:28.367916 dv-cinder-852009-8-iscsi devstack@n-api.service[105512]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/db/utils.py", line 35, in wrapper Sep 13 17:55:28.367916 dv-cinder-852009-8-iscsi devstack@n-api.service[105512]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 13 17:55:28.367916 dv-cinder-852009-8-iscsi devstack@n-api.service[105512]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/flavor.py", line 317, in _flavor_get_by_flavor_id_from_db Sep 13 17:55:28.367916 dv-cinder-852009-8-iscsi devstack@n-api.service[105512]: ERROR nova.api.openstack.wsgi raise exception.FlavorNotFound(flavor_id=flavor_id) Sep 13 17:55:28.367916 dv-cinder-852009-8-iscsi devstack@n-api.service[105512]: ERROR nova.api.openstack.wsgi nova.exception.FlavorNotFound: Flavor 84 could not be found. Sep 13 17:55:28.367916 dv-cinder-852009-8-iscsi devstack@n-api.service[105512]: ERROR nova.api.openstack.wsgi Sep 13 17:55:28.367916 dv-cinder-852009-8-iscsi devstack@n-api.service[105512]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 13 17:55:28.367916 dv-cinder-852009-8-iscsi devstack@n-api.service[105512]: ERROR nova.api.openstack.wsgi Sep 13 17:55:28.367916 dv-cinder-852009-8-iscsi devstack@n-api.service[105512]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 13 17:55:28.367916 dv-cinder-852009-8-iscsi devstack@n-api.service[105512]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 13 17:55:28.367916 dv-cinder-852009-8-iscsi devstack@n-api.service[105512]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 13 17:55:28.369209 dv-cinder-852009-8-iscsi devstack@n-api.service[105512]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 13 17:55:28.369209 dv-cinder-852009-8-iscsi devstack@n-api.service[105512]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 13 17:55:28.369209 dv-cinder-852009-8-iscsi devstack@n-api.service[105512]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 13 17:55:28.369209 dv-cinder-852009-8-iscsi devstack@n-api.service[105512]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 13 17:55:28.369209 dv-cinder-852009-8-iscsi devstack@n-api.service[105512]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/flavors.py", line 68, in show Sep 13 17:55:28.369209 dv-cinder-852009-8-iscsi devstack@n-api.service[105512]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPNotFound(explanation=e.format_message()) Sep 13 17:55:28.369209 dv-cinder-852009-8-iscsi devstack@n-api.service[105512]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Flavor 84 could not be found. Sep 13 17:55:28.369209 dv-cinder-852009-8-iscsi devstack@n-api.service[105512]: ERROR nova.api.openstack.wsgi Sep 13 17:55:28.369209 dv-cinder-852009-8-iscsi devstack@n-api.service[105512]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 13 17:55:28.369209 dv-cinder-852009-8-iscsi devstack@n-api.service[105512]: ERROR nova.api.openstack.wsgi Sep 13 17:55:28.369209 dv-cinder-852009-8-iscsi devstack@n-api.service[105512]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 13 17:55:28.369209 dv-cinder-852009-8-iscsi devstack@n-api.service[105512]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 13 17:55:28.369209 dv-cinder-852009-8-iscsi devstack@n-api.service[105512]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 13 17:55:28.369209 dv-cinder-852009-8-iscsi devstack@n-api.service[105512]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 13 17:55:28.369209 dv-cinder-852009-8-iscsi devstack@n-api.service[105512]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 13 17:55:28.369209 dv-cinder-852009-8-iscsi devstack@n-api.service[105512]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Flavor 84 could not be found. Sep 13 17:55:28.369209 dv-cinder-852009-8-iscsi devstack@n-api.service[105512]: ERROR nova.api.openstack.wsgi Sep 13 17:55:28.369209 dv-cinder-852009-8-iscsi devstack@n-api.service[105512]: DEBUG nova.api.openstack.wsgi [None req-1e0ad018-e07a-44ef-b744-ad39221303e9 admin admin] Returning 404 to user: Flavor 84 could not be found. {{(pid=105512) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 13 17:55:28.370242 dv-cinder-852009-8-iscsi devstack@n-api.service[105512]: INFO nova.api.openstack.requestlog [None req-1e0ad018-e07a-44ef-b744-ad39221303e9 admin admin] 10.222.0.43 "GET /compute/v2.1/flavors/84" status: 404 len: 75 microversion: 2.92 time: 0.430619 Sep 13 17:55:28.370242 dv-cinder-852009-8-iscsi devstack@n-api.service[105512]: [pid: 105512|app: 0|req: 23/44] 10.222.0.43 () {60 vars in 1190 bytes} [Tue Sep 13 17:55:27 2022] GET /compute/v2.1/flavors/84 => generated 75 bytes in 432 msecs (HTTP/1.1 404) 9 headers in 380 bytes (2 switches on core 0) Sep 13 17:55:28.377302 dv-cinder-852009-8-iscsi devstack@n-api.service[105513]: DEBUG nova.api.openstack.wsgi [None req-5ca51e80-8360-420a-8c41-7171e4d0bae7 admin admin] Calling method '>' {{(pid=105513) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 17:55:28.393604 dv-cinder-852009-8-iscsi devstack@n-api.service[105513]: INFO nova.api.openstack.requestlog [None req-5ca51e80-8360-420a-8c41-7171e4d0bae7 admin admin] 10.222.0.43 "GET /compute/v2.1/flavors?is_public=None" status: 200 len: 2056 microversion: 2.92 time: 0.020059 Sep 13 17:55:28.394318 dv-cinder-852009-8-iscsi devstack@n-api.service[105513]: [pid: 105513|app: 0|req: 22/45] 10.222.0.43 () {60 vars in 1210 bytes} [Tue Sep 13 17:55:28 2022] GET /compute/v2.1/flavors?is_public=None => generated 2056 bytes in 22 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 13 17:55:28.404382 dv-cinder-852009-8-iscsi devstack@n-api.service[105512]: DEBUG nova.api.openstack.wsgi [None req-800110c2-7b61-48c7-ae43-32bd514c5c85 admin admin] Calling method '>' {{(pid=105512) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 17:55:28.420670 dv-cinder-852009-8-iscsi devstack@n-api.service[105512]: INFO nova.api.openstack.requestlog [None req-800110c2-7b61-48c7-ae43-32bd514c5c85 admin admin] 10.222.0.43 "GET /compute/v2.1/flavors?is_public=None" status: 200 len: 2056 microversion: 2.92 time: 0.019860 Sep 13 17:55:28.421199 dv-cinder-852009-8-iscsi devstack@n-api.service[105512]: [pid: 105512|app: 0|req: 24/46] 10.222.0.43 () {60 vars in 1210 bytes} [Tue Sep 13 17:55:28 2022] GET /compute/v2.1/flavors?is_public=None => generated 2056 bytes in 21 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 13 17:55:28.431348 dv-cinder-852009-8-iscsi devstack@n-api.service[105513]: DEBUG nova.api.openstack.wsgi [None req-9e9f0292-3d30-4778-87d4-f397780ad1ed admin admin] Calling method '>' {{(pid=105513) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 17:55:28.437494 dv-cinder-852009-8-iscsi devstack@n-api.service[105513]: INFO nova.api.openstack.wsgi [None req-9e9f0292-3d30-4778-87d4-f397780ad1ed admin admin] HTTP exception thrown: Flavor 84 could not be found. Sep 13 17:55:28.439469 dv-cinder-852009-8-iscsi devstack@n-api.service[105513]: DEBUG nova.api.openstack.wsgi [None req-9e9f0292-3d30-4778-87d4-f397780ad1ed admin admin] Request method failure captured: Sep 13 17:55:28.439469 dv-cinder-852009-8-iscsi devstack@n-api.service[105513]: request: GET /compute/v2.1/flavors/84 HTTP/1.1 Sep 13 17:55:28.439469 dv-cinder-852009-8-iscsi devstack@n-api.service[105513]: Accept: application/json Sep 13 17:55:28.439469 dv-cinder-852009-8-iscsi devstack@n-api.service[105513]: Accept-Encoding: gzip, deflate Sep 13 17:55:28.439469 dv-cinder-852009-8-iscsi devstack@n-api.service[105513]: Connection: keep-alive Sep 13 17:55:28.439469 dv-cinder-852009-8-iscsi devstack@n-api.service[105513]: Content-Length: 0 Sep 13 17:55:28.439469 dv-cinder-852009-8-iscsi devstack@n-api.service[105513]: Host: 10.222.0.43 Sep 13 17:55:28.439469 dv-cinder-852009-8-iscsi devstack@n-api.service[105513]: Openstack-Api-Version: compute 2.92 Sep 13 17:55:28.439469 dv-cinder-852009-8-iscsi devstack@n-api.service[105513]: Openstack-System-Scope: None Sep 13 17:55:28.439469 dv-cinder-852009-8-iscsi devstack@n-api.service[105513]: User-Agent: python-novaclient Sep 13 17:55:28.439469 dv-cinder-852009-8-iscsi devstack@n-api.service[105513]: X-Auth-Token: gAAAAABjIMQPz2UpH051tbwbQjYe3trCVu5RrGtFHn81Ir4p5LXuucLM7-4XosF_HCFREQyaeBPaxlNq5QGu--rCoItrTOQe-SeYi88NC5WI8snAVHA4rMHO2aYeQ3Uz2w9NjUXDnCUK1RJphz7vIJhcuhLGbEXceIQDeavU4Nlf5W0c8noQvJk Sep 13 17:55:28.439469 dv-cinder-852009-8-iscsi devstack@n-api.service[105513]: X-Domain-Id: None Sep 13 17:55:28.439469 dv-cinder-852009-8-iscsi devstack@n-api.service[105513]: X-Domain-Name: None Sep 13 17:55:28.439469 dv-cinder-852009-8-iscsi devstack@n-api.service[105513]: X-Identity-Status: Confirmed Sep 13 17:55:28.439469 dv-cinder-852009-8-iscsi devstack@n-api.service[105513]: X-Is-Admin-Project: True Sep 13 17:55:28.439469 dv-cinder-852009-8-iscsi devstack@n-api.service[105513]: X-Openstack-Nova-Api-Version: 2.92 Sep 13 17:55:28.439469 dv-cinder-852009-8-iscsi devstack@n-api.service[105513]: X-Project-Domain-Id: default Sep 13 17:55:28.439469 dv-cinder-852009-8-iscsi devstack@n-api.service[105513]: X-Project-Domain-Name: Default Sep 13 17:55:28.439469 dv-cinder-852009-8-iscsi devstack@n-api.service[105513]: X-Project-Id: c326683f56fe42d09b126fc368517cb3 Sep 13 17:55:28.439469 dv-cinder-852009-8-iscsi devstack@n-api.service[105513]: X-Project-Name: admin Sep 13 17:55:28.439469 dv-cinder-852009-8-iscsi devstack@n-api.service[105513]: X-Role: admin,reader,member Sep 13 17:55:28.439469 dv-cinder-852009-8-iscsi devstack@n-api.service[105513]: X-Roles: admin,reader,member Sep 13 17:55:28.441035 dv-cinder-852009-8-iscsi devstack@n-api.service[105513]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/identity"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/compute/v2/c326683f56fe42d09b126fc368517cb3"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.43:8080", "publicURL": "http://10.222.0.43:8080/v1/AUTH_c326683f56fe42d09b126fc368517cb3"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43:9696/networking"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/volume/v3/c326683f56fe42d09b126fc368517cb3"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/compute/v2.1"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/placement"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/volume/v3/c326683f56fe42d09b126fc368517cb3"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/image"}]}] Sep 13 17:55:28.441035 dv-cinder-852009-8-iscsi devstack@n-api.service[105513]: X-Tenant: admin Sep 13 17:55:28.441035 dv-cinder-852009-8-iscsi devstack@n-api.service[105513]: X-Tenant-Id: c326683f56fe42d09b126fc368517cb3 Sep 13 17:55:28.441035 dv-cinder-852009-8-iscsi devstack@n-api.service[105513]: X-Tenant-Name: admin Sep 13 17:55:28.441035 dv-cinder-852009-8-iscsi devstack@n-api.service[105513]: X-User: admin Sep 13 17:55:28.441035 dv-cinder-852009-8-iscsi devstack@n-api.service[105513]: X-User-Domain-Id: default Sep 13 17:55:28.441035 dv-cinder-852009-8-iscsi devstack@n-api.service[105513]: X-User-Domain-Name: Default Sep 13 17:55:28.441035 dv-cinder-852009-8-iscsi devstack@n-api.service[105513]: X-User-Id: bb561c12b9c44bd29f9bae620dc33608 Sep 13 17:55:28.441035 dv-cinder-852009-8-iscsi devstack@n-api.service[105513]: X-User-Name: admin Sep 13 17:55:28.441035 dv-cinder-852009-8-iscsi devstack@n-api.service[105513]: method: > Sep 13 17:55:28.441035 dv-cinder-852009-8-iscsi devstack@n-api.service[105513]: exception: Flavor 84 could not be found. Sep 13 17:55:28.441035 dv-cinder-852009-8-iscsi devstack@n-api.service[105513]: action_args: {'id': '84'} Sep 13 17:55:28.441035 dv-cinder-852009-8-iscsi devstack@n-api.service[105513]: {{(pid=105513) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 13 17:55:28.441035 dv-cinder-852009-8-iscsi devstack@n-api.service[105513]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 13 17:55:28.441953 dv-cinder-852009-8-iscsi devstack@n-api.service[105513]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/flavors.py", line 66, in show Sep 13 17:55:28.441953 dv-cinder-852009-8-iscsi devstack@n-api.service[105513]: ERROR nova.api.openstack.wsgi flavor = flavors.get_flavor_by_flavor_id(id, ctxt=context) Sep 13 17:55:28.441953 dv-cinder-852009-8-iscsi devstack@n-api.service[105513]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/flavors.py", line 139, in get_flavor_by_flavor_id Sep 13 17:55:28.441953 dv-cinder-852009-8-iscsi devstack@n-api.service[105513]: ERROR nova.api.openstack.wsgi return objects.Flavor.get_by_flavor_id(ctxt, flavorid, read_deleted) Sep 13 17:55:28.441953 dv-cinder-852009-8-iscsi devstack@n-api.service[105513]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_versionedobjects/base.py", line 184, in wrapper Sep 13 17:55:28.441953 dv-cinder-852009-8-iscsi devstack@n-api.service[105513]: ERROR nova.api.openstack.wsgi result = fn(cls, context, *args, **kwargs) Sep 13 17:55:28.441953 dv-cinder-852009-8-iscsi devstack@n-api.service[105513]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/flavor.py", line 390, in get_by_flavor_id Sep 13 17:55:28.441953 dv-cinder-852009-8-iscsi devstack@n-api.service[105513]: ERROR nova.api.openstack.wsgi db_flavor = cls._flavor_get_by_flavor_id_from_db(context, Sep 13 17:55:28.441953 dv-cinder-852009-8-iscsi devstack@n-api.service[105513]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/db/utils.py", line 35, in wrapper Sep 13 17:55:28.441953 dv-cinder-852009-8-iscsi devstack@n-api.service[105513]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 13 17:55:28.441953 dv-cinder-852009-8-iscsi devstack@n-api.service[105513]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/flavor.py", line 317, in _flavor_get_by_flavor_id_from_db Sep 13 17:55:28.441953 dv-cinder-852009-8-iscsi devstack@n-api.service[105513]: ERROR nova.api.openstack.wsgi raise exception.FlavorNotFound(flavor_id=flavor_id) Sep 13 17:55:28.441953 dv-cinder-852009-8-iscsi devstack@n-api.service[105513]: ERROR nova.api.openstack.wsgi nova.exception.FlavorNotFound: Flavor 84 could not be found. Sep 13 17:55:28.441953 dv-cinder-852009-8-iscsi devstack@n-api.service[105513]: ERROR nova.api.openstack.wsgi Sep 13 17:55:28.441953 dv-cinder-852009-8-iscsi devstack@n-api.service[105513]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 13 17:55:28.441953 dv-cinder-852009-8-iscsi devstack@n-api.service[105513]: ERROR nova.api.openstack.wsgi Sep 13 17:55:28.441953 dv-cinder-852009-8-iscsi devstack@n-api.service[105513]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 13 17:55:28.441953 dv-cinder-852009-8-iscsi devstack@n-api.service[105513]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 13 17:55:28.441953 dv-cinder-852009-8-iscsi devstack@n-api.service[105513]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 13 17:55:28.443344 dv-cinder-852009-8-iscsi devstack@n-api.service[105513]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 13 17:55:28.443344 dv-cinder-852009-8-iscsi devstack@n-api.service[105513]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 13 17:55:28.443344 dv-cinder-852009-8-iscsi devstack@n-api.service[105513]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 13 17:55:28.443344 dv-cinder-852009-8-iscsi devstack@n-api.service[105513]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 13 17:55:28.443344 dv-cinder-852009-8-iscsi devstack@n-api.service[105513]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/flavors.py", line 68, in show Sep 13 17:55:28.443344 dv-cinder-852009-8-iscsi devstack@n-api.service[105513]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPNotFound(explanation=e.format_message()) Sep 13 17:55:28.443344 dv-cinder-852009-8-iscsi devstack@n-api.service[105513]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Flavor 84 could not be found. Sep 13 17:55:28.443344 dv-cinder-852009-8-iscsi devstack@n-api.service[105513]: ERROR nova.api.openstack.wsgi Sep 13 17:55:28.443344 dv-cinder-852009-8-iscsi devstack@n-api.service[105513]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 13 17:55:28.443344 dv-cinder-852009-8-iscsi devstack@n-api.service[105513]: ERROR nova.api.openstack.wsgi Sep 13 17:55:28.443344 dv-cinder-852009-8-iscsi devstack@n-api.service[105513]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 13 17:55:28.443344 dv-cinder-852009-8-iscsi devstack@n-api.service[105513]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 13 17:55:28.443344 dv-cinder-852009-8-iscsi devstack@n-api.service[105513]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 13 17:55:28.443344 dv-cinder-852009-8-iscsi devstack@n-api.service[105513]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 13 17:55:28.443344 dv-cinder-852009-8-iscsi devstack@n-api.service[105513]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 13 17:55:28.443344 dv-cinder-852009-8-iscsi devstack@n-api.service[105513]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Flavor 84 could not be found. Sep 13 17:55:28.443344 dv-cinder-852009-8-iscsi devstack@n-api.service[105513]: ERROR nova.api.openstack.wsgi Sep 13 17:55:28.443344 dv-cinder-852009-8-iscsi devstack@n-api.service[105513]: DEBUG nova.api.openstack.wsgi [None req-9e9f0292-3d30-4778-87d4-f397780ad1ed admin admin] Returning 404 to user: Flavor 84 could not be found. {{(pid=105513) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 13 17:55:28.444687 dv-cinder-852009-8-iscsi devstack@n-api.service[105513]: INFO nova.api.openstack.requestlog [None req-9e9f0292-3d30-4778-87d4-f397780ad1ed admin admin] 10.222.0.43 "GET /compute/v2.1/flavors/84" status: 404 len: 75 microversion: 2.92 time: 0.013493 Sep 13 17:55:28.444687 dv-cinder-852009-8-iscsi devstack@n-api.service[105513]: [pid: 105513|app: 0|req: 23/47] 10.222.0.43 () {60 vars in 1190 bytes} [Tue Sep 13 17:55:28 2022] GET /compute/v2.1/flavors/84 => generated 75 bytes in 15 msecs (HTTP/1.1 404) 9 headers in 380 bytes (1 switches on core 0) Sep 13 17:55:29.712623 dv-cinder-852009-8-iscsi devstack@n-api.service[105512]: DEBUG nova.api.openstack.wsgi [None req-800110c2-7b61-48c7-ae43-32bd514c5c85 admin admin] Calling method '>' {{(pid=105512) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 17:55:29.713637 dv-cinder-852009-8-iscsi devstack@n-api.service[105512]: INFO nova.api.openstack.requestlog [None req-800110c2-7b61-48c7-ae43-32bd514c5c85 admin admin] 10.222.0.43 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001508 Sep 13 17:55:29.714051 dv-cinder-852009-8-iscsi devstack@n-api.service[105512]: [pid: 105512|app: 0|req: 25/48] 10.222.0.43 () {56 vars in 1074 bytes} [Tue Sep 13 17:55:29 2022] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 13 17:55:30.320340 dv-cinder-852009-8-iscsi devstack@n-api.service[105513]: DEBUG nova.api.openstack.wsgi [None req-c34ad52c-4540-4423-8490-86d787056c49 admin admin] Calling method '>' {{(pid=105513) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 17:55:30.326874 dv-cinder-852009-8-iscsi devstack@n-api.service[105513]: INFO nova.api.openstack.wsgi [None req-c34ad52c-4540-4423-8490-86d787056c49 admin admin] HTTP exception thrown: Flavor 451 could not be found. Sep 13 17:55:30.328449 dv-cinder-852009-8-iscsi devstack@n-api.service[105513]: DEBUG nova.api.openstack.wsgi [None req-c34ad52c-4540-4423-8490-86d787056c49 admin admin] Request method failure captured: Sep 13 17:55:30.328449 dv-cinder-852009-8-iscsi devstack@n-api.service[105513]: request: GET /compute/v2.1/flavors/451 HTTP/1.1 Sep 13 17:55:30.328449 dv-cinder-852009-8-iscsi devstack@n-api.service[105513]: Accept: application/json Sep 13 17:55:30.328449 dv-cinder-852009-8-iscsi devstack@n-api.service[105513]: Accept-Encoding: gzip, deflate Sep 13 17:55:30.328449 dv-cinder-852009-8-iscsi devstack@n-api.service[105513]: Connection: keep-alive Sep 13 17:55:30.328449 dv-cinder-852009-8-iscsi devstack@n-api.service[105513]: Content-Length: 0 Sep 13 17:55:30.328449 dv-cinder-852009-8-iscsi devstack@n-api.service[105513]: Host: 10.222.0.43 Sep 13 17:55:30.328449 dv-cinder-852009-8-iscsi devstack@n-api.service[105513]: Openstack-Api-Version: compute 2.92 Sep 13 17:55:30.328449 dv-cinder-852009-8-iscsi devstack@n-api.service[105513]: Openstack-System-Scope: None Sep 13 17:55:30.328449 dv-cinder-852009-8-iscsi devstack@n-api.service[105513]: User-Agent: python-novaclient Sep 13 17:55:30.328449 dv-cinder-852009-8-iscsi devstack@n-api.service[105513]: X-Auth-Token: gAAAAABjIMQRtnSCrbVtVJrJl8JHTHdvT9dW2eO1HYFpppdz3Pd6fwcLnvWEcShdV0yjeLVjFYV2ls4ULVpozzr9Drcb2zuXkKUztAKvFx_7Gj7bZThVmQUOj-Z3nQRM-qQu2gzYbyzAGxnVTgjCx-Itesdmg6gatDdbzuOhRB3zUZRO_j7PFXU Sep 13 17:55:30.328449 dv-cinder-852009-8-iscsi devstack@n-api.service[105513]: X-Domain-Id: None Sep 13 17:55:30.328449 dv-cinder-852009-8-iscsi devstack@n-api.service[105513]: X-Domain-Name: None Sep 13 17:55:30.328449 dv-cinder-852009-8-iscsi devstack@n-api.service[105513]: X-Identity-Status: Confirmed Sep 13 17:55:30.328449 dv-cinder-852009-8-iscsi devstack@n-api.service[105513]: X-Is-Admin-Project: True Sep 13 17:55:30.328449 dv-cinder-852009-8-iscsi devstack@n-api.service[105513]: X-Openstack-Nova-Api-Version: 2.92 Sep 13 17:55:30.328449 dv-cinder-852009-8-iscsi devstack@n-api.service[105513]: X-Project-Domain-Id: default Sep 13 17:55:30.328449 dv-cinder-852009-8-iscsi devstack@n-api.service[105513]: X-Project-Domain-Name: Default Sep 13 17:55:30.328449 dv-cinder-852009-8-iscsi devstack@n-api.service[105513]: X-Project-Id: c326683f56fe42d09b126fc368517cb3 Sep 13 17:55:30.328449 dv-cinder-852009-8-iscsi devstack@n-api.service[105513]: X-Project-Name: admin Sep 13 17:55:30.328449 dv-cinder-852009-8-iscsi devstack@n-api.service[105513]: X-Role: admin,reader,member Sep 13 17:55:30.328449 dv-cinder-852009-8-iscsi devstack@n-api.service[105513]: X-Roles: admin,reader,member Sep 13 17:55:30.330179 dv-cinder-852009-8-iscsi devstack@n-api.service[105513]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/identity"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/compute/v2/c326683f56fe42d09b126fc368517cb3"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.43:8080", "publicURL": "http://10.222.0.43:8080/v1/AUTH_c326683f56fe42d09b126fc368517cb3"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43:9696/networking"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/volume/v3/c326683f56fe42d09b126fc368517cb3"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/compute/v2.1"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/placement"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/volume/v3/c326683f56fe42d09b126fc368517cb3"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/image"}]}] Sep 13 17:55:30.330179 dv-cinder-852009-8-iscsi devstack@n-api.service[105513]: X-Tenant: admin Sep 13 17:55:30.330179 dv-cinder-852009-8-iscsi devstack@n-api.service[105513]: X-Tenant-Id: c326683f56fe42d09b126fc368517cb3 Sep 13 17:55:30.330179 dv-cinder-852009-8-iscsi devstack@n-api.service[105513]: X-Tenant-Name: admin Sep 13 17:55:30.330179 dv-cinder-852009-8-iscsi devstack@n-api.service[105513]: X-User: admin Sep 13 17:55:30.330179 dv-cinder-852009-8-iscsi devstack@n-api.service[105513]: X-User-Domain-Id: default Sep 13 17:55:30.330179 dv-cinder-852009-8-iscsi devstack@n-api.service[105513]: X-User-Domain-Name: Default Sep 13 17:55:30.330179 dv-cinder-852009-8-iscsi devstack@n-api.service[105513]: X-User-Id: bb561c12b9c44bd29f9bae620dc33608 Sep 13 17:55:30.330179 dv-cinder-852009-8-iscsi devstack@n-api.service[105513]: X-User-Name: admin Sep 13 17:55:30.330179 dv-cinder-852009-8-iscsi devstack@n-api.service[105513]: method: > Sep 13 17:55:30.330179 dv-cinder-852009-8-iscsi devstack@n-api.service[105513]: exception: Flavor 451 could not be found. Sep 13 17:55:30.330179 dv-cinder-852009-8-iscsi devstack@n-api.service[105513]: action_args: {'id': '451'} Sep 13 17:55:30.330179 dv-cinder-852009-8-iscsi devstack@n-api.service[105513]: {{(pid=105513) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 13 17:55:30.330179 dv-cinder-852009-8-iscsi devstack@n-api.service[105513]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 13 17:55:30.331181 dv-cinder-852009-8-iscsi devstack@n-api.service[105513]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/flavors.py", line 66, in show Sep 13 17:55:30.331181 dv-cinder-852009-8-iscsi devstack@n-api.service[105513]: ERROR nova.api.openstack.wsgi flavor = flavors.get_flavor_by_flavor_id(id, ctxt=context) Sep 13 17:55:30.331181 dv-cinder-852009-8-iscsi devstack@n-api.service[105513]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/flavors.py", line 139, in get_flavor_by_flavor_id Sep 13 17:55:30.331181 dv-cinder-852009-8-iscsi devstack@n-api.service[105513]: ERROR nova.api.openstack.wsgi return objects.Flavor.get_by_flavor_id(ctxt, flavorid, read_deleted) Sep 13 17:55:30.331181 dv-cinder-852009-8-iscsi devstack@n-api.service[105513]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_versionedobjects/base.py", line 184, in wrapper Sep 13 17:55:30.331181 dv-cinder-852009-8-iscsi devstack@n-api.service[105513]: ERROR nova.api.openstack.wsgi result = fn(cls, context, *args, **kwargs) Sep 13 17:55:30.331181 dv-cinder-852009-8-iscsi devstack@n-api.service[105513]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/flavor.py", line 390, in get_by_flavor_id Sep 13 17:55:30.331181 dv-cinder-852009-8-iscsi devstack@n-api.service[105513]: ERROR nova.api.openstack.wsgi db_flavor = cls._flavor_get_by_flavor_id_from_db(context, Sep 13 17:55:30.331181 dv-cinder-852009-8-iscsi devstack@n-api.service[105513]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/db/utils.py", line 35, in wrapper Sep 13 17:55:30.331181 dv-cinder-852009-8-iscsi devstack@n-api.service[105513]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 13 17:55:30.331181 dv-cinder-852009-8-iscsi devstack@n-api.service[105513]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/flavor.py", line 317, in _flavor_get_by_flavor_id_from_db Sep 13 17:55:30.331181 dv-cinder-852009-8-iscsi devstack@n-api.service[105513]: ERROR nova.api.openstack.wsgi raise exception.FlavorNotFound(flavor_id=flavor_id) Sep 13 17:55:30.331181 dv-cinder-852009-8-iscsi devstack@n-api.service[105513]: ERROR nova.api.openstack.wsgi nova.exception.FlavorNotFound: Flavor 451 could not be found. Sep 13 17:55:30.331181 dv-cinder-852009-8-iscsi devstack@n-api.service[105513]: ERROR nova.api.openstack.wsgi Sep 13 17:55:30.331181 dv-cinder-852009-8-iscsi devstack@n-api.service[105513]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 13 17:55:30.331181 dv-cinder-852009-8-iscsi devstack@n-api.service[105513]: ERROR nova.api.openstack.wsgi Sep 13 17:55:30.331181 dv-cinder-852009-8-iscsi devstack@n-api.service[105513]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 13 17:55:30.331181 dv-cinder-852009-8-iscsi devstack@n-api.service[105513]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 13 17:55:30.331181 dv-cinder-852009-8-iscsi devstack@n-api.service[105513]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 13 17:55:30.332294 dv-cinder-852009-8-iscsi devstack@n-api.service[105513]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 13 17:55:30.332294 dv-cinder-852009-8-iscsi devstack@n-api.service[105513]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 13 17:55:30.332294 dv-cinder-852009-8-iscsi devstack@n-api.service[105513]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 13 17:55:30.332294 dv-cinder-852009-8-iscsi devstack@n-api.service[105513]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 13 17:55:30.332294 dv-cinder-852009-8-iscsi devstack@n-api.service[105513]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/flavors.py", line 68, in show Sep 13 17:55:30.332294 dv-cinder-852009-8-iscsi devstack@n-api.service[105513]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPNotFound(explanation=e.format_message()) Sep 13 17:55:30.332294 dv-cinder-852009-8-iscsi devstack@n-api.service[105513]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Flavor 451 could not be found. Sep 13 17:55:30.332294 dv-cinder-852009-8-iscsi devstack@n-api.service[105513]: ERROR nova.api.openstack.wsgi Sep 13 17:55:30.332294 dv-cinder-852009-8-iscsi devstack@n-api.service[105513]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 13 17:55:30.332294 dv-cinder-852009-8-iscsi devstack@n-api.service[105513]: ERROR nova.api.openstack.wsgi Sep 13 17:55:30.332294 dv-cinder-852009-8-iscsi devstack@n-api.service[105513]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 13 17:55:30.332294 dv-cinder-852009-8-iscsi devstack@n-api.service[105513]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 13 17:55:30.332294 dv-cinder-852009-8-iscsi devstack@n-api.service[105513]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 13 17:55:30.332294 dv-cinder-852009-8-iscsi devstack@n-api.service[105513]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 13 17:55:30.332294 dv-cinder-852009-8-iscsi devstack@n-api.service[105513]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 13 17:55:30.332294 dv-cinder-852009-8-iscsi devstack@n-api.service[105513]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Flavor 451 could not be found. Sep 13 17:55:30.332294 dv-cinder-852009-8-iscsi devstack@n-api.service[105513]: ERROR nova.api.openstack.wsgi Sep 13 17:55:30.332294 dv-cinder-852009-8-iscsi devstack@n-api.service[105513]: DEBUG nova.api.openstack.wsgi [None req-c34ad52c-4540-4423-8490-86d787056c49 admin admin] Returning 404 to user: Flavor 451 could not be found. {{(pid=105513) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 13 17:55:30.333416 dv-cinder-852009-8-iscsi devstack@n-api.service[105513]: INFO nova.api.openstack.requestlog [None req-c34ad52c-4540-4423-8490-86d787056c49 admin admin] 10.222.0.43 "GET /compute/v2.1/flavors/451" status: 404 len: 76 microversion: 2.92 time: 0.478713 Sep 13 17:55:30.333416 dv-cinder-852009-8-iscsi devstack@n-api.service[105513]: [pid: 105513|app: 0|req: 24/49] 10.222.0.43 () {60 vars in 1193 bytes} [Tue Sep 13 17:55:29 2022] GET /compute/v2.1/flavors/451 => generated 76 bytes in 480 msecs (HTTP/1.1 404) 9 headers in 380 bytes (1 switches on core 0) Sep 13 17:55:30.340080 dv-cinder-852009-8-iscsi devstack@n-api.service[105512]: DEBUG nova.api.openstack.wsgi [None req-4dceb9a1-f47e-4c55-b8dd-0e57221e3ae6 admin admin] Calling method '>' {{(pid=105512) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 17:55:30.360109 dv-cinder-852009-8-iscsi devstack@n-api.service[105512]: INFO nova.api.openstack.requestlog [None req-4dceb9a1-f47e-4c55-b8dd-0e57221e3ae6 admin admin] 10.222.0.43 "GET /compute/v2.1/flavors?is_public=None" status: 200 len: 2056 microversion: 2.92 time: 0.023342 Sep 13 17:55:30.360938 dv-cinder-852009-8-iscsi devstack@n-api.service[105512]: [pid: 105512|app: 0|req: 26/50] 10.222.0.43 () {60 vars in 1210 bytes} [Tue Sep 13 17:55:30 2022] GET /compute/v2.1/flavors?is_public=None => generated 2056 bytes in 25 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 13 17:55:30.371661 dv-cinder-852009-8-iscsi devstack@n-api.service[105513]: DEBUG nova.api.openstack.wsgi [None req-8d236aa7-deaa-4719-94f4-903aebb5ea61 admin admin] Calling method '>' {{(pid=105513) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 17:55:30.388550 dv-cinder-852009-8-iscsi devstack@n-api.service[105513]: INFO nova.api.openstack.requestlog [None req-8d236aa7-deaa-4719-94f4-903aebb5ea61 admin admin] 10.222.0.43 "GET /compute/v2.1/flavors?is_public=None" status: 200 len: 2056 microversion: 2.92 time: 0.020998 Sep 13 17:55:30.389110 dv-cinder-852009-8-iscsi devstack@n-api.service[105513]: [pid: 105513|app: 0|req: 25/51] 10.222.0.43 () {60 vars in 1210 bytes} [Tue Sep 13 17:55:30 2022] GET /compute/v2.1/flavors?is_public=None => generated 2056 bytes in 22 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 13 17:55:30.399325 dv-cinder-852009-8-iscsi devstack@n-api.service[105512]: DEBUG nova.api.openstack.wsgi [None req-0e970e09-7e06-49eb-9ec7-7516649741e2 admin admin] Calling method '>' {{(pid=105512) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 17:55:30.404551 dv-cinder-852009-8-iscsi devstack@n-api.service[105512]: INFO nova.api.openstack.wsgi [None req-0e970e09-7e06-49eb-9ec7-7516649741e2 admin admin] HTTP exception thrown: Flavor 451 could not be found. Sep 13 17:55:30.406083 dv-cinder-852009-8-iscsi devstack@n-api.service[105512]: DEBUG nova.api.openstack.wsgi [None req-0e970e09-7e06-49eb-9ec7-7516649741e2 admin admin] Request method failure captured: Sep 13 17:55:30.406083 dv-cinder-852009-8-iscsi devstack@n-api.service[105512]: request: GET /compute/v2.1/flavors/451 HTTP/1.1 Sep 13 17:55:30.406083 dv-cinder-852009-8-iscsi devstack@n-api.service[105512]: Accept: application/json Sep 13 17:55:30.406083 dv-cinder-852009-8-iscsi devstack@n-api.service[105512]: Accept-Encoding: gzip, deflate Sep 13 17:55:30.406083 dv-cinder-852009-8-iscsi devstack@n-api.service[105512]: Connection: keep-alive Sep 13 17:55:30.406083 dv-cinder-852009-8-iscsi devstack@n-api.service[105512]: Content-Length: 0 Sep 13 17:55:30.406083 dv-cinder-852009-8-iscsi devstack@n-api.service[105512]: Host: 10.222.0.43 Sep 13 17:55:30.406083 dv-cinder-852009-8-iscsi devstack@n-api.service[105512]: Openstack-Api-Version: compute 2.92 Sep 13 17:55:30.406083 dv-cinder-852009-8-iscsi devstack@n-api.service[105512]: Openstack-System-Scope: None Sep 13 17:55:30.406083 dv-cinder-852009-8-iscsi devstack@n-api.service[105512]: User-Agent: python-novaclient Sep 13 17:55:30.406083 dv-cinder-852009-8-iscsi devstack@n-api.service[105512]: X-Auth-Token: gAAAAABjIMQRtnSCrbVtVJrJl8JHTHdvT9dW2eO1HYFpppdz3Pd6fwcLnvWEcShdV0yjeLVjFYV2ls4ULVpozzr9Drcb2zuXkKUztAKvFx_7Gj7bZThVmQUOj-Z3nQRM-qQu2gzYbyzAGxnVTgjCx-Itesdmg6gatDdbzuOhRB3zUZRO_j7PFXU Sep 13 17:55:30.406083 dv-cinder-852009-8-iscsi devstack@n-api.service[105512]: X-Domain-Id: None Sep 13 17:55:30.406083 dv-cinder-852009-8-iscsi devstack@n-api.service[105512]: X-Domain-Name: None Sep 13 17:55:30.406083 dv-cinder-852009-8-iscsi devstack@n-api.service[105512]: X-Identity-Status: Confirmed Sep 13 17:55:30.406083 dv-cinder-852009-8-iscsi devstack@n-api.service[105512]: X-Is-Admin-Project: True Sep 13 17:55:30.406083 dv-cinder-852009-8-iscsi devstack@n-api.service[105512]: X-Openstack-Nova-Api-Version: 2.92 Sep 13 17:55:30.406083 dv-cinder-852009-8-iscsi devstack@n-api.service[105512]: X-Project-Domain-Id: default Sep 13 17:55:30.406083 dv-cinder-852009-8-iscsi devstack@n-api.service[105512]: X-Project-Domain-Name: Default Sep 13 17:55:30.406083 dv-cinder-852009-8-iscsi devstack@n-api.service[105512]: X-Project-Id: c326683f56fe42d09b126fc368517cb3 Sep 13 17:55:30.406083 dv-cinder-852009-8-iscsi devstack@n-api.service[105512]: X-Project-Name: admin Sep 13 17:55:30.406083 dv-cinder-852009-8-iscsi devstack@n-api.service[105512]: X-Role: admin,reader,member Sep 13 17:55:30.406083 dv-cinder-852009-8-iscsi devstack@n-api.service[105512]: X-Roles: admin,reader,member Sep 13 17:55:30.407773 dv-cinder-852009-8-iscsi devstack@n-api.service[105512]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/identity"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/compute/v2/c326683f56fe42d09b126fc368517cb3"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.43:8080", "publicURL": "http://10.222.0.43:8080/v1/AUTH_c326683f56fe42d09b126fc368517cb3"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43:9696/networking"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/volume/v3/c326683f56fe42d09b126fc368517cb3"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/compute/v2.1"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/placement"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/volume/v3/c326683f56fe42d09b126fc368517cb3"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/image"}]}] Sep 13 17:55:30.407773 dv-cinder-852009-8-iscsi devstack@n-api.service[105512]: X-Tenant: admin Sep 13 17:55:30.407773 dv-cinder-852009-8-iscsi devstack@n-api.service[105512]: X-Tenant-Id: c326683f56fe42d09b126fc368517cb3 Sep 13 17:55:30.407773 dv-cinder-852009-8-iscsi devstack@n-api.service[105512]: X-Tenant-Name: admin Sep 13 17:55:30.407773 dv-cinder-852009-8-iscsi devstack@n-api.service[105512]: X-User: admin Sep 13 17:55:30.407773 dv-cinder-852009-8-iscsi devstack@n-api.service[105512]: X-User-Domain-Id: default Sep 13 17:55:30.407773 dv-cinder-852009-8-iscsi devstack@n-api.service[105512]: X-User-Domain-Name: Default Sep 13 17:55:30.407773 dv-cinder-852009-8-iscsi devstack@n-api.service[105512]: X-User-Id: bb561c12b9c44bd29f9bae620dc33608 Sep 13 17:55:30.407773 dv-cinder-852009-8-iscsi devstack@n-api.service[105512]: X-User-Name: admin Sep 13 17:55:30.407773 dv-cinder-852009-8-iscsi devstack@n-api.service[105512]: method: > Sep 13 17:55:30.407773 dv-cinder-852009-8-iscsi devstack@n-api.service[105512]: exception: Flavor 451 could not be found. Sep 13 17:55:30.407773 dv-cinder-852009-8-iscsi devstack@n-api.service[105512]: action_args: {'id': '451'} Sep 13 17:55:30.407773 dv-cinder-852009-8-iscsi devstack@n-api.service[105512]: {{(pid=105512) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 13 17:55:30.407773 dv-cinder-852009-8-iscsi devstack@n-api.service[105512]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 13 17:55:30.408806 dv-cinder-852009-8-iscsi devstack@n-api.service[105512]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/flavors.py", line 66, in show Sep 13 17:55:30.408806 dv-cinder-852009-8-iscsi devstack@n-api.service[105512]: ERROR nova.api.openstack.wsgi flavor = flavors.get_flavor_by_flavor_id(id, ctxt=context) Sep 13 17:55:30.408806 dv-cinder-852009-8-iscsi devstack@n-api.service[105512]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/flavors.py", line 139, in get_flavor_by_flavor_id Sep 13 17:55:30.408806 dv-cinder-852009-8-iscsi devstack@n-api.service[105512]: ERROR nova.api.openstack.wsgi return objects.Flavor.get_by_flavor_id(ctxt, flavorid, read_deleted) Sep 13 17:55:30.408806 dv-cinder-852009-8-iscsi devstack@n-api.service[105512]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_versionedobjects/base.py", line 184, in wrapper Sep 13 17:55:30.408806 dv-cinder-852009-8-iscsi devstack@n-api.service[105512]: ERROR nova.api.openstack.wsgi result = fn(cls, context, *args, **kwargs) Sep 13 17:55:30.408806 dv-cinder-852009-8-iscsi devstack@n-api.service[105512]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/flavor.py", line 390, in get_by_flavor_id Sep 13 17:55:30.408806 dv-cinder-852009-8-iscsi devstack@n-api.service[105512]: ERROR nova.api.openstack.wsgi db_flavor = cls._flavor_get_by_flavor_id_from_db(context, Sep 13 17:55:30.408806 dv-cinder-852009-8-iscsi devstack@n-api.service[105512]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/db/utils.py", line 35, in wrapper Sep 13 17:55:30.408806 dv-cinder-852009-8-iscsi devstack@n-api.service[105512]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 13 17:55:30.408806 dv-cinder-852009-8-iscsi devstack@n-api.service[105512]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/flavor.py", line 317, in _flavor_get_by_flavor_id_from_db Sep 13 17:55:30.408806 dv-cinder-852009-8-iscsi devstack@n-api.service[105512]: ERROR nova.api.openstack.wsgi raise exception.FlavorNotFound(flavor_id=flavor_id) Sep 13 17:55:30.408806 dv-cinder-852009-8-iscsi devstack@n-api.service[105512]: ERROR nova.api.openstack.wsgi nova.exception.FlavorNotFound: Flavor 451 could not be found. Sep 13 17:55:30.408806 dv-cinder-852009-8-iscsi devstack@n-api.service[105512]: ERROR nova.api.openstack.wsgi Sep 13 17:55:30.408806 dv-cinder-852009-8-iscsi devstack@n-api.service[105512]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 13 17:55:30.408806 dv-cinder-852009-8-iscsi devstack@n-api.service[105512]: ERROR nova.api.openstack.wsgi Sep 13 17:55:30.408806 dv-cinder-852009-8-iscsi devstack@n-api.service[105512]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 13 17:55:30.408806 dv-cinder-852009-8-iscsi devstack@n-api.service[105512]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 13 17:55:30.408806 dv-cinder-852009-8-iscsi devstack@n-api.service[105512]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 13 17:55:30.410194 dv-cinder-852009-8-iscsi devstack@n-api.service[105512]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 13 17:55:30.410194 dv-cinder-852009-8-iscsi devstack@n-api.service[105512]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 13 17:55:30.410194 dv-cinder-852009-8-iscsi devstack@n-api.service[105512]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 13 17:55:30.410194 dv-cinder-852009-8-iscsi devstack@n-api.service[105512]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 13 17:55:30.410194 dv-cinder-852009-8-iscsi devstack@n-api.service[105512]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/flavors.py", line 68, in show Sep 13 17:55:30.410194 dv-cinder-852009-8-iscsi devstack@n-api.service[105512]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPNotFound(explanation=e.format_message()) Sep 13 17:55:30.410194 dv-cinder-852009-8-iscsi devstack@n-api.service[105512]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Flavor 451 could not be found. Sep 13 17:55:30.410194 dv-cinder-852009-8-iscsi devstack@n-api.service[105512]: ERROR nova.api.openstack.wsgi Sep 13 17:55:30.410194 dv-cinder-852009-8-iscsi devstack@n-api.service[105512]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 13 17:55:30.410194 dv-cinder-852009-8-iscsi devstack@n-api.service[105512]: ERROR nova.api.openstack.wsgi Sep 13 17:55:30.410194 dv-cinder-852009-8-iscsi devstack@n-api.service[105512]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 13 17:55:30.410194 dv-cinder-852009-8-iscsi devstack@n-api.service[105512]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 13 17:55:30.410194 dv-cinder-852009-8-iscsi devstack@n-api.service[105512]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 13 17:55:30.410194 dv-cinder-852009-8-iscsi devstack@n-api.service[105512]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 13 17:55:30.410194 dv-cinder-852009-8-iscsi devstack@n-api.service[105512]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 13 17:55:30.410194 dv-cinder-852009-8-iscsi devstack@n-api.service[105512]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Flavor 451 could not be found. Sep 13 17:55:30.410194 dv-cinder-852009-8-iscsi devstack@n-api.service[105512]: ERROR nova.api.openstack.wsgi Sep 13 17:55:30.410194 dv-cinder-852009-8-iscsi devstack@n-api.service[105512]: DEBUG nova.api.openstack.wsgi [None req-0e970e09-7e06-49eb-9ec7-7516649741e2 admin admin] Returning 404 to user: Flavor 451 could not be found. {{(pid=105512) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 13 17:55:30.411415 dv-cinder-852009-8-iscsi devstack@n-api.service[105512]: INFO nova.api.openstack.requestlog [None req-0e970e09-7e06-49eb-9ec7-7516649741e2 admin admin] 10.222.0.43 "GET /compute/v2.1/flavors/451" status: 404 len: 76 microversion: 2.92 time: 0.011940 Sep 13 17:55:30.411415 dv-cinder-852009-8-iscsi devstack@n-api.service[105512]: [pid: 105512|app: 0|req: 27/52] 10.222.0.43 () {60 vars in 1193 bytes} [Tue Sep 13 17:55:30 2022] GET /compute/v2.1/flavors/451 => generated 76 bytes in 13 msecs (HTTP/1.1 404) 9 headers in 380 bytes (1 switches on core 0) Sep 13 17:55:31.640317 dv-cinder-852009-8-iscsi devstack@n-api.service[105513]: DEBUG nova.api.openstack.wsgi [None req-8d236aa7-deaa-4719-94f4-903aebb5ea61 admin admin] Calling method '>' {{(pid=105513) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 17:55:31.641388 dv-cinder-852009-8-iscsi devstack@n-api.service[105513]: INFO nova.api.openstack.requestlog [None req-8d236aa7-deaa-4719-94f4-903aebb5ea61 admin admin] 10.222.0.43 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001495 Sep 13 17:55:31.641820 dv-cinder-852009-8-iscsi devstack@n-api.service[105513]: [pid: 105513|app: 0|req: 26/53] 10.222.0.43 () {56 vars in 1074 bytes} [Tue Sep 13 17:55:31 2022] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 13 17:55:32.201052 dv-cinder-852009-8-iscsi devstack@n-api.service[105512]: DEBUG nova.api.openstack.wsgi [None req-e043abf1-0059-4b30-95e9-9b09b4c22630 admin admin] Action: 'create', calling method: >, body: {"flavor": {"name": "m1.nano", "ram": 256, "vcpus": 1, "disk": 1, "id": "42", "swap": 0, "OS-FLV-EXT-DATA:ephemeral": 0, "rxtx_factor": 1.0, "os-flavor-access:is_public": true}} {{(pid=105512) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 13 17:55:32.225867 dv-cinder-852009-8-iscsi devstack@n-api.service[105512]: INFO nova.api.openstack.requestlog [None req-e043abf1-0059-4b30-95e9-9b09b4c22630 admin admin] 10.222.0.43 "POST /compute/v2.1/flavors" status: 200 len: 404 microversion: 2.92 time: 0.446572 Sep 13 17:55:32.226427 dv-cinder-852009-8-iscsi devstack@n-api.service[105512]: [pid: 105512|app: 0|req: 28/54] 10.222.0.43 () {64 vars in 1235 bytes} [Tue Sep 13 17:55:31 2022] POST /compute/v2.1/flavors => generated 404 bytes in 448 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Sep 13 17:55:33.468274 dv-cinder-852009-8-iscsi devstack@n-api.service[105513]: DEBUG nova.api.openstack.wsgi [None req-8d236aa7-deaa-4719-94f4-903aebb5ea61 admin admin] Calling method '>' {{(pid=105513) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 17:55:33.469465 dv-cinder-852009-8-iscsi devstack@n-api.service[105513]: INFO nova.api.openstack.requestlog [None req-8d236aa7-deaa-4719-94f4-903aebb5ea61 admin admin] 10.222.0.43 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001609 Sep 13 17:55:33.470001 dv-cinder-852009-8-iscsi devstack@n-api.service[105513]: [pid: 105513|app: 0|req: 27/55] 10.222.0.43 () {56 vars in 1074 bytes} [Tue Sep 13 17:55:33 2022] GET /compute/v2.1 => generated 388 bytes in 3 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 13 17:55:34.037497 dv-cinder-852009-8-iscsi devstack@n-api.service[105512]: DEBUG nova.api.openstack.wsgi [None req-781a9f5c-3860-4e5b-914c-69ad289a3faf admin admin] Action: 'create', calling method: >, body: {"flavor": {"name": "m1.micro", "ram": 256, "vcpus": 1, "disk": 2, "id": "84", "swap": 0, "OS-FLV-EXT-DATA:ephemeral": 0, "rxtx_factor": 1.0, "os-flavor-access:is_public": true}} {{(pid=105512) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 13 17:55:34.058234 dv-cinder-852009-8-iscsi devstack@n-api.service[105512]: INFO nova.api.openstack.requestlog [None req-781a9f5c-3860-4e5b-914c-69ad289a3faf admin admin] 10.222.0.43 "POST /compute/v2.1/flavors" status: 200 len: 405 microversion: 2.92 time: 0.452836 Sep 13 17:55:34.058784 dv-cinder-852009-8-iscsi devstack@n-api.service[105512]: [pid: 105512|app: 0|req: 29/56] 10.222.0.43 () {64 vars in 1235 bytes} [Tue Sep 13 17:55:33 2022] POST /compute/v2.1/flavors => generated 405 bytes in 454 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Sep 13 17:55:35.310191 dv-cinder-852009-8-iscsi devstack@n-api.service[105513]: DEBUG nova.api.openstack.wsgi [None req-8d236aa7-deaa-4719-94f4-903aebb5ea61 admin admin] Calling method '>' {{(pid=105513) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 17:55:35.311234 dv-cinder-852009-8-iscsi devstack@n-api.service[105513]: INFO nova.api.openstack.requestlog [None req-8d236aa7-deaa-4719-94f4-903aebb5ea61 admin admin] 10.222.0.43 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001487 Sep 13 17:55:35.311624 dv-cinder-852009-8-iscsi devstack@n-api.service[105513]: [pid: 105513|app: 0|req: 28/57] 10.222.0.43 () {56 vars in 1074 bytes} [Tue Sep 13 17:55:35 2022] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 13 17:55:35.901202 dv-cinder-852009-8-iscsi devstack@n-api.service[105512]: DEBUG nova.api.openstack.wsgi [None req-6efeca02-2301-42b3-9b81-8d6e1ffebc64 admin admin] Action: 'create', calling method: >, body: {"flavor": {"name": "m1.heat", "ram": 512, "vcpus": 1, "disk": 1, "id": "451", "swap": 0, "OS-FLV-EXT-DATA:ephemeral": 0, "rxtx_factor": 1.0, "os-flavor-access:is_public": true}} {{(pid=105512) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 13 17:55:35.921908 dv-cinder-852009-8-iscsi devstack@n-api.service[105512]: INFO nova.api.openstack.requestlog [None req-6efeca02-2301-42b3-9b81-8d6e1ffebc64 admin admin] 10.222.0.43 "POST /compute/v2.1/flavors" status: 200 len: 407 microversion: 2.92 time: 0.474870 Sep 13 17:55:35.922456 dv-cinder-852009-8-iscsi devstack@n-api.service[105512]: [pid: 105512|app: 0|req: 30/58] 10.222.0.43 () {64 vars in 1235 bytes} [Tue Sep 13 17:55:35 2022] POST /compute/v2.1/flavors => generated 407 bytes in 476 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Sep 13 17:55:37.185450 dv-cinder-852009-8-iscsi devstack@n-api.service[105513]: DEBUG nova.api.openstack.wsgi [None req-8d236aa7-deaa-4719-94f4-903aebb5ea61 admin admin] Calling method '>' {{(pid=105513) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 17:55:37.186522 dv-cinder-852009-8-iscsi devstack@n-api.service[105513]: INFO nova.api.openstack.requestlog [None req-8d236aa7-deaa-4719-94f4-903aebb5ea61 admin admin] 10.222.0.43 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001526 Sep 13 17:55:37.186914 dv-cinder-852009-8-iscsi devstack@n-api.service[105513]: [pid: 105513|app: 0|req: 29/59] 10.222.0.43 () {56 vars in 1074 bytes} [Tue Sep 13 17:55:37 2022] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 13 17:55:37.748197 dv-cinder-852009-8-iscsi devstack@n-api.service[105512]: DEBUG nova.api.openstack.wsgi [None req-2b9eb1e0-4c2b-4999-a9ea-b2df28d8f0ba admin admin] Action: 'create', calling method: >, body: {"flavor": {"name": "m1.heat2", "ram": 1024, "vcpus": 1, "disk": 1, "id": "452", "swap": 0, "OS-FLV-EXT-DATA:ephemeral": 0, "rxtx_factor": 1.0, "os-flavor-access:is_public": true}} {{(pid=105512) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 13 17:55:37.768858 dv-cinder-852009-8-iscsi devstack@n-api.service[105512]: INFO nova.api.openstack.requestlog [None req-2b9eb1e0-4c2b-4999-a9ea-b2df28d8f0ba admin admin] 10.222.0.43 "POST /compute/v2.1/flavors" status: 200 len: 409 microversion: 2.92 time: 0.444352 Sep 13 17:55:37.769427 dv-cinder-852009-8-iscsi devstack@n-api.service[105512]: [pid: 105512|app: 0|req: 31/60] 10.222.0.43 () {64 vars in 1235 bytes} [Tue Sep 13 17:55:37 2022] POST /compute/v2.1/flavors => generated 409 bytes in 446 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Sep 13 17:55:39.021362 dv-cinder-852009-8-iscsi devstack@n-api.service[105513]: DEBUG nova.api.openstack.wsgi [None req-8d236aa7-deaa-4719-94f4-903aebb5ea61 admin admin] Calling method '>' {{(pid=105513) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 17:55:39.022369 dv-cinder-852009-8-iscsi devstack@n-api.service[105513]: INFO nova.api.openstack.requestlog [None req-8d236aa7-deaa-4719-94f4-903aebb5ea61 admin admin] 10.222.0.43 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001553 Sep 13 17:55:39.022763 dv-cinder-852009-8-iscsi devstack@n-api.service[105513]: [pid: 105513|app: 0|req: 30/61] 10.222.0.43 () {56 vars in 1074 bytes} [Tue Sep 13 17:55:39 2022] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 13 17:55:39.575189 dv-cinder-852009-8-iscsi devstack@n-api.service[105512]: DEBUG nova.api.openstack.wsgi [None req-01c29f2b-d05a-4463-b4fb-ef03edd136d2 admin admin] Calling method '>' {{(pid=105512) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 17:55:39.597898 dv-cinder-852009-8-iscsi devstack@n-api.service[105512]: INFO nova.api.openstack.requestlog [None req-01c29f2b-d05a-4463-b4fb-ef03edd136d2 admin admin] 10.222.0.43 "GET /compute/v2.1/flavors/detail" status: 200 len: 5777 microversion: 2.92 time: 0.438113 Sep 13 17:55:39.598377 dv-cinder-852009-8-iscsi devstack@n-api.service[105512]: [pid: 105512|app: 0|req: 32/62] 10.222.0.43 () {60 vars in 1202 bytes} [Tue Sep 13 17:55:39 2022] GET /compute/v2.1/flavors/detail => generated 5777 bytes in 439 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 13 17:56:37.263277 dv-cinder-852009-8-iscsi devstack@n-api.service[105513]: DEBUG nova.api.openstack.wsgi [None req-8d236aa7-deaa-4719-94f4-903aebb5ea61 admin admin] Calling method '>' {{(pid=105513) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 17:56:37.264298 dv-cinder-852009-8-iscsi devstack@n-api.service[105513]: INFO nova.api.openstack.requestlog [None req-8d236aa7-deaa-4719-94f4-903aebb5ea61 admin admin] 10.222.0.43 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001474 Sep 13 17:56:37.264733 dv-cinder-852009-8-iscsi devstack@n-api.service[105513]: [pid: 105513|app: 0|req: 31/63] 10.222.0.43 () {54 vars in 931 bytes} [Tue Sep 13 17:56:37 2022] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 13 17:56:37.275431 dv-cinder-852009-8-iscsi devstack@n-api.service[105512]: DEBUG dbcounter [-] [105512] Writing DB stats nova_api:SELECT=26,nova_api:INSERT=4 {{(pid=105512) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 17:56:37.679129 dv-cinder-852009-8-iscsi devstack@n-api.service[105512]: DEBUG nova.api.openstack.wsgi [None req-b602d616-3981-439f-b199-e11ab73c2261 admin admin] Calling method '>' {{(pid=105512) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 17:56:37.700174 dv-cinder-852009-8-iscsi devstack@n-api.service[105512]: INFO nova.api.openstack.requestlog [None req-b602d616-3981-439f-b199-e11ab73c2261 admin admin] 10.222.0.43 "GET /compute/v2.1/flavors/detail?is_public=True" status: 200 len: 5791 microversion: 2.61 time: 0.429217 Sep 13 17:56:37.700738 dv-cinder-852009-8-iscsi devstack@n-api.service[105512]: [pid: 105512|app: 0|req: 33/64] 10.222.0.43 () {60 vars in 1292 bytes} [Tue Sep 13 17:56:37 2022] GET /compute/v2.1/flavors/detail?is_public=True => generated 5791 bytes in 430 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 13 17:56:37.722058 dv-cinder-852009-8-iscsi devstack@n-api.service[105513]: DEBUG dbcounter [-] [105513] Writing DB stats nova_api:SELECT=14 {{(pid=105513) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 17:56:37.726488 dv-cinder-852009-8-iscsi devstack@n-api.service[105513]: DEBUG nova.api.openstack.wsgi [None req-e3903922-a225-4789-8302-eeb0153df0a6 admin admin] Calling method '>' {{(pid=105513) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 17:56:37.734262 dv-cinder-852009-8-iscsi devstack@n-api.service[105513]: INFO nova.api.openstack.requestlog [None req-e3903922-a225-4789-8302-eeb0153df0a6 admin admin] 10.222.0.43 "GET /compute/v2.1/flavors/42/os-extra_specs" status: 200 len: 19 microversion: 2.61 time: 0.013810 Sep 13 17:56:37.735051 dv-cinder-852009-8-iscsi devstack@n-api.service[105513]: [pid: 105513|app: 0|req: 32/65] 10.222.0.43 () {60 vars in 1283 bytes} [Tue Sep 13 17:56:37 2022] GET /compute/v2.1/flavors/42/os-extra_specs => generated 19 bytes in 15 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 13 17:56:37.747121 dv-cinder-852009-8-iscsi devstack@n-api.service[105512]: DEBUG nova.api.openstack.wsgi [None req-ceda1ce4-9f75-4b1e-8392-7be5233fa8d2 admin admin] Calling method '>' {{(pid=105512) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 17:56:37.754822 dv-cinder-852009-8-iscsi devstack@n-api.service[105512]: INFO nova.api.openstack.requestlog [None req-ceda1ce4-9f75-4b1e-8392-7be5233fa8d2 admin admin] 10.222.0.43 "GET /compute/v2.1/flavors/451/os-extra_specs" status: 200 len: 19 microversion: 2.61 time: 0.011408 Sep 13 17:56:37.755346 dv-cinder-852009-8-iscsi devstack@n-api.service[105512]: [pid: 105512|app: 0|req: 34/66] 10.222.0.43 () {60 vars in 1286 bytes} [Tue Sep 13 17:56:37 2022] GET /compute/v2.1/flavors/451/os-extra_specs => generated 19 bytes in 12 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 13 17:56:37.767512 dv-cinder-852009-8-iscsi devstack@n-api.service[105513]: DEBUG nova.api.openstack.wsgi [None req-4df360a4-f02e-43d0-8f6a-7a57d422e60a admin admin] Calling method '>' {{(pid=105513) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 17:56:37.775195 dv-cinder-852009-8-iscsi devstack@n-api.service[105513]: INFO nova.api.openstack.requestlog [None req-4df360a4-f02e-43d0-8f6a-7a57d422e60a admin admin] 10.222.0.43 "GET /compute/v2.1/flavors/452/os-extra_specs" status: 200 len: 19 microversion: 2.61 time: 0.011388 Sep 13 17:56:37.775726 dv-cinder-852009-8-iscsi devstack@n-api.service[105513]: [pid: 105513|app: 0|req: 33/67] 10.222.0.43 () {60 vars in 1286 bytes} [Tue Sep 13 17:56:37 2022] GET /compute/v2.1/flavors/452/os-extra_specs => generated 19 bytes in 12 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 13 17:56:37.787935 dv-cinder-852009-8-iscsi devstack@n-api.service[105512]: DEBUG nova.api.openstack.wsgi [None req-d016398d-ed2d-4559-ab89-aefcb35b3121 admin admin] Calling method '>' {{(pid=105512) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 17:56:37.795759 dv-cinder-852009-8-iscsi devstack@n-api.service[105512]: INFO nova.api.openstack.requestlog [None req-d016398d-ed2d-4559-ab89-aefcb35b3121 admin admin] 10.222.0.43 "GET /compute/v2.1/flavors/84/os-extra_specs" status: 200 len: 19 microversion: 2.61 time: 0.011642 Sep 13 17:56:37.796326 dv-cinder-852009-8-iscsi devstack@n-api.service[105512]: [pid: 105512|app: 0|req: 35/68] 10.222.0.43 () {60 vars in 1283 bytes} [Tue Sep 13 17:56:37 2022] GET /compute/v2.1/flavors/84/os-extra_specs => generated 19 bytes in 13 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 13 17:59:43.734559 dv-cinder-852009-8-iscsi devstack@n-api.service[105513]: DEBUG nova.api.openstack.wsgi [None req-4df360a4-f02e-43d0-8f6a-7a57d422e60a admin admin] Calling method '>' {{(pid=105513) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 17:59:43.735575 dv-cinder-852009-8-iscsi devstack@n-api.service[105513]: INFO nova.api.openstack.requestlog [None req-4df360a4-f02e-43d0-8f6a-7a57d422e60a admin admin] 10.222.0.43 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001476 Sep 13 17:59:43.735960 dv-cinder-852009-8-iscsi devstack@n-api.service[105513]: [pid: 105513|app: 0|req: 34/69] 10.222.0.43 () {56 vars in 1074 bytes} [Tue Sep 13 17:59:43 2022] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 13 17:59:43.880855 dv-cinder-852009-8-iscsi devstack@n-api.service[105512]: DEBUG dbcounter [-] [105512] Writing DB stats nova_api:SELECT=6 {{(pid=105512) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 17:59:44.058361 dv-cinder-852009-8-iscsi devstack@n-api.service[105512]: DEBUG nova.api.openstack.wsgi [None req-aeb98927-c423-4343-b86e-2d9d2599eddd admin admin] Calling method '>' {{(pid=105512) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 17:59:44.063328 dv-cinder-852009-8-iscsi devstack@n-api.service[105512]: DEBUG oslo_concurrency.lockutils [None req-aeb98927-c423-4343-b86e-2d9d2599eddd admin admin] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=105512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 17:59:44.063809 dv-cinder-852009-8-iscsi devstack@n-api.service[105512]: DEBUG oslo_concurrency.lockutils [None req-aeb98927-c423-4343-b86e-2d9d2599eddd admin admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=105512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 17:59:44.064268 dv-cinder-852009-8-iscsi devstack@n-api.service[105512]: DEBUG oslo_concurrency.lockutils [None req-aeb98927-c423-4343-b86e-2d9d2599eddd admin admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=105512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 17:59:44.065016 dv-cinder-852009-8-iscsi devstack@n-api.service[105512]: DEBUG oslo_concurrency.lockutils [None req-aeb98927-c423-4343-b86e-2d9d2599eddd admin admin] Acquiring lock "1daf4f4c-0e4a-4779-b53a-78c48397ea2f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=105512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 17:59:44.065466 dv-cinder-852009-8-iscsi devstack@n-api.service[105512]: DEBUG oslo_concurrency.lockutils [None req-aeb98927-c423-4343-b86e-2d9d2599eddd admin admin] Lock "1daf4f4c-0e4a-4779-b53a-78c48397ea2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=105512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 17:59:44.065886 dv-cinder-852009-8-iscsi devstack@n-api.service[105512]: DEBUG oslo_concurrency.lockutils [None req-aeb98927-c423-4343-b86e-2d9d2599eddd admin admin] Lock "1daf4f4c-0e4a-4779-b53a-78c48397ea2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=105512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 17:59:44.097493 dv-cinder-852009-8-iscsi devstack@n-api.service[105512]: INFO nova.api.openstack.requestlog [None req-aeb98927-c423-4343-b86e-2d9d2599eddd admin admin] 10.222.0.43 "GET /compute/v2.1/os-services" status: 200 len: 791 microversion: 2.92 time: 0.219045 Sep 13 17:59:44.098056 dv-cinder-852009-8-iscsi devstack@n-api.service[105512]: [pid: 105512|app: 0|req: 36/70] 10.222.0.43 () {60 vars in 1193 bytes} [Tue Sep 13 17:59:43 2022] GET /compute/v2.1/os-services => generated 791 bytes in 221 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Sep 13 17:59:45.192911 dv-cinder-852009-8-iscsi devstack@n-api.service[105513]: DEBUG nova.api.openstack.wsgi [None req-4df360a4-f02e-43d0-8f6a-7a57d422e60a admin admin] Calling method '>' {{(pid=105513) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 17:59:45.193932 dv-cinder-852009-8-iscsi devstack@n-api.service[105513]: INFO nova.api.openstack.requestlog [None req-4df360a4-f02e-43d0-8f6a-7a57d422e60a admin admin] 10.222.0.43 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001498 Sep 13 17:59:45.194591 dv-cinder-852009-8-iscsi devstack@n-api.service[105513]: [pid: 105513|app: 0|req: 35/71] 10.222.0.43 () {56 vars in 1074 bytes} [Tue Sep 13 17:59:45 2022] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 13 17:59:45.391886 dv-cinder-852009-8-iscsi devstack@n-api.service[105512]: DEBUG nova.api.openstack.wsgi [None req-f99c337c-d1df-41ec-838a-ab8fa5c87922 admin admin] Calling method '>' {{(pid=105512) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 17:59:45.395354 dv-cinder-852009-8-iscsi devstack@n-api.service[105512]: DEBUG oslo_concurrency.lockutils [None req-f99c337c-d1df-41ec-838a-ab8fa5c87922 admin admin] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=105512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 17:59:45.395890 dv-cinder-852009-8-iscsi devstack@n-api.service[105512]: DEBUG oslo_concurrency.lockutils [None req-f99c337c-d1df-41ec-838a-ab8fa5c87922 admin admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=105512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 17:59:45.396250 dv-cinder-852009-8-iscsi devstack@n-api.service[105512]: DEBUG oslo_concurrency.lockutils [None req-f99c337c-d1df-41ec-838a-ab8fa5c87922 admin admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=105512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 17:59:45.397013 dv-cinder-852009-8-iscsi devstack@n-api.service[105512]: DEBUG oslo_concurrency.lockutils [None req-f99c337c-d1df-41ec-838a-ab8fa5c87922 admin admin] Acquiring lock "1daf4f4c-0e4a-4779-b53a-78c48397ea2f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=105512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 17:59:45.397460 dv-cinder-852009-8-iscsi devstack@n-api.service[105512]: DEBUG oslo_concurrency.lockutils [None req-f99c337c-d1df-41ec-838a-ab8fa5c87922 admin admin] Lock "1daf4f4c-0e4a-4779-b53a-78c48397ea2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=105512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 17:59:45.397883 dv-cinder-852009-8-iscsi devstack@n-api.service[105512]: DEBUG oslo_concurrency.lockutils [None req-f99c337c-d1df-41ec-838a-ab8fa5c87922 admin admin] Lock "1daf4f4c-0e4a-4779-b53a-78c48397ea2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=105512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 17:59:45.417390 dv-cinder-852009-8-iscsi devstack@n-api.service[105512]: INFO nova.api.openstack.requestlog [None req-f99c337c-d1df-41ec-838a-ab8fa5c87922 admin admin] 10.222.0.43 "GET /compute/v2.1/os-services" status: 200 len: 791 microversion: 2.92 time: 0.086410 Sep 13 17:59:45.417955 dv-cinder-852009-8-iscsi devstack@n-api.service[105512]: [pid: 105512|app: 0|req: 37/72] 10.222.0.43 () {60 vars in 1193 bytes} [Tue Sep 13 17:59:45 2022] GET /compute/v2.1/os-services => generated 791 bytes in 88 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Sep 13 17:59:56.931142 dv-cinder-852009-8-iscsi devstack@n-api.service[105513]: DEBUG nova.api.openstack.wsgi [None req-4df360a4-f02e-43d0-8f6a-7a57d422e60a admin admin] Calling method '>' {{(pid=105513) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 17:59:56.932157 dv-cinder-852009-8-iscsi devstack@n-api.service[105513]: INFO nova.api.openstack.requestlog [None req-4df360a4-f02e-43d0-8f6a-7a57d422e60a admin admin] 10.222.0.43 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001550 Sep 13 17:59:56.932581 dv-cinder-852009-8-iscsi devstack@n-api.service[105513]: [pid: 105513|app: 0|req: 36/73] 10.222.0.43 () {56 vars in 1074 bytes} [Tue Sep 13 17:59:56 2022] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 13 17:59:57.079025 dv-cinder-852009-8-iscsi devstack@n-api.service[105512]: DEBUG dbcounter [-] [105512] Writing DB stats nova_cell0:SELECT=4 {{(pid=105512) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 17:59:57.079751 dv-cinder-852009-8-iscsi devstack@n-api.service[105512]: DEBUG dbcounter [-] [105512] Writing DB stats nova_cell1:SELECT=4 {{(pid=105512) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 17:59:57.080402 dv-cinder-852009-8-iscsi devstack@n-api.service[105512]: DEBUG dbcounter [-] [105512] Writing DB stats nova_api:SELECT=8 {{(pid=105512) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 17:59:57.127227 dv-cinder-852009-8-iscsi devstack@n-api.service[105512]: DEBUG nova.api.openstack.wsgi [None req-79571ac0-0b10-4743-94c3-fdda15836a0d admin admin] Calling method '>' {{(pid=105512) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 17:59:57.131022 dv-cinder-852009-8-iscsi devstack@n-api.service[105512]: DEBUG oslo_concurrency.lockutils [None req-79571ac0-0b10-4743-94c3-fdda15836a0d admin admin] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=105512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 17:59:57.131498 dv-cinder-852009-8-iscsi devstack@n-api.service[105512]: DEBUG oslo_concurrency.lockutils [None req-79571ac0-0b10-4743-94c3-fdda15836a0d admin admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=105512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 17:59:57.131935 dv-cinder-852009-8-iscsi devstack@n-api.service[105512]: DEBUG oslo_concurrency.lockutils [None req-79571ac0-0b10-4743-94c3-fdda15836a0d admin admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=105512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 17:59:57.132687 dv-cinder-852009-8-iscsi devstack@n-api.service[105512]: DEBUG oslo_concurrency.lockutils [None req-79571ac0-0b10-4743-94c3-fdda15836a0d admin admin] Acquiring lock "1daf4f4c-0e4a-4779-b53a-78c48397ea2f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=105512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 17:59:57.133133 dv-cinder-852009-8-iscsi devstack@n-api.service[105512]: DEBUG oslo_concurrency.lockutils [None req-79571ac0-0b10-4743-94c3-fdda15836a0d admin admin] Lock "1daf4f4c-0e4a-4779-b53a-78c48397ea2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=105512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 17:59:57.133553 dv-cinder-852009-8-iscsi devstack@n-api.service[105512]: DEBUG oslo_concurrency.lockutils [None req-79571ac0-0b10-4743-94c3-fdda15836a0d admin admin] Lock "1daf4f4c-0e4a-4779-b53a-78c48397ea2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=105512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 17:59:57.159115 dv-cinder-852009-8-iscsi devstack@n-api.service[105512]: INFO nova.api.openstack.requestlog [None req-79571ac0-0b10-4743-94c3-fdda15836a0d admin admin] 10.222.0.43 "GET /compute/v2.1/os-services" status: 200 len: 1035 microversion: 2.92 time: 0.087837 Sep 13 17:59:57.159994 dv-cinder-852009-8-iscsi devstack@n-api.service[105512]: [pid: 105512|app: 0|req: 38/74] 10.222.0.43 () {60 vars in 1193 bytes} [Tue Sep 13 17:59:57 2022] GET /compute/v2.1/os-services => generated 1035 bytes in 90 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Sep 13 17:59:58.244883 dv-cinder-852009-8-iscsi devstack@n-api.service[105513]: DEBUG nova.api.openstack.wsgi [None req-4df360a4-f02e-43d0-8f6a-7a57d422e60a admin admin] Calling method '>' {{(pid=105513) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 17:59:58.245918 dv-cinder-852009-8-iscsi devstack@n-api.service[105513]: INFO nova.api.openstack.requestlog [None req-4df360a4-f02e-43d0-8f6a-7a57d422e60a admin admin] 10.222.0.43 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001481 Sep 13 17:59:58.246319 dv-cinder-852009-8-iscsi devstack@n-api.service[105513]: [pid: 105513|app: 0|req: 37/75] 10.222.0.43 () {56 vars in 1074 bytes} [Tue Sep 13 17:59:58 2022] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 13 17:59:58.439998 dv-cinder-852009-8-iscsi devstack@n-api.service[105512]: DEBUG nova.api.openstack.wsgi [None req-731ead83-b5bf-45a9-aaa9-56f9fef94374 admin admin] Calling method '>' {{(pid=105512) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 17:59:58.443409 dv-cinder-852009-8-iscsi devstack@n-api.service[105512]: DEBUG oslo_concurrency.lockutils [None req-731ead83-b5bf-45a9-aaa9-56f9fef94374 admin admin] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=105512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 17:59:58.443872 dv-cinder-852009-8-iscsi devstack@n-api.service[105512]: DEBUG oslo_concurrency.lockutils [None req-731ead83-b5bf-45a9-aaa9-56f9fef94374 admin admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=105512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 17:59:58.444300 dv-cinder-852009-8-iscsi devstack@n-api.service[105512]: DEBUG oslo_concurrency.lockutils [None req-731ead83-b5bf-45a9-aaa9-56f9fef94374 admin admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=105512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 17:59:58.445035 dv-cinder-852009-8-iscsi devstack@n-api.service[105512]: DEBUG oslo_concurrency.lockutils [None req-731ead83-b5bf-45a9-aaa9-56f9fef94374 admin admin] Acquiring lock "1daf4f4c-0e4a-4779-b53a-78c48397ea2f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=105512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 17:59:58.445481 dv-cinder-852009-8-iscsi devstack@n-api.service[105512]: DEBUG oslo_concurrency.lockutils [None req-731ead83-b5bf-45a9-aaa9-56f9fef94374 admin admin] Lock "1daf4f4c-0e4a-4779-b53a-78c48397ea2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=105512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 17:59:58.445895 dv-cinder-852009-8-iscsi devstack@n-api.service[105512]: DEBUG oslo_concurrency.lockutils [None req-731ead83-b5bf-45a9-aaa9-56f9fef94374 admin admin] Lock "1daf4f4c-0e4a-4779-b53a-78c48397ea2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=105512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 17:59:58.467270 dv-cinder-852009-8-iscsi devstack@n-api.service[105512]: INFO nova.api.openstack.requestlog [None req-731ead83-b5bf-45a9-aaa9-56f9fef94374 admin admin] 10.222.0.43 "GET /compute/v2.1/os-services" status: 200 len: 1035 microversion: 2.92 time: 0.080894 Sep 13 17:59:58.467751 dv-cinder-852009-8-iscsi devstack@n-api.service[105512]: [pid: 105512|app: 0|req: 39/76] 10.222.0.43 () {60 vars in 1193 bytes} [Tue Sep 13 17:59:58 2022] GET /compute/v2.1/os-services => generated 1035 bytes in 82 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 13 18:00:54.668768 dv-cinder-852009-8-iscsi devstack@n-api.service[105511]: Tue Sep 13 18:00:54 2022 - graceful shutdown triggered... Sep 13 18:00:54.669312 dv-cinder-852009-8-iscsi devstack@n-api.service[105512]: Gracefully killing worker 1 (pid: 105512)... Sep 13 18:00:54.668911 dv-cinder-852009-8-iscsi systemd[1]: Stopping Devstack devstack@n-api.service... Sep 13 18:00:54.670126 dv-cinder-852009-8-iscsi devstack@n-api.service[105513]: Gracefully killing worker 2 (pid: 105513)... Sep 13 18:00:54.802807 dv-cinder-852009-8-iscsi devstack@n-api.service[105513]: DEBUG dbcounter [-] [105513] Writing DB stats nova_api:SELECT=4 {{(pid=105513) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 18:00:55.670000 dv-cinder-852009-8-iscsi devstack@n-api.service[105511]: worker 1 buried after 1 seconds Sep 13 18:00:55.670000 dv-cinder-852009-8-iscsi devstack@n-api.service[105511]: worker 2 buried after 1 seconds Sep 13 18:00:55.670000 dv-cinder-852009-8-iscsi devstack@n-api.service[105511]: goodbye to uWSGI. Sep 13 18:00:55.671670 dv-cinder-852009-8-iscsi systemd[1]: devstack@n-api.service: Succeeded. Sep 13 18:00:55.672253 dv-cinder-852009-8-iscsi systemd[1]: Stopped Devstack devstack@n-api.service. Sep 13 18:00:55.675189 dv-cinder-852009-8-iscsi systemd[1]: Starting Devstack devstack@n-api.service... Sep 13 18:00:55.686468 dv-cinder-852009-8-iscsi devstack@n-api.service[120722]: [uWSGI] getting INI configuration from /etc/nova/nova-api-uwsgi.ini Sep 13 18:00:55.689178 dv-cinder-852009-8-iscsi devstack@n-api.service[120722]: *** Starting uWSGI 2.0.18-debian (64bit) on [Tue Sep 13 18:00:55 2022] *** Sep 13 18:00:55.690059 dv-cinder-852009-8-iscsi devstack@n-api.service[120722]: compiled with version: 10.0.1 20200405 (experimental) [master revision 0be9efad938:fcb98e4978a:705510a708d3642c9c962beb663c476167e4e8a4] on 11 April 2020 11:15:55 Sep 13 18:00:55.690208 dv-cinder-852009-8-iscsi devstack@n-api.service[120722]: os: Linux-5.4.0-72-generic #80-Ubuntu SMP Mon Apr 12 17:35:00 UTC 2021 Sep 13 18:00:55.690336 dv-cinder-852009-8-iscsi devstack@n-api.service[120722]: nodename: dv-cinder-852009-8-iscsi Sep 13 18:00:55.690450 dv-cinder-852009-8-iscsi devstack@n-api.service[120722]: machine: x86_64 Sep 13 18:00:55.690562 dv-cinder-852009-8-iscsi devstack@n-api.service[120722]: clock source: unix Sep 13 18:00:55.690672 dv-cinder-852009-8-iscsi devstack@n-api.service[120722]: pcre jit disabled Sep 13 18:00:55.690782 dv-cinder-852009-8-iscsi devstack@n-api.service[120722]: detected number of CPU cores: 4 Sep 13 18:00:55.690928 dv-cinder-852009-8-iscsi devstack@n-api.service[120722]: current working directory: / Sep 13 18:00:55.690928 dv-cinder-852009-8-iscsi devstack@n-api.service[120722]: detected binary path: /usr/bin/uwsgi-core Sep 13 18:00:55.690928 dv-cinder-852009-8-iscsi devstack@n-api.service[120722]: your processes number limit is 47680 Sep 13 18:00:55.690928 dv-cinder-852009-8-iscsi devstack@n-api.service[120722]: your memory page size is 4096 bytes Sep 13 18:00:55.690928 dv-cinder-852009-8-iscsi devstack@n-api.service[120722]: detected max file descriptor number: 2048 Sep 13 18:00:55.690928 dv-cinder-852009-8-iscsi devstack@n-api.service[120722]: lock engine: pthread robust mutexes Sep 13 18:00:55.691409 dv-cinder-852009-8-iscsi devstack@n-api.service[120722]: thunder lock: enabled Sep 13 18:00:55.691409 dv-cinder-852009-8-iscsi devstack@n-api.service[120722]: uwsgi socket 0 bound to UNIX address /var/run/uwsgi/nova-api-wsgi.socket fd 4 Sep 13 18:00:55.691409 dv-cinder-852009-8-iscsi devstack@n-api.service[120722]: Python version: 3.8.10 (default, Jun 22 2022, 20:18:18) [GCC 9.4.0] Sep 13 18:00:55.732319 dv-cinder-852009-8-iscsi devstack@n-api.service[120722]: Python main interpreter initialized at 0x55f1401209c0 Sep 13 18:00:55.732319 dv-cinder-852009-8-iscsi devstack@n-api.service[120722]: python threads support enabled Sep 13 18:00:55.732319 dv-cinder-852009-8-iscsi devstack@n-api.service[120722]: your server socket listen backlog is limited to 100 connections Sep 13 18:00:55.732319 dv-cinder-852009-8-iscsi devstack@n-api.service[120722]: your mercy for graceful operations on workers is 90 seconds Sep 13 18:00:55.732738 dv-cinder-852009-8-iscsi devstack@n-api.service[120722]: mapped 403077 bytes (393 KB) for 2 cores Sep 13 18:00:55.732820 dv-cinder-852009-8-iscsi devstack@n-api.service[120722]: *** Operational MODE: preforking *** Sep 13 18:00:55.733097 dv-cinder-852009-8-iscsi devstack@n-api.service[120722]: *** uWSGI is running in multiple interpreter mode *** Sep 13 18:00:55.733097 dv-cinder-852009-8-iscsi devstack@n-api.service[120722]: spawned uWSGI master process (pid: 120722) Sep 13 18:00:55.733301 dv-cinder-852009-8-iscsi systemd[1]: Started Devstack devstack@n-api.service. Sep 13 18:00:55.736531 dv-cinder-852009-8-iscsi devstack@n-api.service[120722]: spawned uWSGI worker 1 (pid: 120740, cores: 1) Sep 13 18:00:55.736531 dv-cinder-852009-8-iscsi devstack@n-api.service[120722]: spawned uWSGI worker 2 (pid: 120741, cores: 1) Sep 13 18:00:55.736860 dv-cinder-852009-8-iscsi devstack@n-api.service[120722]: running "unix_signal:15 gracefully_kill_them_all" (master-start)... Sep 13 18:00:56.399450 dv-cinder-852009-8-iscsi devstack@n-api.service[120740]: Modules with known eventlet monkey patching issues were imported prior to eventlet monkey patching: urllib3. This warning can usually be ignored if the caller is only importing and not executing nova code. Sep 13 18:00:56.408626 dv-cinder-852009-8-iscsi devstack@n-api.service[120741]: Modules with known eventlet monkey patching issues were imported prior to eventlet monkey patching: urllib3. This warning can usually be ignored if the caller is only importing and not executing nova code. Sep 13 18:00:57.552321 dv-cinder-852009-8-iscsi devstack@n-api.service[120741]: /usr/lib/python3/dist-packages/secretstorage/dhcrypto.py:15: CryptographyDeprecationWarning: int_from_bytes is deprecated, use int.from_bytes instead Sep 13 18:00:57.552321 dv-cinder-852009-8-iscsi devstack@n-api.service[120741]: from cryptography.utils import int_from_bytes Sep 13 18:00:57.553165 dv-cinder-852009-8-iscsi devstack@n-api.service[120741]: /usr/lib/python3/dist-packages/secretstorage/util.py:19: CryptographyDeprecationWarning: int_from_bytes is deprecated, use int.from_bytes instead Sep 13 18:00:57.553165 dv-cinder-852009-8-iscsi devstack@n-api.service[120741]: from cryptography.utils import int_from_bytes Sep 13 18:00:57.583662 dv-cinder-852009-8-iscsi devstack@n-api.service[120740]: /usr/lib/python3/dist-packages/secretstorage/dhcrypto.py:15: CryptographyDeprecationWarning: int_from_bytes is deprecated, use int.from_bytes instead Sep 13 18:00:57.583662 dv-cinder-852009-8-iscsi devstack@n-api.service[120740]: from cryptography.utils import int_from_bytes Sep 13 18:00:57.584319 dv-cinder-852009-8-iscsi devstack@n-api.service[120740]: /usr/lib/python3/dist-packages/secretstorage/util.py:19: CryptographyDeprecationWarning: int_from_bytes is deprecated, use int.from_bytes instead Sep 13 18:00:57.584319 dv-cinder-852009-8-iscsi devstack@n-api.service[120740]: from cryptography.utils import int_from_bytes Sep 13 18:00:59.949531 dv-cinder-852009-8-iscsi devstack@n-api.service[120741]: DEBUG nova.api.openstack.wsgi_app [-] ******************************************************************************** {{(pid=120741) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2589}} Sep 13 18:00:59.950136 dv-cinder-852009-8-iscsi devstack@n-api.service[120741]: DEBUG nova.api.openstack.wsgi_app [-] Configuration options gathered from: {{(pid=120741) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2590}} Sep 13 18:00:59.950390 dv-cinder-852009-8-iscsi devstack@n-api.service[120741]: DEBUG nova.api.openstack.wsgi_app [-] command line args: [] {{(pid=120741) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2591}} Sep 13 18:00:59.950732 dv-cinder-852009-8-iscsi devstack@n-api.service[120741]: DEBUG nova.api.openstack.wsgi_app [-] config files: ['/etc/nova/api-paste.ini', '/etc/nova/nova.conf'] {{(pid=120741) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2592}} Sep 13 18:00:59.950993 dv-cinder-852009-8-iscsi devstack@n-api.service[120741]: DEBUG nova.api.openstack.wsgi_app [-] ================================================================================ {{(pid=120741) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2594}} Sep 13 18:00:59.951387 dv-cinder-852009-8-iscsi devstack@n-api.service[120741]: DEBUG nova.api.openstack.wsgi_app [-] allow_resize_to_same_host = True {{(pid=120741) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 13 18:00:59.951724 dv-cinder-852009-8-iscsi devstack@n-api.service[120741]: DEBUG nova.api.openstack.wsgi_app [-] arq_binding_timeout = 300 {{(pid=120741) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 13 18:00:59.952055 dv-cinder-852009-8-iscsi devstack@n-api.service[120741]: DEBUG nova.api.openstack.wsgi_app [-] block_device_allocate_retries = 60 {{(pid=120741) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 13 18:00:59.952384 dv-cinder-852009-8-iscsi devstack@n-api.service[120741]: DEBUG nova.api.openstack.wsgi_app [-] block_device_allocate_retries_interval = 3 {{(pid=120741) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 13 18:00:59.952741 dv-cinder-852009-8-iscsi devstack@n-api.service[120741]: DEBUG nova.api.openstack.wsgi_app [-] cert = self.pem {{(pid=120741) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 13 18:00:59.953073 dv-cinder-852009-8-iscsi devstack@n-api.service[120741]: DEBUG nova.api.openstack.wsgi_app [-] compute_driver = None {{(pid=120741) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 13 18:00:59.953417 dv-cinder-852009-8-iscsi devstack@n-api.service[120741]: DEBUG nova.api.openstack.wsgi_app [-] compute_monitors = [] {{(pid=120741) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 13 18:00:59.953740 dv-cinder-852009-8-iscsi devstack@n-api.service[120741]: DEBUG nova.api.openstack.wsgi_app [-] config_dir = [] {{(pid=120741) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 13 18:00:59.954074 dv-cinder-852009-8-iscsi devstack@n-api.service[120741]: DEBUG nova.api.openstack.wsgi_app [-] config_drive_format = iso9660 {{(pid=120741) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 13 18:00:59.954334 dv-cinder-852009-8-iscsi devstack@n-api.service[120741]: DEBUG nova.api.openstack.wsgi_app [-] config_file = ['/etc/nova/api-paste.ini', '/etc/nova/nova.conf'] {{(pid=120741) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 13 18:00:59.954653 dv-cinder-852009-8-iscsi devstack@n-api.service[120741]: DEBUG nova.api.openstack.wsgi_app [-] config_source = [] {{(pid=120741) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 13 18:00:59.955158 dv-cinder-852009-8-iscsi devstack@n-api.service[120741]: DEBUG nova.api.openstack.wsgi_app [-] console_host = dv-cinder-852009-8-iscsi {{(pid=120741) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 13 18:00:59.955495 dv-cinder-852009-8-iscsi devstack@n-api.service[120741]: DEBUG nova.api.openstack.wsgi_app [-] control_exchange = nova {{(pid=120741) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 13 18:00:59.955808 dv-cinder-852009-8-iscsi devstack@n-api.service[120741]: DEBUG nova.api.openstack.wsgi_app [-] cpu_allocation_ratio = None {{(pid=120741) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 13 18:00:59.956121 dv-cinder-852009-8-iscsi devstack@n-api.service[120741]: DEBUG nova.api.openstack.wsgi_app [-] daemon = False {{(pid=120741) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 13 18:00:59.956467 dv-cinder-852009-8-iscsi devstack@n-api.service[120741]: DEBUG nova.api.openstack.wsgi_app [-] debug = True {{(pid=120741) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 13 18:00:59.956775 dv-cinder-852009-8-iscsi devstack@n-api.service[120741]: DEBUG nova.api.openstack.wsgi_app [-] default_access_ip_network_name = None {{(pid=120741) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 13 18:00:59.957110 dv-cinder-852009-8-iscsi devstack@n-api.service[120741]: DEBUG nova.api.openstack.wsgi_app [-] default_availability_zone = nova {{(pid=120741) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 13 18:00:59.957425 dv-cinder-852009-8-iscsi devstack@n-api.service[120741]: DEBUG nova.api.openstack.wsgi_app [-] default_ephemeral_format = None {{(pid=120741) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 13 18:00:59.957927 dv-cinder-852009-8-iscsi devstack@n-api.service[120741]: DEBUG nova.api.openstack.wsgi_app [-] default_log_levels = ['amqp=WARN', 'amqplib=WARN', 'boto=WARN', 'qpid=WARN', 'sqlalchemy=WARN', 'suds=INFO', 'oslo.messaging=INFO', 'oslo_messaging=INFO', 'iso8601=WARN', 'requests.packages.urllib3.connectionpool=WARN', 'urllib3.connectionpool=WARN', 'websocket=WARN', 'requests.packages.urllib3.util.retry=WARN', 'urllib3.util.retry=WARN', 'keystonemiddleware=WARN', 'routes.middleware=WARN', 'stevedore=WARN', 'taskflow=WARN', 'keystoneauth=WARN', 'oslo.cache=INFO', 'oslo_policy=INFO', 'dogpile.core.dogpile=INFO', 'glanceclient=WARN', 'oslo.privsep.daemon=INFO'] {{(pid=120741) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 13 18:00:59.959470 dv-cinder-852009-8-iscsi devstack@n-api.service[120741]: DEBUG nova.api.openstack.wsgi_app [-] default_schedule_zone = None {{(pid=120741) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 13 18:00:59.959470 dv-cinder-852009-8-iscsi devstack@n-api.service[120741]: DEBUG nova.api.openstack.wsgi_app [-] disk_allocation_ratio = None {{(pid=120741) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 13 18:00:59.959470 dv-cinder-852009-8-iscsi devstack@n-api.service[120741]: DEBUG nova.api.openstack.wsgi_app [-] enable_new_services = True {{(pid=120741) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 13 18:00:59.959777 dv-cinder-852009-8-iscsi devstack@n-api.service[120741]: DEBUG nova.api.openstack.wsgi_app [-] enabled_apis = ['osapi_compute'] {{(pid=120741) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 13 18:00:59.960019 dv-cinder-852009-8-iscsi devstack@n-api.service[120741]: DEBUG nova.api.openstack.wsgi_app [-] enabled_ssl_apis = [] {{(pid=120741) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 13 18:00:59.960334 dv-cinder-852009-8-iscsi devstack@n-api.service[120741]: DEBUG nova.api.openstack.wsgi_app [-] flat_injected = False {{(pid=120741) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 13 18:00:59.960706 dv-cinder-852009-8-iscsi devstack@n-api.service[120741]: DEBUG nova.api.openstack.wsgi_app [-] force_config_drive = True {{(pid=120741) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 13 18:00:59.961032 dv-cinder-852009-8-iscsi devstack@n-api.service[120741]: DEBUG nova.api.openstack.wsgi_app [-] force_raw_images = True {{(pid=120741) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 13 18:00:59.961378 dv-cinder-852009-8-iscsi devstack@n-api.service[120741]: DEBUG nova.api.openstack.wsgi_app [-] graceful_shutdown_timeout = 5 {{(pid=120741) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 13 18:00:59.961686 dv-cinder-852009-8-iscsi devstack@n-api.service[120741]: DEBUG nova.api.openstack.wsgi_app [-] heal_instance_info_cache_interval = 60 {{(pid=120741) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 13 18:00:59.962080 dv-cinder-852009-8-iscsi devstack@n-api.service[120741]: DEBUG nova.api.openstack.wsgi_app [-] host = dv-cinder-852009-8-iscsi {{(pid=120741) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 13 18:00:59.962404 dv-cinder-852009-8-iscsi devstack@n-api.service[120741]: DEBUG nova.api.openstack.wsgi_app [-] initial_cpu_allocation_ratio = 16.0 {{(pid=120741) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 13 18:00:59.962737 dv-cinder-852009-8-iscsi devstack@n-api.service[120741]: DEBUG nova.api.openstack.wsgi_app [-] initial_disk_allocation_ratio = 1.0 {{(pid=120741) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 13 18:00:59.963040 dv-cinder-852009-8-iscsi devstack@n-api.service[120741]: DEBUG nova.api.openstack.wsgi_app [-] initial_ram_allocation_ratio = 1.5 {{(pid=120741) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 13 18:00:59.963485 dv-cinder-852009-8-iscsi devstack@n-api.service[120741]: DEBUG nova.api.openstack.wsgi_app [-] injected_network_template = /opt/stack/nova/nova/virt/interfaces.template {{(pid=120741) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 13 18:00:59.963789 dv-cinder-852009-8-iscsi devstack@n-api.service[120741]: DEBUG nova.api.openstack.wsgi_app [-] instance_build_timeout = 0 {{(pid=120741) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 13 18:00:59.964107 dv-cinder-852009-8-iscsi devstack@n-api.service[120741]: DEBUG nova.api.openstack.wsgi_app [-] instance_delete_interval = 300 {{(pid=120741) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 13 18:00:59.964445 dv-cinder-852009-8-iscsi devstack@n-api.service[120741]: DEBUG nova.api.openstack.wsgi_app [-] instance_format = [instance: %(uuid)s] {{(pid=120741) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 13 18:00:59.964796 dv-cinder-852009-8-iscsi devstack@n-api.service[120741]: DEBUG nova.api.openstack.wsgi_app [-] instance_name_template = instance-%08x {{(pid=120741) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 13 18:00:59.965109 dv-cinder-852009-8-iscsi devstack@n-api.service[120741]: DEBUG nova.api.openstack.wsgi_app [-] instance_usage_audit = False {{(pid=120741) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 13 18:00:59.965438 dv-cinder-852009-8-iscsi devstack@n-api.service[120741]: DEBUG nova.api.openstack.wsgi_app [-] instance_usage_audit_period = month {{(pid=120741) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 13 18:00:59.965767 dv-cinder-852009-8-iscsi devstack@n-api.service[120741]: DEBUG nova.api.openstack.wsgi_app [-] instance_uuid_format = [instance: %(uuid)s] {{(pid=120741) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 13 18:00:59.966114 dv-cinder-852009-8-iscsi devstack@n-api.service[120741]: DEBUG nova.api.openstack.wsgi_app [-] instances_path = /opt/stack/data/nova/instances {{(pid=120741) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 13 18:00:59.966459 dv-cinder-852009-8-iscsi devstack@n-api.service[120741]: DEBUG nova.api.openstack.wsgi_app [-] internal_service_availability_zone = internal {{(pid=120741) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 13 18:00:59.966727 dv-cinder-852009-8-iscsi devstack@n-api.service[120741]: DEBUG nova.api.openstack.wsgi_app [-] key = None {{(pid=120741) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 13 18:00:59.967089 dv-cinder-852009-8-iscsi devstack@n-api.service[120741]: DEBUG nova.api.openstack.wsgi_app [-] live_migration_retry_count = 30 {{(pid=120741) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 13 18:00:59.967372 dv-cinder-852009-8-iscsi devstack@n-api.service[120741]: DEBUG nova.api.openstack.wsgi_app [-] log_config_append = None {{(pid=120741) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 13 18:00:59.967703 dv-cinder-852009-8-iscsi devstack@n-api.service[120741]: DEBUG nova.api.openstack.wsgi_app [-] log_date_format = %Y-%m-%d %H:%M:%S {{(pid=120741) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 13 18:00:59.968020 dv-cinder-852009-8-iscsi devstack@n-api.service[120741]: DEBUG nova.api.openstack.wsgi_app [-] log_dir = None {{(pid=120741) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 13 18:00:59.968322 dv-cinder-852009-8-iscsi devstack@n-api.service[120741]: DEBUG nova.api.openstack.wsgi_app [-] log_file = None {{(pid=120741) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 13 18:00:59.968604 dv-cinder-852009-8-iscsi devstack@n-api.service[120741]: DEBUG nova.api.openstack.wsgi_app [-] log_options = True {{(pid=120741) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 13 18:00:59.968924 dv-cinder-852009-8-iscsi devstack@n-api.service[120741]: DEBUG nova.api.openstack.wsgi_app [-] log_rotate_interval = 1 {{(pid=120741) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 13 18:00:59.969261 dv-cinder-852009-8-iscsi devstack@n-api.service[120741]: DEBUG nova.api.openstack.wsgi_app [-] log_rotate_interval_type = days {{(pid=120741) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 13 18:00:59.969580 dv-cinder-852009-8-iscsi devstack@n-api.service[120741]: DEBUG nova.api.openstack.wsgi_app [-] log_rotation_type = none {{(pid=120741) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 13 18:00:59.969913 dv-cinder-852009-8-iscsi devstack@n-api.service[120741]: DEBUG nova.api.openstack.wsgi_app [-] logging_context_format_string = %(color)s%(levelname)s %(name)s [%(global_request_id)s %(request_id)s %(project_name)s %(user_name)s%(color)s] %(instance)s%(color)s%(message)s {{(pid=120741) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 13 18:00:59.970169 dv-cinder-852009-8-iscsi devstack@n-api.service[120741]: DEBUG nova.api.openstack.wsgi_app [-] logging_debug_format_suffix = {{(pid=%(process)d) %(funcName)s %(pathname)s:%(lineno)d}} {{(pid=120741) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 13 18:00:59.970409 dv-cinder-852009-8-iscsi devstack@n-api.service[120741]: DEBUG nova.api.openstack.wsgi_app [-] logging_default_format_string = %(color)s%(levelname)s %(name)s [-%(color)s] %(instance)s%(color)s%(message)s {{(pid=120741) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 13 18:00:59.970749 dv-cinder-852009-8-iscsi devstack@n-api.service[120741]: DEBUG nova.api.openstack.wsgi_app [-] logging_exception_prefix = ERROR %(name)s %(instance)s {{(pid=120741) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 13 18:00:59.971073 dv-cinder-852009-8-iscsi devstack@n-api.service[120741]: DEBUG nova.api.openstack.wsgi_app [-] logging_user_identity_format = %(user)s %(project)s %(domain)s %(system_scope)s %(user_domain)s %(project_domain)s {{(pid=120741) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 13 18:00:59.971370 dv-cinder-852009-8-iscsi devstack@n-api.service[120741]: DEBUG nova.api.openstack.wsgi_app [-] long_rpc_timeout = 1800 {{(pid=120741) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 13 18:00:59.971693 dv-cinder-852009-8-iscsi devstack@n-api.service[120741]: DEBUG nova.api.openstack.wsgi_app [-] max_concurrent_builds = 10 {{(pid=120741) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 13 18:00:59.972013 dv-cinder-852009-8-iscsi devstack@n-api.service[120741]: DEBUG nova.api.openstack.wsgi_app [-] max_concurrent_live_migrations = 1 {{(pid=120741) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 13 18:00:59.972322 dv-cinder-852009-8-iscsi devstack@n-api.service[120741]: DEBUG nova.api.openstack.wsgi_app [-] max_concurrent_snapshots = 5 {{(pid=120741) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 13 18:00:59.972701 dv-cinder-852009-8-iscsi devstack@n-api.service[120741]: DEBUG nova.api.openstack.wsgi_app [-] max_local_block_devices = 3 {{(pid=120741) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 13 18:00:59.972965 dv-cinder-852009-8-iscsi devstack@n-api.service[120741]: DEBUG nova.api.openstack.wsgi_app [-] max_logfile_count = 30 {{(pid=120741) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 13 18:00:59.973297 dv-cinder-852009-8-iscsi devstack@n-api.service[120741]: DEBUG nova.api.openstack.wsgi_app [-] max_logfile_size_mb = 200 {{(pid=120741) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 13 18:00:59.973603 dv-cinder-852009-8-iscsi devstack@n-api.service[120741]: DEBUG nova.api.openstack.wsgi_app [-] maximum_instance_delete_attempts = 5 {{(pid=120741) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 13 18:00:59.973980 dv-cinder-852009-8-iscsi devstack@n-api.service[120741]: DEBUG nova.api.openstack.wsgi_app [-] metadata_listen = 0.0.0.0 {{(pid=120741) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 13 18:00:59.974369 dv-cinder-852009-8-iscsi devstack@n-api.service[120741]: DEBUG nova.api.openstack.wsgi_app [-] metadata_listen_port = 8775 {{(pid=120741) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 13 18:00:59.974649 dv-cinder-852009-8-iscsi devstack@n-api.service[120741]: DEBUG nova.api.openstack.wsgi_app [-] metadata_workers = 2 {{(pid=120741) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 13 18:00:59.974960 dv-cinder-852009-8-iscsi devstack@n-api.service[120741]: DEBUG nova.api.openstack.wsgi_app [-] migrate_max_retries = -1 {{(pid=120741) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 13 18:00:59.975282 dv-cinder-852009-8-iscsi devstack@n-api.service[120741]: DEBUG nova.api.openstack.wsgi_app [-] mkisofs_cmd = genisoimage {{(pid=120741) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 13 18:00:59.975673 dv-cinder-852009-8-iscsi devstack@n-api.service[120741]: DEBUG nova.api.openstack.wsgi_app [-] my_block_storage_ip = 10.222.0.43 {{(pid=120741) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 13 18:00:59.975932 dv-cinder-852009-8-iscsi devstack@n-api.service[120741]: DEBUG nova.api.openstack.wsgi_app [-] my_ip = 10.222.0.43 {{(pid=120741) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 13 18:00:59.976239 dv-cinder-852009-8-iscsi devstack@n-api.service[120741]: DEBUG nova.api.openstack.wsgi_app [-] network_allocate_retries = 0 {{(pid=120741) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 13 18:00:59.976617 dv-cinder-852009-8-iscsi devstack@n-api.service[120741]: DEBUG nova.api.openstack.wsgi_app [-] non_inheritable_image_properties = ['cache_in_nova', 'bittorrent'] {{(pid=120741) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 13 18:00:59.976941 dv-cinder-852009-8-iscsi devstack@n-api.service[120741]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_listen = 0.0.0.0 {{(pid=120741) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 13 18:00:59.977254 dv-cinder-852009-8-iscsi devstack@n-api.service[120741]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_listen_port = 8774 {{(pid=120741) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 13 18:00:59.977576 dv-cinder-852009-8-iscsi devstack@n-api.service[120741]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_unique_server_name_scope = {{(pid=120741) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 13 18:00:59.977897 dv-cinder-852009-8-iscsi devstack@n-api.service[120741]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_workers = 2 {{(pid=120741) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 13 18:00:59.978209 dv-cinder-852009-8-iscsi devstack@n-api.service[120741]: DEBUG nova.api.openstack.wsgi_app [-] password_length = 12 {{(pid=120741) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 13 18:00:59.978520 dv-cinder-852009-8-iscsi devstack@n-api.service[120741]: DEBUG nova.api.openstack.wsgi_app [-] periodic_enable = True {{(pid=120741) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 13 18:00:59.978829 dv-cinder-852009-8-iscsi devstack@n-api.service[120741]: DEBUG nova.api.openstack.wsgi_app [-] periodic_fuzzy_delay = 60 {{(pid=120741) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 13 18:00:59.979157 dv-cinder-852009-8-iscsi devstack@n-api.service[120741]: DEBUG nova.api.openstack.wsgi_app [-] pointer_model = usbtablet {{(pid=120741) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 13 18:00:59.979478 dv-cinder-852009-8-iscsi devstack@n-api.service[120741]: DEBUG nova.api.openstack.wsgi_app [-] preallocate_images = none {{(pid=120741) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 13 18:00:59.979789 dv-cinder-852009-8-iscsi devstack@n-api.service[120741]: DEBUG nova.api.openstack.wsgi_app [-] publish_errors = False {{(pid=120741) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 13 18:00:59.980040 dv-cinder-852009-8-iscsi devstack@n-api.service[120741]: DEBUG nova.api.openstack.wsgi_app [-] pybasedir = /opt/stack/nova {{(pid=120741) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 13 18:00:59.980345 dv-cinder-852009-8-iscsi devstack@n-api.service[120741]: DEBUG nova.api.openstack.wsgi_app [-] ram_allocation_ratio = None {{(pid=120741) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 13 18:00:59.980680 dv-cinder-852009-8-iscsi devstack@n-api.service[120741]: DEBUG nova.api.openstack.wsgi_app [-] rate_limit_burst = 0 {{(pid=120741) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 13 18:00:59.981006 dv-cinder-852009-8-iscsi devstack@n-api.service[120741]: DEBUG nova.api.openstack.wsgi_app [-] rate_limit_except_level = CRITICAL {{(pid=120741) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 13 18:00:59.981315 dv-cinder-852009-8-iscsi devstack@n-api.service[120741]: DEBUG nova.api.openstack.wsgi_app [-] rate_limit_interval = 0 {{(pid=120741) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 13 18:00:59.981622 dv-cinder-852009-8-iscsi devstack@n-api.service[120741]: DEBUG nova.api.openstack.wsgi_app [-] reboot_timeout = 0 {{(pid=120741) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 13 18:00:59.981933 dv-cinder-852009-8-iscsi devstack@n-api.service[120741]: DEBUG nova.api.openstack.wsgi_app [-] reclaim_instance_interval = 0 {{(pid=120741) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 13 18:00:59.982234 dv-cinder-852009-8-iscsi devstack@n-api.service[120741]: DEBUG nova.api.openstack.wsgi_app [-] record = None {{(pid=120741) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 13 18:00:59.982378 dv-cinder-852009-8-iscsi devstack@n-api.service[120740]: DEBUG nova.api.openstack.wsgi_app [-] ******************************************************************************** {{(pid=120740) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2589}} Sep 13 18:00:59.982880 dv-cinder-852009-8-iscsi devstack@n-api.service[120741]: DEBUG nova.api.openstack.wsgi_app [-] reimage_timeout_per_gb = 20 {{(pid=120741) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 13 18:00:59.983031 dv-cinder-852009-8-iscsi devstack@n-api.service[120740]: DEBUG nova.api.openstack.wsgi_app [-] Configuration options gathered from: {{(pid=120740) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2590}} Sep 13 18:00:59.983184 dv-cinder-852009-8-iscsi devstack@n-api.service[120741]: DEBUG nova.api.openstack.wsgi_app [-] report_interval = 10 {{(pid=120741) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 13 18:00:59.983184 dv-cinder-852009-8-iscsi devstack@n-api.service[120741]: DEBUG nova.api.openstack.wsgi_app [-] rescue_timeout = 0 {{(pid=120741) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 13 18:00:59.983484 dv-cinder-852009-8-iscsi devstack@n-api.service[120740]: DEBUG nova.api.openstack.wsgi_app [-] command line args: [] {{(pid=120740) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2591}} Sep 13 18:00:59.983646 dv-cinder-852009-8-iscsi devstack@n-api.service[120741]: DEBUG nova.api.openstack.wsgi_app [-] reserved_host_cpus = 0 {{(pid=120741) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 13 18:00:59.983800 dv-cinder-852009-8-iscsi devstack@n-api.service[120740]: DEBUG nova.api.openstack.wsgi_app [-] config files: ['/etc/nova/api-paste.ini', '/etc/nova/nova.conf'] {{(pid=120740) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2592}} Sep 13 18:00:59.983965 dv-cinder-852009-8-iscsi devstack@n-api.service[120741]: DEBUG nova.api.openstack.wsgi_app [-] reserved_host_disk_mb = 0 {{(pid=120741) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 13 18:00:59.984109 dv-cinder-852009-8-iscsi devstack@n-api.service[120740]: DEBUG nova.api.openstack.wsgi_app [-] ================================================================================ {{(pid=120740) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2594}} Sep 13 18:00:59.984268 dv-cinder-852009-8-iscsi devstack@n-api.service[120741]: DEBUG nova.api.openstack.wsgi_app [-] reserved_host_memory_mb = 512 {{(pid=120741) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 13 18:00:59.984452 dv-cinder-852009-8-iscsi devstack@n-api.service[120740]: DEBUG nova.api.openstack.wsgi_app [-] allow_resize_to_same_host = True {{(pid=120740) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 13 18:00:59.984614 dv-cinder-852009-8-iscsi devstack@n-api.service[120741]: DEBUG nova.api.openstack.wsgi_app [-] reserved_huge_pages = None {{(pid=120741) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 13 18:00:59.984767 dv-cinder-852009-8-iscsi devstack@n-api.service[120740]: DEBUG nova.api.openstack.wsgi_app [-] arq_binding_timeout = 300 {{(pid=120740) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 13 18:00:59.984920 dv-cinder-852009-8-iscsi devstack@n-api.service[120741]: DEBUG nova.api.openstack.wsgi_app [-] resize_confirm_window = 0 {{(pid=120741) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 13 18:00:59.985068 dv-cinder-852009-8-iscsi devstack@n-api.service[120740]: DEBUG nova.api.openstack.wsgi_app [-] block_device_allocate_retries = 60 {{(pid=120740) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 13 18:00:59.985218 dv-cinder-852009-8-iscsi devstack@n-api.service[120741]: DEBUG nova.api.openstack.wsgi_app [-] resize_fs_using_block_device = False {{(pid=120741) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 13 18:00:59.985359 dv-cinder-852009-8-iscsi devstack@n-api.service[120740]: DEBUG nova.api.openstack.wsgi_app [-] block_device_allocate_retries_interval = 3 {{(pid=120740) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 13 18:00:59.985512 dv-cinder-852009-8-iscsi devstack@n-api.service[120741]: DEBUG nova.api.openstack.wsgi_app [-] resume_guests_state_on_host_boot = False {{(pid=120741) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 13 18:00:59.985669 dv-cinder-852009-8-iscsi devstack@n-api.service[120740]: DEBUG nova.api.openstack.wsgi_app [-] cert = self.pem {{(pid=120740) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 13 18:00:59.985821 dv-cinder-852009-8-iscsi devstack@n-api.service[120741]: DEBUG nova.api.openstack.wsgi_app [-] rootwrap_config = /etc/nova/rootwrap.conf {{(pid=120741) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 13 18:00:59.985991 dv-cinder-852009-8-iscsi devstack@n-api.service[120740]: DEBUG nova.api.openstack.wsgi_app [-] compute_driver = None {{(pid=120740) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 13 18:00:59.986137 dv-cinder-852009-8-iscsi devstack@n-api.service[120741]: DEBUG nova.api.openstack.wsgi_app [-] running_deleted_instance_action = reap {{(pid=120741) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 13 18:00:59.986287 dv-cinder-852009-8-iscsi devstack@n-api.service[120740]: DEBUG nova.api.openstack.wsgi_app [-] compute_monitors = [] {{(pid=120740) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 13 18:00:59.986437 dv-cinder-852009-8-iscsi devstack@n-api.service[120741]: DEBUG nova.api.openstack.wsgi_app [-] running_deleted_instance_poll_interval = 1800 {{(pid=120741) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 13 18:00:59.986585 dv-cinder-852009-8-iscsi devstack@n-api.service[120740]: DEBUG nova.api.openstack.wsgi_app [-] config_dir = [] {{(pid=120740) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 13 18:00:59.986733 dv-cinder-852009-8-iscsi devstack@n-api.service[120741]: DEBUG nova.api.openstack.wsgi_app [-] running_deleted_instance_timeout = 0 {{(pid=120741) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 13 18:00:59.986875 dv-cinder-852009-8-iscsi devstack@n-api.service[120740]: DEBUG nova.api.openstack.wsgi_app [-] config_drive_format = iso9660 {{(pid=120740) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 13 18:00:59.987045 dv-cinder-852009-8-iscsi devstack@n-api.service[120741]: DEBUG nova.api.openstack.wsgi_app [-] scheduler_instance_sync_interval = 120 {{(pid=120741) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 13 18:00:59.987194 dv-cinder-852009-8-iscsi devstack@n-api.service[120740]: DEBUG nova.api.openstack.wsgi_app [-] config_file = ['/etc/nova/api-paste.ini', '/etc/nova/nova.conf'] {{(pid=120740) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 13 18:00:59.987353 dv-cinder-852009-8-iscsi devstack@n-api.service[120741]: DEBUG nova.api.openstack.wsgi_app [-] service_down_time = 60 {{(pid=120741) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 13 18:00:59.987505 dv-cinder-852009-8-iscsi devstack@n-api.service[120740]: DEBUG nova.api.openstack.wsgi_app [-] config_source = [] {{(pid=120740) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 13 18:00:59.987678 dv-cinder-852009-8-iscsi devstack@n-api.service[120741]: DEBUG nova.api.openstack.wsgi_app [-] servicegroup_driver = db {{(pid=120741) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 13 18:00:59.987840 dv-cinder-852009-8-iscsi devstack@n-api.service[120740]: DEBUG nova.api.openstack.wsgi_app [-] console_host = dv-cinder-852009-8-iscsi {{(pid=120740) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 13 18:00:59.987982 dv-cinder-852009-8-iscsi devstack@n-api.service[120741]: DEBUG nova.api.openstack.wsgi_app [-] shelved_offload_time = 0 {{(pid=120741) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 13 18:00:59.987982 dv-cinder-852009-8-iscsi devstack@n-api.service[120741]: DEBUG nova.api.openstack.wsgi_app [-] shelved_poll_interval = 3600 {{(pid=120741) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 13 18:00:59.988263 dv-cinder-852009-8-iscsi devstack@n-api.service[120740]: DEBUG nova.api.openstack.wsgi_app [-] control_exchange = nova {{(pid=120740) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 13 18:00:59.988263 dv-cinder-852009-8-iscsi devstack@n-api.service[120740]: DEBUG nova.api.openstack.wsgi_app [-] cpu_allocation_ratio = None {{(pid=120740) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 13 18:00:59.988590 dv-cinder-852009-8-iscsi devstack@n-api.service[120741]: DEBUG nova.api.openstack.wsgi_app [-] shutdown_timeout = 0 {{(pid=120741) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 13 18:00:59.988590 dv-cinder-852009-8-iscsi devstack@n-api.service[120741]: DEBUG nova.api.openstack.wsgi_app [-] source_is_ipv6 = False {{(pid=120741) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 13 18:00:59.988874 dv-cinder-852009-8-iscsi devstack@n-api.service[120740]: DEBUG nova.api.openstack.wsgi_app [-] daemon = False {{(pid=120740) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 13 18:00:59.989016 dv-cinder-852009-8-iscsi devstack@n-api.service[120741]: DEBUG nova.api.openstack.wsgi_app [-] ssl_only = False {{(pid=120741) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 13 18:00:59.989163 dv-cinder-852009-8-iscsi devstack@n-api.service[120740]: DEBUG nova.api.openstack.wsgi_app [-] debug = True {{(pid=120740) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 13 18:00:59.989163 dv-cinder-852009-8-iscsi devstack@n-api.service[120740]: DEBUG nova.api.openstack.wsgi_app [-] default_access_ip_network_name = None {{(pid=120740) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 13 18:00:59.989446 dv-cinder-852009-8-iscsi devstack@n-api.service[120741]: DEBUG nova.api.openstack.wsgi_app [-] state_path = /opt/stack/data/nova {{(pid=120741) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 13 18:00:59.989446 dv-cinder-852009-8-iscsi devstack@n-api.service[120741]: DEBUG nova.api.openstack.wsgi_app [-] sync_power_state_interval = 600 {{(pid=120741) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 13 18:00:59.989848 dv-cinder-852009-8-iscsi devstack@n-api.service[120740]: DEBUG nova.api.openstack.wsgi_app [-] default_availability_zone = nova {{(pid=120740) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 13 18:00:59.990495 dv-cinder-852009-8-iscsi devstack@n-api.service[120741]: DEBUG nova.api.openstack.wsgi_app [-] sync_power_state_pool_size = 1000 {{(pid=120741) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 13 18:00:59.990645 dv-cinder-852009-8-iscsi devstack@n-api.service[120740]: DEBUG nova.api.openstack.wsgi_app [-] default_ephemeral_format = None {{(pid=120740) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 13 18:00:59.990801 dv-cinder-852009-8-iscsi devstack@n-api.service[120741]: DEBUG nova.api.openstack.wsgi_app [-] syslog_log_facility = LOG_USER {{(pid=120741) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 13 18:00:59.990801 dv-cinder-852009-8-iscsi devstack@n-api.service[120741]: DEBUG nova.api.openstack.wsgi_app [-] tempdir = None {{(pid=120741) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 13 18:00:59.991090 dv-cinder-852009-8-iscsi devstack@n-api.service[120740]: DEBUG nova.api.openstack.wsgi_app [-] default_log_levels = ['amqp=WARN', 'amqplib=WARN', 'boto=WARN', 'qpid=WARN', 'sqlalchemy=WARN', 'suds=INFO', 'oslo.messaging=INFO', 'oslo_messaging=INFO', 'iso8601=WARN', 'requests.packages.urllib3.connectionpool=WARN', 'urllib3.connectionpool=WARN', 'websocket=WARN', 'requests.packages.urllib3.util.retry=WARN', 'urllib3.util.retry=WARN', 'keystonemiddleware=WARN', 'routes.middleware=WARN', 'stevedore=WARN', 'taskflow=WARN', 'keystoneauth=WARN', 'oslo.cache=INFO', 'oslo_policy=INFO', 'dogpile.core.dogpile=INFO', 'glanceclient=WARN', 'oslo.privsep.daemon=INFO'] {{(pid=120740) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 13 18:00:59.991250 dv-cinder-852009-8-iscsi devstack@n-api.service[120741]: DEBUG nova.api.openstack.wsgi_app [-] timeout_nbd = 10 {{(pid=120741) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 13 18:00:59.991409 dv-cinder-852009-8-iscsi devstack@n-api.service[120740]: DEBUG nova.api.openstack.wsgi_app [-] default_schedule_zone = None {{(pid=120740) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 13 18:00:59.991552 dv-cinder-852009-8-iscsi devstack@n-api.service[120741]: DEBUG nova.api.openstack.wsgi_app [-] transport_url = **** {{(pid=120741) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 13 18:00:59.991703 dv-cinder-852009-8-iscsi devstack@n-api.service[120740]: DEBUG nova.api.openstack.wsgi_app [-] disk_allocation_ratio = None {{(pid=120740) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 13 18:00:59.992080 dv-cinder-852009-8-iscsi devstack@n-api.service[120741]: DEBUG nova.api.openstack.wsgi_app [-] update_resources_interval = 0 {{(pid=120741) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 13 18:00:59.992225 dv-cinder-852009-8-iscsi devstack@n-api.service[120740]: DEBUG nova.api.openstack.wsgi_app [-] enable_new_services = True {{(pid=120740) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 13 18:00:59.992375 dv-cinder-852009-8-iscsi devstack@n-api.service[120741]: DEBUG nova.api.openstack.wsgi_app [-] use_cow_images = True {{(pid=120741) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 13 18:00:59.992656 dv-cinder-852009-8-iscsi devstack@n-api.service[120740]: DEBUG nova.api.openstack.wsgi_app [-] enabled_apis = ['osapi_compute'] {{(pid=120740) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 13 18:00:59.992814 dv-cinder-852009-8-iscsi devstack@n-api.service[120741]: DEBUG nova.api.openstack.wsgi_app [-] use_eventlog = False {{(pid=120741) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 13 18:00:59.992965 dv-cinder-852009-8-iscsi devstack@n-api.service[120740]: DEBUG nova.api.openstack.wsgi_app [-] enabled_ssl_apis = [] {{(pid=120740) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 13 18:00:59.993108 dv-cinder-852009-8-iscsi devstack@n-api.service[120741]: DEBUG nova.api.openstack.wsgi_app [-] use_journal = False {{(pid=120741) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 13 18:00:59.993256 dv-cinder-852009-8-iscsi devstack@n-api.service[120740]: DEBUG nova.api.openstack.wsgi_app [-] flat_injected = False {{(pid=120740) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 13 18:00:59.993408 dv-cinder-852009-8-iscsi devstack@n-api.service[120741]: DEBUG nova.api.openstack.wsgi_app [-] use_json = False {{(pid=120741) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 13 18:00:59.993557 dv-cinder-852009-8-iscsi devstack@n-api.service[120740]: DEBUG nova.api.openstack.wsgi_app [-] force_config_drive = True {{(pid=120740) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 13 18:00:59.993714 dv-cinder-852009-8-iscsi devstack@n-api.service[120741]: DEBUG nova.api.openstack.wsgi_app [-] use_rootwrap_daemon = False {{(pid=120741) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 13 18:00:59.993855 dv-cinder-852009-8-iscsi devstack@n-api.service[120740]: DEBUG nova.api.openstack.wsgi_app [-] force_raw_images = True {{(pid=120740) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 13 18:00:59.994002 dv-cinder-852009-8-iscsi devstack@n-api.service[120741]: DEBUG nova.api.openstack.wsgi_app [-] use_stderr = False {{(pid=120741) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 13 18:00:59.994154 dv-cinder-852009-8-iscsi devstack@n-api.service[120740]: DEBUG nova.api.openstack.wsgi_app [-] graceful_shutdown_timeout = 5 {{(pid=120740) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 13 18:00:59.994295 dv-cinder-852009-8-iscsi devstack@n-api.service[120741]: DEBUG nova.api.openstack.wsgi_app [-] use_syslog = False {{(pid=120741) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 13 18:00:59.994441 dv-cinder-852009-8-iscsi devstack@n-api.service[120740]: DEBUG nova.api.openstack.wsgi_app [-] heal_instance_info_cache_interval = 60 {{(pid=120740) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 13 18:00:59.994672 dv-cinder-852009-8-iscsi devstack@n-api.service[120741]: DEBUG nova.api.openstack.wsgi_app [-] vcpu_pin_set = None {{(pid=120741) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 13 18:00:59.994672 dv-cinder-852009-8-iscsi devstack@n-api.service[120741]: DEBUG nova.api.openstack.wsgi_app [-] vif_plugging_is_fatal = True {{(pid=120741) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 13 18:00:59.994948 dv-cinder-852009-8-iscsi devstack@n-api.service[120740]: DEBUG nova.api.openstack.wsgi_app [-] host = dv-cinder-852009-8-iscsi {{(pid=120740) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 13 18:00:59.995089 dv-cinder-852009-8-iscsi devstack@n-api.service[120741]: DEBUG nova.api.openstack.wsgi_app [-] vif_plugging_timeout = 300 {{(pid=120741) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 13 18:00:59.995236 dv-cinder-852009-8-iscsi devstack@n-api.service[120740]: DEBUG nova.api.openstack.wsgi_app [-] initial_cpu_allocation_ratio = 16.0 {{(pid=120740) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 13 18:00:59.995395 dv-cinder-852009-8-iscsi devstack@n-api.service[120741]: DEBUG nova.api.openstack.wsgi_app [-] virt_mkfs = [] {{(pid=120741) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 13 18:00:59.995536 dv-cinder-852009-8-iscsi devstack@n-api.service[120740]: DEBUG nova.api.openstack.wsgi_app [-] initial_disk_allocation_ratio = 1.0 {{(pid=120740) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 13 18:00:59.995684 dv-cinder-852009-8-iscsi devstack@n-api.service[120741]: DEBUG nova.api.openstack.wsgi_app [-] volume_usage_poll_interval = 0 {{(pid=120741) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 13 18:00:59.995835 dv-cinder-852009-8-iscsi devstack@n-api.service[120740]: DEBUG nova.api.openstack.wsgi_app [-] initial_ram_allocation_ratio = 1.5 {{(pid=120740) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 13 18:00:59.995976 dv-cinder-852009-8-iscsi devstack@n-api.service[120741]: DEBUG nova.api.openstack.wsgi_app [-] watch_log_file = False {{(pid=120741) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 13 18:00:59.996125 dv-cinder-852009-8-iscsi devstack@n-api.service[120740]: DEBUG nova.api.openstack.wsgi_app [-] injected_network_template = /opt/stack/nova/nova/virt/interfaces.template {{(pid=120740) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 13 18:00:59.996281 dv-cinder-852009-8-iscsi devstack@n-api.service[120741]: DEBUG nova.api.openstack.wsgi_app [-] web = /usr/share/spice-html5 {{(pid=120741) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 13 18:00:59.996450 dv-cinder-852009-8-iscsi devstack@n-api.service[120740]: DEBUG nova.api.openstack.wsgi_app [-] instance_build_timeout = 0 {{(pid=120740) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 13 18:00:59.996595 dv-cinder-852009-8-iscsi devstack@n-api.service[120741]: DEBUG nova.api.openstack.wsgi_app [-] oslo_concurrency.disable_process_locking = False {{(pid=120741) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 18:00:59.996736 dv-cinder-852009-8-iscsi devstack@n-api.service[120740]: DEBUG nova.api.openstack.wsgi_app [-] instance_delete_interval = 300 {{(pid=120740) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 13 18:00:59.996876 dv-cinder-852009-8-iscsi devstack@n-api.service[120741]: DEBUG nova.api.openstack.wsgi_app [-] oslo_concurrency.lock_path = /opt/stack/data/nova {{(pid=120741) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 18:00:59.997032 dv-cinder-852009-8-iscsi devstack@n-api.service[120740]: DEBUG nova.api.openstack.wsgi_app [-] instance_format = [instance: %(uuid)s] {{(pid=120740) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 13 18:00:59.997173 dv-cinder-852009-8-iscsi devstack@n-api.service[120741]: DEBUG nova.api.openstack.wsgi_app [-] api.auth_strategy = keystone {{(pid=120741) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 18:00:59.997313 dv-cinder-852009-8-iscsi devstack@n-api.service[120740]: DEBUG nova.api.openstack.wsgi_app [-] instance_name_template = instance-%08x {{(pid=120740) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 13 18:00:59.997453 dv-cinder-852009-8-iscsi devstack@n-api.service[120741]: DEBUG nova.api.openstack.wsgi_app [-] api.compute_link_prefix = None {{(pid=120741) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 18:00:59.997592 dv-cinder-852009-8-iscsi devstack@n-api.service[120740]: DEBUG nova.api.openstack.wsgi_app [-] instance_usage_audit = False {{(pid=120740) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 13 18:00:59.997737 dv-cinder-852009-8-iscsi devstack@n-api.service[120741]: DEBUG nova.api.openstack.wsgi_app [-] api.config_drive_skip_versions = 1.0 2007-01-19 2007-03-01 2007-08-29 2007-10-10 2007-12-15 2008-02-01 2008-09-01 {{(pid=120741) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 18:00:59.997903 dv-cinder-852009-8-iscsi devstack@n-api.service[120740]: DEBUG nova.api.openstack.wsgi_app [-] instance_usage_audit_period = month {{(pid=120740) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 13 18:00:59.998045 dv-cinder-852009-8-iscsi devstack@n-api.service[120741]: DEBUG nova.api.openstack.wsgi_app [-] api.dhcp_domain = novalocal {{(pid=120741) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 18:00:59.998191 dv-cinder-852009-8-iscsi devstack@n-api.service[120740]: DEBUG nova.api.openstack.wsgi_app [-] instance_uuid_format = [instance: %(uuid)s] {{(pid=120740) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 13 18:00:59.998338 dv-cinder-852009-8-iscsi devstack@n-api.service[120741]: DEBUG nova.api.openstack.wsgi_app [-] api.enable_instance_password = True {{(pid=120741) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 18:00:59.998485 dv-cinder-852009-8-iscsi devstack@n-api.service[120740]: DEBUG nova.api.openstack.wsgi_app [-] instances_path = /opt/stack/data/nova/instances {{(pid=120740) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 13 18:00:59.998634 dv-cinder-852009-8-iscsi devstack@n-api.service[120741]: DEBUG nova.api.openstack.wsgi_app [-] api.glance_link_prefix = None {{(pid=120741) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 18:00:59.998784 dv-cinder-852009-8-iscsi devstack@n-api.service[120740]: DEBUG nova.api.openstack.wsgi_app [-] internal_service_availability_zone = internal {{(pid=120740) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 13 18:00:59.998924 dv-cinder-852009-8-iscsi devstack@n-api.service[120741]: DEBUG nova.api.openstack.wsgi_app [-] api.instance_list_cells_batch_fixed_size = 100 {{(pid=120741) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 18:00:59.999071 dv-cinder-852009-8-iscsi devstack@n-api.service[120740]: DEBUG nova.api.openstack.wsgi_app [-] key = None {{(pid=120740) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 13 18:00:59.999213 dv-cinder-852009-8-iscsi devstack@n-api.service[120741]: DEBUG nova.api.openstack.wsgi_app [-] api.instance_list_cells_batch_strategy = distributed {{(pid=120741) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 18:00:59.999370 dv-cinder-852009-8-iscsi devstack@n-api.service[120740]: DEBUG nova.api.openstack.wsgi_app [-] live_migration_retry_count = 30 {{(pid=120740) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 13 18:00:59.999519 dv-cinder-852009-8-iscsi devstack@n-api.service[120741]: DEBUG nova.api.openstack.wsgi_app [-] api.instance_list_per_project_cells = False {{(pid=120741) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 18:00:59.999667 dv-cinder-852009-8-iscsi devstack@n-api.service[120740]: DEBUG nova.api.openstack.wsgi_app [-] log_config_append = None {{(pid=120740) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 13 18:00:59.999825 dv-cinder-852009-8-iscsi devstack@n-api.service[120741]: DEBUG nova.api.openstack.wsgi_app [-] api.list_records_by_skipping_down_cells = True {{(pid=120741) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 18:00:59.999972 dv-cinder-852009-8-iscsi devstack@n-api.service[120740]: DEBUG nova.api.openstack.wsgi_app [-] log_date_format = %Y-%m-%d %H:%M:%S {{(pid=120740) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 13 18:01:00.000789 dv-cinder-852009-8-iscsi devstack@n-api.service[120741]: DEBUG nova.api.openstack.wsgi_app [-] api.local_metadata_per_cell = False {{(pid=120741) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 18:01:00.000952 dv-cinder-852009-8-iscsi devstack@n-api.service[120740]: DEBUG nova.api.openstack.wsgi_app [-] log_dir = None {{(pid=120740) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 13 18:01:00.001118 dv-cinder-852009-8-iscsi devstack@n-api.service[120741]: DEBUG nova.api.openstack.wsgi_app [-] api.max_limit = 1000 {{(pid=120741) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 18:01:00.001269 dv-cinder-852009-8-iscsi devstack@n-api.service[120740]: DEBUG nova.api.openstack.wsgi_app [-] log_file = None {{(pid=120740) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 13 18:01:00.001420 dv-cinder-852009-8-iscsi devstack@n-api.service[120741]: DEBUG nova.api.openstack.wsgi_app [-] api.metadata_cache_expiration = 15 {{(pid=120741) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 18:01:00.001572 dv-cinder-852009-8-iscsi devstack@n-api.service[120740]: DEBUG nova.api.openstack.wsgi_app [-] log_options = True {{(pid=120740) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 13 18:01:00.001572 dv-cinder-852009-8-iscsi devstack@n-api.service[120740]: DEBUG nova.api.openstack.wsgi_app [-] log_rotate_interval = 1 {{(pid=120740) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 13 18:01:00.001918 dv-cinder-852009-8-iscsi devstack@n-api.service[120741]: DEBUG nova.api.openstack.wsgi_app [-] api.neutron_default_tenant_id = default {{(pid=120741) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 18:01:00.001918 dv-cinder-852009-8-iscsi devstack@n-api.service[120741]: DEBUG nova.api.openstack.wsgi_app [-] api.use_forwarded_for = False {{(pid=120741) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 18:01:00.002375 dv-cinder-852009-8-iscsi devstack@n-api.service[120740]: DEBUG nova.api.openstack.wsgi_app [-] log_rotate_interval_type = days {{(pid=120740) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 13 18:01:00.002518 dv-cinder-852009-8-iscsi devstack@n-api.service[120741]: DEBUG nova.api.openstack.wsgi_app [-] api.use_neutron_default_nets = False {{(pid=120741) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 18:01:00.002785 dv-cinder-852009-8-iscsi devstack@n-api.service[120740]: DEBUG nova.api.openstack.wsgi_app [-] log_rotation_type = none {{(pid=120740) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 13 18:01:00.003299 dv-cinder-852009-8-iscsi devstack@n-api.service[120741]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_connect_timeout = 5 {{(pid=120741) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 18:01:00.003450 dv-cinder-852009-8-iscsi devstack@n-api.service[120740]: DEBUG nova.api.openstack.wsgi_app [-] logging_context_format_string = %(color)s%(levelname)s %(name)s [%(global_request_id)s %(request_id)s %(project_name)s %(user_name)s%(color)s] %(instance)s%(color)s%(message)s {{(pid=120740) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 13 18:01:00.003450 dv-cinder-852009-8-iscsi devstack@n-api.service[120740]: DEBUG nova.api.openstack.wsgi_app [-] logging_debug_format_suffix = {{(pid=%(process)d) %(funcName)s %(pathname)s:%(lineno)d}} {{(pid=120740) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 13 18:01:00.003737 dv-cinder-852009-8-iscsi devstack@n-api.service[120741]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_failure_fatal = False {{(pid=120741) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 18:01:00.003972 dv-cinder-852009-8-iscsi devstack@n-api.service[120740]: DEBUG nova.api.openstack.wsgi_app [-] logging_default_format_string = %(color)s%(levelname)s %(name)s [-%(color)s] %(instance)s%(color)s%(message)s {{(pid=120740) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 13 18:01:00.004132 dv-cinder-852009-8-iscsi devstack@n-api.service[120741]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_read_timeout = 5 {{(pid=120741) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 18:01:00.004282 dv-cinder-852009-8-iscsi devstack@n-api.service[120740]: DEBUG nova.api.openstack.wsgi_app [-] logging_exception_prefix = ERROR %(name)s %(instance)s {{(pid=120740) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 13 18:01:00.004452 dv-cinder-852009-8-iscsi devstack@n-api.service[120741]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_ssl_certfile = {{(pid=120741) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 18:01:00.004610 dv-cinder-852009-8-iscsi devstack@n-api.service[120740]: DEBUG nova.api.openstack.wsgi_app [-] logging_user_identity_format = %(user)s %(project)s %(domain)s %(system_scope)s %(user_domain)s %(project_domain)s {{(pid=120740) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 13 18:01:00.004753 dv-cinder-852009-8-iscsi devstack@n-api.service[120741]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_targets = [] {{(pid=120741) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 18:01:00.004904 dv-cinder-852009-8-iscsi devstack@n-api.service[120740]: DEBUG nova.api.openstack.wsgi_app [-] long_rpc_timeout = 1800 {{(pid=120740) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 13 18:01:00.005044 dv-cinder-852009-8-iscsi devstack@n-api.service[120741]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_jsonfile_path = None {{(pid=120741) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 18:01:00.005193 dv-cinder-852009-8-iscsi devstack@n-api.service[120740]: DEBUG nova.api.openstack.wsgi_app [-] max_concurrent_builds = 10 {{(pid=120740) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 13 18:01:00.005335 dv-cinder-852009-8-iscsi devstack@n-api.service[120741]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_providers = ['StaticJSON'] {{(pid=120741) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 18:01:00.005482 dv-cinder-852009-8-iscsi devstack@n-api.service[120740]: DEBUG nova.api.openstack.wsgi_app [-] max_concurrent_live_migrations = 1 {{(pid=120740) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 13 18:01:00.005637 dv-cinder-852009-8-iscsi devstack@n-api.service[120741]: DEBUG nova.api.openstack.wsgi_app [-] cache.backend = dogpile.cache.memcached {{(pid=120741) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 18:01:00.005780 dv-cinder-852009-8-iscsi devstack@n-api.service[120740]: DEBUG nova.api.openstack.wsgi_app [-] max_concurrent_snapshots = 5 {{(pid=120740) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 13 18:01:00.005931 dv-cinder-852009-8-iscsi devstack@n-api.service[120741]: DEBUG nova.api.openstack.wsgi_app [-] cache.backend_argument = **** {{(pid=120741) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 18:01:00.006086 dv-cinder-852009-8-iscsi devstack@n-api.service[120740]: DEBUG nova.api.openstack.wsgi_app [-] max_local_block_devices = 3 {{(pid=120740) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 13 18:01:00.006234 dv-cinder-852009-8-iscsi devstack@n-api.service[120741]: DEBUG nova.api.openstack.wsgi_app [-] cache.config_prefix = cache.oslo {{(pid=120741) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 18:01:00.006385 dv-cinder-852009-8-iscsi devstack@n-api.service[120740]: DEBUG nova.api.openstack.wsgi_app [-] max_logfile_count = 30 {{(pid=120740) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 13 18:01:00.006526 dv-cinder-852009-8-iscsi devstack@n-api.service[120741]: DEBUG nova.api.openstack.wsgi_app [-] cache.dead_timeout = 60.0 {{(pid=120741) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 18:01:00.006689 dv-cinder-852009-8-iscsi devstack@n-api.service[120740]: DEBUG nova.api.openstack.wsgi_app [-] max_logfile_size_mb = 200 {{(pid=120740) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 13 18:01:00.007404 dv-cinder-852009-8-iscsi devstack@n-api.service[120741]: DEBUG nova.api.openstack.wsgi_app [-] cache.debug_cache_backend = False {{(pid=120741) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 18:01:00.007567 dv-cinder-852009-8-iscsi devstack@n-api.service[120740]: DEBUG nova.api.openstack.wsgi_app [-] maximum_instance_delete_attempts = 5 {{(pid=120740) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 13 18:01:00.007710 dv-cinder-852009-8-iscsi devstack@n-api.service[120741]: DEBUG nova.api.openstack.wsgi_app [-] cache.enable_retry_client = False {{(pid=120741) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 18:01:00.007852 dv-cinder-852009-8-iscsi devstack@n-api.service[120740]: DEBUG nova.api.openstack.wsgi_app [-] metadata_listen = 0.0.0.0 {{(pid=120740) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 13 18:01:00.007992 dv-cinder-852009-8-iscsi devstack@n-api.service[120741]: DEBUG nova.api.openstack.wsgi_app [-] cache.enable_socket_keepalive = False {{(pid=120741) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 18:01:00.008139 dv-cinder-852009-8-iscsi devstack@n-api.service[120740]: DEBUG nova.api.openstack.wsgi_app [-] metadata_listen_port = 8775 {{(pid=120740) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 13 18:01:00.008288 dv-cinder-852009-8-iscsi devstack@n-api.service[120741]: DEBUG nova.api.openstack.wsgi_app [-] cache.enabled = True {{(pid=120741) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 18:01:00.008485 dv-cinder-852009-8-iscsi devstack@n-api.service[120740]: DEBUG nova.api.openstack.wsgi_app [-] metadata_workers = 2 {{(pid=120740) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 13 18:01:00.008825 dv-cinder-852009-8-iscsi devstack@n-api.service[120741]: DEBUG nova.api.openstack.wsgi_app [-] cache.expiration_time = 600 {{(pid=120741) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 18:01:00.008982 dv-cinder-852009-8-iscsi devstack@n-api.service[120740]: DEBUG nova.api.openstack.wsgi_app [-] migrate_max_retries = -1 {{(pid=120740) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 13 18:01:00.009126 dv-cinder-852009-8-iscsi devstack@n-api.service[120741]: DEBUG nova.api.openstack.wsgi_app [-] cache.hashclient_retry_attempts = 2 {{(pid=120741) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 18:01:00.009266 dv-cinder-852009-8-iscsi devstack@n-api.service[120740]: DEBUG nova.api.openstack.wsgi_app [-] mkisofs_cmd = genisoimage {{(pid=120740) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 13 18:01:00.009419 dv-cinder-852009-8-iscsi devstack@n-api.service[120741]: DEBUG nova.api.openstack.wsgi_app [-] cache.hashclient_retry_delay = 1.0 {{(pid=120741) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 18:01:00.009572 dv-cinder-852009-8-iscsi devstack@n-api.service[120740]: DEBUG nova.api.openstack.wsgi_app [-] my_block_storage_ip = 10.222.0.43 {{(pid=120740) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 13 18:01:00.009723 dv-cinder-852009-8-iscsi devstack@n-api.service[120741]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_dead_retry = 300 {{(pid=120741) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 18:01:00.009877 dv-cinder-852009-8-iscsi devstack@n-api.service[120740]: DEBUG nova.api.openstack.wsgi_app [-] my_ip = 10.222.0.43 {{(pid=120740) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 13 18:01:00.010029 dv-cinder-852009-8-iscsi devstack@n-api.service[120741]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_password = {{(pid=120741) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 18:01:00.010177 dv-cinder-852009-8-iscsi devstack@n-api.service[120740]: DEBUG nova.api.openstack.wsgi_app [-] network_allocate_retries = 0 {{(pid=120740) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 13 18:01:00.010663 dv-cinder-852009-8-iscsi devstack@n-api.service[120741]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_connection_get_timeout = 10 {{(pid=120741) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 18:01:00.010835 dv-cinder-852009-8-iscsi devstack@n-api.service[120740]: DEBUG nova.api.openstack.wsgi_app [-] non_inheritable_image_properties = ['cache_in_nova', 'bittorrent'] {{(pid=120740) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 13 18:01:00.011086 dv-cinder-852009-8-iscsi devstack@n-api.service[120741]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_flush_on_reconnect = False {{(pid=120741) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 18:01:00.011239 dv-cinder-852009-8-iscsi devstack@n-api.service[120740]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_listen = 0.0.0.0 {{(pid=120740) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 13 18:01:00.011526 dv-cinder-852009-8-iscsi devstack@n-api.service[120741]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_maxsize = 10 {{(pid=120741) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 18:01:00.011674 dv-cinder-852009-8-iscsi devstack@n-api.service[120740]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_listen_port = 8774 {{(pid=120740) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 13 18:01:00.011825 dv-cinder-852009-8-iscsi devstack@n-api.service[120741]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_unused_timeout = 60 {{(pid=120741) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 18:01:00.012023 dv-cinder-852009-8-iscsi devstack@n-api.service[120740]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_unique_server_name_scope = {{(pid=120740) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 13 18:01:00.012183 dv-cinder-852009-8-iscsi devstack@n-api.service[120741]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_sasl_enabled = False {{(pid=120741) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 18:01:00.012509 dv-cinder-852009-8-iscsi devstack@n-api.service[120740]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_workers = 2 {{(pid=120740) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 13 18:01:00.012662 dv-cinder-852009-8-iscsi devstack@n-api.service[120741]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_servers = ['localhost:11211'] {{(pid=120741) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 18:01:00.012894 dv-cinder-852009-8-iscsi devstack@n-api.service[120740]: DEBUG nova.api.openstack.wsgi_app [-] password_length = 12 {{(pid=120740) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 13 18:01:00.013052 dv-cinder-852009-8-iscsi devstack@n-api.service[120741]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_socket_timeout = 1.0 {{(pid=120741) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 18:01:00.013194 dv-cinder-852009-8-iscsi devstack@n-api.service[120740]: DEBUG nova.api.openstack.wsgi_app [-] periodic_enable = True {{(pid=120740) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 13 18:01:00.013334 dv-cinder-852009-8-iscsi devstack@n-api.service[120741]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_username = {{(pid=120741) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 18:01:00.013475 dv-cinder-852009-8-iscsi devstack@n-api.service[120740]: DEBUG nova.api.openstack.wsgi_app [-] periodic_fuzzy_delay = 60 {{(pid=120740) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 13 18:01:00.013615 dv-cinder-852009-8-iscsi devstack@n-api.service[120741]: DEBUG nova.api.openstack.wsgi_app [-] cache.proxies = [] {{(pid=120741) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 18:01:00.013764 dv-cinder-852009-8-iscsi devstack@n-api.service[120740]: DEBUG nova.api.openstack.wsgi_app [-] pointer_model = usbtablet {{(pid=120740) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 13 18:01:00.013915 dv-cinder-852009-8-iscsi devstack@n-api.service[120741]: DEBUG nova.api.openstack.wsgi_app [-] cache.retry_attempts = 2 {{(pid=120741) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 18:01:00.014066 dv-cinder-852009-8-iscsi devstack@n-api.service[120740]: DEBUG nova.api.openstack.wsgi_app [-] preallocate_images = none {{(pid=120740) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 13 18:01:00.014226 dv-cinder-852009-8-iscsi devstack@n-api.service[120741]: DEBUG nova.api.openstack.wsgi_app [-] cache.retry_delay = 0.0 {{(pid=120741) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 18:01:00.014376 dv-cinder-852009-8-iscsi devstack@n-api.service[120740]: DEBUG nova.api.openstack.wsgi_app [-] publish_errors = False {{(pid=120740) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 13 18:01:00.014523 dv-cinder-852009-8-iscsi devstack@n-api.service[120741]: DEBUG nova.api.openstack.wsgi_app [-] cache.socket_keepalive_count = 1 {{(pid=120741) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 18:01:00.014673 dv-cinder-852009-8-iscsi devstack@n-api.service[120740]: DEBUG nova.api.openstack.wsgi_app [-] pybasedir = /opt/stack/nova {{(pid=120740) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 13 18:01:00.014822 dv-cinder-852009-8-iscsi devstack@n-api.service[120741]: DEBUG nova.api.openstack.wsgi_app [-] cache.socket_keepalive_idle = 1 {{(pid=120741) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 18:01:00.014964 dv-cinder-852009-8-iscsi devstack@n-api.service[120740]: DEBUG nova.api.openstack.wsgi_app [-] ram_allocation_ratio = None {{(pid=120740) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 13 18:01:00.015104 dv-cinder-852009-8-iscsi devstack@n-api.service[120741]: DEBUG nova.api.openstack.wsgi_app [-] cache.socket_keepalive_interval = 1 {{(pid=120741) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 18:01:00.015243 dv-cinder-852009-8-iscsi devstack@n-api.service[120740]: DEBUG nova.api.openstack.wsgi_app [-] rate_limit_burst = 0 {{(pid=120740) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 13 18:01:00.015391 dv-cinder-852009-8-iscsi devstack@n-api.service[120741]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_allowed_ciphers = None {{(pid=120741) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 18:01:00.015542 dv-cinder-852009-8-iscsi devstack@n-api.service[120740]: DEBUG nova.api.openstack.wsgi_app [-] rate_limit_except_level = CRITICAL {{(pid=120740) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 13 18:01:00.015701 dv-cinder-852009-8-iscsi devstack@n-api.service[120741]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_cafile = None {{(pid=120741) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 18:01:00.015849 dv-cinder-852009-8-iscsi devstack@n-api.service[120740]: DEBUG nova.api.openstack.wsgi_app [-] rate_limit_interval = 0 {{(pid=120740) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 13 18:01:00.015999 dv-cinder-852009-8-iscsi devstack@n-api.service[120741]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_certfile = None {{(pid=120741) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 18:01:00.016158 dv-cinder-852009-8-iscsi devstack@n-api.service[120740]: DEBUG nova.api.openstack.wsgi_app [-] reboot_timeout = 0 {{(pid=120740) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 13 18:01:00.016356 dv-cinder-852009-8-iscsi devstack@n-api.service[120741]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_enabled = False {{(pid=120741) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 18:01:00.016561 dv-cinder-852009-8-iscsi devstack@n-api.service[120740]: DEBUG nova.api.openstack.wsgi_app [-] reclaim_instance_interval = 0 {{(pid=120740) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 13 18:01:00.016704 dv-cinder-852009-8-iscsi devstack@n-api.service[120741]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_keyfile = None {{(pid=120741) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 18:01:00.016851 dv-cinder-852009-8-iscsi devstack@n-api.service[120740]: DEBUG nova.api.openstack.wsgi_app [-] record = None {{(pid=120740) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 13 18:01:00.016851 dv-cinder-852009-8-iscsi devstack@n-api.service[120740]: DEBUG nova.api.openstack.wsgi_app [-] reimage_timeout_per_gb = 20 {{(pid=120740) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 13 18:01:00.017124 dv-cinder-852009-8-iscsi devstack@n-api.service[120741]: DEBUG nova.api.openstack.wsgi_app [-] cinder.auth_section = None {{(pid=120741) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 18:01:00.017273 dv-cinder-852009-8-iscsi devstack@n-api.service[120740]: DEBUG nova.api.openstack.wsgi_app [-] report_interval = 10 {{(pid=120740) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 13 18:01:00.017422 dv-cinder-852009-8-iscsi devstack@n-api.service[120741]: DEBUG nova.api.openstack.wsgi_app [-] cinder.auth_type = password {{(pid=120741) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 18:01:00.017569 dv-cinder-852009-8-iscsi devstack@n-api.service[120740]: DEBUG nova.api.openstack.wsgi_app [-] rescue_timeout = 0 {{(pid=120740) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 13 18:01:00.017715 dv-cinder-852009-8-iscsi devstack@n-api.service[120741]: DEBUG nova.api.openstack.wsgi_app [-] cinder.cafile = None {{(pid=120741) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 18:01:00.017863 dv-cinder-852009-8-iscsi devstack@n-api.service[120740]: DEBUG nova.api.openstack.wsgi_app [-] reserved_host_cpus = 0 {{(pid=120740) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 13 18:01:00.018010 dv-cinder-852009-8-iscsi devstack@n-api.service[120741]: DEBUG nova.api.openstack.wsgi_app [-] cinder.catalog_info = volumev3::publicURL {{(pid=120741) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 18:01:00.018159 dv-cinder-852009-8-iscsi devstack@n-api.service[120740]: DEBUG nova.api.openstack.wsgi_app [-] reserved_host_disk_mb = 0 {{(pid=120740) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 13 18:01:00.018315 dv-cinder-852009-8-iscsi devstack@n-api.service[120741]: DEBUG nova.api.openstack.wsgi_app [-] cinder.certfile = None {{(pid=120741) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 18:01:00.018456 dv-cinder-852009-8-iscsi devstack@n-api.service[120740]: DEBUG nova.api.openstack.wsgi_app [-] reserved_host_memory_mb = 512 {{(pid=120740) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 13 18:01:00.018603 dv-cinder-852009-8-iscsi devstack@n-api.service[120741]: DEBUG nova.api.openstack.wsgi_app [-] cinder.collect_timing = False {{(pid=120741) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 18:01:00.018743 dv-cinder-852009-8-iscsi devstack@n-api.service[120740]: DEBUG nova.api.openstack.wsgi_app [-] reserved_huge_pages = None {{(pid=120740) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 13 18:01:00.018881 dv-cinder-852009-8-iscsi devstack@n-api.service[120741]: DEBUG nova.api.openstack.wsgi_app [-] cinder.cross_az_attach = True {{(pid=120741) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 18:01:00.019040 dv-cinder-852009-8-iscsi devstack@n-api.service[120740]: DEBUG nova.api.openstack.wsgi_app [-] resize_confirm_window = 0 {{(pid=120740) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 13 18:01:00.019195 dv-cinder-852009-8-iscsi devstack@n-api.service[120741]: DEBUG nova.api.openstack.wsgi_app [-] cinder.debug = False {{(pid=120741) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 18:01:00.019345 dv-cinder-852009-8-iscsi devstack@n-api.service[120740]: DEBUG nova.api.openstack.wsgi_app [-] resize_fs_using_block_device = False {{(pid=120740) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 13 18:01:00.019494 dv-cinder-852009-8-iscsi devstack@n-api.service[120741]: DEBUG nova.api.openstack.wsgi_app [-] cinder.endpoint_template = None {{(pid=120741) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 18:01:00.019642 dv-cinder-852009-8-iscsi devstack@n-api.service[120740]: DEBUG nova.api.openstack.wsgi_app [-] resume_guests_state_on_host_boot = False {{(pid=120740) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 13 18:01:00.019790 dv-cinder-852009-8-iscsi devstack@n-api.service[120741]: DEBUG nova.api.openstack.wsgi_app [-] cinder.http_retries = 3 {{(pid=120741) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 18:01:00.019949 dv-cinder-852009-8-iscsi devstack@n-api.service[120740]: DEBUG nova.api.openstack.wsgi_app [-] rootwrap_config = /etc/nova/rootwrap.conf {{(pid=120740) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 13 18:01:00.020099 dv-cinder-852009-8-iscsi devstack@n-api.service[120741]: DEBUG nova.api.openstack.wsgi_app [-] cinder.insecure = False {{(pid=120741) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 18:01:00.020099 dv-cinder-852009-8-iscsi devstack@n-api.service[120741]: DEBUG nova.api.openstack.wsgi_app [-] cinder.keyfile = None {{(pid=120741) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 18:01:00.020373 dv-cinder-852009-8-iscsi devstack@n-api.service[120740]: DEBUG nova.api.openstack.wsgi_app [-] running_deleted_instance_action = reap {{(pid=120740) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 13 18:01:00.021029 dv-cinder-852009-8-iscsi devstack@n-api.service[120741]: DEBUG nova.api.openstack.wsgi_app [-] cinder.os_region_name = RegionOne {{(pid=120741) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 18:01:00.021029 dv-cinder-852009-8-iscsi devstack@n-api.service[120741]: DEBUG nova.api.openstack.wsgi_app [-] cinder.split_loggers = False {{(pid=120741) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 18:01:00.021433 dv-cinder-852009-8-iscsi devstack@n-api.service[120740]: DEBUG nova.api.openstack.wsgi_app [-] running_deleted_instance_poll_interval = 1800 {{(pid=120740) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 13 18:01:00.021681 dv-cinder-852009-8-iscsi devstack@n-api.service[120741]: DEBUG nova.api.openstack.wsgi_app [-] cinder.timeout = None {{(pid=120741) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 18:01:00.021921 dv-cinder-852009-8-iscsi devstack@n-api.service[120740]: DEBUG nova.api.openstack.wsgi_app [-] running_deleted_instance_timeout = 0 {{(pid=120740) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 13 18:01:00.022110 dv-cinder-852009-8-iscsi devstack@n-api.service[120741]: DEBUG nova.api.openstack.wsgi_app [-] compute.consecutive_build_service_disable_threshold = 10 {{(pid=120741) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 18:01:00.022266 dv-cinder-852009-8-iscsi devstack@n-api.service[120740]: DEBUG nova.api.openstack.wsgi_app [-] scheduler_instance_sync_interval = 120 {{(pid=120740) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 13 18:01:00.022586 dv-cinder-852009-8-iscsi devstack@n-api.service[120741]: DEBUG nova.api.openstack.wsgi_app [-] compute.cpu_dedicated_set = None {{(pid=120741) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 18:01:00.022742 dv-cinder-852009-8-iscsi devstack@n-api.service[120740]: DEBUG nova.api.openstack.wsgi_app [-] service_down_time = 60 {{(pid=120740) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 13 18:01:00.022920 dv-cinder-852009-8-iscsi devstack@n-api.service[120741]: DEBUG nova.api.openstack.wsgi_app [-] compute.cpu_shared_set = None {{(pid=120741) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 18:01:00.023153 dv-cinder-852009-8-iscsi devstack@n-api.service[120740]: DEBUG nova.api.openstack.wsgi_app [-] servicegroup_driver = db {{(pid=120740) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 13 18:01:00.023443 dv-cinder-852009-8-iscsi devstack@n-api.service[120741]: DEBUG nova.api.openstack.wsgi_app [-] compute.image_type_exclude_list = [] {{(pid=120741) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 18:01:00.023678 dv-cinder-852009-8-iscsi devstack@n-api.service[120740]: DEBUG nova.api.openstack.wsgi_app [-] shelved_offload_time = 0 {{(pid=120740) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 13 18:01:00.023822 dv-cinder-852009-8-iscsi devstack@n-api.service[120741]: DEBUG nova.api.openstack.wsgi_app [-] compute.live_migration_wait_for_vif_plug = True {{(pid=120741) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 18:01:00.023963 dv-cinder-852009-8-iscsi devstack@n-api.service[120740]: DEBUG nova.api.openstack.wsgi_app [-] shelved_poll_interval = 3600 {{(pid=120740) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 13 18:01:00.024104 dv-cinder-852009-8-iscsi devstack@n-api.service[120741]: DEBUG nova.api.openstack.wsgi_app [-] compute.max_concurrent_disk_ops = 0 {{(pid=120741) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 18:01:00.024251 dv-cinder-852009-8-iscsi devstack@n-api.service[120740]: DEBUG nova.api.openstack.wsgi_app [-] shutdown_timeout = 0 {{(pid=120740) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 13 18:01:00.024400 dv-cinder-852009-8-iscsi devstack@n-api.service[120741]: DEBUG nova.api.openstack.wsgi_app [-] compute.max_disk_devices_to_attach = -1 {{(pid=120741) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 18:01:00.024580 dv-cinder-852009-8-iscsi devstack@n-api.service[120740]: DEBUG nova.api.openstack.wsgi_app [-] source_is_ipv6 = False {{(pid=120740) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 13 18:01:00.024723 dv-cinder-852009-8-iscsi devstack@n-api.service[120741]: DEBUG nova.api.openstack.wsgi_app [-] compute.packing_host_numa_cells_allocation_strategy = False {{(pid=120741) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 18:01:00.024871 dv-cinder-852009-8-iscsi devstack@n-api.service[120740]: DEBUG nova.api.openstack.wsgi_app [-] ssl_only = False {{(pid=120740) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 13 18:01:00.025020 dv-cinder-852009-8-iscsi devstack@n-api.service[120741]: DEBUG nova.api.openstack.wsgi_app [-] compute.provider_config_location = /etc/nova/provider_config/ {{(pid=120741) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 18:01:00.025188 dv-cinder-852009-8-iscsi devstack@n-api.service[120740]: DEBUG nova.api.openstack.wsgi_app [-] state_path = /opt/stack/data/nova {{(pid=120740) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 13 18:01:00.025347 dv-cinder-852009-8-iscsi devstack@n-api.service[120741]: DEBUG nova.api.openstack.wsgi_app [-] compute.resource_provider_association_refresh = 300 {{(pid=120741) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 18:01:00.025503 dv-cinder-852009-8-iscsi devstack@n-api.service[120740]: DEBUG nova.api.openstack.wsgi_app [-] sync_power_state_interval = 600 {{(pid=120740) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 13 18:01:00.025653 dv-cinder-852009-8-iscsi devstack@n-api.service[120741]: DEBUG nova.api.openstack.wsgi_app [-] compute.shutdown_retry_interval = 10 {{(pid=120741) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 18:01:00.025812 dv-cinder-852009-8-iscsi devstack@n-api.service[120740]: DEBUG nova.api.openstack.wsgi_app [-] sync_power_state_pool_size = 1000 {{(pid=120740) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 13 18:01:00.025955 dv-cinder-852009-8-iscsi devstack@n-api.service[120741]: DEBUG nova.api.openstack.wsgi_app [-] conductor.workers = 2 {{(pid=120741) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 18:01:00.026106 dv-cinder-852009-8-iscsi devstack@n-api.service[120740]: DEBUG nova.api.openstack.wsgi_app [-] syslog_log_facility = LOG_USER {{(pid=120740) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 13 18:01:00.026261 dv-cinder-852009-8-iscsi devstack@n-api.service[120741]: DEBUG nova.api.openstack.wsgi_app [-] console.allowed_origins = [] {{(pid=120741) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 18:01:00.026403 dv-cinder-852009-8-iscsi devstack@n-api.service[120740]: DEBUG nova.api.openstack.wsgi_app [-] tempdir = None {{(pid=120740) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 13 18:01:00.026551 dv-cinder-852009-8-iscsi devstack@n-api.service[120741]: DEBUG nova.api.openstack.wsgi_app [-] console.ssl_ciphers = None {{(pid=120741) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 18:01:00.026700 dv-cinder-852009-8-iscsi devstack@n-api.service[120740]: DEBUG nova.api.openstack.wsgi_app [-] timeout_nbd = 10 {{(pid=120740) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 13 18:01:00.026848 dv-cinder-852009-8-iscsi devstack@n-api.service[120741]: DEBUG nova.api.openstack.wsgi_app [-] console.ssl_minimum_version = default {{(pid=120741) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 18:01:00.026988 dv-cinder-852009-8-iscsi devstack@n-api.service[120740]: DEBUG nova.api.openstack.wsgi_app [-] transport_url = **** {{(pid=120740) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 13 18:01:00.027157 dv-cinder-852009-8-iscsi devstack@n-api.service[120741]: DEBUG nova.api.openstack.wsgi_app [-] consoleauth.token_ttl = 600 {{(pid=120741) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 18:01:00.027306 dv-cinder-852009-8-iscsi devstack@n-api.service[120740]: DEBUG nova.api.openstack.wsgi_app [-] update_resources_interval = 0 {{(pid=120740) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 13 18:01:00.027454 dv-cinder-852009-8-iscsi devstack@n-api.service[120741]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.cafile = None {{(pid=120741) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 18:01:00.027602 dv-cinder-852009-8-iscsi devstack@n-api.service[120740]: DEBUG nova.api.openstack.wsgi_app [-] use_cow_images = True {{(pid=120740) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 13 18:01:00.027743 dv-cinder-852009-8-iscsi devstack@n-api.service[120741]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.certfile = None {{(pid=120741) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 18:01:00.027743 dv-cinder-852009-8-iscsi devstack@n-api.service[120741]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.collect_timing = False {{(pid=120741) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 18:01:00.027743 dv-cinder-852009-8-iscsi devstack@n-api.service[120741]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.connect_retries = None {{(pid=120741) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 18:01:00.028147 dv-cinder-852009-8-iscsi devstack@n-api.service[120740]: DEBUG nova.api.openstack.wsgi_app [-] use_eventlog = False {{(pid=120740) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 13 18:01:00.028294 dv-cinder-852009-8-iscsi devstack@n-api.service[120741]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.connect_retry_delay = None {{(pid=120741) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 18:01:00.028498 dv-cinder-852009-8-iscsi devstack@n-api.service[120740]: DEBUG nova.api.openstack.wsgi_app [-] use_journal = False {{(pid=120740) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 13 18:01:00.028656 dv-cinder-852009-8-iscsi devstack@n-api.service[120741]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.endpoint_override = None {{(pid=120741) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 18:01:00.028798 dv-cinder-852009-8-iscsi devstack@n-api.service[120740]: DEBUG nova.api.openstack.wsgi_app [-] use_json = False {{(pid=120740) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 13 18:01:00.028958 dv-cinder-852009-8-iscsi devstack@n-api.service[120741]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.insecure = False {{(pid=120741) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 18:01:00.029107 dv-cinder-852009-8-iscsi devstack@n-api.service[120740]: DEBUG nova.api.openstack.wsgi_app [-] use_rootwrap_daemon = False {{(pid=120740) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 13 18:01:00.029248 dv-cinder-852009-8-iscsi devstack@n-api.service[120741]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.keyfile = None {{(pid=120741) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 18:01:00.029394 dv-cinder-852009-8-iscsi devstack@n-api.service[120740]: DEBUG nova.api.openstack.wsgi_app [-] use_stderr = False {{(pid=120740) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 13 18:01:00.029577 dv-cinder-852009-8-iscsi devstack@n-api.service[120741]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.max_version = None {{(pid=120741) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 18:01:00.029577 dv-cinder-852009-8-iscsi devstack@n-api.service[120741]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.min_version = None {{(pid=120741) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 18:01:00.029859 dv-cinder-852009-8-iscsi devstack@n-api.service[120740]: DEBUG nova.api.openstack.wsgi_app [-] use_syslog = False {{(pid=120740) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 13 18:01:00.030000 dv-cinder-852009-8-iscsi devstack@n-api.service[120741]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.region_name = None {{(pid=120741) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 18:01:00.030139 dv-cinder-852009-8-iscsi devstack@n-api.service[120740]: DEBUG nova.api.openstack.wsgi_app [-] vcpu_pin_set = None {{(pid=120740) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 13 18:01:00.030287 dv-cinder-852009-8-iscsi devstack@n-api.service[120741]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.service_name = None {{(pid=120741) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 18:01:00.030428 dv-cinder-852009-8-iscsi devstack@n-api.service[120740]: DEBUG nova.api.openstack.wsgi_app [-] vif_plugging_is_fatal = True {{(pid=120740) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 13 18:01:00.030581 dv-cinder-852009-8-iscsi devstack@n-api.service[120741]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.service_type = accelerator {{(pid=120741) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 18:01:00.030749 dv-cinder-852009-8-iscsi devstack@n-api.service[120740]: DEBUG nova.api.openstack.wsgi_app [-] vif_plugging_timeout = 300 {{(pid=120740) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 13 18:01:00.031247 dv-cinder-852009-8-iscsi devstack@n-api.service[120741]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.split_loggers = False {{(pid=120741) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 18:01:00.031511 dv-cinder-852009-8-iscsi devstack@n-api.service[120740]: DEBUG nova.api.openstack.wsgi_app [-] virt_mkfs = [] {{(pid=120740) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 13 18:01:00.031665 dv-cinder-852009-8-iscsi devstack@n-api.service[120741]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.status_code_retries = None {{(pid=120741) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 18:01:00.034702 dv-cinder-852009-8-iscsi devstack@n-api.service[120740]: DEBUG nova.api.openstack.wsgi_app [-] volume_usage_poll_interval = 0 {{(pid=120740) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 13 18:01:00.034889 dv-cinder-852009-8-iscsi devstack@n-api.service[120741]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.status_code_retry_delay = None {{(pid=120741) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 18:01:00.035050 dv-cinder-852009-8-iscsi devstack@n-api.service[120740]: DEBUG nova.api.openstack.wsgi_app [-] watch_log_file = False {{(pid=120740) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 13 18:01:00.035204 dv-cinder-852009-8-iscsi devstack@n-api.service[120741]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.timeout = None {{(pid=120741) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 18:01:00.035348 dv-cinder-852009-8-iscsi devstack@n-api.service[120740]: DEBUG nova.api.openstack.wsgi_app [-] web = /usr/share/spice-html5 {{(pid=120740) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 13 18:01:00.035490 dv-cinder-852009-8-iscsi devstack@n-api.service[120741]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.valid_interfaces = ['internal', 'public'] {{(pid=120741) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 18:01:00.035640 dv-cinder-852009-8-iscsi devstack@n-api.service[120740]: DEBUG nova.api.openstack.wsgi_app [-] oslo_concurrency.disable_process_locking = False {{(pid=120740) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 18:01:00.035810 dv-cinder-852009-8-iscsi devstack@n-api.service[120741]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.version = None {{(pid=120741) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 18:01:00.035962 dv-cinder-852009-8-iscsi devstack@n-api.service[120740]: DEBUG nova.api.openstack.wsgi_app [-] oslo_concurrency.lock_path = /opt/stack/data/nova {{(pid=120740) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 18:01:00.036112 dv-cinder-852009-8-iscsi devstack@n-api.service[120741]: DEBUG nova.api.openstack.wsgi_app [-] database.backend = sqlalchemy {{(pid=120741) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 18:01:00.036265 dv-cinder-852009-8-iscsi devstack@n-api.service[120740]: DEBUG nova.api.openstack.wsgi_app [-] api.auth_strategy = keystone {{(pid=120740) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 18:01:00.036490 dv-cinder-852009-8-iscsi devstack@n-api.service[120741]: DEBUG nova.api.openstack.wsgi_app [-] database.connection = **** {{(pid=120741) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 18:01:00.036651 dv-cinder-852009-8-iscsi devstack@n-api.service[120740]: DEBUG nova.api.openstack.wsgi_app [-] api.compute_link_prefix = None {{(pid=120740) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 18:01:00.036794 dv-cinder-852009-8-iscsi devstack@n-api.service[120741]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_debug = 0 {{(pid=120741) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 18:01:00.036933 dv-cinder-852009-8-iscsi devstack@n-api.service[120740]: DEBUG nova.api.openstack.wsgi_app [-] api.config_drive_skip_versions = 1.0 2007-01-19 2007-03-01 2007-08-29 2007-10-10 2007-12-15 2008-02-01 2008-09-01 {{(pid=120740) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 18:01:00.037089 dv-cinder-852009-8-iscsi devstack@n-api.service[120741]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_parameters = {{(pid=120741) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 18:01:00.037232 dv-cinder-852009-8-iscsi devstack@n-api.service[120740]: DEBUG nova.api.openstack.wsgi_app [-] api.dhcp_domain = novalocal {{(pid=120740) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 18:01:00.037379 dv-cinder-852009-8-iscsi devstack@n-api.service[120741]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_recycle_time = 3600 {{(pid=120741) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 18:01:00.037530 dv-cinder-852009-8-iscsi devstack@n-api.service[120740]: DEBUG nova.api.openstack.wsgi_app [-] api.enable_instance_password = True {{(pid=120740) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 18:01:00.037679 dv-cinder-852009-8-iscsi devstack@n-api.service[120741]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_trace = False {{(pid=120741) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 18:01:00.037827 dv-cinder-852009-8-iscsi devstack@n-api.service[120740]: DEBUG nova.api.openstack.wsgi_app [-] api.glance_link_prefix = None {{(pid=120740) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 18:01:00.037976 dv-cinder-852009-8-iscsi devstack@n-api.service[120741]: DEBUG nova.api.openstack.wsgi_app [-] database.db_inc_retry_interval = True {{(pid=120741) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 18:01:00.038136 dv-cinder-852009-8-iscsi devstack@n-api.service[120740]: DEBUG nova.api.openstack.wsgi_app [-] api.instance_list_cells_batch_fixed_size = 100 {{(pid=120740) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 18:01:00.038278 dv-cinder-852009-8-iscsi devstack@n-api.service[120741]: DEBUG nova.api.openstack.wsgi_app [-] database.db_max_retries = 20 {{(pid=120741) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 18:01:00.038433 dv-cinder-852009-8-iscsi devstack@n-api.service[120740]: DEBUG nova.api.openstack.wsgi_app [-] api.instance_list_cells_batch_strategy = distributed {{(pid=120740) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 18:01:00.038583 dv-cinder-852009-8-iscsi devstack@n-api.service[120741]: DEBUG nova.api.openstack.wsgi_app [-] database.db_max_retry_interval = 10 {{(pid=120741) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 18:01:00.038723 dv-cinder-852009-8-iscsi devstack@n-api.service[120740]: DEBUG nova.api.openstack.wsgi_app [-] api.instance_list_per_project_cells = False {{(pid=120740) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 18:01:00.038863 dv-cinder-852009-8-iscsi devstack@n-api.service[120741]: DEBUG nova.api.openstack.wsgi_app [-] database.db_retry_interval = 1 {{(pid=120741) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 18:01:00.039003 dv-cinder-852009-8-iscsi devstack@n-api.service[120740]: DEBUG nova.api.openstack.wsgi_app [-] api.list_records_by_skipping_down_cells = True {{(pid=120740) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 18:01:00.039143 dv-cinder-852009-8-iscsi devstack@n-api.service[120741]: DEBUG nova.api.openstack.wsgi_app [-] database.max_overflow = 50 {{(pid=120741) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 18:01:00.039297 dv-cinder-852009-8-iscsi devstack@n-api.service[120740]: DEBUG nova.api.openstack.wsgi_app [-] api.local_metadata_per_cell = False {{(pid=120740) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 18:01:00.039440 dv-cinder-852009-8-iscsi devstack@n-api.service[120741]: DEBUG nova.api.openstack.wsgi_app [-] database.max_pool_size = 5 {{(pid=120741) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 18:01:00.039586 dv-cinder-852009-8-iscsi devstack@n-api.service[120740]: DEBUG nova.api.openstack.wsgi_app [-] api.max_limit = 1000 {{(pid=120740) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 18:01:00.039735 dv-cinder-852009-8-iscsi devstack@n-api.service[120741]: DEBUG nova.api.openstack.wsgi_app [-] database.max_retries = 10 {{(pid=120741) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 18:01:00.039875 dv-cinder-852009-8-iscsi devstack@n-api.service[120740]: DEBUG nova.api.openstack.wsgi_app [-] api.metadata_cache_expiration = 15 {{(pid=120740) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 18:01:00.040041 dv-cinder-852009-8-iscsi devstack@n-api.service[120741]: DEBUG nova.api.openstack.wsgi_app [-] database.mysql_enable_ndb = False {{(pid=120741) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 18:01:00.040183 dv-cinder-852009-8-iscsi devstack@n-api.service[120740]: DEBUG nova.api.openstack.wsgi_app [-] api.neutron_default_tenant_id = default {{(pid=120740) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 18:01:00.040324 dv-cinder-852009-8-iscsi devstack@n-api.service[120741]: DEBUG nova.api.openstack.wsgi_app [-] database.mysql_sql_mode = TRADITIONAL {{(pid=120741) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 18:01:00.040492 dv-cinder-852009-8-iscsi devstack@n-api.service[120740]: DEBUG nova.api.openstack.wsgi_app [-] api.use_forwarded_for = False {{(pid=120740) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 18:01:00.040639 dv-cinder-852009-8-iscsi devstack@n-api.service[120741]: DEBUG nova.api.openstack.wsgi_app [-] database.pool_timeout = None {{(pid=120741) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 18:01:00.040788 dv-cinder-852009-8-iscsi devstack@n-api.service[120740]: DEBUG nova.api.openstack.wsgi_app [-] api.use_neutron_default_nets = False {{(pid=120740) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 18:01:00.041253 dv-cinder-852009-8-iscsi devstack@n-api.service[120741]: DEBUG nova.api.openstack.wsgi_app [-] database.retry_interval = 10 {{(pid=120741) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 18:01:00.041410 dv-cinder-852009-8-iscsi devstack@n-api.service[120740]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_connect_timeout = 5 {{(pid=120740) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 18:01:00.041667 dv-cinder-852009-8-iscsi devstack@n-api.service[120741]: DEBUG nova.api.openstack.wsgi_app [-] database.slave_connection = **** {{(pid=120741) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 18:01:00.041815 dv-cinder-852009-8-iscsi devstack@n-api.service[120740]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_failure_fatal = False {{(pid=120740) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 18:01:00.041964 dv-cinder-852009-8-iscsi devstack@n-api.service[120741]: DEBUG nova.api.openstack.wsgi_app [-] database.sqlite_synchronous = True {{(pid=120741) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 18:01:00.042106 dv-cinder-852009-8-iscsi devstack@n-api.service[120740]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_read_timeout = 5 {{(pid=120740) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 18:01:00.042262 dv-cinder-852009-8-iscsi devstack@n-api.service[120741]: DEBUG nova.api.openstack.wsgi_app [-] api_database.backend = sqlalchemy {{(pid=120741) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 18:01:00.042430 dv-cinder-852009-8-iscsi devstack@n-api.service[120740]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_ssl_certfile = {{(pid=120740) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 18:01:00.042572 dv-cinder-852009-8-iscsi devstack@n-api.service[120741]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection = **** {{(pid=120741) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 18:01:00.042712 dv-cinder-852009-8-iscsi devstack@n-api.service[120740]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_targets = [] {{(pid=120740) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 18:01:00.042860 dv-cinder-852009-8-iscsi devstack@n-api.service[120741]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_debug = 0 {{(pid=120741) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 18:01:00.043000 dv-cinder-852009-8-iscsi devstack@n-api.service[120740]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_jsonfile_path = None {{(pid=120740) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 18:01:00.043151 dv-cinder-852009-8-iscsi devstack@n-api.service[120741]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_parameters = {{(pid=120741) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 18:01:00.043299 dv-cinder-852009-8-iscsi devstack@n-api.service[120740]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_providers = ['StaticJSON'] {{(pid=120740) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 18:01:00.043441 dv-cinder-852009-8-iscsi devstack@n-api.service[120741]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_recycle_time = 3600 {{(pid=120741) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 18:01:00.043580 dv-cinder-852009-8-iscsi devstack@n-api.service[120740]: DEBUG nova.api.openstack.wsgi_app [-] cache.backend = dogpile.cache.memcached {{(pid=120740) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 18:01:00.043720 dv-cinder-852009-8-iscsi devstack@n-api.service[120741]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_trace = False {{(pid=120741) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 18:01:00.043878 dv-cinder-852009-8-iscsi devstack@n-api.service[120740]: DEBUG nova.api.openstack.wsgi_app [-] cache.backend_argument = **** {{(pid=120740) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 18:01:00.044027 dv-cinder-852009-8-iscsi devstack@n-api.service[120741]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_inc_retry_interval = True {{(pid=120741) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 18:01:00.044170 dv-cinder-852009-8-iscsi devstack@n-api.service[120740]: DEBUG nova.api.openstack.wsgi_app [-] cache.config_prefix = cache.oslo {{(pid=120740) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 18:01:00.044363 dv-cinder-852009-8-iscsi devstack@n-api.service[120741]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_max_retries = 20 {{(pid=120741) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 18:01:00.044830 dv-cinder-852009-8-iscsi devstack@n-api.service[120740]: DEBUG nova.api.openstack.wsgi_app [-] cache.dead_timeout = 60.0 {{(pid=120740) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 18:01:00.044991 dv-cinder-852009-8-iscsi devstack@n-api.service[120741]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_max_retry_interval = 10 {{(pid=120741) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 18:01:00.045144 dv-cinder-852009-8-iscsi devstack@n-api.service[120740]: DEBUG nova.api.openstack.wsgi_app [-] cache.debug_cache_backend = False {{(pid=120740) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 18:01:00.045294 dv-cinder-852009-8-iscsi devstack@n-api.service[120741]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_retry_interval = 1 {{(pid=120741) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 18:01:00.045443 dv-cinder-852009-8-iscsi devstack@n-api.service[120740]: DEBUG nova.api.openstack.wsgi_app [-] cache.enable_retry_client = False {{(pid=120740) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 18:01:00.045587 dv-cinder-852009-8-iscsi devstack@n-api.service[120741]: DEBUG nova.api.openstack.wsgi_app [-] api_database.max_overflow = 50 {{(pid=120741) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 18:01:00.045734 dv-cinder-852009-8-iscsi devstack@n-api.service[120740]: DEBUG nova.api.openstack.wsgi_app [-] cache.enable_socket_keepalive = False {{(pid=120740) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 18:01:00.045876 dv-cinder-852009-8-iscsi devstack@n-api.service[120741]: DEBUG nova.api.openstack.wsgi_app [-] api_database.max_pool_size = 5 {{(pid=120741) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 18:01:00.046026 dv-cinder-852009-8-iscsi devstack@n-api.service[120740]: DEBUG nova.api.openstack.wsgi_app [-] cache.enabled = True {{(pid=120740) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 18:01:00.046178 dv-cinder-852009-8-iscsi devstack@n-api.service[120741]: DEBUG nova.api.openstack.wsgi_app [-] api_database.max_retries = 10 {{(pid=120741) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 18:01:00.046329 dv-cinder-852009-8-iscsi devstack@n-api.service[120740]: DEBUG nova.api.openstack.wsgi_app [-] cache.expiration_time = 600 {{(pid=120740) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 18:01:00.046470 dv-cinder-852009-8-iscsi devstack@n-api.service[120741]: DEBUG nova.api.openstack.wsgi_app [-] api_database.mysql_enable_ndb = False {{(pid=120741) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 18:01:00.046621 dv-cinder-852009-8-iscsi devstack@n-api.service[120740]: DEBUG nova.api.openstack.wsgi_app [-] cache.hashclient_retry_attempts = 2 {{(pid=120740) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 18:01:00.046769 dv-cinder-852009-8-iscsi devstack@n-api.service[120741]: DEBUG nova.api.openstack.wsgi_app [-] api_database.mysql_sql_mode = TRADITIONAL {{(pid=120741) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 18:01:00.046920 dv-cinder-852009-8-iscsi devstack@n-api.service[120740]: DEBUG nova.api.openstack.wsgi_app [-] cache.hashclient_retry_delay = 1.0 {{(pid=120740) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 18:01:00.047070 dv-cinder-852009-8-iscsi devstack@n-api.service[120741]: DEBUG nova.api.openstack.wsgi_app [-] api_database.pool_timeout = None {{(pid=120741) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 18:01:00.047210 dv-cinder-852009-8-iscsi devstack@n-api.service[120740]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_dead_retry = 300 {{(pid=120740) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 18:01:00.047358 dv-cinder-852009-8-iscsi devstack@n-api.service[120741]: DEBUG nova.api.openstack.wsgi_app [-] api_database.retry_interval = 10 {{(pid=120741) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 18:01:00.047499 dv-cinder-852009-8-iscsi devstack@n-api.service[120740]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_password = {{(pid=120740) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 18:01:00.047654 dv-cinder-852009-8-iscsi devstack@n-api.service[120741]: DEBUG nova.api.openstack.wsgi_app [-] api_database.slave_connection = **** {{(pid=120741) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 18:01:00.047796 dv-cinder-852009-8-iscsi devstack@n-api.service[120740]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_connection_get_timeout = 10 {{(pid=120740) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 18:01:00.047944 dv-cinder-852009-8-iscsi devstack@n-api.service[120741]: DEBUG nova.api.openstack.wsgi_app [-] api_database.sqlite_synchronous = True {{(pid=120741) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 18:01:00.048085 dv-cinder-852009-8-iscsi devstack@n-api.service[120740]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_flush_on_reconnect = False {{(pid=120740) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 18:01:00.048225 dv-cinder-852009-8-iscsi devstack@n-api.service[120741]: DEBUG nova.api.openstack.wsgi_app [-] devices.enabled_mdev_types = [] {{(pid=120741) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 18:01:00.048374 dv-cinder-852009-8-iscsi devstack@n-api.service[120740]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_maxsize = 10 {{(pid=120740) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 18:01:00.048580 dv-cinder-852009-8-iscsi devstack@n-api.service[120741]: DEBUG nova.api.openstack.wsgi_app [-] ephemeral_storage_encryption.cipher = aes-xts-plain64 {{(pid=120741) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 18:01:00.048736 dv-cinder-852009-8-iscsi devstack@n-api.service[120740]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_unused_timeout = 60 {{(pid=120740) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 18:01:00.048885 dv-cinder-852009-8-iscsi devstack@n-api.service[120741]: DEBUG nova.api.openstack.wsgi_app [-] ephemeral_storage_encryption.enabled = False {{(pid=120741) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 18:01:00.049026 dv-cinder-852009-8-iscsi devstack@n-api.service[120740]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_sasl_enabled = False {{(pid=120740) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 18:01:00.049166 dv-cinder-852009-8-iscsi devstack@n-api.service[120741]: DEBUG nova.api.openstack.wsgi_app [-] ephemeral_storage_encryption.key_size = 512 {{(pid=120741) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 18:01:00.049351 dv-cinder-852009-8-iscsi devstack@n-api.service[120740]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_servers = ['localhost:11211'] {{(pid=120740) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 18:01:00.049507 dv-cinder-852009-8-iscsi devstack@n-api.service[120741]: DEBUG nova.api.openstack.wsgi_app [-] glance.api_servers = None {{(pid=120741) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 18:01:00.049656 dv-cinder-852009-8-iscsi devstack@n-api.service[120740]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_socket_timeout = 1.0 {{(pid=120740) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 18:01:00.049798 dv-cinder-852009-8-iscsi devstack@n-api.service[120741]: DEBUG nova.api.openstack.wsgi_app [-] glance.cafile = None {{(pid=120741) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 18:01:00.049938 dv-cinder-852009-8-iscsi devstack@n-api.service[120740]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_username = {{(pid=120740) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 18:01:00.050085 dv-cinder-852009-8-iscsi devstack@n-api.service[120741]: DEBUG nova.api.openstack.wsgi_app [-] glance.certfile = None {{(pid=120741) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 18:01:00.050234 dv-cinder-852009-8-iscsi devstack@n-api.service[120740]: DEBUG nova.api.openstack.wsgi_app [-] cache.proxies = [] {{(pid=120740) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 18:01:00.050398 dv-cinder-852009-8-iscsi devstack@n-api.service[120741]: DEBUG nova.api.openstack.wsgi_app [-] glance.collect_timing = False {{(pid=120741) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 18:01:00.050547 dv-cinder-852009-8-iscsi devstack@n-api.service[120740]: DEBUG nova.api.openstack.wsgi_app [-] cache.retry_attempts = 2 {{(pid=120740) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 18:01:00.050699 dv-cinder-852009-8-iscsi devstack@n-api.service[120741]: DEBUG nova.api.openstack.wsgi_app [-] glance.connect_retries = None {{(pid=120741) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 18:01:00.050841 dv-cinder-852009-8-iscsi devstack@n-api.service[120740]: DEBUG nova.api.openstack.wsgi_app [-] cache.retry_delay = 0.0 {{(pid=120740) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 18:01:00.050988 dv-cinder-852009-8-iscsi devstack@n-api.service[120741]: DEBUG nova.api.openstack.wsgi_app [-] glance.connect_retry_delay = None {{(pid=120741) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 18:01:00.051432 dv-cinder-852009-8-iscsi devstack@n-api.service[120740]: DEBUG nova.api.openstack.wsgi_app [-] cache.socket_keepalive_count = 1 {{(pid=120740) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 18:01:00.051588 dv-cinder-852009-8-iscsi devstack@n-api.service[120741]: DEBUG nova.api.openstack.wsgi_app [-] glance.debug = False {{(pid=120741) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 18:01:00.051839 dv-cinder-852009-8-iscsi devstack@n-api.service[120740]: DEBUG nova.api.openstack.wsgi_app [-] cache.socket_keepalive_idle = 1 {{(pid=120740) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 18:01:00.051987 dv-cinder-852009-8-iscsi devstack@n-api.service[120741]: DEBUG nova.api.openstack.wsgi_app [-] glance.default_trusted_certificate_ids = [] {{(pid=120741) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 18:01:00.052603 dv-cinder-852009-8-iscsi devstack@n-api.service[120740]: DEBUG nova.api.openstack.wsgi_app [-] cache.socket_keepalive_interval = 1 {{(pid=120740) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 18:01:00.052768 dv-cinder-852009-8-iscsi devstack@n-api.service[120741]: DEBUG nova.api.openstack.wsgi_app [-] glance.enable_certificate_validation = False {{(pid=120741) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 18:01:00.052768 dv-cinder-852009-8-iscsi devstack@n-api.service[120741]: DEBUG nova.api.openstack.wsgi_app [-] glance.enable_rbd_download = False {{(pid=120741) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 18:01:00.053066 dv-cinder-852009-8-iscsi devstack@n-api.service[120740]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_allowed_ciphers = None {{(pid=120740) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 18:01:00.053228 dv-cinder-852009-8-iscsi devstack@n-api.service[120741]: DEBUG nova.api.openstack.wsgi_app [-] glance.endpoint_override = None {{(pid=120741) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 18:01:00.053374 dv-cinder-852009-8-iscsi devstack@n-api.service[120740]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_cafile = None {{(pid=120740) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 18:01:00.053531 dv-cinder-852009-8-iscsi devstack@n-api.service[120741]: DEBUG nova.api.openstack.wsgi_app [-] glance.insecure = False {{(pid=120741) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 18:01:00.053681 dv-cinder-852009-8-iscsi devstack@n-api.service[120740]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_certfile = None {{(pid=120740) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 18:01:00.053843 dv-cinder-852009-8-iscsi devstack@n-api.service[120741]: DEBUG nova.api.openstack.wsgi_app [-] glance.keyfile = None {{(pid=120741) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 18:01:00.053986 dv-cinder-852009-8-iscsi devstack@n-api.service[120740]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_enabled = False {{(pid=120740) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 18:01:00.054143 dv-cinder-852009-8-iscsi devstack@n-api.service[120741]: DEBUG nova.api.openstack.wsgi_app [-] glance.max_version = None {{(pid=120741) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 18:01:00.054306 dv-cinder-852009-8-iscsi devstack@n-api.service[120740]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_keyfile = None {{(pid=120740) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 18:01:00.054493 dv-cinder-852009-8-iscsi devstack@n-api.service[120741]: DEBUG nova.api.openstack.wsgi_app [-] glance.min_version = None {{(pid=120741) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 18:01:00.055100 dv-cinder-852009-8-iscsi devstack@n-api.service[120740]: DEBUG nova.api.openstack.wsgi_app [-] cinder.auth_section = None {{(pid=120740) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 18:01:00.055273 dv-cinder-852009-8-iscsi devstack@n-api.service[120741]: DEBUG nova.api.openstack.wsgi_app [-] glance.num_retries = 3 {{(pid=120741) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 18:01:00.055416 dv-cinder-852009-8-iscsi devstack@n-api.service[120740]: DEBUG nova.api.openstack.wsgi_app [-] cinder.auth_type = password {{(pid=120740) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 18:01:00.055556 dv-cinder-852009-8-iscsi devstack@n-api.service[120741]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_ceph_conf = {{(pid=120741) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 18:01:00.055716 dv-cinder-852009-8-iscsi devstack@n-api.service[120740]: DEBUG nova.api.openstack.wsgi_app [-] cinder.cafile = None {{(pid=120740) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 18:01:00.055866 dv-cinder-852009-8-iscsi devstack@n-api.service[120741]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_connect_timeout = 5 {{(pid=120741) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 18:01:00.056009 dv-cinder-852009-8-iscsi devstack@n-api.service[120740]: DEBUG nova.api.openstack.wsgi_app [-] cinder.catalog_info = volumev3::publicURL {{(pid=120740) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 18:01:00.056173 dv-cinder-852009-8-iscsi devstack@n-api.service[120741]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_pool = {{(pid=120741) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 18:01:00.056315 dv-cinder-852009-8-iscsi devstack@n-api.service[120740]: DEBUG nova.api.openstack.wsgi_app [-] cinder.certfile = None {{(pid=120740) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 18:01:00.056479 dv-cinder-852009-8-iscsi devstack@n-api.service[120741]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_user = {{(pid=120741) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 18:01:00.056635 dv-cinder-852009-8-iscsi devstack@n-api.service[120740]: DEBUG nova.api.openstack.wsgi_app [-] cinder.collect_timing = False {{(pid=120740) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 18:01:00.056776 dv-cinder-852009-8-iscsi devstack@n-api.service[120741]: DEBUG nova.api.openstack.wsgi_app [-] glance.region_name = None {{(pid=120741) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 18:01:00.057000 dv-cinder-852009-8-iscsi devstack@n-api.service[120740]: DEBUG nova.api.openstack.wsgi_app [-] cinder.cross_az_attach = True {{(pid=120740) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 18:01:00.057154 dv-cinder-852009-8-iscsi devstack@n-api.service[120741]: DEBUG nova.api.openstack.wsgi_app [-] glance.service_name = None {{(pid=120741) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 18:01:00.057296 dv-cinder-852009-8-iscsi devstack@n-api.service[120740]: DEBUG nova.api.openstack.wsgi_app [-] cinder.debug = False {{(pid=120740) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 18:01:00.057444 dv-cinder-852009-8-iscsi devstack@n-api.service[120741]: DEBUG nova.api.openstack.wsgi_app [-] glance.service_type = image {{(pid=120741) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 18:01:00.057592 dv-cinder-852009-8-iscsi devstack@n-api.service[120740]: DEBUG nova.api.openstack.wsgi_app [-] cinder.endpoint_template = None {{(pid=120740) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 18:01:00.057757 dv-cinder-852009-8-iscsi devstack@n-api.service[120741]: DEBUG nova.api.openstack.wsgi_app [-] glance.split_loggers = False {{(pid=120741) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 18:01:00.057757 dv-cinder-852009-8-iscsi devstack@n-api.service[120741]: DEBUG nova.api.openstack.wsgi_app [-] glance.status_code_retries = None {{(pid=120741) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 18:01:00.058044 dv-cinder-852009-8-iscsi devstack@n-api.service[120740]: DEBUG nova.api.openstack.wsgi_app [-] cinder.http_retries = 3 {{(pid=120740) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 18:01:00.058044 dv-cinder-852009-8-iscsi devstack@n-api.service[120740]: DEBUG nova.api.openstack.wsgi_app [-] cinder.insecure = False {{(pid=120740) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 18:01:00.058044 dv-cinder-852009-8-iscsi devstack@n-api.service[120740]: DEBUG nova.api.openstack.wsgi_app [-] cinder.keyfile = None {{(pid=120740) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 18:01:00.058441 dv-cinder-852009-8-iscsi devstack@n-api.service[120741]: DEBUG nova.api.openstack.wsgi_app [-] glance.status_code_retry_delay = None {{(pid=120741) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 18:01:00.058590 dv-cinder-852009-8-iscsi devstack@n-api.service[120740]: DEBUG nova.api.openstack.wsgi_app [-] cinder.os_region_name = RegionOne {{(pid=120740) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 18:01:00.058740 dv-cinder-852009-8-iscsi devstack@n-api.service[120741]: DEBUG nova.api.openstack.wsgi_app [-] glance.timeout = None {{(pid=120741) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 18:01:00.058889 dv-cinder-852009-8-iscsi devstack@n-api.service[120740]: DEBUG nova.api.openstack.wsgi_app [-] cinder.split_loggers = False {{(pid=120740) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 18:01:00.058889 dv-cinder-852009-8-iscsi devstack@n-api.service[120740]: DEBUG nova.api.openstack.wsgi_app [-] cinder.timeout = None {{(pid=120740) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 18:01:00.059179 dv-cinder-852009-8-iscsi devstack@n-api.service[120741]: DEBUG nova.api.openstack.wsgi_app [-] glance.valid_interfaces = ['internal', 'public'] {{(pid=120741) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 18:01:00.059328 dv-cinder-852009-8-iscsi devstack@n-api.service[120740]: DEBUG nova.api.openstack.wsgi_app [-] compute.consecutive_build_service_disable_threshold = 10 {{(pid=120740) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 18:01:00.059488 dv-cinder-852009-8-iscsi devstack@n-api.service[120741]: DEBUG nova.api.openstack.wsgi_app [-] glance.verify_glance_signatures = False {{(pid=120741) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 18:01:00.059639 dv-cinder-852009-8-iscsi devstack@n-api.service[120740]: DEBUG nova.api.openstack.wsgi_app [-] compute.cpu_dedicated_set = None {{(pid=120740) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 18:01:00.059780 dv-cinder-852009-8-iscsi devstack@n-api.service[120741]: DEBUG nova.api.openstack.wsgi_app [-] glance.version = None {{(pid=120741) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 18:01:00.059919 dv-cinder-852009-8-iscsi devstack@n-api.service[120740]: DEBUG nova.api.openstack.wsgi_app [-] compute.cpu_shared_set = None {{(pid=120740) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 18:01:00.060066 dv-cinder-852009-8-iscsi devstack@n-api.service[120741]: DEBUG nova.api.openstack.wsgi_app [-] guestfs.debug = False {{(pid=120741) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 18:01:00.060207 dv-cinder-852009-8-iscsi devstack@n-api.service[120740]: DEBUG nova.api.openstack.wsgi_app [-] compute.image_type_exclude_list = [] {{(pid=120740) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 18:01:00.060356 dv-cinder-852009-8-iscsi devstack@n-api.service[120741]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.config_drive_cdrom = False {{(pid=120741) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 18:01:00.060557 dv-cinder-852009-8-iscsi devstack@n-api.service[120740]: DEBUG nova.api.openstack.wsgi_app [-] compute.live_migration_wait_for_vif_plug = True {{(pid=120740) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 18:01:00.060700 dv-cinder-852009-8-iscsi devstack@n-api.service[120741]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.config_drive_inject_password = False {{(pid=120741) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 18:01:00.060840 dv-cinder-852009-8-iscsi devstack@n-api.service[120740]: DEBUG nova.api.openstack.wsgi_app [-] compute.max_concurrent_disk_ops = 0 {{(pid=120740) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 18:01:00.060979 dv-cinder-852009-8-iscsi devstack@n-api.service[120741]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.dynamic_memory_ratio = 1.0 {{(pid=120741) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 18:01:00.061126 dv-cinder-852009-8-iscsi devstack@n-api.service[120740]: DEBUG nova.api.openstack.wsgi_app [-] compute.max_disk_devices_to_attach = -1 {{(pid=120740) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 18:01:00.061294 dv-cinder-852009-8-iscsi devstack@n-api.service[120741]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.enable_instance_metrics_collection = False {{(pid=120741) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 18:01:00.061749 dv-cinder-852009-8-iscsi devstack@n-api.service[120740]: DEBUG nova.api.openstack.wsgi_app [-] compute.packing_host_numa_cells_allocation_strategy = False {{(pid=120740) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 18:01:00.062013 dv-cinder-852009-8-iscsi devstack@n-api.service[120741]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.enable_remotefx = False {{(pid=120741) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 18:01:00.062169 dv-cinder-852009-8-iscsi devstack@n-api.service[120740]: DEBUG nova.api.openstack.wsgi_app [-] compute.provider_config_location = /etc/nova/provider_config/ {{(pid=120740) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 18:01:00.062321 dv-cinder-852009-8-iscsi devstack@n-api.service[120741]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.instances_path_share = {{(pid=120741) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 18:01:00.062461 dv-cinder-852009-8-iscsi devstack@n-api.service[120740]: DEBUG nova.api.openstack.wsgi_app [-] compute.resource_provider_association_refresh = 300 {{(pid=120740) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 18:01:00.062612 dv-cinder-852009-8-iscsi devstack@n-api.service[120741]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.iscsi_initiator_list = [] {{(pid=120741) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 18:01:00.062753 dv-cinder-852009-8-iscsi devstack@n-api.service[120740]: DEBUG nova.api.openstack.wsgi_app [-] compute.shutdown_retry_interval = 10 {{(pid=120740) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 18:01:00.062901 dv-cinder-852009-8-iscsi devstack@n-api.service[120741]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.limit_cpu_features = False {{(pid=120741) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 18:01:00.063042 dv-cinder-852009-8-iscsi devstack@n-api.service[120740]: DEBUG nova.api.openstack.wsgi_app [-] conductor.workers = 2 {{(pid=120740) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 18:01:00.063197 dv-cinder-852009-8-iscsi devstack@n-api.service[120741]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.mounted_disk_query_retry_count = 10 {{(pid=120741) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 18:01:00.063350 dv-cinder-852009-8-iscsi devstack@n-api.service[120740]: DEBUG nova.api.openstack.wsgi_app [-] console.allowed_origins = [] {{(pid=120740) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 18:01:00.063505 dv-cinder-852009-8-iscsi devstack@n-api.service[120741]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.mounted_disk_query_retry_interval = 5 {{(pid=120741) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 18:01:00.063655 dv-cinder-852009-8-iscsi devstack@n-api.service[120740]: DEBUG nova.api.openstack.wsgi_app [-] console.ssl_ciphers = None {{(pid=120740) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 18:01:00.063807 dv-cinder-852009-8-iscsi devstack@n-api.service[120741]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.power_state_check_timeframe = 60 {{(pid=120741) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 18:01:00.063947 dv-cinder-852009-8-iscsi devstack@n-api.service[120740]: DEBUG nova.api.openstack.wsgi_app [-] console.ssl_minimum_version = default {{(pid=120740) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 18:01:00.064094 dv-cinder-852009-8-iscsi devstack@n-api.service[120741]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.power_state_event_polling_interval = 2 {{(pid=120741) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 18:01:00.064246 dv-cinder-852009-8-iscsi devstack@n-api.service[120740]: DEBUG nova.api.openstack.wsgi_app [-] consoleauth.token_ttl = 600 {{(pid=120740) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 18:01:00.064398 dv-cinder-852009-8-iscsi devstack@n-api.service[120741]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.qemu_img_cmd = qemu-img.exe {{(pid=120741) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 18:01:00.064609 dv-cinder-852009-8-iscsi devstack@n-api.service[120740]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.cafile = None {{(pid=120740) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 18:01:00.064751 dv-cinder-852009-8-iscsi devstack@n-api.service[120741]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.use_multipath_io = False {{(pid=120741) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 18:01:00.064995 dv-cinder-852009-8-iscsi devstack@n-api.service[120740]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.certfile = None {{(pid=120740) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 18:01:00.065377 dv-cinder-852009-8-iscsi devstack@n-api.service[120741]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.volume_attach_retry_count = 10 {{(pid=120741) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 18:01:00.065541 dv-cinder-852009-8-iscsi devstack@n-api.service[120740]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.collect_timing = False {{(pid=120740) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 18:01:00.065683 dv-cinder-852009-8-iscsi devstack@n-api.service[120741]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.volume_attach_retry_interval = 5 {{(pid=120741) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 18:01:00.065831 dv-cinder-852009-8-iscsi devstack@n-api.service[120740]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.connect_retries = None {{(pid=120740) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 18:01:00.065983 dv-cinder-852009-8-iscsi devstack@n-api.service[120741]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.vswitch_name = None {{(pid=120741) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 18:01:00.066133 dv-cinder-852009-8-iscsi devstack@n-api.service[120740]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.connect_retry_delay = None {{(pid=120740) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 18:01:00.066285 dv-cinder-852009-8-iscsi devstack@n-api.service[120741]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.wait_soft_reboot_seconds = 60 {{(pid=120741) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 18:01:00.066448 dv-cinder-852009-8-iscsi devstack@n-api.service[120740]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.endpoint_override = None {{(pid=120740) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 18:01:00.066600 dv-cinder-852009-8-iscsi devstack@n-api.service[120741]: DEBUG nova.api.openstack.wsgi_app [-] mks.enabled = False {{(pid=120741) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 18:01:00.066750 dv-cinder-852009-8-iscsi devstack@n-api.service[120740]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.insecure = False {{(pid=120740) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 18:01:00.066750 dv-cinder-852009-8-iscsi devstack@n-api.service[120740]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.keyfile = None {{(pid=120740) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 18:01:00.067025 dv-cinder-852009-8-iscsi devstack@n-api.service[120741]: DEBUG nova.api.openstack.wsgi_app [-] mks.mksproxy_base_url = http://127.0.0.1:6090/ {{(pid=120741) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 18:01:00.067174 dv-cinder-852009-8-iscsi devstack@n-api.service[120740]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.max_version = None {{(pid=120740) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 18:01:00.067331 dv-cinder-852009-8-iscsi devstack@n-api.service[120741]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.manager_interval = 2400 {{(pid=120741) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 18:01:00.067479 dv-cinder-852009-8-iscsi devstack@n-api.service[120740]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.min_version = None {{(pid=120740) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 18:01:00.067650 dv-cinder-852009-8-iscsi devstack@n-api.service[120741]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.precache_concurrency = 1 {{(pid=120741) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 18:01:00.067795 dv-cinder-852009-8-iscsi devstack@n-api.service[120740]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.region_name = None {{(pid=120740) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 18:01:00.067946 dv-cinder-852009-8-iscsi devstack@n-api.service[120741]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.remove_unused_base_images = True {{(pid=120741) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 18:01:00.068098 dv-cinder-852009-8-iscsi devstack@n-api.service[120740]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.service_name = None {{(pid=120740) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 18:01:00.068240 dv-cinder-852009-8-iscsi devstack@n-api.service[120741]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.remove_unused_original_minimum_age_seconds = 86400 {{(pid=120741) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 18:01:00.068381 dv-cinder-852009-8-iscsi devstack@n-api.service[120740]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.service_type = accelerator {{(pid=120740) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 18:01:00.068622 dv-cinder-852009-8-iscsi devstack@n-api.service[120741]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.remove_unused_resized_minimum_age_seconds = 3600 {{(pid=120741) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 18:01:00.068775 dv-cinder-852009-8-iscsi devstack@n-api.service[120740]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.split_loggers = False {{(pid=120740) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 18:01:00.068925 dv-cinder-852009-8-iscsi devstack@n-api.service[120741]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.subdirectory_name = _base {{(pid=120741) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 18:01:00.069074 dv-cinder-852009-8-iscsi devstack@n-api.service[120740]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.status_code_retries = None {{(pid=120740) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 18:01:00.069215 dv-cinder-852009-8-iscsi devstack@n-api.service[120741]: DEBUG nova.api.openstack.wsgi_app [-] ironic.api_max_retries = 60 {{(pid=120741) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 18:01:00.069363 dv-cinder-852009-8-iscsi devstack@n-api.service[120740]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.status_code_retry_delay = None {{(pid=120740) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 18:01:00.069503 dv-cinder-852009-8-iscsi devstack@n-api.service[120741]: DEBUG nova.api.openstack.wsgi_app [-] ironic.api_retry_interval = 2 {{(pid=120741) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 18:01:00.069659 dv-cinder-852009-8-iscsi devstack@n-api.service[120740]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.timeout = None {{(pid=120740) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 18:01:00.069815 dv-cinder-852009-8-iscsi devstack@n-api.service[120741]: DEBUG nova.api.openstack.wsgi_app [-] ironic.auth_section = None {{(pid=120741) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 18:01:00.069968 dv-cinder-852009-8-iscsi devstack@n-api.service[120740]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.valid_interfaces = ['internal', 'public'] {{(pid=120740) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 18:01:00.070117 dv-cinder-852009-8-iscsi devstack@n-api.service[120741]: DEBUG nova.api.openstack.wsgi_app [-] ironic.auth_type = None {{(pid=120741) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 18:01:00.070258 dv-cinder-852009-8-iscsi devstack@n-api.service[120740]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.version = None {{(pid=120740) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 18:01:00.070411 dv-cinder-852009-8-iscsi devstack@n-api.service[120741]: DEBUG nova.api.openstack.wsgi_app [-] ironic.cafile = None {{(pid=120741) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 18:01:00.070560 dv-cinder-852009-8-iscsi devstack@n-api.service[120740]: DEBUG nova.api.openstack.wsgi_app [-] database.backend = sqlalchemy {{(pid=120740) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 18:01:00.070711 dv-cinder-852009-8-iscsi devstack@n-api.service[120741]: DEBUG nova.api.openstack.wsgi_app [-] ironic.certfile = None {{(pid=120741) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 18:01:00.070860 dv-cinder-852009-8-iscsi devstack@n-api.service[120740]: DEBUG nova.api.openstack.wsgi_app [-] database.connection = **** {{(pid=120740) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 18:01:00.071002 dv-cinder-852009-8-iscsi devstack@n-api.service[120741]: DEBUG nova.api.openstack.wsgi_app [-] ironic.collect_timing = False {{(pid=120741) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 18:01:00.071141 dv-cinder-852009-8-iscsi devstack@n-api.service[120740]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_debug = 0 {{(pid=120740) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 18:01:00.071292 dv-cinder-852009-8-iscsi devstack@n-api.service[120741]: DEBUG nova.api.openstack.wsgi_app [-] ironic.connect_retries = None {{(pid=120741) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 18:01:00.071434 dv-cinder-852009-8-iscsi devstack@n-api.service[120740]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_parameters = {{(pid=120740) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 18:01:00.071858 dv-cinder-852009-8-iscsi devstack@n-api.service[120741]: DEBUG nova.api.openstack.wsgi_app [-] ironic.connect_retry_delay = None {{(pid=120741) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 18:01:00.072028 dv-cinder-852009-8-iscsi devstack@n-api.service[120740]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_recycle_time = 3600 {{(pid=120740) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 18:01:00.072276 dv-cinder-852009-8-iscsi devstack@n-api.service[120741]: DEBUG nova.api.openstack.wsgi_app [-] ironic.endpoint_override = None {{(pid=120741) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 18:01:00.072441 dv-cinder-852009-8-iscsi devstack@n-api.service[120740]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_trace = False {{(pid=120740) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 18:01:00.072601 dv-cinder-852009-8-iscsi devstack@n-api.service[120741]: DEBUG nova.api.openstack.wsgi_app [-] ironic.insecure = False {{(pid=120741) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 18:01:00.072752 dv-cinder-852009-8-iscsi devstack@n-api.service[120740]: DEBUG nova.api.openstack.wsgi_app [-] database.db_inc_retry_interval = True {{(pid=120740) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 18:01:00.072900 dv-cinder-852009-8-iscsi devstack@n-api.service[120741]: DEBUG nova.api.openstack.wsgi_app [-] ironic.keyfile = None {{(pid=120741) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 18:01:00.073055 dv-cinder-852009-8-iscsi devstack@n-api.service[120740]: DEBUG nova.api.openstack.wsgi_app [-] database.db_max_retries = 20 {{(pid=120740) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 18:01:00.073203 dv-cinder-852009-8-iscsi devstack@n-api.service[120741]: DEBUG nova.api.openstack.wsgi_app [-] ironic.max_version = None {{(pid=120741) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 18:01:00.073349 dv-cinder-852009-8-iscsi devstack@n-api.service[120740]: DEBUG nova.api.openstack.wsgi_app [-] database.db_max_retry_interval = 10 {{(pid=120740) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 18:01:00.073505 dv-cinder-852009-8-iscsi devstack@n-api.service[120741]: DEBUG nova.api.openstack.wsgi_app [-] ironic.min_version = None {{(pid=120741) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 18:01:00.073653 dv-cinder-852009-8-iscsi devstack@n-api.service[120740]: DEBUG nova.api.openstack.wsgi_app [-] database.db_retry_interval = 1 {{(pid=120740) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 18:01:00.073807 dv-cinder-852009-8-iscsi devstack@n-api.service[120741]: DEBUG nova.api.openstack.wsgi_app [-] ironic.partition_key = None {{(pid=120741) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 18:01:00.073954 dv-cinder-852009-8-iscsi devstack@n-api.service[120740]: DEBUG nova.api.openstack.wsgi_app [-] database.max_overflow = 50 {{(pid=120740) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 18:01:00.074124 dv-cinder-852009-8-iscsi devstack@n-api.service[120741]: DEBUG nova.api.openstack.wsgi_app [-] ironic.peer_list = [] {{(pid=120741) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 18:01:00.074285 dv-cinder-852009-8-iscsi devstack@n-api.service[120740]: DEBUG nova.api.openstack.wsgi_app [-] database.max_pool_size = 5 {{(pid=120740) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 18:01:00.074443 dv-cinder-852009-8-iscsi devstack@n-api.service[120741]: DEBUG nova.api.openstack.wsgi_app [-] ironic.region_name = None {{(pid=120741) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 18:01:00.074642 dv-cinder-852009-8-iscsi devstack@n-api.service[120740]: DEBUG nova.api.openstack.wsgi_app [-] database.max_retries = 10 {{(pid=120740) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 18:01:00.074793 dv-cinder-852009-8-iscsi devstack@n-api.service[120741]: DEBUG nova.api.openstack.wsgi_app [-] ironic.serial_console_state_timeout = 10 {{(pid=120741) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 18:01:00.074957 dv-cinder-852009-8-iscsi devstack@n-api.service[120740]: DEBUG nova.api.openstack.wsgi_app [-] database.mysql_enable_ndb = False {{(pid=120740) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 18:01:00.075174 dv-cinder-852009-8-iscsi devstack@n-api.service[120741]: DEBUG nova.api.openstack.wsgi_app [-] ironic.service_name = None {{(pid=120741) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 18:01:00.075570 dv-cinder-852009-8-iscsi devstack@n-api.service[120740]: DEBUG nova.api.openstack.wsgi_app [-] database.mysql_sql_mode = TRADITIONAL {{(pid=120740) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 18:01:00.075732 dv-cinder-852009-8-iscsi devstack@n-api.service[120741]: DEBUG nova.api.openstack.wsgi_app [-] ironic.service_type = baremetal {{(pid=120741) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 18:01:00.075883 dv-cinder-852009-8-iscsi devstack@n-api.service[120740]: DEBUG nova.api.openstack.wsgi_app [-] database.pool_timeout = None {{(pid=120740) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 18:01:00.076038 dv-cinder-852009-8-iscsi devstack@n-api.service[120741]: DEBUG nova.api.openstack.wsgi_app [-] ironic.split_loggers = False {{(pid=120741) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 18:01:00.076038 dv-cinder-852009-8-iscsi devstack@n-api.service[120741]: DEBUG nova.api.openstack.wsgi_app [-] ironic.status_code_retries = None {{(pid=120741) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 18:01:00.076343 dv-cinder-852009-8-iscsi devstack@n-api.service[120740]: DEBUG nova.api.openstack.wsgi_app [-] database.retry_interval = 10 {{(pid=120740) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 18:01:00.076575 dv-cinder-852009-8-iscsi devstack@n-api.service[120741]: DEBUG nova.api.openstack.wsgi_app [-] ironic.status_code_retry_delay = None {{(pid=120741) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 18:01:00.076735 dv-cinder-852009-8-iscsi devstack@n-api.service[120740]: DEBUG nova.api.openstack.wsgi_app [-] database.slave_connection = **** {{(pid=120740) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 18:01:00.076883 dv-cinder-852009-8-iscsi devstack@n-api.service[120741]: DEBUG nova.api.openstack.wsgi_app [-] ironic.timeout = None {{(pid=120741) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 18:01:00.077042 dv-cinder-852009-8-iscsi devstack@n-api.service[120740]: DEBUG nova.api.openstack.wsgi_app [-] database.sqlite_synchronous = True {{(pid=120740) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 18:01:00.077207 dv-cinder-852009-8-iscsi devstack@n-api.service[120741]: DEBUG nova.api.openstack.wsgi_app [-] ironic.valid_interfaces = ['internal', 'public'] {{(pid=120741) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 18:01:00.077359 dv-cinder-852009-8-iscsi devstack@n-api.service[120740]: DEBUG nova.api.openstack.wsgi_app [-] api_database.backend = sqlalchemy {{(pid=120740) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 18:01:00.077515 dv-cinder-852009-8-iscsi devstack@n-api.service[120741]: DEBUG nova.api.openstack.wsgi_app [-] ironic.version = None {{(pid=120741) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 18:01:00.077664 dv-cinder-852009-8-iscsi devstack@n-api.service[120740]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection = **** {{(pid=120740) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 18:01:00.077823 dv-cinder-852009-8-iscsi devstack@n-api.service[120741]: DEBUG nova.api.openstack.wsgi_app [-] key_manager.backend = nova.keymgr.conf_key_mgr.ConfKeyManager {{(pid=120741) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 18:01:00.077973 dv-cinder-852009-8-iscsi devstack@n-api.service[120740]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_debug = 0 {{(pid=120740) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 18:01:00.078120 dv-cinder-852009-8-iscsi devstack@n-api.service[120741]: DEBUG nova.api.openstack.wsgi_app [-] key_manager.fixed_key = **** {{(pid=120741) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 18:01:00.078280 dv-cinder-852009-8-iscsi devstack@n-api.service[120740]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_parameters = {{(pid=120740) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 18:01:00.078429 dv-cinder-852009-8-iscsi devstack@n-api.service[120741]: DEBUG nova.api.openstack.wsgi_app [-] barbican.auth_endpoint = http://localhost/identity/v3 {{(pid=120741) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 18:01:00.078587 dv-cinder-852009-8-iscsi devstack@n-api.service[120740]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_recycle_time = 3600 {{(pid=120740) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 18:01:00.078734 dv-cinder-852009-8-iscsi devstack@n-api.service[120741]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_api_version = None {{(pid=120741) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 18:01:00.078888 dv-cinder-852009-8-iscsi devstack@n-api.service[120740]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_trace = False {{(pid=120740) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 18:01:00.079045 dv-cinder-852009-8-iscsi devstack@n-api.service[120741]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_endpoint = None {{(pid=120741) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 18:01:00.079205 dv-cinder-852009-8-iscsi devstack@n-api.service[120740]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_inc_retry_interval = True {{(pid=120740) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 18:01:00.079353 dv-cinder-852009-8-iscsi devstack@n-api.service[120741]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_endpoint_type = public {{(pid=120741) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 18:01:00.079499 dv-cinder-852009-8-iscsi devstack@n-api.service[120740]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_max_retries = 20 {{(pid=120740) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 18:01:00.079645 dv-cinder-852009-8-iscsi devstack@n-api.service[120741]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_region_name = None {{(pid=120741) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 18:01:00.079809 dv-cinder-852009-8-iscsi devstack@n-api.service[120740]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_max_retry_interval = 10 {{(pid=120740) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 18:01:00.079967 dv-cinder-852009-8-iscsi devstack@n-api.service[120741]: DEBUG nova.api.openstack.wsgi_app [-] barbican.cafile = None {{(pid=120741) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 18:01:00.080131 dv-cinder-852009-8-iscsi devstack@n-api.service[120740]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_retry_interval = 1 {{(pid=120740) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 18:01:00.080285 dv-cinder-852009-8-iscsi devstack@n-api.service[120741]: DEBUG nova.api.openstack.wsgi_app [-] barbican.certfile = None {{(pid=120741) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 18:01:00.080450 dv-cinder-852009-8-iscsi devstack@n-api.service[120740]: DEBUG nova.api.openstack.wsgi_app [-] api_database.max_overflow = 50 {{(pid=120740) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 18:01:00.080623 dv-cinder-852009-8-iscsi devstack@n-api.service[120741]: DEBUG nova.api.openstack.wsgi_app [-] barbican.collect_timing = False {{(pid=120741) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 18:01:00.080779 dv-cinder-852009-8-iscsi devstack@n-api.service[120740]: DEBUG nova.api.openstack.wsgi_app [-] api_database.max_pool_size = 5 {{(pid=120740) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 18:01:00.080976 dv-cinder-852009-8-iscsi devstack@n-api.service[120741]: DEBUG nova.api.openstack.wsgi_app [-] barbican.insecure = False {{(pid=120741) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 18:01:00.081134 dv-cinder-852009-8-iscsi devstack@n-api.service[120740]: DEBUG nova.api.openstack.wsgi_app [-] api_database.max_retries = 10 {{(pid=120740) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 18:01:00.081282 dv-cinder-852009-8-iscsi devstack@n-api.service[120741]: DEBUG nova.api.openstack.wsgi_app [-] barbican.keyfile = None {{(pid=120741) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 18:01:00.081430 dv-cinder-852009-8-iscsi devstack@n-api.service[120740]: DEBUG nova.api.openstack.wsgi_app [-] api_database.mysql_enable_ndb = False {{(pid=120740) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 18:01:00.081576 dv-cinder-852009-8-iscsi devstack@n-api.service[120741]: DEBUG nova.api.openstack.wsgi_app [-] barbican.number_of_retries = 60 {{(pid=120741) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 18:01:00.081576 dv-cinder-852009-8-iscsi devstack@n-api.service[120741]: DEBUG nova.api.openstack.wsgi_app [-] barbican.retry_delay = 1 {{(pid=120741) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 18:01:00.082176 dv-cinder-852009-8-iscsi devstack@n-api.service[120740]: DEBUG nova.api.openstack.wsgi_app [-] api_database.mysql_sql_mode = TRADITIONAL {{(pid=120740) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 18:01:00.082452 dv-cinder-852009-8-iscsi devstack@n-api.service[120741]: DEBUG nova.api.openstack.wsgi_app [-] barbican.send_service_user_token = False {{(pid=120741) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 18:01:00.082615 dv-cinder-852009-8-iscsi devstack@n-api.service[120740]: DEBUG nova.api.openstack.wsgi_app [-] api_database.pool_timeout = None {{(pid=120740) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 18:01:00.082772 dv-cinder-852009-8-iscsi devstack@n-api.service[120741]: DEBUG nova.api.openstack.wsgi_app [-] barbican.split_loggers = False {{(pid=120741) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 18:01:00.082921 dv-cinder-852009-8-iscsi devstack@n-api.service[120740]: DEBUG nova.api.openstack.wsgi_app [-] api_database.retry_interval = 10 {{(pid=120740) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 18:01:00.083089 dv-cinder-852009-8-iscsi devstack@n-api.service[120741]: DEBUG nova.api.openstack.wsgi_app [-] barbican.timeout = None {{(pid=120741) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 18:01:00.083375 dv-cinder-852009-8-iscsi devstack@n-api.service[120740]: DEBUG nova.api.openstack.wsgi_app [-] api_database.slave_connection = **** {{(pid=120740) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 18:01:00.083531 dv-cinder-852009-8-iscsi devstack@n-api.service[120741]: DEBUG nova.api.openstack.wsgi_app [-] barbican.verify_ssl = True {{(pid=120741) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 18:01:00.083679 dv-cinder-852009-8-iscsi devstack@n-api.service[120740]: DEBUG nova.api.openstack.wsgi_app [-] api_database.sqlite_synchronous = True {{(pid=120740) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 18:01:00.083834 dv-cinder-852009-8-iscsi devstack@n-api.service[120741]: DEBUG nova.api.openstack.wsgi_app [-] barbican.verify_ssl_path = None {{(pid=120741) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 18:01:00.083991 dv-cinder-852009-8-iscsi devstack@n-api.service[120740]: DEBUG nova.api.openstack.wsgi_app [-] devices.enabled_mdev_types = [] {{(pid=120740) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 18:01:00.084147 dv-cinder-852009-8-iscsi devstack@n-api.service[120741]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.auth_section = None {{(pid=120741) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 18:01:00.084307 dv-cinder-852009-8-iscsi devstack@n-api.service[120740]: DEBUG nova.api.openstack.wsgi_app [-] ephemeral_storage_encryption.cipher = aes-xts-plain64 {{(pid=120740) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 18:01:00.084497 dv-cinder-852009-8-iscsi devstack@n-api.service[120741]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.auth_type = None {{(pid=120741) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 18:01:00.084703 dv-cinder-852009-8-iscsi devstack@n-api.service[120740]: DEBUG nova.api.openstack.wsgi_app [-] ephemeral_storage_encryption.enabled = False {{(pid=120740) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 18:01:00.084855 dv-cinder-852009-8-iscsi devstack@n-api.service[120741]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.cafile = None {{(pid=120741) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 18:01:00.085012 dv-cinder-852009-8-iscsi devstack@n-api.service[120740]: DEBUG nova.api.openstack.wsgi_app [-] ephemeral_storage_encryption.key_size = 512 {{(pid=120740) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 18:01:00.085197 dv-cinder-852009-8-iscsi devstack@n-api.service[120741]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.certfile = None {{(pid=120741) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 18:01:00.085445 dv-cinder-852009-8-iscsi devstack@n-api.service[120740]: DEBUG nova.api.openstack.wsgi_app [-] glance.api_servers = None {{(pid=120740) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 18:01:00.085913 dv-cinder-852009-8-iscsi devstack@n-api.service[120741]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.collect_timing = False {{(pid=120741) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 18:01:00.086071 dv-cinder-852009-8-iscsi devstack@n-api.service[120740]: DEBUG nova.api.openstack.wsgi_app [-] glance.cafile = None {{(pid=120740) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 18:01:00.086239 dv-cinder-852009-8-iscsi devstack@n-api.service[120741]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.insecure = False {{(pid=120741) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 18:01:00.086389 dv-cinder-852009-8-iscsi devstack@n-api.service[120740]: DEBUG nova.api.openstack.wsgi_app [-] glance.certfile = None {{(pid=120740) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 18:01:00.086546 dv-cinder-852009-8-iscsi devstack@n-api.service[120741]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.keyfile = None {{(pid=120741) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 18:01:00.086701 dv-cinder-852009-8-iscsi devstack@n-api.service[120740]: DEBUG nova.api.openstack.wsgi_app [-] glance.collect_timing = False {{(pid=120740) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 18:01:00.086856 dv-cinder-852009-8-iscsi devstack@n-api.service[120741]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.split_loggers = False {{(pid=120741) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 18:01:00.087004 dv-cinder-852009-8-iscsi devstack@n-api.service[120740]: DEBUG nova.api.openstack.wsgi_app [-] glance.connect_retries = None {{(pid=120740) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 18:01:00.087158 dv-cinder-852009-8-iscsi devstack@n-api.service[120741]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.timeout = None {{(pid=120741) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 18:01:00.087314 dv-cinder-852009-8-iscsi devstack@n-api.service[120740]: DEBUG nova.api.openstack.wsgi_app [-] glance.connect_retry_delay = None {{(pid=120740) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 18:01:00.087479 dv-cinder-852009-8-iscsi devstack@n-api.service[120741]: DEBUG nova.api.openstack.wsgi_app [-] vault.approle_role_id = None {{(pid=120741) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 18:01:00.087479 dv-cinder-852009-8-iscsi devstack@n-api.service[120741]: DEBUG nova.api.openstack.wsgi_app [-] vault.approle_secret_id = None {{(pid=120741) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 18:01:00.087780 dv-cinder-852009-8-iscsi devstack@n-api.service[120740]: DEBUG nova.api.openstack.wsgi_app [-] glance.debug = False {{(pid=120740) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 18:01:00.087929 dv-cinder-852009-8-iscsi devstack@n-api.service[120741]: DEBUG nova.api.openstack.wsgi_app [-] vault.cafile = None {{(pid=120741) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 18:01:00.088084 dv-cinder-852009-8-iscsi devstack@n-api.service[120740]: DEBUG nova.api.openstack.wsgi_app [-] glance.default_trusted_certificate_ids = [] {{(pid=120740) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 18:01:00.088233 dv-cinder-852009-8-iscsi devstack@n-api.service[120741]: DEBUG nova.api.openstack.wsgi_app [-] vault.certfile = None {{(pid=120741) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 18:01:00.088394 dv-cinder-852009-8-iscsi devstack@n-api.service[120740]: DEBUG nova.api.openstack.wsgi_app [-] glance.enable_certificate_validation = False {{(pid=120740) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 18:01:00.088579 dv-cinder-852009-8-iscsi devstack@n-api.service[120741]: DEBUG nova.api.openstack.wsgi_app [-] vault.collect_timing = False {{(pid=120741) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 18:01:00.088730 dv-cinder-852009-8-iscsi devstack@n-api.service[120740]: DEBUG nova.api.openstack.wsgi_app [-] glance.enable_rbd_download = False {{(pid=120740) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 18:01:00.088885 dv-cinder-852009-8-iscsi devstack@n-api.service[120741]: DEBUG nova.api.openstack.wsgi_app [-] vault.insecure = False {{(pid=120741) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 18:01:00.089044 dv-cinder-852009-8-iscsi devstack@n-api.service[120740]: DEBUG nova.api.openstack.wsgi_app [-] glance.endpoint_override = None {{(pid=120740) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 18:01:00.089191 dv-cinder-852009-8-iscsi devstack@n-api.service[120741]: DEBUG nova.api.openstack.wsgi_app [-] vault.keyfile = None {{(pid=120741) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 18:01:00.089423 dv-cinder-852009-8-iscsi devstack@n-api.service[120740]: DEBUG nova.api.openstack.wsgi_app [-] glance.insecure = False {{(pid=120740) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 18:01:00.089576 dv-cinder-852009-8-iscsi devstack@n-api.service[120741]: DEBUG nova.api.openstack.wsgi_app [-] vault.kv_mountpoint = secret {{(pid=120741) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 18:01:00.089745 dv-cinder-852009-8-iscsi devstack@n-api.service[120740]: DEBUG nova.api.openstack.wsgi_app [-] glance.keyfile = None {{(pid=120740) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 18:01:00.089893 dv-cinder-852009-8-iscsi devstack@n-api.service[120741]: DEBUG nova.api.openstack.wsgi_app [-] vault.kv_version = 2 {{(pid=120741) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 18:01:00.090048 dv-cinder-852009-8-iscsi devstack@n-api.service[120740]: DEBUG nova.api.openstack.wsgi_app [-] glance.max_version = None {{(pid=120740) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 18:01:00.090204 dv-cinder-852009-8-iscsi devstack@n-api.service[120741]: DEBUG nova.api.openstack.wsgi_app [-] vault.namespace = None {{(pid=120741) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 18:01:00.090361 dv-cinder-852009-8-iscsi devstack@n-api.service[120740]: DEBUG nova.api.openstack.wsgi_app [-] glance.min_version = None {{(pid=120740) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 18:01:00.090509 dv-cinder-852009-8-iscsi devstack@n-api.service[120741]: DEBUG nova.api.openstack.wsgi_app [-] vault.root_token_id = None {{(pid=120741) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 18:01:00.090657 dv-cinder-852009-8-iscsi devstack@n-api.service[120740]: DEBUG nova.api.openstack.wsgi_app [-] glance.num_retries = 3 {{(pid=120740) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 18:01:00.090821 dv-cinder-852009-8-iscsi devstack@n-api.service[120741]: DEBUG nova.api.openstack.wsgi_app [-] vault.split_loggers = False {{(pid=120741) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 18:01:00.091062 dv-cinder-852009-8-iscsi devstack@n-api.service[120740]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_ceph_conf = {{(pid=120740) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 18:01:00.091225 dv-cinder-852009-8-iscsi devstack@n-api.service[120741]: DEBUG nova.api.openstack.wsgi_app [-] vault.ssl_ca_crt_file = None {{(pid=120741) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 18:01:00.091391 dv-cinder-852009-8-iscsi devstack@n-api.service[120740]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_connect_timeout = 5 {{(pid=120740) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 18:01:00.091547 dv-cinder-852009-8-iscsi devstack@n-api.service[120741]: DEBUG nova.api.openstack.wsgi_app [-] vault.timeout = None {{(pid=120741) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 18:01:00.091704 dv-cinder-852009-8-iscsi devstack@n-api.service[120740]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_pool = {{(pid=120740) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 18:01:00.091862 dv-cinder-852009-8-iscsi devstack@n-api.service[120741]: DEBUG nova.api.openstack.wsgi_app [-] vault.use_ssl = False {{(pid=120741) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 18:01:00.092284 dv-cinder-852009-8-iscsi devstack@n-api.service[120740]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_user = {{(pid=120740) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 18:01:00.092493 dv-cinder-852009-8-iscsi devstack@n-api.service[120741]: DEBUG nova.api.openstack.wsgi_app [-] vault.vault_url = http://127.0.0.1:8200 {{(pid=120741) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 18:01:00.092736 dv-cinder-852009-8-iscsi devstack@n-api.service[120740]: DEBUG nova.api.openstack.wsgi_app [-] glance.region_name = None {{(pid=120740) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 18:01:00.092902 dv-cinder-852009-8-iscsi devstack@n-api.service[120741]: DEBUG nova.api.openstack.wsgi_app [-] keystone.cafile = None {{(pid=120741) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 18:01:00.093051 dv-cinder-852009-8-iscsi devstack@n-api.service[120740]: DEBUG nova.api.openstack.wsgi_app [-] glance.service_name = None {{(pid=120740) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 18:01:00.093197 dv-cinder-852009-8-iscsi devstack@n-api.service[120741]: DEBUG nova.api.openstack.wsgi_app [-] keystone.certfile = None {{(pid=120741) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 18:01:00.093344 dv-cinder-852009-8-iscsi devstack@n-api.service[120740]: DEBUG nova.api.openstack.wsgi_app [-] glance.service_type = image {{(pid=120740) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 18:01:00.093500 dv-cinder-852009-8-iscsi devstack@n-api.service[120741]: DEBUG nova.api.openstack.wsgi_app [-] keystone.collect_timing = False {{(pid=120741) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 18:01:00.093650 dv-cinder-852009-8-iscsi devstack@n-api.service[120740]: DEBUG nova.api.openstack.wsgi_app [-] glance.split_loggers = False {{(pid=120740) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 18:01:00.093806 dv-cinder-852009-8-iscsi devstack@n-api.service[120741]: DEBUG nova.api.openstack.wsgi_app [-] keystone.connect_retries = None {{(pid=120741) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 18:01:00.093955 dv-cinder-852009-8-iscsi devstack@n-api.service[120740]: DEBUG nova.api.openstack.wsgi_app [-] glance.status_code_retries = None {{(pid=120740) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 18:01:00.094102 dv-cinder-852009-8-iscsi devstack@n-api.service[120741]: DEBUG nova.api.openstack.wsgi_app [-] keystone.connect_retry_delay = None {{(pid=120741) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 18:01:00.094273 dv-cinder-852009-8-iscsi devstack@n-api.service[120740]: DEBUG nova.api.openstack.wsgi_app [-] glance.status_code_retry_delay = None {{(pid=120740) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 18:01:00.094422 dv-cinder-852009-8-iscsi devstack@n-api.service[120741]: DEBUG nova.api.openstack.wsgi_app [-] keystone.endpoint_override = None {{(pid=120741) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 18:01:00.094577 dv-cinder-852009-8-iscsi devstack@n-api.service[120740]: DEBUG nova.api.openstack.wsgi_app [-] glance.timeout = None {{(pid=120740) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 18:01:00.094770 dv-cinder-852009-8-iscsi devstack@n-api.service[120741]: DEBUG nova.api.openstack.wsgi_app [-] keystone.insecure = False {{(pid=120741) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 18:01:00.094924 dv-cinder-852009-8-iscsi devstack@n-api.service[120740]: DEBUG nova.api.openstack.wsgi_app [-] glance.valid_interfaces = ['internal', 'public'] {{(pid=120740) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 18:01:00.095072 dv-cinder-852009-8-iscsi devstack@n-api.service[120741]: DEBUG nova.api.openstack.wsgi_app [-] keystone.keyfile = None {{(pid=120741) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 18:01:00.095234 dv-cinder-852009-8-iscsi devstack@n-api.service[120740]: DEBUG nova.api.openstack.wsgi_app [-] glance.verify_glance_signatures = False {{(pid=120740) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 18:01:00.095399 dv-cinder-852009-8-iscsi devstack@n-api.service[120741]: DEBUG nova.api.openstack.wsgi_app [-] keystone.max_version = None {{(pid=120741) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 18:01:00.095637 dv-cinder-852009-8-iscsi devstack@n-api.service[120740]: DEBUG nova.api.openstack.wsgi_app [-] glance.version = None {{(pid=120740) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 18:01:00.095934 dv-cinder-852009-8-iscsi devstack@n-api.service[120741]: DEBUG nova.api.openstack.wsgi_app [-] keystone.min_version = None {{(pid=120741) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 18:01:00.096114 dv-cinder-852009-8-iscsi devstack@n-api.service[120740]: DEBUG nova.api.openstack.wsgi_app [-] guestfs.debug = False {{(pid=120740) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 18:01:00.096346 dv-cinder-852009-8-iscsi devstack@n-api.service[120741]: DEBUG nova.api.openstack.wsgi_app [-] keystone.region_name = None {{(pid=120741) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 18:01:00.096618 dv-cinder-852009-8-iscsi devstack@n-api.service[120740]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.config_drive_cdrom = False {{(pid=120740) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 18:01:00.096780 dv-cinder-852009-8-iscsi devstack@n-api.service[120741]: DEBUG nova.api.openstack.wsgi_app [-] keystone.service_name = None {{(pid=120741) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 18:01:00.096931 dv-cinder-852009-8-iscsi devstack@n-api.service[120740]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.config_drive_inject_password = False {{(pid=120740) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 18:01:00.097078 dv-cinder-852009-8-iscsi devstack@n-api.service[120741]: DEBUG nova.api.openstack.wsgi_app [-] keystone.service_type = identity {{(pid=120741) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 18:01:00.097233 dv-cinder-852009-8-iscsi devstack@n-api.service[120740]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.dynamic_memory_ratio = 1.0 {{(pid=120740) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 18:01:00.097381 dv-cinder-852009-8-iscsi devstack@n-api.service[120741]: DEBUG nova.api.openstack.wsgi_app [-] keystone.split_loggers = False {{(pid=120741) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 18:01:00.097608 dv-cinder-852009-8-iscsi devstack@n-api.service[120740]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.enable_instance_metrics_collection = False {{(pid=120740) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 18:01:00.097766 dv-cinder-852009-8-iscsi devstack@n-api.service[120741]: DEBUG nova.api.openstack.wsgi_app [-] keystone.status_code_retries = None {{(pid=120741) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 18:01:00.097766 dv-cinder-852009-8-iscsi devstack@n-api.service[120741]: DEBUG nova.api.openstack.wsgi_app [-] keystone.status_code_retry_delay = None {{(pid=120741) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 18:01:00.098058 dv-cinder-852009-8-iscsi devstack@n-api.service[120740]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.enable_remotefx = False {{(pid=120740) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 18:01:00.098204 dv-cinder-852009-8-iscsi devstack@n-api.service[120741]: DEBUG nova.api.openstack.wsgi_app [-] keystone.timeout = None {{(pid=120741) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 18:01:00.098360 dv-cinder-852009-8-iscsi devstack@n-api.service[120740]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.instances_path_share = {{(pid=120740) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 18:01:00.098360 dv-cinder-852009-8-iscsi devstack@n-api.service[120740]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.iscsi_initiator_list = [] {{(pid=120740) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 18:01:00.098652 dv-cinder-852009-8-iscsi devstack@n-api.service[120741]: DEBUG nova.api.openstack.wsgi_app [-] keystone.valid_interfaces = ['internal', 'public'] {{(pid=120741) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 18:01:00.098652 dv-cinder-852009-8-iscsi devstack@n-api.service[120741]: DEBUG nova.api.openstack.wsgi_app [-] keystone.version = None {{(pid=120741) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 18:01:00.098979 dv-cinder-852009-8-iscsi devstack@n-api.service[120740]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.limit_cpu_features = False {{(pid=120740) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 18:01:00.098979 dv-cinder-852009-8-iscsi devstack@n-api.service[120740]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.mounted_disk_query_retry_count = 10 {{(pid=120740) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 18:01:00.099284 dv-cinder-852009-8-iscsi devstack@n-api.service[120741]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.connection_uri = {{(pid=120741) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 18:01:00.099433 dv-cinder-852009-8-iscsi devstack@n-api.service[120740]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.mounted_disk_query_retry_interval = 5 {{(pid=120740) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 18:01:00.099580 dv-cinder-852009-8-iscsi devstack@n-api.service[120741]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.cpu_mode = None {{(pid=120741) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 18:01:00.099728 dv-cinder-852009-8-iscsi devstack@n-api.service[120740]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.power_state_check_timeframe = 60 {{(pid=120740) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 18:01:00.099874 dv-cinder-852009-8-iscsi devstack@n-api.service[120741]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.cpu_model_extra_flags = [] {{(pid=120741) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 18:01:00.100021 dv-cinder-852009-8-iscsi devstack@n-api.service[120740]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.power_state_event_polling_interval = 2 {{(pid=120740) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 18:01:00.100177 dv-cinder-852009-8-iscsi devstack@n-api.service[120741]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.cpu_models = [] {{(pid=120741) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 18:01:00.100327 dv-cinder-852009-8-iscsi devstack@n-api.service[120740]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.qemu_img_cmd = qemu-img.exe {{(pid=120740) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 18:01:00.100540 dv-cinder-852009-8-iscsi devstack@n-api.service[120741]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.device_detach_attempts = 8 {{(pid=120741) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 18:01:00.100704 dv-cinder-852009-8-iscsi devstack@n-api.service[120740]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.use_multipath_io = False {{(pid=120740) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 18:01:00.100852 dv-cinder-852009-8-iscsi devstack@n-api.service[120741]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.device_detach_timeout = 20 {{(pid=120741) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 18:01:00.101015 dv-cinder-852009-8-iscsi devstack@n-api.service[120740]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.volume_attach_retry_count = 10 {{(pid=120740) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 18:01:00.101179 dv-cinder-852009-8-iscsi devstack@n-api.service[120741]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.disk_cachemodes = [] {{(pid=120741) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 18:01:00.101928 dv-cinder-852009-8-iscsi devstack@n-api.service[120740]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.volume_attach_retry_interval = 5 {{(pid=120740) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 18:01:00.102119 dv-cinder-852009-8-iscsi devstack@n-api.service[120741]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.disk_prefix = None {{(pid=120741) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 18:01:00.102557 dv-cinder-852009-8-iscsi devstack@n-api.service[120740]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.vswitch_name = None {{(pid=120740) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 18:01:00.102724 dv-cinder-852009-8-iscsi devstack@n-api.service[120741]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.enabled_perf_events = [] {{(pid=120741) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 18:01:00.102975 dv-cinder-852009-8-iscsi devstack@n-api.service[120740]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.wait_soft_reboot_seconds = 60 {{(pid=120740) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 18:01:00.103378 dv-cinder-852009-8-iscsi devstack@n-api.service[120741]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.file_backed_memory = 0 {{(pid=120741) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 18:01:00.103546 dv-cinder-852009-8-iscsi devstack@n-api.service[120740]: DEBUG nova.api.openstack.wsgi_app [-] mks.enabled = False {{(pid=120740) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 18:01:00.103717 dv-cinder-852009-8-iscsi devstack@n-api.service[120741]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.gid_maps = [] {{(pid=120741) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 18:01:00.103717 dv-cinder-852009-8-iscsi devstack@n-api.service[120741]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.hw_disk_discard = None {{(pid=120741) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 18:01:00.104007 dv-cinder-852009-8-iscsi devstack@n-api.service[120740]: DEBUG nova.api.openstack.wsgi_app [-] mks.mksproxy_base_url = http://127.0.0.1:6090/ {{(pid=120740) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 18:01:00.104157 dv-cinder-852009-8-iscsi devstack@n-api.service[120741]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.hw_machine_type = None {{(pid=120741) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 18:01:00.104157 dv-cinder-852009-8-iscsi devstack@n-api.service[120741]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_ceph_conf = {{(pid=120741) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 18:01:00.104470 dv-cinder-852009-8-iscsi devstack@n-api.service[120740]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.manager_interval = 2400 {{(pid=120740) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 18:01:00.104638 dv-cinder-852009-8-iscsi devstack@n-api.service[120741]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_glance_copy_poll_interval = 15 {{(pid=120741) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 18:01:00.104838 dv-cinder-852009-8-iscsi devstack@n-api.service[120740]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.precache_concurrency = 1 {{(pid=120740) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 18:01:00.105136 dv-cinder-852009-8-iscsi devstack@n-api.service[120741]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_glance_copy_timeout = 600 {{(pid=120741) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 18:01:00.105292 dv-cinder-852009-8-iscsi devstack@n-api.service[120740]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.remove_unused_base_images = True {{(pid=120740) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 18:01:00.105442 dv-cinder-852009-8-iscsi devstack@n-api.service[120741]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_glance_store_name = {{(pid=120741) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 18:01:00.105618 dv-cinder-852009-8-iscsi devstack@n-api.service[120740]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.remove_unused_original_minimum_age_seconds = 86400 {{(pid=120740) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 18:01:00.105886 dv-cinder-852009-8-iscsi devstack@n-api.service[120741]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_pool = rbd {{(pid=120741) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 18:01:00.106253 dv-cinder-852009-8-iscsi devstack@n-api.service[120740]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.remove_unused_resized_minimum_age_seconds = 3600 {{(pid=120740) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 18:01:00.106528 dv-cinder-852009-8-iscsi devstack@n-api.service[120741]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_type = default {{(pid=120741) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 18:01:00.106698 dv-cinder-852009-8-iscsi devstack@n-api.service[120740]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.subdirectory_name = _base {{(pid=120740) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 18:01:00.106857 dv-cinder-852009-8-iscsi devstack@n-api.service[120741]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_volume_group = None {{(pid=120741) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 18:01:00.107013 dv-cinder-852009-8-iscsi devstack@n-api.service[120740]: DEBUG nova.api.openstack.wsgi_app [-] ironic.api_max_retries = 60 {{(pid=120740) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 18:01:00.107162 dv-cinder-852009-8-iscsi devstack@n-api.service[120741]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.inject_key = False {{(pid=120741) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 18:01:00.107319 dv-cinder-852009-8-iscsi devstack@n-api.service[120740]: DEBUG nova.api.openstack.wsgi_app [-] ironic.api_retry_interval = 2 {{(pid=120740) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 18:01:00.107476 dv-cinder-852009-8-iscsi devstack@n-api.service[120741]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.inject_partition = -2 {{(pid=120741) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 18:01:00.107639 dv-cinder-852009-8-iscsi devstack@n-api.service[120740]: DEBUG nova.api.openstack.wsgi_app [-] ironic.auth_section = None {{(pid=120740) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 18:01:00.107788 dv-cinder-852009-8-iscsi devstack@n-api.service[120741]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.inject_password = False {{(pid=120741) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 18:01:00.108073 dv-cinder-852009-8-iscsi devstack@n-api.service[120740]: DEBUG nova.api.openstack.wsgi_app [-] ironic.auth_type = None {{(pid=120740) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 18:01:00.108228 dv-cinder-852009-8-iscsi devstack@n-api.service[120741]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.iscsi_iface = None {{(pid=120741) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 18:01:00.108389 dv-cinder-852009-8-iscsi devstack@n-api.service[120740]: DEBUG nova.api.openstack.wsgi_app [-] ironic.cafile = None {{(pid=120740) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 18:01:00.108575 dv-cinder-852009-8-iscsi devstack@n-api.service[120741]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.iser_use_multipath = False {{(pid=120741) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 18:01:00.108734 dv-cinder-852009-8-iscsi devstack@n-api.service[120740]: DEBUG nova.api.openstack.wsgi_app [-] ironic.certfile = None {{(pid=120740) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 18:01:00.109034 dv-cinder-852009-8-iscsi devstack@n-api.service[120741]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_bandwidth = 0 {{(pid=120741) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 18:01:00.109208 dv-cinder-852009-8-iscsi devstack@n-api.service[120740]: DEBUG nova.api.openstack.wsgi_app [-] ironic.collect_timing = False {{(pid=120740) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 18:01:00.109358 dv-cinder-852009-8-iscsi devstack@n-api.service[120741]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_completion_timeout = 800 {{(pid=120741) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 18:01:00.109507 dv-cinder-852009-8-iscsi devstack@n-api.service[120740]: DEBUG nova.api.openstack.wsgi_app [-] ironic.connect_retries = None {{(pid=120740) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 18:01:00.109664 dv-cinder-852009-8-iscsi devstack@n-api.service[120741]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_downtime = 500 {{(pid=120741) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 18:01:00.109814 dv-cinder-852009-8-iscsi devstack@n-api.service[120740]: DEBUG nova.api.openstack.wsgi_app [-] ironic.connect_retry_delay = None {{(pid=120740) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 18:01:00.109961 dv-cinder-852009-8-iscsi devstack@n-api.service[120741]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_downtime_delay = 75 {{(pid=120741) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 18:01:00.110118 dv-cinder-852009-8-iscsi devstack@n-api.service[120740]: DEBUG nova.api.openstack.wsgi_app [-] ironic.endpoint_override = None {{(pid=120740) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 18:01:00.110276 dv-cinder-852009-8-iscsi devstack@n-api.service[120741]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_downtime_steps = 10 {{(pid=120741) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 18:01:00.110432 dv-cinder-852009-8-iscsi devstack@n-api.service[120740]: DEBUG nova.api.openstack.wsgi_app [-] ironic.insecure = False {{(pid=120740) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 18:01:00.110610 dv-cinder-852009-8-iscsi devstack@n-api.service[120741]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_inbound_addr = None {{(pid=120741) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 18:01:00.110767 dv-cinder-852009-8-iscsi devstack@n-api.service[120740]: DEBUG nova.api.openstack.wsgi_app [-] ironic.keyfile = None {{(pid=120740) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 18:01:00.110923 dv-cinder-852009-8-iscsi devstack@n-api.service[120741]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_permit_auto_converge = False {{(pid=120741) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 18:01:00.111071 dv-cinder-852009-8-iscsi devstack@n-api.service[120740]: DEBUG nova.api.openstack.wsgi_app [-] ironic.max_version = None {{(pid=120740) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 18:01:00.111225 dv-cinder-852009-8-iscsi devstack@n-api.service[120741]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_permit_post_copy = False {{(pid=120741) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 18:01:00.111375 dv-cinder-852009-8-iscsi devstack@n-api.service[120740]: DEBUG nova.api.openstack.wsgi_app [-] ironic.min_version = None {{(pid=120740) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 18:01:00.111538 dv-cinder-852009-8-iscsi devstack@n-api.service[120741]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_scheme = None {{(pid=120741) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 18:01:00.111696 dv-cinder-852009-8-iscsi devstack@n-api.service[120740]: DEBUG nova.api.openstack.wsgi_app [-] ironic.partition_key = None {{(pid=120740) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 18:01:00.111844 dv-cinder-852009-8-iscsi devstack@n-api.service[120741]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_timeout_action = abort {{(pid=120741) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 18:01:00.111992 dv-cinder-852009-8-iscsi devstack@n-api.service[120740]: DEBUG nova.api.openstack.wsgi_app [-] ironic.peer_list = [] {{(pid=120740) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 18:01:00.112148 dv-cinder-852009-8-iscsi devstack@n-api.service[120741]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_tunnelled = False {{(pid=120741) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 18:01:00.112325 dv-cinder-852009-8-iscsi devstack@n-api.service[120740]: DEBUG nova.api.openstack.wsgi_app [-] ironic.region_name = None {{(pid=120740) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 18:01:00.112845 dv-cinder-852009-8-iscsi devstack@n-api.service[120741]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_uri = None {{(pid=120741) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 18:01:00.113131 dv-cinder-852009-8-iscsi devstack@n-api.service[120740]: DEBUG nova.api.openstack.wsgi_app [-] ironic.serial_console_state_timeout = 10 {{(pid=120740) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 18:01:00.113297 dv-cinder-852009-8-iscsi devstack@n-api.service[120741]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_with_native_tls = False {{(pid=120741) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 18:01:00.113455 dv-cinder-852009-8-iscsi devstack@n-api.service[120740]: DEBUG nova.api.openstack.wsgi_app [-] ironic.service_name = None {{(pid=120740) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 18:01:00.113610 dv-cinder-852009-8-iscsi devstack@n-api.service[120741]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.max_queues = None {{(pid=120741) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 18:01:00.113770 dv-cinder-852009-8-iscsi devstack@n-api.service[120740]: DEBUG nova.api.openstack.wsgi_app [-] ironic.service_type = baremetal {{(pid=120740) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 18:01:00.113919 dv-cinder-852009-8-iscsi devstack@n-api.service[120741]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.mem_stats_period_seconds = 10 {{(pid=120741) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 18:01:00.114066 dv-cinder-852009-8-iscsi devstack@n-api.service[120740]: DEBUG nova.api.openstack.wsgi_app [-] ironic.split_loggers = False {{(pid=120740) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 18:01:00.114213 dv-cinder-852009-8-iscsi devstack@n-api.service[120741]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.nfs_mount_options = None {{(pid=120741) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 18:01:00.114369 dv-cinder-852009-8-iscsi devstack@n-api.service[120740]: DEBUG nova.api.openstack.wsgi_app [-] ironic.status_code_retries = None {{(pid=120740) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 18:01:00.114666 dv-cinder-852009-8-iscsi devstack@n-api.service[120741]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.nfs_mount_point_base = /opt/stack/data/nova/mnt {{(pid=120741) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 18:01:00.114835 dv-cinder-852009-8-iscsi devstack@n-api.service[120740]: DEBUG nova.api.openstack.wsgi_app [-] ironic.status_code_retry_delay = None {{(pid=120740) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 18:01:00.115034 dv-cinder-852009-8-iscsi devstack@n-api.service[120741]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_aoe_discover_tries = 3 {{(pid=120741) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 18:01:00.115183 dv-cinder-852009-8-iscsi devstack@n-api.service[120740]: DEBUG nova.api.openstack.wsgi_app [-] ironic.timeout = None {{(pid=120740) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 18:01:00.115349 dv-cinder-852009-8-iscsi devstack@n-api.service[120741]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_iser_scan_tries = 5 {{(pid=120741) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 18:01:00.115508 dv-cinder-852009-8-iscsi devstack@n-api.service[120740]: DEBUG nova.api.openstack.wsgi_app [-] ironic.valid_interfaces = ['internal', 'public'] {{(pid=120740) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 18:01:00.115665 dv-cinder-852009-8-iscsi devstack@n-api.service[120741]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_memory_encrypted_guests = None {{(pid=120741) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 18:01:00.115848 dv-cinder-852009-8-iscsi devstack@n-api.service[120740]: DEBUG nova.api.openstack.wsgi_app [-] ironic.version = None {{(pid=120740) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 18:01:00.116640 dv-cinder-852009-8-iscsi devstack@n-api.service[120741]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_nvme_discover_tries = 5 {{(pid=120741) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 18:01:00.116762 dv-cinder-852009-8-iscsi devstack@n-api.service[120740]: DEBUG nova.api.openstack.wsgi_app [-] key_manager.backend = nova.keymgr.conf_key_mgr.ConfKeyManager {{(pid=120740) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 18:01:00.116853 dv-cinder-852009-8-iscsi devstack@n-api.service[120741]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_pcie_ports = 0 {{(pid=120741) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 18:01:00.116991 dv-cinder-852009-8-iscsi devstack@n-api.service[120740]: DEBUG nova.api.openstack.wsgi_app [-] key_manager.fixed_key = **** {{(pid=120740) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 18:01:00.117080 dv-cinder-852009-8-iscsi devstack@n-api.service[120741]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_volume_scan_tries = 5 {{(pid=120741) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 18:01:00.117166 dv-cinder-852009-8-iscsi devstack@n-api.service[120740]: DEBUG nova.api.openstack.wsgi_app [-] barbican.auth_endpoint = http://localhost/identity/v3 {{(pid=120740) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 18:01:00.117259 dv-cinder-852009-8-iscsi devstack@n-api.service[120741]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.pmem_namespaces = [] {{(pid=120741) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 18:01:00.117356 dv-cinder-852009-8-iscsi devstack@n-api.service[120740]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_api_version = None {{(pid=120740) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 18:01:00.117440 dv-cinder-852009-8-iscsi devstack@n-api.service[120741]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.quobyte_client_cfg = None {{(pid=120741) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 18:01:00.117523 dv-cinder-852009-8-iscsi devstack@n-api.service[120740]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_endpoint = None {{(pid=120740) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 18:01:00.117616 dv-cinder-852009-8-iscsi devstack@n-api.service[120741]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.quobyte_mount_point_base = /opt/stack/data/nova/mnt {{(pid=120741) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 18:01:00.117710 dv-cinder-852009-8-iscsi devstack@n-api.service[120740]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_endpoint_type = public {{(pid=120740) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 18:01:00.117794 dv-cinder-852009-8-iscsi devstack@n-api.service[120741]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_connect_timeout = 5 {{(pid=120741) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 18:01:00.117884 dv-cinder-852009-8-iscsi devstack@n-api.service[120740]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_region_name = None {{(pid=120740) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 18:01:00.117975 dv-cinder-852009-8-iscsi devstack@n-api.service[120741]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_destroy_volume_retries = 12 {{(pid=120741) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 18:01:00.118066 dv-cinder-852009-8-iscsi devstack@n-api.service[120740]: DEBUG nova.api.openstack.wsgi_app [-] barbican.cafile = None {{(pid=120740) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 18:01:00.118159 dv-cinder-852009-8-iscsi devstack@n-api.service[120741]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_destroy_volume_retry_interval = 5 {{(pid=120741) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 18:01:00.118252 dv-cinder-852009-8-iscsi devstack@n-api.service[120740]: DEBUG nova.api.openstack.wsgi_app [-] barbican.certfile = None {{(pid=120740) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 18:01:00.118252 dv-cinder-852009-8-iscsi devstack@n-api.service[120740]: DEBUG nova.api.openstack.wsgi_app [-] barbican.collect_timing = False {{(pid=120740) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 18:01:00.118405 dv-cinder-852009-8-iscsi devstack@n-api.service[120741]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_secret_uuid = None {{(pid=120741) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 18:01:00.118497 dv-cinder-852009-8-iscsi devstack@n-api.service[120740]: DEBUG nova.api.openstack.wsgi_app [-] barbican.insecure = False {{(pid=120740) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 18:01:00.118581 dv-cinder-852009-8-iscsi devstack@n-api.service[120741]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_user = None {{(pid=120741) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 18:01:00.118678 dv-cinder-852009-8-iscsi devstack@n-api.service[120740]: DEBUG nova.api.openstack.wsgi_app [-] barbican.keyfile = None {{(pid=120740) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 18:01:00.118770 dv-cinder-852009-8-iscsi devstack@n-api.service[120741]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.realtime_scheduler_priority = 1 {{(pid=120741) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 18:01:00.118861 dv-cinder-852009-8-iscsi devstack@n-api.service[120740]: DEBUG nova.api.openstack.wsgi_app [-] barbican.number_of_retries = 60 {{(pid=120740) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 18:01:00.118952 dv-cinder-852009-8-iscsi devstack@n-api.service[120741]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.remote_filesystem_transport = ssh {{(pid=120741) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 18:01:00.119037 dv-cinder-852009-8-iscsi devstack@n-api.service[120740]: DEBUG nova.api.openstack.wsgi_app [-] barbican.retry_delay = 1 {{(pid=120740) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 18:01:00.119130 dv-cinder-852009-8-iscsi devstack@n-api.service[120741]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rescue_image_id = None {{(pid=120741) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 18:01:00.119215 dv-cinder-852009-8-iscsi devstack@n-api.service[120740]: DEBUG nova.api.openstack.wsgi_app [-] barbican.send_service_user_token = False {{(pid=120740) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 18:01:00.119305 dv-cinder-852009-8-iscsi devstack@n-api.service[120741]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rescue_kernel_id = None {{(pid=120741) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 18:01:00.119390 dv-cinder-852009-8-iscsi devstack@n-api.service[120740]: DEBUG nova.api.openstack.wsgi_app [-] barbican.split_loggers = False {{(pid=120740) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 18:01:00.119479 dv-cinder-852009-8-iscsi devstack@n-api.service[120741]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rescue_ramdisk_id = None {{(pid=120741) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 18:01:00.119569 dv-cinder-852009-8-iscsi devstack@n-api.service[120740]: DEBUG nova.api.openstack.wsgi_app [-] barbican.timeout = None {{(pid=120740) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 18:01:00.119662 dv-cinder-852009-8-iscsi devstack@n-api.service[120741]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rng_dev_path = /dev/urandom {{(pid=120741) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 18:01:00.119748 dv-cinder-852009-8-iscsi devstack@n-api.service[120740]: DEBUG nova.api.openstack.wsgi_app [-] barbican.verify_ssl = True {{(pid=120740) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 18:01:00.119839 dv-cinder-852009-8-iscsi devstack@n-api.service[120741]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rx_queue_size = None {{(pid=120741) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 18:01:00.119931 dv-cinder-852009-8-iscsi devstack@n-api.service[120740]: DEBUG nova.api.openstack.wsgi_app [-] barbican.verify_ssl_path = None {{(pid=120740) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 18:01:00.120022 dv-cinder-852009-8-iscsi devstack@n-api.service[120741]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.smbfs_mount_options = {{(pid=120741) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 18:01:00.120105 dv-cinder-852009-8-iscsi devstack@n-api.service[120740]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.auth_section = None {{(pid=120740) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 18:01:00.120191 dv-cinder-852009-8-iscsi devstack@n-api.service[120741]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.smbfs_mount_point_base = /opt/stack/data/nova/mnt {{(pid=120741) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 18:01:00.120264 dv-cinder-852009-8-iscsi devstack@n-api.service[120740]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.auth_type = None {{(pid=120740) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 18:01:00.120341 dv-cinder-852009-8-iscsi devstack@n-api.service[120741]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.snapshot_compression = False {{(pid=120741) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 18:01:00.120454 dv-cinder-852009-8-iscsi devstack@n-api.service[120740]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.cafile = None {{(pid=120740) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 18:01:00.120555 dv-cinder-852009-8-iscsi devstack@n-api.service[120741]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.snapshot_image_format = None {{(pid=120741) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 18:01:00.120661 dv-cinder-852009-8-iscsi devstack@n-api.service[120740]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.certfile = None {{(pid=120740) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 18:01:00.120661 dv-cinder-852009-8-iscsi devstack@n-api.service[120740]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.collect_timing = False {{(pid=120740) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 18:01:00.120833 dv-cinder-852009-8-iscsi devstack@n-api.service[120741]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.snapshots_directory = /opt/stack/data/nova/instances/snapshots {{(pid=120741) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 18:01:00.120926 dv-cinder-852009-8-iscsi devstack@n-api.service[120740]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.insecure = False {{(pid=120740) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 18:01:00.120999 dv-cinder-852009-8-iscsi devstack@n-api.service[120741]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.sparse_logical_volumes = False {{(pid=120741) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 18:01:00.121068 dv-cinder-852009-8-iscsi devstack@n-api.service[120740]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.keyfile = None {{(pid=120740) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 18:01:00.121163 dv-cinder-852009-8-iscsi devstack@n-api.service[120741]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.swtpm_enabled = False {{(pid=120741) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 18:01:00.121249 dv-cinder-852009-8-iscsi devstack@n-api.service[120740]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.split_loggers = False {{(pid=120740) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 18:01:00.121340 dv-cinder-852009-8-iscsi devstack@n-api.service[120741]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.swtpm_group = tss {{(pid=120741) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 18:01:00.121431 dv-cinder-852009-8-iscsi devstack@n-api.service[120740]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.timeout = None {{(pid=120740) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 18:01:00.121528 dv-cinder-852009-8-iscsi devstack@n-api.service[120741]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.swtpm_user = tss {{(pid=120741) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 18:01:00.121614 dv-cinder-852009-8-iscsi devstack@n-api.service[120740]: DEBUG nova.api.openstack.wsgi_app [-] vault.approle_role_id = None {{(pid=120740) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 18:01:00.121710 dv-cinder-852009-8-iscsi devstack@n-api.service[120741]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.sysinfo_serial = unique {{(pid=120741) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 18:01:00.121795 dv-cinder-852009-8-iscsi devstack@n-api.service[120740]: DEBUG nova.api.openstack.wsgi_app [-] vault.approle_secret_id = None {{(pid=120740) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 18:01:00.121878 dv-cinder-852009-8-iscsi devstack@n-api.service[120741]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.tx_queue_size = None {{(pid=120741) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 18:01:00.121961 dv-cinder-852009-8-iscsi devstack@n-api.service[120740]: DEBUG nova.api.openstack.wsgi_app [-] vault.cafile = None {{(pid=120740) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 18:01:00.122051 dv-cinder-852009-8-iscsi devstack@n-api.service[120741]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.uid_maps = [] {{(pid=120741) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 18:01:00.122143 dv-cinder-852009-8-iscsi devstack@n-api.service[120740]: DEBUG nova.api.openstack.wsgi_app [-] vault.certfile = None {{(pid=120740) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 18:01:00.122240 dv-cinder-852009-8-iscsi devstack@n-api.service[120741]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.use_virtio_for_bridges = True {{(pid=120741) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 18:01:00.122326 dv-cinder-852009-8-iscsi devstack@n-api.service[120740]: DEBUG nova.api.openstack.wsgi_app [-] vault.collect_timing = False {{(pid=120740) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 18:01:00.122410 dv-cinder-852009-8-iscsi devstack@n-api.service[120741]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.virt_type = kvm {{(pid=120741) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 18:01:00.122708 dv-cinder-852009-8-iscsi devstack@n-api.service[120740]: DEBUG nova.api.openstack.wsgi_app [-] vault.insecure = False {{(pid=120740) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 18:01:00.122818 dv-cinder-852009-8-iscsi devstack@n-api.service[120741]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.volume_clear = zero {{(pid=120741) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 18:01:00.122902 dv-cinder-852009-8-iscsi devstack@n-api.service[120740]: DEBUG nova.api.openstack.wsgi_app [-] vault.keyfile = None {{(pid=120740) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 18:01:00.122996 dv-cinder-852009-8-iscsi devstack@n-api.service[120741]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.volume_clear_size = 0 {{(pid=120741) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 18:01:00.123089 dv-cinder-852009-8-iscsi devstack@n-api.service[120740]: DEBUG nova.api.openstack.wsgi_app [-] vault.kv_mountpoint = secret {{(pid=120740) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 18:01:00.123194 dv-cinder-852009-8-iscsi devstack@n-api.service[120741]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.volume_use_multipath = False {{(pid=120741) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 18:01:00.123285 dv-cinder-852009-8-iscsi devstack@n-api.service[120740]: DEBUG nova.api.openstack.wsgi_app [-] vault.kv_version = 2 {{(pid=120740) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 18:01:00.123369 dv-cinder-852009-8-iscsi devstack@n-api.service[120741]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_cache_path = None {{(pid=120741) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 18:01:00.123539 dv-cinder-852009-8-iscsi devstack@n-api.service[120740]: DEBUG nova.api.openstack.wsgi_app [-] vault.namespace = None {{(pid=120740) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 18:01:00.123627 dv-cinder-852009-8-iscsi devstack@n-api.service[120741]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_log_path = /var/log/vstorage/%(cluster_name)s/nova.log.gz {{(pid=120741) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 18:01:00.123711 dv-cinder-852009-8-iscsi devstack@n-api.service[120740]: DEBUG nova.api.openstack.wsgi_app [-] vault.root_token_id = None {{(pid=120740) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 18:01:00.123794 dv-cinder-852009-8-iscsi devstack@n-api.service[120741]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_group = qemu {{(pid=120741) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 18:01:00.123877 dv-cinder-852009-8-iscsi devstack@n-api.service[120740]: DEBUG nova.api.openstack.wsgi_app [-] vault.split_loggers = False {{(pid=120740) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 18:01:00.123962 dv-cinder-852009-8-iscsi devstack@n-api.service[120741]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_opts = [] {{(pid=120741) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 18:01:00.124060 dv-cinder-852009-8-iscsi devstack@n-api.service[120740]: DEBUG nova.api.openstack.wsgi_app [-] vault.ssl_ca_crt_file = None {{(pid=120740) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 18:01:00.124146 dv-cinder-852009-8-iscsi devstack@n-api.service[120741]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_perms = 0770 {{(pid=120741) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 18:01:00.124242 dv-cinder-852009-8-iscsi devstack@n-api.service[120740]: DEBUG nova.api.openstack.wsgi_app [-] vault.timeout = None {{(pid=120740) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 18:01:00.124334 dv-cinder-852009-8-iscsi devstack@n-api.service[120741]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_point_base = /opt/stack/data/nova/mnt {{(pid=120741) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 18:01:00.124418 dv-cinder-852009-8-iscsi devstack@n-api.service[120740]: DEBUG nova.api.openstack.wsgi_app [-] vault.use_ssl = False {{(pid=120740) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 18:01:00.124607 dv-cinder-852009-8-iscsi devstack@n-api.service[120741]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_user = stack {{(pid=120741) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 18:01:00.124702 dv-cinder-852009-8-iscsi devstack@n-api.service[120740]: DEBUG nova.api.openstack.wsgi_app [-] vault.vault_url = http://127.0.0.1:8200 {{(pid=120740) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 18:01:00.124788 dv-cinder-852009-8-iscsi devstack@n-api.service[120741]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.wait_soft_reboot_seconds = 120 {{(pid=120741) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 18:01:00.124883 dv-cinder-852009-8-iscsi devstack@n-api.service[120740]: DEBUG nova.api.openstack.wsgi_app [-] keystone.cafile = None {{(pid=120740) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 18:01:00.124883 dv-cinder-852009-8-iscsi devstack@n-api.service[120740]: DEBUG nova.api.openstack.wsgi_app [-] keystone.certfile = None {{(pid=120740) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 18:01:00.125101 dv-cinder-852009-8-iscsi devstack@n-api.service[120741]: DEBUG nova.api.openstack.wsgi_app [-] neutron.auth_section = None {{(pid=120741) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 18:01:00.125196 dv-cinder-852009-8-iscsi devstack@n-api.service[120740]: DEBUG nova.api.openstack.wsgi_app [-] keystone.collect_timing = False {{(pid=120740) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 18:01:00.125290 dv-cinder-852009-8-iscsi devstack@n-api.service[120741]: DEBUG nova.api.openstack.wsgi_app [-] neutron.auth_type = password {{(pid=120741) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 18:01:00.125375 dv-cinder-852009-8-iscsi devstack@n-api.service[120740]: DEBUG nova.api.openstack.wsgi_app [-] keystone.connect_retries = None {{(pid=120740) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 18:01:00.125464 dv-cinder-852009-8-iscsi devstack@n-api.service[120741]: DEBUG nova.api.openstack.wsgi_app [-] neutron.cafile = None {{(pid=120741) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 18:01:00.125547 dv-cinder-852009-8-iscsi devstack@n-api.service[120740]: DEBUG nova.api.openstack.wsgi_app [-] keystone.connect_retry_delay = None {{(pid=120740) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 18:01:00.125547 dv-cinder-852009-8-iscsi devstack@n-api.service[120740]: DEBUG nova.api.openstack.wsgi_app [-] keystone.endpoint_override = None {{(pid=120740) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 18:01:00.125719 dv-cinder-852009-8-iscsi devstack@n-api.service[120741]: DEBUG nova.api.openstack.wsgi_app [-] neutron.certfile = None {{(pid=120741) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 18:01:00.125814 dv-cinder-852009-8-iscsi devstack@n-api.service[120740]: DEBUG nova.api.openstack.wsgi_app [-] keystone.insecure = False {{(pid=120740) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 18:01:00.125899 dv-cinder-852009-8-iscsi devstack@n-api.service[120741]: DEBUG nova.api.openstack.wsgi_app [-] neutron.collect_timing = False {{(pid=120741) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 18:01:00.125989 dv-cinder-852009-8-iscsi devstack@n-api.service[120740]: DEBUG nova.api.openstack.wsgi_app [-] keystone.keyfile = None {{(pid=120740) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 18:01:00.126087 dv-cinder-852009-8-iscsi devstack@n-api.service[120741]: DEBUG nova.api.openstack.wsgi_app [-] neutron.connect_retries = None {{(pid=120741) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 18:01:00.126176 dv-cinder-852009-8-iscsi devstack@n-api.service[120740]: DEBUG nova.api.openstack.wsgi_app [-] keystone.max_version = None {{(pid=120740) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 18:01:00.126270 dv-cinder-852009-8-iscsi devstack@n-api.service[120741]: DEBUG nova.api.openstack.wsgi_app [-] neutron.connect_retry_delay = None {{(pid=120741) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 18:01:00.126354 dv-cinder-852009-8-iscsi devstack@n-api.service[120740]: DEBUG nova.api.openstack.wsgi_app [-] keystone.min_version = None {{(pid=120740) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 18:01:00.126443 dv-cinder-852009-8-iscsi devstack@n-api.service[120741]: DEBUG nova.api.openstack.wsgi_app [-] neutron.default_floating_pool = public {{(pid=120741) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 18:01:00.126709 dv-cinder-852009-8-iscsi devstack@n-api.service[120740]: DEBUG nova.api.openstack.wsgi_app [-] keystone.region_name = None {{(pid=120740) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 18:01:00.126812 dv-cinder-852009-8-iscsi devstack@n-api.service[120741]: DEBUG nova.api.openstack.wsgi_app [-] neutron.endpoint_override = None {{(pid=120741) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 18:01:00.126906 dv-cinder-852009-8-iscsi devstack@n-api.service[120740]: DEBUG nova.api.openstack.wsgi_app [-] keystone.service_name = None {{(pid=120740) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 18:01:00.127001 dv-cinder-852009-8-iscsi devstack@n-api.service[120741]: DEBUG nova.api.openstack.wsgi_app [-] neutron.extension_sync_interval = 600 {{(pid=120741) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 18:01:00.127085 dv-cinder-852009-8-iscsi devstack@n-api.service[120740]: DEBUG nova.api.openstack.wsgi_app [-] keystone.service_type = identity {{(pid=120740) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 18:01:00.127169 dv-cinder-852009-8-iscsi devstack@n-api.service[120741]: DEBUG nova.api.openstack.wsgi_app [-] neutron.http_retries = 3 {{(pid=120741) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 18:01:00.127252 dv-cinder-852009-8-iscsi devstack@n-api.service[120740]: DEBUG nova.api.openstack.wsgi_app [-] keystone.split_loggers = False {{(pid=120740) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 18:01:00.127334 dv-cinder-852009-8-iscsi devstack@n-api.service[120741]: DEBUG nova.api.openstack.wsgi_app [-] neutron.insecure = False {{(pid=120741) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 18:01:00.127423 dv-cinder-852009-8-iscsi devstack@n-api.service[120740]: DEBUG nova.api.openstack.wsgi_app [-] keystone.status_code_retries = None {{(pid=120740) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 18:01:00.127516 dv-cinder-852009-8-iscsi devstack@n-api.service[120741]: DEBUG nova.api.openstack.wsgi_app [-] neutron.keyfile = None {{(pid=120741) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 18:01:00.127601 dv-cinder-852009-8-iscsi devstack@n-api.service[120740]: DEBUG nova.api.openstack.wsgi_app [-] keystone.status_code_retry_delay = None {{(pid=120740) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 18:01:00.127685 dv-cinder-852009-8-iscsi devstack@n-api.service[120741]: DEBUG nova.api.openstack.wsgi_app [-] neutron.max_version = None {{(pid=120741) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 18:01:00.127767 dv-cinder-852009-8-iscsi devstack@n-api.service[120740]: DEBUG nova.api.openstack.wsgi_app [-] keystone.timeout = None {{(pid=120740) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 18:01:00.128217 dv-cinder-852009-8-iscsi devstack@n-api.service[120741]: DEBUG nova.api.openstack.wsgi_app [-] neutron.metadata_proxy_shared_secret = **** {{(pid=120741) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 18:01:00.128320 dv-cinder-852009-8-iscsi devstack@n-api.service[120740]: DEBUG nova.api.openstack.wsgi_app [-] keystone.valid_interfaces = ['internal', 'public'] {{(pid=120740) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 18:01:00.128416 dv-cinder-852009-8-iscsi devstack@n-api.service[120741]: DEBUG nova.api.openstack.wsgi_app [-] neutron.min_version = None {{(pid=120741) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 18:01:00.128531 dv-cinder-852009-8-iscsi devstack@n-api.service[120740]: DEBUG nova.api.openstack.wsgi_app [-] keystone.version = None {{(pid=120740) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 18:01:00.128617 dv-cinder-852009-8-iscsi devstack@n-api.service[120741]: DEBUG nova.api.openstack.wsgi_app [-] neutron.ovs_bridge = br-int {{(pid=120741) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 18:01:00.128700 dv-cinder-852009-8-iscsi devstack@n-api.service[120740]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.connection_uri = {{(pid=120740) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 18:01:00.128790 dv-cinder-852009-8-iscsi devstack@n-api.service[120741]: DEBUG nova.api.openstack.wsgi_app [-] neutron.physnets = [] {{(pid=120741) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 18:01:00.128884 dv-cinder-852009-8-iscsi devstack@n-api.service[120740]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.cpu_mode = None {{(pid=120740) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 18:01:00.128976 dv-cinder-852009-8-iscsi devstack@n-api.service[120741]: DEBUG nova.api.openstack.wsgi_app [-] neutron.region_name = RegionOne {{(pid=120741) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 18:01:00.129049 dv-cinder-852009-8-iscsi devstack@n-api.service[120740]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.cpu_model_extra_flags = [] {{(pid=120740) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 18:01:00.129139 dv-cinder-852009-8-iscsi devstack@n-api.service[120741]: DEBUG nova.api.openstack.wsgi_app [-] neutron.service_metadata_proxy = True {{(pid=120741) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 18:01:00.129231 dv-cinder-852009-8-iscsi devstack@n-api.service[120740]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.cpu_models = [] {{(pid=120740) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 18:01:00.129316 dv-cinder-852009-8-iscsi devstack@n-api.service[120741]: DEBUG nova.api.openstack.wsgi_app [-] neutron.service_name = None {{(pid=120741) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 18:01:00.129408 dv-cinder-852009-8-iscsi devstack@n-api.service[120740]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.device_detach_attempts = 8 {{(pid=120740) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 18:01:00.129540 dv-cinder-852009-8-iscsi devstack@n-api.service[120741]: DEBUG nova.api.openstack.wsgi_app [-] neutron.service_type = network {{(pid=120741) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 18:01:00.129640 dv-cinder-852009-8-iscsi devstack@n-api.service[120740]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.device_detach_timeout = 20 {{(pid=120740) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 18:01:00.129732 dv-cinder-852009-8-iscsi devstack@n-api.service[120741]: DEBUG nova.api.openstack.wsgi_app [-] neutron.split_loggers = False {{(pid=120741) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 18:01:00.129824 dv-cinder-852009-8-iscsi devstack@n-api.service[120740]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.disk_cachemodes = [] {{(pid=120740) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 18:01:00.129908 dv-cinder-852009-8-iscsi devstack@n-api.service[120741]: DEBUG nova.api.openstack.wsgi_app [-] neutron.status_code_retries = None {{(pid=120741) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 18:01:00.130001 dv-cinder-852009-8-iscsi devstack@n-api.service[120740]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.disk_prefix = None {{(pid=120740) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 18:01:00.130108 dv-cinder-852009-8-iscsi devstack@n-api.service[120741]: DEBUG nova.api.openstack.wsgi_app [-] neutron.status_code_retry_delay = None {{(pid=120741) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 18:01:00.130108 dv-cinder-852009-8-iscsi devstack@n-api.service[120741]: DEBUG nova.api.openstack.wsgi_app [-] neutron.timeout = None {{(pid=120741) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 18:01:00.130264 dv-cinder-852009-8-iscsi devstack@n-api.service[120740]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.enabled_perf_events = [] {{(pid=120740) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 18:01:00.130264 dv-cinder-852009-8-iscsi devstack@n-api.service[120740]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.file_backed_memory = 0 {{(pid=120740) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 18:01:00.130431 dv-cinder-852009-8-iscsi devstack@n-api.service[120741]: DEBUG nova.api.openstack.wsgi_app [-] neutron.valid_interfaces = ['internal', 'public'] {{(pid=120741) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 18:01:00.130523 dv-cinder-852009-8-iscsi devstack@n-api.service[120740]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.gid_maps = [] {{(pid=120740) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 18:01:00.130606 dv-cinder-852009-8-iscsi devstack@n-api.service[120741]: DEBUG nova.api.openstack.wsgi_app [-] neutron.version = None {{(pid=120741) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 18:01:00.130688 dv-cinder-852009-8-iscsi devstack@n-api.service[120740]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.hw_disk_discard = None {{(pid=120740) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 18:01:00.130778 dv-cinder-852009-8-iscsi devstack@n-api.service[120741]: DEBUG nova.api.openstack.wsgi_app [-] notifications.bdms_in_notifications = False {{(pid=120741) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 18:01:00.130862 dv-cinder-852009-8-iscsi devstack@n-api.service[120740]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.hw_machine_type = None {{(pid=120740) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 18:01:00.130953 dv-cinder-852009-8-iscsi devstack@n-api.service[120741]: DEBUG nova.api.openstack.wsgi_app [-] notifications.default_level = INFO {{(pid=120741) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 18:01:00.131044 dv-cinder-852009-8-iscsi devstack@n-api.service[120740]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_ceph_conf = {{(pid=120740) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 18:01:00.131128 dv-cinder-852009-8-iscsi devstack@n-api.service[120741]: DEBUG nova.api.openstack.wsgi_app [-] notifications.notification_format = unversioned {{(pid=120741) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 18:01:00.131218 dv-cinder-852009-8-iscsi devstack@n-api.service[120740]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_glance_copy_poll_interval = 15 {{(pid=120740) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 18:01:00.131312 dv-cinder-852009-8-iscsi devstack@n-api.service[120741]: DEBUG nova.api.openstack.wsgi_app [-] notifications.notify_on_state_change = None {{(pid=120741) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 18:01:00.131407 dv-cinder-852009-8-iscsi devstack@n-api.service[120740]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_glance_copy_timeout = 600 {{(pid=120740) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 18:01:00.131504 dv-cinder-852009-8-iscsi devstack@n-api.service[120741]: DEBUG nova.api.openstack.wsgi_app [-] notifications.versioned_notifications_topics = ['versioned_notifications'] {{(pid=120741) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 18:01:00.131590 dv-cinder-852009-8-iscsi devstack@n-api.service[120740]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_glance_store_name = {{(pid=120740) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 18:01:00.131680 dv-cinder-852009-8-iscsi devstack@n-api.service[120741]: DEBUG nova.api.openstack.wsgi_app [-] pci.alias = [] {{(pid=120741) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 18:01:00.131774 dv-cinder-852009-8-iscsi devstack@n-api.service[120740]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_pool = rbd {{(pid=120740) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 18:01:00.131876 dv-cinder-852009-8-iscsi devstack@n-api.service[120741]: DEBUG nova.api.openstack.wsgi_app [-] pci.device_spec = [] {{(pid=120741) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 18:01:00.131961 dv-cinder-852009-8-iscsi devstack@n-api.service[120740]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_type = default {{(pid=120740) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 18:01:00.132043 dv-cinder-852009-8-iscsi devstack@n-api.service[120741]: DEBUG nova.api.openstack.wsgi_app [-] pci.report_in_placement = False {{(pid=120741) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 18:01:00.132126 dv-cinder-852009-8-iscsi devstack@n-api.service[120740]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_volume_group = None {{(pid=120740) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 18:01:00.132268 dv-cinder-852009-8-iscsi devstack@n-api.service[120741]: DEBUG nova.api.openstack.wsgi_app [-] placement.auth_section = None {{(pid=120741) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 18:01:00.132359 dv-cinder-852009-8-iscsi devstack@n-api.service[120740]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.inject_key = False {{(pid=120740) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 18:01:00.132572 dv-cinder-852009-8-iscsi devstack@n-api.service[120741]: DEBUG nova.api.openstack.wsgi_app [-] placement.auth_type = password {{(pid=120741) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 18:01:00.132677 dv-cinder-852009-8-iscsi devstack@n-api.service[120740]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.inject_partition = -2 {{(pid=120740) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 18:01:00.132777 dv-cinder-852009-8-iscsi devstack@n-api.service[120741]: DEBUG nova.api.openstack.wsgi_app [-] placement.cafile = None {{(pid=120741) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 18:01:00.132848 dv-cinder-852009-8-iscsi devstack@n-api.service[120740]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.inject_password = False {{(pid=120740) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 18:01:00.132918 dv-cinder-852009-8-iscsi devstack@n-api.service[120741]: DEBUG nova.api.openstack.wsgi_app [-] placement.certfile = None {{(pid=120741) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 18:01:00.132994 dv-cinder-852009-8-iscsi devstack@n-api.service[120740]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.iscsi_iface = None {{(pid=120740) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 18:01:00.133084 dv-cinder-852009-8-iscsi devstack@n-api.service[120741]: DEBUG nova.api.openstack.wsgi_app [-] placement.collect_timing = False {{(pid=120741) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 18:01:00.133178 dv-cinder-852009-8-iscsi devstack@n-api.service[120740]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.iser_use_multipath = False {{(pid=120740) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 18:01:00.133269 dv-cinder-852009-8-iscsi devstack@n-api.service[120741]: DEBUG nova.api.openstack.wsgi_app [-] placement.connect_retries = None {{(pid=120741) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 18:01:00.133269 dv-cinder-852009-8-iscsi devstack@n-api.service[120741]: DEBUG nova.api.openstack.wsgi_app [-] placement.connect_retry_delay = None {{(pid=120741) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 18:01:00.133432 dv-cinder-852009-8-iscsi devstack@n-api.service[120740]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_bandwidth = 0 {{(pid=120740) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 18:01:00.133522 dv-cinder-852009-8-iscsi devstack@n-api.service[120741]: DEBUG nova.api.openstack.wsgi_app [-] placement.endpoint_override = None {{(pid=120741) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 18:01:00.133616 dv-cinder-852009-8-iscsi devstack@n-api.service[120740]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_completion_timeout = 800 {{(pid=120740) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 18:01:00.133697 dv-cinder-852009-8-iscsi devstack@n-api.service[120741]: DEBUG nova.api.openstack.wsgi_app [-] placement.insecure = False {{(pid=120741) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 18:01:00.133768 dv-cinder-852009-8-iscsi devstack@n-api.service[120740]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_downtime = 500 {{(pid=120740) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 18:01:00.133851 dv-cinder-852009-8-iscsi devstack@n-api.service[120741]: DEBUG nova.api.openstack.wsgi_app [-] placement.keyfile = None {{(pid=120741) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 18:01:00.133940 dv-cinder-852009-8-iscsi devstack@n-api.service[120740]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_downtime_delay = 75 {{(pid=120740) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 18:01:00.134038 dv-cinder-852009-8-iscsi devstack@n-api.service[120741]: DEBUG nova.api.openstack.wsgi_app [-] placement.max_version = None {{(pid=120741) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 18:01:00.134123 dv-cinder-852009-8-iscsi devstack@n-api.service[120740]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_downtime_steps = 10 {{(pid=120740) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 18:01:00.134328 dv-cinder-852009-8-iscsi devstack@n-api.service[120741]: DEBUG nova.api.openstack.wsgi_app [-] placement.min_version = None {{(pid=120741) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 18:01:00.134422 dv-cinder-852009-8-iscsi devstack@n-api.service[120740]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_inbound_addr = None {{(pid=120740) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 18:01:00.134513 dv-cinder-852009-8-iscsi devstack@n-api.service[120741]: DEBUG nova.api.openstack.wsgi_app [-] placement.region_name = RegionOne {{(pid=120741) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 18:01:00.134613 dv-cinder-852009-8-iscsi devstack@n-api.service[120740]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_permit_auto_converge = False {{(pid=120740) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 18:01:00.134702 dv-cinder-852009-8-iscsi devstack@n-api.service[120741]: DEBUG nova.api.openstack.wsgi_app [-] placement.service_name = None {{(pid=120741) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 18:01:00.134783 dv-cinder-852009-8-iscsi devstack@n-api.service[120740]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_permit_post_copy = False {{(pid=120740) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 18:01:00.134866 dv-cinder-852009-8-iscsi devstack@n-api.service[120741]: DEBUG nova.api.openstack.wsgi_app [-] placement.service_type = placement {{(pid=120741) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 18:01:00.134951 dv-cinder-852009-8-iscsi devstack@n-api.service[120740]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_scheme = None {{(pid=120740) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 18:01:00.135052 dv-cinder-852009-8-iscsi devstack@n-api.service[120741]: DEBUG nova.api.openstack.wsgi_app [-] placement.split_loggers = False {{(pid=120741) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 18:01:00.135143 dv-cinder-852009-8-iscsi devstack@n-api.service[120740]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_timeout_action = abort {{(pid=120740) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 18:01:00.135240 dv-cinder-852009-8-iscsi devstack@n-api.service[120741]: DEBUG nova.api.openstack.wsgi_app [-] placement.status_code_retries = None {{(pid=120741) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 18:01:00.135334 dv-cinder-852009-8-iscsi devstack@n-api.service[120740]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_tunnelled = False {{(pid=120740) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 18:01:00.135425 dv-cinder-852009-8-iscsi devstack@n-api.service[120741]: DEBUG nova.api.openstack.wsgi_app [-] placement.status_code_retry_delay = None {{(pid=120741) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 18:01:00.135510 dv-cinder-852009-8-iscsi devstack@n-api.service[120740]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_uri = None {{(pid=120740) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 18:01:00.135592 dv-cinder-852009-8-iscsi devstack@n-api.service[120741]: DEBUG nova.api.openstack.wsgi_app [-] placement.timeout = None {{(pid=120741) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 18:01:00.135675 dv-cinder-852009-8-iscsi devstack@n-api.service[120740]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_with_native_tls = False {{(pid=120740) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 18:01:00.135766 dv-cinder-852009-8-iscsi devstack@n-api.service[120741]: DEBUG nova.api.openstack.wsgi_app [-] placement.valid_interfaces = ['internal', 'public'] {{(pid=120741) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 18:01:00.135851 dv-cinder-852009-8-iscsi devstack@n-api.service[120740]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.max_queues = None {{(pid=120740) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 18:01:00.135934 dv-cinder-852009-8-iscsi devstack@n-api.service[120741]: DEBUG nova.api.openstack.wsgi_app [-] placement.version = None {{(pid=120741) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 18:01:00.136023 dv-cinder-852009-8-iscsi devstack@n-api.service[120740]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.mem_stats_period_seconds = 10 {{(pid=120740) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 18:01:00.136107 dv-cinder-852009-8-iscsi devstack@n-api.service[120741]: DEBUG nova.api.openstack.wsgi_app [-] quota.cores = 20 {{(pid=120741) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 18:01:00.136203 dv-cinder-852009-8-iscsi devstack@n-api.service[120740]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.nfs_mount_options = None {{(pid=120740) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 18:01:00.136287 dv-cinder-852009-8-iscsi devstack@n-api.service[120741]: DEBUG nova.api.openstack.wsgi_app [-] quota.count_usage_from_placement = False {{(pid=120741) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 18:01:00.136369 dv-cinder-852009-8-iscsi devstack@n-api.service[120740]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.nfs_mount_point_base = /opt/stack/data/nova/mnt {{(pid=120740) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 18:01:00.136467 dv-cinder-852009-8-iscsi devstack@n-api.service[120741]: DEBUG nova.api.openstack.wsgi_app [-] quota.driver = nova.quota.DbQuotaDriver {{(pid=120741) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 18:01:00.136552 dv-cinder-852009-8-iscsi devstack@n-api.service[120740]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_aoe_discover_tries = 3 {{(pid=120740) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 18:01:00.136634 dv-cinder-852009-8-iscsi devstack@n-api.service[120741]: DEBUG nova.api.openstack.wsgi_app [-] quota.injected_file_content_bytes = 10240 {{(pid=120741) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 18:01:00.136940 dv-cinder-852009-8-iscsi devstack@n-api.service[120740]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_iser_scan_tries = 5 {{(pid=120740) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 18:01:00.137036 dv-cinder-852009-8-iscsi devstack@n-api.service[120741]: DEBUG nova.api.openstack.wsgi_app [-] quota.injected_file_path_length = 255 {{(pid=120741) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 18:01:00.137129 dv-cinder-852009-8-iscsi devstack@n-api.service[120740]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_memory_encrypted_guests = None {{(pid=120740) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 18:01:00.137213 dv-cinder-852009-8-iscsi devstack@n-api.service[120741]: DEBUG nova.api.openstack.wsgi_app [-] quota.injected_files = 5 {{(pid=120741) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 18:01:00.137303 dv-cinder-852009-8-iscsi devstack@n-api.service[120740]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_nvme_discover_tries = 5 {{(pid=120740) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 18:01:00.137394 dv-cinder-852009-8-iscsi devstack@n-api.service[120741]: DEBUG nova.api.openstack.wsgi_app [-] quota.instances = 10 {{(pid=120741) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 18:01:00.137489 dv-cinder-852009-8-iscsi devstack@n-api.service[120740]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_pcie_ports = 0 {{(pid=120740) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 18:01:00.137580 dv-cinder-852009-8-iscsi devstack@n-api.service[120741]: DEBUG nova.api.openstack.wsgi_app [-] quota.key_pairs = 100 {{(pid=120741) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 18:01:00.137580 dv-cinder-852009-8-iscsi devstack@n-api.service[120741]: DEBUG nova.api.openstack.wsgi_app [-] quota.metadata_items = 128 {{(pid=120741) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 18:01:00.137743 dv-cinder-852009-8-iscsi devstack@n-api.service[120740]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_volume_scan_tries = 5 {{(pid=120740) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 18:01:00.137827 dv-cinder-852009-8-iscsi devstack@n-api.service[120741]: DEBUG nova.api.openstack.wsgi_app [-] quota.ram = 51200 {{(pid=120741) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 18:01:00.137917 dv-cinder-852009-8-iscsi devstack@n-api.service[120740]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.pmem_namespaces = [] {{(pid=120740) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 18:01:00.138014 dv-cinder-852009-8-iscsi devstack@n-api.service[120741]: DEBUG nova.api.openstack.wsgi_app [-] quota.recheck_quota = True {{(pid=120741) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 18:01:00.138099 dv-cinder-852009-8-iscsi devstack@n-api.service[120740]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.quobyte_client_cfg = None {{(pid=120740) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 18:01:00.138189 dv-cinder-852009-8-iscsi devstack@n-api.service[120741]: DEBUG nova.api.openstack.wsgi_app [-] quota.server_group_members = 10 {{(pid=120741) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 18:01:00.138274 dv-cinder-852009-8-iscsi devstack@n-api.service[120740]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.quobyte_mount_point_base = /opt/stack/data/nova/mnt {{(pid=120740) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 18:01:00.138398 dv-cinder-852009-8-iscsi devstack@n-api.service[120741]: DEBUG nova.api.openstack.wsgi_app [-] quota.server_groups = 10 {{(pid=120741) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 18:01:00.138496 dv-cinder-852009-8-iscsi devstack@n-api.service[120740]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_connect_timeout = 5 {{(pid=120740) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 18:01:00.138569 dv-cinder-852009-8-iscsi devstack@n-api.service[120741]: DEBUG nova.api.openstack.wsgi_app [-] rdp.enabled = False {{(pid=120741) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 18:01:00.138659 dv-cinder-852009-8-iscsi devstack@n-api.service[120740]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_destroy_volume_retries = 12 {{(pid=120740) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 18:01:00.138659 dv-cinder-852009-8-iscsi devstack@n-api.service[120740]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_destroy_volume_retry_interval = 5 {{(pid=120740) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 18:01:00.138825 dv-cinder-852009-8-iscsi devstack@n-api.service[120741]: DEBUG nova.api.openstack.wsgi_app [-] rdp.html5_proxy_base_url = http://127.0.0.1:6083/ {{(pid=120741) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 18:01:00.138915 dv-cinder-852009-8-iscsi devstack@n-api.service[120740]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_secret_uuid = None {{(pid=120740) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 18:01:00.139011 dv-cinder-852009-8-iscsi devstack@n-api.service[120741]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.discover_hosts_in_cells_interval = -1 {{(pid=120741) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 18:01:00.139135 dv-cinder-852009-8-iscsi devstack@n-api.service[120740]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_user = None {{(pid=120740) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 18:01:00.139219 dv-cinder-852009-8-iscsi devstack@n-api.service[120741]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.enable_isolated_aggregate_filtering = False {{(pid=120741) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 18:01:00.139298 dv-cinder-852009-8-iscsi devstack@n-api.service[120740]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.realtime_scheduler_priority = 1 {{(pid=120740) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 18:01:00.139370 dv-cinder-852009-8-iscsi devstack@n-api.service[120741]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.image_metadata_prefilter = False {{(pid=120741) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 18:01:00.139440 dv-cinder-852009-8-iscsi devstack@n-api.service[120740]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.remote_filesystem_transport = ssh {{(pid=120740) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 18:01:00.139523 dv-cinder-852009-8-iscsi devstack@n-api.service[120741]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.limit_tenants_to_placement_aggregate = False {{(pid=120741) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 18:01:00.139596 dv-cinder-852009-8-iscsi devstack@n-api.service[120740]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rescue_image_id = None {{(pid=120740) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 18:01:00.139890 dv-cinder-852009-8-iscsi devstack@n-api.service[120740]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rescue_kernel_id = None {{(pid=120740) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 18:01:00.140122 dv-cinder-852009-8-iscsi devstack@n-api.service[120740]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rescue_ramdisk_id = None {{(pid=120740) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 18:01:00.140534 dv-cinder-852009-8-iscsi devstack@n-api.service[120741]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.max_attempts = 3 {{(pid=120741) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 18:01:00.140649 dv-cinder-852009-8-iscsi devstack@n-api.service[120740]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rng_dev_path = /dev/urandom {{(pid=120740) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 18:01:00.140772 dv-cinder-852009-8-iscsi devstack@n-api.service[120740]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rx_queue_size = None {{(pid=120740) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 18:01:00.140854 dv-cinder-852009-8-iscsi devstack@n-api.service[120741]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.max_placement_results = 1000 {{(pid=120741) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 18:01:00.141097 dv-cinder-852009-8-iscsi devstack@n-api.service[120741]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.placement_aggregate_required_for_tenants = False {{(pid=120741) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 18:01:00.141178 dv-cinder-852009-8-iscsi devstack@n-api.service[120740]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.smbfs_mount_options = {{(pid=120740) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 18:01:00.141416 dv-cinder-852009-8-iscsi devstack@n-api.service[120741]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.query_placement_for_availability_zone = True {{(pid=120741) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 18:01:00.141980 dv-cinder-852009-8-iscsi devstack@n-api.service[120740]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.smbfs_mount_point_base = /opt/stack/data/nova/mnt {{(pid=120740) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 18:01:00.142073 dv-cinder-852009-8-iscsi devstack@n-api.service[120741]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.query_placement_for_image_type_support = False {{(pid=120741) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 18:01:00.142161 dv-cinder-852009-8-iscsi devstack@n-api.service[120740]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.snapshot_compression = False {{(pid=120740) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 18:01:00.142237 dv-cinder-852009-8-iscsi devstack@n-api.service[120741]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.query_placement_for_routed_network_aggregates = False {{(pid=120741) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 18:01:00.142316 dv-cinder-852009-8-iscsi devstack@n-api.service[120740]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.snapshot_image_format = None {{(pid=120740) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 18:01:00.143015 dv-cinder-852009-8-iscsi devstack@n-api.service[120741]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.workers = 2 {{(pid=120741) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 18:01:00.143124 dv-cinder-852009-8-iscsi devstack@n-api.service[120740]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.snapshots_directory = /opt/stack/data/nova/instances/snapshots {{(pid=120740) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 18:01:00.143200 dv-cinder-852009-8-iscsi devstack@n-api.service[120741]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.aggregate_image_properties_isolation_namespace = None {{(pid=120741) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 18:01:00.143281 dv-cinder-852009-8-iscsi devstack@n-api.service[120740]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.sparse_logical_volumes = False {{(pid=120740) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 18:01:00.143354 dv-cinder-852009-8-iscsi devstack@n-api.service[120741]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.aggregate_image_properties_isolation_separator = . {{(pid=120741) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 18:01:00.143432 dv-cinder-852009-8-iscsi devstack@n-api.service[120740]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.swtpm_enabled = False {{(pid=120740) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 18:01:00.143504 dv-cinder-852009-8-iscsi devstack@n-api.service[120741]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.available_filters = ['nova.scheduler.filters.all_filters'] {{(pid=120741) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 18:01:00.143779 dv-cinder-852009-8-iscsi devstack@n-api.service[120741]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.build_failure_weight_multiplier = 1000000.0 {{(pid=120741) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 18:01:00.144084 dv-cinder-852009-8-iscsi devstack@n-api.service[120741]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.cpu_weight_multiplier = 1.0 {{(pid=120741) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 18:01:00.144408 dv-cinder-852009-8-iscsi devstack@n-api.service[120741]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.cross_cell_move_weight_multiplier = 1000000.0 {{(pid=120741) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 18:01:00.144752 dv-cinder-852009-8-iscsi devstack@n-api.service[120741]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.disk_weight_multiplier = 1.0 {{(pid=120741) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 18:01:00.144849 dv-cinder-852009-8-iscsi devstack@n-api.service[120740]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.swtpm_group = tss {{(pid=120740) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 18:01:00.145120 dv-cinder-852009-8-iscsi devstack@n-api.service[120741]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.enabled_filters = ['AvailabilityZoneFilter', 'ComputeFilter', 'ComputeCapabilitiesFilter', 'ImagePropertiesFilter', 'ServerGroupAntiAffinityFilter', 'ServerGroupAffinityFilter', 'SameHostFilter', 'DifferentHostFilter'] {{(pid=120741) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 18:01:00.145227 dv-cinder-852009-8-iscsi devstack@n-api.service[120740]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.swtpm_user = tss {{(pid=120740) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 18:01:00.145439 dv-cinder-852009-8-iscsi devstack@n-api.service[120741]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.host_subset_size = 1 {{(pid=120741) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 18:01:00.145538 dv-cinder-852009-8-iscsi devstack@n-api.service[120740]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.sysinfo_serial = unique {{(pid=120740) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 18:01:00.145810 dv-cinder-852009-8-iscsi devstack@n-api.service[120741]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.image_properties_default_architecture = None {{(pid=120741) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 18:01:00.145912 dv-cinder-852009-8-iscsi devstack@n-api.service[120740]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.tx_queue_size = None {{(pid=120740) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 18:01:00.146134 dv-cinder-852009-8-iscsi devstack@n-api.service[120741]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.io_ops_weight_multiplier = -1.0 {{(pid=120741) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 18:01:00.146395 dv-cinder-852009-8-iscsi devstack@n-api.service[120740]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.uid_maps = [] {{(pid=120740) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 18:01:00.146484 dv-cinder-852009-8-iscsi devstack@n-api.service[120741]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.isolated_hosts = [] {{(pid=120741) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 18:01:00.146575 dv-cinder-852009-8-iscsi devstack@n-api.service[120740]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.use_virtio_for_bridges = True {{(pid=120740) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 18:01:00.146758 dv-cinder-852009-8-iscsi devstack@n-api.service[120741]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.isolated_images = [] {{(pid=120741) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 18:01:00.147048 dv-cinder-852009-8-iscsi devstack@n-api.service[120740]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.virt_type = kvm {{(pid=120740) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 18:01:00.147142 dv-cinder-852009-8-iscsi devstack@n-api.service[120741]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.max_instances_per_host = 50 {{(pid=120741) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 18:01:00.147227 dv-cinder-852009-8-iscsi devstack@n-api.service[120740]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.volume_clear = zero {{(pid=120740) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 18:01:00.147371 dv-cinder-852009-8-iscsi devstack@n-api.service[120741]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.max_io_ops_per_host = 8 {{(pid=120741) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 18:01:00.147463 dv-cinder-852009-8-iscsi devstack@n-api.service[120740]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.volume_clear_size = 0 {{(pid=120740) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 18:01:00.147687 dv-cinder-852009-8-iscsi devstack@n-api.service[120741]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.pci_weight_multiplier = 1.0 {{(pid=120741) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 18:01:00.147793 dv-cinder-852009-8-iscsi devstack@n-api.service[120740]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.volume_use_multipath = False {{(pid=120740) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 18:01:00.148002 dv-cinder-852009-8-iscsi devstack@n-api.service[120741]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.ram_weight_multiplier = 1.0 {{(pid=120741) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 18:01:00.148095 dv-cinder-852009-8-iscsi devstack@n-api.service[120740]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_cache_path = None {{(pid=120740) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 18:01:00.148315 dv-cinder-852009-8-iscsi devstack@n-api.service[120741]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.restrict_isolated_hosts_to_isolated_images = True {{(pid=120741) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 18:01:00.148416 dv-cinder-852009-8-iscsi devstack@n-api.service[120740]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_log_path = /var/log/vstorage/%(cluster_name)s/nova.log.gz {{(pid=120740) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 18:01:00.148663 dv-cinder-852009-8-iscsi devstack@n-api.service[120741]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.shuffle_best_same_weighed_hosts = False {{(pid=120741) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 18:01:00.148761 dv-cinder-852009-8-iscsi devstack@n-api.service[120740]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_group = qemu {{(pid=120740) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 18:01:00.148978 dv-cinder-852009-8-iscsi devstack@n-api.service[120741]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.soft_affinity_weight_multiplier = 1.0 {{(pid=120741) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 18:01:00.149075 dv-cinder-852009-8-iscsi devstack@n-api.service[120740]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_opts = [] {{(pid=120740) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 18:01:00.149294 dv-cinder-852009-8-iscsi devstack@n-api.service[120741]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.soft_anti_affinity_weight_multiplier = 1.0 {{(pid=120741) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 18:01:00.149431 dv-cinder-852009-8-iscsi devstack@n-api.service[120740]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_perms = 0770 {{(pid=120740) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 18:01:00.149783 dv-cinder-852009-8-iscsi devstack@n-api.service[120741]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.track_instance_changes = False {{(pid=120741) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 18:01:00.149889 dv-cinder-852009-8-iscsi devstack@n-api.service[120740]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_point_base = /opt/stack/data/nova/mnt {{(pid=120740) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 18:01:00.149982 dv-cinder-852009-8-iscsi devstack@n-api.service[120741]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.weight_classes = ['nova.scheduler.weights.all_weighers'] {{(pid=120741) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 18:01:00.150116 dv-cinder-852009-8-iscsi devstack@n-api.service[120740]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_user = stack {{(pid=120740) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 18:01:00.150555 dv-cinder-852009-8-iscsi devstack@n-api.service[120740]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.wait_soft_reboot_seconds = 120 {{(pid=120740) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 18:01:00.150784 dv-cinder-852009-8-iscsi devstack@n-api.service[120740]: DEBUG nova.api.openstack.wsgi_app [-] neutron.auth_section = None {{(pid=120740) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 18:01:00.150975 dv-cinder-852009-8-iscsi devstack@n-api.service[120741]: DEBUG nova.api.openstack.wsgi_app [-] metrics.required = True {{(pid=120741) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 18:01:00.151105 dv-cinder-852009-8-iscsi devstack@n-api.service[120740]: DEBUG nova.api.openstack.wsgi_app [-] neutron.auth_type = password {{(pid=120740) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 18:01:00.151306 dv-cinder-852009-8-iscsi devstack@n-api.service[120741]: DEBUG nova.api.openstack.wsgi_app [-] metrics.weight_multiplier = 1.0 {{(pid=120741) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 18:01:00.151405 dv-cinder-852009-8-iscsi devstack@n-api.service[120740]: DEBUG nova.api.openstack.wsgi_app [-] neutron.cafile = None {{(pid=120740) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 18:01:00.151637 dv-cinder-852009-8-iscsi devstack@n-api.service[120741]: DEBUG nova.api.openstack.wsgi_app [-] metrics.weight_of_unavailable = -10000.0 {{(pid=120741) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 18:01:00.151736 dv-cinder-852009-8-iscsi devstack@n-api.service[120740]: DEBUG nova.api.openstack.wsgi_app [-] neutron.certfile = None {{(pid=120740) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 18:01:00.151954 dv-cinder-852009-8-iscsi devstack@n-api.service[120741]: DEBUG nova.api.openstack.wsgi_app [-] metrics.weight_setting = [] {{(pid=120741) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 18:01:00.152047 dv-cinder-852009-8-iscsi devstack@n-api.service[120740]: DEBUG nova.api.openstack.wsgi_app [-] neutron.collect_timing = False {{(pid=120740) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 18:01:00.152327 dv-cinder-852009-8-iscsi devstack@n-api.service[120740]: DEBUG nova.api.openstack.wsgi_app [-] neutron.connect_retries = None {{(pid=120740) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 18:01:00.152548 dv-cinder-852009-8-iscsi devstack@n-api.service[120741]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.base_url = ws://127.0.0.1:6083/ {{(pid=120741) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 18:01:00.152671 dv-cinder-852009-8-iscsi devstack@n-api.service[120740]: DEBUG nova.api.openstack.wsgi_app [-] neutron.connect_retry_delay = None {{(pid=120740) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 18:01:00.152874 dv-cinder-852009-8-iscsi devstack@n-api.service[120741]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.enabled = False {{(pid=120741) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 18:01:00.152988 dv-cinder-852009-8-iscsi devstack@n-api.service[120740]: DEBUG nova.api.openstack.wsgi_app [-] neutron.default_floating_pool = public {{(pid=120740) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 18:01:00.153214 dv-cinder-852009-8-iscsi devstack@n-api.service[120741]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.port_range = 10000:20000 {{(pid=120741) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 18:01:00.153306 dv-cinder-852009-8-iscsi devstack@n-api.service[120740]: DEBUG nova.api.openstack.wsgi_app [-] neutron.endpoint_override = None {{(pid=120740) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 18:01:00.153610 dv-cinder-852009-8-iscsi devstack@n-api.service[120740]: DEBUG nova.api.openstack.wsgi_app [-] neutron.extension_sync_interval = 600 {{(pid=120740) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 18:01:00.153913 dv-cinder-852009-8-iscsi devstack@n-api.service[120741]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.proxyclient_address = 127.0.0.1 {{(pid=120741) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 18:01:00.154014 dv-cinder-852009-8-iscsi devstack@n-api.service[120740]: DEBUG nova.api.openstack.wsgi_app [-] neutron.http_retries = 3 {{(pid=120740) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 18:01:00.154230 dv-cinder-852009-8-iscsi devstack@n-api.service[120740]: DEBUG nova.api.openstack.wsgi_app [-] neutron.insecure = False {{(pid=120740) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 18:01:00.154329 dv-cinder-852009-8-iscsi devstack@n-api.service[120741]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.serialproxy_host = 0.0.0.0 {{(pid=120741) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 18:01:00.154543 dv-cinder-852009-8-iscsi devstack@n-api.service[120740]: DEBUG nova.api.openstack.wsgi_app [-] neutron.keyfile = None {{(pid=120740) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 18:01:00.154636 dv-cinder-852009-8-iscsi devstack@n-api.service[120741]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.serialproxy_port = 6083 {{(pid=120741) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 18:01:00.154887 dv-cinder-852009-8-iscsi devstack@n-api.service[120740]: DEBUG nova.api.openstack.wsgi_app [-] neutron.max_version = None {{(pid=120740) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 18:01:00.155097 dv-cinder-852009-8-iscsi devstack@n-api.service[120741]: DEBUG nova.api.openstack.wsgi_app [-] service_user.auth_section = None {{(pid=120741) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 18:01:00.155202 dv-cinder-852009-8-iscsi devstack@n-api.service[120740]: DEBUG nova.api.openstack.wsgi_app [-] neutron.metadata_proxy_shared_secret = **** {{(pid=120740) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 18:01:00.155433 dv-cinder-852009-8-iscsi devstack@n-api.service[120741]: DEBUG nova.api.openstack.wsgi_app [-] service_user.auth_type = password {{(pid=120741) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 18:01:00.155532 dv-cinder-852009-8-iscsi devstack@n-api.service[120740]: DEBUG nova.api.openstack.wsgi_app [-] neutron.min_version = None {{(pid=120740) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 18:01:00.155748 dv-cinder-852009-8-iscsi devstack@n-api.service[120741]: DEBUG nova.api.openstack.wsgi_app [-] service_user.cafile = None {{(pid=120741) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 18:01:00.155849 dv-cinder-852009-8-iscsi devstack@n-api.service[120740]: DEBUG nova.api.openstack.wsgi_app [-] neutron.ovs_bridge = br-int {{(pid=120740) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 18:01:00.156061 dv-cinder-852009-8-iscsi devstack@n-api.service[120741]: DEBUG nova.api.openstack.wsgi_app [-] service_user.certfile = None {{(pid=120741) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 18:01:00.156160 dv-cinder-852009-8-iscsi devstack@n-api.service[120740]: DEBUG nova.api.openstack.wsgi_app [-] neutron.physnets = [] {{(pid=120740) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 18:01:00.156376 dv-cinder-852009-8-iscsi devstack@n-api.service[120741]: DEBUG nova.api.openstack.wsgi_app [-] service_user.collect_timing = False {{(pid=120741) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 18:01:00.156493 dv-cinder-852009-8-iscsi devstack@n-api.service[120740]: DEBUG nova.api.openstack.wsgi_app [-] neutron.region_name = RegionOne {{(pid=120740) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 18:01:00.156784 dv-cinder-852009-8-iscsi devstack@n-api.service[120740]: DEBUG nova.api.openstack.wsgi_app [-] neutron.service_metadata_proxy = True {{(pid=120740) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 18:01:00.156882 dv-cinder-852009-8-iscsi devstack@n-api.service[120741]: DEBUG nova.api.openstack.wsgi_app [-] service_user.insecure = False {{(pid=120741) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 18:01:00.157100 dv-cinder-852009-8-iscsi devstack@n-api.service[120740]: DEBUG nova.api.openstack.wsgi_app [-] neutron.service_name = None {{(pid=120740) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 18:01:00.157207 dv-cinder-852009-8-iscsi devstack@n-api.service[120741]: DEBUG nova.api.openstack.wsgi_app [-] service_user.keyfile = None {{(pid=120741) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 18:01:00.157423 dv-cinder-852009-8-iscsi devstack@n-api.service[120741]: DEBUG nova.api.openstack.wsgi_app [-] service_user.send_service_user_token = True {{(pid=120741) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 18:01:00.157517 dv-cinder-852009-8-iscsi devstack@n-api.service[120740]: DEBUG nova.api.openstack.wsgi_app [-] neutron.service_type = network {{(pid=120740) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 18:01:00.157736 dv-cinder-852009-8-iscsi devstack@n-api.service[120740]: DEBUG nova.api.openstack.wsgi_app [-] neutron.split_loggers = False {{(pid=120740) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 18:01:00.157836 dv-cinder-852009-8-iscsi devstack@n-api.service[120741]: DEBUG nova.api.openstack.wsgi_app [-] service_user.split_loggers = False {{(pid=120741) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 18:01:00.158046 dv-cinder-852009-8-iscsi devstack@n-api.service[120740]: DEBUG nova.api.openstack.wsgi_app [-] neutron.status_code_retries = None {{(pid=120740) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 18:01:00.158139 dv-cinder-852009-8-iscsi devstack@n-api.service[120741]: DEBUG nova.api.openstack.wsgi_app [-] service_user.timeout = None {{(pid=120741) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 18:01:00.158352 dv-cinder-852009-8-iscsi devstack@n-api.service[120740]: DEBUG nova.api.openstack.wsgi_app [-] neutron.status_code_retry_delay = None {{(pid=120740) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 18:01:00.158450 dv-cinder-852009-8-iscsi devstack@n-api.service[120741]: DEBUG nova.api.openstack.wsgi_app [-] spice.agent_enabled = True {{(pid=120741) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 18:01:00.158661 dv-cinder-852009-8-iscsi devstack@n-api.service[120740]: DEBUG nova.api.openstack.wsgi_app [-] neutron.timeout = None {{(pid=120740) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 18:01:00.158762 dv-cinder-852009-8-iscsi devstack@n-api.service[120741]: DEBUG nova.api.openstack.wsgi_app [-] spice.enabled = False {{(pid=120741) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 18:01:00.159007 dv-cinder-852009-8-iscsi devstack@n-api.service[120740]: DEBUG nova.api.openstack.wsgi_app [-] neutron.valid_interfaces = ['internal', 'public'] {{(pid=120740) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 18:01:00.159195 dv-cinder-852009-8-iscsi devstack@n-api.service[120741]: DEBUG nova.api.openstack.wsgi_app [-] spice.html5proxy_base_url = http://127.0.0.1:6082/spice_auto.html {{(pid=120741) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 18:01:00.159318 dv-cinder-852009-8-iscsi devstack@n-api.service[120740]: DEBUG nova.api.openstack.wsgi_app [-] neutron.version = None {{(pid=120740) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 18:01:00.159551 dv-cinder-852009-8-iscsi devstack@n-api.service[120741]: DEBUG nova.api.openstack.wsgi_app [-] spice.html5proxy_host = 0.0.0.0 {{(pid=120741) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 18:01:00.159650 dv-cinder-852009-8-iscsi devstack@n-api.service[120740]: DEBUG nova.api.openstack.wsgi_app [-] notifications.bdms_in_notifications = False {{(pid=120740) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 18:01:00.159868 dv-cinder-852009-8-iscsi devstack@n-api.service[120741]: DEBUG nova.api.openstack.wsgi_app [-] spice.html5proxy_port = 6082 {{(pid=120741) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 18:01:00.159968 dv-cinder-852009-8-iscsi devstack@n-api.service[120740]: DEBUG nova.api.openstack.wsgi_app [-] notifications.default_level = INFO {{(pid=120740) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 18:01:00.160194 dv-cinder-852009-8-iscsi devstack@n-api.service[120741]: DEBUG nova.api.openstack.wsgi_app [-] spice.server_listen = 127.0.0.1 {{(pid=120741) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 18:01:00.160293 dv-cinder-852009-8-iscsi devstack@n-api.service[120740]: DEBUG nova.api.openstack.wsgi_app [-] notifications.notification_format = unversioned {{(pid=120740) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 18:01:00.160554 dv-cinder-852009-8-iscsi devstack@n-api.service[120741]: DEBUG nova.api.openstack.wsgi_app [-] spice.server_proxyclient_address = 127.0.0.1 {{(pid=120741) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 18:01:00.160692 dv-cinder-852009-8-iscsi devstack@n-api.service[120740]: DEBUG nova.api.openstack.wsgi_app [-] notifications.notify_on_state_change = None {{(pid=120740) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 18:01:00.160869 dv-cinder-852009-8-iscsi devstack@n-api.service[120741]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.baseapi = None {{(pid=120741) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 18:01:00.160966 dv-cinder-852009-8-iscsi devstack@n-api.service[120740]: DEBUG nova.api.openstack.wsgi_app [-] notifications.versioned_notifications_topics = ['versioned_notifications'] {{(pid=120740) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 18:01:00.161181 dv-cinder-852009-8-iscsi devstack@n-api.service[120741]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.cert = None {{(pid=120741) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 18:01:00.161285 dv-cinder-852009-8-iscsi devstack@n-api.service[120740]: DEBUG nova.api.openstack.wsgi_app [-] pci.alias = [] {{(pid=120740) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 18:01:00.161536 dv-cinder-852009-8-iscsi devstack@n-api.service[120741]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.compute = auto {{(pid=120741) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 18:01:00.161649 dv-cinder-852009-8-iscsi devstack@n-api.service[120740]: DEBUG nova.api.openstack.wsgi_app [-] pci.device_spec = [] {{(pid=120740) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 18:01:00.161870 dv-cinder-852009-8-iscsi devstack@n-api.service[120741]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.conductor = None {{(pid=120741) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 18:01:00.161964 dv-cinder-852009-8-iscsi devstack@n-api.service[120740]: DEBUG nova.api.openstack.wsgi_app [-] pci.report_in_placement = False {{(pid=120740) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 18:01:00.162181 dv-cinder-852009-8-iscsi devstack@n-api.service[120741]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.scheduler = None {{(pid=120741) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 18:01:00.162285 dv-cinder-852009-8-iscsi devstack@n-api.service[120740]: DEBUG nova.api.openstack.wsgi_app [-] placement.auth_section = None {{(pid=120740) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 18:01:00.162498 dv-cinder-852009-8-iscsi devstack@n-api.service[120741]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.auth_section = None {{(pid=120741) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 18:01:00.162601 dv-cinder-852009-8-iscsi devstack@n-api.service[120740]: DEBUG nova.api.openstack.wsgi_app [-] placement.auth_type = password {{(pid=120740) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 18:01:00.162815 dv-cinder-852009-8-iscsi devstack@n-api.service[120741]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.auth_type = None {{(pid=120741) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 18:01:00.162911 dv-cinder-852009-8-iscsi devstack@n-api.service[120740]: DEBUG nova.api.openstack.wsgi_app [-] placement.cafile = None {{(pid=120740) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 18:01:00.163123 dv-cinder-852009-8-iscsi devstack@n-api.service[120741]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.cafile = None {{(pid=120741) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 18:01:00.163224 dv-cinder-852009-8-iscsi devstack@n-api.service[120740]: DEBUG nova.api.openstack.wsgi_app [-] placement.certfile = None {{(pid=120740) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 18:01:00.163434 dv-cinder-852009-8-iscsi devstack@n-api.service[120741]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.certfile = None {{(pid=120741) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 18:01:00.163625 dv-cinder-852009-8-iscsi devstack@n-api.service[120740]: DEBUG nova.api.openstack.wsgi_app [-] placement.collect_timing = False {{(pid=120740) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 18:01:00.163730 dv-cinder-852009-8-iscsi devstack@n-api.service[120741]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.collect_timing = False {{(pid=120741) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 18:01:00.163817 dv-cinder-852009-8-iscsi devstack@n-api.service[120740]: DEBUG nova.api.openstack.wsgi_app [-] placement.connect_retries = None {{(pid=120740) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 18:01:00.164042 dv-cinder-852009-8-iscsi devstack@n-api.service[120741]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.insecure = False {{(pid=120741) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 18:01:00.164136 dv-cinder-852009-8-iscsi devstack@n-api.service[120740]: DEBUG nova.api.openstack.wsgi_app [-] placement.connect_retry_delay = None {{(pid=120740) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 18:01:00.164347 dv-cinder-852009-8-iscsi devstack@n-api.service[120741]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.keyfile = None {{(pid=120741) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 18:01:00.164465 dv-cinder-852009-8-iscsi devstack@n-api.service[120740]: DEBUG nova.api.openstack.wsgi_app [-] placement.endpoint_override = None {{(pid=120740) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 18:01:00.164690 dv-cinder-852009-8-iscsi devstack@n-api.service[120740]: DEBUG nova.api.openstack.wsgi_app [-] placement.insecure = False {{(pid=120740) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 18:01:00.164781 dv-cinder-852009-8-iscsi devstack@n-api.service[120741]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.split_loggers = False {{(pid=120741) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 18:01:00.165001 dv-cinder-852009-8-iscsi devstack@n-api.service[120740]: DEBUG nova.api.openstack.wsgi_app [-] placement.keyfile = None {{(pid=120740) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 18:01:00.165154 dv-cinder-852009-8-iscsi devstack@n-api.service[120741]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.timeout = None {{(pid=120741) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 18:01:00.165309 dv-cinder-852009-8-iscsi devstack@n-api.service[120740]: DEBUG nova.api.openstack.wsgi_app [-] placement.max_version = None {{(pid=120740) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 18:01:00.165445 dv-cinder-852009-8-iscsi devstack@n-api.service[120741]: DEBUG nova.api.openstack.wsgi_app [-] vmware.api_retry_count = 10 {{(pid=120741) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 18:01:00.165595 dv-cinder-852009-8-iscsi devstack@n-api.service[120740]: DEBUG nova.api.openstack.wsgi_app [-] placement.min_version = None {{(pid=120740) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 18:01:00.165733 dv-cinder-852009-8-iscsi devstack@n-api.service[120741]: DEBUG nova.api.openstack.wsgi_app [-] vmware.ca_file = None {{(pid=120741) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 18:01:00.165915 dv-cinder-852009-8-iscsi devstack@n-api.service[120740]: DEBUG nova.api.openstack.wsgi_app [-] placement.region_name = RegionOne {{(pid=120740) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 18:01:00.166056 dv-cinder-852009-8-iscsi devstack@n-api.service[120741]: DEBUG nova.api.openstack.wsgi_app [-] vmware.cache_prefix = None {{(pid=120741) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 18:01:00.166280 dv-cinder-852009-8-iscsi devstack@n-api.service[120740]: DEBUG nova.api.openstack.wsgi_app [-] placement.service_name = None {{(pid=120740) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 18:01:00.166420 dv-cinder-852009-8-iscsi devstack@n-api.service[120741]: DEBUG nova.api.openstack.wsgi_app [-] vmware.cluster_name = None {{(pid=120741) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 18:01:00.166558 dv-cinder-852009-8-iscsi devstack@n-api.service[120741]: DEBUG nova.api.openstack.wsgi_app [-] vmware.connection_pool_size = 10 {{(pid=120741) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 18:01:00.166694 dv-cinder-852009-8-iscsi devstack@n-api.service[120740]: DEBUG nova.api.openstack.wsgi_app [-] placement.service_type = placement {{(pid=120740) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 18:01:00.166831 dv-cinder-852009-8-iscsi devstack@n-api.service[120741]: DEBUG nova.api.openstack.wsgi_app [-] vmware.console_delay_seconds = None {{(pid=120741) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 18:01:00.166977 dv-cinder-852009-8-iscsi devstack@n-api.service[120740]: DEBUG nova.api.openstack.wsgi_app [-] placement.split_loggers = False {{(pid=120740) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 18:01:00.167135 dv-cinder-852009-8-iscsi devstack@n-api.service[120741]: DEBUG nova.api.openstack.wsgi_app [-] vmware.datastore_regex = None {{(pid=120741) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 18:01:00.167224 dv-cinder-852009-8-iscsi devstack@n-api.service[120740]: DEBUG nova.api.openstack.wsgi_app [-] placement.status_code_retries = None {{(pid=120740) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 18:01:00.167407 dv-cinder-852009-8-iscsi devstack@n-api.service[120741]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_ip = None {{(pid=120741) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 18:01:00.167524 dv-cinder-852009-8-iscsi devstack@n-api.service[120740]: DEBUG nova.api.openstack.wsgi_app [-] placement.status_code_retry_delay = None {{(pid=120740) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 18:01:00.167712 dv-cinder-852009-8-iscsi devstack@n-api.service[120741]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_password = **** {{(pid=120741) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 18:01:00.167807 dv-cinder-852009-8-iscsi devstack@n-api.service[120740]: DEBUG nova.api.openstack.wsgi_app [-] placement.timeout = None {{(pid=120740) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 18:01:00.168025 dv-cinder-852009-8-iscsi devstack@n-api.service[120741]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_port = 443 {{(pid=120741) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 18:01:00.168128 dv-cinder-852009-8-iscsi devstack@n-api.service[120740]: DEBUG nova.api.openstack.wsgi_app [-] placement.valid_interfaces = ['internal', 'public'] {{(pid=120740) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 18:01:00.168331 dv-cinder-852009-8-iscsi devstack@n-api.service[120741]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_username = None {{(pid=120741) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 18:01:00.168490 dv-cinder-852009-8-iscsi devstack@n-api.service[120740]: DEBUG nova.api.openstack.wsgi_app [-] placement.version = None {{(pid=120740) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 18:01:00.168711 dv-cinder-852009-8-iscsi devstack@n-api.service[120740]: DEBUG nova.api.openstack.wsgi_app [-] quota.cores = 20 {{(pid=120740) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 18:01:00.168825 dv-cinder-852009-8-iscsi devstack@n-api.service[120741]: DEBUG nova.api.openstack.wsgi_app [-] vmware.insecure = False {{(pid=120741) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 18:01:00.169027 dv-cinder-852009-8-iscsi devstack@n-api.service[120740]: DEBUG nova.api.openstack.wsgi_app [-] quota.count_usage_from_placement = False {{(pid=120740) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 18:01:00.169129 dv-cinder-852009-8-iscsi devstack@n-api.service[120741]: DEBUG nova.api.openstack.wsgi_app [-] vmware.integration_bridge = None {{(pid=120741) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 18:01:00.169357 dv-cinder-852009-8-iscsi devstack@n-api.service[120740]: DEBUG nova.api.openstack.wsgi_app [-] quota.driver = nova.quota.DbQuotaDriver {{(pid=120740) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 18:01:00.169459 dv-cinder-852009-8-iscsi devstack@n-api.service[120741]: DEBUG nova.api.openstack.wsgi_app [-] vmware.maximum_objects = 100 {{(pid=120741) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 18:01:00.169677 dv-cinder-852009-8-iscsi devstack@n-api.service[120740]: DEBUG nova.api.openstack.wsgi_app [-] quota.injected_file_content_bytes = 10240 {{(pid=120740) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 18:01:00.169787 dv-cinder-852009-8-iscsi devstack@n-api.service[120741]: DEBUG nova.api.openstack.wsgi_app [-] vmware.pbm_default_policy = None {{(pid=120741) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 18:01:00.169998 dv-cinder-852009-8-iscsi devstack@n-api.service[120740]: DEBUG nova.api.openstack.wsgi_app [-] quota.injected_file_path_length = 255 {{(pid=120740) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 18:01:00.170093 dv-cinder-852009-8-iscsi devstack@n-api.service[120741]: DEBUG nova.api.openstack.wsgi_app [-] vmware.pbm_enabled = False {{(pid=120741) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 18:01:00.170302 dv-cinder-852009-8-iscsi devstack@n-api.service[120741]: DEBUG nova.api.openstack.wsgi_app [-] vmware.pbm_wsdl_location = None {{(pid=120741) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 18:01:00.170395 dv-cinder-852009-8-iscsi devstack@n-api.service[120740]: DEBUG nova.api.openstack.wsgi_app [-] quota.injected_files = 5 {{(pid=120740) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 18:01:00.170621 dv-cinder-852009-8-iscsi devstack@n-api.service[120740]: DEBUG nova.api.openstack.wsgi_app [-] quota.instances = 10 {{(pid=120740) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 18:01:00.170723 dv-cinder-852009-8-iscsi devstack@n-api.service[120741]: DEBUG nova.api.openstack.wsgi_app [-] vmware.serial_log_dir = /opt/vmware/vspc {{(pid=120741) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 18:01:00.170926 dv-cinder-852009-8-iscsi devstack@n-api.service[120741]: DEBUG nova.api.openstack.wsgi_app [-] vmware.serial_port_proxy_uri = None {{(pid=120741) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 18:01:00.171028 dv-cinder-852009-8-iscsi devstack@n-api.service[120740]: DEBUG nova.api.openstack.wsgi_app [-] quota.key_pairs = 100 {{(pid=120740) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 18:01:00.171231 dv-cinder-852009-8-iscsi devstack@n-api.service[120741]: DEBUG nova.api.openstack.wsgi_app [-] vmware.serial_port_service_uri = None {{(pid=120741) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 18:01:00.171335 dv-cinder-852009-8-iscsi devstack@n-api.service[120740]: DEBUG nova.api.openstack.wsgi_app [-] quota.metadata_items = 128 {{(pid=120740) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 18:01:00.171550 dv-cinder-852009-8-iscsi devstack@n-api.service[120740]: DEBUG nova.api.openstack.wsgi_app [-] quota.ram = 51200 {{(pid=120740) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 18:01:00.171653 dv-cinder-852009-8-iscsi devstack@n-api.service[120741]: DEBUG nova.api.openstack.wsgi_app [-] vmware.task_poll_interval = 0.5 {{(pid=120741) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 18:01:00.171859 dv-cinder-852009-8-iscsi devstack@n-api.service[120741]: DEBUG nova.api.openstack.wsgi_app [-] vmware.use_linked_clone = True {{(pid=120741) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 18:01:00.171953 dv-cinder-852009-8-iscsi devstack@n-api.service[120740]: DEBUG nova.api.openstack.wsgi_app [-] quota.recheck_quota = True {{(pid=120740) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 18:01:00.172175 dv-cinder-852009-8-iscsi devstack@n-api.service[120740]: DEBUG nova.api.openstack.wsgi_app [-] quota.server_group_members = 10 {{(pid=120740) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 18:01:00.172267 dv-cinder-852009-8-iscsi devstack@n-api.service[120741]: DEBUG nova.api.openstack.wsgi_app [-] vmware.vnc_keymap = en-us {{(pid=120741) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 18:01:00.172515 dv-cinder-852009-8-iscsi devstack@n-api.service[120741]: DEBUG nova.api.openstack.wsgi_app [-] vmware.vnc_port = 5900 {{(pid=120741) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 18:01:00.172630 dv-cinder-852009-8-iscsi devstack@n-api.service[120740]: DEBUG nova.api.openstack.wsgi_app [-] quota.server_groups = 10 {{(pid=120740) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 18:01:00.172830 dv-cinder-852009-8-iscsi devstack@n-api.service[120741]: DEBUG nova.api.openstack.wsgi_app [-] vmware.vnc_port_total = 10000 {{(pid=120741) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 18:01:00.172925 dv-cinder-852009-8-iscsi devstack@n-api.service[120740]: DEBUG nova.api.openstack.wsgi_app [-] rdp.enabled = False {{(pid=120740) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 18:01:00.173181 dv-cinder-852009-8-iscsi devstack@n-api.service[120741]: DEBUG nova.api.openstack.wsgi_app [-] vnc.auth_schemes = ['none'] {{(pid=120741) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 18:01:00.173399 dv-cinder-852009-8-iscsi devstack@n-api.service[120740]: DEBUG nova.api.openstack.wsgi_app [-] rdp.html5_proxy_base_url = http://127.0.0.1:6083/ {{(pid=120740) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 18:01:00.173534 dv-cinder-852009-8-iscsi devstack@n-api.service[120741]: DEBUG nova.api.openstack.wsgi_app [-] vnc.enabled = True {{(pid=120741) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 18:01:00.173737 dv-cinder-852009-8-iscsi devstack@n-api.service[120740]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.discover_hosts_in_cells_interval = -1 {{(pid=120740) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 18:01:00.174019 dv-cinder-852009-8-iscsi devstack@n-api.service[120741]: DEBUG nova.api.openstack.wsgi_app [-] vnc.novncproxy_base_url = http://127.0.0.1:6080/vnc_auto.html {{(pid=120741) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 18:01:00.174134 dv-cinder-852009-8-iscsi devstack@n-api.service[120740]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.enable_isolated_aggregate_filtering = False {{(pid=120740) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 18:01:00.174353 dv-cinder-852009-8-iscsi devstack@n-api.service[120741]: DEBUG nova.api.openstack.wsgi_app [-] vnc.novncproxy_host = 0.0.0.0 {{(pid=120741) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 18:01:00.174465 dv-cinder-852009-8-iscsi devstack@n-api.service[120740]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.image_metadata_prefilter = False {{(pid=120740) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 18:01:00.174680 dv-cinder-852009-8-iscsi devstack@n-api.service[120740]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.limit_tenants_to_placement_aggregate = False {{(pid=120740) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 18:01:00.174781 dv-cinder-852009-8-iscsi devstack@n-api.service[120741]: DEBUG nova.api.openstack.wsgi_app [-] vnc.novncproxy_port = 6080 {{(pid=120741) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 18:01:00.174994 dv-cinder-852009-8-iscsi devstack@n-api.service[120740]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.max_attempts = 3 {{(pid=120740) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 18:01:00.175104 dv-cinder-852009-8-iscsi devstack@n-api.service[120741]: DEBUG nova.api.openstack.wsgi_app [-] vnc.server_listen = 127.0.0.1 {{(pid=120741) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 18:01:00.175315 dv-cinder-852009-8-iscsi devstack@n-api.service[120740]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.max_placement_results = 1000 {{(pid=120740) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 18:01:00.175474 dv-cinder-852009-8-iscsi devstack@n-api.service[120741]: DEBUG nova.api.openstack.wsgi_app [-] vnc.server_proxyclient_address = 127.0.0.1 {{(pid=120741) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 18:01:00.175624 dv-cinder-852009-8-iscsi devstack@n-api.service[120741]: DEBUG nova.api.openstack.wsgi_app [-] vnc.vencrypt_ca_certs = None {{(pid=120741) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 18:01:00.175720 dv-cinder-852009-8-iscsi devstack@n-api.service[120740]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.placement_aggregate_required_for_tenants = False {{(pid=120740) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 18:01:00.175931 dv-cinder-852009-8-iscsi devstack@n-api.service[120741]: DEBUG nova.api.openstack.wsgi_app [-] vnc.vencrypt_client_cert = None {{(pid=120741) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 18:01:00.176024 dv-cinder-852009-8-iscsi devstack@n-api.service[120740]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.query_placement_for_availability_zone = True {{(pid=120740) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 18:01:00.176235 dv-cinder-852009-8-iscsi devstack@n-api.service[120741]: DEBUG nova.api.openstack.wsgi_app [-] vnc.vencrypt_client_key = None {{(pid=120741) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 18:01:00.176343 dv-cinder-852009-8-iscsi devstack@n-api.service[120740]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.query_placement_for_image_type_support = False {{(pid=120740) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 18:01:00.176584 dv-cinder-852009-8-iscsi devstack@n-api.service[120741]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_compute_service_check_for_ffu = False {{(pid=120741) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 18:01:00.176693 dv-cinder-852009-8-iscsi devstack@n-api.service[120740]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.query_placement_for_routed_network_aggregates = False {{(pid=120740) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 18:01:00.176898 dv-cinder-852009-8-iscsi devstack@n-api.service[120741]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_fallback_pcpu_query = False {{(pid=120741) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 18:01:00.177065 dv-cinder-852009-8-iscsi devstack@n-api.service[120740]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.workers = 2 {{(pid=120740) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 18:01:00.177270 dv-cinder-852009-8-iscsi devstack@n-api.service[120741]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_group_policy_check_upcall = False {{(pid=120741) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 18:01:00.177432 dv-cinder-852009-8-iscsi devstack@n-api.service[120740]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.aggregate_image_properties_isolation_namespace = None {{(pid=120740) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 18:01:00.177576 dv-cinder-852009-8-iscsi devstack@n-api.service[120741]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_libvirt_livesnapshot = False {{(pid=120741) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 18:01:00.177668 dv-cinder-852009-8-iscsi devstack@n-api.service[120740]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.aggregate_image_properties_isolation_separator = . {{(pid=120740) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 18:01:00.177876 dv-cinder-852009-8-iscsi devstack@n-api.service[120741]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_rootwrap = False {{(pid=120741) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 18:01:00.177976 dv-cinder-852009-8-iscsi devstack@n-api.service[120740]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.available_filters = ['nova.scheduler.filters.all_filters'] {{(pid=120740) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 18:01:00.178186 dv-cinder-852009-8-iscsi devstack@n-api.service[120741]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.enable_numa_live_migration = False {{(pid=120741) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 18:01:00.178287 dv-cinder-852009-8-iscsi devstack@n-api.service[120740]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.build_failure_weight_multiplier = 1000000.0 {{(pid=120740) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 18:01:00.178495 dv-cinder-852009-8-iscsi devstack@n-api.service[120741]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.enable_qemu_monitor_announce_self = False {{(pid=120741) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 18:01:00.178594 dv-cinder-852009-8-iscsi devstack@n-api.service[120740]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.cpu_weight_multiplier = 1.0 {{(pid=120740) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 18:01:00.178803 dv-cinder-852009-8-iscsi devstack@n-api.service[120741]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.ensure_libvirt_rbd_instance_dir_cleanup = False {{(pid=120741) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 18:01:00.178901 dv-cinder-852009-8-iscsi devstack@n-api.service[120740]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.cross_cell_move_weight_multiplier = 1000000.0 {{(pid=120740) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 18:01:00.179111 dv-cinder-852009-8-iscsi devstack@n-api.service[120741]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.handle_virt_lifecycle_events = True {{(pid=120741) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 18:01:00.179212 dv-cinder-852009-8-iscsi devstack@n-api.service[120740]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.disk_weight_multiplier = 1.0 {{(pid=120740) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 18:01:00.179419 dv-cinder-852009-8-iscsi devstack@n-api.service[120741]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.libvirt_disable_apic = False {{(pid=120741) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 18:01:00.179518 dv-cinder-852009-8-iscsi devstack@n-api.service[120740]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.enabled_filters = ['AvailabilityZoneFilter', 'ComputeFilter', 'ComputeCapabilitiesFilter', 'ImagePropertiesFilter', 'ServerGroupAntiAffinityFilter', 'ServerGroupAffinityFilter', 'SameHostFilter', 'DifferentHostFilter'] {{(pid=120740) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 18:01:00.179729 dv-cinder-852009-8-iscsi devstack@n-api.service[120741]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.never_download_image_if_on_rbd = False {{(pid=120741) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 18:01:00.179864 dv-cinder-852009-8-iscsi devstack@n-api.service[120740]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.host_subset_size = 1 {{(pid=120740) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 18:01:00.180034 dv-cinder-852009-8-iscsi devstack@n-api.service[120741]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.reserve_disk_resource_for_image_cache = False {{(pid=120741) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 18:01:00.180135 dv-cinder-852009-8-iscsi devstack@n-api.service[120740]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.image_properties_default_architecture = None {{(pid=120740) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 18:01:00.180340 dv-cinder-852009-8-iscsi devstack@n-api.service[120741]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.skip_cpu_compare_on_dest = False {{(pid=120741) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 18:01:00.180471 dv-cinder-852009-8-iscsi devstack@n-api.service[120740]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.io_ops_weight_multiplier = -1.0 {{(pid=120740) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 18:01:00.180686 dv-cinder-852009-8-iscsi devstack@n-api.service[120741]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.skip_hypervisor_version_check_on_lm = False {{(pid=120741) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 18:01:00.180797 dv-cinder-852009-8-iscsi devstack@n-api.service[120740]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.isolated_hosts = [] {{(pid=120740) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 18:01:00.180995 dv-cinder-852009-8-iscsi devstack@n-api.service[120741]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.unified_limits_count_pcpu_as_vcpu = False {{(pid=120741) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 18:01:00.181100 dv-cinder-852009-8-iscsi devstack@n-api.service[120740]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.isolated_images = [] {{(pid=120740) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 18:01:00.181309 dv-cinder-852009-8-iscsi devstack@n-api.service[120741]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.wait_for_vif_plugged_event_during_hard_reboot = [] {{(pid=120741) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 18:01:00.181402 dv-cinder-852009-8-iscsi devstack@n-api.service[120740]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.max_instances_per_host = 50 {{(pid=120740) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 18:01:00.181651 dv-cinder-852009-8-iscsi devstack@n-api.service[120741]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.api_paste_config = /etc/nova/api-paste.ini {{(pid=120741) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 18:01:00.181759 dv-cinder-852009-8-iscsi devstack@n-api.service[120740]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.max_io_ops_per_host = 8 {{(pid=120740) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 18:01:00.181972 dv-cinder-852009-8-iscsi devstack@n-api.service[120741]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.client_socket_timeout = 900 {{(pid=120741) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 18:01:00.182082 dv-cinder-852009-8-iscsi devstack@n-api.service[120740]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.pci_weight_multiplier = 1.0 {{(pid=120740) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 18:01:00.182287 dv-cinder-852009-8-iscsi devstack@n-api.service[120740]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.ram_weight_multiplier = 1.0 {{(pid=120740) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 18:01:00.182377 dv-cinder-852009-8-iscsi devstack@n-api.service[120741]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.default_pool_size = 1000 {{(pid=120741) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 18:01:00.182600 dv-cinder-852009-8-iscsi devstack@n-api.service[120741]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.keep_alive = True {{(pid=120741) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 18:01:00.182700 dv-cinder-852009-8-iscsi devstack@n-api.service[120740]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.restrict_isolated_hosts_to_isolated_images = True {{(pid=120740) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 18:01:00.182911 dv-cinder-852009-8-iscsi devstack@n-api.service[120740]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.shuffle_best_same_weighed_hosts = False {{(pid=120740) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 18:01:00.183009 dv-cinder-852009-8-iscsi devstack@n-api.service[120741]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.max_header_line = 16384 {{(pid=120741) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 18:01:00.183217 dv-cinder-852009-8-iscsi devstack@n-api.service[120741]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.secure_proxy_ssl_header = None {{(pid=120741) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 18:01:00.183315 dv-cinder-852009-8-iscsi devstack@n-api.service[120740]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.soft_affinity_weight_multiplier = 1.0 {{(pid=120740) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 18:01:00.183530 dv-cinder-852009-8-iscsi devstack@n-api.service[120740]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.soft_anti_affinity_weight_multiplier = 1.0 {{(pid=120740) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 18:01:00.183655 dv-cinder-852009-8-iscsi devstack@n-api.service[120741]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.ssl_ca_file = None {{(pid=120741) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 18:01:00.183842 dv-cinder-852009-8-iscsi devstack@n-api.service[120741]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.ssl_cert_file = None {{(pid=120741) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 18:01:00.183939 dv-cinder-852009-8-iscsi devstack@n-api.service[120740]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.track_instance_changes = False {{(pid=120740) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 18:01:00.184152 dv-cinder-852009-8-iscsi devstack@n-api.service[120741]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.ssl_key_file = None {{(pid=120741) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 18:01:00.184244 dv-cinder-852009-8-iscsi devstack@n-api.service[120740]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.weight_classes = ['nova.scheduler.weights.all_weighers'] {{(pid=120740) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 18:01:00.184493 dv-cinder-852009-8-iscsi devstack@n-api.service[120741]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.tcp_keepidle = 600 {{(pid=120741) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 18:01:00.184610 dv-cinder-852009-8-iscsi devstack@n-api.service[120740]: DEBUG nova.api.openstack.wsgi_app [-] metrics.required = True {{(pid=120740) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 18:01:00.184857 dv-cinder-852009-8-iscsi devstack@n-api.service[120740]: DEBUG nova.api.openstack.wsgi_app [-] metrics.weight_multiplier = 1.0 {{(pid=120740) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 18:01:00.184963 dv-cinder-852009-8-iscsi devstack@n-api.service[120741]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.wsgi_log_format = %(client_ip)s "%(request_line)s" status: %(status_code)s len: %(body_length)s time: %(wall_seconds).7f {{(pid=120741) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 18:01:00.185127 dv-cinder-852009-8-iscsi devstack@n-api.service[120740]: DEBUG nova.api.openstack.wsgi_app [-] metrics.weight_of_unavailable = -10000.0 {{(pid=120740) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 18:01:00.185219 dv-cinder-852009-8-iscsi devstack@n-api.service[120741]: DEBUG nova.api.openstack.wsgi_app [-] zvm.ca_file = None {{(pid=120741) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 18:01:00.185431 dv-cinder-852009-8-iscsi devstack@n-api.service[120741]: DEBUG nova.api.openstack.wsgi_app [-] zvm.cloud_connector_url = None {{(pid=120741) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 18:01:00.185512 dv-cinder-852009-8-iscsi devstack@n-api.service[120740]: DEBUG nova.api.openstack.wsgi_app [-] metrics.weight_setting = [] {{(pid=120740) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 18:01:00.185860 dv-cinder-852009-8-iscsi devstack@n-api.service[120741]: DEBUG nova.api.openstack.wsgi_app [-] zvm.image_tmp_path = /opt/stack/data/nova/images {{(pid=120741) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 18:01:00.185956 dv-cinder-852009-8-iscsi devstack@n-api.service[120740]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.base_url = ws://127.0.0.1:6083/ {{(pid=120740) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 18:01:00.186173 dv-cinder-852009-8-iscsi devstack@n-api.service[120741]: DEBUG nova.api.openstack.wsgi_app [-] zvm.reachable_timeout = 300 {{(pid=120741) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 18:01:00.186311 dv-cinder-852009-8-iscsi devstack@n-api.service[120740]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.enabled = False {{(pid=120740) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 18:01:00.186494 dv-cinder-852009-8-iscsi devstack@n-api.service[120741]: DEBUG nova.api.openstack.wsgi_app [-] oslo_versionedobjects.fatal_exception_format_errors = False {{(pid=120741) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 18:01:00.186597 dv-cinder-852009-8-iscsi devstack@n-api.service[120740]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.port_range = 10000:20000 {{(pid=120740) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 18:01:00.186817 dv-cinder-852009-8-iscsi devstack@n-api.service[120741]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_buffer_size = 1000 {{(pid=120741) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 18:01:00.186915 dv-cinder-852009-8-iscsi devstack@n-api.service[120740]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.proxyclient_address = 127.0.0.1 {{(pid=120740) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 18:01:00.187130 dv-cinder-852009-8-iscsi devstack@n-api.service[120741]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_enabled = False {{(pid=120741) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 18:01:00.187235 dv-cinder-852009-8-iscsi devstack@n-api.service[120740]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.serialproxy_host = 0.0.0.0 {{(pid=120740) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 18:01:00.187454 dv-cinder-852009-8-iscsi devstack@n-api.service[120741]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_process_name = {{(pid=120741) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 18:01:00.187586 dv-cinder-852009-8-iscsi devstack@n-api.service[120740]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.serialproxy_port = 6083 {{(pid=120740) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 18:01:00.187778 dv-cinder-852009-8-iscsi devstack@n-api.service[120741]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_socket_file = /var/tmp/metrics_collector.sock {{(pid=120741) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 18:01:00.187890 dv-cinder-852009-8-iscsi devstack@n-api.service[120740]: DEBUG nova.api.openstack.wsgi_app [-] service_user.auth_section = None {{(pid=120740) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 18:01:00.188089 dv-cinder-852009-8-iscsi devstack@n-api.service[120741]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_thread_stop_timeout = 10 {{(pid=120741) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 18:01:00.188193 dv-cinder-852009-8-iscsi devstack@n-api.service[120740]: DEBUG nova.api.openstack.wsgi_app [-] service_user.auth_type = password {{(pid=120740) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 18:01:00.188411 dv-cinder-852009-8-iscsi devstack@n-api.service[120741]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.enforce_new_defaults = False {{(pid=120741) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 18:01:00.188574 dv-cinder-852009-8-iscsi devstack@n-api.service[120740]: DEBUG nova.api.openstack.wsgi_app [-] service_user.cafile = None {{(pid=120740) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 18:01:00.188743 dv-cinder-852009-8-iscsi devstack@n-api.service[120741]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.enforce_scope = False {{(pid=120741) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 18:01:00.188836 dv-cinder-852009-8-iscsi devstack@n-api.service[120740]: DEBUG nova.api.openstack.wsgi_app [-] service_user.certfile = None {{(pid=120740) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 18:01:00.189075 dv-cinder-852009-8-iscsi devstack@n-api.service[120741]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.policy_default_rule = default {{(pid=120741) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 18:01:00.189177 dv-cinder-852009-8-iscsi devstack@n-api.service[120740]: DEBUG nova.api.openstack.wsgi_app [-] service_user.collect_timing = False {{(pid=120740) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 18:01:00.189416 dv-cinder-852009-8-iscsi devstack@n-api.service[120741]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.policy_dirs = ['policy.d'] {{(pid=120741) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 18:01:00.189508 dv-cinder-852009-8-iscsi devstack@n-api.service[120740]: DEBUG nova.api.openstack.wsgi_app [-] service_user.insecure = False {{(pid=120740) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 18:01:00.189742 dv-cinder-852009-8-iscsi devstack@n-api.service[120740]: DEBUG nova.api.openstack.wsgi_app [-] service_user.keyfile = None {{(pid=120740) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 18:01:00.189831 dv-cinder-852009-8-iscsi devstack@n-api.service[120741]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.policy_file = policy.yaml {{(pid=120741) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 18:01:00.190066 dv-cinder-852009-8-iscsi devstack@n-api.service[120741]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_content_type = application/x-www-form-urlencoded {{(pid=120741) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 18:01:00.190157 dv-cinder-852009-8-iscsi devstack@n-api.service[120740]: DEBUG nova.api.openstack.wsgi_app [-] service_user.send_service_user_token = True {{(pid=120740) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 18:01:00.190373 dv-cinder-852009-8-iscsi devstack@n-api.service[120741]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_ca_crt_file = None {{(pid=120741) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 18:01:00.190465 dv-cinder-852009-8-iscsi devstack@n-api.service[120740]: DEBUG nova.api.openstack.wsgi_app [-] service_user.split_loggers = False {{(pid=120740) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 18:01:00.190676 dv-cinder-852009-8-iscsi devstack@n-api.service[120740]: DEBUG nova.api.openstack.wsgi_app [-] service_user.timeout = None {{(pid=120740) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 18:01:00.190774 dv-cinder-852009-8-iscsi devstack@n-api.service[120741]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_client_crt_file = None {{(pid=120741) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 18:01:00.190979 dv-cinder-852009-8-iscsi devstack@n-api.service[120741]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_client_key_file = None {{(pid=120741) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 18:01:00.191070 dv-cinder-852009-8-iscsi devstack@n-api.service[120740]: DEBUG nova.api.openstack.wsgi_app [-] spice.agent_enabled = True {{(pid=120740) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 18:01:00.191289 dv-cinder-852009-8-iscsi devstack@n-api.service[120741]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_verify_server_crt = False {{(pid=120741) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 18:01:00.191388 dv-cinder-852009-8-iscsi devstack@n-api.service[120740]: DEBUG nova.api.openstack.wsgi_app [-] spice.enabled = False {{(pid=120740) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 18:01:00.191606 dv-cinder-852009-8-iscsi devstack@n-api.service[120741]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.auth_section = None {{(pid=120741) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 18:01:00.191826 dv-cinder-852009-8-iscsi devstack@n-api.service[120740]: DEBUG nova.api.openstack.wsgi_app [-] spice.html5proxy_base_url = http://127.0.0.1:6082/spice_auto.html {{(pid=120740) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 18:01:00.191929 dv-cinder-852009-8-iscsi devstack@n-api.service[120741]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.auth_type = None {{(pid=120741) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 18:01:00.192184 dv-cinder-852009-8-iscsi devstack@n-api.service[120740]: DEBUG nova.api.openstack.wsgi_app [-] spice.html5proxy_host = 0.0.0.0 {{(pid=120740) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 18:01:00.192285 dv-cinder-852009-8-iscsi devstack@n-api.service[120741]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.cafile = None {{(pid=120741) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 18:01:00.192520 dv-cinder-852009-8-iscsi devstack@n-api.service[120741]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.certfile = None {{(pid=120741) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 18:01:00.192644 dv-cinder-852009-8-iscsi devstack@n-api.service[120740]: DEBUG nova.api.openstack.wsgi_app [-] spice.html5proxy_port = 6082 {{(pid=120740) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 18:01:00.192857 dv-cinder-852009-8-iscsi devstack@n-api.service[120741]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.collect_timing = False {{(pid=120741) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 18:01:00.192959 dv-cinder-852009-8-iscsi devstack@n-api.service[120740]: DEBUG nova.api.openstack.wsgi_app [-] spice.server_listen = 127.0.0.1 {{(pid=120740) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 18:01:00.193162 dv-cinder-852009-8-iscsi devstack@n-api.service[120741]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.connect_retries = None {{(pid=120741) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 18:01:00.193254 dv-cinder-852009-8-iscsi devstack@n-api.service[120740]: DEBUG nova.api.openstack.wsgi_app [-] spice.server_proxyclient_address = 127.0.0.1 {{(pid=120740) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 18:01:00.193522 dv-cinder-852009-8-iscsi devstack@n-api.service[120740]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.baseapi = None {{(pid=120740) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 18:01:00.193602 dv-cinder-852009-8-iscsi devstack@n-api.service[120741]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.connect_retry_delay = None {{(pid=120741) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 18:01:00.193834 dv-cinder-852009-8-iscsi devstack@n-api.service[120740]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.cert = None {{(pid=120740) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 18:01:00.193925 dv-cinder-852009-8-iscsi devstack@n-api.service[120741]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.endpoint_id = None {{(pid=120741) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 18:01:00.194165 dv-cinder-852009-8-iscsi devstack@n-api.service[120740]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.compute = auto {{(pid=120740) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 18:01:00.194248 dv-cinder-852009-8-iscsi devstack@n-api.service[120741]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.endpoint_override = None {{(pid=120741) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 18:01:00.194476 dv-cinder-852009-8-iscsi devstack@n-api.service[120740]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.conductor = None {{(pid=120740) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 18:01:00.194563 dv-cinder-852009-8-iscsi devstack@n-api.service[120741]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.insecure = False {{(pid=120741) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 18:01:00.194786 dv-cinder-852009-8-iscsi devstack@n-api.service[120740]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.scheduler = None {{(pid=120740) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 18:01:00.194876 dv-cinder-852009-8-iscsi devstack@n-api.service[120741]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.keyfile = None {{(pid=120741) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 18:01:00.195105 dv-cinder-852009-8-iscsi devstack@n-api.service[120740]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.auth_section = None {{(pid=120740) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 18:01:00.195199 dv-cinder-852009-8-iscsi devstack@n-api.service[120741]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.max_version = None {{(pid=120741) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 18:01:00.195418 dv-cinder-852009-8-iscsi devstack@n-api.service[120740]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.auth_type = None {{(pid=120740) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 18:01:00.195508 dv-cinder-852009-8-iscsi devstack@n-api.service[120741]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.min_version = None {{(pid=120741) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 18:01:00.195719 dv-cinder-852009-8-iscsi devstack@n-api.service[120741]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.region_name = None {{(pid=120741) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 18:01:00.195801 dv-cinder-852009-8-iscsi devstack@n-api.service[120740]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.cafile = None {{(pid=120740) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 18:01:00.196022 dv-cinder-852009-8-iscsi devstack@n-api.service[120741]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.service_name = None {{(pid=120741) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 18:01:00.196103 dv-cinder-852009-8-iscsi devstack@n-api.service[120740]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.certfile = None {{(pid=120740) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 18:01:00.196325 dv-cinder-852009-8-iscsi devstack@n-api.service[120741]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.service_type = None {{(pid=120741) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 18:01:00.196406 dv-cinder-852009-8-iscsi devstack@n-api.service[120740]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.collect_timing = False {{(pid=120740) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 18:01:00.196665 dv-cinder-852009-8-iscsi devstack@n-api.service[120740]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.insecure = False {{(pid=120740) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 18:01:00.196749 dv-cinder-852009-8-iscsi devstack@n-api.service[120741]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.split_loggers = False {{(pid=120741) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 18:01:00.197048 dv-cinder-852009-8-iscsi devstack@n-api.service[120740]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.keyfile = None {{(pid=120740) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 18:01:00.197141 dv-cinder-852009-8-iscsi devstack@n-api.service[120741]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.status_code_retries = None {{(pid=120741) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 18:01:00.197422 dv-cinder-852009-8-iscsi devstack@n-api.service[120741]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.status_code_retry_delay = None {{(pid=120741) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 18:01:00.197561 dv-cinder-852009-8-iscsi devstack@n-api.service[120740]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.split_loggers = False {{(pid=120740) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 18:01:00.197647 dv-cinder-852009-8-iscsi devstack@n-api.service[120741]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.timeout = None {{(pid=120741) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 18:01:00.197740 dv-cinder-852009-8-iscsi devstack@n-api.service[120740]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.timeout = None {{(pid=120740) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 18:01:00.197894 dv-cinder-852009-8-iscsi devstack@n-api.service[120741]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.valid_interfaces = None {{(pid=120741) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 18:01:00.198036 dv-cinder-852009-8-iscsi devstack@n-api.service[120740]: DEBUG nova.api.openstack.wsgi_app [-] vmware.api_retry_count = 10 {{(pid=120740) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 18:01:00.198198 dv-cinder-852009-8-iscsi devstack@n-api.service[120741]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.version = None {{(pid=120741) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 18:01:00.198322 dv-cinder-852009-8-iscsi devstack@n-api.service[120740]: DEBUG nova.api.openstack.wsgi_app [-] vmware.ca_file = None {{(pid=120740) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 18:01:00.198511 dv-cinder-852009-8-iscsi devstack@n-api.service[120740]: DEBUG nova.api.openstack.wsgi_app [-] vmware.cache_prefix = None {{(pid=120740) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 18:01:00.198603 dv-cinder-852009-8-iscsi devstack@n-api.service[120741]: DEBUG nova.api.openstack.wsgi_app [-] oslo_middleware.http_basic_auth_user_file = /etc/htpasswd {{(pid=120741) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 18:01:00.198821 dv-cinder-852009-8-iscsi devstack@n-api.service[120740]: DEBUG nova.api.openstack.wsgi_app [-] vmware.cluster_name = None {{(pid=120740) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 18:01:00.198912 dv-cinder-852009-8-iscsi devstack@n-api.service[120741]: DEBUG nova.api.openstack.wsgi_app [-] profiler.connection_string = messaging:// {{(pid=120741) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 18:01:00.199137 dv-cinder-852009-8-iscsi devstack@n-api.service[120740]: DEBUG nova.api.openstack.wsgi_app [-] vmware.connection_pool_size = 10 {{(pid=120740) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 18:01:00.199245 dv-cinder-852009-8-iscsi devstack@n-api.service[120741]: DEBUG nova.api.openstack.wsgi_app [-] profiler.enabled = False {{(pid=120741) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 18:01:00.199445 dv-cinder-852009-8-iscsi devstack@n-api.service[120740]: DEBUG nova.api.openstack.wsgi_app [-] vmware.console_delay_seconds = None {{(pid=120740) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 18:01:00.199544 dv-cinder-852009-8-iscsi devstack@n-api.service[120741]: DEBUG nova.api.openstack.wsgi_app [-] profiler.es_doc_type = notification {{(pid=120741) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 18:01:00.199756 dv-cinder-852009-8-iscsi devstack@n-api.service[120740]: DEBUG nova.api.openstack.wsgi_app [-] vmware.datastore_regex = None {{(pid=120740) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 18:01:00.199850 dv-cinder-852009-8-iscsi devstack@n-api.service[120741]: DEBUG nova.api.openstack.wsgi_app [-] profiler.es_scroll_size = 10000 {{(pid=120741) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 18:01:00.200065 dv-cinder-852009-8-iscsi devstack@n-api.service[120740]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_ip = None {{(pid=120740) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 18:01:00.200171 dv-cinder-852009-8-iscsi devstack@n-api.service[120741]: DEBUG nova.api.openstack.wsgi_app [-] profiler.es_scroll_time = 2m {{(pid=120741) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 18:01:00.200372 dv-cinder-852009-8-iscsi devstack@n-api.service[120740]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_password = **** {{(pid=120740) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 18:01:00.200496 dv-cinder-852009-8-iscsi devstack@n-api.service[120741]: DEBUG nova.api.openstack.wsgi_app [-] profiler.filter_error_trace = False {{(pid=120741) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 18:01:00.200719 dv-cinder-852009-8-iscsi devstack@n-api.service[120741]: DEBUG nova.api.openstack.wsgi_app [-] profiler.hmac_keys = SECRET_KEY {{(pid=120741) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 18:01:00.200809 dv-cinder-852009-8-iscsi devstack@n-api.service[120740]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_port = 443 {{(pid=120740) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 18:01:00.201034 dv-cinder-852009-8-iscsi devstack@n-api.service[120740]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_username = None {{(pid=120740) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 18:01:00.201131 dv-cinder-852009-8-iscsi devstack@n-api.service[120741]: DEBUG nova.api.openstack.wsgi_app [-] profiler.sentinel_service_name = mymaster {{(pid=120741) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 18:01:00.201350 dv-cinder-852009-8-iscsi devstack@n-api.service[120741]: DEBUG nova.api.openstack.wsgi_app [-] profiler.socket_timeout = 0.1 {{(pid=120741) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 18:01:00.201450 dv-cinder-852009-8-iscsi devstack@n-api.service[120740]: DEBUG nova.api.openstack.wsgi_app [-] vmware.insecure = False {{(pid=120740) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 18:01:00.201662 dv-cinder-852009-8-iscsi devstack@n-api.service[120741]: DEBUG nova.api.openstack.wsgi_app [-] profiler.trace_sqlalchemy = False {{(pid=120741) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 18:01:00.201762 dv-cinder-852009-8-iscsi devstack@n-api.service[120740]: DEBUG nova.api.openstack.wsgi_app [-] vmware.integration_bridge = None {{(pid=120740) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 18:01:00.201995 dv-cinder-852009-8-iscsi devstack@n-api.service[120741]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.amqp_auto_delete = False {{(pid=120741) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 18:01:00.202096 dv-cinder-852009-8-iscsi devstack@n-api.service[120740]: DEBUG nova.api.openstack.wsgi_app [-] vmware.maximum_objects = 100 {{(pid=120740) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 18:01:00.202306 dv-cinder-852009-8-iscsi devstack@n-api.service[120741]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.amqp_durable_queues = False {{(pid=120741) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 18:01:00.202407 dv-cinder-852009-8-iscsi devstack@n-api.service[120740]: DEBUG nova.api.openstack.wsgi_app [-] vmware.pbm_default_policy = None {{(pid=120740) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 18:01:00.202615 dv-cinder-852009-8-iscsi devstack@n-api.service[120741]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.conn_pool_min_size = 2 {{(pid=120741) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 18:01:00.202707 dv-cinder-852009-8-iscsi devstack@n-api.service[120740]: DEBUG nova.api.openstack.wsgi_app [-] vmware.pbm_enabled = False {{(pid=120740) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 18:01:00.202927 dv-cinder-852009-8-iscsi devstack@n-api.service[120741]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.conn_pool_ttl = 1200 {{(pid=120741) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 18:01:00.203027 dv-cinder-852009-8-iscsi devstack@n-api.service[120740]: DEBUG nova.api.openstack.wsgi_app [-] vmware.pbm_wsdl_location = None {{(pid=120740) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 18:01:00.203234 dv-cinder-852009-8-iscsi devstack@n-api.service[120741]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.direct_mandatory_flag = True {{(pid=120741) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 18:01:00.203335 dv-cinder-852009-8-iscsi devstack@n-api.service[120740]: DEBUG nova.api.openstack.wsgi_app [-] vmware.serial_log_dir = /opt/vmware/vspc {{(pid=120740) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 18:01:00.203545 dv-cinder-852009-8-iscsi devstack@n-api.service[120741]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.enable_cancel_on_failover = False {{(pid=120741) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 18:01:00.203644 dv-cinder-852009-8-iscsi devstack@n-api.service[120740]: DEBUG nova.api.openstack.wsgi_app [-] vmware.serial_port_proxy_uri = None {{(pid=120740) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 18:01:00.203852 dv-cinder-852009-8-iscsi devstack@n-api.service[120741]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.heartbeat_in_pthread = False {{(pid=120741) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 18:01:00.203987 dv-cinder-852009-8-iscsi devstack@n-api.service[120740]: DEBUG nova.api.openstack.wsgi_app [-] vmware.serial_port_service_uri = None {{(pid=120740) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 18:01:00.204180 dv-cinder-852009-8-iscsi devstack@n-api.service[120741]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.heartbeat_rate = 3 {{(pid=120741) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 18:01:00.204279 dv-cinder-852009-8-iscsi devstack@n-api.service[120740]: DEBUG nova.api.openstack.wsgi_app [-] vmware.task_poll_interval = 0.5 {{(pid=120740) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 18:01:00.204528 dv-cinder-852009-8-iscsi devstack@n-api.service[120741]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.heartbeat_timeout_threshold = 600 {{(pid=120741) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 18:01:00.204642 dv-cinder-852009-8-iscsi devstack@n-api.service[120740]: DEBUG nova.api.openstack.wsgi_app [-] vmware.use_linked_clone = True {{(pid=120740) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 18:01:00.204844 dv-cinder-852009-8-iscsi devstack@n-api.service[120741]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_compression = None {{(pid=120741) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 18:01:00.204945 dv-cinder-852009-8-iscsi devstack@n-api.service[120740]: DEBUG nova.api.openstack.wsgi_app [-] vmware.vnc_keymap = en-us {{(pid=120740) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 18:01:00.205165 dv-cinder-852009-8-iscsi devstack@n-api.service[120740]: DEBUG nova.api.openstack.wsgi_app [-] vmware.vnc_port = 5900 {{(pid=120740) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 18:01:00.205282 dv-cinder-852009-8-iscsi devstack@n-api.service[120741]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_failover_strategy = round-robin {{(pid=120741) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 18:01:00.205481 dv-cinder-852009-8-iscsi devstack@n-api.service[120741]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_missing_consumer_retry_timeout = 60 {{(pid=120741) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 18:01:00.205604 dv-cinder-852009-8-iscsi devstack@n-api.service[120740]: DEBUG nova.api.openstack.wsgi_app [-] vmware.vnc_port_total = 10000 {{(pid=120740) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 18:01:00.205799 dv-cinder-852009-8-iscsi devstack@n-api.service[120741]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_reconnect_delay = 1.0 {{(pid=120741) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 18:01:00.205914 dv-cinder-852009-8-iscsi devstack@n-api.service[120740]: DEBUG nova.api.openstack.wsgi_app [-] vnc.auth_schemes = ['none'] {{(pid=120740) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 18:01:00.206112 dv-cinder-852009-8-iscsi devstack@n-api.service[120741]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_ha_queues = False {{(pid=120741) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 18:01:00.206216 dv-cinder-852009-8-iscsi devstack@n-api.service[120740]: DEBUG nova.api.openstack.wsgi_app [-] vnc.enabled = True {{(pid=120740) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 18:01:00.206422 dv-cinder-852009-8-iscsi devstack@n-api.service[120741]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_interval_max = 30 {{(pid=120741) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 18:01:00.206689 dv-cinder-852009-8-iscsi devstack@n-api.service[120740]: DEBUG nova.api.openstack.wsgi_app [-] vnc.novncproxy_base_url = http://127.0.0.1:6080/vnc_auto.html {{(pid=120740) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 18:01:00.206814 dv-cinder-852009-8-iscsi devstack@n-api.service[120741]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_login_method = AMQPLAIN {{(pid=120741) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 18:01:00.207034 dv-cinder-852009-8-iscsi devstack@n-api.service[120740]: DEBUG nova.api.openstack.wsgi_app [-] vnc.novncproxy_host = 0.0.0.0 {{(pid=120740) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 18:01:00.207190 dv-cinder-852009-8-iscsi devstack@n-api.service[120741]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_qos_prefetch_count = 0 {{(pid=120741) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 18:01:00.207339 dv-cinder-852009-8-iscsi devstack@n-api.service[120741]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_quorum_delivery_limit = 0 {{(pid=120741) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 18:01:00.207439 dv-cinder-852009-8-iscsi devstack@n-api.service[120740]: DEBUG nova.api.openstack.wsgi_app [-] vnc.novncproxy_port = 6080 {{(pid=120740) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 18:01:00.207648 dv-cinder-852009-8-iscsi devstack@n-api.service[120741]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_quorum_queue = False {{(pid=120741) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 18:01:00.207802 dv-cinder-852009-8-iscsi devstack@n-api.service[120740]: DEBUG nova.api.openstack.wsgi_app [-] vnc.server_listen = 127.0.0.1 {{(pid=120740) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 18:01:00.207963 dv-cinder-852009-8-iscsi devstack@n-api.service[120741]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_quroum_max_memory_bytes = 0 {{(pid=120741) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 18:01:00.208105 dv-cinder-852009-8-iscsi devstack@n-api.service[120740]: DEBUG nova.api.openstack.wsgi_app [-] vnc.server_proxyclient_address = 127.0.0.1 {{(pid=120740) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 18:01:00.208334 dv-cinder-852009-8-iscsi devstack@n-api.service[120741]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_quroum_max_memory_length = 0 {{(pid=120741) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 18:01:00.208520 dv-cinder-852009-8-iscsi devstack@n-api.service[120740]: DEBUG nova.api.openstack.wsgi_app [-] vnc.vencrypt_ca_certs = None {{(pid=120740) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 18:01:00.208676 dv-cinder-852009-8-iscsi devstack@n-api.service[120741]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_retry_backoff = 2 {{(pid=120741) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 18:01:00.208824 dv-cinder-852009-8-iscsi devstack@n-api.service[120740]: DEBUG nova.api.openstack.wsgi_app [-] vnc.vencrypt_client_cert = None {{(pid=120740) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 18:01:00.208993 dv-cinder-852009-8-iscsi devstack@n-api.service[120741]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_retry_interval = 1 {{(pid=120741) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 18:01:00.209258 dv-cinder-852009-8-iscsi devstack@n-api.service[120740]: DEBUG nova.api.openstack.wsgi_app [-] vnc.vencrypt_client_key = None {{(pid=120740) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 18:01:00.209413 dv-cinder-852009-8-iscsi devstack@n-api.service[120741]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_transient_queues_ttl = 1800 {{(pid=120741) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 18:01:00.209557 dv-cinder-852009-8-iscsi devstack@n-api.service[120740]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_compute_service_check_for_ffu = False {{(pid=120740) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 18:01:00.209696 dv-cinder-852009-8-iscsi devstack@n-api.service[120741]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rpc_conn_pool_size = 30 {{(pid=120741) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 18:01:00.209832 dv-cinder-852009-8-iscsi devstack@n-api.service[120740]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_fallback_pcpu_query = False {{(pid=120740) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 18:01:00.209992 dv-cinder-852009-8-iscsi devstack@n-api.service[120741]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl = False {{(pid=120741) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 18:01:00.210132 dv-cinder-852009-8-iscsi devstack@n-api.service[120740]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_group_policy_check_upcall = False {{(pid=120740) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 18:01:00.210275 dv-cinder-852009-8-iscsi devstack@n-api.service[120741]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_ca_file = {{(pid=120741) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 18:01:00.210412 dv-cinder-852009-8-iscsi devstack@n-api.service[120740]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_libvirt_livesnapshot = False {{(pid=120740) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 18:01:00.210555 dv-cinder-852009-8-iscsi devstack@n-api.service[120740]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_rootwrap = False {{(pid=120740) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 18:01:00.210701 dv-cinder-852009-8-iscsi devstack@n-api.service[120741]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_cert_file = {{(pid=120741) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 18:01:00.210859 dv-cinder-852009-8-iscsi devstack@n-api.service[120740]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.enable_numa_live_migration = False {{(pid=120740) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 18:01:00.210992 dv-cinder-852009-8-iscsi devstack@n-api.service[120741]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_enforce_fips_mode = False {{(pid=120741) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 18:01:00.211145 dv-cinder-852009-8-iscsi devstack@n-api.service[120740]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.enable_qemu_monitor_announce_self = False {{(pid=120740) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 18:01:00.211282 dv-cinder-852009-8-iscsi devstack@n-api.service[120741]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_key_file = {{(pid=120741) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 18:01:00.211418 dv-cinder-852009-8-iscsi devstack@n-api.service[120740]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.ensure_libvirt_rbd_instance_dir_cleanup = False {{(pid=120740) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 18:01:00.211554 dv-cinder-852009-8-iscsi devstack@n-api.service[120741]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_version = {{(pid=120741) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 18:01:00.211717 dv-cinder-852009-8-iscsi devstack@n-api.service[120740]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.handle_virt_lifecycle_events = True {{(pid=120740) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 18:01:00.211867 dv-cinder-852009-8-iscsi devstack@n-api.service[120741]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.driver = ['messagingv2'] {{(pid=120741) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 18:01:00.212013 dv-cinder-852009-8-iscsi devstack@n-api.service[120740]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.libvirt_disable_apic = False {{(pid=120740) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 18:01:00.212157 dv-cinder-852009-8-iscsi devstack@n-api.service[120741]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.retry = -1 {{(pid=120741) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 18:01:00.212327 dv-cinder-852009-8-iscsi devstack@n-api.service[120740]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.never_download_image_if_on_rbd = False {{(pid=120740) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 18:01:00.212500 dv-cinder-852009-8-iscsi devstack@n-api.service[120741]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.topics = ['notifications'] {{(pid=120741) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 18:01:00.212666 dv-cinder-852009-8-iscsi devstack@n-api.service[120740]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.reserve_disk_resource_for_image_cache = False {{(pid=120740) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 18:01:00.212760 dv-cinder-852009-8-iscsi devstack@n-api.service[120741]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.transport_url = **** {{(pid=120741) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 18:01:00.212978 dv-cinder-852009-8-iscsi devstack@n-api.service[120740]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.skip_cpu_compare_on_dest = False {{(pid=120740) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 18:01:00.213074 dv-cinder-852009-8-iscsi devstack@n-api.service[120741]: DEBUG nova.api.openstack.wsgi_app [-] oslo_reports.file_event_handler = None {{(pid=120741) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 18:01:00.213290 dv-cinder-852009-8-iscsi devstack@n-api.service[120740]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.skip_hypervisor_version_check_on_lm = False {{(pid=120740) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 18:01:00.213383 dv-cinder-852009-8-iscsi devstack@n-api.service[120741]: DEBUG nova.api.openstack.wsgi_app [-] oslo_reports.file_event_handler_interval = 1 {{(pid=120741) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 18:01:00.213601 dv-cinder-852009-8-iscsi devstack@n-api.service[120740]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.unified_limits_count_pcpu_as_vcpu = False {{(pid=120740) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 18:01:00.213703 dv-cinder-852009-8-iscsi devstack@n-api.service[120741]: DEBUG nova.api.openstack.wsgi_app [-] oslo_reports.log_dir = None {{(pid=120741) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 18:01:00.214131 dv-cinder-852009-8-iscsi devstack@n-api.service[120741]: DEBUG nova.api.openstack.wsgi_app [-] ******************************************************************************** {{(pid=120741) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2613}} Sep 13 18:01:00.214227 dv-cinder-852009-8-iscsi devstack@n-api.service[120740]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.wait_for_vif_plugged_event_during_hard_reboot = [] {{(pid=120740) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 18:01:00.214321 dv-cinder-852009-8-iscsi devstack@n-api.service[120740]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.api_paste_config = /etc/nova/api-paste.ini {{(pid=120740) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 18:01:00.214563 dv-cinder-852009-8-iscsi devstack@n-api.service[120740]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.client_socket_timeout = 900 {{(pid=120740) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 18:01:00.214883 dv-cinder-852009-8-iscsi devstack@n-api.service[120740]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.default_pool_size = 1000 {{(pid=120740) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 18:01:00.215211 dv-cinder-852009-8-iscsi devstack@n-api.service[120740]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.keep_alive = True {{(pid=120740) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 18:01:00.215517 dv-cinder-852009-8-iscsi devstack@n-api.service[120740]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.max_header_line = 16384 {{(pid=120740) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 18:01:00.215829 dv-cinder-852009-8-iscsi devstack@n-api.service[120740]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.secure_proxy_ssl_header = None {{(pid=120740) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 18:01:00.216142 dv-cinder-852009-8-iscsi devstack@n-api.service[120740]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.ssl_ca_file = None {{(pid=120740) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 18:01:00.216491 dv-cinder-852009-8-iscsi devstack@n-api.service[120740]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.ssl_cert_file = None {{(pid=120740) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 18:01:00.216808 dv-cinder-852009-8-iscsi devstack@n-api.service[120740]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.ssl_key_file = None {{(pid=120740) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 18:01:00.217234 dv-cinder-852009-8-iscsi devstack@n-api.service[120740]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.tcp_keepidle = 600 {{(pid=120740) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 18:01:00.217460 dv-cinder-852009-8-iscsi devstack@n-api.service[120740]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.wsgi_log_format = %(client_ip)s "%(request_line)s" status: %(status_code)s len: %(body_length)s time: %(wall_seconds).7f {{(pid=120740) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 18:01:00.217779 dv-cinder-852009-8-iscsi devstack@n-api.service[120740]: DEBUG nova.api.openstack.wsgi_app [-] zvm.ca_file = None {{(pid=120740) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 18:01:00.218118 dv-cinder-852009-8-iscsi devstack@n-api.service[120740]: DEBUG nova.api.openstack.wsgi_app [-] zvm.cloud_connector_url = None {{(pid=120740) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 18:01:00.218517 dv-cinder-852009-8-iscsi devstack@n-api.service[120740]: DEBUG nova.api.openstack.wsgi_app [-] zvm.image_tmp_path = /opt/stack/data/nova/images {{(pid=120740) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 18:01:00.218834 dv-cinder-852009-8-iscsi devstack@n-api.service[120740]: DEBUG nova.api.openstack.wsgi_app [-] zvm.reachable_timeout = 300 {{(pid=120740) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 18:01:00.219159 dv-cinder-852009-8-iscsi devstack@n-api.service[120740]: DEBUG nova.api.openstack.wsgi_app [-] oslo_versionedobjects.fatal_exception_format_errors = False {{(pid=120740) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 18:01:00.219484 dv-cinder-852009-8-iscsi devstack@n-api.service[120740]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_buffer_size = 1000 {{(pid=120740) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 18:01:00.219796 dv-cinder-852009-8-iscsi devstack@n-api.service[120740]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_enabled = False {{(pid=120740) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 18:01:00.220128 dv-cinder-852009-8-iscsi devstack@n-api.service[120740]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_process_name = {{(pid=120740) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 18:01:00.220480 dv-cinder-852009-8-iscsi devstack@n-api.service[120740]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_socket_file = /var/tmp/metrics_collector.sock {{(pid=120740) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 18:01:00.220796 dv-cinder-852009-8-iscsi devstack@n-api.service[120740]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_thread_stop_timeout = 10 {{(pid=120740) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 18:01:00.221122 dv-cinder-852009-8-iscsi devstack@n-api.service[120740]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.enforce_new_defaults = False {{(pid=120740) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 18:01:00.221435 dv-cinder-852009-8-iscsi devstack@n-api.service[120740]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.enforce_scope = False {{(pid=120740) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 18:01:00.221773 dv-cinder-852009-8-iscsi devstack@n-api.service[120740]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.policy_default_rule = default {{(pid=120740) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 18:01:00.222121 dv-cinder-852009-8-iscsi devstack@n-api.service[120740]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.policy_dirs = ['policy.d'] {{(pid=120740) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 18:01:00.222451 dv-cinder-852009-8-iscsi devstack@n-api.service[120740]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.policy_file = policy.yaml {{(pid=120740) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 18:01:00.222930 dv-cinder-852009-8-iscsi devstack@n-api.service[120740]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_content_type = application/x-www-form-urlencoded {{(pid=120740) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 18:01:00.223090 dv-cinder-852009-8-iscsi devstack@n-api.service[120740]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_ca_crt_file = None {{(pid=120740) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 18:01:00.223398 dv-cinder-852009-8-iscsi devstack@n-api.service[120740]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_client_crt_file = None {{(pid=120740) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 18:01:00.223706 dv-cinder-852009-8-iscsi devstack@n-api.service[120740]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_client_key_file = None {{(pid=120740) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 18:01:00.224078 dv-cinder-852009-8-iscsi devstack@n-api.service[120740]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_verify_server_crt = False {{(pid=120740) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 18:01:00.224402 dv-cinder-852009-8-iscsi devstack@n-api.service[120740]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.auth_section = None {{(pid=120740) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 18:01:00.224739 dv-cinder-852009-8-iscsi devstack@n-api.service[120740]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.auth_type = None {{(pid=120740) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 18:01:00.225090 dv-cinder-852009-8-iscsi devstack@n-api.service[120740]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.cafile = None {{(pid=120740) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 18:01:00.225396 dv-cinder-852009-8-iscsi devstack@n-api.service[120740]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.certfile = None {{(pid=120740) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 18:01:00.225710 dv-cinder-852009-8-iscsi devstack@n-api.service[120740]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.collect_timing = False {{(pid=120740) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 18:01:00.226016 dv-cinder-852009-8-iscsi devstack@n-api.service[120740]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.connect_retries = None {{(pid=120740) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 18:01:00.226322 dv-cinder-852009-8-iscsi devstack@n-api.service[120740]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.connect_retry_delay = None {{(pid=120740) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 18:01:00.226627 dv-cinder-852009-8-iscsi devstack@n-api.service[120740]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.endpoint_id = None {{(pid=120740) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 18:01:00.226934 dv-cinder-852009-8-iscsi devstack@n-api.service[120740]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.endpoint_override = None {{(pid=120740) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 18:01:00.227247 dv-cinder-852009-8-iscsi devstack@n-api.service[120740]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.insecure = False {{(pid=120740) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 18:01:00.227551 dv-cinder-852009-8-iscsi devstack@n-api.service[120740]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.keyfile = None {{(pid=120740) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 18:01:00.227855 dv-cinder-852009-8-iscsi devstack@n-api.service[120740]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.max_version = None {{(pid=120740) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 18:01:00.228157 dv-cinder-852009-8-iscsi devstack@n-api.service[120740]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.min_version = None {{(pid=120740) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 18:01:00.228481 dv-cinder-852009-8-iscsi devstack@n-api.service[120740]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.region_name = None {{(pid=120740) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 18:01:00.228788 dv-cinder-852009-8-iscsi devstack@n-api.service[120740]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.service_name = None {{(pid=120740) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 18:01:00.229092 dv-cinder-852009-8-iscsi devstack@n-api.service[120740]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.service_type = None {{(pid=120740) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 18:01:00.229401 dv-cinder-852009-8-iscsi devstack@n-api.service[120740]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.split_loggers = False {{(pid=120740) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 18:01:00.229703 dv-cinder-852009-8-iscsi devstack@n-api.service[120740]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.status_code_retries = None {{(pid=120740) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 18:01:00.230009 dv-cinder-852009-8-iscsi devstack@n-api.service[120740]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.status_code_retry_delay = None {{(pid=120740) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 18:01:00.230311 dv-cinder-852009-8-iscsi devstack@n-api.service[120740]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.timeout = None {{(pid=120740) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 18:01:00.230616 dv-cinder-852009-8-iscsi devstack@n-api.service[120740]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.valid_interfaces = None {{(pid=120740) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 18:01:00.230918 dv-cinder-852009-8-iscsi devstack@n-api.service[120740]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.version = None {{(pid=120740) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 18:01:00.231252 dv-cinder-852009-8-iscsi devstack@n-api.service[120740]: DEBUG nova.api.openstack.wsgi_app [-] oslo_middleware.http_basic_auth_user_file = /etc/htpasswd {{(pid=120740) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 18:01:00.231586 dv-cinder-852009-8-iscsi devstack@n-api.service[120740]: DEBUG nova.api.openstack.wsgi_app [-] profiler.connection_string = messaging:// {{(pid=120740) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 18:01:00.231908 dv-cinder-852009-8-iscsi devstack@n-api.service[120740]: DEBUG nova.api.openstack.wsgi_app [-] profiler.enabled = False {{(pid=120740) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 18:01:00.232234 dv-cinder-852009-8-iscsi devstack@n-api.service[120740]: DEBUG nova.api.openstack.wsgi_app [-] profiler.es_doc_type = notification {{(pid=120740) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 18:01:00.232571 dv-cinder-852009-8-iscsi devstack@n-api.service[120740]: DEBUG nova.api.openstack.wsgi_app [-] profiler.es_scroll_size = 10000 {{(pid=120740) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 18:01:00.232898 dv-cinder-852009-8-iscsi devstack@n-api.service[120740]: DEBUG nova.api.openstack.wsgi_app [-] profiler.es_scroll_time = 2m {{(pid=120740) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 18:01:00.233210 dv-cinder-852009-8-iscsi devstack@n-api.service[120740]: DEBUG nova.api.openstack.wsgi_app [-] profiler.filter_error_trace = False {{(pid=120740) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 18:01:00.233534 dv-cinder-852009-8-iscsi devstack@n-api.service[120740]: DEBUG nova.api.openstack.wsgi_app [-] profiler.hmac_keys = SECRET_KEY {{(pid=120740) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 18:01:00.233859 dv-cinder-852009-8-iscsi devstack@n-api.service[120740]: DEBUG nova.api.openstack.wsgi_app [-] profiler.sentinel_service_name = mymaster {{(pid=120740) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 18:01:00.234179 dv-cinder-852009-8-iscsi devstack@n-api.service[120740]: DEBUG nova.api.openstack.wsgi_app [-] profiler.socket_timeout = 0.1 {{(pid=120740) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 18:01:00.234492 dv-cinder-852009-8-iscsi devstack@n-api.service[120740]: DEBUG nova.api.openstack.wsgi_app [-] profiler.trace_sqlalchemy = False {{(pid=120740) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 18:01:00.234831 dv-cinder-852009-8-iscsi devstack@n-api.service[120740]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.amqp_auto_delete = False {{(pid=120740) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 18:01:00.235146 dv-cinder-852009-8-iscsi devstack@n-api.service[120740]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.amqp_durable_queues = False {{(pid=120740) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 18:01:00.235462 dv-cinder-852009-8-iscsi devstack@n-api.service[120740]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.conn_pool_min_size = 2 {{(pid=120740) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 18:01:00.235777 dv-cinder-852009-8-iscsi devstack@n-api.service[120740]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.conn_pool_ttl = 1200 {{(pid=120740) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 18:01:00.236089 dv-cinder-852009-8-iscsi devstack@n-api.service[120740]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.direct_mandatory_flag = True {{(pid=120740) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 18:01:00.236402 dv-cinder-852009-8-iscsi devstack@n-api.service[120740]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.enable_cancel_on_failover = False {{(pid=120740) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 18:01:00.236740 dv-cinder-852009-8-iscsi devstack@n-api.service[120740]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.heartbeat_in_pthread = False {{(pid=120740) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 18:01:00.237075 dv-cinder-852009-8-iscsi devstack@n-api.service[120740]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.heartbeat_rate = 3 {{(pid=120740) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 18:01:00.237410 dv-cinder-852009-8-iscsi devstack@n-api.service[120740]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.heartbeat_timeout_threshold = 600 {{(pid=120740) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 18:01:00.237798 dv-cinder-852009-8-iscsi devstack@n-api.service[120740]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_compression = None {{(pid=120740) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 18:01:00.238052 dv-cinder-852009-8-iscsi devstack@n-api.service[120740]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_failover_strategy = round-robin {{(pid=120740) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 18:01:00.238372 dv-cinder-852009-8-iscsi devstack@n-api.service[120740]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_missing_consumer_retry_timeout = 60 {{(pid=120740) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 18:01:00.238774 dv-cinder-852009-8-iscsi devstack@n-api.service[120740]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_reconnect_delay = 1.0 {{(pid=120740) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 18:01:00.239012 dv-cinder-852009-8-iscsi devstack@n-api.service[120740]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_ha_queues = False {{(pid=120740) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 18:01:00.239326 dv-cinder-852009-8-iscsi devstack@n-api.service[120740]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_interval_max = 30 {{(pid=120740) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 18:01:00.239687 dv-cinder-852009-8-iscsi devstack@n-api.service[120740]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_login_method = AMQPLAIN {{(pid=120740) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 18:01:00.240002 dv-cinder-852009-8-iscsi devstack@n-api.service[120740]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_qos_prefetch_count = 0 {{(pid=120740) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 18:01:00.240315 dv-cinder-852009-8-iscsi devstack@n-api.service[120740]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_quorum_delivery_limit = 0 {{(pid=120740) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 18:01:00.240655 dv-cinder-852009-8-iscsi devstack@n-api.service[120740]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_quorum_queue = False {{(pid=120740) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 18:01:00.240969 dv-cinder-852009-8-iscsi devstack@n-api.service[120740]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_quroum_max_memory_bytes = 0 {{(pid=120740) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 18:01:00.241285 dv-cinder-852009-8-iscsi devstack@n-api.service[120740]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_quroum_max_memory_length = 0 {{(pid=120740) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 18:01:00.241605 dv-cinder-852009-8-iscsi devstack@n-api.service[120740]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_retry_backoff = 2 {{(pid=120740) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 18:01:00.241922 dv-cinder-852009-8-iscsi devstack@n-api.service[120740]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_retry_interval = 1 {{(pid=120740) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 18:01:00.242236 dv-cinder-852009-8-iscsi devstack@n-api.service[120740]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_transient_queues_ttl = 1800 {{(pid=120740) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 18:01:00.242555 dv-cinder-852009-8-iscsi devstack@n-api.service[120740]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rpc_conn_pool_size = 30 {{(pid=120740) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 18:01:00.242876 dv-cinder-852009-8-iscsi devstack@n-api.service[120740]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl = False {{(pid=120740) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 18:01:00.243206 dv-cinder-852009-8-iscsi devstack@n-api.service[120740]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_ca_file = {{(pid=120740) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 18:01:00.243537 dv-cinder-852009-8-iscsi devstack@n-api.service[120740]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_cert_file = {{(pid=120740) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 18:01:00.243849 dv-cinder-852009-8-iscsi devstack@n-api.service[120740]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_enforce_fips_mode = False {{(pid=120740) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 18:01:00.244180 dv-cinder-852009-8-iscsi devstack@n-api.service[120740]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_key_file = {{(pid=120740) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 18:01:00.244534 dv-cinder-852009-8-iscsi devstack@n-api.service[120740]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_version = {{(pid=120740) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 18:01:00.244889 dv-cinder-852009-8-iscsi devstack@n-api.service[120740]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.driver = ['messagingv2'] {{(pid=120740) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 18:01:00.245204 dv-cinder-852009-8-iscsi devstack@n-api.service[120740]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.retry = -1 {{(pid=120740) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 18:01:00.245556 dv-cinder-852009-8-iscsi devstack@n-api.service[120740]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.topics = ['notifications'] {{(pid=120740) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 18:01:00.245888 dv-cinder-852009-8-iscsi devstack@n-api.service[120740]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.transport_url = **** {{(pid=120740) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 18:01:00.246208 dv-cinder-852009-8-iscsi devstack@n-api.service[120740]: DEBUG nova.api.openstack.wsgi_app [-] oslo_reports.file_event_handler = None {{(pid=120740) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 18:01:00.246523 dv-cinder-852009-8-iscsi devstack@n-api.service[120740]: DEBUG nova.api.openstack.wsgi_app [-] oslo_reports.file_event_handler_interval = 1 {{(pid=120740) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 18:01:00.246832 dv-cinder-852009-8-iscsi devstack@n-api.service[120740]: DEBUG nova.api.openstack.wsgi_app [-] oslo_reports.log_dir = None {{(pid=120740) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 18:01:00.247079 dv-cinder-852009-8-iscsi devstack@n-api.service[120740]: DEBUG nova.api.openstack.wsgi_app [-] ******************************************************************************** {{(pid=120740) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2613}} Sep 13 18:01:00.275309 dv-cinder-852009-8-iscsi devstack@n-api.service[120741]: INFO dbcounter [None req-48f629ef-fc40-40e5-a66e-78b5762435be None None] Registered counter for database nova_api Sep 13 18:01:00.295992 dv-cinder-852009-8-iscsi devstack@n-api.service[120741]: DEBUG oslo_db.sqlalchemy.engines [None req-48f629ef-fc40-40e5-a66e-78b5762435be None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=120741) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Sep 13 18:01:00.302763 dv-cinder-852009-8-iscsi devstack@n-api.service[120741]: DEBUG dbcounter [-] [120741] Writer thread running {{(pid=120741) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:99}} Sep 13 18:01:00.308451 dv-cinder-852009-8-iscsi devstack@n-api.service[120740]: INFO dbcounter [None req-9e0b7320-1a9e-45c0-a287-cfa3836f0557 None None] Registered counter for database nova_api Sep 13 18:01:00.329241 dv-cinder-852009-8-iscsi devstack@n-api.service[120740]: DEBUG oslo_db.sqlalchemy.engines [None req-9e0b7320-1a9e-45c0-a287-cfa3836f0557 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=120740) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Sep 13 18:01:00.336216 dv-cinder-852009-8-iscsi devstack@n-api.service[120740]: DEBUG dbcounter [-] [120740] Writer thread running {{(pid=120740) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:99}} Sep 13 18:01:00.358880 dv-cinder-852009-8-iscsi devstack@n-api.service[120741]: DEBUG nova.context [None req-48f629ef-fc40-40e5-a66e-78b5762435be None None] Found 2 cells: 00000000-0000-0000-0000-000000000000(cell0),1daf4f4c-0e4a-4779-b53a-78c48397ea2f(cell1) {{(pid=120741) load_cells /opt/stack/nova/nova/context.py:464}} Sep 13 18:01:00.362921 dv-cinder-852009-8-iscsi devstack@n-api.service[120741]: DEBUG oslo_concurrency.lockutils [None req-48f629ef-fc40-40e5-a66e-78b5762435be None None] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120741) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 18:01:00.363394 dv-cinder-852009-8-iscsi devstack@n-api.service[120741]: DEBUG oslo_concurrency.lockutils [None req-48f629ef-fc40-40e5-a66e-78b5762435be None None] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120741) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 18:01:00.365034 dv-cinder-852009-8-iscsi devstack@n-api.service[120741]: DEBUG oslo_concurrency.lockutils [None req-48f629ef-fc40-40e5-a66e-78b5762435be None None] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120741) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 18:01:00.365767 dv-cinder-852009-8-iscsi devstack@n-api.service[120741]: DEBUG oslo_concurrency.lockutils [None req-48f629ef-fc40-40e5-a66e-78b5762435be None None] Acquiring lock "1daf4f4c-0e4a-4779-b53a-78c48397ea2f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120741) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 18:01:00.366196 dv-cinder-852009-8-iscsi devstack@n-api.service[120741]: DEBUG oslo_concurrency.lockutils [None req-48f629ef-fc40-40e5-a66e-78b5762435be None None] Lock "1daf4f4c-0e4a-4779-b53a-78c48397ea2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120741) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 18:01:00.368219 dv-cinder-852009-8-iscsi devstack@n-api.service[120741]: DEBUG oslo_concurrency.lockutils [None req-48f629ef-fc40-40e5-a66e-78b5762435be None None] Lock "1daf4f4c-0e4a-4779-b53a-78c48397ea2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120741) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 18:01:00.370279 dv-cinder-852009-8-iscsi devstack@n-api.service[120741]: INFO dbcounter [None req-48f629ef-fc40-40e5-a66e-78b5762435be None None] Registered counter for database nova_cell0 Sep 13 18:01:00.374393 dv-cinder-852009-8-iscsi devstack@n-api.service[120741]: INFO dbcounter [None req-48f629ef-fc40-40e5-a66e-78b5762435be None None] Registered counter for database nova_cell1 Sep 13 18:01:00.382430 dv-cinder-852009-8-iscsi devstack@n-api.service[120741]: DEBUG oslo_db.sqlalchemy.engines [None req-48f629ef-fc40-40e5-a66e-78b5762435be None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=120741) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Sep 13 18:01:00.383745 dv-cinder-852009-8-iscsi devstack@n-api.service[120741]: DEBUG oslo_db.sqlalchemy.engines [None req-48f629ef-fc40-40e5-a66e-78b5762435be None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=120741) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Sep 13 18:01:00.390299 dv-cinder-852009-8-iscsi devstack@n-api.service[120741]: DEBUG dbcounter [-] [120741] Writer thread running {{(pid=120741) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:99}} Sep 13 18:01:00.391901 dv-cinder-852009-8-iscsi devstack@n-api.service[120741]: DEBUG dbcounter [-] [120741] Writer thread running {{(pid=120741) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:99}} Sep 13 18:01:00.392588 dv-cinder-852009-8-iscsi devstack@n-api.service[120740]: DEBUG nova.context [None req-9e0b7320-1a9e-45c0-a287-cfa3836f0557 None None] Found 2 cells: 00000000-0000-0000-0000-000000000000(cell0),1daf4f4c-0e4a-4779-b53a-78c48397ea2f(cell1) {{(pid=120740) load_cells /opt/stack/nova/nova/context.py:464}} Sep 13 18:01:00.396686 dv-cinder-852009-8-iscsi devstack@n-api.service[120740]: DEBUG oslo_concurrency.lockutils [None req-9e0b7320-1a9e-45c0-a287-cfa3836f0557 None None] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120740) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 18:01:00.397161 dv-cinder-852009-8-iscsi devstack@n-api.service[120740]: DEBUG oslo_concurrency.lockutils [None req-9e0b7320-1a9e-45c0-a287-cfa3836f0557 None None] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120740) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 18:01:00.398725 dv-cinder-852009-8-iscsi devstack@n-api.service[120740]: DEBUG oslo_concurrency.lockutils [None req-9e0b7320-1a9e-45c0-a287-cfa3836f0557 None None] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120740) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 18:01:00.399478 dv-cinder-852009-8-iscsi devstack@n-api.service[120740]: DEBUG oslo_concurrency.lockutils [None req-9e0b7320-1a9e-45c0-a287-cfa3836f0557 None None] Acquiring lock "1daf4f4c-0e4a-4779-b53a-78c48397ea2f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120740) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 18:01:00.399907 dv-cinder-852009-8-iscsi devstack@n-api.service[120740]: DEBUG oslo_concurrency.lockutils [None req-9e0b7320-1a9e-45c0-a287-cfa3836f0557 None None] Lock "1daf4f4c-0e4a-4779-b53a-78c48397ea2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120740) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 18:01:00.401963 dv-cinder-852009-8-iscsi devstack@n-api.service[120740]: DEBUG oslo_concurrency.lockutils [None req-9e0b7320-1a9e-45c0-a287-cfa3836f0557 None None] Lock "1daf4f4c-0e4a-4779-b53a-78c48397ea2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120740) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 18:01:00.404029 dv-cinder-852009-8-iscsi devstack@n-api.service[120740]: INFO dbcounter [None req-9e0b7320-1a9e-45c0-a287-cfa3836f0557 None None] Registered counter for database nova_cell0 Sep 13 18:01:00.408144 dv-cinder-852009-8-iscsi devstack@n-api.service[120740]: INFO dbcounter [None req-9e0b7320-1a9e-45c0-a287-cfa3836f0557 None None] Registered counter for database nova_cell1 Sep 13 18:01:00.415877 dv-cinder-852009-8-iscsi devstack@n-api.service[120740]: DEBUG oslo_db.sqlalchemy.engines [None req-9e0b7320-1a9e-45c0-a287-cfa3836f0557 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=120740) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Sep 13 18:01:00.418191 dv-cinder-852009-8-iscsi devstack@n-api.service[120740]: DEBUG oslo_db.sqlalchemy.engines [None req-9e0b7320-1a9e-45c0-a287-cfa3836f0557 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=120740) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Sep 13 18:01:00.422783 dv-cinder-852009-8-iscsi devstack@n-api.service[120740]: DEBUG dbcounter [-] [120740] Writer thread running {{(pid=120740) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:99}} Sep 13 18:01:00.537345 dv-cinder-852009-8-iscsi devstack@n-api.service[120741]: INFO dbcounter [None req-48f629ef-fc40-40e5-a66e-78b5762435be None None] Registered counter for database nova_cell0 Sep 13 18:01:00.544322 dv-cinder-852009-8-iscsi devstack@n-api.service[120741]: DEBUG oslo_db.sqlalchemy.engines [None req-48f629ef-fc40-40e5-a66e-78b5762435be None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=120741) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Sep 13 18:01:00.549063 dv-cinder-852009-8-iscsi devstack@n-api.service[120741]: DEBUG dbcounter [-] [120741] Writer thread running {{(pid=120741) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:99}} Sep 13 18:01:00.561547 dv-cinder-852009-8-iscsi devstack@n-api.service[120740]: DEBUG dbcounter [-] [120740] Writer thread running {{(pid=120740) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:99}} Sep 13 18:01:00.572012 dv-cinder-852009-8-iscsi devstack@n-api.service[120740]: INFO dbcounter [None req-9e0b7320-1a9e-45c0-a287-cfa3836f0557 None None] Registered counter for database nova_cell0 Sep 13 18:01:00.579067 dv-cinder-852009-8-iscsi devstack@n-api.service[120740]: DEBUG oslo_db.sqlalchemy.engines [None req-9e0b7320-1a9e-45c0-a287-cfa3836f0557 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=120740) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Sep 13 18:01:00.583742 dv-cinder-852009-8-iscsi devstack@n-api.service[120740]: DEBUG dbcounter [-] [120740] Writer thread running {{(pid=120740) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:99}} Sep 13 18:01:00.871525 dv-cinder-852009-8-iscsi devstack@n-api.service[120741]: WARNING keystonemiddleware.auth_token [None req-48f629ef-fc40-40e5-a66e-78b5762435be None None] AuthToken middleware is set with keystone_authtoken.service_token_roles_required set to False. This is backwards compatible but deprecated behaviour. Please set this to True. Sep 13 18:01:00.879293 dv-cinder-852009-8-iscsi devstack@n-api.service[120741]: WARNING keystonemiddleware.auth_token [None req-48f629ef-fc40-40e5-a66e-78b5762435be None None] Configuring www_authenticate_uri to point to the public identity endpoint is required; clients may not be able to authenticate against an admin endpoint Sep 13 18:01:00.912925 dv-cinder-852009-8-iscsi devstack@n-api.service[120740]: WARNING keystonemiddleware.auth_token [None req-9e0b7320-1a9e-45c0-a287-cfa3836f0557 None None] AuthToken middleware is set with keystone_authtoken.service_token_roles_required set to False. This is backwards compatible but deprecated behaviour. Please set this to True. Sep 13 18:01:00.920390 dv-cinder-852009-8-iscsi devstack@n-api.service[120740]: WARNING keystonemiddleware.auth_token [None req-9e0b7320-1a9e-45c0-a287-cfa3836f0557 None None] Configuring www_authenticate_uri to point to the public identity endpoint is required; clients may not be able to authenticate against an admin endpoint Sep 13 18:01:01.237207 dv-cinder-852009-8-iscsi devstack@n-api.service[120741]: WARNING keystonemiddleware.auth_token [None req-48f629ef-fc40-40e5-a66e-78b5762435be None None] AuthToken middleware is set with keystone_authtoken.service_token_roles_required set to False. This is backwards compatible but deprecated behaviour. Please set this to True. Sep 13 18:01:01.243993 dv-cinder-852009-8-iscsi devstack@n-api.service[120741]: WARNING keystonemiddleware.auth_token [None req-48f629ef-fc40-40e5-a66e-78b5762435be None None] Configuring www_authenticate_uri to point to the public identity endpoint is required; clients may not be able to authenticate against an admin endpoint Sep 13 18:01:01.249648 dv-cinder-852009-8-iscsi devstack@n-api.service[120741]: WSGI app 0 (mountpoint='') ready in 6 seconds on interpreter 0x55f1401209c0 pid: 120741 (default app) Sep 13 18:01:01.278011 dv-cinder-852009-8-iscsi devstack@n-api.service[120740]: WARNING keystonemiddleware.auth_token [None req-9e0b7320-1a9e-45c0-a287-cfa3836f0557 None None] AuthToken middleware is set with keystone_authtoken.service_token_roles_required set to False. This is backwards compatible but deprecated behaviour. Please set this to True. Sep 13 18:01:01.284236 dv-cinder-852009-8-iscsi devstack@n-api.service[120740]: WARNING keystonemiddleware.auth_token [None req-9e0b7320-1a9e-45c0-a287-cfa3836f0557 None None] Configuring www_authenticate_uri to point to the public identity endpoint is required; clients may not be able to authenticate against an admin endpoint Sep 13 18:01:01.289721 dv-cinder-852009-8-iscsi devstack@n-api.service[120740]: WSGI app 0 (mountpoint='') ready in 6 seconds on interpreter 0x55f1401209c0 pid: 120740 (default app) Sep 13 18:01:47.603201 dv-cinder-852009-8-iscsi devstack@n-api.service[120741]: DEBUG dbcounter [-] [120741] Writing DB stats nova_api:SELECT=3 {{(pid=120741) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 18:01:47.604765 dv-cinder-852009-8-iscsi devstack@n-api.service[120741]: DEBUG dbcounter [-] [120741] Writing DB stats nova_cell0:SELECT=3 {{(pid=120741) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 18:01:47.605696 dv-cinder-852009-8-iscsi devstack@n-api.service[120741]: DEBUG dbcounter [-] [120741] Writing DB stats nova_cell1:SELECT=3 {{(pid=120741) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 18:01:47.606679 dv-cinder-852009-8-iscsi devstack@n-api.service[120741]: DEBUG dbcounter [-] [120741] Writing DB stats nova_cell0:SELECT=3 {{(pid=120741) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 18:01:48.608007 dv-cinder-852009-8-iscsi devstack@n-api.service[120741]: DEBUG nova.api.openstack.wsgi [None req-8f1796de-b14f-4a3c-84ef-2d3e010b3556 tempest-ServerRescueNegativeTestJSON-412251590 tempest-ServerRescueNegativeTestJSON-412251590-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServerRescueNegativeTestJSON-server-1804052190", "imageRef": "33034e36-e6b2-4847-92a1-ff3188c05a4a", "flavorRef": "452", "adminPass": "***", "networks": [{"uuid": "}]}} {{(pid=120741) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 13 18:01:49.026458 dv-cinder-852009-8-iscsi devstack@n-api.service[120740]: DEBUG dbcounter [-] [120740] Writing DB stats nova_api:SELECT=3 {{(pid=120740) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 18:01:49.030362 dv-cinder-852009-8-iscsi devstack@n-api.service[120740]: DEBUG dbcounter [-] [120740] Writing DB stats nova_cell0:SELECT=3 {{(pid=120740) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 18:01:49.034210 dv-cinder-852009-8-iscsi devstack@n-api.service[120740]: DEBUG dbcounter [-] [120740] Writing DB stats nova_cell1:SELECT=3 {{(pid=120740) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 18:01:49.034992 dv-cinder-852009-8-iscsi devstack@n-api.service[120740]: DEBUG dbcounter [-] [120740] Writing DB stats nova_cell0:SELECT=3 {{(pid=120740) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 18:01:49.148958 dv-cinder-852009-8-iscsi devstack@n-api.service[120741]: DEBUG nova.network.neutron [None req-8f1796de-b14f-4a3c-84ef-2d3e010b3556 tempest-ServerRescueNegativeTestJSON-412251590 tempest-ServerRescueNegativeTestJSON-412251590-project] validate_networks() for [('59c975bb-abd7-408b-a2d1-e892c96db606', None, None, None, None, None)] {{(pid=120741) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Sep 13 18:01:50.105930 dv-cinder-852009-8-iscsi devstack@n-api.service[120740]: DEBUG nova.api.openstack.wsgi [None req-44315969-f468-49be-bca5-cb7954824635 tempest-AttachVolumeShelveTestJSON-385853788 tempest-AttachVolumeShelveTestJSON-385853788-project] Action: 'create', calling method: .version_select at 0x7fa627b7c430>, body: {"keypair": {"name": "tempest-keypair-68191066", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBHukxEcy1D/B7leW8gzHqbbMtmvLuPdMif3qMdMwu67Cq+GDGPw8cmd/NZEFnNFhDVMgDic1tGWBmS9EbEOWzIQHJgM8+iBvpwZ9DLRivwXYszNGCtspoxuQt297zSs0zw=="}} {{(pid=120740) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 13 18:01:50.223502 dv-cinder-852009-8-iscsi devstack@n-api.service[120740]: DEBUG nova.quota [None req-44315969-f468-49be-bca5-cb7954824635 tempest-AttachVolumeShelveTestJSON-385853788 tempest-AttachVolumeShelveTestJSON-385853788-project] Getting quotas for project 75e14fd88bfb4cd896fa7b070a0fac47. Resources: {'key_pairs'} {{(pid=120740) _get_quotas /opt/stack/nova/nova/quota.py:393}} Sep 13 18:01:50.256824 dv-cinder-852009-8-iscsi devstack@n-api.service[120740]: DEBUG nova.quota [None req-44315969-f468-49be-bca5-cb7954824635 tempest-AttachVolumeShelveTestJSON-385853788 tempest-AttachVolumeShelveTestJSON-385853788-project] Getting quotas for user e68ecd9b3ca643539b109f75bb242d6f and project 75e14fd88bfb4cd896fa7b070a0fac47. Resources: {'key_pairs'} {{(pid=120740) _get_quotas /opt/stack/nova/nova/quota.py:383}} Sep 13 18:01:50.361144 dv-cinder-852009-8-iscsi devstack@n-api.service[120740]: INFO nova.api.openstack.requestlog [None req-44315969-f468-49be-bca5-cb7954824635 tempest-AttachVolumeShelveTestJSON-385853788 tempest-AttachVolumeShelveTestJSON-385853788-project] 10.222.0.43 "POST /compute/v2.1/os-keypairs" status: 201 len: 399 microversion: 2.20 time: 1.356745 Sep 13 18:01:50.361754 dv-cinder-852009-8-iscsi devstack@n-api.service[120740]: [pid: 120740|app: 0|req: 1/1] 10.222.0.43 () {62 vars in 1200 bytes} [Tue Sep 13 18:01:49 2022] POST /compute/v2.1/os-keypairs => generated 399 bytes in 1359 msecs (HTTP/1.1 201) 9 headers in 364 bytes (1 switches on core 0) Sep 13 18:01:50.911940 dv-cinder-852009-8-iscsi devstack@n-api.service[120741]: DEBUG nova.virt.hardware [None req-8f1796de-b14f-4a3c-84ef-2d3e010b3556 tempest-ServerRescueNegativeTestJSON-412251590 tempest-ServerRescueNegativeTestJSON-412251590-project] Flavor limits 0:0:0 {{(pid=120741) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Sep 13 18:01:50.915406 dv-cinder-852009-8-iscsi devstack@n-api.service[120741]: DEBUG nova.virt.hardware [None req-8f1796de-b14f-4a3c-84ef-2d3e010b3556 tempest-ServerRescueNegativeTestJSON-412251590 tempest-ServerRescueNegativeTestJSON-412251590-project] Image limits 0:0:0 {{(pid=120741) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Sep 13 18:01:50.916504 dv-cinder-852009-8-iscsi devstack@n-api.service[120741]: DEBUG nova.virt.hardware [None req-8f1796de-b14f-4a3c-84ef-2d3e010b3556 tempest-ServerRescueNegativeTestJSON-412251590 tempest-ServerRescueNegativeTestJSON-412251590-project] Flavor pref 0:0:0 {{(pid=120741) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Sep 13 18:01:50.917406 dv-cinder-852009-8-iscsi devstack@n-api.service[120741]: DEBUG nova.virt.hardware [None req-8f1796de-b14f-4a3c-84ef-2d3e010b3556 tempest-ServerRescueNegativeTestJSON-412251590 tempest-ServerRescueNegativeTestJSON-412251590-project] Image pref 0:0:0 {{(pid=120741) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Sep 13 18:01:50.918357 dv-cinder-852009-8-iscsi devstack@n-api.service[120741]: DEBUG nova.virt.hardware [None req-8f1796de-b14f-4a3c-84ef-2d3e010b3556 tempest-ServerRescueNegativeTestJSON-412251590 tempest-ServerRescueNegativeTestJSON-412251590-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=120741) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Sep 13 18:01:50.973092 dv-cinder-852009-8-iscsi devstack@n-api.service[120741]: DEBUG oslo_concurrency.lockutils [None req-8f1796de-b14f-4a3c-84ef-2d3e010b3556 tempest-ServerRescueNegativeTestJSON-412251590 tempest-ServerRescueNegativeTestJSON-412251590-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120741) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 18:01:50.973897 dv-cinder-852009-8-iscsi devstack@n-api.service[120741]: DEBUG oslo_concurrency.lockutils [None req-8f1796de-b14f-4a3c-84ef-2d3e010b3556 tempest-ServerRescueNegativeTestJSON-412251590 tempest-ServerRescueNegativeTestJSON-412251590-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120741) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 18:01:50.974528 dv-cinder-852009-8-iscsi devstack@n-api.service[120741]: DEBUG oslo_concurrency.lockutils [None req-8f1796de-b14f-4a3c-84ef-2d3e010b3556 tempest-ServerRescueNegativeTestJSON-412251590 tempest-ServerRescueNegativeTestJSON-412251590-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120741) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 18:01:50.978318 dv-cinder-852009-8-iscsi devstack@n-api.service[120741]: DEBUG oslo_concurrency.lockutils [None req-8f1796de-b14f-4a3c-84ef-2d3e010b3556 tempest-ServerRescueNegativeTestJSON-412251590 tempest-ServerRescueNegativeTestJSON-412251590-project] Acquiring lock "1daf4f4c-0e4a-4779-b53a-78c48397ea2f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120741) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 18:01:50.979277 dv-cinder-852009-8-iscsi devstack@n-api.service[120741]: DEBUG oslo_concurrency.lockutils [None req-8f1796de-b14f-4a3c-84ef-2d3e010b3556 tempest-ServerRescueNegativeTestJSON-412251590 tempest-ServerRescueNegativeTestJSON-412251590-project] Lock "1daf4f4c-0e4a-4779-b53a-78c48397ea2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120741) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 18:01:50.980932 dv-cinder-852009-8-iscsi devstack@n-api.service[120741]: DEBUG oslo_concurrency.lockutils [None req-8f1796de-b14f-4a3c-84ef-2d3e010b3556 tempest-ServerRescueNegativeTestJSON-412251590 tempest-ServerRescueNegativeTestJSON-412251590-project] Lock "1daf4f4c-0e4a-4779-b53a-78c48397ea2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120741) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 18:01:51.079476 dv-cinder-852009-8-iscsi devstack@n-api.service[120741]: DEBUG nova.quota [None req-8f1796de-b14f-4a3c-84ef-2d3e010b3556 tempest-ServerRescueNegativeTestJSON-412251590 tempest-ServerRescueNegativeTestJSON-412251590-project] Getting quotas for project 2eae4acecf6c4961830ead78d71b2ad3. Resources: {'cores', 'ram', 'instances'} {{(pid=120741) _get_quotas /opt/stack/nova/nova/quota.py:393}} Sep 13 18:01:51.088184 dv-cinder-852009-8-iscsi devstack@n-api.service[120741]: DEBUG nova.quota [None req-8f1796de-b14f-4a3c-84ef-2d3e010b3556 tempest-ServerRescueNegativeTestJSON-412251590 tempest-ServerRescueNegativeTestJSON-412251590-project] Getting quotas for user 60800cf2774e409d9c1b6f4992669991 and project 2eae4acecf6c4961830ead78d71b2ad3. Resources: {'cores', 'ram', 'instances'} {{(pid=120741) _get_quotas /opt/stack/nova/nova/quota.py:383}} Sep 13 18:01:51.120180 dv-cinder-852009-8-iscsi devstack@n-api.service[120741]: DEBUG nova.compute.api [None req-8f1796de-b14f-4a3c-84ef-2d3e010b3556 tempest-ServerRescueNegativeTestJSON-412251590 tempest-ServerRescueNegativeTestJSON-412251590-project] Going to run 1 instances... {{(pid=120741) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Sep 13 18:01:51.125764 dv-cinder-852009-8-iscsi devstack@n-api.service[120741]: DEBUG nova.compute.api [None req-8f1796de-b14f-4a3c-84ef-2d3e010b3556 tempest-ServerRescueNegativeTestJSON-412251590 tempest-ServerRescueNegativeTestJSON-412251590-project] [instance: a9c22f82-a945-4a94-b3c9-fe95265053bd] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='33034e36-e6b2-4847-92a1-ff3188c05a4a',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=120741) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Sep 13 18:01:51.309322 dv-cinder-852009-8-iscsi devstack@n-api.service[120741]: INFO nova.api.openstack.requestlog [None req-8f1796de-b14f-4a3c-84ef-2d3e010b3556 tempest-ServerRescueNegativeTestJSON-412251590 tempest-ServerRescueNegativeTestJSON-412251590-project] 10.222.0.43 "POST /compute/v2.1/servers" status: 202 len: 383 microversion: 2.1 time: 3.720322 Sep 13 18:01:51.310665 dv-cinder-852009-8-iscsi devstack@n-api.service[120741]: [pid: 120741|app: 0|req: 1/2] 10.222.0.43 () {60 vars in 1147 bytes} [Tue Sep 13 18:01:47 2022] POST /compute/v2.1/servers => generated 383 bytes in 3724 msecs (HTTP/1.1 202) 10 headers in 451 bytes (2 switches on core 0) Sep 13 18:01:51.322678 dv-cinder-852009-8-iscsi devstack@n-api.service[120740]: DEBUG nova.api.openstack.wsgi [None req-ce932191-7643-4b07-a9ba-0c6e9d64026d tempest-ServerRescueNegativeTestJSON-412251590 tempest-ServerRescueNegativeTestJSON-412251590-project] Calling method '>' {{(pid=120740) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 18:01:51.323414 dv-cinder-852009-8-iscsi devstack@n-api.service[120740]: DEBUG nova.compute.api [None req-ce932191-7643-4b07-a9ba-0c6e9d64026d tempest-ServerRescueNegativeTestJSON-412251590 tempest-ServerRescueNegativeTestJSON-412251590-project] [instance: a9c22f82-a945-4a94-b3c9-fe95265053bd] Fetching instance by UUID {{(pid=120740) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 18:01:53.396848 dv-cinder-852009-8-iscsi devstack@n-api.service[120740]: DEBUG nova.policy [None req-ce932191-7643-4b07-a9ba-0c6e9d64026d tempest-ServerRescueNegativeTestJSON-412251590 tempest-ServerRescueNegativeTestJSON-412251590-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '60800cf2774e409d9c1b6f4992669991', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2eae4acecf6c4961830ead78d71b2ad3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120740) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 18:01:53.453743 dv-cinder-852009-8-iscsi devstack@n-api.service[120740]: INFO nova.api.openstack.requestlog [None req-ce932191-7643-4b07-a9ba-0c6e9d64026d tempest-ServerRescueNegativeTestJSON-412251590 tempest-ServerRescueNegativeTestJSON-412251590-project] 10.222.0.43 "GET /compute/v2.1/servers/a9c22f82-a945-4a94-b3c9-fe95265053bd" status: 200 len: 1222 microversion: 2.1 time: 2.134888 Sep 13 18:01:53.460641 dv-cinder-852009-8-iscsi devstack@n-api.service[120740]: [pid: 120740|app: 0|req: 2/3] 10.222.0.43 () {58 vars in 1236 bytes} [Tue Sep 13 18:01:51 2022] GET /compute/v2.1/servers/a9c22f82-a945-4a94-b3c9-fe95265053bd => generated 1222 bytes in 2143 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 13 18:01:53.800287 dv-cinder-852009-8-iscsi devstack@n-api.service[120740]: DEBUG nova.api.openstack.wsgi [None req-ea548eb1-8345-4913-960e-f721116c1899 tempest-ServerRescueNegativeTestJSON-412251590 tempest-ServerRescueNegativeTestJSON-412251590-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServerRescueNegativeTestJSON-server-1349533461", "imageRef": "33034e36-e6b2-4847-92a1-ff3188c05a4a", "flavorRef": "452", "adminPass": "***", "networks": [{"uuid": "}]}} {{(pid=120740) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 13 18:01:54.033821 dv-cinder-852009-8-iscsi devstack@n-api.service[120741]: DEBUG nova.api.openstack.wsgi [None req-58df6a78-fe1b-4d52-843c-d810aec3b6c2 tempest-AttachVolumeTestJSON-555093534 tempest-AttachVolumeTestJSON-555093534-project] Action: 'create', calling method: .version_select at 0x7fa62718c3a0>, body: {"keypair": {"name": "tempest-keypair-1286157980", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBDjunYcYeVE1yAzrnQZxRxDVmdKvIepOUM8aodEe5Q1NSzI32jbuwK2H9WJvXWQ3ZFWF3IgwssymJ15t5g60coR/K2xsGMbJVcjj4EJv0g6iXDDBq02+JYq7HWKpntpQYg=="}} {{(pid=120741) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 13 18:01:54.064347 dv-cinder-852009-8-iscsi devstack@n-api.service[120740]: DEBUG nova.network.neutron [None req-ea548eb1-8345-4913-960e-f721116c1899 tempest-ServerRescueNegativeTestJSON-412251590 tempest-ServerRescueNegativeTestJSON-412251590-project] validate_networks() for [('59c975bb-abd7-408b-a2d1-e892c96db606', None, None, None, None, None)] {{(pid=120740) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Sep 13 18:01:54.143255 dv-cinder-852009-8-iscsi devstack@n-api.service[120741]: DEBUG nova.quota [None req-58df6a78-fe1b-4d52-843c-d810aec3b6c2 tempest-AttachVolumeTestJSON-555093534 tempest-AttachVolumeTestJSON-555093534-project] Getting quotas for project a279fcbf274c4704a31a2b95061e1469. Resources: {'key_pairs'} {{(pid=120741) _get_quotas /opt/stack/nova/nova/quota.py:393}} Sep 13 18:01:54.163823 dv-cinder-852009-8-iscsi devstack@n-api.service[120741]: DEBUG nova.quota [None req-58df6a78-fe1b-4d52-843c-d810aec3b6c2 tempest-AttachVolumeTestJSON-555093534 tempest-AttachVolumeTestJSON-555093534-project] Getting quotas for user 0625b3113ce044bbac4f6142eaade11c and project a279fcbf274c4704a31a2b95061e1469. Resources: {'key_pairs'} {{(pid=120741) _get_quotas /opt/stack/nova/nova/quota.py:383}} Sep 13 18:01:54.255793 dv-cinder-852009-8-iscsi devstack@n-api.service[120741]: INFO nova.api.openstack.requestlog [None req-58df6a78-fe1b-4d52-843c-d810aec3b6c2 tempest-AttachVolumeTestJSON-555093534 tempest-AttachVolumeTestJSON-555093534-project] 10.222.0.43 "POST /compute/v2.1/os-keypairs" status: 200 len: 386 microversion: 2.1 time: 0.613534 Sep 13 18:01:54.266192 dv-cinder-852009-8-iscsi devstack@n-api.service[120741]: [pid: 120741|app: 0|req: 2/4] 10.222.0.43 () {60 vars in 1159 bytes} [Tue Sep 13 18:01:53 2022] POST /compute/v2.1/os-keypairs => generated 386 bytes in 628 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 13 18:01:56.193343 dv-cinder-852009-8-iscsi devstack@n-api.service[120741]: DEBUG nova.api.openstack.wsgi [None req-92413059-3195-4f44-855b-b2970435a2ad tempest-AttachVolumeShelveTestJSON-385853788 tempest-AttachVolumeShelveTestJSON-385853788-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-AttachVolumeShelveTestJSON-server-1454798358", "imageRef": "33034e36-e6b2-4847-92a1-ff3188c05a4a", "flavorRef": "452", "adminPass": "***", "networks": [{"uuid": "a840bf21-d395-471c-bfba-b1533e9bad0d"}], "security_groups": [{"name": "tempest-securitygroup--896785947"}], "key_name": "tempest-keypair-68191066", "user_data": "}} {{(pid=120741) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 13 18:01:56.853088 dv-cinder-852009-8-iscsi devstack@n-api.service[120741]: DEBUG nova.network.neutron [None req-92413059-3195-4f44-855b-b2970435a2ad tempest-AttachVolumeShelveTestJSON-385853788 tempest-AttachVolumeShelveTestJSON-385853788-project] validate_networks() for [('a840bf21-d395-471c-bfba-b1533e9bad0d', None, None, None, None, None)] {{(pid=120741) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Sep 13 18:01:58.732171 dv-cinder-852009-8-iscsi devstack@n-api.service[120740]: DEBUG nova.virt.hardware [None req-ea548eb1-8345-4913-960e-f721116c1899 tempest-ServerRescueNegativeTestJSON-412251590 tempest-ServerRescueNegativeTestJSON-412251590-project] Flavor limits 0:0:0 {{(pid=120740) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Sep 13 18:01:58.741524 dv-cinder-852009-8-iscsi devstack@n-api.service[120740]: DEBUG nova.virt.hardware [None req-ea548eb1-8345-4913-960e-f721116c1899 tempest-ServerRescueNegativeTestJSON-412251590 tempest-ServerRescueNegativeTestJSON-412251590-project] Image limits 0:0:0 {{(pid=120740) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Sep 13 18:01:58.742138 dv-cinder-852009-8-iscsi devstack@n-api.service[120740]: DEBUG nova.virt.hardware [None req-ea548eb1-8345-4913-960e-f721116c1899 tempest-ServerRescueNegativeTestJSON-412251590 tempest-ServerRescueNegativeTestJSON-412251590-project] Flavor pref 0:0:0 {{(pid=120740) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Sep 13 18:01:58.742557 dv-cinder-852009-8-iscsi devstack@n-api.service[120740]: DEBUG nova.virt.hardware [None req-ea548eb1-8345-4913-960e-f721116c1899 tempest-ServerRescueNegativeTestJSON-412251590 tempest-ServerRescueNegativeTestJSON-412251590-project] Image pref 0:0:0 {{(pid=120740) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Sep 13 18:01:58.742970 dv-cinder-852009-8-iscsi devstack@n-api.service[120740]: DEBUG nova.virt.hardware [None req-ea548eb1-8345-4913-960e-f721116c1899 tempest-ServerRescueNegativeTestJSON-412251590 tempest-ServerRescueNegativeTestJSON-412251590-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=120740) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Sep 13 18:01:58.797889 dv-cinder-852009-8-iscsi devstack@n-api.service[120740]: DEBUG oslo_concurrency.lockutils [None req-ea548eb1-8345-4913-960e-f721116c1899 tempest-ServerRescueNegativeTestJSON-412251590 tempest-ServerRescueNegativeTestJSON-412251590-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120740) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 18:01:58.799598 dv-cinder-852009-8-iscsi devstack@n-api.service[120740]: DEBUG oslo_concurrency.lockutils [None req-ea548eb1-8345-4913-960e-f721116c1899 tempest-ServerRescueNegativeTestJSON-412251590 tempest-ServerRescueNegativeTestJSON-412251590-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.009s {{(pid=120740) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 18:01:58.816569 dv-cinder-852009-8-iscsi devstack@n-api.service[120740]: DEBUG oslo_concurrency.lockutils [None req-ea548eb1-8345-4913-960e-f721116c1899 tempest-ServerRescueNegativeTestJSON-412251590 tempest-ServerRescueNegativeTestJSON-412251590-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.017s {{(pid=120740) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 18:01:58.817925 dv-cinder-852009-8-iscsi devstack@n-api.service[120740]: DEBUG oslo_concurrency.lockutils [None req-ea548eb1-8345-4913-960e-f721116c1899 tempest-ServerRescueNegativeTestJSON-412251590 tempest-ServerRescueNegativeTestJSON-412251590-project] Acquiring lock "1daf4f4c-0e4a-4779-b53a-78c48397ea2f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120740) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 18:01:58.820535 dv-cinder-852009-8-iscsi devstack@n-api.service[120740]: DEBUG oslo_concurrency.lockutils [None req-ea548eb1-8345-4913-960e-f721116c1899 tempest-ServerRescueNegativeTestJSON-412251590 tempest-ServerRescueNegativeTestJSON-412251590-project] Lock "1daf4f4c-0e4a-4779-b53a-78c48397ea2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120740) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 18:01:58.826072 dv-cinder-852009-8-iscsi devstack@n-api.service[120740]: DEBUG oslo_concurrency.lockutils [None req-ea548eb1-8345-4913-960e-f721116c1899 tempest-ServerRescueNegativeTestJSON-412251590 tempest-ServerRescueNegativeTestJSON-412251590-project] Lock "1daf4f4c-0e4a-4779-b53a-78c48397ea2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=120740) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 18:01:58.918313 dv-cinder-852009-8-iscsi devstack@n-api.service[120740]: DEBUG nova.quota [None req-ea548eb1-8345-4913-960e-f721116c1899 tempest-ServerRescueNegativeTestJSON-412251590 tempest-ServerRescueNegativeTestJSON-412251590-project] Getting quotas for project 2eae4acecf6c4961830ead78d71b2ad3. Resources: {'cores', 'ram', 'instances'} {{(pid=120740) _get_quotas /opt/stack/nova/nova/quota.py:393}} Sep 13 18:01:58.931603 dv-cinder-852009-8-iscsi devstack@n-api.service[120740]: DEBUG nova.quota [None req-ea548eb1-8345-4913-960e-f721116c1899 tempest-ServerRescueNegativeTestJSON-412251590 tempest-ServerRescueNegativeTestJSON-412251590-project] Getting quotas for user 60800cf2774e409d9c1b6f4992669991 and project 2eae4acecf6c4961830ead78d71b2ad3. Resources: {'cores', 'ram', 'instances'} {{(pid=120740) _get_quotas /opt/stack/nova/nova/quota.py:383}} Sep 13 18:01:58.971228 dv-cinder-852009-8-iscsi devstack@n-api.service[120740]: DEBUG nova.compute.api [None req-ea548eb1-8345-4913-960e-f721116c1899 tempest-ServerRescueNegativeTestJSON-412251590 tempest-ServerRescueNegativeTestJSON-412251590-project] Going to run 1 instances... {{(pid=120740) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Sep 13 18:01:58.978425 dv-cinder-852009-8-iscsi devstack@n-api.service[120740]: DEBUG nova.compute.api [None req-ea548eb1-8345-4913-960e-f721116c1899 tempest-ServerRescueNegativeTestJSON-412251590 tempest-ServerRescueNegativeTestJSON-412251590-project] [instance: 8cd29851-35c1-4032-a137-ab9419a2ec5b] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='33034e36-e6b2-4847-92a1-ff3188c05a4a',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=120740) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Sep 13 18:01:59.147959 dv-cinder-852009-8-iscsi devstack@n-api.service[120740]: INFO nova.api.openstack.requestlog [None req-ea548eb1-8345-4913-960e-f721116c1899 tempest-ServerRescueNegativeTestJSON-412251590 tempest-ServerRescueNegativeTestJSON-412251590-project] 10.222.0.43 "POST /compute/v2.1/servers" status: 202 len: 383 microversion: 2.1 time: 5.352976 Sep 13 18:01:59.155677 dv-cinder-852009-8-iscsi devstack@n-api.service[120740]: [pid: 120740|app: 0|req: 3/5] 10.222.0.43 () {60 vars in 1147 bytes} [Tue Sep 13 18:01:53 2022] POST /compute/v2.1/servers => generated 383 bytes in 5362 msecs (HTTP/1.1 202) 10 headers in 451 bytes (2 switches on core 0) Sep 13 18:01:59.896968 dv-cinder-852009-8-iscsi devstack@n-api.service[120740]: DEBUG nova.api.openstack.wsgi [None req-a437ca94-0cb0-4615-b4ab-9bd1864147c3 tempest-DeleteServersTestJSON-1632919649 tempest-DeleteServersTestJSON-1632919649-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-DeleteServersTestJSON-server-2032470074", "imageRef": "33034e36-e6b2-4847-92a1-ff3188c05a4a", "flavorRef": "452", "networks": [{"uuid": "bbce7e8b-25af-4d90-8ecf-bffedd9c1781"}]}} {{(pid=120740) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 13 18:02:00.144614 dv-cinder-852009-8-iscsi devstack@n-api.service[120740]: DEBUG nova.network.neutron [None req-a437ca94-0cb0-4615-b4ab-9bd1864147c3 tempest-DeleteServersTestJSON-1632919649 tempest-DeleteServersTestJSON-1632919649-project] validate_networks() for [('bbce7e8b-25af-4d90-8ecf-bffedd9c1781', None, None, None, None, None)] {{(pid=120740) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Sep 13 18:02:01.032005 dv-cinder-852009-8-iscsi devstack@n-api.service[120741]: DEBUG dbcounter [-] [120741] Writing DB stats nova_cell0:SELECT=2 {{(pid=120741) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 18:02:01.047067 dv-cinder-852009-8-iscsi devstack@n-api.service[120741]: DEBUG dbcounter [-] [120741] Writing DB stats nova_cell1:SELECT=2 {{(pid=120741) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 18:02:02.135362 dv-cinder-852009-8-iscsi devstack@n-api.service[120741]: DEBUG nova.virt.hardware [None req-92413059-3195-4f44-855b-b2970435a2ad tempest-AttachVolumeShelveTestJSON-385853788 tempest-AttachVolumeShelveTestJSON-385853788-project] Flavor limits 0:0:0 {{(pid=120741) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Sep 13 18:02:02.136632 dv-cinder-852009-8-iscsi devstack@n-api.service[120741]: DEBUG nova.virt.hardware [None req-92413059-3195-4f44-855b-b2970435a2ad tempest-AttachVolumeShelveTestJSON-385853788 tempest-AttachVolumeShelveTestJSON-385853788-project] Image limits 0:0:0 {{(pid=120741) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Sep 13 18:02:02.137346 dv-cinder-852009-8-iscsi devstack@n-api.service[120741]: DEBUG nova.virt.hardware [None req-92413059-3195-4f44-855b-b2970435a2ad tempest-AttachVolumeShelveTestJSON-385853788 tempest-AttachVolumeShelveTestJSON-385853788-project] Flavor pref 0:0:0 {{(pid=120741) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Sep 13 18:02:02.137968 dv-cinder-852009-8-iscsi devstack@n-api.service[120741]: DEBUG nova.virt.hardware [None req-92413059-3195-4f44-855b-b2970435a2ad tempest-AttachVolumeShelveTestJSON-385853788 tempest-AttachVolumeShelveTestJSON-385853788-project] Image pref 0:0:0 {{(pid=120741) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Sep 13 18:02:02.138543 dv-cinder-852009-8-iscsi devstack@n-api.service[120741]: DEBUG nova.virt.hardware [None req-92413059-3195-4f44-855b-b2970435a2ad tempest-AttachVolumeShelveTestJSON-385853788 tempest-AttachVolumeShelveTestJSON-385853788-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=120741) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Sep 13 18:02:02.170356 dv-cinder-852009-8-iscsi devstack@n-api.service[120741]: DEBUG oslo_concurrency.lockutils [None req-92413059-3195-4f44-855b-b2970435a2ad tempest-AttachVolumeShelveTestJSON-385853788 tempest-AttachVolumeShelveTestJSON-385853788-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120741) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 18:02:02.173459 dv-cinder-852009-8-iscsi devstack@n-api.service[120741]: DEBUG oslo_concurrency.lockutils [None req-92413059-3195-4f44-855b-b2970435a2ad tempest-AttachVolumeShelveTestJSON-385853788 tempest-AttachVolumeShelveTestJSON-385853788-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.007s {{(pid=120741) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 18:02:02.175837 dv-cinder-852009-8-iscsi devstack@n-api.service[120741]: DEBUG oslo_concurrency.lockutils [None req-92413059-3195-4f44-855b-b2970435a2ad tempest-AttachVolumeShelveTestJSON-385853788 tempest-AttachVolumeShelveTestJSON-385853788-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=120741) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 18:02:02.178686 dv-cinder-852009-8-iscsi devstack@n-api.service[120741]: DEBUG oslo_concurrency.lockutils [None req-92413059-3195-4f44-855b-b2970435a2ad tempest-AttachVolumeShelveTestJSON-385853788 tempest-AttachVolumeShelveTestJSON-385853788-project] Acquiring lock "1daf4f4c-0e4a-4779-b53a-78c48397ea2f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120741) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 18:02:02.186473 dv-cinder-852009-8-iscsi devstack@n-api.service[120741]: DEBUG oslo_concurrency.lockutils [None req-92413059-3195-4f44-855b-b2970435a2ad tempest-AttachVolumeShelveTestJSON-385853788 tempest-AttachVolumeShelveTestJSON-385853788-project] Lock "1daf4f4c-0e4a-4779-b53a-78c48397ea2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.007s {{(pid=120741) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 18:02:02.191515 dv-cinder-852009-8-iscsi devstack@n-api.service[120741]: DEBUG oslo_concurrency.lockutils [None req-92413059-3195-4f44-855b-b2970435a2ad tempest-AttachVolumeShelveTestJSON-385853788 tempest-AttachVolumeShelveTestJSON-385853788-project] Lock "1daf4f4c-0e4a-4779-b53a-78c48397ea2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=120741) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 18:02:02.277050 dv-cinder-852009-8-iscsi devstack@n-api.service[120740]: DEBUG nova.virt.hardware [None req-a437ca94-0cb0-4615-b4ab-9bd1864147c3 tempest-DeleteServersTestJSON-1632919649 tempest-DeleteServersTestJSON-1632919649-project] Flavor limits 0:0:0 {{(pid=120740) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Sep 13 18:02:02.278287 dv-cinder-852009-8-iscsi devstack@n-api.service[120740]: DEBUG nova.virt.hardware [None req-a437ca94-0cb0-4615-b4ab-9bd1864147c3 tempest-DeleteServersTestJSON-1632919649 tempest-DeleteServersTestJSON-1632919649-project] Image limits 0:0:0 {{(pid=120740) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Sep 13 18:02:02.278896 dv-cinder-852009-8-iscsi devstack@n-api.service[120740]: DEBUG nova.virt.hardware [None req-a437ca94-0cb0-4615-b4ab-9bd1864147c3 tempest-DeleteServersTestJSON-1632919649 tempest-DeleteServersTestJSON-1632919649-project] Flavor pref 0:0:0 {{(pid=120740) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Sep 13 18:02:02.279438 dv-cinder-852009-8-iscsi devstack@n-api.service[120740]: DEBUG nova.virt.hardware [None req-a437ca94-0cb0-4615-b4ab-9bd1864147c3 tempest-DeleteServersTestJSON-1632919649 tempest-DeleteServersTestJSON-1632919649-project] Image pref 0:0:0 {{(pid=120740) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Sep 13 18:02:02.280075 dv-cinder-852009-8-iscsi devstack@n-api.service[120740]: DEBUG nova.virt.hardware [None req-a437ca94-0cb0-4615-b4ab-9bd1864147c3 tempest-DeleteServersTestJSON-1632919649 tempest-DeleteServersTestJSON-1632919649-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=120740) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Sep 13 18:02:02.295348 dv-cinder-852009-8-iscsi devstack@n-api.service[120741]: DEBUG nova.quota [None req-92413059-3195-4f44-855b-b2970435a2ad tempest-AttachVolumeShelveTestJSON-385853788 tempest-AttachVolumeShelveTestJSON-385853788-project] Getting quotas for project 75e14fd88bfb4cd896fa7b070a0fac47. Resources: {'cores', 'ram', 'instances'} {{(pid=120741) _get_quotas /opt/stack/nova/nova/quota.py:393}} Sep 13 18:02:02.303881 dv-cinder-852009-8-iscsi devstack@n-api.service[120740]: DEBUG oslo_concurrency.lockutils [None req-a437ca94-0cb0-4615-b4ab-9bd1864147c3 tempest-DeleteServersTestJSON-1632919649 tempest-DeleteServersTestJSON-1632919649-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120740) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 18:02:02.305500 dv-cinder-852009-8-iscsi devstack@n-api.service[120740]: DEBUG oslo_concurrency.lockutils [None req-a437ca94-0cb0-4615-b4ab-9bd1864147c3 tempest-DeleteServersTestJSON-1632919649 tempest-DeleteServersTestJSON-1632919649-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120740) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 18:02:02.306198 dv-cinder-852009-8-iscsi devstack@n-api.service[120740]: DEBUG oslo_concurrency.lockutils [None req-a437ca94-0cb0-4615-b4ab-9bd1864147c3 tempest-DeleteServersTestJSON-1632919649 tempest-DeleteServersTestJSON-1632919649-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120740) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 18:02:02.307614 dv-cinder-852009-8-iscsi devstack@n-api.service[120741]: DEBUG nova.quota [None req-92413059-3195-4f44-855b-b2970435a2ad tempest-AttachVolumeShelveTestJSON-385853788 tempest-AttachVolumeShelveTestJSON-385853788-project] Getting quotas for user e68ecd9b3ca643539b109f75bb242d6f and project 75e14fd88bfb4cd896fa7b070a0fac47. Resources: {'cores', 'ram', 'instances'} {{(pid=120741) _get_quotas /opt/stack/nova/nova/quota.py:383}} Sep 13 18:02:02.310065 dv-cinder-852009-8-iscsi devstack@n-api.service[120740]: DEBUG oslo_concurrency.lockutils [None req-a437ca94-0cb0-4615-b4ab-9bd1864147c3 tempest-DeleteServersTestJSON-1632919649 tempest-DeleteServersTestJSON-1632919649-project] Acquiring lock "1daf4f4c-0e4a-4779-b53a-78c48397ea2f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120740) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 18:02:02.310837 dv-cinder-852009-8-iscsi devstack@n-api.service[120740]: DEBUG oslo_concurrency.lockutils [None req-a437ca94-0cb0-4615-b4ab-9bd1864147c3 tempest-DeleteServersTestJSON-1632919649 tempest-DeleteServersTestJSON-1632919649-project] Lock "1daf4f4c-0e4a-4779-b53a-78c48397ea2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120740) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 18:02:02.312175 dv-cinder-852009-8-iscsi devstack@n-api.service[120740]: DEBUG oslo_concurrency.lockutils [None req-a437ca94-0cb0-4615-b4ab-9bd1864147c3 tempest-DeleteServersTestJSON-1632919649 tempest-DeleteServersTestJSON-1632919649-project] Lock "1daf4f4c-0e4a-4779-b53a-78c48397ea2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120740) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 18:02:02.335361 dv-cinder-852009-8-iscsi devstack@n-api.service[120740]: DEBUG nova.quota [None req-a437ca94-0cb0-4615-b4ab-9bd1864147c3 tempest-DeleteServersTestJSON-1632919649 tempest-DeleteServersTestJSON-1632919649-project] Getting quotas for project 66136f123f5b4ad0a824920bbdf9d245. Resources: {'cores', 'ram', 'instances'} {{(pid=120740) _get_quotas /opt/stack/nova/nova/quota.py:393}} Sep 13 18:02:02.340691 dv-cinder-852009-8-iscsi devstack@n-api.service[120741]: DEBUG nova.compute.api [None req-92413059-3195-4f44-855b-b2970435a2ad tempest-AttachVolumeShelveTestJSON-385853788 tempest-AttachVolumeShelveTestJSON-385853788-project] Going to run 1 instances... {{(pid=120741) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Sep 13 18:02:02.340833 dv-cinder-852009-8-iscsi devstack@n-api.service[120740]: DEBUG nova.quota [None req-a437ca94-0cb0-4615-b4ab-9bd1864147c3 tempest-DeleteServersTestJSON-1632919649 tempest-DeleteServersTestJSON-1632919649-project] Getting quotas for user 51db5ef052144879b53979268ac4ceb5 and project 66136f123f5b4ad0a824920bbdf9d245. Resources: {'cores', 'ram', 'instances'} {{(pid=120740) _get_quotas /opt/stack/nova/nova/quota.py:383}} Sep 13 18:02:02.346742 dv-cinder-852009-8-iscsi devstack@n-api.service[120741]: DEBUG nova.compute.api [None req-92413059-3195-4f44-855b-b2970435a2ad tempest-AttachVolumeShelveTestJSON-385853788 tempest-AttachVolumeShelveTestJSON-385853788-project] [instance: 11d2616a-96f9-4a7a-aab8-219219986a8b] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='33034e36-e6b2-4847-92a1-ff3188c05a4a',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=120741) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Sep 13 18:02:02.353152 dv-cinder-852009-8-iscsi devstack@n-api.service[120740]: DEBUG nova.compute.api [None req-a437ca94-0cb0-4615-b4ab-9bd1864147c3 tempest-DeleteServersTestJSON-1632919649 tempest-DeleteServersTestJSON-1632919649-project] Going to run 1 instances... {{(pid=120740) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Sep 13 18:02:02.355694 dv-cinder-852009-8-iscsi devstack@n-api.service[120740]: DEBUG nova.compute.api [None req-a437ca94-0cb0-4615-b4ab-9bd1864147c3 tempest-DeleteServersTestJSON-1632919649 tempest-DeleteServersTestJSON-1632919649-project] [instance: 207d1d8d-58a4-4b99-aa09-1c5023c60784] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='33034e36-e6b2-4847-92a1-ff3188c05a4a',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=120740) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Sep 13 18:02:02.456582 dv-cinder-852009-8-iscsi devstack@n-api.service[120740]: INFO nova.api.openstack.requestlog [None req-a437ca94-0cb0-4615-b4ab-9bd1864147c3 tempest-DeleteServersTestJSON-1632919649 tempest-DeleteServersTestJSON-1632919649-project] 10.222.0.43 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 3.295449 Sep 13 18:02:02.457583 dv-cinder-852009-8-iscsi devstack@n-api.service[120740]: [pid: 120740|app: 0|req: 4/6] 10.222.0.43 () {60 vars in 1147 bytes} [Tue Sep 13 18:01:59 2022] POST /compute/v2.1/servers => generated 380 bytes in 3301 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Sep 13 18:02:02.471009 dv-cinder-852009-8-iscsi devstack@n-api.service[120740]: DEBUG nova.api.openstack.wsgi [None req-53bf2f63-354c-48dd-b6b8-9d86f4050695 tempest-ServerRescueNegativeTestJSON-412251590 tempest-ServerRescueNegativeTestJSON-412251590-project] Calling method '>' {{(pid=120740) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 18:02:02.471901 dv-cinder-852009-8-iscsi devstack@n-api.service[120740]: DEBUG nova.compute.api [None req-53bf2f63-354c-48dd-b6b8-9d86f4050695 tempest-ServerRescueNegativeTestJSON-412251590 tempest-ServerRescueNegativeTestJSON-412251590-project] [instance: 8cd29851-35c1-4032-a137-ab9419a2ec5b] Fetching instance by UUID {{(pid=120740) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 18:02:02.514376 dv-cinder-852009-8-iscsi devstack@n-api.service[120740]: DEBUG oslo_concurrency.lockutils [None req-53bf2f63-354c-48dd-b6b8-9d86f4050695 tempest-ServerRescueNegativeTestJSON-412251590 tempest-ServerRescueNegativeTestJSON-412251590-project] Acquiring lock "1daf4f4c-0e4a-4779-b53a-78c48397ea2f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120740) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 18:02:02.527477 dv-cinder-852009-8-iscsi devstack@n-api.service[120740]: DEBUG oslo_concurrency.lockutils [None req-53bf2f63-354c-48dd-b6b8-9d86f4050695 tempest-ServerRescueNegativeTestJSON-412251590 tempest-ServerRescueNegativeTestJSON-412251590-project] Lock "1daf4f4c-0e4a-4779-b53a-78c48397ea2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.013s {{(pid=120740) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 18:02:02.530412 dv-cinder-852009-8-iscsi devstack@n-api.service[120740]: DEBUG oslo_concurrency.lockutils [None req-53bf2f63-354c-48dd-b6b8-9d86f4050695 tempest-ServerRescueNegativeTestJSON-412251590 tempest-ServerRescueNegativeTestJSON-412251590-project] Lock "1daf4f4c-0e4a-4779-b53a-78c48397ea2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=120740) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 18:02:02.534074 dv-cinder-852009-8-iscsi devstack@n-api.service[120740]: DEBUG oslo_concurrency.lockutils [None req-53bf2f63-354c-48dd-b6b8-9d86f4050695 tempest-ServerRescueNegativeTestJSON-412251590 tempest-ServerRescueNegativeTestJSON-412251590-project] Acquiring lock "1daf4f4c-0e4a-4779-b53a-78c48397ea2f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120740) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 18:02:02.534782 dv-cinder-852009-8-iscsi devstack@n-api.service[120740]: DEBUG oslo_concurrency.lockutils [None req-53bf2f63-354c-48dd-b6b8-9d86f4050695 tempest-ServerRescueNegativeTestJSON-412251590 tempest-ServerRescueNegativeTestJSON-412251590-project] Lock "1daf4f4c-0e4a-4779-b53a-78c48397ea2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120740) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 18:02:02.537535 dv-cinder-852009-8-iscsi devstack@n-api.service[120740]: DEBUG oslo_concurrency.lockutils [None req-53bf2f63-354c-48dd-b6b8-9d86f4050695 tempest-ServerRescueNegativeTestJSON-412251590 tempest-ServerRescueNegativeTestJSON-412251590-project] Lock "1daf4f4c-0e4a-4779-b53a-78c48397ea2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120740) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 18:02:02.557798 dv-cinder-852009-8-iscsi devstack@n-api.service[120741]: INFO nova.api.openstack.requestlog [None req-92413059-3195-4f44-855b-b2970435a2ad tempest-AttachVolumeShelveTestJSON-385853788 tempest-AttachVolumeShelveTestJSON-385853788-project] 10.222.0.43 "POST /compute/v2.1/servers" status: 202 len: 401 microversion: 2.20 time: 6.368909 Sep 13 18:02:02.577027 dv-cinder-852009-8-iscsi devstack@n-api.service[120741]: [pid: 120741|app: 0|req: 3/7] 10.222.0.43 () {62 vars in 1188 bytes} [Tue Sep 13 18:01:56 2022] POST /compute/v2.1/servers => generated 401 bytes in 6382 msecs (HTTP/1.1 202) 10 headers in 453 bytes (2 switches on core 0) Sep 13 18:02:02.622118 dv-cinder-852009-8-iscsi devstack@n-api.service[120741]: DEBUG nova.api.openstack.wsgi [None req-d6a4771c-53e1-4a41-97e2-31d435b5fc2c tempest-DeleteServersTestJSON-1632919649 tempest-DeleteServersTestJSON-1632919649-project] Calling method '>' {{(pid=120741) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 18:02:02.626626 dv-cinder-852009-8-iscsi devstack@n-api.service[120741]: DEBUG nova.compute.api [None req-d6a4771c-53e1-4a41-97e2-31d435b5fc2c tempest-DeleteServersTestJSON-1632919649 tempest-DeleteServersTestJSON-1632919649-project] [instance: 207d1d8d-58a4-4b99-aa09-1c5023c60784] Fetching instance by UUID {{(pid=120741) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 18:02:03.215442 dv-cinder-852009-8-iscsi devstack@n-api.service[120740]: DEBUG nova.policy [None req-53bf2f63-354c-48dd-b6b8-9d86f4050695 tempest-ServerRescueNegativeTestJSON-412251590 tempest-ServerRescueNegativeTestJSON-412251590-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '60800cf2774e409d9c1b6f4992669991', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2eae4acecf6c4961830ead78d71b2ad3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120740) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 18:02:03.226800 dv-cinder-852009-8-iscsi devstack@n-api.service[120741]: DEBUG nova.policy [None req-d6a4771c-53e1-4a41-97e2-31d435b5fc2c tempest-DeleteServersTestJSON-1632919649 tempest-DeleteServersTestJSON-1632919649-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '51db5ef052144879b53979268ac4ceb5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '66136f123f5b4ad0a824920bbdf9d245', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120741) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 18:02:03.271399 dv-cinder-852009-8-iscsi devstack@n-api.service[120740]: INFO nova.api.openstack.requestlog [None req-53bf2f63-354c-48dd-b6b8-9d86f4050695 tempest-ServerRescueNegativeTestJSON-412251590 tempest-ServerRescueNegativeTestJSON-412251590-project] 10.222.0.43 "GET /compute/v2.1/servers/8cd29851-35c1-4032-a137-ab9419a2ec5b" status: 200 len: 1282 microversion: 2.1 time: 0.812111 Sep 13 18:02:03.274699 dv-cinder-852009-8-iscsi devstack@n-api.service[120740]: [pid: 120740|app: 0|req: 5/8] 10.222.0.43 () {58 vars in 1236 bytes} [Tue Sep 13 18:02:02 2022] GET /compute/v2.1/servers/8cd29851-35c1-4032-a137-ab9419a2ec5b => generated 1282 bytes in 816 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 13 18:02:03.293232 dv-cinder-852009-8-iscsi devstack@n-api.service[120741]: INFO nova.api.openstack.requestlog [None req-d6a4771c-53e1-4a41-97e2-31d435b5fc2c tempest-DeleteServersTestJSON-1632919649 tempest-DeleteServersTestJSON-1632919649-project] 10.222.0.43 "GET /compute/v2.1/servers/207d1d8d-58a4-4b99-aa09-1c5023c60784" status: 200 len: 1215 microversion: 2.1 time: 0.708147 Sep 13 18:02:03.294929 dv-cinder-852009-8-iscsi devstack@n-api.service[120741]: [pid: 120741|app: 0|req: 4/9] 10.222.0.43 () {58 vars in 1236 bytes} [Tue Sep 13 18:02:02 2022] GET /compute/v2.1/servers/207d1d8d-58a4-4b99-aa09-1c5023c60784 => generated 1215 bytes in 724 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 13 18:02:03.310905 dv-cinder-852009-8-iscsi devstack@n-api.service[120740]: DEBUG nova.api.openstack.wsgi [None req-bd533c36-e3c1-4f33-b126-8e3085ef8348 tempest-AttachVolumeShelveTestJSON-385853788 tempest-AttachVolumeShelveTestJSON-385853788-project] Calling method '>' {{(pid=120740) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 18:02:03.313452 dv-cinder-852009-8-iscsi devstack@n-api.service[120741]: DEBUG nova.api.openstack.wsgi [None req-c8aee345-1ec7-4434-a07c-70c6a6751f05 tempest-AttachVolumeTestJSON-555093534 tempest-AttachVolumeTestJSON-555093534-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-AttachVolumeTestJSON-server-2134365788", "imageRef": "33034e36-e6b2-4847-92a1-ff3188c05a4a", "flavorRef": "452", "adminPass": "***", "networks": [{"uuid": "c3ccf009-999c-4527-966f-109321f8fcee"}], "security_groups": [{"name": "tempest-securitygroup--51472521"}], "key_name": "tempest-keypair-1286157980", "user_data": "}} {{(pid=120741) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 13 18:02:03.317302 dv-cinder-852009-8-iscsi devstack@n-api.service[120740]: DEBUG nova.compute.api [None req-bd533c36-e3c1-4f33-b126-8e3085ef8348 tempest-AttachVolumeShelveTestJSON-385853788 tempest-AttachVolumeShelveTestJSON-385853788-project] [instance: 11d2616a-96f9-4a7a-aab8-219219986a8b] Fetching instance by UUID {{(pid=120740) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 18:02:03.703441 dv-cinder-852009-8-iscsi devstack@n-api.service[120740]: DEBUG nova.policy [None req-bd533c36-e3c1-4f33-b126-8e3085ef8348 tempest-AttachVolumeShelveTestJSON-385853788 tempest-AttachVolumeShelveTestJSON-385853788-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e68ecd9b3ca643539b109f75bb242d6f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '75e14fd88bfb4cd896fa7b070a0fac47', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120740) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 18:02:03.719194 dv-cinder-852009-8-iscsi devstack@n-api.service[120740]: DEBUG nova.policy [None req-bd533c36-e3c1-4f33-b126-8e3085ef8348 tempest-AttachVolumeShelveTestJSON-385853788 tempest-AttachVolumeShelveTestJSON-385853788-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'e68ecd9b3ca643539b109f75bb242d6f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '75e14fd88bfb4cd896fa7b070a0fac47', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120740) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 18:02:03.720680 dv-cinder-852009-8-iscsi devstack@n-api.service[120740]: DEBUG nova.policy [None req-bd533c36-e3c1-4f33-b126-8e3085ef8348 tempest-AttachVolumeShelveTestJSON-385853788 tempest-AttachVolumeShelveTestJSON-385853788-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'e68ecd9b3ca643539b109f75bb242d6f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '75e14fd88bfb4cd896fa7b070a0fac47', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120740) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 18:02:03.721786 dv-cinder-852009-8-iscsi devstack@n-api.service[120740]: INFO nova.api.openstack.requestlog [None req-bd533c36-e3c1-4f33-b126-8e3085ef8348 tempest-AttachVolumeShelveTestJSON-385853788 tempest-AttachVolumeShelveTestJSON-385853788-project] 10.222.0.43 "GET /compute/v2.1/servers/11d2616a-96f9-4a7a-aab8-219219986a8b" status: 200 len: 1280 microversion: 2.20 time: 0.444230 Sep 13 18:02:03.730277 dv-cinder-852009-8-iscsi devstack@n-api.service[120740]: [pid: 120740|app: 0|req: 6/10] 10.222.0.43 () {60 vars in 1277 bytes} [Tue Sep 13 18:02:03 2022] GET /compute/v2.1/servers/11d2616a-96f9-4a7a-aab8-219219986a8b => generated 1280 bytes in 455 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 13 18:02:04.019308 dv-cinder-852009-8-iscsi devstack@n-api.service[120741]: DEBUG nova.network.neutron [None req-c8aee345-1ec7-4434-a07c-70c6a6751f05 tempest-AttachVolumeTestJSON-555093534 tempest-AttachVolumeTestJSON-555093534-project] validate_networks() for [('c3ccf009-999c-4527-966f-109321f8fcee', None, None, None, None, None)] {{(pid=120741) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Sep 13 18:02:04.313910 dv-cinder-852009-8-iscsi devstack@n-api.service[120740]: DEBUG nova.api.openstack.wsgi [None req-07efce07-b88c-426b-a327-bd89ae33617d tempest-ServerRescueNegativeTestJSON-412251590 tempest-ServerRescueNegativeTestJSON-412251590-project] Calling method '>' {{(pid=120740) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 18:02:04.319530 dv-cinder-852009-8-iscsi devstack@n-api.service[120740]: DEBUG nova.compute.api [None req-07efce07-b88c-426b-a327-bd89ae33617d tempest-ServerRescueNegativeTestJSON-412251590 tempest-ServerRescueNegativeTestJSON-412251590-project] [instance: 8cd29851-35c1-4032-a137-ab9419a2ec5b] Fetching instance by UUID {{(pid=120740) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 18:02:04.347020 dv-cinder-852009-8-iscsi devstack@n-api.service[120740]: DEBUG oslo_concurrency.lockutils [None req-07efce07-b88c-426b-a327-bd89ae33617d tempest-ServerRescueNegativeTestJSON-412251590 tempest-ServerRescueNegativeTestJSON-412251590-project] Acquiring lock "1daf4f4c-0e4a-4779-b53a-78c48397ea2f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120740) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 18:02:04.355313 dv-cinder-852009-8-iscsi devstack@n-api.service[120740]: DEBUG oslo_concurrency.lockutils [None req-07efce07-b88c-426b-a327-bd89ae33617d tempest-ServerRescueNegativeTestJSON-412251590 tempest-ServerRescueNegativeTestJSON-412251590-project] Lock "1daf4f4c-0e4a-4779-b53a-78c48397ea2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120740) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 18:02:04.358373 dv-cinder-852009-8-iscsi devstack@n-api.service[120740]: DEBUG oslo_concurrency.lockutils [None req-07efce07-b88c-426b-a327-bd89ae33617d tempest-ServerRescueNegativeTestJSON-412251590 tempest-ServerRescueNegativeTestJSON-412251590-project] Lock "1daf4f4c-0e4a-4779-b53a-78c48397ea2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.008s {{(pid=120740) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 18:02:04.370317 dv-cinder-852009-8-iscsi devstack@n-api.service[120740]: DEBUG oslo_concurrency.lockutils [None req-07efce07-b88c-426b-a327-bd89ae33617d tempest-ServerRescueNegativeTestJSON-412251590 tempest-ServerRescueNegativeTestJSON-412251590-project] Acquiring lock "1daf4f4c-0e4a-4779-b53a-78c48397ea2f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120740) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 18:02:04.370945 dv-cinder-852009-8-iscsi devstack@n-api.service[120740]: DEBUG oslo_concurrency.lockutils [None req-07efce07-b88c-426b-a327-bd89ae33617d tempest-ServerRescueNegativeTestJSON-412251590 tempest-ServerRescueNegativeTestJSON-412251590-project] Lock "1daf4f4c-0e4a-4779-b53a-78c48397ea2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.012s {{(pid=120740) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 18:02:04.371398 dv-cinder-852009-8-iscsi devstack@n-api.service[120740]: DEBUG oslo_concurrency.lockutils [None req-07efce07-b88c-426b-a327-bd89ae33617d tempest-ServerRescueNegativeTestJSON-412251590 tempest-ServerRescueNegativeTestJSON-412251590-project] Lock "1daf4f4c-0e4a-4779-b53a-78c48397ea2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120740) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 18:02:04.694555 dv-cinder-852009-8-iscsi devstack@n-api.service[120740]: DEBUG nova.policy [None req-07efce07-b88c-426b-a327-bd89ae33617d tempest-ServerRescueNegativeTestJSON-412251590 tempest-ServerRescueNegativeTestJSON-412251590-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '60800cf2774e409d9c1b6f4992669991', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2eae4acecf6c4961830ead78d71b2ad3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120740) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 18:02:04.721950 dv-cinder-852009-8-iscsi devstack@n-api.service[120740]: INFO nova.api.openstack.requestlog [None req-07efce07-b88c-426b-a327-bd89ae33617d tempest-ServerRescueNegativeTestJSON-412251590 tempest-ServerRescueNegativeTestJSON-412251590-project] 10.222.0.43 "GET /compute/v2.1/servers/8cd29851-35c1-4032-a137-ab9419a2ec5b" status: 200 len: 1280 microversion: 2.1 time: 0.414475 Sep 13 18:02:04.736454 dv-cinder-852009-8-iscsi devstack@n-api.service[120740]: [pid: 120740|app: 0|req: 7/11] 10.222.0.43 () {58 vars in 1236 bytes} [Tue Sep 13 18:02:04 2022] GET /compute/v2.1/servers/8cd29851-35c1-4032-a137-ab9419a2ec5b => generated 1280 bytes in 424 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 13 18:02:04.744722 dv-cinder-852009-8-iscsi devstack@n-api.service[120740]: DEBUG nova.api.openstack.wsgi [None req-52528019-0b5b-4bfe-8f3c-c3e49407d1f5 tempest-DeleteServersTestJSON-1632919649 tempest-DeleteServersTestJSON-1632919649-project] Calling method '>' {{(pid=120740) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 18:02:04.746760 dv-cinder-852009-8-iscsi devstack@n-api.service[120740]: DEBUG nova.compute.api [None req-52528019-0b5b-4bfe-8f3c-c3e49407d1f5 tempest-DeleteServersTestJSON-1632919649 tempest-DeleteServersTestJSON-1632919649-project] [instance: 207d1d8d-58a4-4b99-aa09-1c5023c60784] Fetching instance by UUID {{(pid=120740) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 18:02:04.784387 dv-cinder-852009-8-iscsi devstack@n-api.service[120740]: DEBUG oslo_concurrency.lockutils [None req-52528019-0b5b-4bfe-8f3c-c3e49407d1f5 tempest-DeleteServersTestJSON-1632919649 tempest-DeleteServersTestJSON-1632919649-project] Acquiring lock "1daf4f4c-0e4a-4779-b53a-78c48397ea2f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120740) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 18:02:04.798994 dv-cinder-852009-8-iscsi devstack@n-api.service[120740]: DEBUG oslo_concurrency.lockutils [None req-52528019-0b5b-4bfe-8f3c-c3e49407d1f5 tempest-DeleteServersTestJSON-1632919649 tempest-DeleteServersTestJSON-1632919649-project] Lock "1daf4f4c-0e4a-4779-b53a-78c48397ea2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.014s {{(pid=120740) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 18:02:04.801920 dv-cinder-852009-8-iscsi devstack@n-api.service[120740]: DEBUG oslo_concurrency.lockutils [None req-52528019-0b5b-4bfe-8f3c-c3e49407d1f5 tempest-DeleteServersTestJSON-1632919649 tempest-DeleteServersTestJSON-1632919649-project] Lock "1daf4f4c-0e4a-4779-b53a-78c48397ea2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=120740) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 18:02:04.802985 dv-cinder-852009-8-iscsi devstack@n-api.service[120740]: DEBUG oslo_concurrency.lockutils [None req-52528019-0b5b-4bfe-8f3c-c3e49407d1f5 tempest-DeleteServersTestJSON-1632919649 tempest-DeleteServersTestJSON-1632919649-project] Acquiring lock "1daf4f4c-0e4a-4779-b53a-78c48397ea2f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120740) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 18:02:04.808364 dv-cinder-852009-8-iscsi devstack@n-api.service[120740]: DEBUG oslo_concurrency.lockutils [None req-52528019-0b5b-4bfe-8f3c-c3e49407d1f5 tempest-DeleteServersTestJSON-1632919649 tempest-DeleteServersTestJSON-1632919649-project] Lock "1daf4f4c-0e4a-4779-b53a-78c48397ea2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=120740) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 18:02:04.809366 dv-cinder-852009-8-iscsi devstack@n-api.service[120740]: DEBUG oslo_concurrency.lockutils [None req-52528019-0b5b-4bfe-8f3c-c3e49407d1f5 tempest-DeleteServersTestJSON-1632919649 tempest-DeleteServersTestJSON-1632919649-project] Lock "1daf4f4c-0e4a-4779-b53a-78c48397ea2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120740) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 18:02:05.247140 dv-cinder-852009-8-iscsi devstack@n-api.service[120740]: DEBUG nova.policy [None req-52528019-0b5b-4bfe-8f3c-c3e49407d1f5 tempest-DeleteServersTestJSON-1632919649 tempest-DeleteServersTestJSON-1632919649-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '51db5ef052144879b53979268ac4ceb5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '66136f123f5b4ad0a824920bbdf9d245', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120740) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 18:02:05.265655 dv-cinder-852009-8-iscsi devstack@n-api.service[120740]: INFO nova.api.openstack.requestlog [None req-52528019-0b5b-4bfe-8f3c-c3e49407d1f5 tempest-DeleteServersTestJSON-1632919649 tempest-DeleteServersTestJSON-1632919649-project] 10.222.0.43 "GET /compute/v2.1/servers/207d1d8d-58a4-4b99-aa09-1c5023c60784" status: 200 len: 1267 microversion: 2.1 time: 0.538053 Sep 13 18:02:05.276583 dv-cinder-852009-8-iscsi devstack@n-api.service[120740]: [pid: 120740|app: 0|req: 8/12] 10.222.0.43 () {58 vars in 1236 bytes} [Tue Sep 13 18:02:04 2022] GET /compute/v2.1/servers/207d1d8d-58a4-4b99-aa09-1c5023c60784 => generated 1267 bytes in 542 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 13 18:02:05.297397 dv-cinder-852009-8-iscsi devstack@n-api.service[120740]: DEBUG nova.api.openstack.wsgi [None req-e095e742-37f3-4fe5-9f8b-57c10b054dec tempest-AttachVolumeShelveTestJSON-385853788 tempest-AttachVolumeShelveTestJSON-385853788-project] Calling method '>' {{(pid=120740) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 18:02:05.298739 dv-cinder-852009-8-iscsi devstack@n-api.service[120740]: DEBUG nova.compute.api [None req-e095e742-37f3-4fe5-9f8b-57c10b054dec tempest-AttachVolumeShelveTestJSON-385853788 tempest-AttachVolumeShelveTestJSON-385853788-project] [instance: 11d2616a-96f9-4a7a-aab8-219219986a8b] Fetching instance by UUID {{(pid=120740) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 18:02:05.327150 dv-cinder-852009-8-iscsi devstack@n-api.service[120740]: DEBUG oslo_concurrency.lockutils [None req-e095e742-37f3-4fe5-9f8b-57c10b054dec tempest-AttachVolumeShelveTestJSON-385853788 tempest-AttachVolumeShelveTestJSON-385853788-project] Acquiring lock "1daf4f4c-0e4a-4779-b53a-78c48397ea2f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120740) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 18:02:05.327826 dv-cinder-852009-8-iscsi devstack@n-api.service[120740]: DEBUG oslo_concurrency.lockutils [None req-e095e742-37f3-4fe5-9f8b-57c10b054dec tempest-AttachVolumeShelveTestJSON-385853788 tempest-AttachVolumeShelveTestJSON-385853788-project] Lock "1daf4f4c-0e4a-4779-b53a-78c48397ea2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120740) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 18:02:05.330389 dv-cinder-852009-8-iscsi devstack@n-api.service[120740]: DEBUG oslo_concurrency.lockutils [None req-e095e742-37f3-4fe5-9f8b-57c10b054dec tempest-AttachVolumeShelveTestJSON-385853788 tempest-AttachVolumeShelveTestJSON-385853788-project] Lock "1daf4f4c-0e4a-4779-b53a-78c48397ea2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120740) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 18:02:05.339660 dv-cinder-852009-8-iscsi devstack@n-api.service[120740]: DEBUG oslo_concurrency.lockutils [None req-e095e742-37f3-4fe5-9f8b-57c10b054dec tempest-AttachVolumeShelveTestJSON-385853788 tempest-AttachVolumeShelveTestJSON-385853788-project] Acquiring lock "1daf4f4c-0e4a-4779-b53a-78c48397ea2f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120740) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 18:02:05.343101 dv-cinder-852009-8-iscsi devstack@n-api.service[120740]: DEBUG oslo_concurrency.lockutils [None req-e095e742-37f3-4fe5-9f8b-57c10b054dec tempest-AttachVolumeShelveTestJSON-385853788 tempest-AttachVolumeShelveTestJSON-385853788-project] Lock "1daf4f4c-0e4a-4779-b53a-78c48397ea2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.007s {{(pid=120740) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 18:02:05.343886 dv-cinder-852009-8-iscsi devstack@n-api.service[120740]: DEBUG oslo_concurrency.lockutils [None req-e095e742-37f3-4fe5-9f8b-57c10b054dec tempest-AttachVolumeShelveTestJSON-385853788 tempest-AttachVolumeShelveTestJSON-385853788-project] Lock "1daf4f4c-0e4a-4779-b53a-78c48397ea2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=120740) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 18:02:05.860527 dv-cinder-852009-8-iscsi devstack@n-api.service[120741]: DEBUG nova.virt.hardware [None req-c8aee345-1ec7-4434-a07c-70c6a6751f05 tempest-AttachVolumeTestJSON-555093534 tempest-AttachVolumeTestJSON-555093534-project] Flavor limits 0:0:0 {{(pid=120741) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Sep 13 18:02:05.861168 dv-cinder-852009-8-iscsi devstack@n-api.service[120741]: DEBUG nova.virt.hardware [None req-c8aee345-1ec7-4434-a07c-70c6a6751f05 tempest-AttachVolumeTestJSON-555093534 tempest-AttachVolumeTestJSON-555093534-project] Image limits 0:0:0 {{(pid=120741) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Sep 13 18:02:05.861467 dv-cinder-852009-8-iscsi devstack@n-api.service[120741]: DEBUG nova.virt.hardware [None req-c8aee345-1ec7-4434-a07c-70c6a6751f05 tempest-AttachVolumeTestJSON-555093534 tempest-AttachVolumeTestJSON-555093534-project] Flavor pref 0:0:0 {{(pid=120741) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Sep 13 18:02:05.862241 dv-cinder-852009-8-iscsi devstack@n-api.service[120741]: DEBUG nova.virt.hardware [None req-c8aee345-1ec7-4434-a07c-70c6a6751f05 tempest-AttachVolumeTestJSON-555093534 tempest-AttachVolumeTestJSON-555093534-project] Image pref 0:0:0 {{(pid=120741) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Sep 13 18:02:05.863088 dv-cinder-852009-8-iscsi devstack@n-api.service[120741]: DEBUG nova.virt.hardware [None req-c8aee345-1ec7-4434-a07c-70c6a6751f05 tempest-AttachVolumeTestJSON-555093534 tempest-AttachVolumeTestJSON-555093534-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=120741) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Sep 13 18:02:05.880813 dv-cinder-852009-8-iscsi devstack@n-api.service[120741]: DEBUG oslo_concurrency.lockutils [None req-c8aee345-1ec7-4434-a07c-70c6a6751f05 tempest-AttachVolumeTestJSON-555093534 tempest-AttachVolumeTestJSON-555093534-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120741) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 18:02:05.884322 dv-cinder-852009-8-iscsi devstack@n-api.service[120741]: DEBUG oslo_concurrency.lockutils [None req-c8aee345-1ec7-4434-a07c-70c6a6751f05 tempest-AttachVolumeTestJSON-555093534 tempest-AttachVolumeTestJSON-555093534-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=120741) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 18:02:05.885232 dv-cinder-852009-8-iscsi devstack@n-api.service[120741]: DEBUG oslo_concurrency.lockutils [None req-c8aee345-1ec7-4434-a07c-70c6a6751f05 tempest-AttachVolumeTestJSON-555093534 tempest-AttachVolumeTestJSON-555093534-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120741) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 18:02:05.886308 dv-cinder-852009-8-iscsi devstack@n-api.service[120741]: DEBUG oslo_concurrency.lockutils [None req-c8aee345-1ec7-4434-a07c-70c6a6751f05 tempest-AttachVolumeTestJSON-555093534 tempest-AttachVolumeTestJSON-555093534-project] Acquiring lock "1daf4f4c-0e4a-4779-b53a-78c48397ea2f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120741) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 18:02:05.889120 dv-cinder-852009-8-iscsi devstack@n-api.service[120741]: DEBUG oslo_concurrency.lockutils [None req-c8aee345-1ec7-4434-a07c-70c6a6751f05 tempest-AttachVolumeTestJSON-555093534 tempest-AttachVolumeTestJSON-555093534-project] Lock "1daf4f4c-0e4a-4779-b53a-78c48397ea2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120741) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 18:02:05.889791 dv-cinder-852009-8-iscsi devstack@n-api.service[120741]: DEBUG oslo_concurrency.lockutils [None req-c8aee345-1ec7-4434-a07c-70c6a6751f05 tempest-AttachVolumeTestJSON-555093534 tempest-AttachVolumeTestJSON-555093534-project] Lock "1daf4f4c-0e4a-4779-b53a-78c48397ea2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120741) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 18:02:05.929746 dv-cinder-852009-8-iscsi devstack@n-api.service[120740]: DEBUG nova.policy [None req-e095e742-37f3-4fe5-9f8b-57c10b054dec tempest-AttachVolumeShelveTestJSON-385853788 tempest-AttachVolumeShelveTestJSON-385853788-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e68ecd9b3ca643539b109f75bb242d6f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '75e14fd88bfb4cd896fa7b070a0fac47', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120740) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 18:02:05.943287 dv-cinder-852009-8-iscsi devstack@n-api.service[120741]: DEBUG nova.quota [None req-c8aee345-1ec7-4434-a07c-70c6a6751f05 tempest-AttachVolumeTestJSON-555093534 tempest-AttachVolumeTestJSON-555093534-project] Getting quotas for project a279fcbf274c4704a31a2b95061e1469. Resources: {'cores', 'ram', 'instances'} {{(pid=120741) _get_quotas /opt/stack/nova/nova/quota.py:393}} Sep 13 18:02:05.949658 dv-cinder-852009-8-iscsi devstack@n-api.service[120741]: DEBUG nova.quota [None req-c8aee345-1ec7-4434-a07c-70c6a6751f05 tempest-AttachVolumeTestJSON-555093534 tempest-AttachVolumeTestJSON-555093534-project] Getting quotas for user 0625b3113ce044bbac4f6142eaade11c and project a279fcbf274c4704a31a2b95061e1469. Resources: {'cores', 'ram', 'instances'} {{(pid=120741) _get_quotas /opt/stack/nova/nova/quota.py:383}} Sep 13 18:02:05.950497 dv-cinder-852009-8-iscsi devstack@n-api.service[120740]: DEBUG nova.policy [None req-e095e742-37f3-4fe5-9f8b-57c10b054dec tempest-AttachVolumeShelveTestJSON-385853788 tempest-AttachVolumeShelveTestJSON-385853788-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'e68ecd9b3ca643539b109f75bb242d6f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '75e14fd88bfb4cd896fa7b070a0fac47', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120740) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 18:02:05.960339 dv-cinder-852009-8-iscsi devstack@n-api.service[120740]: DEBUG nova.policy [None req-e095e742-37f3-4fe5-9f8b-57c10b054dec tempest-AttachVolumeShelveTestJSON-385853788 tempest-AttachVolumeShelveTestJSON-385853788-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'e68ecd9b3ca643539b109f75bb242d6f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '75e14fd88bfb4cd896fa7b070a0fac47', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120740) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 18:02:05.965421 dv-cinder-852009-8-iscsi devstack@n-api.service[120741]: DEBUG nova.compute.api [None req-c8aee345-1ec7-4434-a07c-70c6a6751f05 tempest-AttachVolumeTestJSON-555093534 tempest-AttachVolumeTestJSON-555093534-project] Going to run 1 instances... {{(pid=120741) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Sep 13 18:02:05.968564 dv-cinder-852009-8-iscsi devstack@n-api.service[120740]: INFO nova.api.openstack.requestlog [None req-e095e742-37f3-4fe5-9f8b-57c10b054dec tempest-AttachVolumeShelveTestJSON-385853788 tempest-AttachVolumeShelveTestJSON-385853788-project] 10.222.0.43 "GET /compute/v2.1/servers/11d2616a-96f9-4a7a-aab8-219219986a8b" status: 200 len: 1276 microversion: 2.20 time: 0.693863 Sep 13 18:02:05.968851 dv-cinder-852009-8-iscsi devstack@n-api.service[120741]: DEBUG nova.compute.api [None req-c8aee345-1ec7-4434-a07c-70c6a6751f05 tempest-AttachVolumeTestJSON-555093534 tempest-AttachVolumeTestJSON-555093534-project] [instance: b958d409-df20-44c6-aa0e-58cb0a482edf] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='33034e36-e6b2-4847-92a1-ff3188c05a4a',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=120741) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Sep 13 18:02:05.974182 dv-cinder-852009-8-iscsi devstack@n-api.service[120740]: [pid: 120740|app: 0|req: 9/13] 10.222.0.43 () {60 vars in 1277 bytes} [Tue Sep 13 18:02:05 2022] GET /compute/v2.1/servers/11d2616a-96f9-4a7a-aab8-219219986a8b => generated 1276 bytes in 705 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 13 18:02:05.995541 dv-cinder-852009-8-iscsi devstack@n-api.service[120740]: DEBUG nova.api.openstack.wsgi [None req-e83ecd4a-9266-476a-9626-ae3139ef720b tempest-ServerRescueNegativeTestJSON-412251590 tempest-ServerRescueNegativeTestJSON-412251590-project] Calling method '>' {{(pid=120740) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 18:02:05.996155 dv-cinder-852009-8-iscsi devstack@n-api.service[120740]: DEBUG nova.compute.api [None req-e83ecd4a-9266-476a-9626-ae3139ef720b tempest-ServerRescueNegativeTestJSON-412251590 tempest-ServerRescueNegativeTestJSON-412251590-project] [instance: 8cd29851-35c1-4032-a137-ab9419a2ec5b] Fetching instance by UUID {{(pid=120740) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 18:02:06.029431 dv-cinder-852009-8-iscsi devstack@n-api.service[120740]: DEBUG oslo_concurrency.lockutils [None req-e83ecd4a-9266-476a-9626-ae3139ef720b tempest-ServerRescueNegativeTestJSON-412251590 tempest-ServerRescueNegativeTestJSON-412251590-project] Acquiring lock "1daf4f4c-0e4a-4779-b53a-78c48397ea2f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120740) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 18:02:06.034510 dv-cinder-852009-8-iscsi devstack@n-api.service[120740]: DEBUG oslo_concurrency.lockutils [None req-e83ecd4a-9266-476a-9626-ae3139ef720b tempest-ServerRescueNegativeTestJSON-412251590 tempest-ServerRescueNegativeTestJSON-412251590-project] Lock "1daf4f4c-0e4a-4779-b53a-78c48397ea2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120740) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 18:02:06.035562 dv-cinder-852009-8-iscsi devstack@n-api.service[120740]: DEBUG oslo_concurrency.lockutils [None req-e83ecd4a-9266-476a-9626-ae3139ef720b tempest-ServerRescueNegativeTestJSON-412251590 tempest-ServerRescueNegativeTestJSON-412251590-project] Lock "1daf4f4c-0e4a-4779-b53a-78c48397ea2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=120740) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 18:02:06.045489 dv-cinder-852009-8-iscsi devstack@n-api.service[120740]: DEBUG oslo_concurrency.lockutils [None req-e83ecd4a-9266-476a-9626-ae3139ef720b tempest-ServerRescueNegativeTestJSON-412251590 tempest-ServerRescueNegativeTestJSON-412251590-project] Acquiring lock "1daf4f4c-0e4a-4779-b53a-78c48397ea2f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120740) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 18:02:06.048788 dv-cinder-852009-8-iscsi devstack@n-api.service[120740]: DEBUG oslo_concurrency.lockutils [None req-e83ecd4a-9266-476a-9626-ae3139ef720b tempest-ServerRescueNegativeTestJSON-412251590 tempest-ServerRescueNegativeTestJSON-412251590-project] Lock "1daf4f4c-0e4a-4779-b53a-78c48397ea2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=120740) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 18:02:06.056229 dv-cinder-852009-8-iscsi devstack@n-api.service[120740]: DEBUG oslo_concurrency.lockutils [None req-e83ecd4a-9266-476a-9626-ae3139ef720b tempest-ServerRescueNegativeTestJSON-412251590 tempest-ServerRescueNegativeTestJSON-412251590-project] Lock "1daf4f4c-0e4a-4779-b53a-78c48397ea2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=120740) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 18:02:06.153488 dv-cinder-852009-8-iscsi devstack@n-api.service[120741]: INFO nova.api.openstack.requestlog [None req-c8aee345-1ec7-4434-a07c-70c6a6751f05 tempest-AttachVolumeTestJSON-555093534 tempest-AttachVolumeTestJSON-555093534-project] 10.222.0.43 "POST /compute/v2.1/servers" status: 202 len: 400 microversion: 2.1 time: 2.857274 Sep 13 18:02:06.172727 dv-cinder-852009-8-iscsi devstack@n-api.service[120741]: [pid: 120741|app: 0|req: 5/14] 10.222.0.43 () {60 vars in 1147 bytes} [Tue Sep 13 18:02:03 2022] POST /compute/v2.1/servers => generated 400 bytes in 2877 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Sep 13 18:02:06.190210 dv-cinder-852009-8-iscsi devstack@n-api.service[120741]: DEBUG nova.api.openstack.wsgi [None req-d17e2d17-cedd-4844-aa9a-fb74f1ee91ab tempest-AttachVolumeTestJSON-555093534 tempest-AttachVolumeTestJSON-555093534-project] Calling method '>' {{(pid=120741) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 18:02:06.194195 dv-cinder-852009-8-iscsi devstack@n-api.service[120741]: DEBUG nova.compute.api [None req-d17e2d17-cedd-4844-aa9a-fb74f1ee91ab tempest-AttachVolumeTestJSON-555093534 tempest-AttachVolumeTestJSON-555093534-project] [instance: b958d409-df20-44c6-aa0e-58cb0a482edf] Fetching instance by UUID {{(pid=120741) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 18:02:06.606952 dv-cinder-852009-8-iscsi devstack@n-api.service[120741]: DEBUG nova.policy [None req-d17e2d17-cedd-4844-aa9a-fb74f1ee91ab tempest-AttachVolumeTestJSON-555093534 tempest-AttachVolumeTestJSON-555093534-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0625b3113ce044bbac4f6142eaade11c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a279fcbf274c4704a31a2b95061e1469', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120741) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 18:02:06.615286 dv-cinder-852009-8-iscsi devstack@n-api.service[120741]: INFO nova.api.openstack.requestlog [None req-d17e2d17-cedd-4844-aa9a-fb74f1ee91ab tempest-AttachVolumeTestJSON-555093534 tempest-AttachVolumeTestJSON-555093534-project] 10.222.0.43 "GET /compute/v2.1/servers/b958d409-df20-44c6-aa0e-58cb0a482edf" status: 200 len: 1238 microversion: 2.1 time: 0.440032 Sep 13 18:02:06.619124 dv-cinder-852009-8-iscsi devstack@n-api.service[120740]: DEBUG nova.policy [None req-e83ecd4a-9266-476a-9626-ae3139ef720b tempest-ServerRescueNegativeTestJSON-412251590 tempest-ServerRescueNegativeTestJSON-412251590-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '60800cf2774e409d9c1b6f4992669991', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2eae4acecf6c4961830ead78d71b2ad3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120740) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 18:02:06.628794 dv-cinder-852009-8-iscsi devstack@n-api.service[120740]: INFO nova.api.openstack.requestlog [None req-e83ecd4a-9266-476a-9626-ae3139ef720b tempest-ServerRescueNegativeTestJSON-412251590 tempest-ServerRescueNegativeTestJSON-412251590-project] 10.222.0.43 "GET /compute/v2.1/servers/8cd29851-35c1-4032-a137-ab9419a2ec5b" status: 200 len: 1280 microversion: 2.1 time: 0.653406 Sep 13 18:02:06.634740 dv-cinder-852009-8-iscsi devstack@n-api.service[120740]: [pid: 120740|app: 0|req: 10/16] 10.222.0.43 () {58 vars in 1236 bytes} [Tue Sep 13 18:02:05 2022] GET /compute/v2.1/servers/8cd29851-35c1-4032-a137-ab9419a2ec5b => generated 1280 bytes in 660 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 13 18:02:06.635290 dv-cinder-852009-8-iscsi devstack@n-api.service[120741]: [pid: 120741|app: 0|req: 6/16] 10.222.0.43 () {58 vars in 1236 bytes} [Tue Sep 13 18:02:06 2022] GET /compute/v2.1/servers/b958d409-df20-44c6-aa0e-58cb0a482edf => generated 1238 bytes in 442 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 13 18:02:06.651525 dv-cinder-852009-8-iscsi devstack@n-api.service[120740]: DEBUG nova.api.openstack.wsgi [None req-3f3c4fae-275b-472a-a6af-608dd2c3d023 tempest-DeleteServersTestJSON-1632919649 tempest-DeleteServersTestJSON-1632919649-project] Calling method '>' {{(pid=120740) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 18:02:06.652256 dv-cinder-852009-8-iscsi devstack@n-api.service[120740]: DEBUG nova.compute.api [None req-3f3c4fae-275b-472a-a6af-608dd2c3d023 tempest-DeleteServersTestJSON-1632919649 tempest-DeleteServersTestJSON-1632919649-project] [instance: 207d1d8d-58a4-4b99-aa09-1c5023c60784] Fetching instance by UUID {{(pid=120740) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 18:02:06.676982 dv-cinder-852009-8-iscsi devstack@n-api.service[120740]: DEBUG oslo_concurrency.lockutils [None req-3f3c4fae-275b-472a-a6af-608dd2c3d023 tempest-DeleteServersTestJSON-1632919649 tempest-DeleteServersTestJSON-1632919649-project] Acquiring lock "1daf4f4c-0e4a-4779-b53a-78c48397ea2f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120740) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 18:02:06.678075 dv-cinder-852009-8-iscsi devstack@n-api.service[120740]: DEBUG oslo_concurrency.lockutils [None req-3f3c4fae-275b-472a-a6af-608dd2c3d023 tempest-DeleteServersTestJSON-1632919649 tempest-DeleteServersTestJSON-1632919649-project] Lock "1daf4f4c-0e4a-4779-b53a-78c48397ea2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.011s {{(pid=120740) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 18:02:06.678545 dv-cinder-852009-8-iscsi devstack@n-api.service[120740]: DEBUG oslo_concurrency.lockutils [None req-3f3c4fae-275b-472a-a6af-608dd2c3d023 tempest-DeleteServersTestJSON-1632919649 tempest-DeleteServersTestJSON-1632919649-project] Lock "1daf4f4c-0e4a-4779-b53a-78c48397ea2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120740) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 18:02:06.679322 dv-cinder-852009-8-iscsi devstack@n-api.service[120740]: DEBUG oslo_concurrency.lockutils [None req-3f3c4fae-275b-472a-a6af-608dd2c3d023 tempest-DeleteServersTestJSON-1632919649 tempest-DeleteServersTestJSON-1632919649-project] Acquiring lock "1daf4f4c-0e4a-4779-b53a-78c48397ea2f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120740) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 18:02:06.679755 dv-cinder-852009-8-iscsi devstack@n-api.service[120740]: DEBUG oslo_concurrency.lockutils [None req-3f3c4fae-275b-472a-a6af-608dd2c3d023 tempest-DeleteServersTestJSON-1632919649 tempest-DeleteServersTestJSON-1632919649-project] Lock "1daf4f4c-0e4a-4779-b53a-78c48397ea2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120740) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 18:02:06.680196 dv-cinder-852009-8-iscsi devstack@n-api.service[120740]: DEBUG oslo_concurrency.lockutils [None req-3f3c4fae-275b-472a-a6af-608dd2c3d023 tempest-DeleteServersTestJSON-1632919649 tempest-DeleteServersTestJSON-1632919649-project] Lock "1daf4f4c-0e4a-4779-b53a-78c48397ea2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120740) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 18:02:06.995926 dv-cinder-852009-8-iscsi devstack@n-api.service[120741]: DEBUG nova.api.openstack.wsgi [None req-ab55b10b-5845-475e-809c-40428d2da9ab tempest-AttachVolumeShelveTestJSON-385853788 tempest-AttachVolumeShelveTestJSON-385853788-project] Calling method '>' {{(pid=120741) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 18:02:06.997572 dv-cinder-852009-8-iscsi devstack@n-api.service[120741]: DEBUG nova.compute.api [None req-ab55b10b-5845-475e-809c-40428d2da9ab tempest-AttachVolumeShelveTestJSON-385853788 tempest-AttachVolumeShelveTestJSON-385853788-project] [instance: 11d2616a-96f9-4a7a-aab8-219219986a8b] Fetching instance by UUID {{(pid=120741) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 18:02:06.999196 dv-cinder-852009-8-iscsi devstack@n-api.service[120740]: DEBUG nova.policy [None req-3f3c4fae-275b-472a-a6af-608dd2c3d023 tempest-DeleteServersTestJSON-1632919649 tempest-DeleteServersTestJSON-1632919649-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '51db5ef052144879b53979268ac4ceb5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '66136f123f5b4ad0a824920bbdf9d245', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120740) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 18:02:07.008609 dv-cinder-852009-8-iscsi devstack@n-api.service[120741]: DEBUG oslo_concurrency.lockutils [None req-ab55b10b-5845-475e-809c-40428d2da9ab tempest-AttachVolumeShelveTestJSON-385853788 tempest-AttachVolumeShelveTestJSON-385853788-project] Acquiring lock "1daf4f4c-0e4a-4779-b53a-78c48397ea2f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120741) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 18:02:07.010731 dv-cinder-852009-8-iscsi devstack@n-api.service[120741]: DEBUG oslo_concurrency.lockutils [None req-ab55b10b-5845-475e-809c-40428d2da9ab tempest-AttachVolumeShelveTestJSON-385853788 tempest-AttachVolumeShelveTestJSON-385853788-project] Lock "1daf4f4c-0e4a-4779-b53a-78c48397ea2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120741) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 18:02:07.011419 dv-cinder-852009-8-iscsi devstack@n-api.service[120741]: DEBUG oslo_concurrency.lockutils [None req-ab55b10b-5845-475e-809c-40428d2da9ab tempest-AttachVolumeShelveTestJSON-385853788 tempest-AttachVolumeShelveTestJSON-385853788-project] Lock "1daf4f4c-0e4a-4779-b53a-78c48397ea2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120741) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 18:02:07.011524 dv-cinder-852009-8-iscsi devstack@n-api.service[120740]: INFO nova.api.openstack.requestlog [None req-3f3c4fae-275b-472a-a6af-608dd2c3d023 tempest-DeleteServersTestJSON-1632919649 tempest-DeleteServersTestJSON-1632919649-project] 10.222.0.43 "GET /compute/v2.1/servers/207d1d8d-58a4-4b99-aa09-1c5023c60784" status: 200 len: 1273 microversion: 2.1 time: 0.375496 Sep 13 18:02:07.012068 dv-cinder-852009-8-iscsi devstack@n-api.service[120740]: [pid: 120740|app: 0|req: 11/17] 10.222.0.43 () {58 vars in 1236 bytes} [Tue Sep 13 18:02:06 2022] GET /compute/v2.1/servers/207d1d8d-58a4-4b99-aa09-1c5023c60784 => generated 1273 bytes in 377 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 13 18:02:07.013762 dv-cinder-852009-8-iscsi devstack@n-api.service[120741]: DEBUG oslo_concurrency.lockutils [None req-ab55b10b-5845-475e-809c-40428d2da9ab tempest-AttachVolumeShelveTestJSON-385853788 tempest-AttachVolumeShelveTestJSON-385853788-project] Acquiring lock "1daf4f4c-0e4a-4779-b53a-78c48397ea2f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120741) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 18:02:07.015189 dv-cinder-852009-8-iscsi devstack@n-api.service[120741]: DEBUG oslo_concurrency.lockutils [None req-ab55b10b-5845-475e-809c-40428d2da9ab tempest-AttachVolumeShelveTestJSON-385853788 tempest-AttachVolumeShelveTestJSON-385853788-project] Lock "1daf4f4c-0e4a-4779-b53a-78c48397ea2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120741) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 18:02:07.016839 dv-cinder-852009-8-iscsi devstack@n-api.service[120741]: DEBUG oslo_concurrency.lockutils [None req-ab55b10b-5845-475e-809c-40428d2da9ab tempest-AttachVolumeShelveTestJSON-385853788 tempest-AttachVolumeShelveTestJSON-385853788-project] Lock "1daf4f4c-0e4a-4779-b53a-78c48397ea2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120741) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 18:02:07.639922 dv-cinder-852009-8-iscsi devstack@n-api.service[120740]: DEBUG nova.api.openstack.wsgi [None req-a1ca01ce-8e53-487c-a8a6-560bec114f90 tempest-AttachVolumeTestJSON-555093534 tempest-AttachVolumeTestJSON-555093534-project] Calling method '>' {{(pid=120740) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 18:02:07.640733 dv-cinder-852009-8-iscsi devstack@n-api.service[120740]: DEBUG nova.compute.api [None req-a1ca01ce-8e53-487c-a8a6-560bec114f90 tempest-AttachVolumeTestJSON-555093534 tempest-AttachVolumeTestJSON-555093534-project] [instance: b958d409-df20-44c6-aa0e-58cb0a482edf] Fetching instance by UUID {{(pid=120740) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 18:02:07.660665 dv-cinder-852009-8-iscsi devstack@n-api.service[120740]: DEBUG oslo_concurrency.lockutils [None req-a1ca01ce-8e53-487c-a8a6-560bec114f90 tempest-AttachVolumeTestJSON-555093534 tempest-AttachVolumeTestJSON-555093534-project] Acquiring lock "1daf4f4c-0e4a-4779-b53a-78c48397ea2f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120740) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 18:02:07.663728 dv-cinder-852009-8-iscsi devstack@n-api.service[120740]: DEBUG oslo_concurrency.lockutils [None req-a1ca01ce-8e53-487c-a8a6-560bec114f90 tempest-AttachVolumeTestJSON-555093534 tempest-AttachVolumeTestJSON-555093534-project] Lock "1daf4f4c-0e4a-4779-b53a-78c48397ea2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.011s {{(pid=120740) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 18:02:07.664317 dv-cinder-852009-8-iscsi devstack@n-api.service[120740]: DEBUG oslo_concurrency.lockutils [None req-a1ca01ce-8e53-487c-a8a6-560bec114f90 tempest-AttachVolumeTestJSON-555093534 tempest-AttachVolumeTestJSON-555093534-project] Lock "1daf4f4c-0e4a-4779-b53a-78c48397ea2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120740) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 18:02:07.665319 dv-cinder-852009-8-iscsi devstack@n-api.service[120740]: DEBUG oslo_concurrency.lockutils [None req-a1ca01ce-8e53-487c-a8a6-560bec114f90 tempest-AttachVolumeTestJSON-555093534 tempest-AttachVolumeTestJSON-555093534-project] Acquiring lock "1daf4f4c-0e4a-4779-b53a-78c48397ea2f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120740) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 18:02:07.668872 dv-cinder-852009-8-iscsi devstack@n-api.service[120740]: DEBUG oslo_concurrency.lockutils [None req-a1ca01ce-8e53-487c-a8a6-560bec114f90 tempest-AttachVolumeTestJSON-555093534 tempest-AttachVolumeTestJSON-555093534-project] Lock "1daf4f4c-0e4a-4779-b53a-78c48397ea2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120740) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 18:02:07.670170 dv-cinder-852009-8-iscsi devstack@n-api.service[120740]: DEBUG oslo_concurrency.lockutils [None req-a1ca01ce-8e53-487c-a8a6-560bec114f90 tempest-AttachVolumeTestJSON-555093534 tempest-AttachVolumeTestJSON-555093534-project] Lock "1daf4f4c-0e4a-4779-b53a-78c48397ea2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120740) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 18:02:08.736493 dv-cinder-852009-8-iscsi devstack@n-api.service[120740]: DEBUG nova.policy [None req-a1ca01ce-8e53-487c-a8a6-560bec114f90 tempest-AttachVolumeTestJSON-555093534 tempest-AttachVolumeTestJSON-555093534-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0625b3113ce044bbac4f6142eaade11c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a279fcbf274c4704a31a2b95061e1469', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120740) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 18:02:08.748026 dv-cinder-852009-8-iscsi devstack@n-api.service[120740]: INFO nova.api.openstack.requestlog [None req-a1ca01ce-8e53-487c-a8a6-560bec114f90 tempest-AttachVolumeTestJSON-555093534 tempest-AttachVolumeTestJSON-555093534-project] 10.222.0.43 "GET /compute/v2.1/servers/b958d409-df20-44c6-aa0e-58cb0a482edf" status: 200 len: 1242 microversion: 2.1 time: 1.112370 Sep 13 18:02:08.752368 dv-cinder-852009-8-iscsi devstack@n-api.service[120740]: [pid: 120740|app: 0|req: 12/18] 10.222.0.43 () {58 vars in 1236 bytes} [Tue Sep 13 18:02:07 2022] GET /compute/v2.1/servers/b958d409-df20-44c6-aa0e-58cb0a482edf => generated 1242 bytes in 1117 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 13 18:02:08.765678 dv-cinder-852009-8-iscsi devstack@n-api.service[120740]: DEBUG nova.api.openstack.wsgi [None req-e6b62283-17ed-497f-aac7-58891bbbeca5 tempest-ServerRescueNegativeTestJSON-412251590 tempest-ServerRescueNegativeTestJSON-412251590-project] Calling method '>' {{(pid=120740) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 18:02:08.771988 dv-cinder-852009-8-iscsi devstack@n-api.service[120740]: DEBUG nova.compute.api [None req-e6b62283-17ed-497f-aac7-58891bbbeca5 tempest-ServerRescueNegativeTestJSON-412251590 tempest-ServerRescueNegativeTestJSON-412251590-project] [instance: 8cd29851-35c1-4032-a137-ab9419a2ec5b] Fetching instance by UUID {{(pid=120740) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 18:02:08.807334 dv-cinder-852009-8-iscsi devstack@n-api.service[120740]: DEBUG oslo_concurrency.lockutils [None req-e6b62283-17ed-497f-aac7-58891bbbeca5 tempest-ServerRescueNegativeTestJSON-412251590 tempest-ServerRescueNegativeTestJSON-412251590-project] Acquiring lock "1daf4f4c-0e4a-4779-b53a-78c48397ea2f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120740) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 18:02:08.808969 dv-cinder-852009-8-iscsi devstack@n-api.service[120740]: DEBUG oslo_concurrency.lockutils [None req-e6b62283-17ed-497f-aac7-58891bbbeca5 tempest-ServerRescueNegativeTestJSON-412251590 tempest-ServerRescueNegativeTestJSON-412251590-project] Lock "1daf4f4c-0e4a-4779-b53a-78c48397ea2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=120740) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 18:02:08.810928 dv-cinder-852009-8-iscsi devstack@n-api.service[120740]: DEBUG oslo_concurrency.lockutils [None req-e6b62283-17ed-497f-aac7-58891bbbeca5 tempest-ServerRescueNegativeTestJSON-412251590 tempest-ServerRescueNegativeTestJSON-412251590-project] Lock "1daf4f4c-0e4a-4779-b53a-78c48397ea2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120740) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 18:02:08.811910 dv-cinder-852009-8-iscsi devstack@n-api.service[120740]: DEBUG oslo_concurrency.lockutils [None req-e6b62283-17ed-497f-aac7-58891bbbeca5 tempest-ServerRescueNegativeTestJSON-412251590 tempest-ServerRescueNegativeTestJSON-412251590-project] Acquiring lock "1daf4f4c-0e4a-4779-b53a-78c48397ea2f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120740) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 18:02:08.815084 dv-cinder-852009-8-iscsi devstack@n-api.service[120740]: DEBUG oslo_concurrency.lockutils [None req-e6b62283-17ed-497f-aac7-58891bbbeca5 tempest-ServerRescueNegativeTestJSON-412251590 tempest-ServerRescueNegativeTestJSON-412251590-project] Lock "1daf4f4c-0e4a-4779-b53a-78c48397ea2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120740) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 18:02:08.817382 dv-cinder-852009-8-iscsi devstack@n-api.service[120740]: DEBUG oslo_concurrency.lockutils [None req-e6b62283-17ed-497f-aac7-58891bbbeca5 tempest-ServerRescueNegativeTestJSON-412251590 tempest-ServerRescueNegativeTestJSON-412251590-project] Lock "1daf4f4c-0e4a-4779-b53a-78c48397ea2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120740) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 18:02:08.952893 dv-cinder-852009-8-iscsi devstack@n-api.service[120741]: DEBUG nova.policy [None req-ab55b10b-5845-475e-809c-40428d2da9ab tempest-AttachVolumeShelveTestJSON-385853788 tempest-AttachVolumeShelveTestJSON-385853788-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e68ecd9b3ca643539b109f75bb242d6f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '75e14fd88bfb4cd896fa7b070a0fac47', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120741) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 18:02:08.998371 dv-cinder-852009-8-iscsi devstack@n-api.service[120741]: DEBUG nova.policy [None req-ab55b10b-5845-475e-809c-40428d2da9ab tempest-AttachVolumeShelveTestJSON-385853788 tempest-AttachVolumeShelveTestJSON-385853788-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'e68ecd9b3ca643539b109f75bb242d6f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '75e14fd88bfb4cd896fa7b070a0fac47', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120741) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 18:02:09.006041 dv-cinder-852009-8-iscsi devstack@n-api.service[120741]: DEBUG nova.policy [None req-ab55b10b-5845-475e-809c-40428d2da9ab tempest-AttachVolumeShelveTestJSON-385853788 tempest-AttachVolumeShelveTestJSON-385853788-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'e68ecd9b3ca643539b109f75bb242d6f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '75e14fd88bfb4cd896fa7b070a0fac47', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120741) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 18:02:09.010631 dv-cinder-852009-8-iscsi devstack@n-api.service[120741]: INFO nova.api.openstack.requestlog [None req-ab55b10b-5845-475e-809c-40428d2da9ab tempest-AttachVolumeShelveTestJSON-385853788 tempest-AttachVolumeShelveTestJSON-385853788-project] 10.222.0.43 "GET /compute/v2.1/servers/11d2616a-96f9-4a7a-aab8-219219986a8b" status: 200 len: 1332 microversion: 2.20 time: 2.019636 Sep 13 18:02:09.017675 dv-cinder-852009-8-iscsi devstack@n-api.service[120741]: [pid: 120741|app: 0|req: 7/19] 10.222.0.43 () {60 vars in 1277 bytes} [Tue Sep 13 18:02:06 2022] GET /compute/v2.1/servers/11d2616a-96f9-4a7a-aab8-219219986a8b => generated 1332 bytes in 2028 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Sep 13 18:02:09.047953 dv-cinder-852009-8-iscsi devstack@n-api.service[120741]: DEBUG nova.api.openstack.wsgi [None req-d54cf5ee-6159-46c2-b18b-a9db0f718fc7 tempest-DeleteServersTestJSON-1632919649 tempest-DeleteServersTestJSON-1632919649-project] Calling method '>' {{(pid=120741) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 18:02:09.050267 dv-cinder-852009-8-iscsi devstack@n-api.service[120741]: DEBUG nova.compute.api [None req-d54cf5ee-6159-46c2-b18b-a9db0f718fc7 tempest-DeleteServersTestJSON-1632919649 tempest-DeleteServersTestJSON-1632919649-project] [instance: 207d1d8d-58a4-4b99-aa09-1c5023c60784] Fetching instance by UUID {{(pid=120741) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 18:02:09.088348 dv-cinder-852009-8-iscsi devstack@n-api.service[120741]: DEBUG oslo_concurrency.lockutils [None req-d54cf5ee-6159-46c2-b18b-a9db0f718fc7 tempest-DeleteServersTestJSON-1632919649 tempest-DeleteServersTestJSON-1632919649-project] Acquiring lock "1daf4f4c-0e4a-4779-b53a-78c48397ea2f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120741) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 18:02:09.089028 dv-cinder-852009-8-iscsi devstack@n-api.service[120741]: DEBUG oslo_concurrency.lockutils [None req-d54cf5ee-6159-46c2-b18b-a9db0f718fc7 tempest-DeleteServersTestJSON-1632919649 tempest-DeleteServersTestJSON-1632919649-project] Lock "1daf4f4c-0e4a-4779-b53a-78c48397ea2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.008s {{(pid=120741) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 18:02:09.089482 dv-cinder-852009-8-iscsi devstack@n-api.service[120741]: DEBUG oslo_concurrency.lockutils [None req-d54cf5ee-6159-46c2-b18b-a9db0f718fc7 tempest-DeleteServersTestJSON-1632919649 tempest-DeleteServersTestJSON-1632919649-project] Lock "1daf4f4c-0e4a-4779-b53a-78c48397ea2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120741) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 18:02:09.090237 dv-cinder-852009-8-iscsi devstack@n-api.service[120741]: DEBUG oslo_concurrency.lockutils [None req-d54cf5ee-6159-46c2-b18b-a9db0f718fc7 tempest-DeleteServersTestJSON-1632919649 tempest-DeleteServersTestJSON-1632919649-project] Acquiring lock "1daf4f4c-0e4a-4779-b53a-78c48397ea2f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120741) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 18:02:09.097246 dv-cinder-852009-8-iscsi devstack@n-api.service[120741]: DEBUG oslo_concurrency.lockutils [None req-d54cf5ee-6159-46c2-b18b-a9db0f718fc7 tempest-DeleteServersTestJSON-1632919649 tempest-DeleteServersTestJSON-1632919649-project] Lock "1daf4f4c-0e4a-4779-b53a-78c48397ea2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.007s {{(pid=120741) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 18:02:09.104891 dv-cinder-852009-8-iscsi devstack@n-api.service[120741]: DEBUG oslo_concurrency.lockutils [None req-d54cf5ee-6159-46c2-b18b-a9db0f718fc7 tempest-DeleteServersTestJSON-1632919649 tempest-DeleteServersTestJSON-1632919649-project] Lock "1daf4f4c-0e4a-4779-b53a-78c48397ea2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120741) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 18:02:09.457842 dv-cinder-852009-8-iscsi devstack@n-api.service[120740]: DEBUG nova.policy [None req-e6b62283-17ed-497f-aac7-58891bbbeca5 tempest-ServerRescueNegativeTestJSON-412251590 tempest-ServerRescueNegativeTestJSON-412251590-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '60800cf2774e409d9c1b6f4992669991', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2eae4acecf6c4961830ead78d71b2ad3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120740) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 18:02:09.472756 dv-cinder-852009-8-iscsi devstack@n-api.service[120741]: DEBUG nova.policy [None req-d54cf5ee-6159-46c2-b18b-a9db0f718fc7 tempest-DeleteServersTestJSON-1632919649 tempest-DeleteServersTestJSON-1632919649-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '51db5ef052144879b53979268ac4ceb5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '66136f123f5b4ad0a824920bbdf9d245', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120741) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 18:02:09.477041 dv-cinder-852009-8-iscsi devstack@n-api.service[120740]: INFO nova.api.openstack.requestlog [None req-e6b62283-17ed-497f-aac7-58891bbbeca5 tempest-ServerRescueNegativeTestJSON-412251590 tempest-ServerRescueNegativeTestJSON-412251590-project] 10.222.0.43 "GET /compute/v2.1/servers/8cd29851-35c1-4032-a137-ab9419a2ec5b" status: 200 len: 1280 microversion: 2.1 time: 0.711266 Sep 13 18:02:09.483089 dv-cinder-852009-8-iscsi devstack@n-api.service[120740]: [pid: 120740|app: 0|req: 13/20] 10.222.0.43 () {58 vars in 1236 bytes} [Tue Sep 13 18:02:08 2022] GET /compute/v2.1/servers/8cd29851-35c1-4032-a137-ab9419a2ec5b => generated 1280 bytes in 729 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 13 18:02:09.485593 dv-cinder-852009-8-iscsi devstack@n-api.service[120741]: INFO nova.api.openstack.requestlog [None req-d54cf5ee-6159-46c2-b18b-a9db0f718fc7 tempest-DeleteServersTestJSON-1632919649 tempest-DeleteServersTestJSON-1632919649-project] 10.222.0.43 "GET /compute/v2.1/servers/207d1d8d-58a4-4b99-aa09-1c5023c60784" status: 200 len: 1273 microversion: 2.1 time: 0.456591 Sep 13 18:02:09.491794 dv-cinder-852009-8-iscsi devstack@n-api.service[120741]: [pid: 120741|app: 0|req: 8/21] 10.222.0.43 () {58 vars in 1236 bytes} [Tue Sep 13 18:02:09 2022] GET /compute/v2.1/servers/207d1d8d-58a4-4b99-aa09-1c5023c60784 => generated 1273 bytes in 473 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 13 18:02:09.776782 dv-cinder-852009-8-iscsi devstack@n-api.service[120741]: DEBUG nova.api.openstack.wsgi [None req-733437af-44d1-4b0a-9fb4-4f119455ef50 tempest-AttachVolumeTestJSON-555093534 tempest-AttachVolumeTestJSON-555093534-project] Calling method '>' {{(pid=120741) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 18:02:09.777767 dv-cinder-852009-8-iscsi devstack@n-api.service[120741]: DEBUG nova.compute.api [None req-733437af-44d1-4b0a-9fb4-4f119455ef50 tempest-AttachVolumeTestJSON-555093534 tempest-AttachVolumeTestJSON-555093534-project] [instance: b958d409-df20-44c6-aa0e-58cb0a482edf] Fetching instance by UUID {{(pid=120741) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 18:02:09.794255 dv-cinder-852009-8-iscsi devstack@n-api.service[120741]: DEBUG oslo_concurrency.lockutils [None req-733437af-44d1-4b0a-9fb4-4f119455ef50 tempest-AttachVolumeTestJSON-555093534 tempest-AttachVolumeTestJSON-555093534-project] Acquiring lock "1daf4f4c-0e4a-4779-b53a-78c48397ea2f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120741) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 18:02:09.796080 dv-cinder-852009-8-iscsi devstack@n-api.service[120741]: DEBUG oslo_concurrency.lockutils [None req-733437af-44d1-4b0a-9fb4-4f119455ef50 tempest-AttachVolumeTestJSON-555093534 tempest-AttachVolumeTestJSON-555093534-project] Lock "1daf4f4c-0e4a-4779-b53a-78c48397ea2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.007s {{(pid=120741) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 18:02:09.797538 dv-cinder-852009-8-iscsi devstack@n-api.service[120741]: DEBUG oslo_concurrency.lockutils [None req-733437af-44d1-4b0a-9fb4-4f119455ef50 tempest-AttachVolumeTestJSON-555093534 tempest-AttachVolumeTestJSON-555093534-project] Lock "1daf4f4c-0e4a-4779-b53a-78c48397ea2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120741) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 18:02:09.801949 dv-cinder-852009-8-iscsi devstack@n-api.service[120741]: DEBUG oslo_concurrency.lockutils [None req-733437af-44d1-4b0a-9fb4-4f119455ef50 tempest-AttachVolumeTestJSON-555093534 tempest-AttachVolumeTestJSON-555093534-project] Acquiring lock "1daf4f4c-0e4a-4779-b53a-78c48397ea2f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120741) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 18:02:09.805535 dv-cinder-852009-8-iscsi devstack@n-api.service[120741]: DEBUG oslo_concurrency.lockutils [None req-733437af-44d1-4b0a-9fb4-4f119455ef50 tempest-AttachVolumeTestJSON-555093534 tempest-AttachVolumeTestJSON-555093534-project] Lock "1daf4f4c-0e4a-4779-b53a-78c48397ea2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=120741) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 18:02:09.808360 dv-cinder-852009-8-iscsi devstack@n-api.service[120741]: DEBUG oslo_concurrency.lockutils [None req-733437af-44d1-4b0a-9fb4-4f119455ef50 tempest-AttachVolumeTestJSON-555093534 tempest-AttachVolumeTestJSON-555093534-project] Lock "1daf4f4c-0e4a-4779-b53a-78c48397ea2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120741) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 18:02:09.952382 dv-cinder-852009-8-iscsi devstack@n-api.service[120740]: DEBUG nova.api.openstack.wsgi [req-dbeca7ed-60bd-4c54-8fd1-6a2cc6ee694b req-67e93b3e-36c8-402f-a7c5-e4d284c40c63 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "a9c22f82-a945-4a94-b3c9-fe95265053bd", "tag": "e84094dd-b823-4e24-a968-9356ccb4ceb5"}]} {{(pid=120740) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 13 18:02:10.008407 dv-cinder-852009-8-iscsi devstack@n-api.service[120740]: DEBUG oslo_concurrency.lockutils [req-dbeca7ed-60bd-4c54-8fd1-6a2cc6ee694b req-67e93b3e-36c8-402f-a7c5-e4d284c40c63 service nova] Acquiring lock "1daf4f4c-0e4a-4779-b53a-78c48397ea2f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120740) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 18:02:10.008972 dv-cinder-852009-8-iscsi devstack@n-api.service[120740]: DEBUG oslo_concurrency.lockutils [req-dbeca7ed-60bd-4c54-8fd1-6a2cc6ee694b req-67e93b3e-36c8-402f-a7c5-e4d284c40c63 service nova] Lock "1daf4f4c-0e4a-4779-b53a-78c48397ea2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.010s {{(pid=120740) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 18:02:10.009563 dv-cinder-852009-8-iscsi devstack@n-api.service[120740]: DEBUG oslo_concurrency.lockutils [req-dbeca7ed-60bd-4c54-8fd1-6a2cc6ee694b req-67e93b3e-36c8-402f-a7c5-e4d284c40c63 service nova] Lock "1daf4f4c-0e4a-4779-b53a-78c48397ea2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120740) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 18:02:10.114187 dv-cinder-852009-8-iscsi devstack@n-api.service[120740]: INFO nova.api.openstack.compute.server_external_events [req-dbeca7ed-60bd-4c54-8fd1-6a2cc6ee694b req-67e93b3e-36c8-402f-a7c5-e4d284c40c63 service nova] Creating event network-changed:e84094dd-b823-4e24-a968-9356ccb4ceb5 for instance a9c22f82-a945-4a94-b3c9-fe95265053bd on hv-cinder-85200 Sep 13 18:02:10.115229 dv-cinder-852009-8-iscsi devstack@n-api.service[120740]: DEBUG oslo_concurrency.lockutils [req-dbeca7ed-60bd-4c54-8fd1-6a2cc6ee694b req-67e93b3e-36c8-402f-a7c5-e4d284c40c63 service nova] Acquiring lock "compute-rpcapi-router" {{(pid=120740) lock /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:312}} Sep 13 18:02:10.116873 dv-cinder-852009-8-iscsi devstack@n-api.service[120740]: DEBUG oslo_concurrency.lockutils [req-dbeca7ed-60bd-4c54-8fd1-6a2cc6ee694b req-67e93b3e-36c8-402f-a7c5-e4d284c40c63 service nova] Acquired lock "compute-rpcapi-router" {{(pid=120740) lock /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:315}} Sep 13 18:02:10.120066 dv-cinder-852009-8-iscsi devstack@n-api.service[120740]: DEBUG oslo_concurrency.lockutils [None req-54382102-e82c-433b-ad6e-623c5fe5c9f3 None None] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120740) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 18:02:10.121162 dv-cinder-852009-8-iscsi devstack@n-api.service[120740]: DEBUG oslo_concurrency.lockutils [None req-54382102-e82c-433b-ad6e-623c5fe5c9f3 None None] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120740) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 18:02:10.123734 dv-cinder-852009-8-iscsi devstack@n-api.service[120740]: DEBUG oslo_concurrency.lockutils [None req-54382102-e82c-433b-ad6e-623c5fe5c9f3 None None] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120740) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 18:02:10.127081 dv-cinder-852009-8-iscsi devstack@n-api.service[120740]: DEBUG oslo_concurrency.lockutils [None req-54382102-e82c-433b-ad6e-623c5fe5c9f3 None None] Acquiring lock "1daf4f4c-0e4a-4779-b53a-78c48397ea2f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120740) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 18:02:10.128341 dv-cinder-852009-8-iscsi devstack@n-api.service[120740]: DEBUG oslo_concurrency.lockutils [None req-54382102-e82c-433b-ad6e-623c5fe5c9f3 None None] Lock "1daf4f4c-0e4a-4779-b53a-78c48397ea2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120740) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 18:02:10.134853 dv-cinder-852009-8-iscsi devstack@n-api.service[120740]: DEBUG oslo_concurrency.lockutils [None req-54382102-e82c-433b-ad6e-623c5fe5c9f3 None None] Lock "1daf4f4c-0e4a-4779-b53a-78c48397ea2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120740) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 18:02:10.164349 dv-cinder-852009-8-iscsi devstack@n-api.service[120740]: INFO nova.compute.rpcapi [None req-54382102-e82c-433b-ad6e-623c5fe5c9f3 None None] Automatically selected compute RPC version 6.1 from minimum service version 64 Sep 13 18:02:10.171535 dv-cinder-852009-8-iscsi devstack@n-api.service[120740]: DEBUG oslo_concurrency.lockutils [None req-54382102-e82c-433b-ad6e-623c5fe5c9f3 None None] Releasing lock "compute-rpcapi-router" {{(pid=120740) lock /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:333}} Sep 13 18:02:10.216125 dv-cinder-852009-8-iscsi devstack@n-api.service[120740]: INFO nova.api.openstack.requestlog [None req-54382102-e82c-433b-ad6e-623c5fe5c9f3 None None] 10.222.0.43 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.731538 Sep 13 18:02:10.217257 dv-cinder-852009-8-iscsi devstack@n-api.service[120740]: [pid: 120740|app: 0|req: 14/22] 10.222.0.43 () {64 vars in 1317 bytes} [Tue Sep 13 18:02:09 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 733 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 13 18:02:10.231975 dv-cinder-852009-8-iscsi devstack@n-api.service[120740]: DEBUG nova.api.openstack.wsgi [None req-9ea61937-1519-4ca3-be3e-a7d6b37629a1 tempest-AttachVolumeShelveTestJSON-385853788 tempest-AttachVolumeShelveTestJSON-385853788-project] Calling method '>' {{(pid=120740) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 18:02:10.233974 dv-cinder-852009-8-iscsi devstack@n-api.service[120740]: DEBUG nova.compute.api [None req-9ea61937-1519-4ca3-be3e-a7d6b37629a1 tempest-AttachVolumeShelveTestJSON-385853788 tempest-AttachVolumeShelveTestJSON-385853788-project] [instance: 11d2616a-96f9-4a7a-aab8-219219986a8b] Fetching instance by UUID {{(pid=120740) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 18:02:10.260993 dv-cinder-852009-8-iscsi devstack@n-api.service[120740]: DEBUG oslo_concurrency.lockutils [None req-9ea61937-1519-4ca3-be3e-a7d6b37629a1 tempest-AttachVolumeShelveTestJSON-385853788 tempest-AttachVolumeShelveTestJSON-385853788-project] Acquiring lock "1daf4f4c-0e4a-4779-b53a-78c48397ea2f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120740) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 18:02:10.261718 dv-cinder-852009-8-iscsi devstack@n-api.service[120740]: DEBUG oslo_concurrency.lockutils [None req-9ea61937-1519-4ca3-be3e-a7d6b37629a1 tempest-AttachVolumeShelveTestJSON-385853788 tempest-AttachVolumeShelveTestJSON-385853788-project] Lock "1daf4f4c-0e4a-4779-b53a-78c48397ea2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120740) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 18:02:10.270056 dv-cinder-852009-8-iscsi devstack@n-api.service[120740]: DEBUG oslo_concurrency.lockutils [None req-9ea61937-1519-4ca3-be3e-a7d6b37629a1 tempest-AttachVolumeShelveTestJSON-385853788 tempest-AttachVolumeShelveTestJSON-385853788-project] Lock "1daf4f4c-0e4a-4779-b53a-78c48397ea2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.008s {{(pid=120740) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 18:02:10.270875 dv-cinder-852009-8-iscsi devstack@n-api.service[120740]: DEBUG oslo_concurrency.lockutils [None req-9ea61937-1519-4ca3-be3e-a7d6b37629a1 tempest-AttachVolumeShelveTestJSON-385853788 tempest-AttachVolumeShelveTestJSON-385853788-project] Acquiring lock "1daf4f4c-0e4a-4779-b53a-78c48397ea2f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120740) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 18:02:10.272230 dv-cinder-852009-8-iscsi devstack@n-api.service[120740]: DEBUG oslo_concurrency.lockutils [None req-9ea61937-1519-4ca3-be3e-a7d6b37629a1 tempest-AttachVolumeShelveTestJSON-385853788 tempest-AttachVolumeShelveTestJSON-385853788-project] Lock "1daf4f4c-0e4a-4779-b53a-78c48397ea2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120740) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 18:02:10.273065 dv-cinder-852009-8-iscsi devstack@n-api.service[120740]: DEBUG oslo_concurrency.lockutils [None req-9ea61937-1519-4ca3-be3e-a7d6b37629a1 tempest-AttachVolumeShelveTestJSON-385853788 tempest-AttachVolumeShelveTestJSON-385853788-project] Lock "1daf4f4c-0e4a-4779-b53a-78c48397ea2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120740) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 18:02:10.993875 dv-cinder-852009-8-iscsi devstack@n-api.service[120741]: DEBUG nova.policy [None req-733437af-44d1-4b0a-9fb4-4f119455ef50 tempest-AttachVolumeTestJSON-555093534 tempest-AttachVolumeTestJSON-555093534-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0625b3113ce044bbac4f6142eaade11c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a279fcbf274c4704a31a2b95061e1469', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120741) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 18:02:11.016606 dv-cinder-852009-8-iscsi devstack@n-api.service[120741]: INFO nova.api.openstack.requestlog [None req-733437af-44d1-4b0a-9fb4-4f119455ef50 tempest-AttachVolumeTestJSON-555093534 tempest-AttachVolumeTestJSON-555093534-project] 10.222.0.43 "GET /compute/v2.1/servers/b958d409-df20-44c6-aa0e-58cb0a482edf" status: 200 len: 1298 microversion: 2.1 time: 1.238088 Sep 13 18:02:11.021647 dv-cinder-852009-8-iscsi devstack@n-api.service[120741]: [pid: 120741|app: 0|req: 9/23] 10.222.0.43 () {58 vars in 1236 bytes} [Tue Sep 13 18:02:09 2022] GET /compute/v2.1/servers/b958d409-df20-44c6-aa0e-58cb0a482edf => generated 1298 bytes in 1251 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 13 18:02:11.035617 dv-cinder-852009-8-iscsi devstack@n-api.service[120741]: DEBUG nova.api.openstack.wsgi [None req-9e315461-33c5-427f-a7c9-229793865020 tempest-ServerRescueNegativeTestJSON-412251590 tempest-ServerRescueNegativeTestJSON-412251590-project] Calling method '>' {{(pid=120741) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 18:02:11.044707 dv-cinder-852009-8-iscsi devstack@n-api.service[120741]: DEBUG nova.compute.api [None req-9e315461-33c5-427f-a7c9-229793865020 tempest-ServerRescueNegativeTestJSON-412251590 tempest-ServerRescueNegativeTestJSON-412251590-project] [instance: 8cd29851-35c1-4032-a137-ab9419a2ec5b] Fetching instance by UUID {{(pid=120741) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 18:02:11.045996 dv-cinder-852009-8-iscsi devstack@n-api.service[120740]: DEBUG nova.policy [None req-9ea61937-1519-4ca3-be3e-a7d6b37629a1 tempest-AttachVolumeShelveTestJSON-385853788 tempest-AttachVolumeShelveTestJSON-385853788-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e68ecd9b3ca643539b109f75bb242d6f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '75e14fd88bfb4cd896fa7b070a0fac47', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120740) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 18:02:11.057176 dv-cinder-852009-8-iscsi devstack@n-api.service[120740]: DEBUG nova.policy [None req-9ea61937-1519-4ca3-be3e-a7d6b37629a1 tempest-AttachVolumeShelveTestJSON-385853788 tempest-AttachVolumeShelveTestJSON-385853788-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'e68ecd9b3ca643539b109f75bb242d6f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '75e14fd88bfb4cd896fa7b070a0fac47', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120740) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 18:02:11.063089 dv-cinder-852009-8-iscsi devstack@n-api.service[120741]: DEBUG oslo_concurrency.lockutils [None req-9e315461-33c5-427f-a7c9-229793865020 tempest-ServerRescueNegativeTestJSON-412251590 tempest-ServerRescueNegativeTestJSON-412251590-project] Acquiring lock "1daf4f4c-0e4a-4779-b53a-78c48397ea2f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120741) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 18:02:11.063693 dv-cinder-852009-8-iscsi devstack@n-api.service[120741]: DEBUG oslo_concurrency.lockutils [None req-9e315461-33c5-427f-a7c9-229793865020 tempest-ServerRescueNegativeTestJSON-412251590 tempest-ServerRescueNegativeTestJSON-412251590-project] Lock "1daf4f4c-0e4a-4779-b53a-78c48397ea2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120741) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 18:02:11.064111 dv-cinder-852009-8-iscsi devstack@n-api.service[120741]: DEBUG oslo_concurrency.lockutils [None req-9e315461-33c5-427f-a7c9-229793865020 tempest-ServerRescueNegativeTestJSON-412251590 tempest-ServerRescueNegativeTestJSON-412251590-project] Lock "1daf4f4c-0e4a-4779-b53a-78c48397ea2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120741) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 18:02:11.064909 dv-cinder-852009-8-iscsi devstack@n-api.service[120741]: DEBUG oslo_concurrency.lockutils [None req-9e315461-33c5-427f-a7c9-229793865020 tempest-ServerRescueNegativeTestJSON-412251590 tempest-ServerRescueNegativeTestJSON-412251590-project] Acquiring lock "1daf4f4c-0e4a-4779-b53a-78c48397ea2f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120741) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 18:02:11.065471 dv-cinder-852009-8-iscsi devstack@n-api.service[120741]: DEBUG oslo_concurrency.lockutils [None req-9e315461-33c5-427f-a7c9-229793865020 tempest-ServerRescueNegativeTestJSON-412251590 tempest-ServerRescueNegativeTestJSON-412251590-project] Lock "1daf4f4c-0e4a-4779-b53a-78c48397ea2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120741) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 18:02:11.065917 dv-cinder-852009-8-iscsi devstack@n-api.service[120741]: DEBUG oslo_concurrency.lockutils [None req-9e315461-33c5-427f-a7c9-229793865020 tempest-ServerRescueNegativeTestJSON-412251590 tempest-ServerRescueNegativeTestJSON-412251590-project] Lock "1daf4f4c-0e4a-4779-b53a-78c48397ea2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120741) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 18:02:11.070371 dv-cinder-852009-8-iscsi devstack@n-api.service[120740]: DEBUG nova.policy [None req-9ea61937-1519-4ca3-be3e-a7d6b37629a1 tempest-AttachVolumeShelveTestJSON-385853788 tempest-AttachVolumeShelveTestJSON-385853788-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'e68ecd9b3ca643539b109f75bb242d6f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '75e14fd88bfb4cd896fa7b070a0fac47', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120740) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 18:02:11.074259 dv-cinder-852009-8-iscsi devstack@n-api.service[120740]: INFO nova.api.openstack.requestlog [None req-9ea61937-1519-4ca3-be3e-a7d6b37629a1 tempest-AttachVolumeShelveTestJSON-385853788 tempest-AttachVolumeShelveTestJSON-385853788-project] 10.222.0.43 "GET /compute/v2.1/servers/11d2616a-96f9-4a7a-aab8-219219986a8b" status: 200 len: 1338 microversion: 2.20 time: 0.855612 Sep 13 18:02:11.079159 dv-cinder-852009-8-iscsi devstack@n-api.service[120740]: [pid: 120740|app: 0|req: 15/24] 10.222.0.43 () {60 vars in 1277 bytes} [Tue Sep 13 18:02:10 2022] GET /compute/v2.1/servers/11d2616a-96f9-4a7a-aab8-219219986a8b => generated 1338 bytes in 861 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 13 18:02:11.097931 dv-cinder-852009-8-iscsi devstack@n-api.service[120740]: DEBUG nova.api.openstack.wsgi [None req-e5450870-c406-4515-90cc-8565b012b957 tempest-DeleteServersTestJSON-1632919649 tempest-DeleteServersTestJSON-1632919649-project] Calling method '>' {{(pid=120740) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 18:02:11.103424 dv-cinder-852009-8-iscsi devstack@n-api.service[120740]: DEBUG nova.compute.api [None req-e5450870-c406-4515-90cc-8565b012b957 tempest-DeleteServersTestJSON-1632919649 tempest-DeleteServersTestJSON-1632919649-project] [instance: 207d1d8d-58a4-4b99-aa09-1c5023c60784] Fetching instance by UUID {{(pid=120740) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 18:02:11.115968 dv-cinder-852009-8-iscsi devstack@n-api.service[120740]: DEBUG oslo_concurrency.lockutils [None req-e5450870-c406-4515-90cc-8565b012b957 tempest-DeleteServersTestJSON-1632919649 tempest-DeleteServersTestJSON-1632919649-project] Acquiring lock "1daf4f4c-0e4a-4779-b53a-78c48397ea2f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120740) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 18:02:11.128921 dv-cinder-852009-8-iscsi devstack@n-api.service[120740]: DEBUG oslo_concurrency.lockutils [None req-e5450870-c406-4515-90cc-8565b012b957 tempest-DeleteServersTestJSON-1632919649 tempest-DeleteServersTestJSON-1632919649-project] Lock "1daf4f4c-0e4a-4779-b53a-78c48397ea2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120740) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 18:02:11.130299 dv-cinder-852009-8-iscsi devstack@n-api.service[120740]: DEBUG oslo_concurrency.lockutils [None req-e5450870-c406-4515-90cc-8565b012b957 tempest-DeleteServersTestJSON-1632919649 tempest-DeleteServersTestJSON-1632919649-project] Lock "1daf4f4c-0e4a-4779-b53a-78c48397ea2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.014s {{(pid=120740) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 18:02:11.134430 dv-cinder-852009-8-iscsi devstack@n-api.service[120740]: DEBUG oslo_concurrency.lockutils [None req-e5450870-c406-4515-90cc-8565b012b957 tempest-DeleteServersTestJSON-1632919649 tempest-DeleteServersTestJSON-1632919649-project] Acquiring lock "1daf4f4c-0e4a-4779-b53a-78c48397ea2f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120740) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 18:02:11.135189 dv-cinder-852009-8-iscsi devstack@n-api.service[120740]: DEBUG oslo_concurrency.lockutils [None req-e5450870-c406-4515-90cc-8565b012b957 tempest-DeleteServersTestJSON-1632919649 tempest-DeleteServersTestJSON-1632919649-project] Lock "1daf4f4c-0e4a-4779-b53a-78c48397ea2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120740) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 18:02:11.137098 dv-cinder-852009-8-iscsi devstack@n-api.service[120740]: DEBUG oslo_concurrency.lockutils [None req-e5450870-c406-4515-90cc-8565b012b957 tempest-DeleteServersTestJSON-1632919649 tempest-DeleteServersTestJSON-1632919649-project] Lock "1daf4f4c-0e4a-4779-b53a-78c48397ea2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120740) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 18:02:11.548529 dv-cinder-852009-8-iscsi devstack@n-api.service[120740]: DEBUG nova.policy [None req-e5450870-c406-4515-90cc-8565b012b957 tempest-DeleteServersTestJSON-1632919649 tempest-DeleteServersTestJSON-1632919649-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '51db5ef052144879b53979268ac4ceb5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '66136f123f5b4ad0a824920bbdf9d245', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120740) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 18:02:11.559489 dv-cinder-852009-8-iscsi devstack@n-api.service[120740]: INFO nova.api.openstack.requestlog [None req-e5450870-c406-4515-90cc-8565b012b957 tempest-DeleteServersTestJSON-1632919649 tempest-DeleteServersTestJSON-1632919649-project] 10.222.0.43 "GET /compute/v2.1/servers/207d1d8d-58a4-4b99-aa09-1c5023c60784" status: 200 len: 1273 microversion: 2.1 time: 0.478728 Sep 13 18:02:11.563461 dv-cinder-852009-8-iscsi devstack@n-api.service[120740]: [pid: 120740|app: 0|req: 16/25] 10.222.0.43 () {58 vars in 1236 bytes} [Tue Sep 13 18:02:11 2022] GET /compute/v2.1/servers/207d1d8d-58a4-4b99-aa09-1c5023c60784 => generated 1273 bytes in 483 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 13 18:02:11.732163 dv-cinder-852009-8-iscsi devstack@n-api.service[120741]: DEBUG nova.policy [None req-9e315461-33c5-427f-a7c9-229793865020 tempest-ServerRescueNegativeTestJSON-412251590 tempest-ServerRescueNegativeTestJSON-412251590-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '60800cf2774e409d9c1b6f4992669991', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2eae4acecf6c4961830ead78d71b2ad3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120741) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 18:02:11.745266 dv-cinder-852009-8-iscsi devstack@n-api.service[120741]: INFO nova.api.openstack.requestlog [None req-9e315461-33c5-427f-a7c9-229793865020 tempest-ServerRescueNegativeTestJSON-412251590 tempest-ServerRescueNegativeTestJSON-412251590-project] 10.222.0.43 "GET /compute/v2.1/servers/8cd29851-35c1-4032-a137-ab9419a2ec5b" status: 200 len: 1322 microversion: 2.1 time: 0.719286 Sep 13 18:02:11.752967 dv-cinder-852009-8-iscsi devstack@n-api.service[120741]: [pid: 120741|app: 0|req: 10/26] 10.222.0.43 () {58 vars in 1236 bytes} [Tue Sep 13 18:02:11 2022] GET /compute/v2.1/servers/8cd29851-35c1-4032-a137-ab9419a2ec5b => generated 1322 bytes in 730 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 13 18:02:12.046696 dv-cinder-852009-8-iscsi devstack@n-api.service[120740]: DEBUG nova.api.openstack.wsgi [None req-d59ed0bb-de23-496e-a975-157a53f8778c tempest-AttachVolumeTestJSON-555093534 tempest-AttachVolumeTestJSON-555093534-project] Calling method '>' {{(pid=120740) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 18:02:12.048461 dv-cinder-852009-8-iscsi devstack@n-api.service[120740]: DEBUG nova.compute.api [None req-d59ed0bb-de23-496e-a975-157a53f8778c tempest-AttachVolumeTestJSON-555093534 tempest-AttachVolumeTestJSON-555093534-project] [instance: b958d409-df20-44c6-aa0e-58cb0a482edf] Fetching instance by UUID {{(pid=120740) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 18:02:12.060808 dv-cinder-852009-8-iscsi devstack@n-api.service[120740]: DEBUG oslo_concurrency.lockutils [None req-d59ed0bb-de23-496e-a975-157a53f8778c tempest-AttachVolumeTestJSON-555093534 tempest-AttachVolumeTestJSON-555093534-project] Acquiring lock "1daf4f4c-0e4a-4779-b53a-78c48397ea2f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120740) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 18:02:12.061754 dv-cinder-852009-8-iscsi devstack@n-api.service[120740]: DEBUG oslo_concurrency.lockutils [None req-d59ed0bb-de23-496e-a975-157a53f8778c tempest-AttachVolumeTestJSON-555093534 tempest-AttachVolumeTestJSON-555093534-project] Lock "1daf4f4c-0e4a-4779-b53a-78c48397ea2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120740) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 18:02:12.062811 dv-cinder-852009-8-iscsi devstack@n-api.service[120740]: DEBUG oslo_concurrency.lockutils [None req-d59ed0bb-de23-496e-a975-157a53f8778c tempest-AttachVolumeTestJSON-555093534 tempest-AttachVolumeTestJSON-555093534-project] Lock "1daf4f4c-0e4a-4779-b53a-78c48397ea2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120740) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 18:02:12.064412 dv-cinder-852009-8-iscsi devstack@n-api.service[120740]: DEBUG oslo_concurrency.lockutils [None req-d59ed0bb-de23-496e-a975-157a53f8778c tempest-AttachVolumeTestJSON-555093534 tempest-AttachVolumeTestJSON-555093534-project] Acquiring lock "1daf4f4c-0e4a-4779-b53a-78c48397ea2f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120740) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 18:02:12.065305 dv-cinder-852009-8-iscsi devstack@n-api.service[120740]: DEBUG oslo_concurrency.lockutils [None req-d59ed0bb-de23-496e-a975-157a53f8778c tempest-AttachVolumeTestJSON-555093534 tempest-AttachVolumeTestJSON-555093534-project] Lock "1daf4f4c-0e4a-4779-b53a-78c48397ea2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120740) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 18:02:12.066282 dv-cinder-852009-8-iscsi devstack@n-api.service[120740]: DEBUG oslo_concurrency.lockutils [None req-d59ed0bb-de23-496e-a975-157a53f8778c tempest-AttachVolumeTestJSON-555093534 tempest-AttachVolumeTestJSON-555093534-project] Lock "1daf4f4c-0e4a-4779-b53a-78c48397ea2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120740) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 18:02:12.115855 dv-cinder-852009-8-iscsi devstack@n-api.service[120741]: DEBUG nova.api.openstack.wsgi [None req-cc0dd0ee-0a29-40fb-9adb-94f642c5771a tempest-AttachVolumeShelveTestJSON-385853788 tempest-AttachVolumeShelveTestJSON-385853788-project] Calling method '>' {{(pid=120741) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 18:02:12.118279 dv-cinder-852009-8-iscsi devstack@n-api.service[120741]: DEBUG nova.compute.api [None req-cc0dd0ee-0a29-40fb-9adb-94f642c5771a tempest-AttachVolumeShelveTestJSON-385853788 tempest-AttachVolumeShelveTestJSON-385853788-project] [instance: 11d2616a-96f9-4a7a-aab8-219219986a8b] Fetching instance by UUID {{(pid=120741) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 18:02:12.132379 dv-cinder-852009-8-iscsi devstack@n-api.service[120741]: DEBUG oslo_concurrency.lockutils [None req-cc0dd0ee-0a29-40fb-9adb-94f642c5771a tempest-AttachVolumeShelveTestJSON-385853788 tempest-AttachVolumeShelveTestJSON-385853788-project] Acquiring lock "1daf4f4c-0e4a-4779-b53a-78c48397ea2f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120741) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 18:02:12.133901 dv-cinder-852009-8-iscsi devstack@n-api.service[120741]: DEBUG oslo_concurrency.lockutils [None req-cc0dd0ee-0a29-40fb-9adb-94f642c5771a tempest-AttachVolumeShelveTestJSON-385853788 tempest-AttachVolumeShelveTestJSON-385853788-project] Lock "1daf4f4c-0e4a-4779-b53a-78c48397ea2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120741) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 18:02:12.135653 dv-cinder-852009-8-iscsi devstack@n-api.service[120741]: DEBUG oslo_concurrency.lockutils [None req-cc0dd0ee-0a29-40fb-9adb-94f642c5771a tempest-AttachVolumeShelveTestJSON-385853788 tempest-AttachVolumeShelveTestJSON-385853788-project] Lock "1daf4f4c-0e4a-4779-b53a-78c48397ea2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120741) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 18:02:12.137504 dv-cinder-852009-8-iscsi devstack@n-api.service[120741]: DEBUG oslo_concurrency.lockutils [None req-cc0dd0ee-0a29-40fb-9adb-94f642c5771a tempest-AttachVolumeShelveTestJSON-385853788 tempest-AttachVolumeShelveTestJSON-385853788-project] Acquiring lock "1daf4f4c-0e4a-4779-b53a-78c48397ea2f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120741) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 18:02:12.142022 dv-cinder-852009-8-iscsi devstack@n-api.service[120741]: DEBUG oslo_concurrency.lockutils [None req-cc0dd0ee-0a29-40fb-9adb-94f642c5771a tempest-AttachVolumeShelveTestJSON-385853788 tempest-AttachVolumeShelveTestJSON-385853788-project] Lock "1daf4f4c-0e4a-4779-b53a-78c48397ea2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120741) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 18:02:12.144872 dv-cinder-852009-8-iscsi devstack@n-api.service[120741]: DEBUG oslo_concurrency.lockutils [None req-cc0dd0ee-0a29-40fb-9adb-94f642c5771a tempest-AttachVolumeShelveTestJSON-385853788 tempest-AttachVolumeShelveTestJSON-385853788-project] Lock "1daf4f4c-0e4a-4779-b53a-78c48397ea2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=120741) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 18:02:12.256377 dv-cinder-852009-8-iscsi devstack@n-api.service[120740]: DEBUG nova.policy [None req-d59ed0bb-de23-496e-a975-157a53f8778c tempest-AttachVolumeTestJSON-555093534 tempest-AttachVolumeTestJSON-555093534-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0625b3113ce044bbac4f6142eaade11c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a279fcbf274c4704a31a2b95061e1469', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120740) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 18:02:12.275204 dv-cinder-852009-8-iscsi devstack@n-api.service[120740]: INFO nova.api.openstack.requestlog [None req-d59ed0bb-de23-496e-a975-157a53f8778c tempest-AttachVolumeTestJSON-555093534 tempest-AttachVolumeTestJSON-555093534-project] 10.222.0.43 "GET /compute/v2.1/servers/b958d409-df20-44c6-aa0e-58cb0a482edf" status: 200 len: 1296 microversion: 2.1 time: 0.234407 Sep 13 18:02:12.279173 dv-cinder-852009-8-iscsi devstack@n-api.service[120740]: [pid: 120740|app: 0|req: 17/27] 10.222.0.43 () {58 vars in 1236 bytes} [Tue Sep 13 18:02:12 2022] GET /compute/v2.1/servers/b958d409-df20-44c6-aa0e-58cb0a482edf => generated 1296 bytes in 239 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 13 18:02:12.596468 dv-cinder-852009-8-iscsi devstack@n-api.service[120740]: DEBUG nova.api.openstack.wsgi [None req-a09c7927-053f-4bb4-98ad-2ac81cb14796 tempest-DeleteServersTestJSON-1632919649 tempest-DeleteServersTestJSON-1632919649-project] Calling method '>' {{(pid=120740) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 18:02:12.598538 dv-cinder-852009-8-iscsi devstack@n-api.service[120740]: DEBUG nova.compute.api [None req-a09c7927-053f-4bb4-98ad-2ac81cb14796 tempest-DeleteServersTestJSON-1632919649 tempest-DeleteServersTestJSON-1632919649-project] [instance: 207d1d8d-58a4-4b99-aa09-1c5023c60784] Fetching instance by UUID {{(pid=120740) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 18:02:12.640120 dv-cinder-852009-8-iscsi devstack@n-api.service[120740]: DEBUG oslo_concurrency.lockutils [None req-a09c7927-053f-4bb4-98ad-2ac81cb14796 tempest-DeleteServersTestJSON-1632919649 tempest-DeleteServersTestJSON-1632919649-project] Acquiring lock "1daf4f4c-0e4a-4779-b53a-78c48397ea2f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120740) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 18:02:12.643835 dv-cinder-852009-8-iscsi devstack@n-api.service[120740]: DEBUG oslo_concurrency.lockutils [None req-a09c7927-053f-4bb4-98ad-2ac81cb14796 tempest-DeleteServersTestJSON-1632919649 tempest-DeleteServersTestJSON-1632919649-project] Lock "1daf4f4c-0e4a-4779-b53a-78c48397ea2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=120740) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 18:02:12.647424 dv-cinder-852009-8-iscsi devstack@n-api.service[120740]: DEBUG oslo_concurrency.lockutils [None req-a09c7927-053f-4bb4-98ad-2ac81cb14796 tempest-DeleteServersTestJSON-1632919649 tempest-DeleteServersTestJSON-1632919649-project] Lock "1daf4f4c-0e4a-4779-b53a-78c48397ea2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=120740) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 18:02:12.648409 dv-cinder-852009-8-iscsi devstack@n-api.service[120740]: DEBUG oslo_concurrency.lockutils [None req-a09c7927-053f-4bb4-98ad-2ac81cb14796 tempest-DeleteServersTestJSON-1632919649 tempest-DeleteServersTestJSON-1632919649-project] Acquiring lock "1daf4f4c-0e4a-4779-b53a-78c48397ea2f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120740) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 18:02:12.652499 dv-cinder-852009-8-iscsi devstack@n-api.service[120740]: DEBUG oslo_concurrency.lockutils [None req-a09c7927-053f-4bb4-98ad-2ac81cb14796 tempest-DeleteServersTestJSON-1632919649 tempest-DeleteServersTestJSON-1632919649-project] Lock "1daf4f4c-0e4a-4779-b53a-78c48397ea2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=120740) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 18:02:12.652951 dv-cinder-852009-8-iscsi devstack@n-api.service[120740]: DEBUG oslo_concurrency.lockutils [None req-a09c7927-053f-4bb4-98ad-2ac81cb14796 tempest-DeleteServersTestJSON-1632919649 tempest-DeleteServersTestJSON-1632919649-project] Lock "1daf4f4c-0e4a-4779-b53a-78c48397ea2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120740) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 18:02:13.069625 dv-cinder-852009-8-iscsi devstack@n-api.service[120741]: DEBUG nova.policy [None req-cc0dd0ee-0a29-40fb-9adb-94f642c5771a tempest-AttachVolumeShelveTestJSON-385853788 tempest-AttachVolumeShelveTestJSON-385853788-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e68ecd9b3ca643539b109f75bb242d6f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '75e14fd88bfb4cd896fa7b070a0fac47', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120741) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 18:02:13.088280 dv-cinder-852009-8-iscsi devstack@n-api.service[120741]: DEBUG nova.policy [None req-cc0dd0ee-0a29-40fb-9adb-94f642c5771a tempest-AttachVolumeShelveTestJSON-385853788 tempest-AttachVolumeShelveTestJSON-385853788-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'e68ecd9b3ca643539b109f75bb242d6f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '75e14fd88bfb4cd896fa7b070a0fac47', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120741) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 18:02:13.090101 dv-cinder-852009-8-iscsi devstack@n-api.service[120741]: DEBUG nova.policy [None req-cc0dd0ee-0a29-40fb-9adb-94f642c5771a tempest-AttachVolumeShelveTestJSON-385853788 tempest-AttachVolumeShelveTestJSON-385853788-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'e68ecd9b3ca643539b109f75bb242d6f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '75e14fd88bfb4cd896fa7b070a0fac47', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120741) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 18:02:13.091300 dv-cinder-852009-8-iscsi devstack@n-api.service[120741]: INFO nova.api.openstack.requestlog [None req-cc0dd0ee-0a29-40fb-9adb-94f642c5771a tempest-AttachVolumeShelveTestJSON-385853788 tempest-AttachVolumeShelveTestJSON-385853788-project] 10.222.0.43 "GET /compute/v2.1/servers/11d2616a-96f9-4a7a-aab8-219219986a8b" status: 200 len: 1405 microversion: 2.20 time: 0.981272 Sep 13 18:02:13.094276 dv-cinder-852009-8-iscsi devstack@n-api.service[120741]: [pid: 120741|app: 0|req: 11/28] 10.222.0.43 () {60 vars in 1277 bytes} [Tue Sep 13 18:02:12 2022] GET /compute/v2.1/servers/11d2616a-96f9-4a7a-aab8-219219986a8b => generated 1405 bytes in 988 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 13 18:02:13.105318 dv-cinder-852009-8-iscsi devstack@n-api.service[120741]: DEBUG nova.api.openstack.wsgi [None req-1c9f37ac-c1ce-4cbc-8f79-b3ffc48893b6 tempest-ServerRescueNegativeTestJSON-412251590 tempest-ServerRescueNegativeTestJSON-412251590-project] Calling method '>' {{(pid=120741) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 18:02:13.105939 dv-cinder-852009-8-iscsi devstack@n-api.service[120741]: DEBUG nova.compute.api [None req-1c9f37ac-c1ce-4cbc-8f79-b3ffc48893b6 tempest-ServerRescueNegativeTestJSON-412251590 tempest-ServerRescueNegativeTestJSON-412251590-project] [instance: 8cd29851-35c1-4032-a137-ab9419a2ec5b] Fetching instance by UUID {{(pid=120741) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 18:02:13.127957 dv-cinder-852009-8-iscsi devstack@n-api.service[120741]: DEBUG oslo_concurrency.lockutils [None req-1c9f37ac-c1ce-4cbc-8f79-b3ffc48893b6 tempest-ServerRescueNegativeTestJSON-412251590 tempest-ServerRescueNegativeTestJSON-412251590-project] Acquiring lock "1daf4f4c-0e4a-4779-b53a-78c48397ea2f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120741) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 18:02:13.128624 dv-cinder-852009-8-iscsi devstack@n-api.service[120741]: DEBUG oslo_concurrency.lockutils [None req-1c9f37ac-c1ce-4cbc-8f79-b3ffc48893b6 tempest-ServerRescueNegativeTestJSON-412251590 tempest-ServerRescueNegativeTestJSON-412251590-project] Lock "1daf4f4c-0e4a-4779-b53a-78c48397ea2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120741) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 18:02:13.142663 dv-cinder-852009-8-iscsi devstack@n-api.service[120741]: DEBUG oslo_concurrency.lockutils [None req-1c9f37ac-c1ce-4cbc-8f79-b3ffc48893b6 tempest-ServerRescueNegativeTestJSON-412251590 tempest-ServerRescueNegativeTestJSON-412251590-project] Lock "1daf4f4c-0e4a-4779-b53a-78c48397ea2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120741) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 18:02:13.148394 dv-cinder-852009-8-iscsi devstack@n-api.service[120741]: DEBUG oslo_concurrency.lockutils [None req-1c9f37ac-c1ce-4cbc-8f79-b3ffc48893b6 tempest-ServerRescueNegativeTestJSON-412251590 tempest-ServerRescueNegativeTestJSON-412251590-project] Acquiring lock "1daf4f4c-0e4a-4779-b53a-78c48397ea2f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120741) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 18:02:13.151616 dv-cinder-852009-8-iscsi devstack@n-api.service[120741]: DEBUG oslo_concurrency.lockutils [None req-1c9f37ac-c1ce-4cbc-8f79-b3ffc48893b6 tempest-ServerRescueNegativeTestJSON-412251590 tempest-ServerRescueNegativeTestJSON-412251590-project] Lock "1daf4f4c-0e4a-4779-b53a-78c48397ea2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=120741) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 18:02:13.154668 dv-cinder-852009-8-iscsi devstack@n-api.service[120741]: DEBUG oslo_concurrency.lockutils [None req-1c9f37ac-c1ce-4cbc-8f79-b3ffc48893b6 tempest-ServerRescueNegativeTestJSON-412251590 tempest-ServerRescueNegativeTestJSON-412251590-project] Lock "1daf4f4c-0e4a-4779-b53a-78c48397ea2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=120741) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 18:02:13.396971 dv-cinder-852009-8-iscsi devstack@n-api.service[120740]: DEBUG nova.policy [None req-a09c7927-053f-4bb4-98ad-2ac81cb14796 tempest-DeleteServersTestJSON-1632919649 tempest-DeleteServersTestJSON-1632919649-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '51db5ef052144879b53979268ac4ceb5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '66136f123f5b4ad0a824920bbdf9d245', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120740) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 18:02:13.410133 dv-cinder-852009-8-iscsi devstack@n-api.service[120740]: INFO nova.api.openstack.requestlog [None req-a09c7927-053f-4bb4-98ad-2ac81cb14796 tempest-DeleteServersTestJSON-1632919649 tempest-DeleteServersTestJSON-1632919649-project] 10.222.0.43 "GET /compute/v2.1/servers/207d1d8d-58a4-4b99-aa09-1c5023c60784" status: 200 len: 1315 microversion: 2.1 time: 0.824395 Sep 13 18:02:13.426665 dv-cinder-852009-8-iscsi devstack@n-api.service[120740]: [pid: 120740|app: 0|req: 18/29] 10.222.0.43 () {58 vars in 1236 bytes} [Tue Sep 13 18:02:12 2022] GET /compute/v2.1/servers/207d1d8d-58a4-4b99-aa09-1c5023c60784 => generated 1315 bytes in 842 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 13 18:02:13.432088 dv-cinder-852009-8-iscsi devstack@n-api.service[120740]: DEBUG nova.api.openstack.wsgi [None req-a7f2696e-011b-400f-b560-b47bd0b8979b tempest-AttachVolumeTestJSON-555093534 tempest-AttachVolumeTestJSON-555093534-project] Calling method '>' {{(pid=120740) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 18:02:13.432702 dv-cinder-852009-8-iscsi devstack@n-api.service[120740]: DEBUG nova.compute.api [None req-a7f2696e-011b-400f-b560-b47bd0b8979b tempest-AttachVolumeTestJSON-555093534 tempest-AttachVolumeTestJSON-555093534-project] [instance: b958d409-df20-44c6-aa0e-58cb0a482edf] Fetching instance by UUID {{(pid=120740) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 18:02:13.439180 dv-cinder-852009-8-iscsi devstack@n-api.service[120740]: DEBUG oslo_concurrency.lockutils [None req-a7f2696e-011b-400f-b560-b47bd0b8979b tempest-AttachVolumeTestJSON-555093534 tempest-AttachVolumeTestJSON-555093534-project] Acquiring lock "1daf4f4c-0e4a-4779-b53a-78c48397ea2f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120740) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 18:02:13.439663 dv-cinder-852009-8-iscsi devstack@n-api.service[120740]: DEBUG oslo_concurrency.lockutils [None req-a7f2696e-011b-400f-b560-b47bd0b8979b tempest-AttachVolumeTestJSON-555093534 tempest-AttachVolumeTestJSON-555093534-project] Lock "1daf4f4c-0e4a-4779-b53a-78c48397ea2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120740) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 18:02:13.440095 dv-cinder-852009-8-iscsi devstack@n-api.service[120740]: DEBUG oslo_concurrency.lockutils [None req-a7f2696e-011b-400f-b560-b47bd0b8979b tempest-AttachVolumeTestJSON-555093534 tempest-AttachVolumeTestJSON-555093534-project] Lock "1daf4f4c-0e4a-4779-b53a-78c48397ea2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120740) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 18:02:13.440844 dv-cinder-852009-8-iscsi devstack@n-api.service[120740]: DEBUG oslo_concurrency.lockutils [None req-a7f2696e-011b-400f-b560-b47bd0b8979b tempest-AttachVolumeTestJSON-555093534 tempest-AttachVolumeTestJSON-555093534-project] Acquiring lock "1daf4f4c-0e4a-4779-b53a-78c48397ea2f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120740) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 18:02:13.441303 dv-cinder-852009-8-iscsi devstack@n-api.service[120740]: DEBUG oslo_concurrency.lockutils [None req-a7f2696e-011b-400f-b560-b47bd0b8979b tempest-AttachVolumeTestJSON-555093534 tempest-AttachVolumeTestJSON-555093534-project] Lock "1daf4f4c-0e4a-4779-b53a-78c48397ea2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120740) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 18:02:13.441726 dv-cinder-852009-8-iscsi devstack@n-api.service[120740]: DEBUG oslo_concurrency.lockutils [None req-a7f2696e-011b-400f-b560-b47bd0b8979b tempest-AttachVolumeTestJSON-555093534 tempest-AttachVolumeTestJSON-555093534-project] Lock "1daf4f4c-0e4a-4779-b53a-78c48397ea2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120740) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 18:02:13.718868 dv-cinder-852009-8-iscsi devstack@n-api.service[120740]: DEBUG dbcounter [-] [120740] Writing DB stats nova_cell0:SELECT=20 {{(pid=120740) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 18:02:13.759473 dv-cinder-852009-8-iscsi devstack@n-api.service[120740]: DEBUG nova.policy [None req-a7f2696e-011b-400f-b560-b47bd0b8979b tempest-AttachVolumeTestJSON-555093534 tempest-AttachVolumeTestJSON-555093534-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0625b3113ce044bbac4f6142eaade11c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a279fcbf274c4704a31a2b95061e1469', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120740) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 18:02:13.775930 dv-cinder-852009-8-iscsi devstack@n-api.service[120740]: INFO nova.api.openstack.requestlog [None req-a7f2696e-011b-400f-b560-b47bd0b8979b tempest-AttachVolumeTestJSON-555093534 tempest-AttachVolumeTestJSON-555093534-project] 10.222.0.43 "GET /compute/v2.1/servers/b958d409-df20-44c6-aa0e-58cb0a482edf" status: 200 len: 1296 microversion: 2.1 time: 0.348027 Sep 13 18:02:13.794373 dv-cinder-852009-8-iscsi devstack@n-api.service[120740]: [pid: 120740|app: 0|req: 19/30] 10.222.0.43 () {58 vars in 1236 bytes} [Tue Sep 13 18:02:13 2022] GET /compute/v2.1/servers/b958d409-df20-44c6-aa0e-58cb0a482edf => generated 1296 bytes in 367 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 13 18:02:14.002320 dv-cinder-852009-8-iscsi devstack@n-api.service[120741]: DEBUG nova.policy [None req-1c9f37ac-c1ce-4cbc-8f79-b3ffc48893b6 tempest-ServerRescueNegativeTestJSON-412251590 tempest-ServerRescueNegativeTestJSON-412251590-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '60800cf2774e409d9c1b6f4992669991', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2eae4acecf6c4961830ead78d71b2ad3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120741) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 18:02:14.018204 dv-cinder-852009-8-iscsi devstack@n-api.service[120741]: INFO nova.api.openstack.requestlog [None req-1c9f37ac-c1ce-4cbc-8f79-b3ffc48893b6 tempest-ServerRescueNegativeTestJSON-412251590 tempest-ServerRescueNegativeTestJSON-412251590-project] 10.222.0.43 "GET /compute/v2.1/servers/8cd29851-35c1-4032-a137-ab9419a2ec5b" status: 200 len: 1322 microversion: 2.1 time: 0.921664 Sep 13 18:02:14.021732 dv-cinder-852009-8-iscsi devstack@n-api.service[120741]: [pid: 120741|app: 0|req: 12/31] 10.222.0.43 () {58 vars in 1236 bytes} [Tue Sep 13 18:02:13 2022] GET /compute/v2.1/servers/8cd29851-35c1-4032-a137-ab9419a2ec5b => generated 1322 bytes in 926 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 13 18:02:14.133313 dv-cinder-852009-8-iscsi devstack@n-api.service[120740]: DEBUG nova.api.openstack.wsgi [None req-878b2164-8981-46cd-a434-232731a41899 tempest-AttachVolumeShelveTestJSON-385853788 tempest-AttachVolumeShelveTestJSON-385853788-project] Calling method '>' {{(pid=120740) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 18:02:14.134395 dv-cinder-852009-8-iscsi devstack@n-api.service[120740]: DEBUG nova.compute.api [None req-878b2164-8981-46cd-a434-232731a41899 tempest-AttachVolumeShelveTestJSON-385853788 tempest-AttachVolumeShelveTestJSON-385853788-project] [instance: 11d2616a-96f9-4a7a-aab8-219219986a8b] Fetching instance by UUID {{(pid=120740) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 18:02:14.149933 dv-cinder-852009-8-iscsi devstack@n-api.service[120740]: DEBUG oslo_concurrency.lockutils [None req-878b2164-8981-46cd-a434-232731a41899 tempest-AttachVolumeShelveTestJSON-385853788 tempest-AttachVolumeShelveTestJSON-385853788-project] Acquiring lock "1daf4f4c-0e4a-4779-b53a-78c48397ea2f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120740) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 18:02:14.150645 dv-cinder-852009-8-iscsi devstack@n-api.service[120740]: DEBUG oslo_concurrency.lockutils [None req-878b2164-8981-46cd-a434-232731a41899 tempest-AttachVolumeShelveTestJSON-385853788 tempest-AttachVolumeShelveTestJSON-385853788-project] Lock "1daf4f4c-0e4a-4779-b53a-78c48397ea2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120740) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 18:02:14.152997 dv-cinder-852009-8-iscsi devstack@n-api.service[120740]: DEBUG oslo_concurrency.lockutils [None req-878b2164-8981-46cd-a434-232731a41899 tempest-AttachVolumeShelveTestJSON-385853788 tempest-AttachVolumeShelveTestJSON-385853788-project] Lock "1daf4f4c-0e4a-4779-b53a-78c48397ea2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120740) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 18:02:14.154066 dv-cinder-852009-8-iscsi devstack@n-api.service[120740]: DEBUG oslo_concurrency.lockutils [None req-878b2164-8981-46cd-a434-232731a41899 tempest-AttachVolumeShelveTestJSON-385853788 tempest-AttachVolumeShelveTestJSON-385853788-project] Acquiring lock "1daf4f4c-0e4a-4779-b53a-78c48397ea2f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120740) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 18:02:14.157423 dv-cinder-852009-8-iscsi devstack@n-api.service[120740]: DEBUG oslo_concurrency.lockutils [None req-878b2164-8981-46cd-a434-232731a41899 tempest-AttachVolumeShelveTestJSON-385853788 tempest-AttachVolumeShelveTestJSON-385853788-project] Lock "1daf4f4c-0e4a-4779-b53a-78c48397ea2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120740) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 18:02:14.160216 dv-cinder-852009-8-iscsi devstack@n-api.service[120740]: DEBUG oslo_concurrency.lockutils [None req-878b2164-8981-46cd-a434-232731a41899 tempest-AttachVolumeShelveTestJSON-385853788 tempest-AttachVolumeShelveTestJSON-385853788-project] Lock "1daf4f4c-0e4a-4779-b53a-78c48397ea2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=120740) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 18:02:14.436318 dv-cinder-852009-8-iscsi devstack@n-api.service[120741]: DEBUG nova.api.openstack.wsgi [None req-d5e2dea7-e9d8-48b0-be67-a6aecffc834e tempest-DeleteServersTestJSON-1632919649 tempest-DeleteServersTestJSON-1632919649-project] Calling method '>' {{(pid=120741) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 18:02:14.438137 dv-cinder-852009-8-iscsi devstack@n-api.service[120741]: DEBUG nova.compute.api [None req-d5e2dea7-e9d8-48b0-be67-a6aecffc834e tempest-DeleteServersTestJSON-1632919649 tempest-DeleteServersTestJSON-1632919649-project] [instance: 207d1d8d-58a4-4b99-aa09-1c5023c60784] Fetching instance by UUID {{(pid=120741) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 18:02:14.451102 dv-cinder-852009-8-iscsi devstack@n-api.service[120741]: DEBUG oslo_concurrency.lockutils [None req-d5e2dea7-e9d8-48b0-be67-a6aecffc834e tempest-DeleteServersTestJSON-1632919649 tempest-DeleteServersTestJSON-1632919649-project] Acquiring lock "1daf4f4c-0e4a-4779-b53a-78c48397ea2f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120741) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 18:02:14.451980 dv-cinder-852009-8-iscsi devstack@n-api.service[120741]: DEBUG oslo_concurrency.lockutils [None req-d5e2dea7-e9d8-48b0-be67-a6aecffc834e tempest-DeleteServersTestJSON-1632919649 tempest-DeleteServersTestJSON-1632919649-project] Lock "1daf4f4c-0e4a-4779-b53a-78c48397ea2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120741) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 18:02:14.454992 dv-cinder-852009-8-iscsi devstack@n-api.service[120741]: DEBUG oslo_concurrency.lockutils [None req-d5e2dea7-e9d8-48b0-be67-a6aecffc834e tempest-DeleteServersTestJSON-1632919649 tempest-DeleteServersTestJSON-1632919649-project] Lock "1daf4f4c-0e4a-4779-b53a-78c48397ea2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=120741) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 18:02:14.457141 dv-cinder-852009-8-iscsi devstack@n-api.service[120741]: DEBUG oslo_concurrency.lockutils [None req-d5e2dea7-e9d8-48b0-be67-a6aecffc834e tempest-DeleteServersTestJSON-1632919649 tempest-DeleteServersTestJSON-1632919649-project] Acquiring lock "1daf4f4c-0e4a-4779-b53a-78c48397ea2f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120741) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 18:02:14.460106 dv-cinder-852009-8-iscsi devstack@n-api.service[120741]: DEBUG oslo_concurrency.lockutils [None req-d5e2dea7-e9d8-48b0-be67-a6aecffc834e tempest-DeleteServersTestJSON-1632919649 tempest-DeleteServersTestJSON-1632919649-project] Lock "1daf4f4c-0e4a-4779-b53a-78c48397ea2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120741) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 18:02:14.461020 dv-cinder-852009-8-iscsi devstack@n-api.service[120741]: DEBUG oslo_concurrency.lockutils [None req-d5e2dea7-e9d8-48b0-be67-a6aecffc834e tempest-DeleteServersTestJSON-1632919649 tempest-DeleteServersTestJSON-1632919649-project] Lock "1daf4f4c-0e4a-4779-b53a-78c48397ea2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=120741) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 18:02:14.775914 dv-cinder-852009-8-iscsi devstack@n-api.service[120740]: DEBUG nova.policy [None req-878b2164-8981-46cd-a434-232731a41899 tempest-AttachVolumeShelveTestJSON-385853788 tempest-AttachVolumeShelveTestJSON-385853788-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e68ecd9b3ca643539b109f75bb242d6f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '75e14fd88bfb4cd896fa7b070a0fac47', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120740) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 18:02:14.784715 dv-cinder-852009-8-iscsi devstack@n-api.service[120740]: DEBUG nova.policy [None req-878b2164-8981-46cd-a434-232731a41899 tempest-AttachVolumeShelveTestJSON-385853788 tempest-AttachVolumeShelveTestJSON-385853788-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'e68ecd9b3ca643539b109f75bb242d6f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '75e14fd88bfb4cd896fa7b070a0fac47', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120740) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 18:02:14.796101 dv-cinder-852009-8-iscsi devstack@n-api.service[120740]: DEBUG nova.policy [None req-878b2164-8981-46cd-a434-232731a41899 tempest-AttachVolumeShelveTestJSON-385853788 tempest-AttachVolumeShelveTestJSON-385853788-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'e68ecd9b3ca643539b109f75bb242d6f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '75e14fd88bfb4cd896fa7b070a0fac47', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120740) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 18:02:14.797781 dv-cinder-852009-8-iscsi devstack@n-api.service[120740]: INFO nova.api.openstack.requestlog [None req-878b2164-8981-46cd-a434-232731a41899 tempest-AttachVolumeShelveTestJSON-385853788 tempest-AttachVolumeShelveTestJSON-385853788-project] 10.222.0.43 "GET /compute/v2.1/servers/11d2616a-96f9-4a7a-aab8-219219986a8b" status: 200 len: 1405 microversion: 2.20 time: 0.676014 Sep 13 18:02:14.798559 dv-cinder-852009-8-iscsi devstack@n-api.service[120740]: [pid: 120740|app: 0|req: 20/32] 10.222.0.43 () {60 vars in 1277 bytes} [Tue Sep 13 18:02:14 2022] GET /compute/v2.1/servers/11d2616a-96f9-4a7a-aab8-219219986a8b => generated 1405 bytes in 677 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 13 18:02:14.806332 dv-cinder-852009-8-iscsi devstack@n-api.service[120740]: DEBUG nova.api.openstack.wsgi [None req-35bb6ee7-1dae-4798-98c5-f72c27e49e21 tempest-AttachVolumeTestJSON-555093534 tempest-AttachVolumeTestJSON-555093534-project] Calling method '>' {{(pid=120740) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 18:02:14.809622 dv-cinder-852009-8-iscsi devstack@n-api.service[120740]: DEBUG nova.compute.api [None req-35bb6ee7-1dae-4798-98c5-f72c27e49e21 tempest-AttachVolumeTestJSON-555093534 tempest-AttachVolumeTestJSON-555093534-project] [instance: b958d409-df20-44c6-aa0e-58cb0a482edf] Fetching instance by UUID {{(pid=120740) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 18:02:14.833034 dv-cinder-852009-8-iscsi devstack@n-api.service[120740]: DEBUG oslo_concurrency.lockutils [None req-35bb6ee7-1dae-4798-98c5-f72c27e49e21 tempest-AttachVolumeTestJSON-555093534 tempest-AttachVolumeTestJSON-555093534-project] Acquiring lock "1daf4f4c-0e4a-4779-b53a-78c48397ea2f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120740) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 18:02:14.833826 dv-cinder-852009-8-iscsi devstack@n-api.service[120740]: DEBUG oslo_concurrency.lockutils [None req-35bb6ee7-1dae-4798-98c5-f72c27e49e21 tempest-AttachVolumeTestJSON-555093534 tempest-AttachVolumeTestJSON-555093534-project] Lock "1daf4f4c-0e4a-4779-b53a-78c48397ea2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120740) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 18:02:14.834468 dv-cinder-852009-8-iscsi devstack@n-api.service[120740]: DEBUG oslo_concurrency.lockutils [None req-35bb6ee7-1dae-4798-98c5-f72c27e49e21 tempest-AttachVolumeTestJSON-555093534 tempest-AttachVolumeTestJSON-555093534-project] Lock "1daf4f4c-0e4a-4779-b53a-78c48397ea2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120740) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 18:02:14.836302 dv-cinder-852009-8-iscsi devstack@n-api.service[120740]: DEBUG oslo_concurrency.lockutils [None req-35bb6ee7-1dae-4798-98c5-f72c27e49e21 tempest-AttachVolumeTestJSON-555093534 tempest-AttachVolumeTestJSON-555093534-project] Acquiring lock "1daf4f4c-0e4a-4779-b53a-78c48397ea2f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120740) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 18:02:14.838873 dv-cinder-852009-8-iscsi devstack@n-api.service[120740]: DEBUG oslo_concurrency.lockutils [None req-35bb6ee7-1dae-4798-98c5-f72c27e49e21 tempest-AttachVolumeTestJSON-555093534 tempest-AttachVolumeTestJSON-555093534-project] Lock "1daf4f4c-0e4a-4779-b53a-78c48397ea2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120740) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 18:02:14.839571 dv-cinder-852009-8-iscsi devstack@n-api.service[120740]: DEBUG oslo_concurrency.lockutils [None req-35bb6ee7-1dae-4798-98c5-f72c27e49e21 tempest-AttachVolumeTestJSON-555093534 tempest-AttachVolumeTestJSON-555093534-project] Lock "1daf4f4c-0e4a-4779-b53a-78c48397ea2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=120740) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 18:02:15.051892 dv-cinder-852009-8-iscsi devstack@n-api.service[120741]: DEBUG nova.policy [None req-d5e2dea7-e9d8-48b0-be67-a6aecffc834e tempest-DeleteServersTestJSON-1632919649 tempest-DeleteServersTestJSON-1632919649-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '51db5ef052144879b53979268ac4ceb5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '66136f123f5b4ad0a824920bbdf9d245', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120741) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 18:02:15.060808 dv-cinder-852009-8-iscsi devstack@n-api.service[120741]: INFO nova.api.openstack.requestlog [None req-d5e2dea7-e9d8-48b0-be67-a6aecffc834e tempest-DeleteServersTestJSON-1632919649 tempest-DeleteServersTestJSON-1632919649-project] 10.222.0.43 "GET /compute/v2.1/servers/207d1d8d-58a4-4b99-aa09-1c5023c60784" status: 200 len: 1315 microversion: 2.1 time: 0.630224 Sep 13 18:02:15.061396 dv-cinder-852009-8-iscsi devstack@n-api.service[120741]: [pid: 120741|app: 0|req: 13/33] 10.222.0.43 () {58 vars in 1236 bytes} [Tue Sep 13 18:02:14 2022] GET /compute/v2.1/servers/207d1d8d-58a4-4b99-aa09-1c5023c60784 => generated 1315 bytes in 632 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 13 18:02:15.082899 dv-cinder-852009-8-iscsi devstack@n-api.service[120741]: DEBUG nova.api.openstack.wsgi [None req-bd8155d8-bbae-4972-96ef-fa405336fe61 tempest-ServerRescueNegativeTestJSON-412251590 tempest-ServerRescueNegativeTestJSON-412251590-project] Calling method '>' {{(pid=120741) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 18:02:15.093780 dv-cinder-852009-8-iscsi devstack@n-api.service[120741]: DEBUG nova.compute.api [None req-bd8155d8-bbae-4972-96ef-fa405336fe61 tempest-ServerRescueNegativeTestJSON-412251590 tempest-ServerRescueNegativeTestJSON-412251590-project] [instance: 8cd29851-35c1-4032-a137-ab9419a2ec5b] Fetching instance by UUID {{(pid=120741) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 18:02:15.114442 dv-cinder-852009-8-iscsi devstack@n-api.service[120741]: DEBUG oslo_concurrency.lockutils [None req-bd8155d8-bbae-4972-96ef-fa405336fe61 tempest-ServerRescueNegativeTestJSON-412251590 tempest-ServerRescueNegativeTestJSON-412251590-project] Acquiring lock "1daf4f4c-0e4a-4779-b53a-78c48397ea2f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120741) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 18:02:15.116881 dv-cinder-852009-8-iscsi devstack@n-api.service[120741]: DEBUG oslo_concurrency.lockutils [None req-bd8155d8-bbae-4972-96ef-fa405336fe61 tempest-ServerRescueNegativeTestJSON-412251590 tempest-ServerRescueNegativeTestJSON-412251590-project] Lock "1daf4f4c-0e4a-4779-b53a-78c48397ea2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120741) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 18:02:15.117828 dv-cinder-852009-8-iscsi devstack@n-api.service[120741]: DEBUG oslo_concurrency.lockutils [None req-bd8155d8-bbae-4972-96ef-fa405336fe61 tempest-ServerRescueNegativeTestJSON-412251590 tempest-ServerRescueNegativeTestJSON-412251590-project] Lock "1daf4f4c-0e4a-4779-b53a-78c48397ea2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120741) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 18:02:15.119892 dv-cinder-852009-8-iscsi devstack@n-api.service[120741]: DEBUG oslo_concurrency.lockutils [None req-bd8155d8-bbae-4972-96ef-fa405336fe61 tempest-ServerRescueNegativeTestJSON-412251590 tempest-ServerRescueNegativeTestJSON-412251590-project] Acquiring lock "1daf4f4c-0e4a-4779-b53a-78c48397ea2f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120741) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 18:02:15.120604 dv-cinder-852009-8-iscsi devstack@n-api.service[120741]: DEBUG oslo_concurrency.lockutils [None req-bd8155d8-bbae-4972-96ef-fa405336fe61 tempest-ServerRescueNegativeTestJSON-412251590 tempest-ServerRescueNegativeTestJSON-412251590-project] Lock "1daf4f4c-0e4a-4779-b53a-78c48397ea2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120741) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 18:02:15.121257 dv-cinder-852009-8-iscsi devstack@n-api.service[120741]: DEBUG oslo_concurrency.lockutils [None req-bd8155d8-bbae-4972-96ef-fa405336fe61 tempest-ServerRescueNegativeTestJSON-412251590 tempest-ServerRescueNegativeTestJSON-412251590-project] Lock "1daf4f4c-0e4a-4779-b53a-78c48397ea2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120741) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 18:02:15.432253 dv-cinder-852009-8-iscsi devstack@n-api.service[120740]: DEBUG nova.policy [None req-35bb6ee7-1dae-4798-98c5-f72c27e49e21 tempest-AttachVolumeTestJSON-555093534 tempest-AttachVolumeTestJSON-555093534-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0625b3113ce044bbac4f6142eaade11c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a279fcbf274c4704a31a2b95061e1469', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120740) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 18:02:15.440878 dv-cinder-852009-8-iscsi devstack@n-api.service[120740]: INFO nova.api.openstack.requestlog [None req-35bb6ee7-1dae-4798-98c5-f72c27e49e21 tempest-AttachVolumeTestJSON-555093534 tempest-AttachVolumeTestJSON-555093534-project] 10.222.0.43 "GET /compute/v2.1/servers/b958d409-df20-44c6-aa0e-58cb0a482edf" status: 200 len: 1362 microversion: 2.1 time: 0.640526 Sep 13 18:02:15.441625 dv-cinder-852009-8-iscsi devstack@n-api.service[120740]: [pid: 120740|app: 0|req: 21/34] 10.222.0.43 () {58 vars in 1236 bytes} [Tue Sep 13 18:02:14 2022] GET /compute/v2.1/servers/b958d409-df20-44c6-aa0e-58cb0a482edf => generated 1362 bytes in 642 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 13 18:02:15.712688 dv-cinder-852009-8-iscsi devstack@n-api.service[120740]: DEBUG nova.api.openstack.wsgi [req-0e09f3f9-4fe9-4490-a86f-243de9965f4f req-196ce601-5619-4b98-8410-25ab7b40dd70 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "8cd29851-35c1-4032-a137-ab9419a2ec5b", "tag": "eb1bc841-d939-422b-b6e4-a6ed6ba2c0a1"}]} {{(pid=120740) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 13 18:02:15.731397 dv-cinder-852009-8-iscsi devstack@n-api.service[120740]: DEBUG oslo_concurrency.lockutils [req-0e09f3f9-4fe9-4490-a86f-243de9965f4f req-196ce601-5619-4b98-8410-25ab7b40dd70 service nova] Acquiring lock "1daf4f4c-0e4a-4779-b53a-78c48397ea2f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120740) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 18:02:15.731958 dv-cinder-852009-8-iscsi devstack@n-api.service[120740]: DEBUG oslo_concurrency.lockutils [req-0e09f3f9-4fe9-4490-a86f-243de9965f4f req-196ce601-5619-4b98-8410-25ab7b40dd70 service nova] Lock "1daf4f4c-0e4a-4779-b53a-78c48397ea2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120740) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 18:02:15.732355 dv-cinder-852009-8-iscsi devstack@n-api.service[120740]: DEBUG oslo_concurrency.lockutils [req-0e09f3f9-4fe9-4490-a86f-243de9965f4f req-196ce601-5619-4b98-8410-25ab7b40dd70 service nova] Lock "1daf4f4c-0e4a-4779-b53a-78c48397ea2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120740) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 18:02:15.747519 dv-cinder-852009-8-iscsi devstack@n-api.service[120740]: DEBUG dbcounter [-] [120740] Writing DB stats nova_cell1:SELECT=100 {{(pid=120740) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 18:02:15.761470 dv-cinder-852009-8-iscsi devstack@n-api.service[120740]: INFO nova.api.openstack.compute.server_external_events [req-0e09f3f9-4fe9-4490-a86f-243de9965f4f req-196ce601-5619-4b98-8410-25ab7b40dd70 service nova] Creating event network-changed:eb1bc841-d939-422b-b6e4-a6ed6ba2c0a1 for instance 8cd29851-35c1-4032-a137-ab9419a2ec5b on hv-cinder-85200 Sep 13 18:02:15.782989 dv-cinder-852009-8-iscsi devstack@n-api.service[120741]: DEBUG nova.policy [None req-bd8155d8-bbae-4972-96ef-fa405336fe61 tempest-ServerRescueNegativeTestJSON-412251590 tempest-ServerRescueNegativeTestJSON-412251590-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '60800cf2774e409d9c1b6f4992669991', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2eae4acecf6c4961830ead78d71b2ad3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120741) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 18:02:15.783907 dv-cinder-852009-8-iscsi devstack@n-api.service[120740]: INFO nova.api.openstack.requestlog [req-0e09f3f9-4fe9-4490-a86f-243de9965f4f req-196ce601-5619-4b98-8410-25ab7b40dd70 service nova] 10.222.0.43 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.339997 Sep 13 18:02:15.786935 dv-cinder-852009-8-iscsi devstack@n-api.service[120740]: [pid: 120740|app: 0|req: 22/35] 10.222.0.43 () {64 vars in 1317 bytes} [Tue Sep 13 18:02:15 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 344 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 13 18:02:15.795623 dv-cinder-852009-8-iscsi devstack@n-api.service[120741]: INFO nova.api.openstack.requestlog [None req-bd8155d8-bbae-4972-96ef-fa405336fe61 tempest-ServerRescueNegativeTestJSON-412251590 tempest-ServerRescueNegativeTestJSON-412251590-project] 10.222.0.43 "GET /compute/v2.1/servers/8cd29851-35c1-4032-a137-ab9419a2ec5b" status: 200 len: 1322 microversion: 2.1 time: 0.731289 Sep 13 18:02:15.798054 dv-cinder-852009-8-iscsi devstack@n-api.service[120741]: [pid: 120741|app: 0|req: 14/36] 10.222.0.43 () {58 vars in 1236 bytes} [Tue Sep 13 18:02:15 2022] GET /compute/v2.1/servers/8cd29851-35c1-4032-a137-ab9419a2ec5b => generated 1322 bytes in 734 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 13 18:02:15.829778 dv-cinder-852009-8-iscsi devstack@n-api.service[120740]: DEBUG nova.api.openstack.wsgi [None req-187373f1-ed5a-4461-a956-7f9e5fa05c6b tempest-AttachVolumeShelveTestJSON-385853788 tempest-AttachVolumeShelveTestJSON-385853788-project] Calling method '>' {{(pid=120740) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 18:02:15.830552 dv-cinder-852009-8-iscsi devstack@n-api.service[120740]: DEBUG nova.compute.api [None req-187373f1-ed5a-4461-a956-7f9e5fa05c6b tempest-AttachVolumeShelveTestJSON-385853788 tempest-AttachVolumeShelveTestJSON-385853788-project] [instance: 11d2616a-96f9-4a7a-aab8-219219986a8b] Fetching instance by UUID {{(pid=120740) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 18:02:15.843571 dv-cinder-852009-8-iscsi devstack@n-api.service[120740]: DEBUG oslo_concurrency.lockutils [None req-187373f1-ed5a-4461-a956-7f9e5fa05c6b tempest-AttachVolumeShelveTestJSON-385853788 tempest-AttachVolumeShelveTestJSON-385853788-project] Acquiring lock "1daf4f4c-0e4a-4779-b53a-78c48397ea2f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120740) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 18:02:15.844156 dv-cinder-852009-8-iscsi devstack@n-api.service[120740]: DEBUG oslo_concurrency.lockutils [None req-187373f1-ed5a-4461-a956-7f9e5fa05c6b tempest-AttachVolumeShelveTestJSON-385853788 tempest-AttachVolumeShelveTestJSON-385853788-project] Lock "1daf4f4c-0e4a-4779-b53a-78c48397ea2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120740) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 18:02:15.846447 dv-cinder-852009-8-iscsi devstack@n-api.service[120740]: DEBUG oslo_concurrency.lockutils [None req-187373f1-ed5a-4461-a956-7f9e5fa05c6b tempest-AttachVolumeShelveTestJSON-385853788 tempest-AttachVolumeShelveTestJSON-385853788-project] Lock "1daf4f4c-0e4a-4779-b53a-78c48397ea2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120740) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 18:02:15.848796 dv-cinder-852009-8-iscsi devstack@n-api.service[120740]: DEBUG oslo_concurrency.lockutils [None req-187373f1-ed5a-4461-a956-7f9e5fa05c6b tempest-AttachVolumeShelveTestJSON-385853788 tempest-AttachVolumeShelveTestJSON-385853788-project] Acquiring lock "1daf4f4c-0e4a-4779-b53a-78c48397ea2f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120740) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 18:02:15.849652 dv-cinder-852009-8-iscsi devstack@n-api.service[120740]: DEBUG oslo_concurrency.lockutils [None req-187373f1-ed5a-4461-a956-7f9e5fa05c6b tempest-AttachVolumeShelveTestJSON-385853788 tempest-AttachVolumeShelveTestJSON-385853788-project] Lock "1daf4f4c-0e4a-4779-b53a-78c48397ea2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120740) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 18:02:15.851388 dv-cinder-852009-8-iscsi devstack@n-api.service[120740]: DEBUG oslo_concurrency.lockutils [None req-187373f1-ed5a-4461-a956-7f9e5fa05c6b tempest-AttachVolumeShelveTestJSON-385853788 tempest-AttachVolumeShelveTestJSON-385853788-project] Lock "1daf4f4c-0e4a-4779-b53a-78c48397ea2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120740) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 18:02:16.087598 dv-cinder-852009-8-iscsi devstack@n-api.service[120741]: DEBUG nova.api.openstack.wsgi [None req-f27d6559-a124-4463-92a7-5e13f97e72a6 tempest-DeleteServersTestJSON-1632919649 tempest-DeleteServersTestJSON-1632919649-project] Calling method '>' {{(pid=120741) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 18:02:16.088888 dv-cinder-852009-8-iscsi devstack@n-api.service[120741]: DEBUG nova.compute.api [None req-f27d6559-a124-4463-92a7-5e13f97e72a6 tempest-DeleteServersTestJSON-1632919649 tempest-DeleteServersTestJSON-1632919649-project] [instance: 207d1d8d-58a4-4b99-aa09-1c5023c60784] Fetching instance by UUID {{(pid=120741) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 18:02:16.091556 dv-cinder-852009-8-iscsi devstack@n-api.service[120741]: DEBUG dbcounter [-] [120741] Writing DB stats nova_cell0:SELECT=4 {{(pid=120741) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 18:02:16.098793 dv-cinder-852009-8-iscsi devstack@n-api.service[120741]: DEBUG oslo_concurrency.lockutils [None req-f27d6559-a124-4463-92a7-5e13f97e72a6 tempest-DeleteServersTestJSON-1632919649 tempest-DeleteServersTestJSON-1632919649-project] Acquiring lock "1daf4f4c-0e4a-4779-b53a-78c48397ea2f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120741) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 18:02:16.099258 dv-cinder-852009-8-iscsi devstack@n-api.service[120741]: DEBUG oslo_concurrency.lockutils [None req-f27d6559-a124-4463-92a7-5e13f97e72a6 tempest-DeleteServersTestJSON-1632919649 tempest-DeleteServersTestJSON-1632919649-project] Lock "1daf4f4c-0e4a-4779-b53a-78c48397ea2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120741) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 18:02:16.099801 dv-cinder-852009-8-iscsi devstack@n-api.service[120741]: DEBUG oslo_concurrency.lockutils [None req-f27d6559-a124-4463-92a7-5e13f97e72a6 tempest-DeleteServersTestJSON-1632919649 tempest-DeleteServersTestJSON-1632919649-project] Lock "1daf4f4c-0e4a-4779-b53a-78c48397ea2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120741) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 18:02:16.100789 dv-cinder-852009-8-iscsi devstack@n-api.service[120741]: DEBUG oslo_concurrency.lockutils [None req-f27d6559-a124-4463-92a7-5e13f97e72a6 tempest-DeleteServersTestJSON-1632919649 tempest-DeleteServersTestJSON-1632919649-project] Acquiring lock "1daf4f4c-0e4a-4779-b53a-78c48397ea2f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120741) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 18:02:16.101417 dv-cinder-852009-8-iscsi devstack@n-api.service[120741]: DEBUG oslo_concurrency.lockutils [None req-f27d6559-a124-4463-92a7-5e13f97e72a6 tempest-DeleteServersTestJSON-1632919649 tempest-DeleteServersTestJSON-1632919649-project] Lock "1daf4f4c-0e4a-4779-b53a-78c48397ea2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120741) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 18:02:16.102184 dv-cinder-852009-8-iscsi devstack@n-api.service[120741]: DEBUG oslo_concurrency.lockutils [None req-f27d6559-a124-4463-92a7-5e13f97e72a6 tempest-DeleteServersTestJSON-1632919649 tempest-DeleteServersTestJSON-1632919649-project] Lock "1daf4f4c-0e4a-4779-b53a-78c48397ea2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120741) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 18:02:16.326056 dv-cinder-852009-8-iscsi devstack@n-api.service[120740]: DEBUG nova.policy [None req-187373f1-ed5a-4461-a956-7f9e5fa05c6b tempest-AttachVolumeShelveTestJSON-385853788 tempest-AttachVolumeShelveTestJSON-385853788-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e68ecd9b3ca643539b109f75bb242d6f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '75e14fd88bfb4cd896fa7b070a0fac47', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120740) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 18:02:16.335654 dv-cinder-852009-8-iscsi devstack@n-api.service[120740]: DEBUG nova.policy [None req-187373f1-ed5a-4461-a956-7f9e5fa05c6b tempest-AttachVolumeShelveTestJSON-385853788 tempest-AttachVolumeShelveTestJSON-385853788-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'e68ecd9b3ca643539b109f75bb242d6f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '75e14fd88bfb4cd896fa7b070a0fac47', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120740) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 18:02:16.337143 dv-cinder-852009-8-iscsi devstack@n-api.service[120740]: DEBUG nova.policy [None req-187373f1-ed5a-4461-a956-7f9e5fa05c6b tempest-AttachVolumeShelveTestJSON-385853788 tempest-AttachVolumeShelveTestJSON-385853788-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'e68ecd9b3ca643539b109f75bb242d6f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '75e14fd88bfb4cd896fa7b070a0fac47', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120740) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 18:02:16.338257 dv-cinder-852009-8-iscsi devstack@n-api.service[120740]: INFO nova.api.openstack.requestlog [None req-187373f1-ed5a-4461-a956-7f9e5fa05c6b tempest-AttachVolumeShelveTestJSON-385853788 tempest-AttachVolumeShelveTestJSON-385853788-project] 10.222.0.43 "GET /compute/v2.1/servers/11d2616a-96f9-4a7a-aab8-219219986a8b" status: 200 len: 1405 microversion: 2.20 time: 0.513507 Sep 13 18:02:16.339800 dv-cinder-852009-8-iscsi devstack@n-api.service[120740]: [pid: 120740|app: 0|req: 23/37] 10.222.0.43 () {60 vars in 1277 bytes} [Tue Sep 13 18:02:15 2022] GET /compute/v2.1/servers/11d2616a-96f9-4a7a-aab8-219219986a8b => generated 1405 bytes in 516 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 13 18:02:16.391734 dv-cinder-852009-8-iscsi devstack@n-api.service[120741]: DEBUG nova.policy [None req-f27d6559-a124-4463-92a7-5e13f97e72a6 tempest-DeleteServersTestJSON-1632919649 tempest-DeleteServersTestJSON-1632919649-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '51db5ef052144879b53979268ac4ceb5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '66136f123f5b4ad0a824920bbdf9d245', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120741) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 18:02:16.401172 dv-cinder-852009-8-iscsi devstack@n-api.service[120741]: INFO nova.api.openstack.requestlog [None req-f27d6559-a124-4463-92a7-5e13f97e72a6 tempest-DeleteServersTestJSON-1632919649 tempest-DeleteServersTestJSON-1632919649-project] 10.222.0.43 "GET /compute/v2.1/servers/207d1d8d-58a4-4b99-aa09-1c5023c60784" status: 200 len: 1315 microversion: 2.1 time: 0.318945 Sep 13 18:02:16.404404 dv-cinder-852009-8-iscsi devstack@n-api.service[120741]: [pid: 120741|app: 0|req: 15/38] 10.222.0.43 () {58 vars in 1236 bytes} [Tue Sep 13 18:02:16 2022] GET /compute/v2.1/servers/207d1d8d-58a4-4b99-aa09-1c5023c60784 => generated 1315 bytes in 323 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 13 18:02:16.468782 dv-cinder-852009-8-iscsi devstack@n-api.service[120740]: DEBUG nova.api.openstack.wsgi [None req-dabd4a0a-a0ad-4fcb-9a05-96cb58e783fe tempest-AttachVolumeTestJSON-555093534 tempest-AttachVolumeTestJSON-555093534-project] Calling method '>' {{(pid=120740) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 18:02:16.469392 dv-cinder-852009-8-iscsi devstack@n-api.service[120740]: DEBUG nova.compute.api [None req-dabd4a0a-a0ad-4fcb-9a05-96cb58e783fe tempest-AttachVolumeTestJSON-555093534 tempest-AttachVolumeTestJSON-555093534-project] [instance: b958d409-df20-44c6-aa0e-58cb0a482edf] Fetching instance by UUID {{(pid=120740) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 18:02:16.479314 dv-cinder-852009-8-iscsi devstack@n-api.service[120740]: DEBUG oslo_concurrency.lockutils [None req-dabd4a0a-a0ad-4fcb-9a05-96cb58e783fe tempest-AttachVolumeTestJSON-555093534 tempest-AttachVolumeTestJSON-555093534-project] Acquiring lock "1daf4f4c-0e4a-4779-b53a-78c48397ea2f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120740) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 18:02:16.479815 dv-cinder-852009-8-iscsi devstack@n-api.service[120740]: DEBUG oslo_concurrency.lockutils [None req-dabd4a0a-a0ad-4fcb-9a05-96cb58e783fe tempest-AttachVolumeTestJSON-555093534 tempest-AttachVolumeTestJSON-555093534-project] Lock "1daf4f4c-0e4a-4779-b53a-78c48397ea2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120740) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 18:02:16.480600 dv-cinder-852009-8-iscsi devstack@n-api.service[120740]: DEBUG oslo_concurrency.lockutils [None req-dabd4a0a-a0ad-4fcb-9a05-96cb58e783fe tempest-AttachVolumeTestJSON-555093534 tempest-AttachVolumeTestJSON-555093534-project] Lock "1daf4f4c-0e4a-4779-b53a-78c48397ea2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120740) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 18:02:16.481631 dv-cinder-852009-8-iscsi devstack@n-api.service[120740]: DEBUG oslo_concurrency.lockutils [None req-dabd4a0a-a0ad-4fcb-9a05-96cb58e783fe tempest-AttachVolumeTestJSON-555093534 tempest-AttachVolumeTestJSON-555093534-project] Acquiring lock "1daf4f4c-0e4a-4779-b53a-78c48397ea2f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120740) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 18:02:16.482450 dv-cinder-852009-8-iscsi devstack@n-api.service[120740]: DEBUG oslo_concurrency.lockutils [None req-dabd4a0a-a0ad-4fcb-9a05-96cb58e783fe tempest-AttachVolumeTestJSON-555093534 tempest-AttachVolumeTestJSON-555093534-project] Lock "1daf4f4c-0e4a-4779-b53a-78c48397ea2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120740) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 18:02:16.483373 dv-cinder-852009-8-iscsi devstack@n-api.service[120740]: DEBUG oslo_concurrency.lockutils [None req-dabd4a0a-a0ad-4fcb-9a05-96cb58e783fe tempest-AttachVolumeTestJSON-555093534 tempest-AttachVolumeTestJSON-555093534-project] Lock "1daf4f4c-0e4a-4779-b53a-78c48397ea2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120740) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 18:02:16.607594 dv-cinder-852009-8-iscsi devstack@n-api.service[120741]: DEBUG nova.api.openstack.wsgi [req-ec7274a8-9c04-43a2-b294-3c8d0bed814c req-3bdf57b7-907d-4b1b-bc5e-d6f0c9757840 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "b958d409-df20-44c6-aa0e-58cb0a482edf", "tag": "a5580dcb-2c75-47bc-91ef-409ee6db4bdc"}]} {{(pid=120741) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 13 18:02:16.613096 dv-cinder-852009-8-iscsi devstack@n-api.service[120741]: DEBUG dbcounter [-] [120741] Writing DB stats nova_cell0:SELECT=26 {{(pid=120741) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 18:02:16.622380 dv-cinder-852009-8-iscsi devstack@n-api.service[120741]: DEBUG oslo_concurrency.lockutils [req-ec7274a8-9c04-43a2-b294-3c8d0bed814c req-3bdf57b7-907d-4b1b-bc5e-d6f0c9757840 service nova] Acquiring lock "1daf4f4c-0e4a-4779-b53a-78c48397ea2f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120741) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 18:02:16.623017 dv-cinder-852009-8-iscsi devstack@n-api.service[120741]: DEBUG oslo_concurrency.lockutils [req-ec7274a8-9c04-43a2-b294-3c8d0bed814c req-3bdf57b7-907d-4b1b-bc5e-d6f0c9757840 service nova] Lock "1daf4f4c-0e4a-4779-b53a-78c48397ea2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120741) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 18:02:16.623527 dv-cinder-852009-8-iscsi devstack@n-api.service[120741]: DEBUG oslo_concurrency.lockutils [req-ec7274a8-9c04-43a2-b294-3c8d0bed814c req-3bdf57b7-907d-4b1b-bc5e-d6f0c9757840 service nova] Lock "1daf4f4c-0e4a-4779-b53a-78c48397ea2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120741) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 18:02:16.644452 dv-cinder-852009-8-iscsi devstack@n-api.service[120741]: INFO nova.api.openstack.compute.server_external_events [req-ec7274a8-9c04-43a2-b294-3c8d0bed814c req-3bdf57b7-907d-4b1b-bc5e-d6f0c9757840 service nova] Creating event network-changed:a5580dcb-2c75-47bc-91ef-409ee6db4bdc for instance b958d409-df20-44c6-aa0e-58cb0a482edf on hv-cinder-85200 Sep 13 18:02:16.645102 dv-cinder-852009-8-iscsi devstack@n-api.service[120741]: DEBUG oslo_concurrency.lockutils [req-ec7274a8-9c04-43a2-b294-3c8d0bed814c req-3bdf57b7-907d-4b1b-bc5e-d6f0c9757840 service nova] Acquiring lock "compute-rpcapi-router" {{(pid=120741) lock /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:312}} Sep 13 18:02:16.645666 dv-cinder-852009-8-iscsi devstack@n-api.service[120741]: DEBUG oslo_concurrency.lockutils [req-ec7274a8-9c04-43a2-b294-3c8d0bed814c req-3bdf57b7-907d-4b1b-bc5e-d6f0c9757840 service nova] Acquired lock "compute-rpcapi-router" {{(pid=120741) lock /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:315}} Sep 13 18:02:16.646869 dv-cinder-852009-8-iscsi devstack@n-api.service[120741]: DEBUG oslo_concurrency.lockutils [None req-54b67b14-6eae-40f8-b792-ff00ff6b601e None None] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120741) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 18:02:16.647411 dv-cinder-852009-8-iscsi devstack@n-api.service[120741]: DEBUG oslo_concurrency.lockutils [None req-54b67b14-6eae-40f8-b792-ff00ff6b601e None None] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120741) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 18:02:16.647919 dv-cinder-852009-8-iscsi devstack@n-api.service[120741]: DEBUG oslo_concurrency.lockutils [None req-54b67b14-6eae-40f8-b792-ff00ff6b601e None None] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120741) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 18:02:16.648733 dv-cinder-852009-8-iscsi devstack@n-api.service[120741]: DEBUG oslo_concurrency.lockutils [None req-54b67b14-6eae-40f8-b792-ff00ff6b601e None None] Acquiring lock "1daf4f4c-0e4a-4779-b53a-78c48397ea2f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120741) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 18:02:16.649266 dv-cinder-852009-8-iscsi devstack@n-api.service[120741]: DEBUG oslo_concurrency.lockutils [None req-54b67b14-6eae-40f8-b792-ff00ff6b601e None None] Lock "1daf4f4c-0e4a-4779-b53a-78c48397ea2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120741) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 18:02:16.649764 dv-cinder-852009-8-iscsi devstack@n-api.service[120741]: DEBUG oslo_concurrency.lockutils [None req-54b67b14-6eae-40f8-b792-ff00ff6b601e None None] Lock "1daf4f4c-0e4a-4779-b53a-78c48397ea2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120741) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 18:02:16.659171 dv-cinder-852009-8-iscsi devstack@n-api.service[120741]: INFO nova.compute.rpcapi [None req-54b67b14-6eae-40f8-b792-ff00ff6b601e None None] Automatically selected compute RPC version 6.1 from minimum service version 64 Sep 13 18:02:16.660161 dv-cinder-852009-8-iscsi devstack@n-api.service[120741]: DEBUG oslo_concurrency.lockutils [None req-54b67b14-6eae-40f8-b792-ff00ff6b601e None None] Releasing lock "compute-rpcapi-router" {{(pid=120741) lock /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:333}} Sep 13 18:02:16.682150 dv-cinder-852009-8-iscsi devstack@n-api.service[120741]: INFO nova.api.openstack.requestlog [None req-54b67b14-6eae-40f8-b792-ff00ff6b601e None None] 10.222.0.43 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.078820 Sep 13 18:02:16.684757 dv-cinder-852009-8-iscsi devstack@n-api.service[120741]: [pid: 120741|app: 0|req: 16/39] 10.222.0.43 () {64 vars in 1317 bytes} [Tue Sep 13 18:02:16 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 82 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 13 18:02:16.693569 dv-cinder-852009-8-iscsi devstack@n-api.service[120740]: DEBUG nova.policy [None req-dabd4a0a-a0ad-4fcb-9a05-96cb58e783fe tempest-AttachVolumeTestJSON-555093534 tempest-AttachVolumeTestJSON-555093534-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0625b3113ce044bbac4f6142eaade11c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a279fcbf274c4704a31a2b95061e1469', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120740) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 18:02:16.702010 dv-cinder-852009-8-iscsi devstack@n-api.service[120740]: INFO nova.api.openstack.requestlog [None req-dabd4a0a-a0ad-4fcb-9a05-96cb58e783fe tempest-AttachVolumeTestJSON-555093534 tempest-AttachVolumeTestJSON-555093534-project] 10.222.0.43 "GET /compute/v2.1/servers/b958d409-df20-44c6-aa0e-58cb0a482edf" status: 200 len: 1362 microversion: 2.1 time: 0.237400 Sep 13 18:02:16.702989 dv-cinder-852009-8-iscsi devstack@n-api.service[120740]: [pid: 120740|app: 0|req: 24/40] 10.222.0.43 () {58 vars in 1236 bytes} [Tue Sep 13 18:02:16 2022] GET /compute/v2.1/servers/b958d409-df20-44c6-aa0e-58cb0a482edf => generated 1362 bytes in 239 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 13 18:02:16.822204 dv-cinder-852009-8-iscsi devstack@n-api.service[120741]: DEBUG nova.api.openstack.wsgi [None req-3d666900-691a-4a00-9eae-28321a7ca3aa tempest-ServerRescueNegativeTestJSON-412251590 tempest-ServerRescueNegativeTestJSON-412251590-project] Calling method '>' {{(pid=120741) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 18:02:16.823011 dv-cinder-852009-8-iscsi devstack@n-api.service[120741]: DEBUG nova.compute.api [None req-3d666900-691a-4a00-9eae-28321a7ca3aa tempest-ServerRescueNegativeTestJSON-412251590 tempest-ServerRescueNegativeTestJSON-412251590-project] [instance: 8cd29851-35c1-4032-a137-ab9419a2ec5b] Fetching instance by UUID {{(pid=120741) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 18:02:16.829453 dv-cinder-852009-8-iscsi devstack@n-api.service[120741]: DEBUG oslo_concurrency.lockutils [None req-3d666900-691a-4a00-9eae-28321a7ca3aa tempest-ServerRescueNegativeTestJSON-412251590 tempest-ServerRescueNegativeTestJSON-412251590-project] Acquiring lock "1daf4f4c-0e4a-4779-b53a-78c48397ea2f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120741) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 18:02:16.829932 dv-cinder-852009-8-iscsi devstack@n-api.service[120741]: DEBUG oslo_concurrency.lockutils [None req-3d666900-691a-4a00-9eae-28321a7ca3aa tempest-ServerRescueNegativeTestJSON-412251590 tempest-ServerRescueNegativeTestJSON-412251590-project] Lock "1daf4f4c-0e4a-4779-b53a-78c48397ea2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120741) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 18:02:16.830373 dv-cinder-852009-8-iscsi devstack@n-api.service[120741]: DEBUG oslo_concurrency.lockutils [None req-3d666900-691a-4a00-9eae-28321a7ca3aa tempest-ServerRescueNegativeTestJSON-412251590 tempest-ServerRescueNegativeTestJSON-412251590-project] Lock "1daf4f4c-0e4a-4779-b53a-78c48397ea2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120741) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 18:02:16.831057 dv-cinder-852009-8-iscsi devstack@n-api.service[120741]: DEBUG oslo_concurrency.lockutils [None req-3d666900-691a-4a00-9eae-28321a7ca3aa tempest-ServerRescueNegativeTestJSON-412251590 tempest-ServerRescueNegativeTestJSON-412251590-project] Acquiring lock "1daf4f4c-0e4a-4779-b53a-78c48397ea2f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120741) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 18:02:16.831580 dv-cinder-852009-8-iscsi devstack@n-api.service[120741]: DEBUG oslo_concurrency.lockutils [None req-3d666900-691a-4a00-9eae-28321a7ca3aa tempest-ServerRescueNegativeTestJSON-412251590 tempest-ServerRescueNegativeTestJSON-412251590-project] Lock "1daf4f4c-0e4a-4779-b53a-78c48397ea2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120741) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 18:02:16.832010 dv-cinder-852009-8-iscsi devstack@n-api.service[120741]: DEBUG oslo_concurrency.lockutils [None req-3d666900-691a-4a00-9eae-28321a7ca3aa tempest-ServerRescueNegativeTestJSON-412251590 tempest-ServerRescueNegativeTestJSON-412251590-project] Lock "1daf4f4c-0e4a-4779-b53a-78c48397ea2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120741) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 18:02:16.977115 dv-cinder-852009-8-iscsi devstack@n-api.service[120741]: DEBUG nova.policy [None req-3d666900-691a-4a00-9eae-28321a7ca3aa tempest-ServerRescueNegativeTestJSON-412251590 tempest-ServerRescueNegativeTestJSON-412251590-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '60800cf2774e409d9c1b6f4992669991', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2eae4acecf6c4961830ead78d71b2ad3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120741) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 18:02:16.986711 dv-cinder-852009-8-iscsi devstack@n-api.service[120741]: INFO nova.api.openstack.requestlog [None req-3d666900-691a-4a00-9eae-28321a7ca3aa tempest-ServerRescueNegativeTestJSON-412251590 tempest-ServerRescueNegativeTestJSON-412251590-project] 10.222.0.43 "GET /compute/v2.1/servers/8cd29851-35c1-4032-a137-ab9419a2ec5b" status: 200 len: 1322 microversion: 2.1 time: 0.168736 Sep 13 18:02:16.987503 dv-cinder-852009-8-iscsi devstack@n-api.service[120741]: [pid: 120741|app: 0|req: 17/41] 10.222.0.43 () {58 vars in 1236 bytes} [Tue Sep 13 18:02:16 2022] GET /compute/v2.1/servers/8cd29851-35c1-4032-a137-ab9419a2ec5b => generated 1322 bytes in 170 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 13 18:02:17.369369 dv-cinder-852009-8-iscsi devstack@n-api.service[120740]: DEBUG nova.api.openstack.wsgi [None req-0270875e-f6a2-40f5-9b12-875889f608f2 tempest-AttachVolumeShelveTestJSON-385853788 tempest-AttachVolumeShelveTestJSON-385853788-project] Calling method '>' {{(pid=120740) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 18:02:17.370042 dv-cinder-852009-8-iscsi devstack@n-api.service[120740]: DEBUG nova.compute.api [None req-0270875e-f6a2-40f5-9b12-875889f608f2 tempest-AttachVolumeShelveTestJSON-385853788 tempest-AttachVolumeShelveTestJSON-385853788-project] [instance: 11d2616a-96f9-4a7a-aab8-219219986a8b] Fetching instance by UUID {{(pid=120740) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 18:02:17.376258 dv-cinder-852009-8-iscsi devstack@n-api.service[120740]: DEBUG oslo_concurrency.lockutils [None req-0270875e-f6a2-40f5-9b12-875889f608f2 tempest-AttachVolumeShelveTestJSON-385853788 tempest-AttachVolumeShelveTestJSON-385853788-project] Acquiring lock "1daf4f4c-0e4a-4779-b53a-78c48397ea2f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120740) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 18:02:17.376947 dv-cinder-852009-8-iscsi devstack@n-api.service[120740]: DEBUG oslo_concurrency.lockutils [None req-0270875e-f6a2-40f5-9b12-875889f608f2 tempest-AttachVolumeShelveTestJSON-385853788 tempest-AttachVolumeShelveTestJSON-385853788-project] Lock "1daf4f4c-0e4a-4779-b53a-78c48397ea2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120740) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 18:02:17.377374 dv-cinder-852009-8-iscsi devstack@n-api.service[120740]: DEBUG oslo_concurrency.lockutils [None req-0270875e-f6a2-40f5-9b12-875889f608f2 tempest-AttachVolumeShelveTestJSON-385853788 tempest-AttachVolumeShelveTestJSON-385853788-project] Lock "1daf4f4c-0e4a-4779-b53a-78c48397ea2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120740) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 18:02:17.378419 dv-cinder-852009-8-iscsi devstack@n-api.service[120740]: DEBUG oslo_concurrency.lockutils [None req-0270875e-f6a2-40f5-9b12-875889f608f2 tempest-AttachVolumeShelveTestJSON-385853788 tempest-AttachVolumeShelveTestJSON-385853788-project] Acquiring lock "1daf4f4c-0e4a-4779-b53a-78c48397ea2f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120740) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 18:02:17.378865 dv-cinder-852009-8-iscsi devstack@n-api.service[120740]: DEBUG oslo_concurrency.lockutils [None req-0270875e-f6a2-40f5-9b12-875889f608f2 tempest-AttachVolumeShelveTestJSON-385853788 tempest-AttachVolumeShelveTestJSON-385853788-project] Lock "1daf4f4c-0e4a-4779-b53a-78c48397ea2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120740) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 18:02:17.379288 dv-cinder-852009-8-iscsi devstack@n-api.service[120740]: DEBUG oslo_concurrency.lockutils [None req-0270875e-f6a2-40f5-9b12-875889f608f2 tempest-AttachVolumeShelveTestJSON-385853788 tempest-AttachVolumeShelveTestJSON-385853788-project] Lock "1daf4f4c-0e4a-4779-b53a-78c48397ea2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120740) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 18:02:17.423302 dv-cinder-852009-8-iscsi devstack@n-api.service[120741]: DEBUG nova.api.openstack.wsgi [None req-7ebada54-1bf3-469c-ab72-d8407aa074cb tempest-DeleteServersTestJSON-1632919649 tempest-DeleteServersTestJSON-1632919649-project] Calling method '>' {{(pid=120741) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 18:02:17.423815 dv-cinder-852009-8-iscsi devstack@n-api.service[120741]: DEBUG nova.compute.api [None req-7ebada54-1bf3-469c-ab72-d8407aa074cb tempest-DeleteServersTestJSON-1632919649 tempest-DeleteServersTestJSON-1632919649-project] [instance: 207d1d8d-58a4-4b99-aa09-1c5023c60784] Fetching instance by UUID {{(pid=120741) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 18:02:17.430994 dv-cinder-852009-8-iscsi devstack@n-api.service[120741]: DEBUG oslo_concurrency.lockutils [None req-7ebada54-1bf3-469c-ab72-d8407aa074cb tempest-DeleteServersTestJSON-1632919649 tempest-DeleteServersTestJSON-1632919649-project] Acquiring lock "1daf4f4c-0e4a-4779-b53a-78c48397ea2f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120741) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 18:02:17.431377 dv-cinder-852009-8-iscsi devstack@n-api.service[120741]: DEBUG oslo_concurrency.lockutils [None req-7ebada54-1bf3-469c-ab72-d8407aa074cb tempest-DeleteServersTestJSON-1632919649 tempest-DeleteServersTestJSON-1632919649-project] Lock "1daf4f4c-0e4a-4779-b53a-78c48397ea2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120741) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 18:02:17.431805 dv-cinder-852009-8-iscsi devstack@n-api.service[120741]: DEBUG oslo_concurrency.lockutils [None req-7ebada54-1bf3-469c-ab72-d8407aa074cb tempest-DeleteServersTestJSON-1632919649 tempest-DeleteServersTestJSON-1632919649-project] Lock "1daf4f4c-0e4a-4779-b53a-78c48397ea2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120741) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 18:02:17.432534 dv-cinder-852009-8-iscsi devstack@n-api.service[120741]: DEBUG oslo_concurrency.lockutils [None req-7ebada54-1bf3-469c-ab72-d8407aa074cb tempest-DeleteServersTestJSON-1632919649 tempest-DeleteServersTestJSON-1632919649-project] Acquiring lock "1daf4f4c-0e4a-4779-b53a-78c48397ea2f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120741) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 18:02:17.432982 dv-cinder-852009-8-iscsi devstack@n-api.service[120741]: DEBUG oslo_concurrency.lockutils [None req-7ebada54-1bf3-469c-ab72-d8407aa074cb tempest-DeleteServersTestJSON-1632919649 tempest-DeleteServersTestJSON-1632919649-project] Lock "1daf4f4c-0e4a-4779-b53a-78c48397ea2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120741) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 18:02:17.433396 dv-cinder-852009-8-iscsi devstack@n-api.service[120741]: DEBUG oslo_concurrency.lockutils [None req-7ebada54-1bf3-469c-ab72-d8407aa074cb tempest-DeleteServersTestJSON-1632919649 tempest-DeleteServersTestJSON-1632919649-project] Lock "1daf4f4c-0e4a-4779-b53a-78c48397ea2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120741) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 18:02:17.561855 dv-cinder-852009-8-iscsi devstack@n-api.service[120740]: DEBUG nova.policy [None req-0270875e-f6a2-40f5-9b12-875889f608f2 tempest-AttachVolumeShelveTestJSON-385853788 tempest-AttachVolumeShelveTestJSON-385853788-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e68ecd9b3ca643539b109f75bb242d6f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '75e14fd88bfb4cd896fa7b070a0fac47', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120740) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 18:02:17.570571 dv-cinder-852009-8-iscsi devstack@n-api.service[120740]: DEBUG nova.policy [None req-0270875e-f6a2-40f5-9b12-875889f608f2 tempest-AttachVolumeShelveTestJSON-385853788 tempest-AttachVolumeShelveTestJSON-385853788-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'e68ecd9b3ca643539b109f75bb242d6f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '75e14fd88bfb4cd896fa7b070a0fac47', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120740) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 18:02:17.572128 dv-cinder-852009-8-iscsi devstack@n-api.service[120740]: DEBUG nova.policy [None req-0270875e-f6a2-40f5-9b12-875889f608f2 tempest-AttachVolumeShelveTestJSON-385853788 tempest-AttachVolumeShelveTestJSON-385853788-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'e68ecd9b3ca643539b109f75bb242d6f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '75e14fd88bfb4cd896fa7b070a0fac47', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120740) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 18:02:17.573197 dv-cinder-852009-8-iscsi devstack@n-api.service[120740]: INFO nova.api.openstack.requestlog [None req-0270875e-f6a2-40f5-9b12-875889f608f2 tempest-AttachVolumeShelveTestJSON-385853788 tempest-AttachVolumeShelveTestJSON-385853788-project] 10.222.0.43 "GET /compute/v2.1/servers/11d2616a-96f9-4a7a-aab8-219219986a8b" status: 200 len: 1405 microversion: 2.20 time: 0.208116 Sep 13 18:02:17.574095 dv-cinder-852009-8-iscsi devstack@n-api.service[120740]: [pid: 120740|app: 0|req: 25/42] 10.222.0.43 () {60 vars in 1277 bytes} [Tue Sep 13 18:02:17 2022] GET /compute/v2.1/servers/11d2616a-96f9-4a7a-aab8-219219986a8b => generated 1405 bytes in 210 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Sep 13 18:02:17.603055 dv-cinder-852009-8-iscsi devstack@n-api.service[120741]: DEBUG nova.policy [None req-7ebada54-1bf3-469c-ab72-d8407aa074cb tempest-DeleteServersTestJSON-1632919649 tempest-DeleteServersTestJSON-1632919649-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '51db5ef052144879b53979268ac4ceb5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '66136f123f5b4ad0a824920bbdf9d245', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120741) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 18:02:17.610783 dv-cinder-852009-8-iscsi devstack@n-api.service[120741]: INFO nova.api.openstack.requestlog [None req-7ebada54-1bf3-469c-ab72-d8407aa074cb tempest-DeleteServersTestJSON-1632919649 tempest-DeleteServersTestJSON-1632919649-project] 10.222.0.43 "GET /compute/v2.1/servers/207d1d8d-58a4-4b99-aa09-1c5023c60784" status: 200 len: 1315 microversion: 2.1 time: 0.191501 Sep 13 18:02:17.611349 dv-cinder-852009-8-iscsi devstack@n-api.service[120741]: [pid: 120741|app: 0|req: 18/43] 10.222.0.43 () {58 vars in 1236 bytes} [Tue Sep 13 18:02:17 2022] GET /compute/v2.1/servers/207d1d8d-58a4-4b99-aa09-1c5023c60784 => generated 1315 bytes in 193 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 13 18:02:17.727664 dv-cinder-852009-8-iscsi devstack@n-api.service[120740]: DEBUG nova.api.openstack.wsgi [None req-ef88e9ab-f7ad-4cdf-80b7-49a86c410928 tempest-AttachVolumeTestJSON-555093534 tempest-AttachVolumeTestJSON-555093534-project] Calling method '>' {{(pid=120740) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 18:02:17.728191 dv-cinder-852009-8-iscsi devstack@n-api.service[120740]: DEBUG nova.compute.api [None req-ef88e9ab-f7ad-4cdf-80b7-49a86c410928 tempest-AttachVolumeTestJSON-555093534 tempest-AttachVolumeTestJSON-555093534-project] [instance: b958d409-df20-44c6-aa0e-58cb0a482edf] Fetching instance by UUID {{(pid=120740) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 18:02:17.734661 dv-cinder-852009-8-iscsi devstack@n-api.service[120740]: DEBUG oslo_concurrency.lockutils [None req-ef88e9ab-f7ad-4cdf-80b7-49a86c410928 tempest-AttachVolumeTestJSON-555093534 tempest-AttachVolumeTestJSON-555093534-project] Acquiring lock "1daf4f4c-0e4a-4779-b53a-78c48397ea2f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120740) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 18:02:17.735159 dv-cinder-852009-8-iscsi devstack@n-api.service[120740]: DEBUG oslo_concurrency.lockutils [None req-ef88e9ab-f7ad-4cdf-80b7-49a86c410928 tempest-AttachVolumeTestJSON-555093534 tempest-AttachVolumeTestJSON-555093534-project] Lock "1daf4f4c-0e4a-4779-b53a-78c48397ea2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120740) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 18:02:17.735595 dv-cinder-852009-8-iscsi devstack@n-api.service[120740]: DEBUG oslo_concurrency.lockutils [None req-ef88e9ab-f7ad-4cdf-80b7-49a86c410928 tempest-AttachVolumeTestJSON-555093534 tempest-AttachVolumeTestJSON-555093534-project] Lock "1daf4f4c-0e4a-4779-b53a-78c48397ea2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120740) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 18:02:17.736440 dv-cinder-852009-8-iscsi devstack@n-api.service[120740]: DEBUG oslo_concurrency.lockutils [None req-ef88e9ab-f7ad-4cdf-80b7-49a86c410928 tempest-AttachVolumeTestJSON-555093534 tempest-AttachVolumeTestJSON-555093534-project] Acquiring lock "1daf4f4c-0e4a-4779-b53a-78c48397ea2f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120740) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 18:02:17.736783 dv-cinder-852009-8-iscsi devstack@n-api.service[120740]: DEBUG oslo_concurrency.lockutils [None req-ef88e9ab-f7ad-4cdf-80b7-49a86c410928 tempest-AttachVolumeTestJSON-555093534 tempest-AttachVolumeTestJSON-555093534-project] Lock "1daf4f4c-0e4a-4779-b53a-78c48397ea2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120740) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 18:02:17.737210 dv-cinder-852009-8-iscsi devstack@n-api.service[120740]: DEBUG oslo_concurrency.lockutils [None req-ef88e9ab-f7ad-4cdf-80b7-49a86c410928 tempest-AttachVolumeTestJSON-555093534 tempest-AttachVolumeTestJSON-555093534-project] Lock "1daf4f4c-0e4a-4779-b53a-78c48397ea2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120740) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 18:02:17.805926 dv-cinder-852009-8-iscsi devstack@n-api.service[120741]: DEBUG nova.api.openstack.wsgi [req-fc4d90c9-589f-4778-8dee-40026b06afb8 req-9eacd924-f2be-48a6-9645-170b66e241a3 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "207d1d8d-58a4-4b99-aa09-1c5023c60784", "tag": "db9bff9b-84fc-4a92-8b2a-72aa37a0556d"}, {"name": "network-changed", "server_uuid": "11d2616a-96f9-4a7a-aab8-219219986a8b", "tag": "85bfb53c-ec3d-49bc-ade7-acdfac253331"}]} {{(pid=120741) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 13 18:02:17.811172 dv-cinder-852009-8-iscsi devstack@n-api.service[120741]: DEBUG dbcounter [-] [120741] Writing DB stats nova_api:SELECT=87,nova_api:INSERT=10 {{(pid=120741) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 18:02:17.818162 dv-cinder-852009-8-iscsi devstack@n-api.service[120741]: DEBUG oslo_concurrency.lockutils [req-fc4d90c9-589f-4778-8dee-40026b06afb8 req-9eacd924-f2be-48a6-9645-170b66e241a3 service nova] Acquiring lock "1daf4f4c-0e4a-4779-b53a-78c48397ea2f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120741) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 18:02:17.818678 dv-cinder-852009-8-iscsi devstack@n-api.service[120741]: DEBUG oslo_concurrency.lockutils [req-fc4d90c9-589f-4778-8dee-40026b06afb8 req-9eacd924-f2be-48a6-9645-170b66e241a3 service nova] Lock "1daf4f4c-0e4a-4779-b53a-78c48397ea2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120741) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 18:02:17.819726 dv-cinder-852009-8-iscsi devstack@n-api.service[120741]: DEBUG oslo_concurrency.lockutils [req-fc4d90c9-589f-4778-8dee-40026b06afb8 req-9eacd924-f2be-48a6-9645-170b66e241a3 service nova] Lock "1daf4f4c-0e4a-4779-b53a-78c48397ea2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120741) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 18:02:17.833017 dv-cinder-852009-8-iscsi devstack@n-api.service[120741]: INFO nova.api.openstack.compute.server_external_events [req-fc4d90c9-589f-4778-8dee-40026b06afb8 req-9eacd924-f2be-48a6-9645-170b66e241a3 service nova] Creating event network-changed:db9bff9b-84fc-4a92-8b2a-72aa37a0556d for instance 207d1d8d-58a4-4b99-aa09-1c5023c60784 on hv-cinder-85200 Sep 13 18:02:17.833690 dv-cinder-852009-8-iscsi devstack@n-api.service[120741]: INFO nova.api.openstack.compute.server_external_events [req-fc4d90c9-589f-4778-8dee-40026b06afb8 req-9eacd924-f2be-48a6-9645-170b66e241a3 service nova] Creating event network-changed:85bfb53c-ec3d-49bc-ade7-acdfac253331 for instance 11d2616a-96f9-4a7a-aab8-219219986a8b on hv-cinder-85200 Sep 13 18:02:17.839993 dv-cinder-852009-8-iscsi devstack@n-api.service[120741]: INFO nova.api.openstack.requestlog [req-fc4d90c9-589f-4778-8dee-40026b06afb8 req-9eacd924-f2be-48a6-9645-170b66e241a3 service nova] 10.222.0.43 "POST /compute/v2.1/os-server-external-events" status: 200 len: 346 microversion: 2.1 time: 0.037980 Sep 13 18:02:17.840673 dv-cinder-852009-8-iscsi devstack@n-api.service[120741]: [pid: 120741|app: 0|req: 19/44] 10.222.0.43 () {64 vars in 1317 bytes} [Tue Sep 13 18:02:17 2022] POST /compute/v2.1/os-server-external-events => generated 346 bytes in 39 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 13 18:02:17.872753 dv-cinder-852009-8-iscsi devstack@n-api.service[120740]: DEBUG nova.policy [None req-ef88e9ab-f7ad-4cdf-80b7-49a86c410928 tempest-AttachVolumeTestJSON-555093534 tempest-AttachVolumeTestJSON-555093534-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0625b3113ce044bbac4f6142eaade11c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a279fcbf274c4704a31a2b95061e1469', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120740) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 18:02:17.884850 dv-cinder-852009-8-iscsi devstack@n-api.service[120740]: INFO nova.api.openstack.requestlog [None req-ef88e9ab-f7ad-4cdf-80b7-49a86c410928 tempest-AttachVolumeTestJSON-555093534 tempest-AttachVolumeTestJSON-555093534-project] 10.222.0.43 "GET /compute/v2.1/servers/b958d409-df20-44c6-aa0e-58cb0a482edf" status: 200 len: 1362 microversion: 2.1 time: 0.161182 Sep 13 18:02:17.885629 dv-cinder-852009-8-iscsi devstack@n-api.service[120740]: [pid: 120740|app: 0|req: 26/45] 10.222.0.43 () {58 vars in 1236 bytes} [Tue Sep 13 18:02:17 2022] GET /compute/v2.1/servers/b958d409-df20-44c6-aa0e-58cb0a482edf => generated 1362 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 13 18:02:18.012742 dv-cinder-852009-8-iscsi devstack@n-api.service[120741]: DEBUG nova.api.openstack.wsgi [None req-cdef214c-9b50-4ca8-9c43-77a81366606e tempest-ServerRescueNegativeTestJSON-412251590 tempest-ServerRescueNegativeTestJSON-412251590-project] Calling method '>' {{(pid=120741) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 18:02:18.013368 dv-cinder-852009-8-iscsi devstack@n-api.service[120741]: DEBUG nova.compute.api [None req-cdef214c-9b50-4ca8-9c43-77a81366606e tempest-ServerRescueNegativeTestJSON-412251590 tempest-ServerRescueNegativeTestJSON-412251590-project] [instance: 8cd29851-35c1-4032-a137-ab9419a2ec5b] Fetching instance by UUID {{(pid=120741) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 18:02:18.020016 dv-cinder-852009-8-iscsi devstack@n-api.service[120741]: DEBUG oslo_concurrency.lockutils [None req-cdef214c-9b50-4ca8-9c43-77a81366606e tempest-ServerRescueNegativeTestJSON-412251590 tempest-ServerRescueNegativeTestJSON-412251590-project] Acquiring lock "1daf4f4c-0e4a-4779-b53a-78c48397ea2f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120741) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 18:02:18.020613 dv-cinder-852009-8-iscsi devstack@n-api.service[120741]: DEBUG oslo_concurrency.lockutils [None req-cdef214c-9b50-4ca8-9c43-77a81366606e tempest-ServerRescueNegativeTestJSON-412251590 tempest-ServerRescueNegativeTestJSON-412251590-project] Lock "1daf4f4c-0e4a-4779-b53a-78c48397ea2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120741) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 18:02:18.021144 dv-cinder-852009-8-iscsi devstack@n-api.service[120741]: DEBUG oslo_concurrency.lockutils [None req-cdef214c-9b50-4ca8-9c43-77a81366606e tempest-ServerRescueNegativeTestJSON-412251590 tempest-ServerRescueNegativeTestJSON-412251590-project] Lock "1daf4f4c-0e4a-4779-b53a-78c48397ea2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120741) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 18:02:18.021689 dv-cinder-852009-8-iscsi devstack@n-api.service[120741]: DEBUG oslo_concurrency.lockutils [None req-cdef214c-9b50-4ca8-9c43-77a81366606e tempest-ServerRescueNegativeTestJSON-412251590 tempest-ServerRescueNegativeTestJSON-412251590-project] Acquiring lock "1daf4f4c-0e4a-4779-b53a-78c48397ea2f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120741) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 18:02:18.022129 dv-cinder-852009-8-iscsi devstack@n-api.service[120741]: DEBUG oslo_concurrency.lockutils [None req-cdef214c-9b50-4ca8-9c43-77a81366606e tempest-ServerRescueNegativeTestJSON-412251590 tempest-ServerRescueNegativeTestJSON-412251590-project] Lock "1daf4f4c-0e4a-4779-b53a-78c48397ea2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120741) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 18:02:18.022550 dv-cinder-852009-8-iscsi devstack@n-api.service[120741]: DEBUG oslo_concurrency.lockutils [None req-cdef214c-9b50-4ca8-9c43-77a81366606e tempest-ServerRescueNegativeTestJSON-412251590 tempest-ServerRescueNegativeTestJSON-412251590-project] Lock "1daf4f4c-0e4a-4779-b53a-78c48397ea2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120741) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 18:02:18.331748 dv-cinder-852009-8-iscsi devstack@n-api.service[120741]: DEBUG nova.policy [None req-cdef214c-9b50-4ca8-9c43-77a81366606e tempest-ServerRescueNegativeTestJSON-412251590 tempest-ServerRescueNegativeTestJSON-412251590-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '60800cf2774e409d9c1b6f4992669991', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2eae4acecf6c4961830ead78d71b2ad3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120741) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 18:02:18.343158 dv-cinder-852009-8-iscsi devstack@n-api.service[120741]: INFO nova.api.openstack.requestlog [None req-cdef214c-9b50-4ca8-9c43-77a81366606e tempest-ServerRescueNegativeTestJSON-412251590 tempest-ServerRescueNegativeTestJSON-412251590-project] 10.222.0.43 "GET /compute/v2.1/servers/8cd29851-35c1-4032-a137-ab9419a2ec5b" status: 200 len: 1322 microversion: 2.1 time: 0.334751 Sep 13 18:02:18.345161 dv-cinder-852009-8-iscsi devstack@n-api.service[120741]: [pid: 120741|app: 0|req: 20/46] 10.222.0.43 () {58 vars in 1236 bytes} [Tue Sep 13 18:02:18 2022] GET /compute/v2.1/servers/8cd29851-35c1-4032-a137-ab9419a2ec5b => generated 1322 bytes in 337 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 13 18:02:18.599490 dv-cinder-852009-8-iscsi devstack@n-api.service[120740]: DEBUG nova.api.openstack.wsgi [None req-ea1e0766-494e-4b71-921b-ee3761375ca8 tempest-AttachVolumeShelveTestJSON-385853788 tempest-AttachVolumeShelveTestJSON-385853788-project] Calling method '>' {{(pid=120740) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 18:02:18.600820 dv-cinder-852009-8-iscsi devstack@n-api.service[120740]: DEBUG nova.compute.api [None req-ea1e0766-494e-4b71-921b-ee3761375ca8 tempest-AttachVolumeShelveTestJSON-385853788 tempest-AttachVolumeShelveTestJSON-385853788-project] [instance: 11d2616a-96f9-4a7a-aab8-219219986a8b] Fetching instance by UUID {{(pid=120740) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 18:02:18.607507 dv-cinder-852009-8-iscsi devstack@n-api.service[120740]: DEBUG oslo_concurrency.lockutils [None req-ea1e0766-494e-4b71-921b-ee3761375ca8 tempest-AttachVolumeShelveTestJSON-385853788 tempest-AttachVolumeShelveTestJSON-385853788-project] Acquiring lock "1daf4f4c-0e4a-4779-b53a-78c48397ea2f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120740) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 18:02:18.608174 dv-cinder-852009-8-iscsi devstack@n-api.service[120740]: DEBUG oslo_concurrency.lockutils [None req-ea1e0766-494e-4b71-921b-ee3761375ca8 tempest-AttachVolumeShelveTestJSON-385853788 tempest-AttachVolumeShelveTestJSON-385853788-project] Lock "1daf4f4c-0e4a-4779-b53a-78c48397ea2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120740) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 18:02:18.608682 dv-cinder-852009-8-iscsi devstack@n-api.service[120740]: DEBUG oslo_concurrency.lockutils [None req-ea1e0766-494e-4b71-921b-ee3761375ca8 tempest-AttachVolumeShelveTestJSON-385853788 tempest-AttachVolumeShelveTestJSON-385853788-project] Lock "1daf4f4c-0e4a-4779-b53a-78c48397ea2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120740) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 18:02:18.609378 dv-cinder-852009-8-iscsi devstack@n-api.service[120740]: DEBUG oslo_concurrency.lockutils [None req-ea1e0766-494e-4b71-921b-ee3761375ca8 tempest-AttachVolumeShelveTestJSON-385853788 tempest-AttachVolumeShelveTestJSON-385853788-project] Acquiring lock "1daf4f4c-0e4a-4779-b53a-78c48397ea2f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120740) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 18:02:18.609825 dv-cinder-852009-8-iscsi devstack@n-api.service[120740]: DEBUG oslo_concurrency.lockutils [None req-ea1e0766-494e-4b71-921b-ee3761375ca8 tempest-AttachVolumeShelveTestJSON-385853788 tempest-AttachVolumeShelveTestJSON-385853788-project] Lock "1daf4f4c-0e4a-4779-b53a-78c48397ea2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120740) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 18:02:18.610251 dv-cinder-852009-8-iscsi devstack@n-api.service[120740]: DEBUG oslo_concurrency.lockutils [None req-ea1e0766-494e-4b71-921b-ee3761375ca8 tempest-AttachVolumeShelveTestJSON-385853788 tempest-AttachVolumeShelveTestJSON-385853788-project] Lock "1daf4f4c-0e4a-4779-b53a-78c48397ea2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120740) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 18:02:18.633839 dv-cinder-852009-8-iscsi devstack@n-api.service[120741]: DEBUG nova.api.openstack.wsgi [None req-d577a5cc-27d9-4164-a574-f8e966fe6466 tempest-DeleteServersTestJSON-1632919649 tempest-DeleteServersTestJSON-1632919649-project] Calling method '>' {{(pid=120741) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 18:02:18.634697 dv-cinder-852009-8-iscsi devstack@n-api.service[120741]: DEBUG nova.compute.api [None req-d577a5cc-27d9-4164-a574-f8e966fe6466 tempest-DeleteServersTestJSON-1632919649 tempest-DeleteServersTestJSON-1632919649-project] [instance: 207d1d8d-58a4-4b99-aa09-1c5023c60784] Fetching instance by UUID {{(pid=120741) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 18:02:18.642396 dv-cinder-852009-8-iscsi devstack@n-api.service[120741]: DEBUG oslo_concurrency.lockutils [None req-d577a5cc-27d9-4164-a574-f8e966fe6466 tempest-DeleteServersTestJSON-1632919649 tempest-DeleteServersTestJSON-1632919649-project] Acquiring lock "1daf4f4c-0e4a-4779-b53a-78c48397ea2f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120741) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 18:02:18.644397 dv-cinder-852009-8-iscsi devstack@n-api.service[120741]: DEBUG oslo_concurrency.lockutils [None req-d577a5cc-27d9-4164-a574-f8e966fe6466 tempest-DeleteServersTestJSON-1632919649 tempest-DeleteServersTestJSON-1632919649-project] Lock "1daf4f4c-0e4a-4779-b53a-78c48397ea2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120741) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 18:02:18.647053 dv-cinder-852009-8-iscsi devstack@n-api.service[120741]: DEBUG oslo_concurrency.lockutils [None req-d577a5cc-27d9-4164-a574-f8e966fe6466 tempest-DeleteServersTestJSON-1632919649 tempest-DeleteServersTestJSON-1632919649-project] Lock "1daf4f4c-0e4a-4779-b53a-78c48397ea2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=120741) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 18:02:18.647966 dv-cinder-852009-8-iscsi devstack@n-api.service[120741]: DEBUG oslo_concurrency.lockutils [None req-d577a5cc-27d9-4164-a574-f8e966fe6466 tempest-DeleteServersTestJSON-1632919649 tempest-DeleteServersTestJSON-1632919649-project] Acquiring lock "1daf4f4c-0e4a-4779-b53a-78c48397ea2f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120741) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 18:02:18.649641 dv-cinder-852009-8-iscsi devstack@n-api.service[120741]: DEBUG oslo_concurrency.lockutils [None req-d577a5cc-27d9-4164-a574-f8e966fe6466 tempest-DeleteServersTestJSON-1632919649 tempest-DeleteServersTestJSON-1632919649-project] Lock "1daf4f4c-0e4a-4779-b53a-78c48397ea2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120741) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 18:02:18.650312 dv-cinder-852009-8-iscsi devstack@n-api.service[120741]: DEBUG oslo_concurrency.lockutils [None req-d577a5cc-27d9-4164-a574-f8e966fe6466 tempest-DeleteServersTestJSON-1632919649 tempest-DeleteServersTestJSON-1632919649-project] Lock "1daf4f4c-0e4a-4779-b53a-78c48397ea2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120741) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 18:02:18.879859 dv-cinder-852009-8-iscsi devstack@n-api.service[120740]: DEBUG nova.policy [None req-ea1e0766-494e-4b71-921b-ee3761375ca8 tempest-AttachVolumeShelveTestJSON-385853788 tempest-AttachVolumeShelveTestJSON-385853788-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e68ecd9b3ca643539b109f75bb242d6f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '75e14fd88bfb4cd896fa7b070a0fac47', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120740) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 18:02:18.885405 dv-cinder-852009-8-iscsi devstack@n-api.service[120740]: DEBUG nova.policy [None req-ea1e0766-494e-4b71-921b-ee3761375ca8 tempest-AttachVolumeShelveTestJSON-385853788 tempest-AttachVolumeShelveTestJSON-385853788-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'e68ecd9b3ca643539b109f75bb242d6f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '75e14fd88bfb4cd896fa7b070a0fac47', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120740) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 18:02:18.886871 dv-cinder-852009-8-iscsi devstack@n-api.service[120740]: DEBUG nova.policy [None req-ea1e0766-494e-4b71-921b-ee3761375ca8 tempest-AttachVolumeShelveTestJSON-385853788 tempest-AttachVolumeShelveTestJSON-385853788-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'e68ecd9b3ca643539b109f75bb242d6f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '75e14fd88bfb4cd896fa7b070a0fac47', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120740) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 18:02:18.888538 dv-cinder-852009-8-iscsi devstack@n-api.service[120740]: INFO nova.api.openstack.requestlog [None req-ea1e0766-494e-4b71-921b-ee3761375ca8 tempest-AttachVolumeShelveTestJSON-385853788 tempest-AttachVolumeShelveTestJSON-385853788-project] 10.222.0.43 "GET /compute/v2.1/servers/11d2616a-96f9-4a7a-aab8-219219986a8b" status: 200 len: 1405 microversion: 2.20 time: 0.293161 Sep 13 18:02:18.901116 dv-cinder-852009-8-iscsi devstack@n-api.service[120740]: [pid: 120740|app: 0|req: 27/47] 10.222.0.43 () {60 vars in 1277 bytes} [Tue Sep 13 18:02:18 2022] GET /compute/v2.1/servers/11d2616a-96f9-4a7a-aab8-219219986a8b => generated 1405 bytes in 307 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 13 18:02:18.913944 dv-cinder-852009-8-iscsi devstack@n-api.service[120740]: DEBUG nova.api.openstack.wsgi [None req-0534119c-a24e-49c1-bc75-37d18ca2a0aa tempest-AttachVolumeTestJSON-555093534 tempest-AttachVolumeTestJSON-555093534-project] Calling method '>' {{(pid=120740) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 18:02:18.914756 dv-cinder-852009-8-iscsi devstack@n-api.service[120740]: DEBUG nova.compute.api [None req-0534119c-a24e-49c1-bc75-37d18ca2a0aa tempest-AttachVolumeTestJSON-555093534 tempest-AttachVolumeTestJSON-555093534-project] [instance: b958d409-df20-44c6-aa0e-58cb0a482edf] Fetching instance by UUID {{(pid=120740) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 18:02:18.919457 dv-cinder-852009-8-iscsi devstack@n-api.service[120741]: DEBUG nova.policy [None req-d577a5cc-27d9-4164-a574-f8e966fe6466 tempest-DeleteServersTestJSON-1632919649 tempest-DeleteServersTestJSON-1632919649-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '51db5ef052144879b53979268ac4ceb5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '66136f123f5b4ad0a824920bbdf9d245', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120741) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 18:02:18.922392 dv-cinder-852009-8-iscsi devstack@n-api.service[120740]: DEBUG oslo_concurrency.lockutils [None req-0534119c-a24e-49c1-bc75-37d18ca2a0aa tempest-AttachVolumeTestJSON-555093534 tempest-AttachVolumeTestJSON-555093534-project] Acquiring lock "1daf4f4c-0e4a-4779-b53a-78c48397ea2f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120740) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 18:02:18.922908 dv-cinder-852009-8-iscsi devstack@n-api.service[120740]: DEBUG oslo_concurrency.lockutils [None req-0534119c-a24e-49c1-bc75-37d18ca2a0aa tempest-AttachVolumeTestJSON-555093534 tempest-AttachVolumeTestJSON-555093534-project] Lock "1daf4f4c-0e4a-4779-b53a-78c48397ea2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120740) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 18:02:18.923407 dv-cinder-852009-8-iscsi devstack@n-api.service[120740]: DEBUG oslo_concurrency.lockutils [None req-0534119c-a24e-49c1-bc75-37d18ca2a0aa tempest-AttachVolumeTestJSON-555093534 tempest-AttachVolumeTestJSON-555093534-project] Lock "1daf4f4c-0e4a-4779-b53a-78c48397ea2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120740) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 18:02:18.924119 dv-cinder-852009-8-iscsi devstack@n-api.service[120740]: DEBUG oslo_concurrency.lockutils [None req-0534119c-a24e-49c1-bc75-37d18ca2a0aa tempest-AttachVolumeTestJSON-555093534 tempest-AttachVolumeTestJSON-555093534-project] Acquiring lock "1daf4f4c-0e4a-4779-b53a-78c48397ea2f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120740) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 18:02:18.924611 dv-cinder-852009-8-iscsi devstack@n-api.service[120740]: DEBUG oslo_concurrency.lockutils [None req-0534119c-a24e-49c1-bc75-37d18ca2a0aa tempest-AttachVolumeTestJSON-555093534 tempest-AttachVolumeTestJSON-555093534-project] Lock "1daf4f4c-0e4a-4779-b53a-78c48397ea2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120740) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 18:02:18.925042 dv-cinder-852009-8-iscsi devstack@n-api.service[120740]: DEBUG oslo_concurrency.lockutils [None req-0534119c-a24e-49c1-bc75-37d18ca2a0aa tempest-AttachVolumeTestJSON-555093534 tempest-AttachVolumeTestJSON-555093534-project] Lock "1daf4f4c-0e4a-4779-b53a-78c48397ea2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120740) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 18:02:18.927394 dv-cinder-852009-8-iscsi devstack@n-api.service[120741]: INFO nova.api.openstack.requestlog [None req-d577a5cc-27d9-4164-a574-f8e966fe6466 tempest-DeleteServersTestJSON-1632919649 tempest-DeleteServersTestJSON-1632919649-project] 10.222.0.43 "GET /compute/v2.1/servers/207d1d8d-58a4-4b99-aa09-1c5023c60784" status: 200 len: 1315 microversion: 2.1 time: 0.297392 Sep 13 18:02:18.927969 dv-cinder-852009-8-iscsi devstack@n-api.service[120741]: [pid: 120741|app: 0|req: 21/48] 10.222.0.43 () {58 vars in 1236 bytes} [Tue Sep 13 18:02:18 2022] GET /compute/v2.1/servers/207d1d8d-58a4-4b99-aa09-1c5023c60784 => generated 1315 bytes in 299 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 13 18:02:19.052742 dv-cinder-852009-8-iscsi devstack@n-api.service[120740]: DEBUG nova.policy [None req-0534119c-a24e-49c1-bc75-37d18ca2a0aa tempest-AttachVolumeTestJSON-555093534 tempest-AttachVolumeTestJSON-555093534-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0625b3113ce044bbac4f6142eaade11c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a279fcbf274c4704a31a2b95061e1469', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120740) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 18:02:19.061061 dv-cinder-852009-8-iscsi devstack@n-api.service[120740]: INFO nova.api.openstack.requestlog [None req-0534119c-a24e-49c1-bc75-37d18ca2a0aa tempest-AttachVolumeTestJSON-555093534 tempest-AttachVolumeTestJSON-555093534-project] 10.222.0.43 "GET /compute/v2.1/servers/b958d409-df20-44c6-aa0e-58cb0a482edf" status: 200 len: 1362 microversion: 2.1 time: 0.151654 Sep 13 18:02:19.061602 dv-cinder-852009-8-iscsi devstack@n-api.service[120740]: [pid: 120740|app: 0|req: 28/49] 10.222.0.43 () {58 vars in 1236 bytes} [Tue Sep 13 18:02:18 2022] GET /compute/v2.1/servers/b958d409-df20-44c6-aa0e-58cb0a482edf => generated 1362 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 13 18:02:19.368936 dv-cinder-852009-8-iscsi devstack@n-api.service[120741]: DEBUG nova.api.openstack.wsgi [None req-cc8deb61-b8a1-473e-b3f1-5a06f355d18d tempest-ServerRescueNegativeTestJSON-412251590 tempest-ServerRescueNegativeTestJSON-412251590-project] Calling method '>' {{(pid=120741) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 18:02:19.369585 dv-cinder-852009-8-iscsi devstack@n-api.service[120741]: DEBUG nova.compute.api [None req-cc8deb61-b8a1-473e-b3f1-5a06f355d18d tempest-ServerRescueNegativeTestJSON-412251590 tempest-ServerRescueNegativeTestJSON-412251590-project] [instance: 8cd29851-35c1-4032-a137-ab9419a2ec5b] Fetching instance by UUID {{(pid=120741) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 18:02:19.381976 dv-cinder-852009-8-iscsi devstack@n-api.service[120741]: DEBUG oslo_concurrency.lockutils [None req-cc8deb61-b8a1-473e-b3f1-5a06f355d18d tempest-ServerRescueNegativeTestJSON-412251590 tempest-ServerRescueNegativeTestJSON-412251590-project] Acquiring lock "1daf4f4c-0e4a-4779-b53a-78c48397ea2f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120741) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 18:02:19.382525 dv-cinder-852009-8-iscsi devstack@n-api.service[120741]: DEBUG oslo_concurrency.lockutils [None req-cc8deb61-b8a1-473e-b3f1-5a06f355d18d tempest-ServerRescueNegativeTestJSON-412251590 tempest-ServerRescueNegativeTestJSON-412251590-project] Lock "1daf4f4c-0e4a-4779-b53a-78c48397ea2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120741) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 18:02:19.382942 dv-cinder-852009-8-iscsi devstack@n-api.service[120741]: DEBUG oslo_concurrency.lockutils [None req-cc8deb61-b8a1-473e-b3f1-5a06f355d18d tempest-ServerRescueNegativeTestJSON-412251590 tempest-ServerRescueNegativeTestJSON-412251590-project] Lock "1daf4f4c-0e4a-4779-b53a-78c48397ea2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120741) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 18:02:19.383806 dv-cinder-852009-8-iscsi devstack@n-api.service[120741]: DEBUG oslo_concurrency.lockutils [None req-cc8deb61-b8a1-473e-b3f1-5a06f355d18d tempest-ServerRescueNegativeTestJSON-412251590 tempest-ServerRescueNegativeTestJSON-412251590-project] Acquiring lock "1daf4f4c-0e4a-4779-b53a-78c48397ea2f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120741) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 18:02:19.384404 dv-cinder-852009-8-iscsi devstack@n-api.service[120741]: DEBUG oslo_concurrency.lockutils [None req-cc8deb61-b8a1-473e-b3f1-5a06f355d18d tempest-ServerRescueNegativeTestJSON-412251590 tempest-ServerRescueNegativeTestJSON-412251590-project] Lock "1daf4f4c-0e4a-4779-b53a-78c48397ea2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120741) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 18:02:19.384987 dv-cinder-852009-8-iscsi devstack@n-api.service[120741]: DEBUG oslo_concurrency.lockutils [None req-cc8deb61-b8a1-473e-b3f1-5a06f355d18d tempest-ServerRescueNegativeTestJSON-412251590 tempest-ServerRescueNegativeTestJSON-412251590-project] Lock "1daf4f4c-0e4a-4779-b53a-78c48397ea2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120741) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 18:02:19.570483 dv-cinder-852009-8-iscsi devstack@n-api.service[120741]: DEBUG nova.policy [None req-cc8deb61-b8a1-473e-b3f1-5a06f355d18d tempest-ServerRescueNegativeTestJSON-412251590 tempest-ServerRescueNegativeTestJSON-412251590-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '60800cf2774e409d9c1b6f4992669991', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2eae4acecf6c4961830ead78d71b2ad3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120741) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 18:02:19.575599 dv-cinder-852009-8-iscsi devstack@n-api.service[120741]: INFO nova.api.openstack.requestlog [None req-cc8deb61-b8a1-473e-b3f1-5a06f355d18d tempest-ServerRescueNegativeTestJSON-412251590 tempest-ServerRescueNegativeTestJSON-412251590-project] 10.222.0.43 "GET /compute/v2.1/servers/8cd29851-35c1-4032-a137-ab9419a2ec5b" status: 200 len: 1322 microversion: 2.1 time: 0.210685 Sep 13 18:02:19.579898 dv-cinder-852009-8-iscsi devstack@n-api.service[120741]: [pid: 120741|app: 0|req: 22/50] 10.222.0.43 () {58 vars in 1236 bytes} [Tue Sep 13 18:02:19 2022] GET /compute/v2.1/servers/8cd29851-35c1-4032-a137-ab9419a2ec5b => generated 1322 bytes in 216 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 13 18:02:19.927555 dv-cinder-852009-8-iscsi devstack@n-api.service[120740]: DEBUG nova.api.openstack.wsgi [None req-b685aa71-beb9-4039-a8e4-1f04e2a4069d tempest-AttachVolumeShelveTestJSON-385853788 tempest-AttachVolumeShelveTestJSON-385853788-project] Calling method '>' {{(pid=120740) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 18:02:19.928566 dv-cinder-852009-8-iscsi devstack@n-api.service[120740]: DEBUG nova.compute.api [None req-b685aa71-beb9-4039-a8e4-1f04e2a4069d tempest-AttachVolumeShelveTestJSON-385853788 tempest-AttachVolumeShelveTestJSON-385853788-project] [instance: 11d2616a-96f9-4a7a-aab8-219219986a8b] Fetching instance by UUID {{(pid=120740) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 18:02:19.931690 dv-cinder-852009-8-iscsi devstack@n-api.service[120740]: DEBUG dbcounter [-] [120740] Writing DB stats nova_api:SELECT=92,nova_api:INSERT=7 {{(pid=120740) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 18:02:19.940159 dv-cinder-852009-8-iscsi devstack@n-api.service[120740]: DEBUG oslo_concurrency.lockutils [None req-b685aa71-beb9-4039-a8e4-1f04e2a4069d tempest-AttachVolumeShelveTestJSON-385853788 tempest-AttachVolumeShelveTestJSON-385853788-project] Acquiring lock "1daf4f4c-0e4a-4779-b53a-78c48397ea2f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120740) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 18:02:19.940969 dv-cinder-852009-8-iscsi devstack@n-api.service[120740]: DEBUG oslo_concurrency.lockutils [None req-b685aa71-beb9-4039-a8e4-1f04e2a4069d tempest-AttachVolumeShelveTestJSON-385853788 tempest-AttachVolumeShelveTestJSON-385853788-project] Lock "1daf4f4c-0e4a-4779-b53a-78c48397ea2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120740) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 18:02:19.941570 dv-cinder-852009-8-iscsi devstack@n-api.service[120740]: DEBUG oslo_concurrency.lockutils [None req-b685aa71-beb9-4039-a8e4-1f04e2a4069d tempest-AttachVolumeShelveTestJSON-385853788 tempest-AttachVolumeShelveTestJSON-385853788-project] Lock "1daf4f4c-0e4a-4779-b53a-78c48397ea2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120740) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 18:02:19.942675 dv-cinder-852009-8-iscsi devstack@n-api.service[120740]: DEBUG oslo_concurrency.lockutils [None req-b685aa71-beb9-4039-a8e4-1f04e2a4069d tempest-AttachVolumeShelveTestJSON-385853788 tempest-AttachVolumeShelveTestJSON-385853788-project] Acquiring lock "1daf4f4c-0e4a-4779-b53a-78c48397ea2f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120740) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 18:02:19.943103 dv-cinder-852009-8-iscsi devstack@n-api.service[120740]: DEBUG oslo_concurrency.lockutils [None req-b685aa71-beb9-4039-a8e4-1f04e2a4069d tempest-AttachVolumeShelveTestJSON-385853788 tempest-AttachVolumeShelveTestJSON-385853788-project] Lock "1daf4f4c-0e4a-4779-b53a-78c48397ea2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120740) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 18:02:19.943522 dv-cinder-852009-8-iscsi devstack@n-api.service[120740]: DEBUG oslo_concurrency.lockutils [None req-b685aa71-beb9-4039-a8e4-1f04e2a4069d tempest-AttachVolumeShelveTestJSON-385853788 tempest-AttachVolumeShelveTestJSON-385853788-project] Lock "1daf4f4c-0e4a-4779-b53a-78c48397ea2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120740) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 18:02:19.953116 dv-cinder-852009-8-iscsi devstack@n-api.service[120741]: DEBUG nova.api.openstack.wsgi [None req-c8eda49c-14ee-4402-9bf7-d5c74d66e5b2 tempest-DeleteServersTestJSON-1632919649 tempest-DeleteServersTestJSON-1632919649-project] Calling method '>' {{(pid=120741) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 18:02:19.953775 dv-cinder-852009-8-iscsi devstack@n-api.service[120741]: DEBUG nova.compute.api [None req-c8eda49c-14ee-4402-9bf7-d5c74d66e5b2 tempest-DeleteServersTestJSON-1632919649 tempest-DeleteServersTestJSON-1632919649-project] [instance: 207d1d8d-58a4-4b99-aa09-1c5023c60784] Fetching instance by UUID {{(pid=120741) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 18:02:19.960019 dv-cinder-852009-8-iscsi devstack@n-api.service[120741]: DEBUG oslo_concurrency.lockutils [None req-c8eda49c-14ee-4402-9bf7-d5c74d66e5b2 tempest-DeleteServersTestJSON-1632919649 tempest-DeleteServersTestJSON-1632919649-project] Acquiring lock "1daf4f4c-0e4a-4779-b53a-78c48397ea2f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120741) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 18:02:19.960529 dv-cinder-852009-8-iscsi devstack@n-api.service[120741]: DEBUG oslo_concurrency.lockutils [None req-c8eda49c-14ee-4402-9bf7-d5c74d66e5b2 tempest-DeleteServersTestJSON-1632919649 tempest-DeleteServersTestJSON-1632919649-project] Lock "1daf4f4c-0e4a-4779-b53a-78c48397ea2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120741) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 18:02:19.960938 dv-cinder-852009-8-iscsi devstack@n-api.service[120741]: DEBUG oslo_concurrency.lockutils [None req-c8eda49c-14ee-4402-9bf7-d5c74d66e5b2 tempest-DeleteServersTestJSON-1632919649 tempest-DeleteServersTestJSON-1632919649-project] Lock "1daf4f4c-0e4a-4779-b53a-78c48397ea2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120741) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 18:02:19.961660 dv-cinder-852009-8-iscsi devstack@n-api.service[120741]: DEBUG oslo_concurrency.lockutils [None req-c8eda49c-14ee-4402-9bf7-d5c74d66e5b2 tempest-DeleteServersTestJSON-1632919649 tempest-DeleteServersTestJSON-1632919649-project] Acquiring lock "1daf4f4c-0e4a-4779-b53a-78c48397ea2f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120741) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 18:02:19.962135 dv-cinder-852009-8-iscsi devstack@n-api.service[120741]: DEBUG oslo_concurrency.lockutils [None req-c8eda49c-14ee-4402-9bf7-d5c74d66e5b2 tempest-DeleteServersTestJSON-1632919649 tempest-DeleteServersTestJSON-1632919649-project] Lock "1daf4f4c-0e4a-4779-b53a-78c48397ea2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120741) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 18:02:19.962700 dv-cinder-852009-8-iscsi devstack@n-api.service[120741]: DEBUG oslo_concurrency.lockutils [None req-c8eda49c-14ee-4402-9bf7-d5c74d66e5b2 tempest-DeleteServersTestJSON-1632919649 tempest-DeleteServersTestJSON-1632919649-project] Lock "1daf4f4c-0e4a-4779-b53a-78c48397ea2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120741) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 18:02:20.136408 dv-cinder-852009-8-iscsi devstack@n-api.service[120740]: DEBUG nova.policy [None req-b685aa71-beb9-4039-a8e4-1f04e2a4069d tempest-AttachVolumeShelveTestJSON-385853788 tempest-AttachVolumeShelveTestJSON-385853788-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e68ecd9b3ca643539b109f75bb242d6f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '75e14fd88bfb4cd896fa7b070a0fac47', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120740) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 18:02:20.144298 dv-cinder-852009-8-iscsi devstack@n-api.service[120741]: DEBUG nova.policy [None req-c8eda49c-14ee-4402-9bf7-d5c74d66e5b2 tempest-DeleteServersTestJSON-1632919649 tempest-DeleteServersTestJSON-1632919649-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '51db5ef052144879b53979268ac4ceb5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '66136f123f5b4ad0a824920bbdf9d245', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120741) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 18:02:20.146343 dv-cinder-852009-8-iscsi devstack@n-api.service[120740]: DEBUG nova.policy [None req-b685aa71-beb9-4039-a8e4-1f04e2a4069d tempest-AttachVolumeShelveTestJSON-385853788 tempest-AttachVolumeShelveTestJSON-385853788-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'e68ecd9b3ca643539b109f75bb242d6f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '75e14fd88bfb4cd896fa7b070a0fac47', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120740) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 18:02:20.147835 dv-cinder-852009-8-iscsi devstack@n-api.service[120740]: DEBUG nova.policy [None req-b685aa71-beb9-4039-a8e4-1f04e2a4069d tempest-AttachVolumeShelveTestJSON-385853788 tempest-AttachVolumeShelveTestJSON-385853788-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'e68ecd9b3ca643539b109f75bb242d6f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '75e14fd88bfb4cd896fa7b070a0fac47', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120740) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 18:02:20.148289 dv-cinder-852009-8-iscsi devstack@n-api.service[120741]: DEBUG dbcounter [-] [120741] Writing DB stats nova_cell1:SELECT=100 {{(pid=120741) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 18:02:20.149257 dv-cinder-852009-8-iscsi devstack@n-api.service[120740]: INFO nova.api.openstack.requestlog [None req-b685aa71-beb9-4039-a8e4-1f04e2a4069d tempest-AttachVolumeShelveTestJSON-385853788 tempest-AttachVolumeShelveTestJSON-385853788-project] 10.222.0.43 "GET /compute/v2.1/servers/11d2616a-96f9-4a7a-aab8-219219986a8b" status: 200 len: 1405 microversion: 2.20 time: 0.235494 Sep 13 18:02:20.149580 dv-cinder-852009-8-iscsi devstack@n-api.service[120740]: [pid: 120740|app: 0|req: 29/51] 10.222.0.43 () {60 vars in 1277 bytes} [Tue Sep 13 18:02:19 2022] GET /compute/v2.1/servers/11d2616a-96f9-4a7a-aab8-219219986a8b => generated 1405 bytes in 237 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 13 18:02:20.153448 dv-cinder-852009-8-iscsi devstack@n-api.service[120741]: INFO nova.api.openstack.requestlog [None req-c8eda49c-14ee-4402-9bf7-d5c74d66e5b2 tempest-DeleteServersTestJSON-1632919649 tempest-DeleteServersTestJSON-1632919649-project] 10.222.0.43 "GET /compute/v2.1/servers/207d1d8d-58a4-4b99-aa09-1c5023c60784" status: 200 len: 1315 microversion: 2.1 time: 0.205556 Sep 13 18:02:20.154212 dv-cinder-852009-8-iscsi devstack@n-api.service[120741]: [pid: 120741|app: 0|req: 23/52] 10.222.0.43 () {58 vars in 1236 bytes} [Tue Sep 13 18:02:19 2022] GET /compute/v2.1/servers/207d1d8d-58a4-4b99-aa09-1c5023c60784 => generated 1315 bytes in 207 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 13 18:02:20.154521 dv-cinder-852009-8-iscsi devstack@n-api.service[120740]: DEBUG nova.api.openstack.wsgi [None req-6b0043a7-da2c-449f-910f-4698948ea71f tempest-AttachVolumeTestJSON-555093534 tempest-AttachVolumeTestJSON-555093534-project] Calling method '>' {{(pid=120740) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 18:02:20.155126 dv-cinder-852009-8-iscsi devstack@n-api.service[120740]: DEBUG nova.compute.api [None req-6b0043a7-da2c-449f-910f-4698948ea71f tempest-AttachVolumeTestJSON-555093534 tempest-AttachVolumeTestJSON-555093534-project] [instance: b958d409-df20-44c6-aa0e-58cb0a482edf] Fetching instance by UUID {{(pid=120740) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 18:02:20.157209 dv-cinder-852009-8-iscsi devstack@n-api.service[120740]: DEBUG dbcounter [-] [120740] Writing DB stats nova_cell0:SELECT=6 {{(pid=120740) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 18:02:20.162895 dv-cinder-852009-8-iscsi devstack@n-api.service[120740]: DEBUG oslo_concurrency.lockutils [None req-6b0043a7-da2c-449f-910f-4698948ea71f tempest-AttachVolumeTestJSON-555093534 tempest-AttachVolumeTestJSON-555093534-project] Acquiring lock "1daf4f4c-0e4a-4779-b53a-78c48397ea2f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120740) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 18:02:20.163384 dv-cinder-852009-8-iscsi devstack@n-api.service[120740]: DEBUG oslo_concurrency.lockutils [None req-6b0043a7-da2c-449f-910f-4698948ea71f tempest-AttachVolumeTestJSON-555093534 tempest-AttachVolumeTestJSON-555093534-project] Lock "1daf4f4c-0e4a-4779-b53a-78c48397ea2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120740) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 18:02:20.163817 dv-cinder-852009-8-iscsi devstack@n-api.service[120740]: DEBUG oslo_concurrency.lockutils [None req-6b0043a7-da2c-449f-910f-4698948ea71f tempest-AttachVolumeTestJSON-555093534 tempest-AttachVolumeTestJSON-555093534-project] Lock "1daf4f4c-0e4a-4779-b53a-78c48397ea2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120740) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 18:02:20.164547 dv-cinder-852009-8-iscsi devstack@n-api.service[120740]: DEBUG oslo_concurrency.lockutils [None req-6b0043a7-da2c-449f-910f-4698948ea71f tempest-AttachVolumeTestJSON-555093534 tempest-AttachVolumeTestJSON-555093534-project] Acquiring lock "1daf4f4c-0e4a-4779-b53a-78c48397ea2f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120740) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 18:02:20.165083 dv-cinder-852009-8-iscsi devstack@n-api.service[120740]: DEBUG oslo_concurrency.lockutils [None req-6b0043a7-da2c-449f-910f-4698948ea71f tempest-AttachVolumeTestJSON-555093534 tempest-AttachVolumeTestJSON-555093534-project] Lock "1daf4f4c-0e4a-4779-b53a-78c48397ea2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120740) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 18:02:20.165486 dv-cinder-852009-8-iscsi devstack@n-api.service[120740]: DEBUG oslo_concurrency.lockutils [None req-6b0043a7-da2c-449f-910f-4698948ea71f tempest-AttachVolumeTestJSON-555093534 tempest-AttachVolumeTestJSON-555093534-project] Lock "1daf4f4c-0e4a-4779-b53a-78c48397ea2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120740) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 18:02:20.312318 dv-cinder-852009-8-iscsi devstack@n-api.service[120740]: DEBUG nova.policy [None req-6b0043a7-da2c-449f-910f-4698948ea71f tempest-AttachVolumeTestJSON-555093534 tempest-AttachVolumeTestJSON-555093534-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0625b3113ce044bbac4f6142eaade11c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a279fcbf274c4704a31a2b95061e1469', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120740) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 18:02:20.324159 dv-cinder-852009-8-iscsi devstack@n-api.service[120740]: INFO nova.api.openstack.requestlog [None req-6b0043a7-da2c-449f-910f-4698948ea71f tempest-AttachVolumeTestJSON-555093534 tempest-AttachVolumeTestJSON-555093534-project] 10.222.0.43 "GET /compute/v2.1/servers/b958d409-df20-44c6-aa0e-58cb0a482edf" status: 200 len: 1362 microversion: 2.1 time: 0.173007 Sep 13 18:02:20.325071 dv-cinder-852009-8-iscsi devstack@n-api.service[120740]: [pid: 120740|app: 0|req: 30/53] 10.222.0.43 () {58 vars in 1236 bytes} [Tue Sep 13 18:02:20 2022] GET /compute/v2.1/servers/b958d409-df20-44c6-aa0e-58cb0a482edf => generated 1362 bytes in 175 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 13 18:02:20.614686 dv-cinder-852009-8-iscsi devstack@n-api.service[120741]: DEBUG nova.api.openstack.wsgi [None req-f31d8347-dbb0-4fd5-857e-2e28c22eb3ea tempest-ServerRescueNegativeTestJSON-412251590 tempest-ServerRescueNegativeTestJSON-412251590-project] Calling method '>' {{(pid=120741) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 18:02:20.615430 dv-cinder-852009-8-iscsi devstack@n-api.service[120741]: DEBUG nova.compute.api [None req-f31d8347-dbb0-4fd5-857e-2e28c22eb3ea tempest-ServerRescueNegativeTestJSON-412251590 tempest-ServerRescueNegativeTestJSON-412251590-project] [instance: 8cd29851-35c1-4032-a137-ab9419a2ec5b] Fetching instance by UUID {{(pid=120741) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 18:02:20.622223 dv-cinder-852009-8-iscsi devstack@n-api.service[120741]: DEBUG oslo_concurrency.lockutils [None req-f31d8347-dbb0-4fd5-857e-2e28c22eb3ea tempest-ServerRescueNegativeTestJSON-412251590 tempest-ServerRescueNegativeTestJSON-412251590-project] Acquiring lock "1daf4f4c-0e4a-4779-b53a-78c48397ea2f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120741) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 18:02:20.622854 dv-cinder-852009-8-iscsi devstack@n-api.service[120741]: DEBUG oslo_concurrency.lockutils [None req-f31d8347-dbb0-4fd5-857e-2e28c22eb3ea tempest-ServerRescueNegativeTestJSON-412251590 tempest-ServerRescueNegativeTestJSON-412251590-project] Lock "1daf4f4c-0e4a-4779-b53a-78c48397ea2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120741) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 18:02:20.623378 dv-cinder-852009-8-iscsi devstack@n-api.service[120741]: DEBUG oslo_concurrency.lockutils [None req-f31d8347-dbb0-4fd5-857e-2e28c22eb3ea tempest-ServerRescueNegativeTestJSON-412251590 tempest-ServerRescueNegativeTestJSON-412251590-project] Lock "1daf4f4c-0e4a-4779-b53a-78c48397ea2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120741) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 18:02:20.624191 dv-cinder-852009-8-iscsi devstack@n-api.service[120741]: DEBUG oslo_concurrency.lockutils [None req-f31d8347-dbb0-4fd5-857e-2e28c22eb3ea tempest-ServerRescueNegativeTestJSON-412251590 tempest-ServerRescueNegativeTestJSON-412251590-project] Acquiring lock "1daf4f4c-0e4a-4779-b53a-78c48397ea2f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120741) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 18:02:20.624815 dv-cinder-852009-8-iscsi devstack@n-api.service[120741]: DEBUG oslo_concurrency.lockutils [None req-f31d8347-dbb0-4fd5-857e-2e28c22eb3ea tempest-ServerRescueNegativeTestJSON-412251590 tempest-ServerRescueNegativeTestJSON-412251590-project] Lock "1daf4f4c-0e4a-4779-b53a-78c48397ea2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120741) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 18:02:20.625347 dv-cinder-852009-8-iscsi devstack@n-api.service[120741]: DEBUG oslo_concurrency.lockutils [None req-f31d8347-dbb0-4fd5-857e-2e28c22eb3ea tempest-ServerRescueNegativeTestJSON-412251590 tempest-ServerRescueNegativeTestJSON-412251590-project] Lock "1daf4f4c-0e4a-4779-b53a-78c48397ea2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120741) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 18:02:20.757880 dv-cinder-852009-8-iscsi devstack@n-api.service[120741]: DEBUG nova.policy [None req-f31d8347-dbb0-4fd5-857e-2e28c22eb3ea tempest-ServerRescueNegativeTestJSON-412251590 tempest-ServerRescueNegativeTestJSON-412251590-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '60800cf2774e409d9c1b6f4992669991', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2eae4acecf6c4961830ead78d71b2ad3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120741) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 18:02:20.766073 dv-cinder-852009-8-iscsi devstack@n-api.service[120741]: INFO nova.api.openstack.requestlog [None req-f31d8347-dbb0-4fd5-857e-2e28c22eb3ea tempest-ServerRescueNegativeTestJSON-412251590 tempest-ServerRescueNegativeTestJSON-412251590-project] 10.222.0.43 "GET /compute/v2.1/servers/8cd29851-35c1-4032-a137-ab9419a2ec5b" status: 200 len: 1322 microversion: 2.1 time: 0.156592 Sep 13 18:02:20.766607 dv-cinder-852009-8-iscsi devstack@n-api.service[120741]: [pid: 120741|app: 0|req: 24/54] 10.222.0.43 () {58 vars in 1236 bytes} [Tue Sep 13 18:02:20 2022] GET /compute/v2.1/servers/8cd29851-35c1-4032-a137-ab9419a2ec5b => generated 1322 bytes in 169 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 13 18:02:21.178190 dv-cinder-852009-8-iscsi devstack@n-api.service[120740]: DEBUG nova.api.openstack.wsgi [None req-e8d2b3b7-088d-46f6-883b-9cd56cd436b6 tempest-AttachVolumeShelveTestJSON-385853788 tempest-AttachVolumeShelveTestJSON-385853788-project] Calling method '>' {{(pid=120740) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 18:02:21.178874 dv-cinder-852009-8-iscsi devstack@n-api.service[120740]: DEBUG nova.compute.api [None req-e8d2b3b7-088d-46f6-883b-9cd56cd436b6 tempest-AttachVolumeShelveTestJSON-385853788 tempest-AttachVolumeShelveTestJSON-385853788-project] [instance: 11d2616a-96f9-4a7a-aab8-219219986a8b] Fetching instance by UUID {{(pid=120740) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 18:02:21.186919 dv-cinder-852009-8-iscsi devstack@n-api.service[120740]: DEBUG oslo_concurrency.lockutils [None req-e8d2b3b7-088d-46f6-883b-9cd56cd436b6 tempest-AttachVolumeShelveTestJSON-385853788 tempest-AttachVolumeShelveTestJSON-385853788-project] Acquiring lock "1daf4f4c-0e4a-4779-b53a-78c48397ea2f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120740) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 18:02:21.187421 dv-cinder-852009-8-iscsi devstack@n-api.service[120740]: DEBUG oslo_concurrency.lockutils [None req-e8d2b3b7-088d-46f6-883b-9cd56cd436b6 tempest-AttachVolumeShelveTestJSON-385853788 tempest-AttachVolumeShelveTestJSON-385853788-project] Lock "1daf4f4c-0e4a-4779-b53a-78c48397ea2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120740) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 18:02:21.188010 dv-cinder-852009-8-iscsi devstack@n-api.service[120740]: DEBUG oslo_concurrency.lockutils [None req-e8d2b3b7-088d-46f6-883b-9cd56cd436b6 tempest-AttachVolumeShelveTestJSON-385853788 tempest-AttachVolumeShelveTestJSON-385853788-project] Lock "1daf4f4c-0e4a-4779-b53a-78c48397ea2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120740) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 18:02:21.188143 dv-cinder-852009-8-iscsi devstack@n-api.service[120741]: DEBUG nova.api.openstack.wsgi [None req-3b2f3f3d-8a6d-4cb2-ba75-ec84fb71a55c tempest-DeleteServersTestJSON-1632919649 tempest-DeleteServersTestJSON-1632919649-project] Calling method '>' {{(pid=120741) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 18:02:21.188760 dv-cinder-852009-8-iscsi devstack@n-api.service[120741]: DEBUG nova.compute.api [None req-3b2f3f3d-8a6d-4cb2-ba75-ec84fb71a55c tempest-DeleteServersTestJSON-1632919649 tempest-DeleteServersTestJSON-1632919649-project] [instance: 207d1d8d-58a4-4b99-aa09-1c5023c60784] Fetching instance by UUID {{(pid=120741) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 18:02:21.188833 dv-cinder-852009-8-iscsi devstack@n-api.service[120740]: DEBUG oslo_concurrency.lockutils [None req-e8d2b3b7-088d-46f6-883b-9cd56cd436b6 tempest-AttachVolumeShelveTestJSON-385853788 tempest-AttachVolumeShelveTestJSON-385853788-project] Acquiring lock "1daf4f4c-0e4a-4779-b53a-78c48397ea2f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120740) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 18:02:21.189287 dv-cinder-852009-8-iscsi devstack@n-api.service[120740]: DEBUG oslo_concurrency.lockutils [None req-e8d2b3b7-088d-46f6-883b-9cd56cd436b6 tempest-AttachVolumeShelveTestJSON-385853788 tempest-AttachVolumeShelveTestJSON-385853788-project] Lock "1daf4f4c-0e4a-4779-b53a-78c48397ea2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120740) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 18:02:21.189865 dv-cinder-852009-8-iscsi devstack@n-api.service[120740]: DEBUG oslo_concurrency.lockutils [None req-e8d2b3b7-088d-46f6-883b-9cd56cd436b6 tempest-AttachVolumeShelveTestJSON-385853788 tempest-AttachVolumeShelveTestJSON-385853788-project] Lock "1daf4f4c-0e4a-4779-b53a-78c48397ea2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120740) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 18:02:21.194791 dv-cinder-852009-8-iscsi devstack@n-api.service[120741]: DEBUG oslo_concurrency.lockutils [None req-3b2f3f3d-8a6d-4cb2-ba75-ec84fb71a55c tempest-DeleteServersTestJSON-1632919649 tempest-DeleteServersTestJSON-1632919649-project] Acquiring lock "1daf4f4c-0e4a-4779-b53a-78c48397ea2f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120741) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 18:02:21.195257 dv-cinder-852009-8-iscsi devstack@n-api.service[120741]: DEBUG oslo_concurrency.lockutils [None req-3b2f3f3d-8a6d-4cb2-ba75-ec84fb71a55c tempest-DeleteServersTestJSON-1632919649 tempest-DeleteServersTestJSON-1632919649-project] Lock "1daf4f4c-0e4a-4779-b53a-78c48397ea2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120741) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 18:02:21.195689 dv-cinder-852009-8-iscsi devstack@n-api.service[120741]: DEBUG oslo_concurrency.lockutils [None req-3b2f3f3d-8a6d-4cb2-ba75-ec84fb71a55c tempest-DeleteServersTestJSON-1632919649 tempest-DeleteServersTestJSON-1632919649-project] Lock "1daf4f4c-0e4a-4779-b53a-78c48397ea2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120741) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 18:02:21.196400 dv-cinder-852009-8-iscsi devstack@n-api.service[120741]: DEBUG oslo_concurrency.lockutils [None req-3b2f3f3d-8a6d-4cb2-ba75-ec84fb71a55c tempest-DeleteServersTestJSON-1632919649 tempest-DeleteServersTestJSON-1632919649-project] Acquiring lock "1daf4f4c-0e4a-4779-b53a-78c48397ea2f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120741) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 18:02:21.196885 dv-cinder-852009-8-iscsi devstack@n-api.service[120741]: DEBUG oslo_concurrency.lockutils [None req-3b2f3f3d-8a6d-4cb2-ba75-ec84fb71a55c tempest-DeleteServersTestJSON-1632919649 tempest-DeleteServersTestJSON-1632919649-project] Lock "1daf4f4c-0e4a-4779-b53a-78c48397ea2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120741) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 18:02:21.197305 dv-cinder-852009-8-iscsi devstack@n-api.service[120741]: DEBUG oslo_concurrency.lockutils [None req-3b2f3f3d-8a6d-4cb2-ba75-ec84fb71a55c tempest-DeleteServersTestJSON-1632919649 tempest-DeleteServersTestJSON-1632919649-project] Lock "1daf4f4c-0e4a-4779-b53a-78c48397ea2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120741) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 18:02:21.386247 dv-cinder-852009-8-iscsi devstack@n-api.service[120740]: DEBUG nova.policy [None req-e8d2b3b7-088d-46f6-883b-9cd56cd436b6 tempest-AttachVolumeShelveTestJSON-385853788 tempest-AttachVolumeShelveTestJSON-385853788-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e68ecd9b3ca643539b109f75bb242d6f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '75e14fd88bfb4cd896fa7b070a0fac47', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120740) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 18:02:21.390464 dv-cinder-852009-8-iscsi devstack@n-api.service[120741]: DEBUG nova.policy [None req-3b2f3f3d-8a6d-4cb2-ba75-ec84fb71a55c tempest-DeleteServersTestJSON-1632919649 tempest-DeleteServersTestJSON-1632919649-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '51db5ef052144879b53979268ac4ceb5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '66136f123f5b4ad0a824920bbdf9d245', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120741) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 18:02:21.394926 dv-cinder-852009-8-iscsi devstack@n-api.service[120740]: DEBUG nova.policy [None req-e8d2b3b7-088d-46f6-883b-9cd56cd436b6 tempest-AttachVolumeShelveTestJSON-385853788 tempest-AttachVolumeShelveTestJSON-385853788-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'e68ecd9b3ca643539b109f75bb242d6f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '75e14fd88bfb4cd896fa7b070a0fac47', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120740) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 18:02:21.396582 dv-cinder-852009-8-iscsi devstack@n-api.service[120740]: DEBUG nova.policy [None req-e8d2b3b7-088d-46f6-883b-9cd56cd436b6 tempest-AttachVolumeShelveTestJSON-385853788 tempest-AttachVolumeShelveTestJSON-385853788-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'e68ecd9b3ca643539b109f75bb242d6f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '75e14fd88bfb4cd896fa7b070a0fac47', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120740) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 18:02:21.398388 dv-cinder-852009-8-iscsi devstack@n-api.service[120740]: INFO nova.api.openstack.requestlog [None req-e8d2b3b7-088d-46f6-883b-9cd56cd436b6 tempest-AttachVolumeShelveTestJSON-385853788 tempest-AttachVolumeShelveTestJSON-385853788-project] 10.222.0.43 "GET /compute/v2.1/servers/11d2616a-96f9-4a7a-aab8-219219986a8b" status: 200 len: 1405 microversion: 2.20 time: 0.225672 Sep 13 18:02:21.399359 dv-cinder-852009-8-iscsi devstack@n-api.service[120740]: [pid: 120740|app: 0|req: 31/55] 10.222.0.43 () {60 vars in 1277 bytes} [Tue Sep 13 18:02:21 2022] GET /compute/v2.1/servers/11d2616a-96f9-4a7a-aab8-219219986a8b => generated 1405 bytes in 228 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 13 18:02:21.401514 dv-cinder-852009-8-iscsi devstack@n-api.service[120741]: INFO nova.api.openstack.requestlog [None req-3b2f3f3d-8a6d-4cb2-ba75-ec84fb71a55c tempest-DeleteServersTestJSON-1632919649 tempest-DeleteServersTestJSON-1632919649-project] 10.222.0.43 "GET /compute/v2.1/servers/207d1d8d-58a4-4b99-aa09-1c5023c60784" status: 200 len: 1315 microversion: 2.1 time: 0.217366 Sep 13 18:02:21.403226 dv-cinder-852009-8-iscsi devstack@n-api.service[120741]: [pid: 120741|app: 0|req: 25/56] 10.222.0.43 () {58 vars in 1236 bytes} [Tue Sep 13 18:02:21 2022] GET /compute/v2.1/servers/207d1d8d-58a4-4b99-aa09-1c5023c60784 => generated 1315 bytes in 220 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 13 18:02:21.406078 dv-cinder-852009-8-iscsi devstack@n-api.service[120740]: DEBUG nova.api.openstack.wsgi [None req-276c1755-5167-40e3-81f9-1a4341e04917 tempest-AttachVolumeTestJSON-555093534 tempest-AttachVolumeTestJSON-555093534-project] Calling method '>' {{(pid=120740) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 18:02:21.406687 dv-cinder-852009-8-iscsi devstack@n-api.service[120740]: DEBUG nova.compute.api [None req-276c1755-5167-40e3-81f9-1a4341e04917 tempest-AttachVolumeTestJSON-555093534 tempest-AttachVolumeTestJSON-555093534-project] [instance: b958d409-df20-44c6-aa0e-58cb0a482edf] Fetching instance by UUID {{(pid=120740) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 18:02:21.412864 dv-cinder-852009-8-iscsi devstack@n-api.service[120740]: DEBUG oslo_concurrency.lockutils [None req-276c1755-5167-40e3-81f9-1a4341e04917 tempest-AttachVolumeTestJSON-555093534 tempest-AttachVolumeTestJSON-555093534-project] Acquiring lock "1daf4f4c-0e4a-4779-b53a-78c48397ea2f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120740) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 18:02:21.413346 dv-cinder-852009-8-iscsi devstack@n-api.service[120740]: DEBUG oslo_concurrency.lockutils [None req-276c1755-5167-40e3-81f9-1a4341e04917 tempest-AttachVolumeTestJSON-555093534 tempest-AttachVolumeTestJSON-555093534-project] Lock "1daf4f4c-0e4a-4779-b53a-78c48397ea2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120740) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 18:02:21.414025 dv-cinder-852009-8-iscsi devstack@n-api.service[120740]: DEBUG oslo_concurrency.lockutils [None req-276c1755-5167-40e3-81f9-1a4341e04917 tempest-AttachVolumeTestJSON-555093534 tempest-AttachVolumeTestJSON-555093534-project] Lock "1daf4f4c-0e4a-4779-b53a-78c48397ea2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120740) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 18:02:21.414772 dv-cinder-852009-8-iscsi devstack@n-api.service[120740]: DEBUG oslo_concurrency.lockutils [None req-276c1755-5167-40e3-81f9-1a4341e04917 tempest-AttachVolumeTestJSON-555093534 tempest-AttachVolumeTestJSON-555093534-project] Acquiring lock "1daf4f4c-0e4a-4779-b53a-78c48397ea2f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120740) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 18:02:21.415289 dv-cinder-852009-8-iscsi devstack@n-api.service[120740]: DEBUG oslo_concurrency.lockutils [None req-276c1755-5167-40e3-81f9-1a4341e04917 tempest-AttachVolumeTestJSON-555093534 tempest-AttachVolumeTestJSON-555093534-project] Lock "1daf4f4c-0e4a-4779-b53a-78c48397ea2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120740) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 18:02:21.415779 dv-cinder-852009-8-iscsi devstack@n-api.service[120740]: DEBUG oslo_concurrency.lockutils [None req-276c1755-5167-40e3-81f9-1a4341e04917 tempest-AttachVolumeTestJSON-555093534 tempest-AttachVolumeTestJSON-555093534-project] Lock "1daf4f4c-0e4a-4779-b53a-78c48397ea2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120740) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 18:02:21.553267 dv-cinder-852009-8-iscsi devstack@n-api.service[120740]: DEBUG nova.policy [None req-276c1755-5167-40e3-81f9-1a4341e04917 tempest-AttachVolumeTestJSON-555093534 tempest-AttachVolumeTestJSON-555093534-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0625b3113ce044bbac4f6142eaade11c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a279fcbf274c4704a31a2b95061e1469', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120740) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 18:02:21.561663 dv-cinder-852009-8-iscsi devstack@n-api.service[120740]: INFO nova.api.openstack.requestlog [None req-276c1755-5167-40e3-81f9-1a4341e04917 tempest-AttachVolumeTestJSON-555093534 tempest-AttachVolumeTestJSON-555093534-project] 10.222.0.43 "GET /compute/v2.1/servers/b958d409-df20-44c6-aa0e-58cb0a482edf" status: 200 len: 1362 microversion: 2.1 time: 0.161171 Sep 13 18:02:21.562356 dv-cinder-852009-8-iscsi devstack@n-api.service[120740]: [pid: 120740|app: 0|req: 32/57] 10.222.0.43 () {58 vars in 1236 bytes} [Tue Sep 13 18:02:21 2022] GET /compute/v2.1/servers/b958d409-df20-44c6-aa0e-58cb0a482edf => generated 1362 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 13 18:02:21.788357 dv-cinder-852009-8-iscsi devstack@n-api.service[120741]: DEBUG nova.api.openstack.wsgi [None req-cdfce5e1-39f6-447d-81f4-f460ccaee6fd tempest-ServerRescueNegativeTestJSON-412251590 tempest-ServerRescueNegativeTestJSON-412251590-project] Calling method '>' {{(pid=120741) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 18:02:21.789057 dv-cinder-852009-8-iscsi devstack@n-api.service[120741]: DEBUG nova.compute.api [None req-cdfce5e1-39f6-447d-81f4-f460ccaee6fd tempest-ServerRescueNegativeTestJSON-412251590 tempest-ServerRescueNegativeTestJSON-412251590-project] [instance: 8cd29851-35c1-4032-a137-ab9419a2ec5b] Fetching instance by UUID {{(pid=120741) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 18:02:21.795179 dv-cinder-852009-8-iscsi devstack@n-api.service[120741]: DEBUG oslo_concurrency.lockutils [None req-cdfce5e1-39f6-447d-81f4-f460ccaee6fd tempest-ServerRescueNegativeTestJSON-412251590 tempest-ServerRescueNegativeTestJSON-412251590-project] Acquiring lock "1daf4f4c-0e4a-4779-b53a-78c48397ea2f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120741) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 18:02:21.795470 dv-cinder-852009-8-iscsi devstack@n-api.service[120741]: DEBUG oslo_concurrency.lockutils [None req-cdfce5e1-39f6-447d-81f4-f460ccaee6fd tempest-ServerRescueNegativeTestJSON-412251590 tempest-ServerRescueNegativeTestJSON-412251590-project] Lock "1daf4f4c-0e4a-4779-b53a-78c48397ea2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120741) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 18:02:21.795966 dv-cinder-852009-8-iscsi devstack@n-api.service[120741]: DEBUG oslo_concurrency.lockutils [None req-cdfce5e1-39f6-447d-81f4-f460ccaee6fd tempest-ServerRescueNegativeTestJSON-412251590 tempest-ServerRescueNegativeTestJSON-412251590-project] Lock "1daf4f4c-0e4a-4779-b53a-78c48397ea2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120741) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 18:02:21.796689 dv-cinder-852009-8-iscsi devstack@n-api.service[120741]: DEBUG oslo_concurrency.lockutils [None req-cdfce5e1-39f6-447d-81f4-f460ccaee6fd tempest-ServerRescueNegativeTestJSON-412251590 tempest-ServerRescueNegativeTestJSON-412251590-project] Acquiring lock "1daf4f4c-0e4a-4779-b53a-78c48397ea2f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120741) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 18:02:21.797128 dv-cinder-852009-8-iscsi devstack@n-api.service[120741]: DEBUG oslo_concurrency.lockutils [None req-cdfce5e1-39f6-447d-81f4-f460ccaee6fd tempest-ServerRescueNegativeTestJSON-412251590 tempest-ServerRescueNegativeTestJSON-412251590-project] Lock "1daf4f4c-0e4a-4779-b53a-78c48397ea2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120741) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 18:02:21.797573 dv-cinder-852009-8-iscsi devstack@n-api.service[120741]: DEBUG oslo_concurrency.lockutils [None req-cdfce5e1-39f6-447d-81f4-f460ccaee6fd tempest-ServerRescueNegativeTestJSON-412251590 tempest-ServerRescueNegativeTestJSON-412251590-project] Lock "1daf4f4c-0e4a-4779-b53a-78c48397ea2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120741) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 18:02:21.927352 dv-cinder-852009-8-iscsi devstack@n-api.service[120741]: DEBUG nova.policy [None req-cdfce5e1-39f6-447d-81f4-f460ccaee6fd tempest-ServerRescueNegativeTestJSON-412251590 tempest-ServerRescueNegativeTestJSON-412251590-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '60800cf2774e409d9c1b6f4992669991', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2eae4acecf6c4961830ead78d71b2ad3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120741) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 18:02:21.935066 dv-cinder-852009-8-iscsi devstack@n-api.service[120741]: INFO nova.api.openstack.requestlog [None req-cdfce5e1-39f6-447d-81f4-f460ccaee6fd tempest-ServerRescueNegativeTestJSON-412251590 tempest-ServerRescueNegativeTestJSON-412251590-project] 10.222.0.43 "GET /compute/v2.1/servers/8cd29851-35c1-4032-a137-ab9419a2ec5b" status: 200 len: 1322 microversion: 2.1 time: 0.150614 Sep 13 18:02:21.935631 dv-cinder-852009-8-iscsi devstack@n-api.service[120741]: [pid: 120741|app: 0|req: 26/58] 10.222.0.43 () {58 vars in 1236 bytes} [Tue Sep 13 18:02:21 2022] GET /compute/v2.1/servers/8cd29851-35c1-4032-a137-ab9419a2ec5b => generated 1322 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 13 18:02:22.425549 dv-cinder-852009-8-iscsi devstack@n-api.service[120740]: DEBUG nova.api.openstack.wsgi [None req-cadef841-2a85-4445-89f9-c6484abcf6d2 tempest-DeleteServersTestJSON-1632919649 tempest-DeleteServersTestJSON-1632919649-project] Calling method '>' {{(pid=120740) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 18:02:22.426138 dv-cinder-852009-8-iscsi devstack@n-api.service[120740]: DEBUG nova.compute.api [None req-cadef841-2a85-4445-89f9-c6484abcf6d2 tempest-DeleteServersTestJSON-1632919649 tempest-DeleteServersTestJSON-1632919649-project] [instance: 207d1d8d-58a4-4b99-aa09-1c5023c60784] Fetching instance by UUID {{(pid=120740) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 18:02:22.428191 dv-cinder-852009-8-iscsi devstack@n-api.service[120741]: DEBUG nova.api.openstack.wsgi [None req-c94a4442-1db1-456b-bf86-3619e4e667e2 tempest-AttachVolumeShelveTestJSON-385853788 tempest-AttachVolumeShelveTestJSON-385853788-project] Calling method '>' {{(pid=120741) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 18:02:22.429283 dv-cinder-852009-8-iscsi devstack@n-api.service[120741]: DEBUG nova.compute.api [None req-c94a4442-1db1-456b-bf86-3619e4e667e2 tempest-AttachVolumeShelveTestJSON-385853788 tempest-AttachVolumeShelveTestJSON-385853788-project] [instance: 11d2616a-96f9-4a7a-aab8-219219986a8b] Fetching instance by UUID {{(pid=120741) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 18:02:22.433202 dv-cinder-852009-8-iscsi devstack@n-api.service[120740]: DEBUG oslo_concurrency.lockutils [None req-cadef841-2a85-4445-89f9-c6484abcf6d2 tempest-DeleteServersTestJSON-1632919649 tempest-DeleteServersTestJSON-1632919649-project] Acquiring lock "1daf4f4c-0e4a-4779-b53a-78c48397ea2f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120740) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 18:02:22.433685 dv-cinder-852009-8-iscsi devstack@n-api.service[120740]: DEBUG oslo_concurrency.lockutils [None req-cadef841-2a85-4445-89f9-c6484abcf6d2 tempest-DeleteServersTestJSON-1632919649 tempest-DeleteServersTestJSON-1632919649-project] Lock "1daf4f4c-0e4a-4779-b53a-78c48397ea2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120740) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 18:02:22.434103 dv-cinder-852009-8-iscsi devstack@n-api.service[120740]: DEBUG oslo_concurrency.lockutils [None req-cadef841-2a85-4445-89f9-c6484abcf6d2 tempest-DeleteServersTestJSON-1632919649 tempest-DeleteServersTestJSON-1632919649-project] Lock "1daf4f4c-0e4a-4779-b53a-78c48397ea2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120740) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 18:02:22.434800 dv-cinder-852009-8-iscsi devstack@n-api.service[120740]: DEBUG oslo_concurrency.lockutils [None req-cadef841-2a85-4445-89f9-c6484abcf6d2 tempest-DeleteServersTestJSON-1632919649 tempest-DeleteServersTestJSON-1632919649-project] Acquiring lock "1daf4f4c-0e4a-4779-b53a-78c48397ea2f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120740) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 18:02:22.435241 dv-cinder-852009-8-iscsi devstack@n-api.service[120740]: DEBUG oslo_concurrency.lockutils [None req-cadef841-2a85-4445-89f9-c6484abcf6d2 tempest-DeleteServersTestJSON-1632919649 tempest-DeleteServersTestJSON-1632919649-project] Lock "1daf4f4c-0e4a-4779-b53a-78c48397ea2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120740) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 18:02:22.435374 dv-cinder-852009-8-iscsi devstack@n-api.service[120741]: DEBUG oslo_concurrency.lockutils [None req-c94a4442-1db1-456b-bf86-3619e4e667e2 tempest-AttachVolumeShelveTestJSON-385853788 tempest-AttachVolumeShelveTestJSON-385853788-project] Acquiring lock "1daf4f4c-0e4a-4779-b53a-78c48397ea2f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120741) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 18:02:22.435646 dv-cinder-852009-8-iscsi devstack@n-api.service[120740]: DEBUG oslo_concurrency.lockutils [None req-cadef841-2a85-4445-89f9-c6484abcf6d2 tempest-DeleteServersTestJSON-1632919649 tempest-DeleteServersTestJSON-1632919649-project] Lock "1daf4f4c-0e4a-4779-b53a-78c48397ea2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120740) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 18:02:22.435861 dv-cinder-852009-8-iscsi devstack@n-api.service[120741]: DEBUG oslo_concurrency.lockutils [None req-c94a4442-1db1-456b-bf86-3619e4e667e2 tempest-AttachVolumeShelveTestJSON-385853788 tempest-AttachVolumeShelveTestJSON-385853788-project] Lock "1daf4f4c-0e4a-4779-b53a-78c48397ea2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120741) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 18:02:22.436293 dv-cinder-852009-8-iscsi devstack@n-api.service[120741]: DEBUG oslo_concurrency.lockutils [None req-c94a4442-1db1-456b-bf86-3619e4e667e2 tempest-AttachVolumeShelveTestJSON-385853788 tempest-AttachVolumeShelveTestJSON-385853788-project] Lock "1daf4f4c-0e4a-4779-b53a-78c48397ea2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120741) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 18:02:22.437030 dv-cinder-852009-8-iscsi devstack@n-api.service[120741]: DEBUG oslo_concurrency.lockutils [None req-c94a4442-1db1-456b-bf86-3619e4e667e2 tempest-AttachVolumeShelveTestJSON-385853788 tempest-AttachVolumeShelveTestJSON-385853788-project] Acquiring lock "1daf4f4c-0e4a-4779-b53a-78c48397ea2f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120741) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 18:02:22.437463 dv-cinder-852009-8-iscsi devstack@n-api.service[120741]: DEBUG oslo_concurrency.lockutils [None req-c94a4442-1db1-456b-bf86-3619e4e667e2 tempest-AttachVolumeShelveTestJSON-385853788 tempest-AttachVolumeShelveTestJSON-385853788-project] Lock "1daf4f4c-0e4a-4779-b53a-78c48397ea2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120741) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 18:02:22.437880 dv-cinder-852009-8-iscsi devstack@n-api.service[120741]: DEBUG oslo_concurrency.lockutils [None req-c94a4442-1db1-456b-bf86-3619e4e667e2 tempest-AttachVolumeShelveTestJSON-385853788 tempest-AttachVolumeShelveTestJSON-385853788-project] Lock "1daf4f4c-0e4a-4779-b53a-78c48397ea2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120741) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 18:02:22.635090 dv-cinder-852009-8-iscsi devstack@n-api.service[120740]: DEBUG nova.policy [None req-cadef841-2a85-4445-89f9-c6484abcf6d2 tempest-DeleteServersTestJSON-1632919649 tempest-DeleteServersTestJSON-1632919649-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '51db5ef052144879b53979268ac4ceb5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '66136f123f5b4ad0a824920bbdf9d245', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120740) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 18:02:22.639097 dv-cinder-852009-8-iscsi devstack@n-api.service[120741]: DEBUG nova.policy [None req-c94a4442-1db1-456b-bf86-3619e4e667e2 tempest-AttachVolumeShelveTestJSON-385853788 tempest-AttachVolumeShelveTestJSON-385853788-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e68ecd9b3ca643539b109f75bb242d6f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '75e14fd88bfb4cd896fa7b070a0fac47', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120741) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 18:02:22.646297 dv-cinder-852009-8-iscsi devstack@n-api.service[120740]: INFO nova.api.openstack.requestlog [None req-cadef841-2a85-4445-89f9-c6484abcf6d2 tempest-DeleteServersTestJSON-1632919649 tempest-DeleteServersTestJSON-1632919649-project] 10.222.0.43 "GET /compute/v2.1/servers/207d1d8d-58a4-4b99-aa09-1c5023c60784" status: 200 len: 1315 microversion: 2.1 time: 0.224651 Sep 13 18:02:22.646878 dv-cinder-852009-8-iscsi devstack@n-api.service[120740]: [pid: 120740|app: 0|req: 33/59] 10.222.0.43 () {58 vars in 1236 bytes} [Tue Sep 13 18:02:22 2022] GET /compute/v2.1/servers/207d1d8d-58a4-4b99-aa09-1c5023c60784 => generated 1315 bytes in 226 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 13 18:02:22.650935 dv-cinder-852009-8-iscsi devstack@n-api.service[120741]: DEBUG nova.policy [None req-c94a4442-1db1-456b-bf86-3619e4e667e2 tempest-AttachVolumeShelveTestJSON-385853788 tempest-AttachVolumeShelveTestJSON-385853788-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'e68ecd9b3ca643539b109f75bb242d6f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '75e14fd88bfb4cd896fa7b070a0fac47', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120741) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 18:02:22.651296 dv-cinder-852009-8-iscsi devstack@n-api.service[120740]: DEBUG nova.api.openstack.wsgi [None req-50b9e623-5cbd-4d73-a772-46455101f8d8 tempest-AttachVolumeTestJSON-555093534 tempest-AttachVolumeTestJSON-555093534-project] Calling method '>' {{(pid=120740) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 18:02:22.651891 dv-cinder-852009-8-iscsi devstack@n-api.service[120740]: DEBUG nova.compute.api [None req-50b9e623-5cbd-4d73-a772-46455101f8d8 tempest-AttachVolumeTestJSON-555093534 tempest-AttachVolumeTestJSON-555093534-project] [instance: b958d409-df20-44c6-aa0e-58cb0a482edf] Fetching instance by UUID {{(pid=120740) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 18:02:22.652663 dv-cinder-852009-8-iscsi devstack@n-api.service[120741]: DEBUG nova.policy [None req-c94a4442-1db1-456b-bf86-3619e4e667e2 tempest-AttachVolumeShelveTestJSON-385853788 tempest-AttachVolumeShelveTestJSON-385853788-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'e68ecd9b3ca643539b109f75bb242d6f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '75e14fd88bfb4cd896fa7b070a0fac47', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120741) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 18:02:22.654053 dv-cinder-852009-8-iscsi devstack@n-api.service[120741]: INFO nova.api.openstack.requestlog [None req-c94a4442-1db1-456b-bf86-3619e4e667e2 tempest-AttachVolumeShelveTestJSON-385853788 tempest-AttachVolumeShelveTestJSON-385853788-project] 10.222.0.43 "GET /compute/v2.1/servers/11d2616a-96f9-4a7a-aab8-219219986a8b" status: 200 len: 1405 microversion: 2.20 time: 0.229769 Sep 13 18:02:22.657923 dv-cinder-852009-8-iscsi devstack@n-api.service[120740]: DEBUG oslo_concurrency.lockutils [None req-50b9e623-5cbd-4d73-a772-46455101f8d8 tempest-AttachVolumeTestJSON-555093534 tempest-AttachVolumeTestJSON-555093534-project] Acquiring lock "1daf4f4c-0e4a-4779-b53a-78c48397ea2f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120740) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 18:02:22.658714 dv-cinder-852009-8-iscsi devstack@n-api.service[120740]: DEBUG oslo_concurrency.lockutils [None req-50b9e623-5cbd-4d73-a772-46455101f8d8 tempest-AttachVolumeTestJSON-555093534 tempest-AttachVolumeTestJSON-555093534-project] Lock "1daf4f4c-0e4a-4779-b53a-78c48397ea2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120740) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 18:02:22.659119 dv-cinder-852009-8-iscsi devstack@n-api.service[120740]: DEBUG oslo_concurrency.lockutils [None req-50b9e623-5cbd-4d73-a772-46455101f8d8 tempest-AttachVolumeTestJSON-555093534 tempest-AttachVolumeTestJSON-555093534-project] Lock "1daf4f4c-0e4a-4779-b53a-78c48397ea2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120740) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 18:02:22.660000 dv-cinder-852009-8-iscsi devstack@n-api.service[120740]: DEBUG oslo_concurrency.lockutils [None req-50b9e623-5cbd-4d73-a772-46455101f8d8 tempest-AttachVolumeTestJSON-555093534 tempest-AttachVolumeTestJSON-555093534-project] Acquiring lock "1daf4f4c-0e4a-4779-b53a-78c48397ea2f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120740) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 18:02:22.660454 dv-cinder-852009-8-iscsi devstack@n-api.service[120740]: DEBUG oslo_concurrency.lockutils [None req-50b9e623-5cbd-4d73-a772-46455101f8d8 tempest-AttachVolumeTestJSON-555093534 tempest-AttachVolumeTestJSON-555093534-project] Lock "1daf4f4c-0e4a-4779-b53a-78c48397ea2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120740) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 18:02:22.660877 dv-cinder-852009-8-iscsi devstack@n-api.service[120740]: DEBUG oslo_concurrency.lockutils [None req-50b9e623-5cbd-4d73-a772-46455101f8d8 tempest-AttachVolumeTestJSON-555093534 tempest-AttachVolumeTestJSON-555093534-project] Lock "1daf4f4c-0e4a-4779-b53a-78c48397ea2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120740) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 18:02:22.663329 dv-cinder-852009-8-iscsi devstack@n-api.service[120741]: [pid: 120741|app: 0|req: 27/60] 10.222.0.43 () {60 vars in 1277 bytes} [Tue Sep 13 18:02:22 2022] GET /compute/v2.1/servers/11d2616a-96f9-4a7a-aab8-219219986a8b => generated 1405 bytes in 239 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 13 18:02:22.799109 dv-cinder-852009-8-iscsi devstack@n-api.service[120740]: DEBUG nova.policy [None req-50b9e623-5cbd-4d73-a772-46455101f8d8 tempest-AttachVolumeTestJSON-555093534 tempest-AttachVolumeTestJSON-555093534-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0625b3113ce044bbac4f6142eaade11c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a279fcbf274c4704a31a2b95061e1469', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120740) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 18:02:22.807299 dv-cinder-852009-8-iscsi devstack@n-api.service[120740]: INFO nova.api.openstack.requestlog [None req-50b9e623-5cbd-4d73-a772-46455101f8d8 tempest-AttachVolumeTestJSON-555093534 tempest-AttachVolumeTestJSON-555093534-project] 10.222.0.43 "GET /compute/v2.1/servers/b958d409-df20-44c6-aa0e-58cb0a482edf" status: 200 len: 1362 microversion: 2.1 time: 0.159509 Sep 13 18:02:22.807901 dv-cinder-852009-8-iscsi devstack@n-api.service[120740]: [pid: 120740|app: 0|req: 34/61] 10.222.0.43 () {58 vars in 1236 bytes} [Tue Sep 13 18:02:22 2022] GET /compute/v2.1/servers/b958d409-df20-44c6-aa0e-58cb0a482edf => generated 1362 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 13 18:02:22.959938 dv-cinder-852009-8-iscsi devstack@n-api.service[120741]: DEBUG nova.api.openstack.wsgi [None req-8701c925-701b-4375-ba1f-3b4a1d51d1df tempest-ServerRescueNegativeTestJSON-412251590 tempest-ServerRescueNegativeTestJSON-412251590-project] Calling method '>' {{(pid=120741) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 18:02:22.960563 dv-cinder-852009-8-iscsi devstack@n-api.service[120741]: DEBUG nova.compute.api [None req-8701c925-701b-4375-ba1f-3b4a1d51d1df tempest-ServerRescueNegativeTestJSON-412251590 tempest-ServerRescueNegativeTestJSON-412251590-project] [instance: 8cd29851-35c1-4032-a137-ab9419a2ec5b] Fetching instance by UUID {{(pid=120741) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 18:02:22.967338 dv-cinder-852009-8-iscsi devstack@n-api.service[120741]: DEBUG oslo_concurrency.lockutils [None req-8701c925-701b-4375-ba1f-3b4a1d51d1df tempest-ServerRescueNegativeTestJSON-412251590 tempest-ServerRescueNegativeTestJSON-412251590-project] Acquiring lock "1daf4f4c-0e4a-4779-b53a-78c48397ea2f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120741) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 18:02:22.967829 dv-cinder-852009-8-iscsi devstack@n-api.service[120741]: DEBUG oslo_concurrency.lockutils [None req-8701c925-701b-4375-ba1f-3b4a1d51d1df tempest-ServerRescueNegativeTestJSON-412251590 tempest-ServerRescueNegativeTestJSON-412251590-project] Lock "1daf4f4c-0e4a-4779-b53a-78c48397ea2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120741) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 18:02:22.968268 dv-cinder-852009-8-iscsi devstack@n-api.service[120741]: DEBUG oslo_concurrency.lockutils [None req-8701c925-701b-4375-ba1f-3b4a1d51d1df tempest-ServerRescueNegativeTestJSON-412251590 tempest-ServerRescueNegativeTestJSON-412251590-project] Lock "1daf4f4c-0e4a-4779-b53a-78c48397ea2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120741) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 18:02:22.969159 dv-cinder-852009-8-iscsi devstack@n-api.service[120741]: DEBUG oslo_concurrency.lockutils [None req-8701c925-701b-4375-ba1f-3b4a1d51d1df tempest-ServerRescueNegativeTestJSON-412251590 tempest-ServerRescueNegativeTestJSON-412251590-project] Acquiring lock "1daf4f4c-0e4a-4779-b53a-78c48397ea2f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120741) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 18:02:22.969503 dv-cinder-852009-8-iscsi devstack@n-api.service[120741]: DEBUG oslo_concurrency.lockutils [None req-8701c925-701b-4375-ba1f-3b4a1d51d1df tempest-ServerRescueNegativeTestJSON-412251590 tempest-ServerRescueNegativeTestJSON-412251590-project] Lock "1daf4f4c-0e4a-4779-b53a-78c48397ea2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120741) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 18:02:22.970118 dv-cinder-852009-8-iscsi devstack@n-api.service[120741]: DEBUG oslo_concurrency.lockutils [None req-8701c925-701b-4375-ba1f-3b4a1d51d1df tempest-ServerRescueNegativeTestJSON-412251590 tempest-ServerRescueNegativeTestJSON-412251590-project] Lock "1daf4f4c-0e4a-4779-b53a-78c48397ea2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120741) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 18:02:23.111597 dv-cinder-852009-8-iscsi devstack@n-api.service[120741]: DEBUG nova.policy [None req-8701c925-701b-4375-ba1f-3b4a1d51d1df tempest-ServerRescueNegativeTestJSON-412251590 tempest-ServerRescueNegativeTestJSON-412251590-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '60800cf2774e409d9c1b6f4992669991', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2eae4acecf6c4961830ead78d71b2ad3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120741) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 18:02:23.119850 dv-cinder-852009-8-iscsi devstack@n-api.service[120741]: INFO nova.api.openstack.requestlog [None req-8701c925-701b-4375-ba1f-3b4a1d51d1df tempest-ServerRescueNegativeTestJSON-412251590 tempest-ServerRescueNegativeTestJSON-412251590-project] 10.222.0.43 "GET /compute/v2.1/servers/8cd29851-35c1-4032-a137-ab9419a2ec5b" status: 200 len: 1322 microversion: 2.1 time: 0.164772 Sep 13 18:02:23.120464 dv-cinder-852009-8-iscsi devstack@n-api.service[120741]: [pid: 120741|app: 0|req: 28/62] 10.222.0.43 () {58 vars in 1236 bytes} [Tue Sep 13 18:02:22 2022] GET /compute/v2.1/servers/8cd29851-35c1-4032-a137-ab9419a2ec5b => generated 1322 bytes in 166 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 13 18:02:23.670813 dv-cinder-852009-8-iscsi devstack@n-api.service[120740]: DEBUG nova.api.openstack.wsgi [None req-c7ff2edb-6252-4149-9d99-f86b6e86760b tempest-DeleteServersTestJSON-1632919649 tempest-DeleteServersTestJSON-1632919649-project] Calling method '>' {{(pid=120740) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 18:02:23.671420 dv-cinder-852009-8-iscsi devstack@n-api.service[120740]: DEBUG nova.compute.api [None req-c7ff2edb-6252-4149-9d99-f86b6e86760b tempest-DeleteServersTestJSON-1632919649 tempest-DeleteServersTestJSON-1632919649-project] [instance: 207d1d8d-58a4-4b99-aa09-1c5023c60784] Fetching instance by UUID {{(pid=120740) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 18:02:23.678291 dv-cinder-852009-8-iscsi devstack@n-api.service[120740]: DEBUG oslo_concurrency.lockutils [None req-c7ff2edb-6252-4149-9d99-f86b6e86760b tempest-DeleteServersTestJSON-1632919649 tempest-DeleteServersTestJSON-1632919649-project] Acquiring lock "1daf4f4c-0e4a-4779-b53a-78c48397ea2f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120740) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 18:02:23.678839 dv-cinder-852009-8-iscsi devstack@n-api.service[120740]: DEBUG oslo_concurrency.lockutils [None req-c7ff2edb-6252-4149-9d99-f86b6e86760b tempest-DeleteServersTestJSON-1632919649 tempest-DeleteServersTestJSON-1632919649-project] Lock "1daf4f4c-0e4a-4779-b53a-78c48397ea2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120740) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 18:02:23.679316 dv-cinder-852009-8-iscsi devstack@n-api.service[120740]: DEBUG oslo_concurrency.lockutils [None req-c7ff2edb-6252-4149-9d99-f86b6e86760b tempest-DeleteServersTestJSON-1632919649 tempest-DeleteServersTestJSON-1632919649-project] Lock "1daf4f4c-0e4a-4779-b53a-78c48397ea2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120740) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 18:02:23.680078 dv-cinder-852009-8-iscsi devstack@n-api.service[120740]: DEBUG oslo_concurrency.lockutils [None req-c7ff2edb-6252-4149-9d99-f86b6e86760b tempest-DeleteServersTestJSON-1632919649 tempest-DeleteServersTestJSON-1632919649-project] Acquiring lock "1daf4f4c-0e4a-4779-b53a-78c48397ea2f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120740) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 18:02:23.680276 dv-cinder-852009-8-iscsi devstack@n-api.service[120741]: DEBUG nova.api.openstack.wsgi [None req-da41b12f-ff04-4f95-9def-76c75050b69d tempest-AttachVolumeShelveTestJSON-385853788 tempest-AttachVolumeShelveTestJSON-385853788-project] Calling method '>' {{(pid=120741) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 18:02:23.680790 dv-cinder-852009-8-iscsi devstack@n-api.service[120740]: DEBUG oslo_concurrency.lockutils [None req-c7ff2edb-6252-4149-9d99-f86b6e86760b tempest-DeleteServersTestJSON-1632919649 tempest-DeleteServersTestJSON-1632919649-project] Lock "1daf4f4c-0e4a-4779-b53a-78c48397ea2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120740) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 18:02:23.681113 dv-cinder-852009-8-iscsi devstack@n-api.service[120740]: DEBUG oslo_concurrency.lockutils [None req-c7ff2edb-6252-4149-9d99-f86b6e86760b tempest-DeleteServersTestJSON-1632919649 tempest-DeleteServersTestJSON-1632919649-project] Lock "1daf4f4c-0e4a-4779-b53a-78c48397ea2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120740) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 18:02:23.681330 dv-cinder-852009-8-iscsi devstack@n-api.service[120741]: DEBUG nova.compute.api [None req-da41b12f-ff04-4f95-9def-76c75050b69d tempest-AttachVolumeShelveTestJSON-385853788 tempest-AttachVolumeShelveTestJSON-385853788-project] [instance: 11d2616a-96f9-4a7a-aab8-219219986a8b] Fetching instance by UUID {{(pid=120741) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 18:02:23.688466 dv-cinder-852009-8-iscsi devstack@n-api.service[120741]: DEBUG oslo_concurrency.lockutils [None req-da41b12f-ff04-4f95-9def-76c75050b69d tempest-AttachVolumeShelveTestJSON-385853788 tempest-AttachVolumeShelveTestJSON-385853788-project] Acquiring lock "1daf4f4c-0e4a-4779-b53a-78c48397ea2f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120741) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 18:02:23.689008 dv-cinder-852009-8-iscsi devstack@n-api.service[120741]: DEBUG oslo_concurrency.lockutils [None req-da41b12f-ff04-4f95-9def-76c75050b69d tempest-AttachVolumeShelveTestJSON-385853788 tempest-AttachVolumeShelveTestJSON-385853788-project] Lock "1daf4f4c-0e4a-4779-b53a-78c48397ea2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120741) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 18:02:23.689490 dv-cinder-852009-8-iscsi devstack@n-api.service[120741]: DEBUG oslo_concurrency.lockutils [None req-da41b12f-ff04-4f95-9def-76c75050b69d tempest-AttachVolumeShelveTestJSON-385853788 tempest-AttachVolumeShelveTestJSON-385853788-project] Lock "1daf4f4c-0e4a-4779-b53a-78c48397ea2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120741) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 18:02:23.690266 dv-cinder-852009-8-iscsi devstack@n-api.service[120741]: DEBUG oslo_concurrency.lockutils [None req-da41b12f-ff04-4f95-9def-76c75050b69d tempest-AttachVolumeShelveTestJSON-385853788 tempest-AttachVolumeShelveTestJSON-385853788-project] Acquiring lock "1daf4f4c-0e4a-4779-b53a-78c48397ea2f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120741) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 18:02:23.690764 dv-cinder-852009-8-iscsi devstack@n-api.service[120741]: DEBUG oslo_concurrency.lockutils [None req-da41b12f-ff04-4f95-9def-76c75050b69d tempest-AttachVolumeShelveTestJSON-385853788 tempest-AttachVolumeShelveTestJSON-385853788-project] Lock "1daf4f4c-0e4a-4779-b53a-78c48397ea2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120741) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 18:02:23.691387 dv-cinder-852009-8-iscsi devstack@n-api.service[120741]: DEBUG oslo_concurrency.lockutils [None req-da41b12f-ff04-4f95-9def-76c75050b69d tempest-AttachVolumeShelveTestJSON-385853788 tempest-AttachVolumeShelveTestJSON-385853788-project] Lock "1daf4f4c-0e4a-4779-b53a-78c48397ea2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120741) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 18:02:23.876304 dv-cinder-852009-8-iscsi devstack@n-api.service[120740]: DEBUG nova.policy [None req-c7ff2edb-6252-4149-9d99-f86b6e86760b tempest-DeleteServersTestJSON-1632919649 tempest-DeleteServersTestJSON-1632919649-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '51db5ef052144879b53979268ac4ceb5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '66136f123f5b4ad0a824920bbdf9d245', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120740) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 18:02:23.880607 dv-cinder-852009-8-iscsi devstack@n-api.service[120741]: DEBUG nova.policy [None req-da41b12f-ff04-4f95-9def-76c75050b69d tempest-AttachVolumeShelveTestJSON-385853788 tempest-AttachVolumeShelveTestJSON-385853788-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e68ecd9b3ca643539b109f75bb242d6f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '75e14fd88bfb4cd896fa7b070a0fac47', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120741) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 18:02:23.884537 dv-cinder-852009-8-iscsi devstack@n-api.service[120740]: INFO nova.api.openstack.requestlog [None req-c7ff2edb-6252-4149-9d99-f86b6e86760b tempest-DeleteServersTestJSON-1632919649 tempest-DeleteServersTestJSON-1632919649-project] 10.222.0.43 "GET /compute/v2.1/servers/207d1d8d-58a4-4b99-aa09-1c5023c60784" status: 200 len: 1315 microversion: 2.1 time: 0.218117 Sep 13 18:02:23.885094 dv-cinder-852009-8-iscsi devstack@n-api.service[120740]: [pid: 120740|app: 0|req: 35/63] 10.222.0.43 () {58 vars in 1236 bytes} [Tue Sep 13 18:02:23 2022] GET /compute/v2.1/servers/207d1d8d-58a4-4b99-aa09-1c5023c60784 => generated 1315 bytes in 219 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 13 18:02:23.889542 dv-cinder-852009-8-iscsi devstack@n-api.service[120741]: DEBUG nova.policy [None req-da41b12f-ff04-4f95-9def-76c75050b69d tempest-AttachVolumeShelveTestJSON-385853788 tempest-AttachVolumeShelveTestJSON-385853788-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'e68ecd9b3ca643539b109f75bb242d6f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '75e14fd88bfb4cd896fa7b070a0fac47', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120741) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 18:02:23.890049 dv-cinder-852009-8-iscsi devstack@n-api.service[120740]: DEBUG nova.api.openstack.wsgi [None req-cf2a98cb-80b1-4e84-80f8-3e5e624cf39b tempest-AttachVolumeTestJSON-555093534 tempest-AttachVolumeTestJSON-555093534-project] Calling method '>' {{(pid=120740) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 18:02:23.890772 dv-cinder-852009-8-iscsi devstack@n-api.service[120740]: DEBUG nova.compute.api [None req-cf2a98cb-80b1-4e84-80f8-3e5e624cf39b tempest-AttachVolumeTestJSON-555093534 tempest-AttachVolumeTestJSON-555093534-project] [instance: b958d409-df20-44c6-aa0e-58cb0a482edf] Fetching instance by UUID {{(pid=120740) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 18:02:23.891002 dv-cinder-852009-8-iscsi devstack@n-api.service[120741]: DEBUG nova.policy [None req-da41b12f-ff04-4f95-9def-76c75050b69d tempest-AttachVolumeShelveTestJSON-385853788 tempest-AttachVolumeShelveTestJSON-385853788-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'e68ecd9b3ca643539b109f75bb242d6f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '75e14fd88bfb4cd896fa7b070a0fac47', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120741) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 18:02:23.892148 dv-cinder-852009-8-iscsi devstack@n-api.service[120741]: INFO nova.api.openstack.requestlog [None req-da41b12f-ff04-4f95-9def-76c75050b69d tempest-AttachVolumeShelveTestJSON-385853788 tempest-AttachVolumeShelveTestJSON-385853788-project] 10.222.0.43 "GET /compute/v2.1/servers/11d2616a-96f9-4a7a-aab8-219219986a8b" status: 200 len: 1405 microversion: 2.20 time: 0.216610 Sep 13 18:02:23.901206 dv-cinder-852009-8-iscsi devstack@n-api.service[120741]: [pid: 120741|app: 0|req: 29/64] 10.222.0.43 () {60 vars in 1277 bytes} [Tue Sep 13 18:02:23 2022] GET /compute/v2.1/servers/11d2616a-96f9-4a7a-aab8-219219986a8b => generated 1405 bytes in 218 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 13 18:02:23.901358 dv-cinder-852009-8-iscsi devstack@n-api.service[120740]: DEBUG oslo_concurrency.lockutils [None req-cf2a98cb-80b1-4e84-80f8-3e5e624cf39b tempest-AttachVolumeTestJSON-555093534 tempest-AttachVolumeTestJSON-555093534-project] Acquiring lock "1daf4f4c-0e4a-4779-b53a-78c48397ea2f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120740) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 18:02:23.901358 dv-cinder-852009-8-iscsi devstack@n-api.service[120740]: DEBUG oslo_concurrency.lockutils [None req-cf2a98cb-80b1-4e84-80f8-3e5e624cf39b tempest-AttachVolumeTestJSON-555093534 tempest-AttachVolumeTestJSON-555093534-project] Lock "1daf4f4c-0e4a-4779-b53a-78c48397ea2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120740) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 18:02:23.901358 dv-cinder-852009-8-iscsi devstack@n-api.service[120740]: DEBUG oslo_concurrency.lockutils [None req-cf2a98cb-80b1-4e84-80f8-3e5e624cf39b tempest-AttachVolumeTestJSON-555093534 tempest-AttachVolumeTestJSON-555093534-project] Lock "1daf4f4c-0e4a-4779-b53a-78c48397ea2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120740) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 18:02:23.901358 dv-cinder-852009-8-iscsi devstack@n-api.service[120740]: DEBUG oslo_concurrency.lockutils [None req-cf2a98cb-80b1-4e84-80f8-3e5e624cf39b tempest-AttachVolumeTestJSON-555093534 tempest-AttachVolumeTestJSON-555093534-project] Acquiring lock "1daf4f4c-0e4a-4779-b53a-78c48397ea2f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120740) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 18:02:23.901667 dv-cinder-852009-8-iscsi devstack@n-api.service[120740]: DEBUG oslo_concurrency.lockutils [None req-cf2a98cb-80b1-4e84-80f8-3e5e624cf39b tempest-AttachVolumeTestJSON-555093534 tempest-AttachVolumeTestJSON-555093534-project] Lock "1daf4f4c-0e4a-4779-b53a-78c48397ea2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120740) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 18:02:23.901667 dv-cinder-852009-8-iscsi devstack@n-api.service[120740]: DEBUG oslo_concurrency.lockutils [None req-cf2a98cb-80b1-4e84-80f8-3e5e624cf39b tempest-AttachVolumeTestJSON-555093534 tempest-AttachVolumeTestJSON-555093534-project] Lock "1daf4f4c-0e4a-4779-b53a-78c48397ea2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120740) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 18:02:24.029976 dv-cinder-852009-8-iscsi devstack@n-api.service[120740]: DEBUG nova.policy [None req-cf2a98cb-80b1-4e84-80f8-3e5e624cf39b tempest-AttachVolumeTestJSON-555093534 tempest-AttachVolumeTestJSON-555093534-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0625b3113ce044bbac4f6142eaade11c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a279fcbf274c4704a31a2b95061e1469', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120740) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 18:02:24.042186 dv-cinder-852009-8-iscsi devstack@n-api.service[120740]: INFO nova.api.openstack.requestlog [None req-cf2a98cb-80b1-4e84-80f8-3e5e624cf39b tempest-AttachVolumeTestJSON-555093534 tempest-AttachVolumeTestJSON-555093534-project] 10.222.0.43 "GET /compute/v2.1/servers/b958d409-df20-44c6-aa0e-58cb0a482edf" status: 200 len: 1362 microversion: 2.1 time: 0.155653 Sep 13 18:02:24.043012 dv-cinder-852009-8-iscsi devstack@n-api.service[120740]: [pid: 120740|app: 0|req: 36/65] 10.222.0.43 () {58 vars in 1236 bytes} [Tue Sep 13 18:02:23 2022] GET /compute/v2.1/servers/b958d409-df20-44c6-aa0e-58cb0a482edf => generated 1362 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 13 18:02:24.144124 dv-cinder-852009-8-iscsi devstack@n-api.service[120741]: DEBUG nova.api.openstack.wsgi [None req-9e9d6b0f-8748-4842-8e90-e8fcb7ae11ad tempest-ServerRescueNegativeTestJSON-412251590 tempest-ServerRescueNegativeTestJSON-412251590-project] Calling method '>' {{(pid=120741) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 18:02:24.144986 dv-cinder-852009-8-iscsi devstack@n-api.service[120741]: DEBUG nova.compute.api [None req-9e9d6b0f-8748-4842-8e90-e8fcb7ae11ad tempest-ServerRescueNegativeTestJSON-412251590 tempest-ServerRescueNegativeTestJSON-412251590-project] [instance: 8cd29851-35c1-4032-a137-ab9419a2ec5b] Fetching instance by UUID {{(pid=120741) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 18:02:24.151731 dv-cinder-852009-8-iscsi devstack@n-api.service[120741]: DEBUG oslo_concurrency.lockutils [None req-9e9d6b0f-8748-4842-8e90-e8fcb7ae11ad tempest-ServerRescueNegativeTestJSON-412251590 tempest-ServerRescueNegativeTestJSON-412251590-project] Acquiring lock "1daf4f4c-0e4a-4779-b53a-78c48397ea2f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120741) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 18:02:24.152218 dv-cinder-852009-8-iscsi devstack@n-api.service[120741]: DEBUG oslo_concurrency.lockutils [None req-9e9d6b0f-8748-4842-8e90-e8fcb7ae11ad tempest-ServerRescueNegativeTestJSON-412251590 tempest-ServerRescueNegativeTestJSON-412251590-project] Lock "1daf4f4c-0e4a-4779-b53a-78c48397ea2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120741) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 18:02:24.152684 dv-cinder-852009-8-iscsi devstack@n-api.service[120741]: DEBUG oslo_concurrency.lockutils [None req-9e9d6b0f-8748-4842-8e90-e8fcb7ae11ad tempest-ServerRescueNegativeTestJSON-412251590 tempest-ServerRescueNegativeTestJSON-412251590-project] Lock "1daf4f4c-0e4a-4779-b53a-78c48397ea2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120741) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 18:02:24.153390 dv-cinder-852009-8-iscsi devstack@n-api.service[120741]: DEBUG oslo_concurrency.lockutils [None req-9e9d6b0f-8748-4842-8e90-e8fcb7ae11ad tempest-ServerRescueNegativeTestJSON-412251590 tempest-ServerRescueNegativeTestJSON-412251590-project] Acquiring lock "1daf4f4c-0e4a-4779-b53a-78c48397ea2f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120741) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 18:02:24.153846 dv-cinder-852009-8-iscsi devstack@n-api.service[120741]: DEBUG oslo_concurrency.lockutils [None req-9e9d6b0f-8748-4842-8e90-e8fcb7ae11ad tempest-ServerRescueNegativeTestJSON-412251590 tempest-ServerRescueNegativeTestJSON-412251590-project] Lock "1daf4f4c-0e4a-4779-b53a-78c48397ea2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120741) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 18:02:24.154266 dv-cinder-852009-8-iscsi devstack@n-api.service[120741]: DEBUG oslo_concurrency.lockutils [None req-9e9d6b0f-8748-4842-8e90-e8fcb7ae11ad tempest-ServerRescueNegativeTestJSON-412251590 tempest-ServerRescueNegativeTestJSON-412251590-project] Lock "1daf4f4c-0e4a-4779-b53a-78c48397ea2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120741) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 18:02:24.296111 dv-cinder-852009-8-iscsi devstack@n-api.service[120741]: DEBUG nova.policy [None req-9e9d6b0f-8748-4842-8e90-e8fcb7ae11ad tempest-ServerRescueNegativeTestJSON-412251590 tempest-ServerRescueNegativeTestJSON-412251590-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '60800cf2774e409d9c1b6f4992669991', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2eae4acecf6c4961830ead78d71b2ad3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120741) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 18:02:24.305088 dv-cinder-852009-8-iscsi devstack@n-api.service[120741]: INFO nova.api.openstack.requestlog [None req-9e9d6b0f-8748-4842-8e90-e8fcb7ae11ad tempest-ServerRescueNegativeTestJSON-412251590 tempest-ServerRescueNegativeTestJSON-412251590-project] 10.222.0.43 "GET /compute/v2.1/servers/8cd29851-35c1-4032-a137-ab9419a2ec5b" status: 200 len: 1322 microversion: 2.1 time: 0.165087 Sep 13 18:02:24.305669 dv-cinder-852009-8-iscsi devstack@n-api.service[120741]: [pid: 120741|app: 0|req: 30/66] 10.222.0.43 () {58 vars in 1236 bytes} [Tue Sep 13 18:02:24 2022] GET /compute/v2.1/servers/8cd29851-35c1-4032-a137-ab9419a2ec5b => generated 1322 bytes in 166 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 13 18:02:24.912606 dv-cinder-852009-8-iscsi devstack@n-api.service[120740]: DEBUG nova.api.openstack.wsgi [None req-eb7d9a2e-5492-44a6-8cf1-b4388bb11afc tempest-DeleteServersTestJSON-1632919649 tempest-DeleteServersTestJSON-1632919649-project] Calling method '>' {{(pid=120740) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 18:02:24.913681 dv-cinder-852009-8-iscsi devstack@n-api.service[120740]: DEBUG nova.compute.api [None req-eb7d9a2e-5492-44a6-8cf1-b4388bb11afc tempest-DeleteServersTestJSON-1632919649 tempest-DeleteServersTestJSON-1632919649-project] [instance: 207d1d8d-58a4-4b99-aa09-1c5023c60784] Fetching instance by UUID {{(pid=120740) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 18:02:24.920860 dv-cinder-852009-8-iscsi devstack@n-api.service[120741]: DEBUG nova.api.openstack.wsgi [None req-3a7015c0-ca73-4433-b709-89ec55633448 tempest-AttachVolumeShelveTestJSON-385853788 tempest-AttachVolumeShelveTestJSON-385853788-project] Calling method '>' {{(pid=120741) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 18:02:24.921432 dv-cinder-852009-8-iscsi devstack@n-api.service[120741]: DEBUG nova.compute.api [None req-3a7015c0-ca73-4433-b709-89ec55633448 tempest-AttachVolumeShelveTestJSON-385853788 tempest-AttachVolumeShelveTestJSON-385853788-project] [instance: 11d2616a-96f9-4a7a-aab8-219219986a8b] Fetching instance by UUID {{(pid=120741) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 18:02:24.922769 dv-cinder-852009-8-iscsi devstack@n-api.service[120740]: DEBUG oslo_concurrency.lockutils [None req-eb7d9a2e-5492-44a6-8cf1-b4388bb11afc tempest-DeleteServersTestJSON-1632919649 tempest-DeleteServersTestJSON-1632919649-project] Acquiring lock "1daf4f4c-0e4a-4779-b53a-78c48397ea2f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120740) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 18:02:24.923380 dv-cinder-852009-8-iscsi devstack@n-api.service[120740]: DEBUG oslo_concurrency.lockutils [None req-eb7d9a2e-5492-44a6-8cf1-b4388bb11afc tempest-DeleteServersTestJSON-1632919649 tempest-DeleteServersTestJSON-1632919649-project] Lock "1daf4f4c-0e4a-4779-b53a-78c48397ea2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120740) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 18:02:24.924938 dv-cinder-852009-8-iscsi devstack@n-api.service[120740]: DEBUG oslo_concurrency.lockutils [None req-eb7d9a2e-5492-44a6-8cf1-b4388bb11afc tempest-DeleteServersTestJSON-1632919649 tempest-DeleteServersTestJSON-1632919649-project] Lock "1daf4f4c-0e4a-4779-b53a-78c48397ea2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120740) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 18:02:24.926108 dv-cinder-852009-8-iscsi devstack@n-api.service[120740]: DEBUG oslo_concurrency.lockutils [None req-eb7d9a2e-5492-44a6-8cf1-b4388bb11afc tempest-DeleteServersTestJSON-1632919649 tempest-DeleteServersTestJSON-1632919649-project] Acquiring lock "1daf4f4c-0e4a-4779-b53a-78c48397ea2f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120740) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 18:02:24.926912 dv-cinder-852009-8-iscsi devstack@n-api.service[120740]: DEBUG oslo_concurrency.lockutils [None req-eb7d9a2e-5492-44a6-8cf1-b4388bb11afc tempest-DeleteServersTestJSON-1632919649 tempest-DeleteServersTestJSON-1632919649-project] Lock "1daf4f4c-0e4a-4779-b53a-78c48397ea2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120740) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 18:02:24.928940 dv-cinder-852009-8-iscsi devstack@n-api.service[120740]: DEBUG oslo_concurrency.lockutils [None req-eb7d9a2e-5492-44a6-8cf1-b4388bb11afc tempest-DeleteServersTestJSON-1632919649 tempest-DeleteServersTestJSON-1632919649-project] Lock "1daf4f4c-0e4a-4779-b53a-78c48397ea2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120740) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 18:02:24.937059 dv-cinder-852009-8-iscsi devstack@n-api.service[120741]: DEBUG oslo_concurrency.lockutils [None req-3a7015c0-ca73-4433-b709-89ec55633448 tempest-AttachVolumeShelveTestJSON-385853788 tempest-AttachVolumeShelveTestJSON-385853788-project] Acquiring lock "1daf4f4c-0e4a-4779-b53a-78c48397ea2f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120741) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 18:02:24.937572 dv-cinder-852009-8-iscsi devstack@n-api.service[120741]: DEBUG oslo_concurrency.lockutils [None req-3a7015c0-ca73-4433-b709-89ec55633448 tempest-AttachVolumeShelveTestJSON-385853788 tempest-AttachVolumeShelveTestJSON-385853788-project] Lock "1daf4f4c-0e4a-4779-b53a-78c48397ea2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120741) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 18:02:24.940322 dv-cinder-852009-8-iscsi devstack@n-api.service[120741]: DEBUG oslo_concurrency.lockutils [None req-3a7015c0-ca73-4433-b709-89ec55633448 tempest-AttachVolumeShelveTestJSON-385853788 tempest-AttachVolumeShelveTestJSON-385853788-project] Lock "1daf4f4c-0e4a-4779-b53a-78c48397ea2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120741) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 18:02:24.941952 dv-cinder-852009-8-iscsi devstack@n-api.service[120741]: DEBUG oslo_concurrency.lockutils [None req-3a7015c0-ca73-4433-b709-89ec55633448 tempest-AttachVolumeShelveTestJSON-385853788 tempest-AttachVolumeShelveTestJSON-385853788-project] Acquiring lock "1daf4f4c-0e4a-4779-b53a-78c48397ea2f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120741) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 18:02:24.944187 dv-cinder-852009-8-iscsi devstack@n-api.service[120741]: DEBUG oslo_concurrency.lockutils [None req-3a7015c0-ca73-4433-b709-89ec55633448 tempest-AttachVolumeShelveTestJSON-385853788 tempest-AttachVolumeShelveTestJSON-385853788-project] Lock "1daf4f4c-0e4a-4779-b53a-78c48397ea2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120741) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 18:02:24.946022 dv-cinder-852009-8-iscsi devstack@n-api.service[120741]: DEBUG oslo_concurrency.lockutils [None req-3a7015c0-ca73-4433-b709-89ec55633448 tempest-AttachVolumeShelveTestJSON-385853788 tempest-AttachVolumeShelveTestJSON-385853788-project] Lock "1daf4f4c-0e4a-4779-b53a-78c48397ea2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120741) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 18:02:25.229046 dv-cinder-852009-8-iscsi devstack@n-api.service[120741]: DEBUG nova.policy [None req-3a7015c0-ca73-4433-b709-89ec55633448 tempest-AttachVolumeShelveTestJSON-385853788 tempest-AttachVolumeShelveTestJSON-385853788-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e68ecd9b3ca643539b109f75bb242d6f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '75e14fd88bfb4cd896fa7b070a0fac47', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120741) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 18:02:25.242233 dv-cinder-852009-8-iscsi devstack@n-api.service[120741]: DEBUG nova.policy [None req-3a7015c0-ca73-4433-b709-89ec55633448 tempest-AttachVolumeShelveTestJSON-385853788 tempest-AttachVolumeShelveTestJSON-385853788-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'e68ecd9b3ca643539b109f75bb242d6f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '75e14fd88bfb4cd896fa7b070a0fac47', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120741) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 18:02:25.245584 dv-cinder-852009-8-iscsi devstack@n-api.service[120741]: DEBUG nova.policy [None req-3a7015c0-ca73-4433-b709-89ec55633448 tempest-AttachVolumeShelveTestJSON-385853788 tempest-AttachVolumeShelveTestJSON-385853788-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'e68ecd9b3ca643539b109f75bb242d6f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '75e14fd88bfb4cd896fa7b070a0fac47', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120741) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 18:02:25.246770 dv-cinder-852009-8-iscsi devstack@n-api.service[120741]: INFO nova.api.openstack.requestlog [None req-3a7015c0-ca73-4433-b709-89ec55633448 tempest-AttachVolumeShelveTestJSON-385853788 tempest-AttachVolumeShelveTestJSON-385853788-project] 10.222.0.43 "GET /compute/v2.1/servers/11d2616a-96f9-4a7a-aab8-219219986a8b" status: 200 len: 1405 microversion: 2.20 time: 0.333183 Sep 13 18:02:25.248584 dv-cinder-852009-8-iscsi devstack@n-api.service[120741]: [pid: 120741|app: 0|req: 31/67] 10.222.0.43 () {60 vars in 1277 bytes} [Tue Sep 13 18:02:24 2022] GET /compute/v2.1/servers/11d2616a-96f9-4a7a-aab8-219219986a8b => generated 1405 bytes in 336 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 13 18:02:25.266613 dv-cinder-852009-8-iscsi devstack@n-api.service[120741]: DEBUG nova.api.openstack.wsgi [None req-5a475c8d-fd20-4efc-bc67-c7f5053a4d9d tempest-AttachVolumeTestJSON-555093534 tempest-AttachVolumeTestJSON-555093534-project] Calling method '>' {{(pid=120741) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 18:02:25.268533 dv-cinder-852009-8-iscsi devstack@n-api.service[120741]: DEBUG nova.compute.api [None req-5a475c8d-fd20-4efc-bc67-c7f5053a4d9d tempest-AttachVolumeTestJSON-555093534 tempest-AttachVolumeTestJSON-555093534-project] [instance: b958d409-df20-44c6-aa0e-58cb0a482edf] Fetching instance by UUID {{(pid=120741) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 18:02:25.278800 dv-cinder-852009-8-iscsi devstack@n-api.service[120741]: DEBUG oslo_concurrency.lockutils [None req-5a475c8d-fd20-4efc-bc67-c7f5053a4d9d tempest-AttachVolumeTestJSON-555093534 tempest-AttachVolumeTestJSON-555093534-project] Acquiring lock "1daf4f4c-0e4a-4779-b53a-78c48397ea2f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120741) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 18:02:25.279381 dv-cinder-852009-8-iscsi devstack@n-api.service[120741]: DEBUG oslo_concurrency.lockutils [None req-5a475c8d-fd20-4efc-bc67-c7f5053a4d9d tempest-AttachVolumeTestJSON-555093534 tempest-AttachVolumeTestJSON-555093534-project] Lock "1daf4f4c-0e4a-4779-b53a-78c48397ea2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120741) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 18:02:25.279816 dv-cinder-852009-8-iscsi devstack@n-api.service[120741]: DEBUG oslo_concurrency.lockutils [None req-5a475c8d-fd20-4efc-bc67-c7f5053a4d9d tempest-AttachVolumeTestJSON-555093534 tempest-AttachVolumeTestJSON-555093534-project] Lock "1daf4f4c-0e4a-4779-b53a-78c48397ea2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120741) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 18:02:25.280700 dv-cinder-852009-8-iscsi devstack@n-api.service[120741]: DEBUG oslo_concurrency.lockutils [None req-5a475c8d-fd20-4efc-bc67-c7f5053a4d9d tempest-AttachVolumeTestJSON-555093534 tempest-AttachVolumeTestJSON-555093534-project] Acquiring lock "1daf4f4c-0e4a-4779-b53a-78c48397ea2f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120741) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 18:02:25.281310 dv-cinder-852009-8-iscsi devstack@n-api.service[120741]: DEBUG oslo_concurrency.lockutils [None req-5a475c8d-fd20-4efc-bc67-c7f5053a4d9d tempest-AttachVolumeTestJSON-555093534 tempest-AttachVolumeTestJSON-555093534-project] Lock "1daf4f4c-0e4a-4779-b53a-78c48397ea2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120741) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 18:02:25.281745 dv-cinder-852009-8-iscsi devstack@n-api.service[120741]: DEBUG oslo_concurrency.lockutils [None req-5a475c8d-fd20-4efc-bc67-c7f5053a4d9d tempest-AttachVolumeTestJSON-555093534 tempest-AttachVolumeTestJSON-555093534-project] Lock "1daf4f4c-0e4a-4779-b53a-78c48397ea2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120741) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 18:02:25.306135 dv-cinder-852009-8-iscsi devstack@n-api.service[120740]: DEBUG nova.policy [None req-eb7d9a2e-5492-44a6-8cf1-b4388bb11afc tempest-DeleteServersTestJSON-1632919649 tempest-DeleteServersTestJSON-1632919649-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '51db5ef052144879b53979268ac4ceb5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '66136f123f5b4ad0a824920bbdf9d245', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120740) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 18:02:25.315978 dv-cinder-852009-8-iscsi devstack@n-api.service[120740]: INFO nova.api.openstack.requestlog [None req-eb7d9a2e-5492-44a6-8cf1-b4388bb11afc tempest-DeleteServersTestJSON-1632919649 tempest-DeleteServersTestJSON-1632919649-project] 10.222.0.43 "GET /compute/v2.1/servers/207d1d8d-58a4-4b99-aa09-1c5023c60784" status: 200 len: 1315 microversion: 2.1 time: 0.410962 Sep 13 18:02:25.316748 dv-cinder-852009-8-iscsi devstack@n-api.service[120740]: [pid: 120740|app: 0|req: 37/68] 10.222.0.43 () {58 vars in 1236 bytes} [Tue Sep 13 18:02:24 2022] GET /compute/v2.1/servers/207d1d8d-58a4-4b99-aa09-1c5023c60784 => generated 1315 bytes in 413 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 13 18:02:25.417503 dv-cinder-852009-8-iscsi devstack@n-api.service[120740]: DEBUG nova.api.openstack.wsgi [req-921369a5-41fc-4d46-b800-362a91c1876e req-25ccbf97-1fda-4bb0-b748-3adbcdc451f0 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "a9c22f82-a945-4a94-b3c9-fe95265053bd", "name": "network-vif-plugged", "status": "completed", "tag": "e84094dd-b823-4e24-a968-9356ccb4ceb5"}]} {{(pid=120740) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 13 18:02:25.428450 dv-cinder-852009-8-iscsi devstack@n-api.service[120740]: DEBUG oslo_concurrency.lockutils [req-921369a5-41fc-4d46-b800-362a91c1876e req-25ccbf97-1fda-4bb0-b748-3adbcdc451f0 service nova] Acquiring lock "1daf4f4c-0e4a-4779-b53a-78c48397ea2f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120740) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 18:02:25.429172 dv-cinder-852009-8-iscsi devstack@n-api.service[120740]: DEBUG oslo_concurrency.lockutils [req-921369a5-41fc-4d46-b800-362a91c1876e req-25ccbf97-1fda-4bb0-b748-3adbcdc451f0 service nova] Lock "1daf4f4c-0e4a-4779-b53a-78c48397ea2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120740) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 18:02:25.429794 dv-cinder-852009-8-iscsi devstack@n-api.service[120740]: DEBUG oslo_concurrency.lockutils [req-921369a5-41fc-4d46-b800-362a91c1876e req-25ccbf97-1fda-4bb0-b748-3adbcdc451f0 service nova] Lock "1daf4f4c-0e4a-4779-b53a-78c48397ea2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120740) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 18:02:25.445102 dv-cinder-852009-8-iscsi devstack@n-api.service[120740]: INFO nova.api.openstack.compute.server_external_events [req-921369a5-41fc-4d46-b800-362a91c1876e req-25ccbf97-1fda-4bb0-b748-3adbcdc451f0 service nova] Creating event network-vif-plugged:e84094dd-b823-4e24-a968-9356ccb4ceb5 for instance a9c22f82-a945-4a94-b3c9-fe95265053bd on hv-cinder-85200 Sep 13 18:02:25.451562 dv-cinder-852009-8-iscsi devstack@n-api.service[120740]: INFO nova.api.openstack.requestlog [req-921369a5-41fc-4d46-b800-362a91c1876e req-25ccbf97-1fda-4bb0-b748-3adbcdc451f0 service nova] 10.222.0.43 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.133583 Sep 13 18:02:25.453091 dv-cinder-852009-8-iscsi devstack@n-api.service[120740]: [pid: 120740|app: 0|req: 38/69] 10.222.0.43 () {64 vars in 1317 bytes} [Tue Sep 13 18:02:25 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 136 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 13 18:02:25.459888 dv-cinder-852009-8-iscsi devstack@n-api.service[120740]: DEBUG nova.api.openstack.wsgi [None req-fd371ca2-ebe9-42b6-a568-1d7444532a16 tempest-ServerRescueNegativeTestJSON-412251590 tempest-ServerRescueNegativeTestJSON-412251590-project] Calling method '>' {{(pid=120740) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 18:02:25.460686 dv-cinder-852009-8-iscsi devstack@n-api.service[120740]: DEBUG nova.compute.api [None req-fd371ca2-ebe9-42b6-a568-1d7444532a16 tempest-ServerRescueNegativeTestJSON-412251590 tempest-ServerRescueNegativeTestJSON-412251590-project] [instance: 8cd29851-35c1-4032-a137-ab9419a2ec5b] Fetching instance by UUID {{(pid=120740) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 18:02:25.468798 dv-cinder-852009-8-iscsi devstack@n-api.service[120740]: DEBUG oslo_concurrency.lockutils [None req-fd371ca2-ebe9-42b6-a568-1d7444532a16 tempest-ServerRescueNegativeTestJSON-412251590 tempest-ServerRescueNegativeTestJSON-412251590-project] Acquiring lock "1daf4f4c-0e4a-4779-b53a-78c48397ea2f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120740) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 18:02:25.469832 dv-cinder-852009-8-iscsi devstack@n-api.service[120740]: DEBUG oslo_concurrency.lockutils [None req-fd371ca2-ebe9-42b6-a568-1d7444532a16 tempest-ServerRescueNegativeTestJSON-412251590 tempest-ServerRescueNegativeTestJSON-412251590-project] Lock "1daf4f4c-0e4a-4779-b53a-78c48397ea2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120740) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 18:02:25.470342 dv-cinder-852009-8-iscsi devstack@n-api.service[120740]: DEBUG oslo_concurrency.lockutils [None req-fd371ca2-ebe9-42b6-a568-1d7444532a16 tempest-ServerRescueNegativeTestJSON-412251590 tempest-ServerRescueNegativeTestJSON-412251590-project] Lock "1daf4f4c-0e4a-4779-b53a-78c48397ea2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120740) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 18:02:25.471068 dv-cinder-852009-8-iscsi devstack@n-api.service[120740]: DEBUG oslo_concurrency.lockutils [None req-fd371ca2-ebe9-42b6-a568-1d7444532a16 tempest-ServerRescueNegativeTestJSON-412251590 tempest-ServerRescueNegativeTestJSON-412251590-project] Acquiring lock "1daf4f4c-0e4a-4779-b53a-78c48397ea2f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120740) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 18:02:25.471930 dv-cinder-852009-8-iscsi devstack@n-api.service[120740]: DEBUG oslo_concurrency.lockutils [None req-fd371ca2-ebe9-42b6-a568-1d7444532a16 tempest-ServerRescueNegativeTestJSON-412251590 tempest-ServerRescueNegativeTestJSON-412251590-project] Lock "1daf4f4c-0e4a-4779-b53a-78c48397ea2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120740) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 18:02:25.472684 dv-cinder-852009-8-iscsi devstack@n-api.service[120740]: DEBUG oslo_concurrency.lockutils [None req-fd371ca2-ebe9-42b6-a568-1d7444532a16 tempest-ServerRescueNegativeTestJSON-412251590 tempest-ServerRescueNegativeTestJSON-412251590-project] Lock "1daf4f4c-0e4a-4779-b53a-78c48397ea2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120740) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 18:02:25.644669 dv-cinder-852009-8-iscsi devstack@n-api.service[120741]: DEBUG nova.policy [None req-5a475c8d-fd20-4efc-bc67-c7f5053a4d9d tempest-AttachVolumeTestJSON-555093534 tempest-AttachVolumeTestJSON-555093534-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0625b3113ce044bbac4f6142eaade11c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a279fcbf274c4704a31a2b95061e1469', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120741) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 18:02:25.657950 dv-cinder-852009-8-iscsi devstack@n-api.service[120741]: INFO nova.api.openstack.requestlog [None req-5a475c8d-fd20-4efc-bc67-c7f5053a4d9d tempest-AttachVolumeTestJSON-555093534 tempest-AttachVolumeTestJSON-555093534-project] 10.222.0.43 "GET /compute/v2.1/servers/b958d409-df20-44c6-aa0e-58cb0a482edf" status: 200 len: 1362 microversion: 2.1 time: 0.407331 Sep 13 18:02:25.658557 dv-cinder-852009-8-iscsi devstack@n-api.service[120741]: [pid: 120741|app: 0|req: 32/70] 10.222.0.43 () {58 vars in 1236 bytes} [Tue Sep 13 18:02:25 2022] GET /compute/v2.1/servers/b958d409-df20-44c6-aa0e-58cb0a482edf => generated 1362 bytes in 409 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 13 18:02:25.772889 dv-cinder-852009-8-iscsi devstack@n-api.service[120740]: DEBUG nova.policy [None req-fd371ca2-ebe9-42b6-a568-1d7444532a16 tempest-ServerRescueNegativeTestJSON-412251590 tempest-ServerRescueNegativeTestJSON-412251590-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '60800cf2774e409d9c1b6f4992669991', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2eae4acecf6c4961830ead78d71b2ad3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120740) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 18:02:25.784838 dv-cinder-852009-8-iscsi devstack@n-api.service[120740]: INFO nova.api.openstack.requestlog [None req-fd371ca2-ebe9-42b6-a568-1d7444532a16 tempest-ServerRescueNegativeTestJSON-412251590 tempest-ServerRescueNegativeTestJSON-412251590-project] 10.222.0.43 "GET /compute/v2.1/servers/8cd29851-35c1-4032-a137-ab9419a2ec5b" status: 200 len: 1322 microversion: 2.1 time: 0.328183 Sep 13 18:02:25.784838 dv-cinder-852009-8-iscsi devstack@n-api.service[120740]: [pid: 120740|app: 0|req: 39/71] 10.222.0.43 () {58 vars in 1236 bytes} [Tue Sep 13 18:02:25 2022] GET /compute/v2.1/servers/8cd29851-35c1-4032-a137-ab9419a2ec5b => generated 1322 bytes in 330 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 13 18:02:26.273901 dv-cinder-852009-8-iscsi devstack@n-api.service[120741]: DEBUG nova.api.openstack.wsgi [None req-32c39950-0511-4165-a0d8-8ec8ed77fa04 tempest-AttachVolumeShelveTestJSON-385853788 tempest-AttachVolumeShelveTestJSON-385853788-project] Calling method '>' {{(pid=120741) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 18:02:26.275198 dv-cinder-852009-8-iscsi devstack@n-api.service[120741]: DEBUG nova.compute.api [None req-32c39950-0511-4165-a0d8-8ec8ed77fa04 tempest-AttachVolumeShelveTestJSON-385853788 tempest-AttachVolumeShelveTestJSON-385853788-project] [instance: 11d2616a-96f9-4a7a-aab8-219219986a8b] Fetching instance by UUID {{(pid=120741) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 18:02:26.281670 dv-cinder-852009-8-iscsi devstack@n-api.service[120741]: DEBUG oslo_concurrency.lockutils [None req-32c39950-0511-4165-a0d8-8ec8ed77fa04 tempest-AttachVolumeShelveTestJSON-385853788 tempest-AttachVolumeShelveTestJSON-385853788-project] Acquiring lock "1daf4f4c-0e4a-4779-b53a-78c48397ea2f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120741) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 18:02:26.282553 dv-cinder-852009-8-iscsi devstack@n-api.service[120741]: DEBUG oslo_concurrency.lockutils [None req-32c39950-0511-4165-a0d8-8ec8ed77fa04 tempest-AttachVolumeShelveTestJSON-385853788 tempest-AttachVolumeShelveTestJSON-385853788-project] Lock "1daf4f4c-0e4a-4779-b53a-78c48397ea2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120741) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 18:02:26.283187 dv-cinder-852009-8-iscsi devstack@n-api.service[120741]: DEBUG oslo_concurrency.lockutils [None req-32c39950-0511-4165-a0d8-8ec8ed77fa04 tempest-AttachVolumeShelveTestJSON-385853788 tempest-AttachVolumeShelveTestJSON-385853788-project] Lock "1daf4f4c-0e4a-4779-b53a-78c48397ea2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120741) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 18:02:26.284043 dv-cinder-852009-8-iscsi devstack@n-api.service[120741]: DEBUG oslo_concurrency.lockutils [None req-32c39950-0511-4165-a0d8-8ec8ed77fa04 tempest-AttachVolumeShelveTestJSON-385853788 tempest-AttachVolumeShelveTestJSON-385853788-project] Acquiring lock "1daf4f4c-0e4a-4779-b53a-78c48397ea2f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120741) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 18:02:26.284980 dv-cinder-852009-8-iscsi devstack@n-api.service[120741]: DEBUG oslo_concurrency.lockutils [None req-32c39950-0511-4165-a0d8-8ec8ed77fa04 tempest-AttachVolumeShelveTestJSON-385853788 tempest-AttachVolumeShelveTestJSON-385853788-project] Lock "1daf4f4c-0e4a-4779-b53a-78c48397ea2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120741) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 18:02:26.285594 dv-cinder-852009-8-iscsi devstack@n-api.service[120741]: DEBUG oslo_concurrency.lockutils [None req-32c39950-0511-4165-a0d8-8ec8ed77fa04 tempest-AttachVolumeShelveTestJSON-385853788 tempest-AttachVolumeShelveTestJSON-385853788-project] Lock "1daf4f4c-0e4a-4779-b53a-78c48397ea2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120741) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 18:02:26.341205 dv-cinder-852009-8-iscsi devstack@n-api.service[120740]: DEBUG nova.api.openstack.wsgi [None req-97214115-080f-4f9d-9ab7-c3d85bae0a67 tempest-DeleteServersTestJSON-1632919649 tempest-DeleteServersTestJSON-1632919649-project] Calling method '>' {{(pid=120740) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 18:02:26.341797 dv-cinder-852009-8-iscsi devstack@n-api.service[120740]: DEBUG nova.compute.api [None req-97214115-080f-4f9d-9ab7-c3d85bae0a67 tempest-DeleteServersTestJSON-1632919649 tempest-DeleteServersTestJSON-1632919649-project] [instance: 207d1d8d-58a4-4b99-aa09-1c5023c60784] Fetching instance by UUID {{(pid=120740) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 18:02:26.348490 dv-cinder-852009-8-iscsi devstack@n-api.service[120740]: DEBUG oslo_concurrency.lockutils [None req-97214115-080f-4f9d-9ab7-c3d85bae0a67 tempest-DeleteServersTestJSON-1632919649 tempest-DeleteServersTestJSON-1632919649-project] Acquiring lock "1daf4f4c-0e4a-4779-b53a-78c48397ea2f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120740) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 18:02:26.348981 dv-cinder-852009-8-iscsi devstack@n-api.service[120740]: DEBUG oslo_concurrency.lockutils [None req-97214115-080f-4f9d-9ab7-c3d85bae0a67 tempest-DeleteServersTestJSON-1632919649 tempest-DeleteServersTestJSON-1632919649-project] Lock "1daf4f4c-0e4a-4779-b53a-78c48397ea2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120740) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 18:02:26.349452 dv-cinder-852009-8-iscsi devstack@n-api.service[120740]: DEBUG oslo_concurrency.lockutils [None req-97214115-080f-4f9d-9ab7-c3d85bae0a67 tempest-DeleteServersTestJSON-1632919649 tempest-DeleteServersTestJSON-1632919649-project] Lock "1daf4f4c-0e4a-4779-b53a-78c48397ea2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120740) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 18:02:26.350863 dv-cinder-852009-8-iscsi devstack@n-api.service[120740]: DEBUG oslo_concurrency.lockutils [None req-97214115-080f-4f9d-9ab7-c3d85bae0a67 tempest-DeleteServersTestJSON-1632919649 tempest-DeleteServersTestJSON-1632919649-project] Acquiring lock "1daf4f4c-0e4a-4779-b53a-78c48397ea2f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120740) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 18:02:26.350863 dv-cinder-852009-8-iscsi devstack@n-api.service[120740]: DEBUG oslo_concurrency.lockutils [None req-97214115-080f-4f9d-9ab7-c3d85bae0a67 tempest-DeleteServersTestJSON-1632919649 tempest-DeleteServersTestJSON-1632919649-project] Lock "1daf4f4c-0e4a-4779-b53a-78c48397ea2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120740) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 18:02:26.351074 dv-cinder-852009-8-iscsi devstack@n-api.service[120740]: DEBUG oslo_concurrency.lockutils [None req-97214115-080f-4f9d-9ab7-c3d85bae0a67 tempest-DeleteServersTestJSON-1632919649 tempest-DeleteServersTestJSON-1632919649-project] Lock "1daf4f4c-0e4a-4779-b53a-78c48397ea2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120740) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 18:02:26.355598 dv-cinder-852009-8-iscsi devstack@n-api.service[120740]: DEBUG dbcounter [-] [120740] Writing DB stats nova_cell1:SELECT=100 {{(pid=120740) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 18:02:26.657962 dv-cinder-852009-8-iscsi devstack@n-api.service[120741]: DEBUG dbcounter [-] [120741] Writing DB stats nova_cell0:SELECT=2 {{(pid=120741) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 18:02:26.735479 dv-cinder-852009-8-iscsi devstack@n-api.service[120741]: DEBUG nova.policy [None req-32c39950-0511-4165-a0d8-8ec8ed77fa04 tempest-AttachVolumeShelveTestJSON-385853788 tempest-AttachVolumeShelveTestJSON-385853788-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e68ecd9b3ca643539b109f75bb242d6f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '75e14fd88bfb4cd896fa7b070a0fac47', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120741) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 18:02:26.737110 dv-cinder-852009-8-iscsi devstack@n-api.service[120740]: DEBUG nova.policy [None req-97214115-080f-4f9d-9ab7-c3d85bae0a67 tempest-DeleteServersTestJSON-1632919649 tempest-DeleteServersTestJSON-1632919649-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '51db5ef052144879b53979268ac4ceb5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '66136f123f5b4ad0a824920bbdf9d245', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120740) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 18:02:26.745135 dv-cinder-852009-8-iscsi devstack@n-api.service[120741]: DEBUG nova.policy [None req-32c39950-0511-4165-a0d8-8ec8ed77fa04 tempest-AttachVolumeShelveTestJSON-385853788 tempest-AttachVolumeShelveTestJSON-385853788-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'e68ecd9b3ca643539b109f75bb242d6f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '75e14fd88bfb4cd896fa7b070a0fac47', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120741) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 18:02:26.745353 dv-cinder-852009-8-iscsi devstack@n-api.service[120740]: INFO nova.api.openstack.requestlog [None req-97214115-080f-4f9d-9ab7-c3d85bae0a67 tempest-DeleteServersTestJSON-1632919649 tempest-DeleteServersTestJSON-1632919649-project] 10.222.0.43 "GET /compute/v2.1/servers/207d1d8d-58a4-4b99-aa09-1c5023c60784" status: 200 len: 1315 microversion: 2.1 time: 0.407961 Sep 13 18:02:26.746035 dv-cinder-852009-8-iscsi devstack@n-api.service[120740]: [pid: 120740|app: 0|req: 40/72] 10.222.0.43 () {58 vars in 1236 bytes} [Tue Sep 13 18:02:26 2022] GET /compute/v2.1/servers/207d1d8d-58a4-4b99-aa09-1c5023c60784 => generated 1315 bytes in 409 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 13 18:02:26.747203 dv-cinder-852009-8-iscsi devstack@n-api.service[120741]: DEBUG nova.policy [None req-32c39950-0511-4165-a0d8-8ec8ed77fa04 tempest-AttachVolumeShelveTestJSON-385853788 tempest-AttachVolumeShelveTestJSON-385853788-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'e68ecd9b3ca643539b109f75bb242d6f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '75e14fd88bfb4cd896fa7b070a0fac47', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120741) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 18:02:26.748585 dv-cinder-852009-8-iscsi devstack@n-api.service[120741]: INFO nova.api.openstack.requestlog [None req-32c39950-0511-4165-a0d8-8ec8ed77fa04 tempest-AttachVolumeShelveTestJSON-385853788 tempest-AttachVolumeShelveTestJSON-385853788-project] 10.222.0.43 "GET /compute/v2.1/servers/11d2616a-96f9-4a7a-aab8-219219986a8b" status: 200 len: 1405 microversion: 2.20 time: 0.479163 Sep 13 18:02:26.749712 dv-cinder-852009-8-iscsi devstack@n-api.service[120741]: [pid: 120741|app: 0|req: 33/73] 10.222.0.43 () {60 vars in 1277 bytes} [Tue Sep 13 18:02:26 2022] GET /compute/v2.1/servers/11d2616a-96f9-4a7a-aab8-219219986a8b => generated 1405 bytes in 481 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 13 18:02:26.751640 dv-cinder-852009-8-iscsi devstack@n-api.service[120740]: DEBUG nova.api.openstack.wsgi [None req-ab1ef6e9-a7f7-4884-b6cf-883e625cd9f6 tempest-AttachVolumeTestJSON-555093534 tempest-AttachVolumeTestJSON-555093534-project] Calling method '>' {{(pid=120740) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 18:02:26.752314 dv-cinder-852009-8-iscsi devstack@n-api.service[120740]: DEBUG nova.compute.api [None req-ab1ef6e9-a7f7-4884-b6cf-883e625cd9f6 tempest-AttachVolumeTestJSON-555093534 tempest-AttachVolumeTestJSON-555093534-project] [instance: b958d409-df20-44c6-aa0e-58cb0a482edf] Fetching instance by UUID {{(pid=120740) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 18:02:26.759011 dv-cinder-852009-8-iscsi devstack@n-api.service[120740]: DEBUG oslo_concurrency.lockutils [None req-ab1ef6e9-a7f7-4884-b6cf-883e625cd9f6 tempest-AttachVolumeTestJSON-555093534 tempest-AttachVolumeTestJSON-555093534-project] Acquiring lock "1daf4f4c-0e4a-4779-b53a-78c48397ea2f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120740) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 18:02:26.759568 dv-cinder-852009-8-iscsi devstack@n-api.service[120740]: DEBUG oslo_concurrency.lockutils [None req-ab1ef6e9-a7f7-4884-b6cf-883e625cd9f6 tempest-AttachVolumeTestJSON-555093534 tempest-AttachVolumeTestJSON-555093534-project] Lock "1daf4f4c-0e4a-4779-b53a-78c48397ea2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120740) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 18:02:26.760082 dv-cinder-852009-8-iscsi devstack@n-api.service[120740]: DEBUG oslo_concurrency.lockutils [None req-ab1ef6e9-a7f7-4884-b6cf-883e625cd9f6 tempest-AttachVolumeTestJSON-555093534 tempest-AttachVolumeTestJSON-555093534-project] Lock "1daf4f4c-0e4a-4779-b53a-78c48397ea2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120740) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 18:02:26.760885 dv-cinder-852009-8-iscsi devstack@n-api.service[120740]: DEBUG oslo_concurrency.lockutils [None req-ab1ef6e9-a7f7-4884-b6cf-883e625cd9f6 tempest-AttachVolumeTestJSON-555093534 tempest-AttachVolumeTestJSON-555093534-project] Acquiring lock "1daf4f4c-0e4a-4779-b53a-78c48397ea2f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120740) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 18:02:26.761400 dv-cinder-852009-8-iscsi devstack@n-api.service[120740]: DEBUG oslo_concurrency.lockutils [None req-ab1ef6e9-a7f7-4884-b6cf-883e625cd9f6 tempest-AttachVolumeTestJSON-555093534 tempest-AttachVolumeTestJSON-555093534-project] Lock "1daf4f4c-0e4a-4779-b53a-78c48397ea2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120740) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 18:02:26.761888 dv-cinder-852009-8-iscsi devstack@n-api.service[120740]: DEBUG oslo_concurrency.lockutils [None req-ab1ef6e9-a7f7-4884-b6cf-883e625cd9f6 tempest-AttachVolumeTestJSON-555093534 tempest-AttachVolumeTestJSON-555093534-project] Lock "1daf4f4c-0e4a-4779-b53a-78c48397ea2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120740) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 18:02:26.805364 dv-cinder-852009-8-iscsi devstack@n-api.service[120741]: DEBUG nova.api.openstack.wsgi [None req-d39cb008-dffe-49ab-bccf-03de16b0d855 tempest-ServerRescueNegativeTestJSON-412251590 tempest-ServerRescueNegativeTestJSON-412251590-project] Calling method '>' {{(pid=120741) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 18:02:26.805982 dv-cinder-852009-8-iscsi devstack@n-api.service[120741]: DEBUG nova.compute.api [None req-d39cb008-dffe-49ab-bccf-03de16b0d855 tempest-ServerRescueNegativeTestJSON-412251590 tempest-ServerRescueNegativeTestJSON-412251590-project] [instance: 8cd29851-35c1-4032-a137-ab9419a2ec5b] Fetching instance by UUID {{(pid=120741) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 18:02:26.812069 dv-cinder-852009-8-iscsi devstack@n-api.service[120741]: DEBUG oslo_concurrency.lockutils [None req-d39cb008-dffe-49ab-bccf-03de16b0d855 tempest-ServerRescueNegativeTestJSON-412251590 tempest-ServerRescueNegativeTestJSON-412251590-project] Acquiring lock "1daf4f4c-0e4a-4779-b53a-78c48397ea2f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120741) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 18:02:26.812847 dv-cinder-852009-8-iscsi devstack@n-api.service[120741]: DEBUG oslo_concurrency.lockutils [None req-d39cb008-dffe-49ab-bccf-03de16b0d855 tempest-ServerRescueNegativeTestJSON-412251590 tempest-ServerRescueNegativeTestJSON-412251590-project] Lock "1daf4f4c-0e4a-4779-b53a-78c48397ea2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120741) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 18:02:26.813290 dv-cinder-852009-8-iscsi devstack@n-api.service[120741]: DEBUG oslo_concurrency.lockutils [None req-d39cb008-dffe-49ab-bccf-03de16b0d855 tempest-ServerRescueNegativeTestJSON-412251590 tempest-ServerRescueNegativeTestJSON-412251590-project] Lock "1daf4f4c-0e4a-4779-b53a-78c48397ea2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120741) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 18:02:26.814323 dv-cinder-852009-8-iscsi devstack@n-api.service[120741]: DEBUG oslo_concurrency.lockutils [None req-d39cb008-dffe-49ab-bccf-03de16b0d855 tempest-ServerRescueNegativeTestJSON-412251590 tempest-ServerRescueNegativeTestJSON-412251590-project] Acquiring lock "1daf4f4c-0e4a-4779-b53a-78c48397ea2f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120741) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 18:02:26.814781 dv-cinder-852009-8-iscsi devstack@n-api.service[120741]: DEBUG oslo_concurrency.lockutils [None req-d39cb008-dffe-49ab-bccf-03de16b0d855 tempest-ServerRescueNegativeTestJSON-412251590 tempest-ServerRescueNegativeTestJSON-412251590-project] Lock "1daf4f4c-0e4a-4779-b53a-78c48397ea2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120741) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 18:02:26.815206 dv-cinder-852009-8-iscsi devstack@n-api.service[120741]: DEBUG oslo_concurrency.lockutils [None req-d39cb008-dffe-49ab-bccf-03de16b0d855 tempest-ServerRescueNegativeTestJSON-412251590 tempest-ServerRescueNegativeTestJSON-412251590-project] Lock "1daf4f4c-0e4a-4779-b53a-78c48397ea2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120741) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 18:02:26.974603 dv-cinder-852009-8-iscsi devstack@n-api.service[120740]: DEBUG nova.policy [None req-ab1ef6e9-a7f7-4884-b6cf-883e625cd9f6 tempest-AttachVolumeTestJSON-555093534 tempest-AttachVolumeTestJSON-555093534-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0625b3113ce044bbac4f6142eaade11c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a279fcbf274c4704a31a2b95061e1469', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120740) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 18:02:26.985522 dv-cinder-852009-8-iscsi devstack@n-api.service[120740]: INFO nova.api.openstack.requestlog [None req-ab1ef6e9-a7f7-4884-b6cf-883e625cd9f6 tempest-AttachVolumeTestJSON-555093534 tempest-AttachVolumeTestJSON-555093534-project] 10.222.0.43 "GET /compute/v2.1/servers/b958d409-df20-44c6-aa0e-58cb0a482edf" status: 200 len: 1362 microversion: 2.1 time: 0.238292 Sep 13 18:02:26.987204 dv-cinder-852009-8-iscsi devstack@n-api.service[120740]: [pid: 120740|app: 0|req: 41/74] 10.222.0.43 () {58 vars in 1236 bytes} [Tue Sep 13 18:02:26 2022] GET /compute/v2.1/servers/b958d409-df20-44c6-aa0e-58cb0a482edf => generated 1362 bytes in 240 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 13 18:02:27.005043 dv-cinder-852009-8-iscsi devstack@n-api.service[120741]: DEBUG nova.policy [None req-d39cb008-dffe-49ab-bccf-03de16b0d855 tempest-ServerRescueNegativeTestJSON-412251590 tempest-ServerRescueNegativeTestJSON-412251590-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '60800cf2774e409d9c1b6f4992669991', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2eae4acecf6c4961830ead78d71b2ad3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120741) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 18:02:27.013651 dv-cinder-852009-8-iscsi devstack@n-api.service[120741]: INFO nova.api.openstack.requestlog [None req-d39cb008-dffe-49ab-bccf-03de16b0d855 tempest-ServerRescueNegativeTestJSON-412251590 tempest-ServerRescueNegativeTestJSON-412251590-project] 10.222.0.43 "GET /compute/v2.1/servers/8cd29851-35c1-4032-a137-ab9419a2ec5b" status: 200 len: 1322 microversion: 2.1 time: 0.212489 Sep 13 18:02:27.014476 dv-cinder-852009-8-iscsi devstack@n-api.service[120741]: [pid: 120741|app: 0|req: 34/75] 10.222.0.43 () {58 vars in 1236 bytes} [Tue Sep 13 18:02:26 2022] GET /compute/v2.1/servers/8cd29851-35c1-4032-a137-ab9419a2ec5b => generated 1322 bytes in 214 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 13 18:02:27.768960 dv-cinder-852009-8-iscsi devstack@n-api.service[120740]: DEBUG nova.api.openstack.wsgi [None req-dcfeaf9a-24e0-48d7-859a-7fa727698e6f tempest-DeleteServersTestJSON-1632919649 tempest-DeleteServersTestJSON-1632919649-project] Calling method '>' {{(pid=120740) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 18:02:27.769584 dv-cinder-852009-8-iscsi devstack@n-api.service[120740]: DEBUG nova.compute.api [None req-dcfeaf9a-24e0-48d7-859a-7fa727698e6f tempest-DeleteServersTestJSON-1632919649 tempest-DeleteServersTestJSON-1632919649-project] [instance: 207d1d8d-58a4-4b99-aa09-1c5023c60784] Fetching instance by UUID {{(pid=120740) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 18:02:27.775812 dv-cinder-852009-8-iscsi devstack@n-api.service[120740]: DEBUG oslo_concurrency.lockutils [None req-dcfeaf9a-24e0-48d7-859a-7fa727698e6f tempest-DeleteServersTestJSON-1632919649 tempest-DeleteServersTestJSON-1632919649-project] Acquiring lock "1daf4f4c-0e4a-4779-b53a-78c48397ea2f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120740) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 18:02:27.776307 dv-cinder-852009-8-iscsi devstack@n-api.service[120740]: DEBUG oslo_concurrency.lockutils [None req-dcfeaf9a-24e0-48d7-859a-7fa727698e6f tempest-DeleteServersTestJSON-1632919649 tempest-DeleteServersTestJSON-1632919649-project] Lock "1daf4f4c-0e4a-4779-b53a-78c48397ea2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120740) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 18:02:27.776770 dv-cinder-852009-8-iscsi devstack@n-api.service[120740]: DEBUG oslo_concurrency.lockutils [None req-dcfeaf9a-24e0-48d7-859a-7fa727698e6f tempest-DeleteServersTestJSON-1632919649 tempest-DeleteServersTestJSON-1632919649-project] Lock "1daf4f4c-0e4a-4779-b53a-78c48397ea2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120740) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 18:02:27.777471 dv-cinder-852009-8-iscsi devstack@n-api.service[120740]: DEBUG oslo_concurrency.lockutils [None req-dcfeaf9a-24e0-48d7-859a-7fa727698e6f tempest-DeleteServersTestJSON-1632919649 tempest-DeleteServersTestJSON-1632919649-project] Acquiring lock "1daf4f4c-0e4a-4779-b53a-78c48397ea2f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120740) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 18:02:27.777918 dv-cinder-852009-8-iscsi devstack@n-api.service[120740]: DEBUG oslo_concurrency.lockutils [None req-dcfeaf9a-24e0-48d7-859a-7fa727698e6f tempest-DeleteServersTestJSON-1632919649 tempest-DeleteServersTestJSON-1632919649-project] Lock "1daf4f4c-0e4a-4779-b53a-78c48397ea2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120740) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 18:02:27.778446 dv-cinder-852009-8-iscsi devstack@n-api.service[120740]: DEBUG oslo_concurrency.lockutils [None req-dcfeaf9a-24e0-48d7-859a-7fa727698e6f tempest-DeleteServersTestJSON-1632919649 tempest-DeleteServersTestJSON-1632919649-project] Lock "1daf4f4c-0e4a-4779-b53a-78c48397ea2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120740) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 18:02:27.781158 dv-cinder-852009-8-iscsi devstack@n-api.service[120741]: DEBUG nova.api.openstack.wsgi [None req-15e3bd7d-62a5-426b-9548-dbba5bc18706 tempest-AttachVolumeShelveTestJSON-385853788 tempest-AttachVolumeShelveTestJSON-385853788-project] Calling method '>' {{(pid=120741) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 18:02:27.781946 dv-cinder-852009-8-iscsi devstack@n-api.service[120741]: DEBUG nova.compute.api [None req-15e3bd7d-62a5-426b-9548-dbba5bc18706 tempest-AttachVolumeShelveTestJSON-385853788 tempest-AttachVolumeShelveTestJSON-385853788-project] [instance: 11d2616a-96f9-4a7a-aab8-219219986a8b] Fetching instance by UUID {{(pid=120741) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 18:02:27.791031 dv-cinder-852009-8-iscsi devstack@n-api.service[120741]: DEBUG oslo_concurrency.lockutils [None req-15e3bd7d-62a5-426b-9548-dbba5bc18706 tempest-AttachVolumeShelveTestJSON-385853788 tempest-AttachVolumeShelveTestJSON-385853788-project] Acquiring lock "1daf4f4c-0e4a-4779-b53a-78c48397ea2f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120741) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 18:02:27.791582 dv-cinder-852009-8-iscsi devstack@n-api.service[120741]: DEBUG oslo_concurrency.lockutils [None req-15e3bd7d-62a5-426b-9548-dbba5bc18706 tempest-AttachVolumeShelveTestJSON-385853788 tempest-AttachVolumeShelveTestJSON-385853788-project] Lock "1daf4f4c-0e4a-4779-b53a-78c48397ea2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120741) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 18:02:27.792167 dv-cinder-852009-8-iscsi devstack@n-api.service[120741]: DEBUG oslo_concurrency.lockutils [None req-15e3bd7d-62a5-426b-9548-dbba5bc18706 tempest-AttachVolumeShelveTestJSON-385853788 tempest-AttachVolumeShelveTestJSON-385853788-project] Lock "1daf4f4c-0e4a-4779-b53a-78c48397ea2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120741) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 18:02:27.793127 dv-cinder-852009-8-iscsi devstack@n-api.service[120741]: DEBUG oslo_concurrency.lockutils [None req-15e3bd7d-62a5-426b-9548-dbba5bc18706 tempest-AttachVolumeShelveTestJSON-385853788 tempest-AttachVolumeShelveTestJSON-385853788-project] Acquiring lock "1daf4f4c-0e4a-4779-b53a-78c48397ea2f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120741) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 18:02:27.794015 dv-cinder-852009-8-iscsi devstack@n-api.service[120741]: DEBUG oslo_concurrency.lockutils [None req-15e3bd7d-62a5-426b-9548-dbba5bc18706 tempest-AttachVolumeShelveTestJSON-385853788 tempest-AttachVolumeShelveTestJSON-385853788-project] Lock "1daf4f4c-0e4a-4779-b53a-78c48397ea2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120741) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 18:02:27.794526 dv-cinder-852009-8-iscsi devstack@n-api.service[120741]: DEBUG oslo_concurrency.lockutils [None req-15e3bd7d-62a5-426b-9548-dbba5bc18706 tempest-AttachVolumeShelveTestJSON-385853788 tempest-AttachVolumeShelveTestJSON-385853788-project] Lock "1daf4f4c-0e4a-4779-b53a-78c48397ea2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120741) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 18:02:27.986727 dv-cinder-852009-8-iscsi devstack@n-api.service[120740]: DEBUG nova.policy [None req-dcfeaf9a-24e0-48d7-859a-7fa727698e6f tempest-DeleteServersTestJSON-1632919649 tempest-DeleteServersTestJSON-1632919649-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '51db5ef052144879b53979268ac4ceb5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '66136f123f5b4ad0a824920bbdf9d245', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120740) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 18:02:27.991032 dv-cinder-852009-8-iscsi devstack@n-api.service[120741]: DEBUG nova.policy [None req-15e3bd7d-62a5-426b-9548-dbba5bc18706 tempest-AttachVolumeShelveTestJSON-385853788 tempest-AttachVolumeShelveTestJSON-385853788-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e68ecd9b3ca643539b109f75bb242d6f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '75e14fd88bfb4cd896fa7b070a0fac47', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120741) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 18:02:27.995096 dv-cinder-852009-8-iscsi devstack@n-api.service[120740]: INFO nova.api.openstack.requestlog [None req-dcfeaf9a-24e0-48d7-859a-7fa727698e6f tempest-DeleteServersTestJSON-1632919649 tempest-DeleteServersTestJSON-1632919649-project] 10.222.0.43 "GET /compute/v2.1/servers/207d1d8d-58a4-4b99-aa09-1c5023c60784" status: 200 len: 1315 microversion: 2.1 time: 0.229898 Sep 13 18:02:27.995687 dv-cinder-852009-8-iscsi devstack@n-api.service[120740]: [pid: 120740|app: 0|req: 42/76] 10.222.0.43 () {58 vars in 1236 bytes} [Tue Sep 13 18:02:27 2022] GET /compute/v2.1/servers/207d1d8d-58a4-4b99-aa09-1c5023c60784 => generated 1315 bytes in 231 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 13 18:02:28.004078 dv-cinder-852009-8-iscsi devstack@n-api.service[120741]: DEBUG nova.policy [None req-15e3bd7d-62a5-426b-9548-dbba5bc18706 tempest-AttachVolumeShelveTestJSON-385853788 tempest-AttachVolumeShelveTestJSON-385853788-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'e68ecd9b3ca643539b109f75bb242d6f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '75e14fd88bfb4cd896fa7b070a0fac47', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120741) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 18:02:28.005899 dv-cinder-852009-8-iscsi devstack@n-api.service[120741]: DEBUG nova.policy [None req-15e3bd7d-62a5-426b-9548-dbba5bc18706 tempest-AttachVolumeShelveTestJSON-385853788 tempest-AttachVolumeShelveTestJSON-385853788-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'e68ecd9b3ca643539b109f75bb242d6f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '75e14fd88bfb4cd896fa7b070a0fac47', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120741) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 18:02:28.007433 dv-cinder-852009-8-iscsi devstack@n-api.service[120741]: INFO nova.api.openstack.requestlog [None req-15e3bd7d-62a5-426b-9548-dbba5bc18706 tempest-AttachVolumeShelveTestJSON-385853788 tempest-AttachVolumeShelveTestJSON-385853788-project] 10.222.0.43 "GET /compute/v2.1/servers/11d2616a-96f9-4a7a-aab8-219219986a8b" status: 200 len: 1405 microversion: 2.20 time: 0.232074 Sep 13 18:02:28.010781 dv-cinder-852009-8-iscsi devstack@n-api.service[120740]: DEBUG nova.api.openstack.wsgi [None req-77d0a13b-cd81-499e-9b77-d7e75266b7bc tempest-AttachVolumeTestJSON-555093534 tempest-AttachVolumeTestJSON-555093534-project] Calling method '>' {{(pid=120740) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 18:02:28.011641 dv-cinder-852009-8-iscsi devstack@n-api.service[120740]: DEBUG nova.compute.api [None req-77d0a13b-cd81-499e-9b77-d7e75266b7bc tempest-AttachVolumeTestJSON-555093534 tempest-AttachVolumeTestJSON-555093534-project] [instance: b958d409-df20-44c6-aa0e-58cb0a482edf] Fetching instance by UUID {{(pid=120740) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 18:02:28.018413 dv-cinder-852009-8-iscsi devstack@n-api.service[120740]: DEBUG oslo_concurrency.lockutils [None req-77d0a13b-cd81-499e-9b77-d7e75266b7bc tempest-AttachVolumeTestJSON-555093534 tempest-AttachVolumeTestJSON-555093534-project] Acquiring lock "1daf4f4c-0e4a-4779-b53a-78c48397ea2f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120740) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 18:02:28.019177 dv-cinder-852009-8-iscsi devstack@n-api.service[120740]: DEBUG oslo_concurrency.lockutils [None req-77d0a13b-cd81-499e-9b77-d7e75266b7bc tempest-AttachVolumeTestJSON-555093534 tempest-AttachVolumeTestJSON-555093534-project] Lock "1daf4f4c-0e4a-4779-b53a-78c48397ea2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120740) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 18:02:28.020116 dv-cinder-852009-8-iscsi devstack@n-api.service[120740]: DEBUG oslo_concurrency.lockutils [None req-77d0a13b-cd81-499e-9b77-d7e75266b7bc tempest-AttachVolumeTestJSON-555093534 tempest-AttachVolumeTestJSON-555093534-project] Lock "1daf4f4c-0e4a-4779-b53a-78c48397ea2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120740) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 18:02:28.021001 dv-cinder-852009-8-iscsi devstack@n-api.service[120740]: DEBUG oslo_concurrency.lockutils [None req-77d0a13b-cd81-499e-9b77-d7e75266b7bc tempest-AttachVolumeTestJSON-555093534 tempest-AttachVolumeTestJSON-555093534-project] Acquiring lock "1daf4f4c-0e4a-4779-b53a-78c48397ea2f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120740) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 18:02:28.021410 dv-cinder-852009-8-iscsi devstack@n-api.service[120741]: [pid: 120741|app: 0|req: 35/77] 10.222.0.43 () {60 vars in 1277 bytes} [Tue Sep 13 18:02:27 2022] GET /compute/v2.1/servers/11d2616a-96f9-4a7a-aab8-219219986a8b => generated 1405 bytes in 247 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 13 18:02:28.021919 dv-cinder-852009-8-iscsi devstack@n-api.service[120740]: DEBUG oslo_concurrency.lockutils [None req-77d0a13b-cd81-499e-9b77-d7e75266b7bc tempest-AttachVolumeTestJSON-555093534 tempest-AttachVolumeTestJSON-555093534-project] Lock "1daf4f4c-0e4a-4779-b53a-78c48397ea2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120740) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 18:02:28.022496 dv-cinder-852009-8-iscsi devstack@n-api.service[120740]: DEBUG oslo_concurrency.lockutils [None req-77d0a13b-cd81-499e-9b77-d7e75266b7bc tempest-AttachVolumeTestJSON-555093534 tempest-AttachVolumeTestJSON-555093534-project] Lock "1daf4f4c-0e4a-4779-b53a-78c48397ea2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120740) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 18:02:28.036415 dv-cinder-852009-8-iscsi devstack@n-api.service[120741]: DEBUG nova.api.openstack.wsgi [None req-ad442438-6ff6-47c1-9367-1a0cfc03c6f3 tempest-ServerRescueNegativeTestJSON-412251590 tempest-ServerRescueNegativeTestJSON-412251590-project] Calling method '>' {{(pid=120741) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 18:02:28.037133 dv-cinder-852009-8-iscsi devstack@n-api.service[120741]: DEBUG nova.compute.api [None req-ad442438-6ff6-47c1-9367-1a0cfc03c6f3 tempest-ServerRescueNegativeTestJSON-412251590 tempest-ServerRescueNegativeTestJSON-412251590-project] [instance: 8cd29851-35c1-4032-a137-ab9419a2ec5b] Fetching instance by UUID {{(pid=120741) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 18:02:28.043384 dv-cinder-852009-8-iscsi devstack@n-api.service[120741]: DEBUG oslo_concurrency.lockutils [None req-ad442438-6ff6-47c1-9367-1a0cfc03c6f3 tempest-ServerRescueNegativeTestJSON-412251590 tempest-ServerRescueNegativeTestJSON-412251590-project] Acquiring lock "1daf4f4c-0e4a-4779-b53a-78c48397ea2f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120741) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 18:02:28.043871 dv-cinder-852009-8-iscsi devstack@n-api.service[120741]: DEBUG oslo_concurrency.lockutils [None req-ad442438-6ff6-47c1-9367-1a0cfc03c6f3 tempest-ServerRescueNegativeTestJSON-412251590 tempest-ServerRescueNegativeTestJSON-412251590-project] Lock "1daf4f4c-0e4a-4779-b53a-78c48397ea2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120741) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 18:02:28.044507 dv-cinder-852009-8-iscsi devstack@n-api.service[120741]: DEBUG oslo_concurrency.lockutils [None req-ad442438-6ff6-47c1-9367-1a0cfc03c6f3 tempest-ServerRescueNegativeTestJSON-412251590 tempest-ServerRescueNegativeTestJSON-412251590-project] Lock "1daf4f4c-0e4a-4779-b53a-78c48397ea2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120741) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 18:02:28.045405 dv-cinder-852009-8-iscsi devstack@n-api.service[120741]: DEBUG oslo_concurrency.lockutils [None req-ad442438-6ff6-47c1-9367-1a0cfc03c6f3 tempest-ServerRescueNegativeTestJSON-412251590 tempest-ServerRescueNegativeTestJSON-412251590-project] Acquiring lock "1daf4f4c-0e4a-4779-b53a-78c48397ea2f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120741) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 18:02:28.045857 dv-cinder-852009-8-iscsi devstack@n-api.service[120741]: DEBUG oslo_concurrency.lockutils [None req-ad442438-6ff6-47c1-9367-1a0cfc03c6f3 tempest-ServerRescueNegativeTestJSON-412251590 tempest-ServerRescueNegativeTestJSON-412251590-project] Lock "1daf4f4c-0e4a-4779-b53a-78c48397ea2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120741) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 18:02:28.046278 dv-cinder-852009-8-iscsi devstack@n-api.service[120741]: DEBUG oslo_concurrency.lockutils [None req-ad442438-6ff6-47c1-9367-1a0cfc03c6f3 tempest-ServerRescueNegativeTestJSON-412251590 tempest-ServerRescueNegativeTestJSON-412251590-project] Lock "1daf4f4c-0e4a-4779-b53a-78c48397ea2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120741) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 18:02:28.268214 dv-cinder-852009-8-iscsi devstack@n-api.service[120741]: DEBUG nova.policy [None req-ad442438-6ff6-47c1-9367-1a0cfc03c6f3 tempest-ServerRescueNegativeTestJSON-412251590 tempest-ServerRescueNegativeTestJSON-412251590-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '60800cf2774e409d9c1b6f4992669991', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2eae4acecf6c4961830ead78d71b2ad3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120741) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 18:02:28.277551 dv-cinder-852009-8-iscsi devstack@n-api.service[120741]: INFO nova.api.openstack.requestlog [None req-ad442438-6ff6-47c1-9367-1a0cfc03c6f3 tempest-ServerRescueNegativeTestJSON-412251590 tempest-ServerRescueNegativeTestJSON-412251590-project] 10.222.0.43 "GET /compute/v2.1/servers/8cd29851-35c1-4032-a137-ab9419a2ec5b" status: 200 len: 1322 microversion: 2.1 time: 0.244866 Sep 13 18:02:28.279979 dv-cinder-852009-8-iscsi devstack@n-api.service[120741]: [pid: 120741|app: 0|req: 36/78] 10.222.0.43 () {58 vars in 1236 bytes} [Tue Sep 13 18:02:28 2022] GET /compute/v2.1/servers/8cd29851-35c1-4032-a137-ab9419a2ec5b => generated 1322 bytes in 248 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 13 18:02:28.294876 dv-cinder-852009-8-iscsi devstack@n-api.service[120740]: DEBUG nova.policy [None req-77d0a13b-cd81-499e-9b77-d7e75266b7bc tempest-AttachVolumeTestJSON-555093534 tempest-AttachVolumeTestJSON-555093534-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0625b3113ce044bbac4f6142eaade11c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a279fcbf274c4704a31a2b95061e1469', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120740) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 18:02:28.303146 dv-cinder-852009-8-iscsi devstack@n-api.service[120740]: INFO nova.api.openstack.requestlog [None req-77d0a13b-cd81-499e-9b77-d7e75266b7bc tempest-AttachVolumeTestJSON-555093534 tempest-AttachVolumeTestJSON-555093534-project] 10.222.0.43 "GET /compute/v2.1/servers/b958d409-df20-44c6-aa0e-58cb0a482edf" status: 200 len: 1362 microversion: 2.1 time: 0.297671 Sep 13 18:02:28.303727 dv-cinder-852009-8-iscsi devstack@n-api.service[120740]: [pid: 120740|app: 0|req: 43/79] 10.222.0.43 () {58 vars in 1236 bytes} [Tue Sep 13 18:02:28 2022] GET /compute/v2.1/servers/b958d409-df20-44c6-aa0e-58cb0a482edf => generated 1362 bytes in 299 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 13 18:02:29.018610 dv-cinder-852009-8-iscsi devstack@n-api.service[120741]: DEBUG nova.api.openstack.wsgi [None req-d6bcc2f3-0354-4f65-ab21-ea6a0b981e0d tempest-DeleteServersTestJSON-1632919649 tempest-DeleteServersTestJSON-1632919649-project] Calling method '>' {{(pid=120741) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 18:02:29.019246 dv-cinder-852009-8-iscsi devstack@n-api.service[120741]: DEBUG nova.compute.api [None req-d6bcc2f3-0354-4f65-ab21-ea6a0b981e0d tempest-DeleteServersTestJSON-1632919649 tempest-DeleteServersTestJSON-1632919649-project] [instance: 207d1d8d-58a4-4b99-aa09-1c5023c60784] Fetching instance by UUID {{(pid=120741) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 18:02:29.025517 dv-cinder-852009-8-iscsi devstack@n-api.service[120741]: DEBUG oslo_concurrency.lockutils [None req-d6bcc2f3-0354-4f65-ab21-ea6a0b981e0d tempest-DeleteServersTestJSON-1632919649 tempest-DeleteServersTestJSON-1632919649-project] Acquiring lock "1daf4f4c-0e4a-4779-b53a-78c48397ea2f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120741) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 18:02:29.025968 dv-cinder-852009-8-iscsi devstack@n-api.service[120741]: DEBUG oslo_concurrency.lockutils [None req-d6bcc2f3-0354-4f65-ab21-ea6a0b981e0d tempest-DeleteServersTestJSON-1632919649 tempest-DeleteServersTestJSON-1632919649-project] Lock "1daf4f4c-0e4a-4779-b53a-78c48397ea2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120741) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 18:02:29.026674 dv-cinder-852009-8-iscsi devstack@n-api.service[120741]: DEBUG oslo_concurrency.lockutils [None req-d6bcc2f3-0354-4f65-ab21-ea6a0b981e0d tempest-DeleteServersTestJSON-1632919649 tempest-DeleteServersTestJSON-1632919649-project] Lock "1daf4f4c-0e4a-4779-b53a-78c48397ea2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120741) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 18:02:29.029444 dv-cinder-852009-8-iscsi devstack@n-api.service[120741]: DEBUG oslo_concurrency.lockutils [None req-d6bcc2f3-0354-4f65-ab21-ea6a0b981e0d tempest-DeleteServersTestJSON-1632919649 tempest-DeleteServersTestJSON-1632919649-project] Acquiring lock "1daf4f4c-0e4a-4779-b53a-78c48397ea2f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120741) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 18:02:29.029908 dv-cinder-852009-8-iscsi devstack@n-api.service[120741]: DEBUG oslo_concurrency.lockutils [None req-d6bcc2f3-0354-4f65-ab21-ea6a0b981e0d tempest-DeleteServersTestJSON-1632919649 tempest-DeleteServersTestJSON-1632919649-project] Lock "1daf4f4c-0e4a-4779-b53a-78c48397ea2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120741) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 18:02:29.030343 dv-cinder-852009-8-iscsi devstack@n-api.service[120741]: DEBUG oslo_concurrency.lockutils [None req-d6bcc2f3-0354-4f65-ab21-ea6a0b981e0d tempest-DeleteServersTestJSON-1632919649 tempest-DeleteServersTestJSON-1632919649-project] Lock "1daf4f4c-0e4a-4779-b53a-78c48397ea2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120741) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 18:02:29.035571 dv-cinder-852009-8-iscsi devstack@n-api.service[120740]: DEBUG nova.api.openstack.wsgi [None req-631f0bfc-aa48-492a-8528-6baad716eeca tempest-AttachVolumeShelveTestJSON-385853788 tempest-AttachVolumeShelveTestJSON-385853788-project] Calling method '>' {{(pid=120740) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 18:02:29.036334 dv-cinder-852009-8-iscsi devstack@n-api.service[120740]: DEBUG nova.compute.api [None req-631f0bfc-aa48-492a-8528-6baad716eeca tempest-AttachVolumeShelveTestJSON-385853788 tempest-AttachVolumeShelveTestJSON-385853788-project] [instance: 11d2616a-96f9-4a7a-aab8-219219986a8b] Fetching instance by UUID {{(pid=120740) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 18:02:29.042493 dv-cinder-852009-8-iscsi devstack@n-api.service[120740]: DEBUG oslo_concurrency.lockutils [None req-631f0bfc-aa48-492a-8528-6baad716eeca tempest-AttachVolumeShelveTestJSON-385853788 tempest-AttachVolumeShelveTestJSON-385853788-project] Acquiring lock "1daf4f4c-0e4a-4779-b53a-78c48397ea2f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120740) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 18:02:29.043339 dv-cinder-852009-8-iscsi devstack@n-api.service[120740]: DEBUG oslo_concurrency.lockutils [None req-631f0bfc-aa48-492a-8528-6baad716eeca tempest-AttachVolumeShelveTestJSON-385853788 tempest-AttachVolumeShelveTestJSON-385853788-project] Lock "1daf4f4c-0e4a-4779-b53a-78c48397ea2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120740) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 18:02:29.043602 dv-cinder-852009-8-iscsi devstack@n-api.service[120740]: DEBUG oslo_concurrency.lockutils [None req-631f0bfc-aa48-492a-8528-6baad716eeca tempest-AttachVolumeShelveTestJSON-385853788 tempest-AttachVolumeShelveTestJSON-385853788-project] Lock "1daf4f4c-0e4a-4779-b53a-78c48397ea2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120740) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 18:02:29.044144 dv-cinder-852009-8-iscsi devstack@n-api.service[120740]: DEBUG oslo_concurrency.lockutils [None req-631f0bfc-aa48-492a-8528-6baad716eeca tempest-AttachVolumeShelveTestJSON-385853788 tempest-AttachVolumeShelveTestJSON-385853788-project] Acquiring lock "1daf4f4c-0e4a-4779-b53a-78c48397ea2f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120740) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 18:02:29.044731 dv-cinder-852009-8-iscsi devstack@n-api.service[120740]: DEBUG oslo_concurrency.lockutils [None req-631f0bfc-aa48-492a-8528-6baad716eeca tempest-AttachVolumeShelveTestJSON-385853788 tempest-AttachVolumeShelveTestJSON-385853788-project] Lock "1daf4f4c-0e4a-4779-b53a-78c48397ea2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120740) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 18:02:29.045221 dv-cinder-852009-8-iscsi devstack@n-api.service[120740]: DEBUG oslo_concurrency.lockutils [None req-631f0bfc-aa48-492a-8528-6baad716eeca tempest-AttachVolumeShelveTestJSON-385853788 tempest-AttachVolumeShelveTestJSON-385853788-project] Lock "1daf4f4c-0e4a-4779-b53a-78c48397ea2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120740) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 18:02:29.239130 dv-cinder-852009-8-iscsi devstack@n-api.service[120741]: DEBUG nova.policy [None req-d6bcc2f3-0354-4f65-ab21-ea6a0b981e0d tempest-DeleteServersTestJSON-1632919649 tempest-DeleteServersTestJSON-1632919649-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '51db5ef052144879b53979268ac4ceb5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '66136f123f5b4ad0a824920bbdf9d245', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120741) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 18:02:29.245946 dv-cinder-852009-8-iscsi devstack@n-api.service[120740]: DEBUG nova.policy [None req-631f0bfc-aa48-492a-8528-6baad716eeca tempest-AttachVolumeShelveTestJSON-385853788 tempest-AttachVolumeShelveTestJSON-385853788-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e68ecd9b3ca643539b109f75bb242d6f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '75e14fd88bfb4cd896fa7b070a0fac47', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120740) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 18:02:29.250640 dv-cinder-852009-8-iscsi devstack@n-api.service[120741]: INFO nova.api.openstack.requestlog [None req-d6bcc2f3-0354-4f65-ab21-ea6a0b981e0d tempest-DeleteServersTestJSON-1632919649 tempest-DeleteServersTestJSON-1632919649-project] 10.222.0.43 "GET /compute/v2.1/servers/207d1d8d-58a4-4b99-aa09-1c5023c60784" status: 200 len: 1315 microversion: 2.1 time: 0.235083 Sep 13 18:02:29.255171 dv-cinder-852009-8-iscsi devstack@n-api.service[120740]: DEBUG nova.policy [None req-631f0bfc-aa48-492a-8528-6baad716eeca tempest-AttachVolumeShelveTestJSON-385853788 tempest-AttachVolumeShelveTestJSON-385853788-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'e68ecd9b3ca643539b109f75bb242d6f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '75e14fd88bfb4cd896fa7b070a0fac47', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120740) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 18:02:29.256705 dv-cinder-852009-8-iscsi devstack@n-api.service[120740]: DEBUG nova.policy [None req-631f0bfc-aa48-492a-8528-6baad716eeca tempest-AttachVolumeShelveTestJSON-385853788 tempest-AttachVolumeShelveTestJSON-385853788-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'e68ecd9b3ca643539b109f75bb242d6f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '75e14fd88bfb4cd896fa7b070a0fac47', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120740) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 18:02:29.257801 dv-cinder-852009-8-iscsi devstack@n-api.service[120740]: INFO nova.api.openstack.requestlog [None req-631f0bfc-aa48-492a-8528-6baad716eeca tempest-AttachVolumeShelveTestJSON-385853788 tempest-AttachVolumeShelveTestJSON-385853788-project] 10.222.0.43 "GET /compute/v2.1/servers/11d2616a-96f9-4a7a-aab8-219219986a8b" status: 200 len: 1405 microversion: 2.20 time: 0.226666 Sep 13 18:02:29.265126 dv-cinder-852009-8-iscsi devstack@n-api.service[120741]: [pid: 120741|app: 0|req: 37/80] 10.222.0.43 () {58 vars in 1236 bytes} [Tue Sep 13 18:02:29 2022] GET /compute/v2.1/servers/207d1d8d-58a4-4b99-aa09-1c5023c60784 => generated 1315 bytes in 251 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 13 18:02:29.272123 dv-cinder-852009-8-iscsi devstack@n-api.service[120740]: [pid: 120740|app: 0|req: 44/81] 10.222.0.43 () {60 vars in 1277 bytes} [Tue Sep 13 18:02:29 2022] GET /compute/v2.1/servers/11d2616a-96f9-4a7a-aab8-219219986a8b => generated 1405 bytes in 242 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 13 18:02:29.303627 dv-cinder-852009-8-iscsi devstack@n-api.service[120741]: DEBUG nova.api.openstack.wsgi [None req-f42a85df-188b-4013-a5b6-1cfade9883f6 tempest-ServerRescueNegativeTestJSON-412251590 tempest-ServerRescueNegativeTestJSON-412251590-project] Calling method '>' {{(pid=120741) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 18:02:29.304260 dv-cinder-852009-8-iscsi devstack@n-api.service[120741]: DEBUG nova.compute.api [None req-f42a85df-188b-4013-a5b6-1cfade9883f6 tempest-ServerRescueNegativeTestJSON-412251590 tempest-ServerRescueNegativeTestJSON-412251590-project] [instance: 8cd29851-35c1-4032-a137-ab9419a2ec5b] Fetching instance by UUID {{(pid=120741) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 18:02:29.310393 dv-cinder-852009-8-iscsi devstack@n-api.service[120741]: DEBUG oslo_concurrency.lockutils [None req-f42a85df-188b-4013-a5b6-1cfade9883f6 tempest-ServerRescueNegativeTestJSON-412251590 tempest-ServerRescueNegativeTestJSON-412251590-project] Acquiring lock "1daf4f4c-0e4a-4779-b53a-78c48397ea2f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120741) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 18:02:29.310873 dv-cinder-852009-8-iscsi devstack@n-api.service[120741]: DEBUG oslo_concurrency.lockutils [None req-f42a85df-188b-4013-a5b6-1cfade9883f6 tempest-ServerRescueNegativeTestJSON-412251590 tempest-ServerRescueNegativeTestJSON-412251590-project] Lock "1daf4f4c-0e4a-4779-b53a-78c48397ea2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120741) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 18:02:29.311297 dv-cinder-852009-8-iscsi devstack@n-api.service[120741]: DEBUG oslo_concurrency.lockutils [None req-f42a85df-188b-4013-a5b6-1cfade9883f6 tempest-ServerRescueNegativeTestJSON-412251590 tempest-ServerRescueNegativeTestJSON-412251590-project] Lock "1daf4f4c-0e4a-4779-b53a-78c48397ea2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120741) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 18:02:29.311984 dv-cinder-852009-8-iscsi devstack@n-api.service[120741]: DEBUG oslo_concurrency.lockutils [None req-f42a85df-188b-4013-a5b6-1cfade9883f6 tempest-ServerRescueNegativeTestJSON-412251590 tempest-ServerRescueNegativeTestJSON-412251590-project] Acquiring lock "1daf4f4c-0e4a-4779-b53a-78c48397ea2f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120741) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 18:02:29.312436 dv-cinder-852009-8-iscsi devstack@n-api.service[120741]: DEBUG oslo_concurrency.lockutils [None req-f42a85df-188b-4013-a5b6-1cfade9883f6 tempest-ServerRescueNegativeTestJSON-412251590 tempest-ServerRescueNegativeTestJSON-412251590-project] Lock "1daf4f4c-0e4a-4779-b53a-78c48397ea2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120741) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 18:02:29.313040 dv-cinder-852009-8-iscsi devstack@n-api.service[120741]: DEBUG oslo_concurrency.lockutils [None req-f42a85df-188b-4013-a5b6-1cfade9883f6 tempest-ServerRescueNegativeTestJSON-412251590 tempest-ServerRescueNegativeTestJSON-412251590-project] Lock "1daf4f4c-0e4a-4779-b53a-78c48397ea2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120741) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 18:02:29.327716 dv-cinder-852009-8-iscsi devstack@n-api.service[120740]: DEBUG nova.api.openstack.wsgi [None req-4f307548-1a3c-4bfc-8e7d-fe986ec790c0 tempest-AttachVolumeTestJSON-555093534 tempest-AttachVolumeTestJSON-555093534-project] Calling method '>' {{(pid=120740) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 18:02:29.328836 dv-cinder-852009-8-iscsi devstack@n-api.service[120740]: DEBUG nova.compute.api [None req-4f307548-1a3c-4bfc-8e7d-fe986ec790c0 tempest-AttachVolumeTestJSON-555093534 tempest-AttachVolumeTestJSON-555093534-project] [instance: b958d409-df20-44c6-aa0e-58cb0a482edf] Fetching instance by UUID {{(pid=120740) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 18:02:29.338971 dv-cinder-852009-8-iscsi devstack@n-api.service[120740]: DEBUG oslo_concurrency.lockutils [None req-4f307548-1a3c-4bfc-8e7d-fe986ec790c0 tempest-AttachVolumeTestJSON-555093534 tempest-AttachVolumeTestJSON-555093534-project] Acquiring lock "1daf4f4c-0e4a-4779-b53a-78c48397ea2f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120740) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 18:02:29.339927 dv-cinder-852009-8-iscsi devstack@n-api.service[120740]: DEBUG oslo_concurrency.lockutils [None req-4f307548-1a3c-4bfc-8e7d-fe986ec790c0 tempest-AttachVolumeTestJSON-555093534 tempest-AttachVolumeTestJSON-555093534-project] Lock "1daf4f4c-0e4a-4779-b53a-78c48397ea2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120740) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 18:02:29.340603 dv-cinder-852009-8-iscsi devstack@n-api.service[120740]: DEBUG oslo_concurrency.lockutils [None req-4f307548-1a3c-4bfc-8e7d-fe986ec790c0 tempest-AttachVolumeTestJSON-555093534 tempest-AttachVolumeTestJSON-555093534-project] Lock "1daf4f4c-0e4a-4779-b53a-78c48397ea2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120740) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 18:02:29.341522 dv-cinder-852009-8-iscsi devstack@n-api.service[120740]: DEBUG oslo_concurrency.lockutils [None req-4f307548-1a3c-4bfc-8e7d-fe986ec790c0 tempest-AttachVolumeTestJSON-555093534 tempest-AttachVolumeTestJSON-555093534-project] Acquiring lock "1daf4f4c-0e4a-4779-b53a-78c48397ea2f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120740) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 18:02:29.342454 dv-cinder-852009-8-iscsi devstack@n-api.service[120740]: DEBUG oslo_concurrency.lockutils [None req-4f307548-1a3c-4bfc-8e7d-fe986ec790c0 tempest-AttachVolumeTestJSON-555093534 tempest-AttachVolumeTestJSON-555093534-project] Lock "1daf4f4c-0e4a-4779-b53a-78c48397ea2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120740) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 18:02:29.343676 dv-cinder-852009-8-iscsi devstack@n-api.service[120740]: DEBUG oslo_concurrency.lockutils [None req-4f307548-1a3c-4bfc-8e7d-fe986ec790c0 tempest-AttachVolumeTestJSON-555093534 tempest-AttachVolumeTestJSON-555093534-project] Lock "1daf4f4c-0e4a-4779-b53a-78c48397ea2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120740) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 18:02:29.528802 dv-cinder-852009-8-iscsi devstack@n-api.service[120741]: DEBUG nova.policy [None req-f42a85df-188b-4013-a5b6-1cfade9883f6 tempest-ServerRescueNegativeTestJSON-412251590 tempest-ServerRescueNegativeTestJSON-412251590-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '60800cf2774e409d9c1b6f4992669991', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2eae4acecf6c4961830ead78d71b2ad3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120741) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 18:02:29.544374 dv-cinder-852009-8-iscsi devstack@n-api.service[120741]: INFO nova.api.openstack.requestlog [None req-f42a85df-188b-4013-a5b6-1cfade9883f6 tempest-ServerRescueNegativeTestJSON-412251590 tempest-ServerRescueNegativeTestJSON-412251590-project] 10.222.0.43 "GET /compute/v2.1/servers/8cd29851-35c1-4032-a137-ab9419a2ec5b" status: 200 len: 1322 microversion: 2.1 time: 0.244834 Sep 13 18:02:29.545584 dv-cinder-852009-8-iscsi devstack@n-api.service[120741]: [pid: 120741|app: 0|req: 38/82] 10.222.0.43 () {58 vars in 1236 bytes} [Tue Sep 13 18:02:29 2022] GET /compute/v2.1/servers/8cd29851-35c1-4032-a137-ab9419a2ec5b => generated 1322 bytes in 247 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 13 18:02:29.596737 dv-cinder-852009-8-iscsi devstack@n-api.service[120740]: DEBUG nova.policy [None req-4f307548-1a3c-4bfc-8e7d-fe986ec790c0 tempest-AttachVolumeTestJSON-555093534 tempest-AttachVolumeTestJSON-555093534-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0625b3113ce044bbac4f6142eaade11c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a279fcbf274c4704a31a2b95061e1469', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120740) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 18:02:29.606795 dv-cinder-852009-8-iscsi devstack@n-api.service[120740]: INFO nova.api.openstack.requestlog [None req-4f307548-1a3c-4bfc-8e7d-fe986ec790c0 tempest-AttachVolumeTestJSON-555093534 tempest-AttachVolumeTestJSON-555093534-project] 10.222.0.43 "GET /compute/v2.1/servers/b958d409-df20-44c6-aa0e-58cb0a482edf" status: 200 len: 1362 microversion: 2.1 time: 0.284201 Sep 13 18:02:29.607398 dv-cinder-852009-8-iscsi devstack@n-api.service[120740]: [pid: 120740|app: 0|req: 45/83] 10.222.0.43 () {58 vars in 1236 bytes} [Tue Sep 13 18:02:29 2022] GET /compute/v2.1/servers/b958d409-df20-44c6-aa0e-58cb0a482edf => generated 1362 bytes in 286 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 13 18:02:30.275884 dv-cinder-852009-8-iscsi devstack@n-api.service[120741]: DEBUG nova.api.openstack.wsgi [None req-e9e94f41-2784-439a-b846-938e90d0bf9a tempest-DeleteServersTestJSON-1632919649 tempest-DeleteServersTestJSON-1632919649-project] Calling method '>' {{(pid=120741) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 18:02:30.277230 dv-cinder-852009-8-iscsi devstack@n-api.service[120741]: DEBUG nova.compute.api [None req-e9e94f41-2784-439a-b846-938e90d0bf9a tempest-DeleteServersTestJSON-1632919649 tempest-DeleteServersTestJSON-1632919649-project] [instance: 207d1d8d-58a4-4b99-aa09-1c5023c60784] Fetching instance by UUID {{(pid=120741) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 18:02:30.286435 dv-cinder-852009-8-iscsi devstack@n-api.service[120741]: DEBUG oslo_concurrency.lockutils [None req-e9e94f41-2784-439a-b846-938e90d0bf9a tempest-DeleteServersTestJSON-1632919649 tempest-DeleteServersTestJSON-1632919649-project] Acquiring lock "1daf4f4c-0e4a-4779-b53a-78c48397ea2f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120741) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 18:02:30.287139 dv-cinder-852009-8-iscsi devstack@n-api.service[120741]: DEBUG oslo_concurrency.lockutils [None req-e9e94f41-2784-439a-b846-938e90d0bf9a tempest-DeleteServersTestJSON-1632919649 tempest-DeleteServersTestJSON-1632919649-project] Lock "1daf4f4c-0e4a-4779-b53a-78c48397ea2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120741) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 18:02:30.287776 dv-cinder-852009-8-iscsi devstack@n-api.service[120741]: DEBUG oslo_concurrency.lockutils [None req-e9e94f41-2784-439a-b846-938e90d0bf9a tempest-DeleteServersTestJSON-1632919649 tempest-DeleteServersTestJSON-1632919649-project] Lock "1daf4f4c-0e4a-4779-b53a-78c48397ea2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120741) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 18:02:30.288784 dv-cinder-852009-8-iscsi devstack@n-api.service[120740]: DEBUG nova.api.openstack.wsgi [None req-24ff297e-5125-49d1-a6b5-b33f8bfc256c tempest-AttachVolumeShelveTestJSON-385853788 tempest-AttachVolumeShelveTestJSON-385853788-project] Calling method '>' {{(pid=120740) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 18:02:30.289455 dv-cinder-852009-8-iscsi devstack@n-api.service[120740]: DEBUG nova.compute.api [None req-24ff297e-5125-49d1-a6b5-b33f8bfc256c tempest-AttachVolumeShelveTestJSON-385853788 tempest-AttachVolumeShelveTestJSON-385853788-project] [instance: 11d2616a-96f9-4a7a-aab8-219219986a8b] Fetching instance by UUID {{(pid=120740) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 18:02:30.289662 dv-cinder-852009-8-iscsi devstack@n-api.service[120741]: DEBUG oslo_concurrency.lockutils [None req-e9e94f41-2784-439a-b846-938e90d0bf9a tempest-DeleteServersTestJSON-1632919649 tempest-DeleteServersTestJSON-1632919649-project] Acquiring lock "1daf4f4c-0e4a-4779-b53a-78c48397ea2f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120741) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 18:02:30.291064 dv-cinder-852009-8-iscsi devstack@n-api.service[120741]: DEBUG oslo_concurrency.lockutils [None req-e9e94f41-2784-439a-b846-938e90d0bf9a tempest-DeleteServersTestJSON-1632919649 tempest-DeleteServersTestJSON-1632919649-project] Lock "1daf4f4c-0e4a-4779-b53a-78c48397ea2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120741) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 18:02:30.292094 dv-cinder-852009-8-iscsi devstack@n-api.service[120741]: DEBUG oslo_concurrency.lockutils [None req-e9e94f41-2784-439a-b846-938e90d0bf9a tempest-DeleteServersTestJSON-1632919649 tempest-DeleteServersTestJSON-1632919649-project] Lock "1daf4f4c-0e4a-4779-b53a-78c48397ea2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120741) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 18:02:30.301223 dv-cinder-852009-8-iscsi devstack@n-api.service[120740]: DEBUG oslo_concurrency.lockutils [None req-24ff297e-5125-49d1-a6b5-b33f8bfc256c tempest-AttachVolumeShelveTestJSON-385853788 tempest-AttachVolumeShelveTestJSON-385853788-project] Acquiring lock "1daf4f4c-0e4a-4779-b53a-78c48397ea2f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120740) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 18:02:30.304056 dv-cinder-852009-8-iscsi devstack@n-api.service[120740]: DEBUG oslo_concurrency.lockutils [None req-24ff297e-5125-49d1-a6b5-b33f8bfc256c tempest-AttachVolumeShelveTestJSON-385853788 tempest-AttachVolumeShelveTestJSON-385853788-project] Lock "1daf4f4c-0e4a-4779-b53a-78c48397ea2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120740) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 18:02:30.304540 dv-cinder-852009-8-iscsi devstack@n-api.service[120740]: DEBUG oslo_concurrency.lockutils [None req-24ff297e-5125-49d1-a6b5-b33f8bfc256c tempest-AttachVolumeShelveTestJSON-385853788 tempest-AttachVolumeShelveTestJSON-385853788-project] Lock "1daf4f4c-0e4a-4779-b53a-78c48397ea2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=120740) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 18:02:30.307397 dv-cinder-852009-8-iscsi devstack@n-api.service[120740]: DEBUG oslo_concurrency.lockutils [None req-24ff297e-5125-49d1-a6b5-b33f8bfc256c tempest-AttachVolumeShelveTestJSON-385853788 tempest-AttachVolumeShelveTestJSON-385853788-project] Acquiring lock "1daf4f4c-0e4a-4779-b53a-78c48397ea2f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120740) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 18:02:30.308951 dv-cinder-852009-8-iscsi devstack@n-api.service[120740]: DEBUG oslo_concurrency.lockutils [None req-24ff297e-5125-49d1-a6b5-b33f8bfc256c tempest-AttachVolumeShelveTestJSON-385853788 tempest-AttachVolumeShelveTestJSON-385853788-project] Lock "1daf4f4c-0e4a-4779-b53a-78c48397ea2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120740) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 18:02:30.309390 dv-cinder-852009-8-iscsi devstack@n-api.service[120740]: DEBUG oslo_concurrency.lockutils [None req-24ff297e-5125-49d1-a6b5-b33f8bfc256c tempest-AttachVolumeShelveTestJSON-385853788 tempest-AttachVolumeShelveTestJSON-385853788-project] Lock "1daf4f4c-0e4a-4779-b53a-78c48397ea2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120740) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 18:02:30.646991 dv-cinder-852009-8-iscsi devstack@n-api.service[120741]: DEBUG nova.policy [None req-e9e94f41-2784-439a-b846-938e90d0bf9a tempest-DeleteServersTestJSON-1632919649 tempest-DeleteServersTestJSON-1632919649-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '51db5ef052144879b53979268ac4ceb5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '66136f123f5b4ad0a824920bbdf9d245', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120741) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 18:02:30.660375 dv-cinder-852009-8-iscsi devstack@n-api.service[120740]: DEBUG nova.policy [None req-24ff297e-5125-49d1-a6b5-b33f8bfc256c tempest-AttachVolumeShelveTestJSON-385853788 tempest-AttachVolumeShelveTestJSON-385853788-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e68ecd9b3ca643539b109f75bb242d6f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '75e14fd88bfb4cd896fa7b070a0fac47', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120740) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 18:02:30.667225 dv-cinder-852009-8-iscsi devstack@n-api.service[120741]: INFO nova.api.openstack.requestlog [None req-e9e94f41-2784-439a-b846-938e90d0bf9a tempest-DeleteServersTestJSON-1632919649 tempest-DeleteServersTestJSON-1632919649-project] 10.222.0.43 "GET /compute/v2.1/servers/207d1d8d-58a4-4b99-aa09-1c5023c60784" status: 200 len: 1315 microversion: 2.1 time: 0.395804 Sep 13 18:02:30.691131 dv-cinder-852009-8-iscsi devstack@n-api.service[120740]: DEBUG nova.policy [None req-24ff297e-5125-49d1-a6b5-b33f8bfc256c tempest-AttachVolumeShelveTestJSON-385853788 tempest-AttachVolumeShelveTestJSON-385853788-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'e68ecd9b3ca643539b109f75bb242d6f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '75e14fd88bfb4cd896fa7b070a0fac47', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120740) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 18:02:30.691864 dv-cinder-852009-8-iscsi devstack@n-api.service[120741]: [pid: 120741|app: 0|req: 39/84] 10.222.0.43 () {58 vars in 1236 bytes} [Tue Sep 13 18:02:30 2022] GET /compute/v2.1/servers/207d1d8d-58a4-4b99-aa09-1c5023c60784 => generated 1315 bytes in 421 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 13 18:02:30.703684 dv-cinder-852009-8-iscsi devstack@n-api.service[120740]: DEBUG nova.policy [None req-24ff297e-5125-49d1-a6b5-b33f8bfc256c tempest-AttachVolumeShelveTestJSON-385853788 tempest-AttachVolumeShelveTestJSON-385853788-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'e68ecd9b3ca643539b109f75bb242d6f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '75e14fd88bfb4cd896fa7b070a0fac47', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120740) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 18:02:30.704641 dv-cinder-852009-8-iscsi devstack@n-api.service[120741]: DEBUG nova.api.openstack.wsgi [None req-54b3370c-8b20-4af7-82fd-d9be94679ec4 tempest-ServerRescueNegativeTestJSON-412251590 tempest-ServerRescueNegativeTestJSON-412251590-project] Calling method '>' {{(pid=120741) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 18:02:30.705208 dv-cinder-852009-8-iscsi devstack@n-api.service[120741]: DEBUG nova.compute.api [None req-54b3370c-8b20-4af7-82fd-d9be94679ec4 tempest-ServerRescueNegativeTestJSON-412251590 tempest-ServerRescueNegativeTestJSON-412251590-project] [instance: 8cd29851-35c1-4032-a137-ab9419a2ec5b] Fetching instance by UUID {{(pid=120741) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 18:02:30.707734 dv-cinder-852009-8-iscsi devstack@n-api.service[120740]: INFO nova.api.openstack.requestlog [None req-24ff297e-5125-49d1-a6b5-b33f8bfc256c tempest-AttachVolumeShelveTestJSON-385853788 tempest-AttachVolumeShelveTestJSON-385853788-project] 10.222.0.43 "GET /compute/v2.1/servers/11d2616a-96f9-4a7a-aab8-219219986a8b" status: 200 len: 1405 microversion: 2.20 time: 0.421398 Sep 13 18:02:30.709781 dv-cinder-852009-8-iscsi devstack@n-api.service[120740]: [pid: 120740|app: 0|req: 46/85] 10.222.0.43 () {60 vars in 1277 bytes} [Tue Sep 13 18:02:30 2022] GET /compute/v2.1/servers/11d2616a-96f9-4a7a-aab8-219219986a8b => generated 1405 bytes in 426 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 13 18:02:30.723189 dv-cinder-852009-8-iscsi devstack@n-api.service[120740]: DEBUG nova.api.openstack.wsgi [None req-e9fb44f7-52cf-423b-9cdf-bb7cae572159 tempest-AttachVolumeTestJSON-555093534 tempest-AttachVolumeTestJSON-555093534-project] Calling method '>' {{(pid=120740) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 18:02:30.723378 dv-cinder-852009-8-iscsi devstack@n-api.service[120741]: DEBUG oslo_concurrency.lockutils [None req-54b3370c-8b20-4af7-82fd-d9be94679ec4 tempest-ServerRescueNegativeTestJSON-412251590 tempest-ServerRescueNegativeTestJSON-412251590-project] Acquiring lock "1daf4f4c-0e4a-4779-b53a-78c48397ea2f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120741) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 18:02:30.724183 dv-cinder-852009-8-iscsi devstack@n-api.service[120741]: DEBUG oslo_concurrency.lockutils [None req-54b3370c-8b20-4af7-82fd-d9be94679ec4 tempest-ServerRescueNegativeTestJSON-412251590 tempest-ServerRescueNegativeTestJSON-412251590-project] Lock "1daf4f4c-0e4a-4779-b53a-78c48397ea2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120741) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 18:02:30.725377 dv-cinder-852009-8-iscsi devstack@n-api.service[120740]: DEBUG nova.compute.api [None req-e9fb44f7-52cf-423b-9cdf-bb7cae572159 tempest-AttachVolumeTestJSON-555093534 tempest-AttachVolumeTestJSON-555093534-project] [instance: b958d409-df20-44c6-aa0e-58cb0a482edf] Fetching instance by UUID {{(pid=120740) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 18:02:30.725528 dv-cinder-852009-8-iscsi devstack@n-api.service[120741]: DEBUG oslo_concurrency.lockutils [None req-54b3370c-8b20-4af7-82fd-d9be94679ec4 tempest-ServerRescueNegativeTestJSON-412251590 tempest-ServerRescueNegativeTestJSON-412251590-project] Lock "1daf4f4c-0e4a-4779-b53a-78c48397ea2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120741) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 18:02:30.726572 dv-cinder-852009-8-iscsi devstack@n-api.service[120741]: DEBUG oslo_concurrency.lockutils [None req-54b3370c-8b20-4af7-82fd-d9be94679ec4 tempest-ServerRescueNegativeTestJSON-412251590 tempest-ServerRescueNegativeTestJSON-412251590-project] Acquiring lock "1daf4f4c-0e4a-4779-b53a-78c48397ea2f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120741) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 18:02:30.727619 dv-cinder-852009-8-iscsi devstack@n-api.service[120741]: DEBUG oslo_concurrency.lockutils [None req-54b3370c-8b20-4af7-82fd-d9be94679ec4 tempest-ServerRescueNegativeTestJSON-412251590 tempest-ServerRescueNegativeTestJSON-412251590-project] Lock "1daf4f4c-0e4a-4779-b53a-78c48397ea2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120741) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 18:02:30.728779 dv-cinder-852009-8-iscsi devstack@n-api.service[120741]: DEBUG oslo_concurrency.lockutils [None req-54b3370c-8b20-4af7-82fd-d9be94679ec4 tempest-ServerRescueNegativeTestJSON-412251590 tempest-ServerRescueNegativeTestJSON-412251590-project] Lock "1daf4f4c-0e4a-4779-b53a-78c48397ea2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120741) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 18:02:30.735472 dv-cinder-852009-8-iscsi devstack@n-api.service[120740]: DEBUG oslo_concurrency.lockutils [None req-e9fb44f7-52cf-423b-9cdf-bb7cae572159 tempest-AttachVolumeTestJSON-555093534 tempest-AttachVolumeTestJSON-555093534-project] Acquiring lock "1daf4f4c-0e4a-4779-b53a-78c48397ea2f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120740) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 18:02:30.736615 dv-cinder-852009-8-iscsi devstack@n-api.service[120740]: DEBUG oslo_concurrency.lockutils [None req-e9fb44f7-52cf-423b-9cdf-bb7cae572159 tempest-AttachVolumeTestJSON-555093534 tempest-AttachVolumeTestJSON-555093534-project] Lock "1daf4f4c-0e4a-4779-b53a-78c48397ea2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120740) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 18:02:30.737194 dv-cinder-852009-8-iscsi devstack@n-api.service[120740]: DEBUG oslo_concurrency.lockutils [None req-e9fb44f7-52cf-423b-9cdf-bb7cae572159 tempest-AttachVolumeTestJSON-555093534 tempest-AttachVolumeTestJSON-555093534-project] Lock "1daf4f4c-0e4a-4779-b53a-78c48397ea2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120740) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 18:02:30.738670 dv-cinder-852009-8-iscsi devstack@n-api.service[120740]: DEBUG oslo_concurrency.lockutils [None req-e9fb44f7-52cf-423b-9cdf-bb7cae572159 tempest-AttachVolumeTestJSON-555093534 tempest-AttachVolumeTestJSON-555093534-project] Acquiring lock "1daf4f4c-0e4a-4779-b53a-78c48397ea2f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120740) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 18:02:30.739140 dv-cinder-852009-8-iscsi devstack@n-api.service[120740]: DEBUG oslo_concurrency.lockutils [None req-e9fb44f7-52cf-423b-9cdf-bb7cae572159 tempest-AttachVolumeTestJSON-555093534 tempest-AttachVolumeTestJSON-555093534-project] Lock "1daf4f4c-0e4a-4779-b53a-78c48397ea2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120740) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 18:02:30.740527 dv-cinder-852009-8-iscsi devstack@n-api.service[120740]: DEBUG oslo_concurrency.lockutils [None req-e9fb44f7-52cf-423b-9cdf-bb7cae572159 tempest-AttachVolumeTestJSON-555093534 tempest-AttachVolumeTestJSON-555093534-project] Lock "1daf4f4c-0e4a-4779-b53a-78c48397ea2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120740) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 18:02:30.758204 dv-cinder-852009-8-iscsi devstack@n-api.service[120741]: DEBUG dbcounter [-] [120741] Writing DB stats nova_cell1:SELECT=100 {{(pid=120741) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 18:02:30.967724 dv-cinder-852009-8-iscsi devstack@n-api.service[120741]: DEBUG nova.policy [None req-54b3370c-8b20-4af7-82fd-d9be94679ec4 tempest-ServerRescueNegativeTestJSON-412251590 tempest-ServerRescueNegativeTestJSON-412251590-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '60800cf2774e409d9c1b6f4992669991', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2eae4acecf6c4961830ead78d71b2ad3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120741) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 18:02:30.969118 dv-cinder-852009-8-iscsi devstack@n-api.service[120740]: DEBUG nova.policy [None req-e9fb44f7-52cf-423b-9cdf-bb7cae572159 tempest-AttachVolumeTestJSON-555093534 tempest-AttachVolumeTestJSON-555093534-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0625b3113ce044bbac4f6142eaade11c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a279fcbf274c4704a31a2b95061e1469', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120740) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 18:02:30.979222 dv-cinder-852009-8-iscsi devstack@n-api.service[120741]: INFO nova.api.openstack.requestlog [None req-54b3370c-8b20-4af7-82fd-d9be94679ec4 tempest-ServerRescueNegativeTestJSON-412251590 tempest-ServerRescueNegativeTestJSON-412251590-project] 10.222.0.43 "GET /compute/v2.1/servers/8cd29851-35c1-4032-a137-ab9419a2ec5b" status: 200 len: 1322 microversion: 2.1 time: 0.285414 Sep 13 18:02:30.981283 dv-cinder-852009-8-iscsi devstack@n-api.service[120741]: [pid: 120741|app: 0|req: 40/86] 10.222.0.43 () {58 vars in 1236 bytes} [Tue Sep 13 18:02:30 2022] GET /compute/v2.1/servers/8cd29851-35c1-4032-a137-ab9419a2ec5b => generated 1322 bytes in 289 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 13 18:02:30.989333 dv-cinder-852009-8-iscsi devstack@n-api.service[120740]: INFO nova.api.openstack.requestlog [None req-e9fb44f7-52cf-423b-9cdf-bb7cae572159 tempest-AttachVolumeTestJSON-555093534 tempest-AttachVolumeTestJSON-555093534-project] 10.222.0.43 "GET /compute/v2.1/servers/b958d409-df20-44c6-aa0e-58cb0a482edf" status: 200 len: 1362 microversion: 2.1 time: 0.276653 Sep 13 18:02:30.989813 dv-cinder-852009-8-iscsi devstack@n-api.service[120740]: [pid: 120740|app: 0|req: 47/87] 10.222.0.43 () {58 vars in 1236 bytes} [Tue Sep 13 18:02:30 2022] GET /compute/v2.1/servers/b958d409-df20-44c6-aa0e-58cb0a482edf => generated 1362 bytes in 279 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 13 18:02:31.683606 dv-cinder-852009-8-iscsi devstack@n-api.service[120741]: DEBUG nova.api.openstack.wsgi [req-f8f44371-f77b-4f6b-9a91-712a8e898863 req-af713fac-509e-4073-8db9-c013be05e4f0 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "11d2616a-96f9-4a7a-aab8-219219986a8b", "name": "network-vif-plugged", "status": "completed", "tag": "85bfb53c-ec3d-49bc-ade7-acdfac253331"}]} {{(pid=120741) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 13 18:02:31.706402 dv-cinder-852009-8-iscsi devstack@n-api.service[120741]: DEBUG oslo_concurrency.lockutils [req-f8f44371-f77b-4f6b-9a91-712a8e898863 req-af713fac-509e-4073-8db9-c013be05e4f0 service nova] Acquiring lock "1daf4f4c-0e4a-4779-b53a-78c48397ea2f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120741) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 18:02:31.709795 dv-cinder-852009-8-iscsi devstack@n-api.service[120741]: DEBUG oslo_concurrency.lockutils [req-f8f44371-f77b-4f6b-9a91-712a8e898863 req-af713fac-509e-4073-8db9-c013be05e4f0 service nova] Lock "1daf4f4c-0e4a-4779-b53a-78c48397ea2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=120741) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 18:02:31.710684 dv-cinder-852009-8-iscsi devstack@n-api.service[120741]: DEBUG oslo_concurrency.lockutils [req-f8f44371-f77b-4f6b-9a91-712a8e898863 req-af713fac-509e-4073-8db9-c013be05e4f0 service nova] Lock "1daf4f4c-0e4a-4779-b53a-78c48397ea2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120741) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 18:02:31.718996 dv-cinder-852009-8-iscsi devstack@n-api.service[120740]: DEBUG nova.api.openstack.wsgi [None req-4f768f1e-3bff-4b57-91e7-37d03c9633e2 tempest-DeleteServersTestJSON-1632919649 tempest-DeleteServersTestJSON-1632919649-project] Calling method '>' {{(pid=120740) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 18:02:31.720234 dv-cinder-852009-8-iscsi devstack@n-api.service[120740]: DEBUG nova.compute.api [None req-4f768f1e-3bff-4b57-91e7-37d03c9633e2 tempest-DeleteServersTestJSON-1632919649 tempest-DeleteServersTestJSON-1632919649-project] [instance: 207d1d8d-58a4-4b99-aa09-1c5023c60784] Fetching instance by UUID {{(pid=120740) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 18:02:31.732413 dv-cinder-852009-8-iscsi devstack@n-api.service[120740]: DEBUG oslo_concurrency.lockutils [None req-4f768f1e-3bff-4b57-91e7-37d03c9633e2 tempest-DeleteServersTestJSON-1632919649 tempest-DeleteServersTestJSON-1632919649-project] Acquiring lock "1daf4f4c-0e4a-4779-b53a-78c48397ea2f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120740) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 18:02:31.734117 dv-cinder-852009-8-iscsi devstack@n-api.service[120740]: DEBUG oslo_concurrency.lockutils [None req-4f768f1e-3bff-4b57-91e7-37d03c9633e2 tempest-DeleteServersTestJSON-1632919649 tempest-DeleteServersTestJSON-1632919649-project] Lock "1daf4f4c-0e4a-4779-b53a-78c48397ea2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120740) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 18:02:31.737068 dv-cinder-852009-8-iscsi devstack@n-api.service[120740]: DEBUG oslo_concurrency.lockutils [None req-4f768f1e-3bff-4b57-91e7-37d03c9633e2 tempest-DeleteServersTestJSON-1632919649 tempest-DeleteServersTestJSON-1632919649-project] Lock "1daf4f4c-0e4a-4779-b53a-78c48397ea2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=120740) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 18:02:31.742925 dv-cinder-852009-8-iscsi devstack@n-api.service[120740]: DEBUG oslo_concurrency.lockutils [None req-4f768f1e-3bff-4b57-91e7-37d03c9633e2 tempest-DeleteServersTestJSON-1632919649 tempest-DeleteServersTestJSON-1632919649-project] Acquiring lock "1daf4f4c-0e4a-4779-b53a-78c48397ea2f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120740) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 18:02:31.743022 dv-cinder-852009-8-iscsi devstack@n-api.service[120740]: DEBUG oslo_concurrency.lockutils [None req-4f768f1e-3bff-4b57-91e7-37d03c9633e2 tempest-DeleteServersTestJSON-1632919649 tempest-DeleteServersTestJSON-1632919649-project] Lock "1daf4f4c-0e4a-4779-b53a-78c48397ea2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120740) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 18:02:31.745314 dv-cinder-852009-8-iscsi devstack@n-api.service[120740]: DEBUG oslo_concurrency.lockutils [None req-4f768f1e-3bff-4b57-91e7-37d03c9633e2 tempest-DeleteServersTestJSON-1632919649 tempest-DeleteServersTestJSON-1632919649-project] Lock "1daf4f4c-0e4a-4779-b53a-78c48397ea2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120740) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 18:02:31.753078 dv-cinder-852009-8-iscsi devstack@n-api.service[120741]: INFO nova.api.openstack.compute.server_external_events [req-f8f44371-f77b-4f6b-9a91-712a8e898863 req-af713fac-509e-4073-8db9-c013be05e4f0 service nova] Creating event network-vif-plugged:85bfb53c-ec3d-49bc-ade7-acdfac253331 for instance 11d2616a-96f9-4a7a-aab8-219219986a8b on hv-cinder-85200 Sep 13 18:02:31.774705 dv-cinder-852009-8-iscsi devstack@n-api.service[120741]: INFO nova.api.openstack.requestlog [req-f8f44371-f77b-4f6b-9a91-712a8e898863 req-af713fac-509e-4073-8db9-c013be05e4f0 service nova] 10.222.0.43 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.095174 Sep 13 18:02:31.775603 dv-cinder-852009-8-iscsi devstack@n-api.service[120741]: [pid: 120741|app: 0|req: 41/88] 10.222.0.43 () {64 vars in 1317 bytes} [Tue Sep 13 18:02:31 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 97 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 13 18:02:31.793536 dv-cinder-852009-8-iscsi devstack@n-api.service[120741]: DEBUG nova.api.openstack.wsgi [None req-c34e6292-177d-4c06-a2fc-52136d3bf539 tempest-AttachVolumeShelveTestJSON-385853788 tempest-AttachVolumeShelveTestJSON-385853788-project] Calling method '>' {{(pid=120741) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 18:02:31.794619 dv-cinder-852009-8-iscsi devstack@n-api.service[120741]: DEBUG nova.compute.api [None req-c34e6292-177d-4c06-a2fc-52136d3bf539 tempest-AttachVolumeShelveTestJSON-385853788 tempest-AttachVolumeShelveTestJSON-385853788-project] [instance: 11d2616a-96f9-4a7a-aab8-219219986a8b] Fetching instance by UUID {{(pid=120741) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 18:02:31.803597 dv-cinder-852009-8-iscsi devstack@n-api.service[120741]: DEBUG oslo_concurrency.lockutils [None req-c34e6292-177d-4c06-a2fc-52136d3bf539 tempest-AttachVolumeShelveTestJSON-385853788 tempest-AttachVolumeShelveTestJSON-385853788-project] Acquiring lock "1daf4f4c-0e4a-4779-b53a-78c48397ea2f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120741) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 18:02:31.805674 dv-cinder-852009-8-iscsi devstack@n-api.service[120741]: DEBUG oslo_concurrency.lockutils [None req-c34e6292-177d-4c06-a2fc-52136d3bf539 tempest-AttachVolumeShelveTestJSON-385853788 tempest-AttachVolumeShelveTestJSON-385853788-project] Lock "1daf4f4c-0e4a-4779-b53a-78c48397ea2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120741) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 18:02:31.806272 dv-cinder-852009-8-iscsi devstack@n-api.service[120741]: DEBUG oslo_concurrency.lockutils [None req-c34e6292-177d-4c06-a2fc-52136d3bf539 tempest-AttachVolumeShelveTestJSON-385853788 tempest-AttachVolumeShelveTestJSON-385853788-project] Lock "1daf4f4c-0e4a-4779-b53a-78c48397ea2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120741) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 18:02:31.807226 dv-cinder-852009-8-iscsi devstack@n-api.service[120741]: DEBUG oslo_concurrency.lockutils [None req-c34e6292-177d-4c06-a2fc-52136d3bf539 tempest-AttachVolumeShelveTestJSON-385853788 tempest-AttachVolumeShelveTestJSON-385853788-project] Acquiring lock "1daf4f4c-0e4a-4779-b53a-78c48397ea2f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120741) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 18:02:31.808952 dv-cinder-852009-8-iscsi devstack@n-api.service[120741]: DEBUG oslo_concurrency.lockutils [None req-c34e6292-177d-4c06-a2fc-52136d3bf539 tempest-AttachVolumeShelveTestJSON-385853788 tempest-AttachVolumeShelveTestJSON-385853788-project] Lock "1daf4f4c-0e4a-4779-b53a-78c48397ea2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120741) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 18:02:31.809712 dv-cinder-852009-8-iscsi devstack@n-api.service[120741]: DEBUG oslo_concurrency.lockutils [None req-c34e6292-177d-4c06-a2fc-52136d3bf539 tempest-AttachVolumeShelveTestJSON-385853788 tempest-AttachVolumeShelveTestJSON-385853788-project] Lock "1daf4f4c-0e4a-4779-b53a-78c48397ea2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120741) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 18:02:32.181679 dv-cinder-852009-8-iscsi devstack@n-api.service[120741]: DEBUG nova.policy [None req-c34e6292-177d-4c06-a2fc-52136d3bf539 tempest-AttachVolumeShelveTestJSON-385853788 tempest-AttachVolumeShelveTestJSON-385853788-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e68ecd9b3ca643539b109f75bb242d6f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '75e14fd88bfb4cd896fa7b070a0fac47', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120741) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 18:02:32.182675 dv-cinder-852009-8-iscsi devstack@n-api.service[120740]: DEBUG nova.policy [None req-4f768f1e-3bff-4b57-91e7-37d03c9633e2 tempest-DeleteServersTestJSON-1632919649 tempest-DeleteServersTestJSON-1632919649-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '51db5ef052144879b53979268ac4ceb5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '66136f123f5b4ad0a824920bbdf9d245', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120740) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 18:02:32.191858 dv-cinder-852009-8-iscsi devstack@n-api.service[120740]: INFO nova.api.openstack.requestlog [None req-4f768f1e-3bff-4b57-91e7-37d03c9633e2 tempest-DeleteServersTestJSON-1632919649 tempest-DeleteServersTestJSON-1632919649-project] 10.222.0.43 "GET /compute/v2.1/servers/207d1d8d-58a4-4b99-aa09-1c5023c60784" status: 200 len: 1315 microversion: 2.1 time: 0.476718 Sep 13 18:02:32.198548 dv-cinder-852009-8-iscsi devstack@n-api.service[120740]: [pid: 120740|app: 0|req: 48/89] 10.222.0.43 () {58 vars in 1236 bytes} [Tue Sep 13 18:02:31 2022] GET /compute/v2.1/servers/207d1d8d-58a4-4b99-aa09-1c5023c60784 => generated 1315 bytes in 481 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 13 18:02:32.199588 dv-cinder-852009-8-iscsi devstack@n-api.service[120741]: DEBUG nova.policy [None req-c34e6292-177d-4c06-a2fc-52136d3bf539 tempest-AttachVolumeShelveTestJSON-385853788 tempest-AttachVolumeShelveTestJSON-385853788-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'e68ecd9b3ca643539b109f75bb242d6f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '75e14fd88bfb4cd896fa7b070a0fac47', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120741) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 18:02:32.203614 dv-cinder-852009-8-iscsi devstack@n-api.service[120741]: DEBUG nova.policy [None req-c34e6292-177d-4c06-a2fc-52136d3bf539 tempest-AttachVolumeShelveTestJSON-385853788 tempest-AttachVolumeShelveTestJSON-385853788-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'e68ecd9b3ca643539b109f75bb242d6f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '75e14fd88bfb4cd896fa7b070a0fac47', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120741) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 18:02:32.209177 dv-cinder-852009-8-iscsi devstack@n-api.service[120741]: INFO nova.api.openstack.requestlog [None req-c34e6292-177d-4c06-a2fc-52136d3bf539 tempest-AttachVolumeShelveTestJSON-385853788 tempest-AttachVolumeShelveTestJSON-385853788-project] 10.222.0.43 "GET /compute/v2.1/servers/11d2616a-96f9-4a7a-aab8-219219986a8b" status: 200 len: 1405 microversion: 2.20 time: 0.432283 Sep 13 18:02:32.209354 dv-cinder-852009-8-iscsi devstack@n-api.service[120740]: DEBUG nova.api.openstack.wsgi [None req-c541722a-3f96-4d78-b924-6db5799806e7 tempest-ServerRescueNegativeTestJSON-412251590 tempest-ServerRescueNegativeTestJSON-412251590-project] Calling method '>' {{(pid=120740) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 18:02:32.211637 dv-cinder-852009-8-iscsi devstack@n-api.service[120740]: DEBUG nova.compute.api [None req-c541722a-3f96-4d78-b924-6db5799806e7 tempest-ServerRescueNegativeTestJSON-412251590 tempest-ServerRescueNegativeTestJSON-412251590-project] [instance: 8cd29851-35c1-4032-a137-ab9419a2ec5b] Fetching instance by UUID {{(pid=120740) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 18:02:32.223809 dv-cinder-852009-8-iscsi devstack@n-api.service[120741]: [pid: 120741|app: 0|req: 42/90] 10.222.0.43 () {60 vars in 1277 bytes} [Tue Sep 13 18:02:31 2022] GET /compute/v2.1/servers/11d2616a-96f9-4a7a-aab8-219219986a8b => generated 1405 bytes in 447 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 13 18:02:32.229835 dv-cinder-852009-8-iscsi devstack@n-api.service[120740]: DEBUG oslo_concurrency.lockutils [None req-c541722a-3f96-4d78-b924-6db5799806e7 tempest-ServerRescueNegativeTestJSON-412251590 tempest-ServerRescueNegativeTestJSON-412251590-project] Acquiring lock "1daf4f4c-0e4a-4779-b53a-78c48397ea2f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120740) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 18:02:32.231274 dv-cinder-852009-8-iscsi devstack@n-api.service[120740]: DEBUG oslo_concurrency.lockutils [None req-c541722a-3f96-4d78-b924-6db5799806e7 tempest-ServerRescueNegativeTestJSON-412251590 tempest-ServerRescueNegativeTestJSON-412251590-project] Lock "1daf4f4c-0e4a-4779-b53a-78c48397ea2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=120740) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 18:02:32.232116 dv-cinder-852009-8-iscsi devstack@n-api.service[120740]: DEBUG oslo_concurrency.lockutils [None req-c541722a-3f96-4d78-b924-6db5799806e7 tempest-ServerRescueNegativeTestJSON-412251590 tempest-ServerRescueNegativeTestJSON-412251590-project] Lock "1daf4f4c-0e4a-4779-b53a-78c48397ea2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120740) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 18:02:32.234929 dv-cinder-852009-8-iscsi devstack@n-api.service[120740]: DEBUG oslo_concurrency.lockutils [None req-c541722a-3f96-4d78-b924-6db5799806e7 tempest-ServerRescueNegativeTestJSON-412251590 tempest-ServerRescueNegativeTestJSON-412251590-project] Acquiring lock "1daf4f4c-0e4a-4779-b53a-78c48397ea2f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120740) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 18:02:32.235701 dv-cinder-852009-8-iscsi devstack@n-api.service[120741]: DEBUG nova.api.openstack.wsgi [None req-3bb1d99b-277b-4dda-8800-521daaeecbe1 tempest-AttachVolumeTestJSON-555093534 tempest-AttachVolumeTestJSON-555093534-project] Calling method '>' {{(pid=120741) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 18:02:32.236328 dv-cinder-852009-8-iscsi devstack@n-api.service[120740]: DEBUG oslo_concurrency.lockutils [None req-c541722a-3f96-4d78-b924-6db5799806e7 tempest-ServerRescueNegativeTestJSON-412251590 tempest-ServerRescueNegativeTestJSON-412251590-project] Lock "1daf4f4c-0e4a-4779-b53a-78c48397ea2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120740) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 18:02:32.236692 dv-cinder-852009-8-iscsi devstack@n-api.service[120741]: DEBUG nova.compute.api [None req-3bb1d99b-277b-4dda-8800-521daaeecbe1 tempest-AttachVolumeTestJSON-555093534 tempest-AttachVolumeTestJSON-555093534-project] [instance: b958d409-df20-44c6-aa0e-58cb0a482edf] Fetching instance by UUID {{(pid=120741) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 18:02:32.240156 dv-cinder-852009-8-iscsi devstack@n-api.service[120740]: DEBUG oslo_concurrency.lockutils [None req-c541722a-3f96-4d78-b924-6db5799806e7 tempest-ServerRescueNegativeTestJSON-412251590 tempest-ServerRescueNegativeTestJSON-412251590-project] Lock "1daf4f4c-0e4a-4779-b53a-78c48397ea2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120740) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 18:02:32.244066 dv-cinder-852009-8-iscsi devstack@n-api.service[120741]: DEBUG oslo_concurrency.lockutils [None req-3bb1d99b-277b-4dda-8800-521daaeecbe1 tempest-AttachVolumeTestJSON-555093534 tempest-AttachVolumeTestJSON-555093534-project] Acquiring lock "1daf4f4c-0e4a-4779-b53a-78c48397ea2f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120741) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 18:02:32.244757 dv-cinder-852009-8-iscsi devstack@n-api.service[120741]: DEBUG oslo_concurrency.lockutils [None req-3bb1d99b-277b-4dda-8800-521daaeecbe1 tempest-AttachVolumeTestJSON-555093534 tempest-AttachVolumeTestJSON-555093534-project] Lock "1daf4f4c-0e4a-4779-b53a-78c48397ea2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120741) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 18:02:32.245233 dv-cinder-852009-8-iscsi devstack@n-api.service[120741]: DEBUG oslo_concurrency.lockutils [None req-3bb1d99b-277b-4dda-8800-521daaeecbe1 tempest-AttachVolumeTestJSON-555093534 tempest-AttachVolumeTestJSON-555093534-project] Lock "1daf4f4c-0e4a-4779-b53a-78c48397ea2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120741) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 18:02:32.246133 dv-cinder-852009-8-iscsi devstack@n-api.service[120741]: DEBUG oslo_concurrency.lockutils [None req-3bb1d99b-277b-4dda-8800-521daaeecbe1 tempest-AttachVolumeTestJSON-555093534 tempest-AttachVolumeTestJSON-555093534-project] Acquiring lock "1daf4f4c-0e4a-4779-b53a-78c48397ea2f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120741) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 18:02:32.246587 dv-cinder-852009-8-iscsi devstack@n-api.service[120741]: DEBUG oslo_concurrency.lockutils [None req-3bb1d99b-277b-4dda-8800-521daaeecbe1 tempest-AttachVolumeTestJSON-555093534 tempest-AttachVolumeTestJSON-555093534-project] Lock "1daf4f4c-0e4a-4779-b53a-78c48397ea2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120741) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 18:02:32.247004 dv-cinder-852009-8-iscsi devstack@n-api.service[120741]: DEBUG oslo_concurrency.lockutils [None req-3bb1d99b-277b-4dda-8800-521daaeecbe1 tempest-AttachVolumeTestJSON-555093534 tempest-AttachVolumeTestJSON-555093534-project] Lock "1daf4f4c-0e4a-4779-b53a-78c48397ea2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120741) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 18:02:32.514663 dv-cinder-852009-8-iscsi devstack@n-api.service[120741]: DEBUG nova.policy [None req-3bb1d99b-277b-4dda-8800-521daaeecbe1 tempest-AttachVolumeTestJSON-555093534 tempest-AttachVolumeTestJSON-555093534-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0625b3113ce044bbac4f6142eaade11c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a279fcbf274c4704a31a2b95061e1469', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120741) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 18:02:32.525832 dv-cinder-852009-8-iscsi devstack@n-api.service[120741]: INFO nova.api.openstack.requestlog [None req-3bb1d99b-277b-4dda-8800-521daaeecbe1 tempest-AttachVolumeTestJSON-555093534 tempest-AttachVolumeTestJSON-555093534-project] 10.222.0.43 "GET /compute/v2.1/servers/b958d409-df20-44c6-aa0e-58cb0a482edf" status: 200 len: 1362 microversion: 2.1 time: 0.300974 Sep 13 18:02:32.527498 dv-cinder-852009-8-iscsi devstack@n-api.service[120740]: DEBUG nova.policy [None req-c541722a-3f96-4d78-b924-6db5799806e7 tempest-ServerRescueNegativeTestJSON-412251590 tempest-ServerRescueNegativeTestJSON-412251590-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '60800cf2774e409d9c1b6f4992669991', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2eae4acecf6c4961830ead78d71b2ad3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120740) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 18:02:32.528341 dv-cinder-852009-8-iscsi devstack@n-api.service[120741]: [pid: 120741|app: 0|req: 43/91] 10.222.0.43 () {58 vars in 1236 bytes} [Tue Sep 13 18:02:32 2022] GET /compute/v2.1/servers/b958d409-df20-44c6-aa0e-58cb0a482edf => generated 1362 bytes in 304 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 13 18:02:32.550509 dv-cinder-852009-8-iscsi devstack@n-api.service[120740]: INFO nova.api.openstack.requestlog [None req-c541722a-3f96-4d78-b924-6db5799806e7 tempest-ServerRescueNegativeTestJSON-412251590 tempest-ServerRescueNegativeTestJSON-412251590-project] 10.222.0.43 "GET /compute/v2.1/servers/8cd29851-35c1-4032-a137-ab9419a2ec5b" status: 200 len: 1322 microversion: 2.1 time: 0.350522 Sep 13 18:02:32.551098 dv-cinder-852009-8-iscsi devstack@n-api.service[120740]: [pid: 120740|app: 0|req: 49/92] 10.222.0.43 () {58 vars in 1236 bytes} [Tue Sep 13 18:02:32 2022] GET /compute/v2.1/servers/8cd29851-35c1-4032-a137-ab9419a2ec5b => generated 1322 bytes in 352 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 13 18:02:33.223023 dv-cinder-852009-8-iscsi devstack@n-api.service[120741]: DEBUG nova.api.openstack.wsgi [None req-0331899f-2ca6-4d75-ab0b-41d7353d569c tempest-DeleteServersTestJSON-1632919649 tempest-DeleteServersTestJSON-1632919649-project] Calling method '>' {{(pid=120741) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 18:02:33.223705 dv-cinder-852009-8-iscsi devstack@n-api.service[120741]: DEBUG nova.compute.api [None req-0331899f-2ca6-4d75-ab0b-41d7353d569c tempest-DeleteServersTestJSON-1632919649 tempest-DeleteServersTestJSON-1632919649-project] [instance: 207d1d8d-58a4-4b99-aa09-1c5023c60784] Fetching instance by UUID {{(pid=120741) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 18:02:33.230944 dv-cinder-852009-8-iscsi devstack@n-api.service[120741]: DEBUG oslo_concurrency.lockutils [None req-0331899f-2ca6-4d75-ab0b-41d7353d569c tempest-DeleteServersTestJSON-1632919649 tempest-DeleteServersTestJSON-1632919649-project] Acquiring lock "1daf4f4c-0e4a-4779-b53a-78c48397ea2f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120741) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 18:02:33.231620 dv-cinder-852009-8-iscsi devstack@n-api.service[120741]: DEBUG oslo_concurrency.lockutils [None req-0331899f-2ca6-4d75-ab0b-41d7353d569c tempest-DeleteServersTestJSON-1632919649 tempest-DeleteServersTestJSON-1632919649-project] Lock "1daf4f4c-0e4a-4779-b53a-78c48397ea2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120741) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 18:02:33.232229 dv-cinder-852009-8-iscsi devstack@n-api.service[120741]: DEBUG oslo_concurrency.lockutils [None req-0331899f-2ca6-4d75-ab0b-41d7353d569c tempest-DeleteServersTestJSON-1632919649 tempest-DeleteServersTestJSON-1632919649-project] Lock "1daf4f4c-0e4a-4779-b53a-78c48397ea2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120741) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 18:02:33.234750 dv-cinder-852009-8-iscsi devstack@n-api.service[120741]: DEBUG oslo_concurrency.lockutils [None req-0331899f-2ca6-4d75-ab0b-41d7353d569c tempest-DeleteServersTestJSON-1632919649 tempest-DeleteServersTestJSON-1632919649-project] Acquiring lock "1daf4f4c-0e4a-4779-b53a-78c48397ea2f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120741) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 18:02:33.235416 dv-cinder-852009-8-iscsi devstack@n-api.service[120741]: DEBUG oslo_concurrency.lockutils [None req-0331899f-2ca6-4d75-ab0b-41d7353d569c tempest-DeleteServersTestJSON-1632919649 tempest-DeleteServersTestJSON-1632919649-project] Lock "1daf4f4c-0e4a-4779-b53a-78c48397ea2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120741) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 18:02:33.236021 dv-cinder-852009-8-iscsi devstack@n-api.service[120741]: DEBUG oslo_concurrency.lockutils [None req-0331899f-2ca6-4d75-ab0b-41d7353d569c tempest-DeleteServersTestJSON-1632919649 tempest-DeleteServersTestJSON-1632919649-project] Lock "1daf4f4c-0e4a-4779-b53a-78c48397ea2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120741) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 18:02:33.245131 dv-cinder-852009-8-iscsi devstack@n-api.service[120740]: DEBUG nova.api.openstack.wsgi [None req-fe0d2c4c-39a1-40be-aa6d-303e0b361ae9 tempest-AttachVolumeShelveTestJSON-385853788 tempest-AttachVolumeShelveTestJSON-385853788-project] Calling method '>' {{(pid=120740) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 18:02:33.246875 dv-cinder-852009-8-iscsi devstack@n-api.service[120740]: DEBUG nova.compute.api [None req-fe0d2c4c-39a1-40be-aa6d-303e0b361ae9 tempest-AttachVolumeShelveTestJSON-385853788 tempest-AttachVolumeShelveTestJSON-385853788-project] [instance: 11d2616a-96f9-4a7a-aab8-219219986a8b] Fetching instance by UUID {{(pid=120740) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 18:02:33.258276 dv-cinder-852009-8-iscsi devstack@n-api.service[120740]: DEBUG oslo_concurrency.lockutils [None req-fe0d2c4c-39a1-40be-aa6d-303e0b361ae9 tempest-AttachVolumeShelveTestJSON-385853788 tempest-AttachVolumeShelveTestJSON-385853788-project] Acquiring lock "1daf4f4c-0e4a-4779-b53a-78c48397ea2f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120740) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 18:02:33.259114 dv-cinder-852009-8-iscsi devstack@n-api.service[120740]: DEBUG oslo_concurrency.lockutils [None req-fe0d2c4c-39a1-40be-aa6d-303e0b361ae9 tempest-AttachVolumeShelveTestJSON-385853788 tempest-AttachVolumeShelveTestJSON-385853788-project] Lock "1daf4f4c-0e4a-4779-b53a-78c48397ea2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120740) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 18:02:33.259721 dv-cinder-852009-8-iscsi devstack@n-api.service[120740]: DEBUG oslo_concurrency.lockutils [None req-fe0d2c4c-39a1-40be-aa6d-303e0b361ae9 tempest-AttachVolumeShelveTestJSON-385853788 tempest-AttachVolumeShelveTestJSON-385853788-project] Lock "1daf4f4c-0e4a-4779-b53a-78c48397ea2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120740) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 18:02:33.261380 dv-cinder-852009-8-iscsi devstack@n-api.service[120740]: DEBUG oslo_concurrency.lockutils [None req-fe0d2c4c-39a1-40be-aa6d-303e0b361ae9 tempest-AttachVolumeShelveTestJSON-385853788 tempest-AttachVolumeShelveTestJSON-385853788-project] Acquiring lock "1daf4f4c-0e4a-4779-b53a-78c48397ea2f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120740) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 18:02:33.263807 dv-cinder-852009-8-iscsi devstack@n-api.service[120740]: DEBUG oslo_concurrency.lockutils [None req-fe0d2c4c-39a1-40be-aa6d-303e0b361ae9 tempest-AttachVolumeShelveTestJSON-385853788 tempest-AttachVolumeShelveTestJSON-385853788-project] Lock "1daf4f4c-0e4a-4779-b53a-78c48397ea2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120740) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 18:02:33.264463 dv-cinder-852009-8-iscsi devstack@n-api.service[120740]: DEBUG oslo_concurrency.lockutils [None req-fe0d2c4c-39a1-40be-aa6d-303e0b361ae9 tempest-AttachVolumeShelveTestJSON-385853788 tempest-AttachVolumeShelveTestJSON-385853788-project] Lock "1daf4f4c-0e4a-4779-b53a-78c48397ea2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120740) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 18:02:33.461354 dv-cinder-852009-8-iscsi devstack@n-api.service[120740]: DEBUG nova.policy [None req-fe0d2c4c-39a1-40be-aa6d-303e0b361ae9 tempest-AttachVolumeShelveTestJSON-385853788 tempest-AttachVolumeShelveTestJSON-385853788-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e68ecd9b3ca643539b109f75bb242d6f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '75e14fd88bfb4cd896fa7b070a0fac47', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120740) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 18:02:33.473176 dv-cinder-852009-8-iscsi devstack@n-api.service[120740]: DEBUG nova.policy [None req-fe0d2c4c-39a1-40be-aa6d-303e0b361ae9 tempest-AttachVolumeShelveTestJSON-385853788 tempest-AttachVolumeShelveTestJSON-385853788-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'e68ecd9b3ca643539b109f75bb242d6f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '75e14fd88bfb4cd896fa7b070a0fac47', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120740) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 18:02:33.475012 dv-cinder-852009-8-iscsi devstack@n-api.service[120740]: DEBUG nova.policy [None req-fe0d2c4c-39a1-40be-aa6d-303e0b361ae9 tempest-AttachVolumeShelveTestJSON-385853788 tempest-AttachVolumeShelveTestJSON-385853788-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'e68ecd9b3ca643539b109f75bb242d6f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '75e14fd88bfb4cd896fa7b070a0fac47', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120740) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 18:02:33.478067 dv-cinder-852009-8-iscsi devstack@n-api.service[120740]: INFO nova.api.openstack.requestlog [None req-fe0d2c4c-39a1-40be-aa6d-303e0b361ae9 tempest-AttachVolumeShelveTestJSON-385853788 tempest-AttachVolumeShelveTestJSON-385853788-project] 10.222.0.43 "GET /compute/v2.1/servers/11d2616a-96f9-4a7a-aab8-219219986a8b" status: 200 len: 1405 microversion: 2.20 time: 0.241898 Sep 13 18:02:33.478932 dv-cinder-852009-8-iscsi devstack@n-api.service[120740]: [pid: 120740|app: 0|req: 50/93] 10.222.0.43 () {60 vars in 1277 bytes} [Tue Sep 13 18:02:33 2022] GET /compute/v2.1/servers/11d2616a-96f9-4a7a-aab8-219219986a8b => generated 1405 bytes in 244 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Sep 13 18:02:33.483845 dv-cinder-852009-8-iscsi devstack@n-api.service[120741]: DEBUG nova.policy [None req-0331899f-2ca6-4d75-ab0b-41d7353d569c tempest-DeleteServersTestJSON-1632919649 tempest-DeleteServersTestJSON-1632919649-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '51db5ef052144879b53979268ac4ceb5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '66136f123f5b4ad0a824920bbdf9d245', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120741) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 18:02:33.505250 dv-cinder-852009-8-iscsi devstack@n-api.service[120741]: INFO nova.api.openstack.requestlog [None req-0331899f-2ca6-4d75-ab0b-41d7353d569c tempest-DeleteServersTestJSON-1632919649 tempest-DeleteServersTestJSON-1632919649-project] 10.222.0.43 "GET /compute/v2.1/servers/207d1d8d-58a4-4b99-aa09-1c5023c60784" status: 200 len: 1315 microversion: 2.1 time: 0.285443 Sep 13 18:02:33.506366 dv-cinder-852009-8-iscsi devstack@n-api.service[120741]: [pid: 120741|app: 0|req: 44/94] 10.222.0.43 () {58 vars in 1236 bytes} [Tue Sep 13 18:02:33 2022] GET /compute/v2.1/servers/207d1d8d-58a4-4b99-aa09-1c5023c60784 => generated 1315 bytes in 288 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 13 18:02:33.550622 dv-cinder-852009-8-iscsi devstack@n-api.service[120740]: DEBUG nova.api.openstack.wsgi [None req-4c8176ce-9d8f-42ac-9204-6f2864ec752e tempest-AttachVolumeTestJSON-555093534 tempest-AttachVolumeTestJSON-555093534-project] Calling method '>' {{(pid=120740) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 18:02:33.551302 dv-cinder-852009-8-iscsi devstack@n-api.service[120740]: DEBUG nova.compute.api [None req-4c8176ce-9d8f-42ac-9204-6f2864ec752e tempest-AttachVolumeTestJSON-555093534 tempest-AttachVolumeTestJSON-555093534-project] [instance: b958d409-df20-44c6-aa0e-58cb0a482edf] Fetching instance by UUID {{(pid=120740) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 18:02:33.558522 dv-cinder-852009-8-iscsi devstack@n-api.service[120740]: DEBUG oslo_concurrency.lockutils [None req-4c8176ce-9d8f-42ac-9204-6f2864ec752e tempest-AttachVolumeTestJSON-555093534 tempest-AttachVolumeTestJSON-555093534-project] Acquiring lock "1daf4f4c-0e4a-4779-b53a-78c48397ea2f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120740) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 18:02:33.559013 dv-cinder-852009-8-iscsi devstack@n-api.service[120740]: DEBUG oslo_concurrency.lockutils [None req-4c8176ce-9d8f-42ac-9204-6f2864ec752e tempest-AttachVolumeTestJSON-555093534 tempest-AttachVolumeTestJSON-555093534-project] Lock "1daf4f4c-0e4a-4779-b53a-78c48397ea2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120740) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 18:02:33.559440 dv-cinder-852009-8-iscsi devstack@n-api.service[120740]: DEBUG oslo_concurrency.lockutils [None req-4c8176ce-9d8f-42ac-9204-6f2864ec752e tempest-AttachVolumeTestJSON-555093534 tempest-AttachVolumeTestJSON-555093534-project] Lock "1daf4f4c-0e4a-4779-b53a-78c48397ea2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120740) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 18:02:33.561367 dv-cinder-852009-8-iscsi devstack@n-api.service[120740]: DEBUG oslo_concurrency.lockutils [None req-4c8176ce-9d8f-42ac-9204-6f2864ec752e tempest-AttachVolumeTestJSON-555093534 tempest-AttachVolumeTestJSON-555093534-project] Acquiring lock "1daf4f4c-0e4a-4779-b53a-78c48397ea2f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120740) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 18:02:33.561836 dv-cinder-852009-8-iscsi devstack@n-api.service[120740]: DEBUG oslo_concurrency.lockutils [None req-4c8176ce-9d8f-42ac-9204-6f2864ec752e tempest-AttachVolumeTestJSON-555093534 tempest-AttachVolumeTestJSON-555093534-project] Lock "1daf4f4c-0e4a-4779-b53a-78c48397ea2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120740) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 18:02:33.562272 dv-cinder-852009-8-iscsi devstack@n-api.service[120740]: DEBUG oslo_concurrency.lockutils [None req-4c8176ce-9d8f-42ac-9204-6f2864ec752e tempest-AttachVolumeTestJSON-555093534 tempest-AttachVolumeTestJSON-555093534-project] Lock "1daf4f4c-0e4a-4779-b53a-78c48397ea2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120740) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 18:02:33.573127 dv-cinder-852009-8-iscsi devstack@n-api.service[120741]: DEBUG nova.api.openstack.wsgi [None req-e3ad5833-6838-43bf-b58f-1f0ac8e7cc68 tempest-ServerRescueNegativeTestJSON-412251590 tempest-ServerRescueNegativeTestJSON-412251590-project] Calling method '>' {{(pid=120741) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 18:02:33.573739 dv-cinder-852009-8-iscsi devstack@n-api.service[120741]: DEBUG nova.compute.api [None req-e3ad5833-6838-43bf-b58f-1f0ac8e7cc68 tempest-ServerRescueNegativeTestJSON-412251590 tempest-ServerRescueNegativeTestJSON-412251590-project] [instance: 8cd29851-35c1-4032-a137-ab9419a2ec5b] Fetching instance by UUID {{(pid=120741) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 18:02:33.582061 dv-cinder-852009-8-iscsi devstack@n-api.service[120741]: DEBUG oslo_concurrency.lockutils [None req-e3ad5833-6838-43bf-b58f-1f0ac8e7cc68 tempest-ServerRescueNegativeTestJSON-412251590 tempest-ServerRescueNegativeTestJSON-412251590-project] Acquiring lock "1daf4f4c-0e4a-4779-b53a-78c48397ea2f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120741) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 18:02:33.582878 dv-cinder-852009-8-iscsi devstack@n-api.service[120741]: DEBUG oslo_concurrency.lockutils [None req-e3ad5833-6838-43bf-b58f-1f0ac8e7cc68 tempest-ServerRescueNegativeTestJSON-412251590 tempest-ServerRescueNegativeTestJSON-412251590-project] Lock "1daf4f4c-0e4a-4779-b53a-78c48397ea2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120741) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 18:02:33.583383 dv-cinder-852009-8-iscsi devstack@n-api.service[120741]: DEBUG oslo_concurrency.lockutils [None req-e3ad5833-6838-43bf-b58f-1f0ac8e7cc68 tempest-ServerRescueNegativeTestJSON-412251590 tempest-ServerRescueNegativeTestJSON-412251590-project] Lock "1daf4f4c-0e4a-4779-b53a-78c48397ea2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120741) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 18:02:33.584243 dv-cinder-852009-8-iscsi devstack@n-api.service[120741]: DEBUG oslo_concurrency.lockutils [None req-e3ad5833-6838-43bf-b58f-1f0ac8e7cc68 tempest-ServerRescueNegativeTestJSON-412251590 tempest-ServerRescueNegativeTestJSON-412251590-project] Acquiring lock "1daf4f4c-0e4a-4779-b53a-78c48397ea2f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120741) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 18:02:33.584776 dv-cinder-852009-8-iscsi devstack@n-api.service[120741]: DEBUG oslo_concurrency.lockutils [None req-e3ad5833-6838-43bf-b58f-1f0ac8e7cc68 tempest-ServerRescueNegativeTestJSON-412251590 tempest-ServerRescueNegativeTestJSON-412251590-project] Lock "1daf4f4c-0e4a-4779-b53a-78c48397ea2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120741) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 18:02:33.585425 dv-cinder-852009-8-iscsi devstack@n-api.service[120741]: DEBUG oslo_concurrency.lockutils [None req-e3ad5833-6838-43bf-b58f-1f0ac8e7cc68 tempest-ServerRescueNegativeTestJSON-412251590 tempest-ServerRescueNegativeTestJSON-412251590-project] Lock "1daf4f4c-0e4a-4779-b53a-78c48397ea2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120741) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 18:02:33.783502 dv-cinder-852009-8-iscsi devstack@n-api.service[120740]: DEBUG nova.policy [None req-4c8176ce-9d8f-42ac-9204-6f2864ec752e tempest-AttachVolumeTestJSON-555093534 tempest-AttachVolumeTestJSON-555093534-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0625b3113ce044bbac4f6142eaade11c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a279fcbf274c4704a31a2b95061e1469', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120740) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 18:02:33.791552 dv-cinder-852009-8-iscsi devstack@n-api.service[120740]: INFO nova.api.openstack.requestlog [None req-4c8176ce-9d8f-42ac-9204-6f2864ec752e tempest-AttachVolumeTestJSON-555093534 tempest-AttachVolumeTestJSON-555093534-project] 10.222.0.43 "GET /compute/v2.1/servers/b958d409-df20-44c6-aa0e-58cb0a482edf" status: 200 len: 1362 microversion: 2.1 time: 0.244922 Sep 13 18:02:33.792152 dv-cinder-852009-8-iscsi devstack@n-api.service[120740]: [pid: 120740|app: 0|req: 51/95] 10.222.0.43 () {58 vars in 1236 bytes} [Tue Sep 13 18:02:33 2022] GET /compute/v2.1/servers/b958d409-df20-44c6-aa0e-58cb0a482edf => generated 1362 bytes in 246 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 13 18:02:33.837166 dv-cinder-852009-8-iscsi devstack@n-api.service[120741]: DEBUG nova.policy [None req-e3ad5833-6838-43bf-b58f-1f0ac8e7cc68 tempest-ServerRescueNegativeTestJSON-412251590 tempest-ServerRescueNegativeTestJSON-412251590-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '60800cf2774e409d9c1b6f4992669991', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2eae4acecf6c4961830ead78d71b2ad3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120741) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 18:02:33.847923 dv-cinder-852009-8-iscsi devstack@n-api.service[120741]: INFO nova.api.openstack.requestlog [None req-e3ad5833-6838-43bf-b58f-1f0ac8e7cc68 tempest-ServerRescueNegativeTestJSON-412251590 tempest-ServerRescueNegativeTestJSON-412251590-project] 10.222.0.43 "GET /compute/v2.1/servers/8cd29851-35c1-4032-a137-ab9419a2ec5b" status: 200 len: 1322 microversion: 2.1 time: 0.277750 Sep 13 18:02:33.849023 dv-cinder-852009-8-iscsi devstack@n-api.service[120741]: [pid: 120741|app: 0|req: 45/96] 10.222.0.43 () {58 vars in 1236 bytes} [Tue Sep 13 18:02:33 2022] GET /compute/v2.1/servers/8cd29851-35c1-4032-a137-ab9419a2ec5b => generated 1322 bytes in 280 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 13 18:02:33.917987 dv-cinder-852009-8-iscsi devstack@n-api.service[120740]: DEBUG nova.api.openstack.wsgi [req-ee2f11a6-2833-4271-bb58-47dc142aaf33 req-63a952f3-d2a0-436e-9dd2-336a7e81f2df service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "8cd29851-35c1-4032-a137-ab9419a2ec5b", "name": "network-vif-plugged", "status": "completed", "tag": "eb1bc841-d939-422b-b6e4-a6ed6ba2c0a1"}]} {{(pid=120740) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 13 18:02:33.928251 dv-cinder-852009-8-iscsi devstack@n-api.service[120740]: DEBUG oslo_concurrency.lockutils [req-ee2f11a6-2833-4271-bb58-47dc142aaf33 req-63a952f3-d2a0-436e-9dd2-336a7e81f2df service nova] Acquiring lock "1daf4f4c-0e4a-4779-b53a-78c48397ea2f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120740) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 18:02:33.928789 dv-cinder-852009-8-iscsi devstack@n-api.service[120740]: DEBUG oslo_concurrency.lockutils [req-ee2f11a6-2833-4271-bb58-47dc142aaf33 req-63a952f3-d2a0-436e-9dd2-336a7e81f2df service nova] Lock "1daf4f4c-0e4a-4779-b53a-78c48397ea2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120740) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 18:02:33.929214 dv-cinder-852009-8-iscsi devstack@n-api.service[120740]: DEBUG oslo_concurrency.lockutils [req-ee2f11a6-2833-4271-bb58-47dc142aaf33 req-63a952f3-d2a0-436e-9dd2-336a7e81f2df service nova] Lock "1daf4f4c-0e4a-4779-b53a-78c48397ea2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120740) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 18:02:33.940945 dv-cinder-852009-8-iscsi devstack@n-api.service[120740]: INFO nova.api.openstack.compute.server_external_events [req-ee2f11a6-2833-4271-bb58-47dc142aaf33 req-63a952f3-d2a0-436e-9dd2-336a7e81f2df service nova] Creating event network-vif-plugged:eb1bc841-d939-422b-b6e4-a6ed6ba2c0a1 for instance 8cd29851-35c1-4032-a137-ab9419a2ec5b on hv-cinder-85200 Sep 13 18:02:33.948199 dv-cinder-852009-8-iscsi devstack@n-api.service[120740]: INFO nova.api.openstack.requestlog [req-ee2f11a6-2833-4271-bb58-47dc142aaf33 req-63a952f3-d2a0-436e-9dd2-336a7e81f2df service nova] 10.222.0.43 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.033439 Sep 13 18:02:33.949425 dv-cinder-852009-8-iscsi devstack@n-api.service[120740]: [pid: 120740|app: 0|req: 52/97] 10.222.0.43 () {64 vars in 1317 bytes} [Tue Sep 13 18:02:33 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 37 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 13 18:02:34.522146 dv-cinder-852009-8-iscsi devstack@n-api.service[120741]: DEBUG nova.api.openstack.wsgi [None req-5a2c6752-8fb7-431a-aa76-726dbb9c4290 tempest-AttachVolumeShelveTestJSON-385853788 tempest-AttachVolumeShelveTestJSON-385853788-project] Calling method '>' {{(pid=120741) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 18:02:34.522790 dv-cinder-852009-8-iscsi devstack@n-api.service[120741]: DEBUG nova.compute.api [None req-5a2c6752-8fb7-431a-aa76-726dbb9c4290 tempest-AttachVolumeShelveTestJSON-385853788 tempest-AttachVolumeShelveTestJSON-385853788-project] [instance: 11d2616a-96f9-4a7a-aab8-219219986a8b] Fetching instance by UUID {{(pid=120741) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 18:02:34.529450 dv-cinder-852009-8-iscsi devstack@n-api.service[120741]: DEBUG oslo_concurrency.lockutils [None req-5a2c6752-8fb7-431a-aa76-726dbb9c4290 tempest-AttachVolumeShelveTestJSON-385853788 tempest-AttachVolumeShelveTestJSON-385853788-project] Acquiring lock "1daf4f4c-0e4a-4779-b53a-78c48397ea2f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120741) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 18:02:34.530116 dv-cinder-852009-8-iscsi devstack@n-api.service[120741]: DEBUG oslo_concurrency.lockutils [None req-5a2c6752-8fb7-431a-aa76-726dbb9c4290 tempest-AttachVolumeShelveTestJSON-385853788 tempest-AttachVolumeShelveTestJSON-385853788-project] Lock "1daf4f4c-0e4a-4779-b53a-78c48397ea2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120741) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 18:02:34.530597 dv-cinder-852009-8-iscsi devstack@n-api.service[120741]: DEBUG oslo_concurrency.lockutils [None req-5a2c6752-8fb7-431a-aa76-726dbb9c4290 tempest-AttachVolumeShelveTestJSON-385853788 tempest-AttachVolumeShelveTestJSON-385853788-project] Lock "1daf4f4c-0e4a-4779-b53a-78c48397ea2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120741) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 18:02:34.531372 dv-cinder-852009-8-iscsi devstack@n-api.service[120741]: DEBUG oslo_concurrency.lockutils [None req-5a2c6752-8fb7-431a-aa76-726dbb9c4290 tempest-AttachVolumeShelveTestJSON-385853788 tempest-AttachVolumeShelveTestJSON-385853788-project] Acquiring lock "1daf4f4c-0e4a-4779-b53a-78c48397ea2f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120741) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 18:02:34.531480 dv-cinder-852009-8-iscsi devstack@n-api.service[120740]: DEBUG nova.api.openstack.wsgi [None req-20e635d2-fa47-4c06-8e85-35bf33dfda9a tempest-DeleteServersTestJSON-1632919649 tempest-DeleteServersTestJSON-1632919649-project] Calling method '>' {{(pid=120740) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 18:02:34.531991 dv-cinder-852009-8-iscsi devstack@n-api.service[120741]: DEBUG oslo_concurrency.lockutils [None req-5a2c6752-8fb7-431a-aa76-726dbb9c4290 tempest-AttachVolumeShelveTestJSON-385853788 tempest-AttachVolumeShelveTestJSON-385853788-project] Lock "1daf4f4c-0e4a-4779-b53a-78c48397ea2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120741) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 18:02:34.532082 dv-cinder-852009-8-iscsi devstack@n-api.service[120740]: DEBUG nova.compute.api [None req-20e635d2-fa47-4c06-8e85-35bf33dfda9a tempest-DeleteServersTestJSON-1632919649 tempest-DeleteServersTestJSON-1632919649-project] [instance: 207d1d8d-58a4-4b99-aa09-1c5023c60784] Fetching instance by UUID {{(pid=120740) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 18:02:34.532482 dv-cinder-852009-8-iscsi devstack@n-api.service[120741]: DEBUG oslo_concurrency.lockutils [None req-5a2c6752-8fb7-431a-aa76-726dbb9c4290 tempest-AttachVolumeShelveTestJSON-385853788 tempest-AttachVolumeShelveTestJSON-385853788-project] Lock "1daf4f4c-0e4a-4779-b53a-78c48397ea2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120741) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 18:02:34.538360 dv-cinder-852009-8-iscsi devstack@n-api.service[120740]: DEBUG oslo_concurrency.lockutils [None req-20e635d2-fa47-4c06-8e85-35bf33dfda9a tempest-DeleteServersTestJSON-1632919649 tempest-DeleteServersTestJSON-1632919649-project] Acquiring lock "1daf4f4c-0e4a-4779-b53a-78c48397ea2f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120740) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 18:02:34.538876 dv-cinder-852009-8-iscsi devstack@n-api.service[120740]: DEBUG oslo_concurrency.lockutils [None req-20e635d2-fa47-4c06-8e85-35bf33dfda9a tempest-DeleteServersTestJSON-1632919649 tempest-DeleteServersTestJSON-1632919649-project] Lock "1daf4f4c-0e4a-4779-b53a-78c48397ea2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120740) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 18:02:34.539516 dv-cinder-852009-8-iscsi devstack@n-api.service[120740]: DEBUG oslo_concurrency.lockutils [None req-20e635d2-fa47-4c06-8e85-35bf33dfda9a tempest-DeleteServersTestJSON-1632919649 tempest-DeleteServersTestJSON-1632919649-project] Lock "1daf4f4c-0e4a-4779-b53a-78c48397ea2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120740) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 18:02:34.540199 dv-cinder-852009-8-iscsi devstack@n-api.service[120740]: DEBUG oslo_concurrency.lockutils [None req-20e635d2-fa47-4c06-8e85-35bf33dfda9a tempest-DeleteServersTestJSON-1632919649 tempest-DeleteServersTestJSON-1632919649-project] Acquiring lock "1daf4f4c-0e4a-4779-b53a-78c48397ea2f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120740) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 18:02:34.540715 dv-cinder-852009-8-iscsi devstack@n-api.service[120740]: DEBUG oslo_concurrency.lockutils [None req-20e635d2-fa47-4c06-8e85-35bf33dfda9a tempest-DeleteServersTestJSON-1632919649 tempest-DeleteServersTestJSON-1632919649-project] Lock "1daf4f4c-0e4a-4779-b53a-78c48397ea2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120740) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 18:02:34.541126 dv-cinder-852009-8-iscsi devstack@n-api.service[120740]: DEBUG oslo_concurrency.lockutils [None req-20e635d2-fa47-4c06-8e85-35bf33dfda9a tempest-DeleteServersTestJSON-1632919649 tempest-DeleteServersTestJSON-1632919649-project] Lock "1daf4f4c-0e4a-4779-b53a-78c48397ea2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120740) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 18:02:34.746980 dv-cinder-852009-8-iscsi devstack@n-api.service[120740]: DEBUG nova.policy [None req-20e635d2-fa47-4c06-8e85-35bf33dfda9a tempest-DeleteServersTestJSON-1632919649 tempest-DeleteServersTestJSON-1632919649-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '51db5ef052144879b53979268ac4ceb5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '66136f123f5b4ad0a824920bbdf9d245', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120740) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 18:02:34.747145 dv-cinder-852009-8-iscsi devstack@n-api.service[120741]: DEBUG nova.policy [None req-5a2c6752-8fb7-431a-aa76-726dbb9c4290 tempest-AttachVolumeShelveTestJSON-385853788 tempest-AttachVolumeShelveTestJSON-385853788-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e68ecd9b3ca643539b109f75bb242d6f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '75e14fd88bfb4cd896fa7b070a0fac47', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120741) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 18:02:34.755438 dv-cinder-852009-8-iscsi devstack@n-api.service[120740]: INFO nova.api.openstack.requestlog [None req-20e635d2-fa47-4c06-8e85-35bf33dfda9a tempest-DeleteServersTestJSON-1632919649 tempest-DeleteServersTestJSON-1632919649-project] 10.222.0.43 "GET /compute/v2.1/servers/207d1d8d-58a4-4b99-aa09-1c5023c60784" status: 200 len: 1315 microversion: 2.1 time: 0.228679 Sep 13 18:02:34.756799 dv-cinder-852009-8-iscsi devstack@n-api.service[120740]: [pid: 120740|app: 0|req: 53/98] 10.222.0.43 () {58 vars in 1236 bytes} [Tue Sep 13 18:02:34 2022] GET /compute/v2.1/servers/207d1d8d-58a4-4b99-aa09-1c5023c60784 => generated 1315 bytes in 231 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 13 18:02:34.772394 dv-cinder-852009-8-iscsi devstack@n-api.service[120741]: DEBUG nova.policy [None req-5a2c6752-8fb7-431a-aa76-726dbb9c4290 tempest-AttachVolumeShelveTestJSON-385853788 tempest-AttachVolumeShelveTestJSON-385853788-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'e68ecd9b3ca643539b109f75bb242d6f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '75e14fd88bfb4cd896fa7b070a0fac47', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120741) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 18:02:34.774361 dv-cinder-852009-8-iscsi devstack@n-api.service[120741]: DEBUG nova.policy [None req-5a2c6752-8fb7-431a-aa76-726dbb9c4290 tempest-AttachVolumeShelveTestJSON-385853788 tempest-AttachVolumeShelveTestJSON-385853788-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'e68ecd9b3ca643539b109f75bb242d6f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '75e14fd88bfb4cd896fa7b070a0fac47', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120741) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 18:02:34.775531 dv-cinder-852009-8-iscsi devstack@n-api.service[120741]: INFO nova.api.openstack.requestlog [None req-5a2c6752-8fb7-431a-aa76-726dbb9c4290 tempest-AttachVolumeShelveTestJSON-385853788 tempest-AttachVolumeShelveTestJSON-385853788-project] 10.222.0.43 "GET /compute/v2.1/servers/11d2616a-96f9-4a7a-aab8-219219986a8b" status: 200 len: 1405 microversion: 2.20 time: 0.257420 Sep 13 18:02:34.776092 dv-cinder-852009-8-iscsi devstack@n-api.service[120741]: [pid: 120741|app: 0|req: 46/99] 10.222.0.43 () {60 vars in 1277 bytes} [Tue Sep 13 18:02:34 2022] GET /compute/v2.1/servers/11d2616a-96f9-4a7a-aab8-219219986a8b => generated 1405 bytes in 259 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 13 18:02:34.816296 dv-cinder-852009-8-iscsi devstack@n-api.service[120740]: DEBUG nova.api.openstack.wsgi [None req-2f11d840-c250-4b07-ab59-db3bcbf9d54d tempest-AttachVolumeTestJSON-555093534 tempest-AttachVolumeTestJSON-555093534-project] Calling method '>' {{(pid=120740) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 18:02:34.816975 dv-cinder-852009-8-iscsi devstack@n-api.service[120740]: DEBUG nova.compute.api [None req-2f11d840-c250-4b07-ab59-db3bcbf9d54d tempest-AttachVolumeTestJSON-555093534 tempest-AttachVolumeTestJSON-555093534-project] [instance: b958d409-df20-44c6-aa0e-58cb0a482edf] Fetching instance by UUID {{(pid=120740) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 18:02:34.823683 dv-cinder-852009-8-iscsi devstack@n-api.service[120740]: DEBUG oslo_concurrency.lockutils [None req-2f11d840-c250-4b07-ab59-db3bcbf9d54d tempest-AttachVolumeTestJSON-555093534 tempest-AttachVolumeTestJSON-555093534-project] Acquiring lock "1daf4f4c-0e4a-4779-b53a-78c48397ea2f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120740) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 18:02:34.824283 dv-cinder-852009-8-iscsi devstack@n-api.service[120740]: DEBUG oslo_concurrency.lockutils [None req-2f11d840-c250-4b07-ab59-db3bcbf9d54d tempest-AttachVolumeTestJSON-555093534 tempest-AttachVolumeTestJSON-555093534-project] Lock "1daf4f4c-0e4a-4779-b53a-78c48397ea2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120740) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 18:02:34.824758 dv-cinder-852009-8-iscsi devstack@n-api.service[120740]: DEBUG oslo_concurrency.lockutils [None req-2f11d840-c250-4b07-ab59-db3bcbf9d54d tempest-AttachVolumeTestJSON-555093534 tempest-AttachVolumeTestJSON-555093534-project] Lock "1daf4f4c-0e4a-4779-b53a-78c48397ea2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120740) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 18:02:34.825498 dv-cinder-852009-8-iscsi devstack@n-api.service[120740]: DEBUG oslo_concurrency.lockutils [None req-2f11d840-c250-4b07-ab59-db3bcbf9d54d tempest-AttachVolumeTestJSON-555093534 tempest-AttachVolumeTestJSON-555093534-project] Acquiring lock "1daf4f4c-0e4a-4779-b53a-78c48397ea2f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120740) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 18:02:34.826009 dv-cinder-852009-8-iscsi devstack@n-api.service[120740]: DEBUG oslo_concurrency.lockutils [None req-2f11d840-c250-4b07-ab59-db3bcbf9d54d tempest-AttachVolumeTestJSON-555093534 tempest-AttachVolumeTestJSON-555093534-project] Lock "1daf4f4c-0e4a-4779-b53a-78c48397ea2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120740) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 18:02:34.826459 dv-cinder-852009-8-iscsi devstack@n-api.service[120740]: DEBUG oslo_concurrency.lockutils [None req-2f11d840-c250-4b07-ab59-db3bcbf9d54d tempest-AttachVolumeTestJSON-555093534 tempest-AttachVolumeTestJSON-555093534-project] Lock "1daf4f4c-0e4a-4779-b53a-78c48397ea2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120740) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 18:02:34.871889 dv-cinder-852009-8-iscsi devstack@n-api.service[120741]: DEBUG nova.api.openstack.wsgi [None req-7febea44-9ecf-4d98-9a6f-499947d687ec tempest-ServerRescueNegativeTestJSON-412251590 tempest-ServerRescueNegativeTestJSON-412251590-project] Calling method '>' {{(pid=120741) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 18:02:34.873114 dv-cinder-852009-8-iscsi devstack@n-api.service[120741]: DEBUG nova.compute.api [None req-7febea44-9ecf-4d98-9a6f-499947d687ec tempest-ServerRescueNegativeTestJSON-412251590 tempest-ServerRescueNegativeTestJSON-412251590-project] [instance: 8cd29851-35c1-4032-a137-ab9419a2ec5b] Fetching instance by UUID {{(pid=120741) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 18:02:34.880509 dv-cinder-852009-8-iscsi devstack@n-api.service[120741]: DEBUG oslo_concurrency.lockutils [None req-7febea44-9ecf-4d98-9a6f-499947d687ec tempest-ServerRescueNegativeTestJSON-412251590 tempest-ServerRescueNegativeTestJSON-412251590-project] Acquiring lock "1daf4f4c-0e4a-4779-b53a-78c48397ea2f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120741) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 18:02:34.881395 dv-cinder-852009-8-iscsi devstack@n-api.service[120741]: DEBUG oslo_concurrency.lockutils [None req-7febea44-9ecf-4d98-9a6f-499947d687ec tempest-ServerRescueNegativeTestJSON-412251590 tempest-ServerRescueNegativeTestJSON-412251590-project] Lock "1daf4f4c-0e4a-4779-b53a-78c48397ea2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120741) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 18:02:34.881991 dv-cinder-852009-8-iscsi devstack@n-api.service[120741]: DEBUG oslo_concurrency.lockutils [None req-7febea44-9ecf-4d98-9a6f-499947d687ec tempest-ServerRescueNegativeTestJSON-412251590 tempest-ServerRescueNegativeTestJSON-412251590-project] Lock "1daf4f4c-0e4a-4779-b53a-78c48397ea2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120741) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 18:02:34.882929 dv-cinder-852009-8-iscsi devstack@n-api.service[120741]: DEBUG oslo_concurrency.lockutils [None req-7febea44-9ecf-4d98-9a6f-499947d687ec tempest-ServerRescueNegativeTestJSON-412251590 tempest-ServerRescueNegativeTestJSON-412251590-project] Acquiring lock "1daf4f4c-0e4a-4779-b53a-78c48397ea2f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120741) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 18:02:34.883795 dv-cinder-852009-8-iscsi devstack@n-api.service[120741]: DEBUG oslo_concurrency.lockutils [None req-7febea44-9ecf-4d98-9a6f-499947d687ec tempest-ServerRescueNegativeTestJSON-412251590 tempest-ServerRescueNegativeTestJSON-412251590-project] Lock "1daf4f4c-0e4a-4779-b53a-78c48397ea2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120741) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 18:02:34.884364 dv-cinder-852009-8-iscsi devstack@n-api.service[120741]: DEBUG oslo_concurrency.lockutils [None req-7febea44-9ecf-4d98-9a6f-499947d687ec tempest-ServerRescueNegativeTestJSON-412251590 tempest-ServerRescueNegativeTestJSON-412251590-project] Lock "1daf4f4c-0e4a-4779-b53a-78c48397ea2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120741) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 18:02:35.159764 dv-cinder-852009-8-iscsi devstack@n-api.service[120741]: DEBUG nova.policy [None req-7febea44-9ecf-4d98-9a6f-499947d687ec tempest-ServerRescueNegativeTestJSON-412251590 tempest-ServerRescueNegativeTestJSON-412251590-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '60800cf2774e409d9c1b6f4992669991', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2eae4acecf6c4961830ead78d71b2ad3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120741) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 18:02:35.166329 dv-cinder-852009-8-iscsi devstack@n-api.service[120740]: DEBUG nova.policy [None req-2f11d840-c250-4b07-ab59-db3bcbf9d54d tempest-AttachVolumeTestJSON-555093534 tempest-AttachVolumeTestJSON-555093534-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0625b3113ce044bbac4f6142eaade11c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a279fcbf274c4704a31a2b95061e1469', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120740) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 18:02:35.174738 dv-cinder-852009-8-iscsi devstack@n-api.service[120741]: INFO nova.api.openstack.requestlog [None req-7febea44-9ecf-4d98-9a6f-499947d687ec tempest-ServerRescueNegativeTestJSON-412251590 tempest-ServerRescueNegativeTestJSON-412251590-project] 10.222.0.43 "GET /compute/v2.1/servers/8cd29851-35c1-4032-a137-ab9419a2ec5b" status: 200 len: 1322 microversion: 2.1 time: 0.307432 Sep 13 18:02:35.180018 dv-cinder-852009-8-iscsi devstack@n-api.service[120740]: INFO nova.api.openstack.requestlog [None req-2f11d840-c250-4b07-ab59-db3bcbf9d54d tempest-AttachVolumeTestJSON-555093534 tempest-AttachVolumeTestJSON-555093534-project] 10.222.0.43 "GET /compute/v2.1/servers/b958d409-df20-44c6-aa0e-58cb0a482edf" status: 200 len: 1362 microversion: 2.1 time: 0.367581 Sep 13 18:02:35.181030 dv-cinder-852009-8-iscsi devstack@n-api.service[120741]: [pid: 120741|app: 0|req: 47/100] 10.222.0.43 () {58 vars in 1236 bytes} [Tue Sep 13 18:02:34 2022] GET /compute/v2.1/servers/8cd29851-35c1-4032-a137-ab9419a2ec5b => generated 1322 bytes in 314 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 13 18:02:35.181285 dv-cinder-852009-8-iscsi devstack@n-api.service[120740]: [pid: 120740|app: 0|req: 54/101] 10.222.0.43 () {58 vars in 1236 bytes} [Tue Sep 13 18:02:34 2022] GET /compute/v2.1/servers/b958d409-df20-44c6-aa0e-58cb0a482edf => generated 1362 bytes in 369 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 13 18:02:35.778294 dv-cinder-852009-8-iscsi devstack@n-api.service[120741]: DEBUG nova.api.openstack.wsgi [None req-4906337d-bc77-4d92-8024-6b091813dd4a tempest-DeleteServersTestJSON-1632919649 tempest-DeleteServersTestJSON-1632919649-project] Calling method '>' {{(pid=120741) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 18:02:35.778963 dv-cinder-852009-8-iscsi devstack@n-api.service[120741]: DEBUG nova.compute.api [None req-4906337d-bc77-4d92-8024-6b091813dd4a tempest-DeleteServersTestJSON-1632919649 tempest-DeleteServersTestJSON-1632919649-project] [instance: 207d1d8d-58a4-4b99-aa09-1c5023c60784] Fetching instance by UUID {{(pid=120741) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 18:02:35.784907 dv-cinder-852009-8-iscsi devstack@n-api.service[120741]: DEBUG oslo_concurrency.lockutils [None req-4906337d-bc77-4d92-8024-6b091813dd4a tempest-DeleteServersTestJSON-1632919649 tempest-DeleteServersTestJSON-1632919649-project] Acquiring lock "1daf4f4c-0e4a-4779-b53a-78c48397ea2f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120741) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 18:02:35.785437 dv-cinder-852009-8-iscsi devstack@n-api.service[120741]: DEBUG oslo_concurrency.lockutils [None req-4906337d-bc77-4d92-8024-6b091813dd4a tempest-DeleteServersTestJSON-1632919649 tempest-DeleteServersTestJSON-1632919649-project] Lock "1daf4f4c-0e4a-4779-b53a-78c48397ea2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120741) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 18:02:35.785836 dv-cinder-852009-8-iscsi devstack@n-api.service[120741]: DEBUG oslo_concurrency.lockutils [None req-4906337d-bc77-4d92-8024-6b091813dd4a tempest-DeleteServersTestJSON-1632919649 tempest-DeleteServersTestJSON-1632919649-project] Lock "1daf4f4c-0e4a-4779-b53a-78c48397ea2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120741) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 18:02:35.786525 dv-cinder-852009-8-iscsi devstack@n-api.service[120741]: DEBUG oslo_concurrency.lockutils [None req-4906337d-bc77-4d92-8024-6b091813dd4a tempest-DeleteServersTestJSON-1632919649 tempest-DeleteServersTestJSON-1632919649-project] Acquiring lock "1daf4f4c-0e4a-4779-b53a-78c48397ea2f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120741) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 18:02:35.787040 dv-cinder-852009-8-iscsi devstack@n-api.service[120741]: DEBUG oslo_concurrency.lockutils [None req-4906337d-bc77-4d92-8024-6b091813dd4a tempest-DeleteServersTestJSON-1632919649 tempest-DeleteServersTestJSON-1632919649-project] Lock "1daf4f4c-0e4a-4779-b53a-78c48397ea2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120741) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 18:02:35.787442 dv-cinder-852009-8-iscsi devstack@n-api.service[120741]: DEBUG oslo_concurrency.lockutils [None req-4906337d-bc77-4d92-8024-6b091813dd4a tempest-DeleteServersTestJSON-1632919649 tempest-DeleteServersTestJSON-1632919649-project] Lock "1daf4f4c-0e4a-4779-b53a-78c48397ea2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120741) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 18:02:35.801044 dv-cinder-852009-8-iscsi devstack@n-api.service[120740]: DEBUG nova.api.openstack.wsgi [None req-833fc81a-5917-4b14-9a19-b836101d4421 tempest-AttachVolumeShelveTestJSON-385853788 tempest-AttachVolumeShelveTestJSON-385853788-project] Calling method '>' {{(pid=120740) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 18:02:35.802300 dv-cinder-852009-8-iscsi devstack@n-api.service[120740]: DEBUG nova.compute.api [None req-833fc81a-5917-4b14-9a19-b836101d4421 tempest-AttachVolumeShelveTestJSON-385853788 tempest-AttachVolumeShelveTestJSON-385853788-project] [instance: 11d2616a-96f9-4a7a-aab8-219219986a8b] Fetching instance by UUID {{(pid=120740) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 18:02:35.809037 dv-cinder-852009-8-iscsi devstack@n-api.service[120740]: DEBUG oslo_concurrency.lockutils [None req-833fc81a-5917-4b14-9a19-b836101d4421 tempest-AttachVolumeShelveTestJSON-385853788 tempest-AttachVolumeShelveTestJSON-385853788-project] Acquiring lock "1daf4f4c-0e4a-4779-b53a-78c48397ea2f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120740) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 18:02:35.809842 dv-cinder-852009-8-iscsi devstack@n-api.service[120740]: DEBUG oslo_concurrency.lockutils [None req-833fc81a-5917-4b14-9a19-b836101d4421 tempest-AttachVolumeShelveTestJSON-385853788 tempest-AttachVolumeShelveTestJSON-385853788-project] Lock "1daf4f4c-0e4a-4779-b53a-78c48397ea2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120740) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 18:02:35.810424 dv-cinder-852009-8-iscsi devstack@n-api.service[120740]: DEBUG oslo_concurrency.lockutils [None req-833fc81a-5917-4b14-9a19-b836101d4421 tempest-AttachVolumeShelveTestJSON-385853788 tempest-AttachVolumeShelveTestJSON-385853788-project] Lock "1daf4f4c-0e4a-4779-b53a-78c48397ea2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120740) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 18:02:35.811291 dv-cinder-852009-8-iscsi devstack@n-api.service[120740]: DEBUG oslo_concurrency.lockutils [None req-833fc81a-5917-4b14-9a19-b836101d4421 tempest-AttachVolumeShelveTestJSON-385853788 tempest-AttachVolumeShelveTestJSON-385853788-project] Acquiring lock "1daf4f4c-0e4a-4779-b53a-78c48397ea2f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120740) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 18:02:35.811874 dv-cinder-852009-8-iscsi devstack@n-api.service[120740]: DEBUG oslo_concurrency.lockutils [None req-833fc81a-5917-4b14-9a19-b836101d4421 tempest-AttachVolumeShelveTestJSON-385853788 tempest-AttachVolumeShelveTestJSON-385853788-project] Lock "1daf4f4c-0e4a-4779-b53a-78c48397ea2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120740) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 18:02:35.812443 dv-cinder-852009-8-iscsi devstack@n-api.service[120740]: DEBUG oslo_concurrency.lockutils [None req-833fc81a-5917-4b14-9a19-b836101d4421 tempest-AttachVolumeShelveTestJSON-385853788 tempest-AttachVolumeShelveTestJSON-385853788-project] Lock "1daf4f4c-0e4a-4779-b53a-78c48397ea2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120740) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 18:02:36.006784 dv-cinder-852009-8-iscsi devstack@n-api.service[120741]: DEBUG nova.policy [None req-4906337d-bc77-4d92-8024-6b091813dd4a tempest-DeleteServersTestJSON-1632919649 tempest-DeleteServersTestJSON-1632919649-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '51db5ef052144879b53979268ac4ceb5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '66136f123f5b4ad0a824920bbdf9d245', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120741) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 18:02:36.019769 dv-cinder-852009-8-iscsi devstack@n-api.service[120741]: INFO nova.api.openstack.requestlog [None req-4906337d-bc77-4d92-8024-6b091813dd4a tempest-DeleteServersTestJSON-1632919649 tempest-DeleteServersTestJSON-1632919649-project] 10.222.0.43 "GET /compute/v2.1/servers/207d1d8d-58a4-4b99-aa09-1c5023c60784" status: 200 len: 1315 microversion: 2.1 time: 0.245549 Sep 13 18:02:36.024302 dv-cinder-852009-8-iscsi devstack@n-api.service[120741]: [pid: 120741|app: 0|req: 48/102] 10.222.0.43 () {58 vars in 1236 bytes} [Tue Sep 13 18:02:35 2022] GET /compute/v2.1/servers/207d1d8d-58a4-4b99-aa09-1c5023c60784 => generated 1315 bytes in 251 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 13 18:02:36.031596 dv-cinder-852009-8-iscsi devstack@n-api.service[120741]: DEBUG nova.api.openstack.wsgi [req-75744f6c-2e89-4c13-90de-c1a854b4bfb0 req-52e238d9-88b4-406d-95c4-dcfcea930426 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "207d1d8d-58a4-4b99-aa09-1c5023c60784", "name": "network-vif-plugged", "status": "completed", "tag": "db9bff9b-84fc-4a92-8b2a-72aa37a0556d"}]} {{(pid=120741) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 13 18:02:36.041736 dv-cinder-852009-8-iscsi devstack@n-api.service[120740]: DEBUG nova.policy [None req-833fc81a-5917-4b14-9a19-b836101d4421 tempest-AttachVolumeShelveTestJSON-385853788 tempest-AttachVolumeShelveTestJSON-385853788-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e68ecd9b3ca643539b109f75bb242d6f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '75e14fd88bfb4cd896fa7b070a0fac47', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120740) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 18:02:36.044022 dv-cinder-852009-8-iscsi devstack@n-api.service[120741]: DEBUG oslo_concurrency.lockutils [req-75744f6c-2e89-4c13-90de-c1a854b4bfb0 req-52e238d9-88b4-406d-95c4-dcfcea930426 service nova] Acquiring lock "1daf4f4c-0e4a-4779-b53a-78c48397ea2f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120741) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 18:02:36.045935 dv-cinder-852009-8-iscsi devstack@n-api.service[120741]: DEBUG oslo_concurrency.lockutils [req-75744f6c-2e89-4c13-90de-c1a854b4bfb0 req-52e238d9-88b4-406d-95c4-dcfcea930426 service nova] Lock "1daf4f4c-0e4a-4779-b53a-78c48397ea2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120741) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 18:02:36.047697 dv-cinder-852009-8-iscsi devstack@n-api.service[120741]: DEBUG oslo_concurrency.lockutils [req-75744f6c-2e89-4c13-90de-c1a854b4bfb0 req-52e238d9-88b4-406d-95c4-dcfcea930426 service nova] Lock "1daf4f4c-0e4a-4779-b53a-78c48397ea2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120741) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 18:02:36.051934 dv-cinder-852009-8-iscsi devstack@n-api.service[120740]: DEBUG nova.policy [None req-833fc81a-5917-4b14-9a19-b836101d4421 tempest-AttachVolumeShelveTestJSON-385853788 tempest-AttachVolumeShelveTestJSON-385853788-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'e68ecd9b3ca643539b109f75bb242d6f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '75e14fd88bfb4cd896fa7b070a0fac47', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120740) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 18:02:36.053849 dv-cinder-852009-8-iscsi devstack@n-api.service[120740]: DEBUG nova.policy [None req-833fc81a-5917-4b14-9a19-b836101d4421 tempest-AttachVolumeShelveTestJSON-385853788 tempest-AttachVolumeShelveTestJSON-385853788-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'e68ecd9b3ca643539b109f75bb242d6f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '75e14fd88bfb4cd896fa7b070a0fac47', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120740) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 18:02:36.056466 dv-cinder-852009-8-iscsi devstack@n-api.service[120740]: INFO nova.api.openstack.requestlog [None req-833fc81a-5917-4b14-9a19-b836101d4421 tempest-AttachVolumeShelveTestJSON-385853788 tempest-AttachVolumeShelveTestJSON-385853788-project] 10.222.0.43 "GET /compute/v2.1/servers/11d2616a-96f9-4a7a-aab8-219219986a8b" status: 200 len: 1405 microversion: 2.20 time: 0.259280 Sep 13 18:02:36.072112 dv-cinder-852009-8-iscsi devstack@n-api.service[120741]: INFO nova.api.openstack.compute.server_external_events [req-75744f6c-2e89-4c13-90de-c1a854b4bfb0 req-52e238d9-88b4-406d-95c4-dcfcea930426 service nova] Creating event network-vif-plugged:db9bff9b-84fc-4a92-8b2a-72aa37a0556d for instance 207d1d8d-58a4-4b99-aa09-1c5023c60784 on hv-cinder-85200 Sep 13 18:02:36.073147 dv-cinder-852009-8-iscsi devstack@n-api.service[120740]: [pid: 120740|app: 0|req: 55/103] 10.222.0.43 () {60 vars in 1277 bytes} [Tue Sep 13 18:02:35 2022] GET /compute/v2.1/servers/11d2616a-96f9-4a7a-aab8-219219986a8b => generated 1405 bytes in 277 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 13 18:02:36.085429 dv-cinder-852009-8-iscsi devstack@n-api.service[120741]: INFO nova.api.openstack.requestlog [req-75744f6c-2e89-4c13-90de-c1a854b4bfb0 req-52e238d9-88b4-406d-95c4-dcfcea930426 service nova] 10.222.0.43 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.059396 Sep 13 18:02:36.091752 dv-cinder-852009-8-iscsi devstack@n-api.service[120741]: [pid: 120741|app: 0|req: 49/104] 10.222.0.43 () {64 vars in 1317 bytes} [Tue Sep 13 18:02:36 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 65 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 13 18:02:36.202165 dv-cinder-852009-8-iscsi devstack@n-api.service[120740]: DEBUG nova.api.openstack.wsgi [None req-6c49d1ba-18d3-4f42-9f22-c5661ee15c26 tempest-ServerRescueNegativeTestJSON-412251590 tempest-ServerRescueNegativeTestJSON-412251590-project] Calling method '>' {{(pid=120740) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 18:02:36.203231 dv-cinder-852009-8-iscsi devstack@n-api.service[120740]: DEBUG nova.compute.api [None req-6c49d1ba-18d3-4f42-9f22-c5661ee15c26 tempest-ServerRescueNegativeTestJSON-412251590 tempest-ServerRescueNegativeTestJSON-412251590-project] [instance: 8cd29851-35c1-4032-a137-ab9419a2ec5b] Fetching instance by UUID {{(pid=120740) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 18:02:36.206841 dv-cinder-852009-8-iscsi devstack@n-api.service[120741]: DEBUG nova.api.openstack.wsgi [None req-8420511f-f5b9-470d-a628-dfe19814f2f5 tempest-AttachVolumeTestJSON-555093534 tempest-AttachVolumeTestJSON-555093534-project] Calling method '>' {{(pid=120741) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 18:02:36.207540 dv-cinder-852009-8-iscsi devstack@n-api.service[120741]: DEBUG nova.compute.api [None req-8420511f-f5b9-470d-a628-dfe19814f2f5 tempest-AttachVolumeTestJSON-555093534 tempest-AttachVolumeTestJSON-555093534-project] [instance: b958d409-df20-44c6-aa0e-58cb0a482edf] Fetching instance by UUID {{(pid=120741) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 18:02:36.218383 dv-cinder-852009-8-iscsi devstack@n-api.service[120741]: DEBUG oslo_concurrency.lockutils [None req-8420511f-f5b9-470d-a628-dfe19814f2f5 tempest-AttachVolumeTestJSON-555093534 tempest-AttachVolumeTestJSON-555093534-project] Acquiring lock "1daf4f4c-0e4a-4779-b53a-78c48397ea2f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120741) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 18:02:36.218893 dv-cinder-852009-8-iscsi devstack@n-api.service[120741]: DEBUG oslo_concurrency.lockutils [None req-8420511f-f5b9-470d-a628-dfe19814f2f5 tempest-AttachVolumeTestJSON-555093534 tempest-AttachVolumeTestJSON-555093534-project] Lock "1daf4f4c-0e4a-4779-b53a-78c48397ea2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=120741) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 18:02:36.219809 dv-cinder-852009-8-iscsi devstack@n-api.service[120741]: DEBUG oslo_concurrency.lockutils [None req-8420511f-f5b9-470d-a628-dfe19814f2f5 tempest-AttachVolumeTestJSON-555093534 tempest-AttachVolumeTestJSON-555093534-project] Lock "1daf4f4c-0e4a-4779-b53a-78c48397ea2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120741) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 18:02:36.220642 dv-cinder-852009-8-iscsi devstack@n-api.service[120740]: DEBUG oslo_concurrency.lockutils [None req-6c49d1ba-18d3-4f42-9f22-c5661ee15c26 tempest-ServerRescueNegativeTestJSON-412251590 tempest-ServerRescueNegativeTestJSON-412251590-project] Acquiring lock "1daf4f4c-0e4a-4779-b53a-78c48397ea2f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120740) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 18:02:36.221086 dv-cinder-852009-8-iscsi devstack@n-api.service[120741]: DEBUG oslo_concurrency.lockutils [None req-8420511f-f5b9-470d-a628-dfe19814f2f5 tempest-AttachVolumeTestJSON-555093534 tempest-AttachVolumeTestJSON-555093534-project] Acquiring lock "1daf4f4c-0e4a-4779-b53a-78c48397ea2f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120741) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 18:02:36.221547 dv-cinder-852009-8-iscsi devstack@n-api.service[120741]: DEBUG oslo_concurrency.lockutils [None req-8420511f-f5b9-470d-a628-dfe19814f2f5 tempest-AttachVolumeTestJSON-555093534 tempest-AttachVolumeTestJSON-555093534-project] Lock "1daf4f4c-0e4a-4779-b53a-78c48397ea2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120741) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 18:02:36.221793 dv-cinder-852009-8-iscsi devstack@n-api.service[120740]: DEBUG oslo_concurrency.lockutils [None req-6c49d1ba-18d3-4f42-9f22-c5661ee15c26 tempest-ServerRescueNegativeTestJSON-412251590 tempest-ServerRescueNegativeTestJSON-412251590-project] Lock "1daf4f4c-0e4a-4779-b53a-78c48397ea2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120740) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 18:02:36.222493 dv-cinder-852009-8-iscsi devstack@n-api.service[120740]: DEBUG oslo_concurrency.lockutils [None req-6c49d1ba-18d3-4f42-9f22-c5661ee15c26 tempest-ServerRescueNegativeTestJSON-412251590 tempest-ServerRescueNegativeTestJSON-412251590-project] Lock "1daf4f4c-0e4a-4779-b53a-78c48397ea2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120740) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 18:02:36.222776 dv-cinder-852009-8-iscsi devstack@n-api.service[120741]: DEBUG oslo_concurrency.lockutils [None req-8420511f-f5b9-470d-a628-dfe19814f2f5 tempest-AttachVolumeTestJSON-555093534 tempest-AttachVolumeTestJSON-555093534-project] Lock "1daf4f4c-0e4a-4779-b53a-78c48397ea2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120741) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 18:02:36.223765 dv-cinder-852009-8-iscsi devstack@n-api.service[120740]: DEBUG oslo_concurrency.lockutils [None req-6c49d1ba-18d3-4f42-9f22-c5661ee15c26 tempest-ServerRescueNegativeTestJSON-412251590 tempest-ServerRescueNegativeTestJSON-412251590-project] Acquiring lock "1daf4f4c-0e4a-4779-b53a-78c48397ea2f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120740) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 18:02:36.224590 dv-cinder-852009-8-iscsi devstack@n-api.service[120740]: DEBUG oslo_concurrency.lockutils [None req-6c49d1ba-18d3-4f42-9f22-c5661ee15c26 tempest-ServerRescueNegativeTestJSON-412251590 tempest-ServerRescueNegativeTestJSON-412251590-project] Lock "1daf4f4c-0e4a-4779-b53a-78c48397ea2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120740) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 18:02:36.225290 dv-cinder-852009-8-iscsi devstack@n-api.service[120740]: DEBUG oslo_concurrency.lockutils [None req-6c49d1ba-18d3-4f42-9f22-c5661ee15c26 tempest-ServerRescueNegativeTestJSON-412251590 tempest-ServerRescueNegativeTestJSON-412251590-project] Lock "1daf4f4c-0e4a-4779-b53a-78c48397ea2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120740) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 18:02:36.459340 dv-cinder-852009-8-iscsi devstack@n-api.service[120740]: DEBUG nova.policy [None req-6c49d1ba-18d3-4f42-9f22-c5661ee15c26 tempest-ServerRescueNegativeTestJSON-412251590 tempest-ServerRescueNegativeTestJSON-412251590-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '60800cf2774e409d9c1b6f4992669991', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2eae4acecf6c4961830ead78d71b2ad3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120740) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 18:02:36.462083 dv-cinder-852009-8-iscsi devstack@n-api.service[120741]: DEBUG nova.policy [None req-8420511f-f5b9-470d-a628-dfe19814f2f5 tempest-AttachVolumeTestJSON-555093534 tempest-AttachVolumeTestJSON-555093534-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0625b3113ce044bbac4f6142eaade11c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a279fcbf274c4704a31a2b95061e1469', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120741) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 18:02:36.476709 dv-cinder-852009-8-iscsi devstack@n-api.service[120741]: INFO nova.api.openstack.requestlog [None req-8420511f-f5b9-470d-a628-dfe19814f2f5 tempest-AttachVolumeTestJSON-555093534 tempest-AttachVolumeTestJSON-555093534-project] 10.222.0.43 "GET /compute/v2.1/servers/b958d409-df20-44c6-aa0e-58cb0a482edf" status: 200 len: 1362 microversion: 2.1 time: 0.276755 Sep 13 18:02:36.477307 dv-cinder-852009-8-iscsi devstack@n-api.service[120741]: [pid: 120741|app: 0|req: 50/105] 10.222.0.43 () {58 vars in 1236 bytes} [Tue Sep 13 18:02:36 2022] GET /compute/v2.1/servers/b958d409-df20-44c6-aa0e-58cb0a482edf => generated 1362 bytes in 278 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 13 18:02:36.501221 dv-cinder-852009-8-iscsi devstack@n-api.service[120740]: INFO nova.api.openstack.requestlog [None req-6c49d1ba-18d3-4f42-9f22-c5661ee15c26 tempest-ServerRescueNegativeTestJSON-412251590 tempest-ServerRescueNegativeTestJSON-412251590-project] 10.222.0.43 "GET /compute/v2.1/servers/8cd29851-35c1-4032-a137-ab9419a2ec5b" status: 200 len: 1322 microversion: 2.1 time: 0.304656 Sep 13 18:02:36.515049 dv-cinder-852009-8-iscsi devstack@n-api.service[120740]: [pid: 120740|app: 0|req: 56/106] 10.222.0.43 () {58 vars in 1236 bytes} [Tue Sep 13 18:02:36 2022] GET /compute/v2.1/servers/8cd29851-35c1-4032-a137-ab9419a2ec5b => generated 1322 bytes in 318 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 13 18:02:37.049015 dv-cinder-852009-8-iscsi devstack@n-api.service[120741]: DEBUG nova.api.openstack.wsgi [None req-5a45e1a7-b1ca-4c2b-90aa-000178d8ee45 tempest-DeleteServersTestJSON-1632919649 tempest-DeleteServersTestJSON-1632919649-project] Calling method '>' {{(pid=120741) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 18:02:37.049638 dv-cinder-852009-8-iscsi devstack@n-api.service[120741]: DEBUG nova.compute.api [None req-5a45e1a7-b1ca-4c2b-90aa-000178d8ee45 tempest-DeleteServersTestJSON-1632919649 tempest-DeleteServersTestJSON-1632919649-project] [instance: 207d1d8d-58a4-4b99-aa09-1c5023c60784] Fetching instance by UUID {{(pid=120741) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 18:02:37.056196 dv-cinder-852009-8-iscsi devstack@n-api.service[120741]: DEBUG oslo_concurrency.lockutils [None req-5a45e1a7-b1ca-4c2b-90aa-000178d8ee45 tempest-DeleteServersTestJSON-1632919649 tempest-DeleteServersTestJSON-1632919649-project] Acquiring lock "1daf4f4c-0e4a-4779-b53a-78c48397ea2f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120741) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 18:02:37.056630 dv-cinder-852009-8-iscsi devstack@n-api.service[120741]: DEBUG oslo_concurrency.lockutils [None req-5a45e1a7-b1ca-4c2b-90aa-000178d8ee45 tempest-DeleteServersTestJSON-1632919649 tempest-DeleteServersTestJSON-1632919649-project] Lock "1daf4f4c-0e4a-4779-b53a-78c48397ea2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120741) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 18:02:37.057072 dv-cinder-852009-8-iscsi devstack@n-api.service[120741]: DEBUG oslo_concurrency.lockutils [None req-5a45e1a7-b1ca-4c2b-90aa-000178d8ee45 tempest-DeleteServersTestJSON-1632919649 tempest-DeleteServersTestJSON-1632919649-project] Lock "1daf4f4c-0e4a-4779-b53a-78c48397ea2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120741) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 18:02:37.057736 dv-cinder-852009-8-iscsi devstack@n-api.service[120741]: DEBUG oslo_concurrency.lockutils [None req-5a45e1a7-b1ca-4c2b-90aa-000178d8ee45 tempest-DeleteServersTestJSON-1632919649 tempest-DeleteServersTestJSON-1632919649-project] Acquiring lock "1daf4f4c-0e4a-4779-b53a-78c48397ea2f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120741) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 18:02:37.058190 dv-cinder-852009-8-iscsi devstack@n-api.service[120741]: DEBUG oslo_concurrency.lockutils [None req-5a45e1a7-b1ca-4c2b-90aa-000178d8ee45 tempest-DeleteServersTestJSON-1632919649 tempest-DeleteServersTestJSON-1632919649-project] Lock "1daf4f4c-0e4a-4779-b53a-78c48397ea2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120741) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 18:02:37.058653 dv-cinder-852009-8-iscsi devstack@n-api.service[120741]: DEBUG oslo_concurrency.lockutils [None req-5a45e1a7-b1ca-4c2b-90aa-000178d8ee45 tempest-DeleteServersTestJSON-1632919649 tempest-DeleteServersTestJSON-1632919649-project] Lock "1daf4f4c-0e4a-4779-b53a-78c48397ea2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120741) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 18:02:37.083792 dv-cinder-852009-8-iscsi devstack@n-api.service[120740]: DEBUG nova.api.openstack.wsgi [None req-1720533a-4293-4d42-a84d-d37b931da00f tempest-AttachVolumeShelveTestJSON-385853788 tempest-AttachVolumeShelveTestJSON-385853788-project] Calling method '>' {{(pid=120740) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 18:02:37.084513 dv-cinder-852009-8-iscsi devstack@n-api.service[120740]: DEBUG nova.compute.api [None req-1720533a-4293-4d42-a84d-d37b931da00f tempest-AttachVolumeShelveTestJSON-385853788 tempest-AttachVolumeShelveTestJSON-385853788-project] [instance: 11d2616a-96f9-4a7a-aab8-219219986a8b] Fetching instance by UUID {{(pid=120740) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 18:02:37.103007 dv-cinder-852009-8-iscsi devstack@n-api.service[120740]: DEBUG oslo_concurrency.lockutils [None req-1720533a-4293-4d42-a84d-d37b931da00f tempest-AttachVolumeShelveTestJSON-385853788 tempest-AttachVolumeShelveTestJSON-385853788-project] Acquiring lock "1daf4f4c-0e4a-4779-b53a-78c48397ea2f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120740) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 18:02:37.103540 dv-cinder-852009-8-iscsi devstack@n-api.service[120740]: DEBUG oslo_concurrency.lockutils [None req-1720533a-4293-4d42-a84d-d37b931da00f tempest-AttachVolumeShelveTestJSON-385853788 tempest-AttachVolumeShelveTestJSON-385853788-project] Lock "1daf4f4c-0e4a-4779-b53a-78c48397ea2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120740) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 18:02:37.103873 dv-cinder-852009-8-iscsi devstack@n-api.service[120740]: DEBUG oslo_concurrency.lockutils [None req-1720533a-4293-4d42-a84d-d37b931da00f tempest-AttachVolumeShelveTestJSON-385853788 tempest-AttachVolumeShelveTestJSON-385853788-project] Lock "1daf4f4c-0e4a-4779-b53a-78c48397ea2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120740) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 18:02:37.104592 dv-cinder-852009-8-iscsi devstack@n-api.service[120740]: DEBUG oslo_concurrency.lockutils [None req-1720533a-4293-4d42-a84d-d37b931da00f tempest-AttachVolumeShelveTestJSON-385853788 tempest-AttachVolumeShelveTestJSON-385853788-project] Acquiring lock "1daf4f4c-0e4a-4779-b53a-78c48397ea2f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120740) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 18:02:37.105046 dv-cinder-852009-8-iscsi devstack@n-api.service[120740]: DEBUG oslo_concurrency.lockutils [None req-1720533a-4293-4d42-a84d-d37b931da00f tempest-AttachVolumeShelveTestJSON-385853788 tempest-AttachVolumeShelveTestJSON-385853788-project] Lock "1daf4f4c-0e4a-4779-b53a-78c48397ea2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120740) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 18:02:37.105466 dv-cinder-852009-8-iscsi devstack@n-api.service[120740]: DEBUG oslo_concurrency.lockutils [None req-1720533a-4293-4d42-a84d-d37b931da00f tempest-AttachVolumeShelveTestJSON-385853788 tempest-AttachVolumeShelveTestJSON-385853788-project] Lock "1daf4f4c-0e4a-4779-b53a-78c48397ea2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120740) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 18:02:37.134746 dv-cinder-852009-8-iscsi devstack@n-api.service[120740]: DEBUG dbcounter [-] [120740] Writing DB stats nova_cell1:SELECT=100 {{(pid=120740) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 18:02:37.270228 dv-cinder-852009-8-iscsi devstack@n-api.service[120741]: DEBUG nova.policy [None req-5a45e1a7-b1ca-4c2b-90aa-000178d8ee45 tempest-DeleteServersTestJSON-1632919649 tempest-DeleteServersTestJSON-1632919649-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '51db5ef052144879b53979268ac4ceb5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '66136f123f5b4ad0a824920bbdf9d245', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120741) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 18:02:37.281600 dv-cinder-852009-8-iscsi devstack@n-api.service[120741]: INFO nova.api.openstack.requestlog [None req-5a45e1a7-b1ca-4c2b-90aa-000178d8ee45 tempest-DeleteServersTestJSON-1632919649 tempest-DeleteServersTestJSON-1632919649-project] 10.222.0.43 "GET /compute/v2.1/servers/207d1d8d-58a4-4b99-aa09-1c5023c60784" status: 200 len: 1315 microversion: 2.1 time: 0.233916 Sep 13 18:02:37.283992 dv-cinder-852009-8-iscsi devstack@n-api.service[120741]: [pid: 120741|app: 0|req: 51/107] 10.222.0.43 () {58 vars in 1236 bytes} [Tue Sep 13 18:02:37 2022] GET /compute/v2.1/servers/207d1d8d-58a4-4b99-aa09-1c5023c60784 => generated 1315 bytes in 240 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 13 18:02:37.312547 dv-cinder-852009-8-iscsi devstack@n-api.service[120740]: DEBUG nova.policy [None req-1720533a-4293-4d42-a84d-d37b931da00f tempest-AttachVolumeShelveTestJSON-385853788 tempest-AttachVolumeShelveTestJSON-385853788-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e68ecd9b3ca643539b109f75bb242d6f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '75e14fd88bfb4cd896fa7b070a0fac47', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120740) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 18:02:37.321518 dv-cinder-852009-8-iscsi devstack@n-api.service[120740]: DEBUG nova.policy [None req-1720533a-4293-4d42-a84d-d37b931da00f tempest-AttachVolumeShelveTestJSON-385853788 tempest-AttachVolumeShelveTestJSON-385853788-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'e68ecd9b3ca643539b109f75bb242d6f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '75e14fd88bfb4cd896fa7b070a0fac47', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120740) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 18:02:37.322961 dv-cinder-852009-8-iscsi devstack@n-api.service[120740]: DEBUG nova.policy [None req-1720533a-4293-4d42-a84d-d37b931da00f tempest-AttachVolumeShelveTestJSON-385853788 tempest-AttachVolumeShelveTestJSON-385853788-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'e68ecd9b3ca643539b109f75bb242d6f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '75e14fd88bfb4cd896fa7b070a0fac47', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120740) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 18:02:37.324321 dv-cinder-852009-8-iscsi devstack@n-api.service[120740]: INFO nova.api.openstack.requestlog [None req-1720533a-4293-4d42-a84d-d37b931da00f tempest-AttachVolumeShelveTestJSON-385853788 tempest-AttachVolumeShelveTestJSON-385853788-project] 10.222.0.43 "GET /compute/v2.1/servers/11d2616a-96f9-4a7a-aab8-219219986a8b" status: 200 len: 1598 microversion: 2.20 time: 0.244975 Sep 13 18:02:37.324918 dv-cinder-852009-8-iscsi devstack@n-api.service[120740]: [pid: 120740|app: 0|req: 57/108] 10.222.0.43 () {60 vars in 1277 bytes} [Tue Sep 13 18:02:37 2022] GET /compute/v2.1/servers/11d2616a-96f9-4a7a-aab8-219219986a8b => generated 1598 bytes in 246 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 13 18:02:37.350009 dv-cinder-852009-8-iscsi devstack@n-api.service[120741]: DEBUG nova.api.openstack.wsgi [None req-096dcf7a-62b8-4f33-9175-223fa2b8f330 tempest-AttachVolumeShelveTestJSON-385853788 tempest-AttachVolumeShelveTestJSON-385853788-project] Calling method '>' {{(pid=120741) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 18:02:37.350781 dv-cinder-852009-8-iscsi devstack@n-api.service[120741]: DEBUG nova.compute.api [None req-096dcf7a-62b8-4f33-9175-223fa2b8f330 tempest-AttachVolumeShelveTestJSON-385853788 tempest-AttachVolumeShelveTestJSON-385853788-project] [instance: 11d2616a-96f9-4a7a-aab8-219219986a8b] Fetching instance by UUID {{(pid=120741) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 18:02:37.363811 dv-cinder-852009-8-iscsi devstack@n-api.service[120741]: DEBUG oslo_concurrency.lockutils [None req-096dcf7a-62b8-4f33-9175-223fa2b8f330 tempest-AttachVolumeShelveTestJSON-385853788 tempest-AttachVolumeShelveTestJSON-385853788-project] Acquiring lock "1daf4f4c-0e4a-4779-b53a-78c48397ea2f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120741) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 18:02:37.364304 dv-cinder-852009-8-iscsi devstack@n-api.service[120741]: DEBUG oslo_concurrency.lockutils [None req-096dcf7a-62b8-4f33-9175-223fa2b8f330 tempest-AttachVolumeShelveTestJSON-385853788 tempest-AttachVolumeShelveTestJSON-385853788-project] Lock "1daf4f4c-0e4a-4779-b53a-78c48397ea2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120741) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 18:02:37.364749 dv-cinder-852009-8-iscsi devstack@n-api.service[120741]: DEBUG oslo_concurrency.lockutils [None req-096dcf7a-62b8-4f33-9175-223fa2b8f330 tempest-AttachVolumeShelveTestJSON-385853788 tempest-AttachVolumeShelveTestJSON-385853788-project] Lock "1daf4f4c-0e4a-4779-b53a-78c48397ea2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120741) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 18:02:37.365573 dv-cinder-852009-8-iscsi devstack@n-api.service[120741]: DEBUG oslo_concurrency.lockutils [None req-096dcf7a-62b8-4f33-9175-223fa2b8f330 tempest-AttachVolumeShelveTestJSON-385853788 tempest-AttachVolumeShelveTestJSON-385853788-project] Acquiring lock "1daf4f4c-0e4a-4779-b53a-78c48397ea2f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120741) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 18:02:37.366012 dv-cinder-852009-8-iscsi devstack@n-api.service[120741]: DEBUG oslo_concurrency.lockutils [None req-096dcf7a-62b8-4f33-9175-223fa2b8f330 tempest-AttachVolumeShelveTestJSON-385853788 tempest-AttachVolumeShelveTestJSON-385853788-project] Lock "1daf4f4c-0e4a-4779-b53a-78c48397ea2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120741) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 18:02:37.366422 dv-cinder-852009-8-iscsi devstack@n-api.service[120741]: DEBUG oslo_concurrency.lockutils [None req-096dcf7a-62b8-4f33-9175-223fa2b8f330 tempest-AttachVolumeShelveTestJSON-385853788 tempest-AttachVolumeShelveTestJSON-385853788-project] Lock "1daf4f4c-0e4a-4779-b53a-78c48397ea2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120741) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 18:02:37.488500 dv-cinder-852009-8-iscsi devstack@n-api.service[120741]: INFO nova.api.openstack.requestlog [None req-096dcf7a-62b8-4f33-9175-223fa2b8f330 tempest-AttachVolumeShelveTestJSON-385853788 tempest-AttachVolumeShelveTestJSON-385853788-project] 10.222.0.43 "GET /compute/v2.1/servers/11d2616a-96f9-4a7a-aab8-219219986a8b/os-interface" status: 200 len: 285 microversion: 2.20 time: 0.142416 Sep 13 18:02:37.489142 dv-cinder-852009-8-iscsi devstack@n-api.service[120741]: [pid: 120741|app: 0|req: 52/109] 10.222.0.43 () {60 vars in 1316 bytes} [Tue Sep 13 18:02:37 2022] GET /compute/v2.1/servers/11d2616a-96f9-4a7a-aab8-219219986a8b/os-interface => generated 285 bytes in 144 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Sep 13 18:02:37.523741 dv-cinder-852009-8-iscsi devstack@n-api.service[120740]: DEBUG nova.api.openstack.wsgi [None req-35b1e3f6-cc7b-413d-9b24-64cc62bfe2a1 tempest-AttachVolumeTestJSON-555093534 tempest-AttachVolumeTestJSON-555093534-project] Calling method '>' {{(pid=120740) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 18:02:37.523960 dv-cinder-852009-8-iscsi devstack@n-api.service[120741]: DEBUG nova.api.openstack.wsgi [None req-5a73911a-ee5c-4672-ac90-2c862e3050fc tempest-ServerRescueNegativeTestJSON-412251590 tempest-ServerRescueNegativeTestJSON-412251590-project] Calling method '>' {{(pid=120741) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 18:02:37.524732 dv-cinder-852009-8-iscsi devstack@n-api.service[120741]: DEBUG nova.compute.api [None req-5a73911a-ee5c-4672-ac90-2c862e3050fc tempest-ServerRescueNegativeTestJSON-412251590 tempest-ServerRescueNegativeTestJSON-412251590-project] [instance: 8cd29851-35c1-4032-a137-ab9419a2ec5b] Fetching instance by UUID {{(pid=120741) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 18:02:37.524849 dv-cinder-852009-8-iscsi devstack@n-api.service[120740]: DEBUG nova.compute.api [None req-35b1e3f6-cc7b-413d-9b24-64cc62bfe2a1 tempest-AttachVolumeTestJSON-555093534 tempest-AttachVolumeTestJSON-555093534-project] [instance: b958d409-df20-44c6-aa0e-58cb0a482edf] Fetching instance by UUID {{(pid=120740) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 18:02:37.532891 dv-cinder-852009-8-iscsi devstack@n-api.service[120740]: DEBUG oslo_concurrency.lockutils [None req-35b1e3f6-cc7b-413d-9b24-64cc62bfe2a1 tempest-AttachVolumeTestJSON-555093534 tempest-AttachVolumeTestJSON-555093534-project] Acquiring lock "1daf4f4c-0e4a-4779-b53a-78c48397ea2f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120740) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 18:02:37.534108 dv-cinder-852009-8-iscsi devstack@n-api.service[120740]: DEBUG oslo_concurrency.lockutils [None req-35b1e3f6-cc7b-413d-9b24-64cc62bfe2a1 tempest-AttachVolumeTestJSON-555093534 tempest-AttachVolumeTestJSON-555093534-project] Lock "1daf4f4c-0e4a-4779-b53a-78c48397ea2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120740) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 18:02:37.534708 dv-cinder-852009-8-iscsi devstack@n-api.service[120740]: DEBUG oslo_concurrency.lockutils [None req-35b1e3f6-cc7b-413d-9b24-64cc62bfe2a1 tempest-AttachVolumeTestJSON-555093534 tempest-AttachVolumeTestJSON-555093534-project] Lock "1daf4f4c-0e4a-4779-b53a-78c48397ea2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120740) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 18:02:37.535607 dv-cinder-852009-8-iscsi devstack@n-api.service[120740]: DEBUG oslo_concurrency.lockutils [None req-35b1e3f6-cc7b-413d-9b24-64cc62bfe2a1 tempest-AttachVolumeTestJSON-555093534 tempest-AttachVolumeTestJSON-555093534-project] Acquiring lock "1daf4f4c-0e4a-4779-b53a-78c48397ea2f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120740) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 18:02:37.536205 dv-cinder-852009-8-iscsi devstack@n-api.service[120740]: DEBUG oslo_concurrency.lockutils [None req-35b1e3f6-cc7b-413d-9b24-64cc62bfe2a1 tempest-AttachVolumeTestJSON-555093534 tempest-AttachVolumeTestJSON-555093534-project] Lock "1daf4f4c-0e4a-4779-b53a-78c48397ea2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120740) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 18:02:37.536801 dv-cinder-852009-8-iscsi devstack@n-api.service[120740]: DEBUG oslo_concurrency.lockutils [None req-35b1e3f6-cc7b-413d-9b24-64cc62bfe2a1 tempest-AttachVolumeTestJSON-555093534 tempest-AttachVolumeTestJSON-555093534-project] Lock "1daf4f4c-0e4a-4779-b53a-78c48397ea2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120740) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 18:02:37.548597 dv-cinder-852009-8-iscsi devstack@n-api.service[120741]: DEBUG oslo_concurrency.lockutils [None req-5a73911a-ee5c-4672-ac90-2c862e3050fc tempest-ServerRescueNegativeTestJSON-412251590 tempest-ServerRescueNegativeTestJSON-412251590-project] Acquiring lock "1daf4f4c-0e4a-4779-b53a-78c48397ea2f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120741) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 18:02:37.549423 dv-cinder-852009-8-iscsi devstack@n-api.service[120741]: DEBUG oslo_concurrency.lockutils [None req-5a73911a-ee5c-4672-ac90-2c862e3050fc tempest-ServerRescueNegativeTestJSON-412251590 tempest-ServerRescueNegativeTestJSON-412251590-project] Lock "1daf4f4c-0e4a-4779-b53a-78c48397ea2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120741) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 18:02:37.552146 dv-cinder-852009-8-iscsi devstack@n-api.service[120741]: DEBUG oslo_concurrency.lockutils [None req-5a73911a-ee5c-4672-ac90-2c862e3050fc tempest-ServerRescueNegativeTestJSON-412251590 tempest-ServerRescueNegativeTestJSON-412251590-project] Lock "1daf4f4c-0e4a-4779-b53a-78c48397ea2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120741) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 18:02:37.553316 dv-cinder-852009-8-iscsi devstack@n-api.service[120741]: DEBUG oslo_concurrency.lockutils [None req-5a73911a-ee5c-4672-ac90-2c862e3050fc tempest-ServerRescueNegativeTestJSON-412251590 tempest-ServerRescueNegativeTestJSON-412251590-project] Acquiring lock "1daf4f4c-0e4a-4779-b53a-78c48397ea2f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120741) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 18:02:37.558849 dv-cinder-852009-8-iscsi devstack@n-api.service[120741]: DEBUG oslo_concurrency.lockutils [None req-5a73911a-ee5c-4672-ac90-2c862e3050fc tempest-ServerRescueNegativeTestJSON-412251590 tempest-ServerRescueNegativeTestJSON-412251590-project] Lock "1daf4f4c-0e4a-4779-b53a-78c48397ea2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120741) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 18:02:37.559554 dv-cinder-852009-8-iscsi devstack@n-api.service[120741]: DEBUG oslo_concurrency.lockutils [None req-5a73911a-ee5c-4672-ac90-2c862e3050fc tempest-ServerRescueNegativeTestJSON-412251590 tempest-ServerRescueNegativeTestJSON-412251590-project] Lock "1daf4f4c-0e4a-4779-b53a-78c48397ea2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=120741) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 18:02:37.800493 dv-cinder-852009-8-iscsi devstack@n-api.service[120740]: DEBUG nova.policy [None req-35b1e3f6-cc7b-413d-9b24-64cc62bfe2a1 tempest-AttachVolumeTestJSON-555093534 tempest-AttachVolumeTestJSON-555093534-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0625b3113ce044bbac4f6142eaade11c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a279fcbf274c4704a31a2b95061e1469', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120740) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 18:02:37.809391 dv-cinder-852009-8-iscsi devstack@n-api.service[120740]: INFO nova.api.openstack.requestlog [None req-35b1e3f6-cc7b-413d-9b24-64cc62bfe2a1 tempest-AttachVolumeTestJSON-555093534 tempest-AttachVolumeTestJSON-555093534-project] 10.222.0.43 "GET /compute/v2.1/servers/b958d409-df20-44c6-aa0e-58cb0a482edf" status: 200 len: 1362 microversion: 2.1 time: 0.309014 Sep 13 18:02:37.813364 dv-cinder-852009-8-iscsi devstack@n-api.service[120740]: [pid: 120740|app: 0|req: 58/110] 10.222.0.43 () {58 vars in 1236 bytes} [Tue Sep 13 18:02:37 2022] GET /compute/v2.1/servers/b958d409-df20-44c6-aa0e-58cb0a482edf => generated 1362 bytes in 313 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 13 18:02:37.825742 dv-cinder-852009-8-iscsi devstack@n-api.service[120741]: DEBUG nova.policy [None req-5a73911a-ee5c-4672-ac90-2c862e3050fc tempest-ServerRescueNegativeTestJSON-412251590 tempest-ServerRescueNegativeTestJSON-412251590-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '60800cf2774e409d9c1b6f4992669991', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2eae4acecf6c4961830ead78d71b2ad3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120741) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 18:02:37.835697 dv-cinder-852009-8-iscsi devstack@n-api.service[120741]: INFO nova.api.openstack.requestlog [None req-5a73911a-ee5c-4672-ac90-2c862e3050fc tempest-ServerRescueNegativeTestJSON-412251590 tempest-ServerRescueNegativeTestJSON-412251590-project] 10.222.0.43 "GET /compute/v2.1/servers/8cd29851-35c1-4032-a137-ab9419a2ec5b" status: 200 len: 1322 microversion: 2.1 time: 0.316328 Sep 13 18:02:37.836849 dv-cinder-852009-8-iscsi devstack@n-api.service[120741]: [pid: 120741|app: 0|req: 53/111] 10.222.0.43 () {58 vars in 1236 bytes} [Tue Sep 13 18:02:37 2022] GET /compute/v2.1/servers/8cd29851-35c1-4032-a137-ab9419a2ec5b => generated 1322 bytes in 318 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 13 18:02:38.306949 dv-cinder-852009-8-iscsi devstack@n-api.service[120740]: DEBUG nova.api.openstack.wsgi [None req-4c0cc026-8f12-43b3-8140-6fd5d9449d62 tempest-DeleteServersTestJSON-1632919649 tempest-DeleteServersTestJSON-1632919649-project] Calling method '>' {{(pid=120740) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 18:02:38.308147 dv-cinder-852009-8-iscsi devstack@n-api.service[120740]: DEBUG nova.compute.api [None req-4c0cc026-8f12-43b3-8140-6fd5d9449d62 tempest-DeleteServersTestJSON-1632919649 tempest-DeleteServersTestJSON-1632919649-project] [instance: 207d1d8d-58a4-4b99-aa09-1c5023c60784] Fetching instance by UUID {{(pid=120740) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 18:02:38.314661 dv-cinder-852009-8-iscsi devstack@n-api.service[120740]: DEBUG oslo_concurrency.lockutils [None req-4c0cc026-8f12-43b3-8140-6fd5d9449d62 tempest-DeleteServersTestJSON-1632919649 tempest-DeleteServersTestJSON-1632919649-project] Acquiring lock "1daf4f4c-0e4a-4779-b53a-78c48397ea2f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120740) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 18:02:38.315584 dv-cinder-852009-8-iscsi devstack@n-api.service[120740]: DEBUG oslo_concurrency.lockutils [None req-4c0cc026-8f12-43b3-8140-6fd5d9449d62 tempest-DeleteServersTestJSON-1632919649 tempest-DeleteServersTestJSON-1632919649-project] Lock "1daf4f4c-0e4a-4779-b53a-78c48397ea2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120740) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 18:02:38.316168 dv-cinder-852009-8-iscsi devstack@n-api.service[120740]: DEBUG oslo_concurrency.lockutils [None req-4c0cc026-8f12-43b3-8140-6fd5d9449d62 tempest-DeleteServersTestJSON-1632919649 tempest-DeleteServersTestJSON-1632919649-project] Lock "1daf4f4c-0e4a-4779-b53a-78c48397ea2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120740) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 18:02:38.319805 dv-cinder-852009-8-iscsi devstack@n-api.service[120740]: DEBUG oslo_concurrency.lockutils [None req-4c0cc026-8f12-43b3-8140-6fd5d9449d62 tempest-DeleteServersTestJSON-1632919649 tempest-DeleteServersTestJSON-1632919649-project] Acquiring lock "1daf4f4c-0e4a-4779-b53a-78c48397ea2f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120740) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 18:02:38.319805 dv-cinder-852009-8-iscsi devstack@n-api.service[120740]: DEBUG oslo_concurrency.lockutils [None req-4c0cc026-8f12-43b3-8140-6fd5d9449d62 tempest-DeleteServersTestJSON-1632919649 tempest-DeleteServersTestJSON-1632919649-project] Lock "1daf4f4c-0e4a-4779-b53a-78c48397ea2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120740) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 18:02:38.319805 dv-cinder-852009-8-iscsi devstack@n-api.service[120740]: DEBUG oslo_concurrency.lockutils [None req-4c0cc026-8f12-43b3-8140-6fd5d9449d62 tempest-DeleteServersTestJSON-1632919649 tempest-DeleteServersTestJSON-1632919649-project] Lock "1daf4f4c-0e4a-4779-b53a-78c48397ea2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120740) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 18:02:38.477593 dv-cinder-852009-8-iscsi devstack@n-api.service[120740]: DEBUG nova.policy [None req-4c0cc026-8f12-43b3-8140-6fd5d9449d62 tempest-DeleteServersTestJSON-1632919649 tempest-DeleteServersTestJSON-1632919649-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '51db5ef052144879b53979268ac4ceb5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '66136f123f5b4ad0a824920bbdf9d245', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120740) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 18:02:38.488055 dv-cinder-852009-8-iscsi devstack@n-api.service[120740]: INFO nova.api.openstack.requestlog [None req-4c0cc026-8f12-43b3-8140-6fd5d9449d62 tempest-DeleteServersTestJSON-1632919649 tempest-DeleteServersTestJSON-1632919649-project] 10.222.0.43 "GET /compute/v2.1/servers/207d1d8d-58a4-4b99-aa09-1c5023c60784" status: 200 len: 1315 microversion: 2.1 time: 0.186350 Sep 13 18:02:38.489040 dv-cinder-852009-8-iscsi devstack@n-api.service[120740]: [pid: 120740|app: 0|req: 59/112] 10.222.0.43 () {58 vars in 1236 bytes} [Tue Sep 13 18:02:38 2022] GET /compute/v2.1/servers/207d1d8d-58a4-4b99-aa09-1c5023c60784 => generated 1315 bytes in 188 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 13 18:02:38.836030 dv-cinder-852009-8-iscsi devstack@n-api.service[120741]: DEBUG nova.api.openstack.wsgi [None req-49040303-5581-475f-899d-f189ccf0941b tempest-AttachVolumeTestJSON-555093534 tempest-AttachVolumeTestJSON-555093534-project] Calling method '>' {{(pid=120741) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 18:02:38.836629 dv-cinder-852009-8-iscsi devstack@n-api.service[120741]: DEBUG nova.compute.api [None req-49040303-5581-475f-899d-f189ccf0941b tempest-AttachVolumeTestJSON-555093534 tempest-AttachVolumeTestJSON-555093534-project] [instance: b958d409-df20-44c6-aa0e-58cb0a482edf] Fetching instance by UUID {{(pid=120741) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 18:02:38.842663 dv-cinder-852009-8-iscsi devstack@n-api.service[120741]: DEBUG oslo_concurrency.lockutils [None req-49040303-5581-475f-899d-f189ccf0941b tempest-AttachVolumeTestJSON-555093534 tempest-AttachVolumeTestJSON-555093534-project] Acquiring lock "1daf4f4c-0e4a-4779-b53a-78c48397ea2f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120741) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 18:02:38.843166 dv-cinder-852009-8-iscsi devstack@n-api.service[120741]: DEBUG oslo_concurrency.lockutils [None req-49040303-5581-475f-899d-f189ccf0941b tempest-AttachVolumeTestJSON-555093534 tempest-AttachVolumeTestJSON-555093534-project] Lock "1daf4f4c-0e4a-4779-b53a-78c48397ea2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120741) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 18:02:38.843594 dv-cinder-852009-8-iscsi devstack@n-api.service[120741]: DEBUG oslo_concurrency.lockutils [None req-49040303-5581-475f-899d-f189ccf0941b tempest-AttachVolumeTestJSON-555093534 tempest-AttachVolumeTestJSON-555093534-project] Lock "1daf4f4c-0e4a-4779-b53a-78c48397ea2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120741) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 18:02:38.844256 dv-cinder-852009-8-iscsi devstack@n-api.service[120741]: DEBUG oslo_concurrency.lockutils [None req-49040303-5581-475f-899d-f189ccf0941b tempest-AttachVolumeTestJSON-555093534 tempest-AttachVolumeTestJSON-555093534-project] Acquiring lock "1daf4f4c-0e4a-4779-b53a-78c48397ea2f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120741) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 18:02:38.844778 dv-cinder-852009-8-iscsi devstack@n-api.service[120741]: DEBUG oslo_concurrency.lockutils [None req-49040303-5581-475f-899d-f189ccf0941b tempest-AttachVolumeTestJSON-555093534 tempest-AttachVolumeTestJSON-555093534-project] Lock "1daf4f4c-0e4a-4779-b53a-78c48397ea2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120741) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 18:02:38.845208 dv-cinder-852009-8-iscsi devstack@n-api.service[120741]: DEBUG oslo_concurrency.lockutils [None req-49040303-5581-475f-899d-f189ccf0941b tempest-AttachVolumeTestJSON-555093534 tempest-AttachVolumeTestJSON-555093534-project] Lock "1daf4f4c-0e4a-4779-b53a-78c48397ea2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120741) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 18:02:38.859546 dv-cinder-852009-8-iscsi devstack@n-api.service[120740]: DEBUG nova.api.openstack.wsgi [None req-feba8c0b-aead-4c8c-a172-9260747eb5d1 tempest-ServerRescueNegativeTestJSON-412251590 tempest-ServerRescueNegativeTestJSON-412251590-project] Calling method '>' {{(pid=120740) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 18:02:38.860946 dv-cinder-852009-8-iscsi devstack@n-api.service[120740]: DEBUG nova.compute.api [None req-feba8c0b-aead-4c8c-a172-9260747eb5d1 tempest-ServerRescueNegativeTestJSON-412251590 tempest-ServerRescueNegativeTestJSON-412251590-project] [instance: 8cd29851-35c1-4032-a137-ab9419a2ec5b] Fetching instance by UUID {{(pid=120740) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 18:02:38.867785 dv-cinder-852009-8-iscsi devstack@n-api.service[120740]: DEBUG oslo_concurrency.lockutils [None req-feba8c0b-aead-4c8c-a172-9260747eb5d1 tempest-ServerRescueNegativeTestJSON-412251590 tempest-ServerRescueNegativeTestJSON-412251590-project] Acquiring lock "1daf4f4c-0e4a-4779-b53a-78c48397ea2f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120740) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 18:02:38.868345 dv-cinder-852009-8-iscsi devstack@n-api.service[120740]: DEBUG oslo_concurrency.lockutils [None req-feba8c0b-aead-4c8c-a172-9260747eb5d1 tempest-ServerRescueNegativeTestJSON-412251590 tempest-ServerRescueNegativeTestJSON-412251590-project] Lock "1daf4f4c-0e4a-4779-b53a-78c48397ea2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120740) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 18:02:38.868888 dv-cinder-852009-8-iscsi devstack@n-api.service[120740]: DEBUG oslo_concurrency.lockutils [None req-feba8c0b-aead-4c8c-a172-9260747eb5d1 tempest-ServerRescueNegativeTestJSON-412251590 tempest-ServerRescueNegativeTestJSON-412251590-project] Lock "1daf4f4c-0e4a-4779-b53a-78c48397ea2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120740) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 18:02:38.869700 dv-cinder-852009-8-iscsi devstack@n-api.service[120740]: DEBUG oslo_concurrency.lockutils [None req-feba8c0b-aead-4c8c-a172-9260747eb5d1 tempest-ServerRescueNegativeTestJSON-412251590 tempest-ServerRescueNegativeTestJSON-412251590-project] Acquiring lock "1daf4f4c-0e4a-4779-b53a-78c48397ea2f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120740) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 18:02:38.870217 dv-cinder-852009-8-iscsi devstack@n-api.service[120740]: DEBUG oslo_concurrency.lockutils [None req-feba8c0b-aead-4c8c-a172-9260747eb5d1 tempest-ServerRescueNegativeTestJSON-412251590 tempest-ServerRescueNegativeTestJSON-412251590-project] Lock "1daf4f4c-0e4a-4779-b53a-78c48397ea2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120740) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 18:02:38.870696 dv-cinder-852009-8-iscsi devstack@n-api.service[120740]: DEBUG oslo_concurrency.lockutils [None req-feba8c0b-aead-4c8c-a172-9260747eb5d1 tempest-ServerRescueNegativeTestJSON-412251590 tempest-ServerRescueNegativeTestJSON-412251590-project] Lock "1daf4f4c-0e4a-4779-b53a-78c48397ea2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120740) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 18:02:39.052858 dv-cinder-852009-8-iscsi devstack@n-api.service[120741]: DEBUG nova.policy [None req-49040303-5581-475f-899d-f189ccf0941b tempest-AttachVolumeTestJSON-555093534 tempest-AttachVolumeTestJSON-555093534-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0625b3113ce044bbac4f6142eaade11c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a279fcbf274c4704a31a2b95061e1469', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120741) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 18:02:39.059550 dv-cinder-852009-8-iscsi devstack@n-api.service[120740]: DEBUG nova.policy [None req-feba8c0b-aead-4c8c-a172-9260747eb5d1 tempest-ServerRescueNegativeTestJSON-412251590 tempest-ServerRescueNegativeTestJSON-412251590-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '60800cf2774e409d9c1b6f4992669991', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2eae4acecf6c4961830ead78d71b2ad3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120740) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 18:02:39.060480 dv-cinder-852009-8-iscsi devstack@n-api.service[120741]: INFO nova.api.openstack.requestlog [None req-49040303-5581-475f-899d-f189ccf0941b tempest-AttachVolumeTestJSON-555093534 tempest-AttachVolumeTestJSON-555093534-project] 10.222.0.43 "GET /compute/v2.1/servers/b958d409-df20-44c6-aa0e-58cb0a482edf" status: 200 len: 1362 microversion: 2.1 time: 0.228752 Sep 13 18:02:39.061877 dv-cinder-852009-8-iscsi devstack@n-api.service[120741]: [pid: 120741|app: 0|req: 54/113] 10.222.0.43 () {58 vars in 1236 bytes} [Tue Sep 13 18:02:38 2022] GET /compute/v2.1/servers/b958d409-df20-44c6-aa0e-58cb0a482edf => generated 1362 bytes in 231 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 13 18:02:39.066691 dv-cinder-852009-8-iscsi devstack@n-api.service[120741]: DEBUG nova.api.openstack.wsgi [req-72f8d8f0-e9b1-4386-8449-ad7ac3956a41 req-a3f602e1-6fdf-4348-95ce-be8f993ef2c3 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "11d2616a-96f9-4a7a-aab8-219219986a8b", "tag": "85bfb53c-ec3d-49bc-ade7-acdfac253331"}]} {{(pid=120741) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 13 18:02:39.067293 dv-cinder-852009-8-iscsi devstack@n-api.service[120740]: INFO nova.api.openstack.requestlog [None req-feba8c0b-aead-4c8c-a172-9260747eb5d1 tempest-ServerRescueNegativeTestJSON-412251590 tempest-ServerRescueNegativeTestJSON-412251590-project] 10.222.0.43 "GET /compute/v2.1/servers/8cd29851-35c1-4032-a137-ab9419a2ec5b" status: 200 len: 1322 microversion: 2.1 time: 0.211706 Sep 13 18:02:39.067859 dv-cinder-852009-8-iscsi devstack@n-api.service[120740]: [pid: 120740|app: 0|req: 60/114] 10.222.0.43 () {58 vars in 1236 bytes} [Tue Sep 13 18:02:38 2022] GET /compute/v2.1/servers/8cd29851-35c1-4032-a137-ab9419a2ec5b => generated 1322 bytes in 213 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 13 18:02:39.076083 dv-cinder-852009-8-iscsi devstack@n-api.service[120741]: DEBUG oslo_concurrency.lockutils [req-72f8d8f0-e9b1-4386-8449-ad7ac3956a41 req-a3f602e1-6fdf-4348-95ce-be8f993ef2c3 service nova] Acquiring lock "1daf4f4c-0e4a-4779-b53a-78c48397ea2f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120741) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 18:02:39.076832 dv-cinder-852009-8-iscsi devstack@n-api.service[120741]: DEBUG oslo_concurrency.lockutils [req-72f8d8f0-e9b1-4386-8449-ad7ac3956a41 req-a3f602e1-6fdf-4348-95ce-be8f993ef2c3 service nova] Lock "1daf4f4c-0e4a-4779-b53a-78c48397ea2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120741) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 18:02:39.077435 dv-cinder-852009-8-iscsi devstack@n-api.service[120741]: DEBUG oslo_concurrency.lockutils [req-72f8d8f0-e9b1-4386-8449-ad7ac3956a41 req-a3f602e1-6fdf-4348-95ce-be8f993ef2c3 service nova] Lock "1daf4f4c-0e4a-4779-b53a-78c48397ea2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120741) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 18:02:39.088909 dv-cinder-852009-8-iscsi devstack@n-api.service[120741]: INFO nova.api.openstack.compute.server_external_events [req-72f8d8f0-e9b1-4386-8449-ad7ac3956a41 req-a3f602e1-6fdf-4348-95ce-be8f993ef2c3 service nova] Creating event network-changed:85bfb53c-ec3d-49bc-ade7-acdfac253331 for instance 11d2616a-96f9-4a7a-aab8-219219986a8b on hv-cinder-85200 Sep 13 18:02:39.093661 dv-cinder-852009-8-iscsi devstack@n-api.service[120741]: INFO nova.api.openstack.requestlog [req-72f8d8f0-e9b1-4386-8449-ad7ac3956a41 req-a3f602e1-6fdf-4348-95ce-be8f993ef2c3 service nova] 10.222.0.43 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.030402 Sep 13 18:02:39.094257 dv-cinder-852009-8-iscsi devstack@n-api.service[120741]: [pid: 120741|app: 0|req: 55/115] 10.222.0.43 () {64 vars in 1317 bytes} [Tue Sep 13 18:02:39 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 32 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 13 18:02:39.512406 dv-cinder-852009-8-iscsi devstack@n-api.service[120740]: DEBUG nova.api.openstack.wsgi [None req-183f7f3d-4a9d-4775-92da-0cd1993483fb tempest-DeleteServersTestJSON-1632919649 tempest-DeleteServersTestJSON-1632919649-project] Calling method '>' {{(pid=120740) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 18:02:39.513021 dv-cinder-852009-8-iscsi devstack@n-api.service[120740]: DEBUG nova.compute.api [None req-183f7f3d-4a9d-4775-92da-0cd1993483fb tempest-DeleteServersTestJSON-1632919649 tempest-DeleteServersTestJSON-1632919649-project] [instance: 207d1d8d-58a4-4b99-aa09-1c5023c60784] Fetching instance by UUID {{(pid=120740) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 18:02:39.519109 dv-cinder-852009-8-iscsi devstack@n-api.service[120740]: DEBUG oslo_concurrency.lockutils [None req-183f7f3d-4a9d-4775-92da-0cd1993483fb tempest-DeleteServersTestJSON-1632919649 tempest-DeleteServersTestJSON-1632919649-project] Acquiring lock "1daf4f4c-0e4a-4779-b53a-78c48397ea2f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120740) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 18:02:39.519727 dv-cinder-852009-8-iscsi devstack@n-api.service[120740]: DEBUG oslo_concurrency.lockutils [None req-183f7f3d-4a9d-4775-92da-0cd1993483fb tempest-DeleteServersTestJSON-1632919649 tempest-DeleteServersTestJSON-1632919649-project] Lock "1daf4f4c-0e4a-4779-b53a-78c48397ea2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120740) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 18:02:39.520238 dv-cinder-852009-8-iscsi devstack@n-api.service[120740]: DEBUG oslo_concurrency.lockutils [None req-183f7f3d-4a9d-4775-92da-0cd1993483fb tempest-DeleteServersTestJSON-1632919649 tempest-DeleteServersTestJSON-1632919649-project] Lock "1daf4f4c-0e4a-4779-b53a-78c48397ea2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120740) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 18:02:39.521068 dv-cinder-852009-8-iscsi devstack@n-api.service[120740]: DEBUG oslo_concurrency.lockutils [None req-183f7f3d-4a9d-4775-92da-0cd1993483fb tempest-DeleteServersTestJSON-1632919649 tempest-DeleteServersTestJSON-1632919649-project] Acquiring lock "1daf4f4c-0e4a-4779-b53a-78c48397ea2f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120740) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 18:02:39.521552 dv-cinder-852009-8-iscsi devstack@n-api.service[120740]: DEBUG oslo_concurrency.lockutils [None req-183f7f3d-4a9d-4775-92da-0cd1993483fb tempest-DeleteServersTestJSON-1632919649 tempest-DeleteServersTestJSON-1632919649-project] Lock "1daf4f4c-0e4a-4779-b53a-78c48397ea2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120740) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 18:02:39.522078 dv-cinder-852009-8-iscsi devstack@n-api.service[120740]: DEBUG oslo_concurrency.lockutils [None req-183f7f3d-4a9d-4775-92da-0cd1993483fb tempest-DeleteServersTestJSON-1632919649 tempest-DeleteServersTestJSON-1632919649-project] Lock "1daf4f4c-0e4a-4779-b53a-78c48397ea2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120740) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 18:02:39.669184 dv-cinder-852009-8-iscsi devstack@n-api.service[120740]: DEBUG nova.policy [None req-183f7f3d-4a9d-4775-92da-0cd1993483fb tempest-DeleteServersTestJSON-1632919649 tempest-DeleteServersTestJSON-1632919649-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '51db5ef052144879b53979268ac4ceb5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '66136f123f5b4ad0a824920bbdf9d245', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120740) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 18:02:39.678116 dv-cinder-852009-8-iscsi devstack@n-api.service[120740]: INFO nova.api.openstack.requestlog [None req-183f7f3d-4a9d-4775-92da-0cd1993483fb tempest-DeleteServersTestJSON-1632919649 tempest-DeleteServersTestJSON-1632919649-project] 10.222.0.43 "GET /compute/v2.1/servers/207d1d8d-58a4-4b99-aa09-1c5023c60784" status: 200 len: 1315 microversion: 2.1 time: 0.169791 Sep 13 18:02:39.687468 dv-cinder-852009-8-iscsi devstack@n-api.service[120740]: [pid: 120740|app: 0|req: 61/116] 10.222.0.43 () {58 vars in 1236 bytes} [Tue Sep 13 18:02:39 2022] GET /compute/v2.1/servers/207d1d8d-58a4-4b99-aa09-1c5023c60784 => generated 1315 bytes in 180 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 13 18:02:40.084225 dv-cinder-852009-8-iscsi devstack@n-api.service[120741]: DEBUG nova.api.openstack.wsgi [None req-5493af12-7368-49da-99cc-cf9045edfad4 tempest-AttachVolumeTestJSON-555093534 tempest-AttachVolumeTestJSON-555093534-project] Calling method '>' {{(pid=120741) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 18:02:40.086114 dv-cinder-852009-8-iscsi devstack@n-api.service[120741]: DEBUG nova.compute.api [None req-5493af12-7368-49da-99cc-cf9045edfad4 tempest-AttachVolumeTestJSON-555093534 tempest-AttachVolumeTestJSON-555093534-project] [instance: b958d409-df20-44c6-aa0e-58cb0a482edf] Fetching instance by UUID {{(pid=120741) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 18:02:40.093220 dv-cinder-852009-8-iscsi devstack@n-api.service[120740]: DEBUG nova.api.openstack.wsgi [None req-c062daa4-f9ad-4c4c-ae05-89d7874b5bdd tempest-ServerRescueNegativeTestJSON-412251590 tempest-ServerRescueNegativeTestJSON-412251590-project] Calling method '>' {{(pid=120740) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 18:02:40.093572 dv-cinder-852009-8-iscsi devstack@n-api.service[120741]: DEBUG oslo_concurrency.lockutils [None req-5493af12-7368-49da-99cc-cf9045edfad4 tempest-AttachVolumeTestJSON-555093534 tempest-AttachVolumeTestJSON-555093534-project] Acquiring lock "1daf4f4c-0e4a-4779-b53a-78c48397ea2f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120741) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 18:02:40.094104 dv-cinder-852009-8-iscsi devstack@n-api.service[120740]: DEBUG nova.compute.api [None req-c062daa4-f9ad-4c4c-ae05-89d7874b5bdd tempest-ServerRescueNegativeTestJSON-412251590 tempest-ServerRescueNegativeTestJSON-412251590-project] [instance: 8cd29851-35c1-4032-a137-ab9419a2ec5b] Fetching instance by UUID {{(pid=120740) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 18:02:40.094546 dv-cinder-852009-8-iscsi devstack@n-api.service[120741]: DEBUG oslo_concurrency.lockutils [None req-5493af12-7368-49da-99cc-cf9045edfad4 tempest-AttachVolumeTestJSON-555093534 tempest-AttachVolumeTestJSON-555093534-project] Lock "1daf4f4c-0e4a-4779-b53a-78c48397ea2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120741) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 18:02:40.095325 dv-cinder-852009-8-iscsi devstack@n-api.service[120741]: DEBUG oslo_concurrency.lockutils [None req-5493af12-7368-49da-99cc-cf9045edfad4 tempest-AttachVolumeTestJSON-555093534 tempest-AttachVolumeTestJSON-555093534-project] Lock "1daf4f4c-0e4a-4779-b53a-78c48397ea2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120741) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 18:02:40.096557 dv-cinder-852009-8-iscsi devstack@n-api.service[120741]: DEBUG oslo_concurrency.lockutils [None req-5493af12-7368-49da-99cc-cf9045edfad4 tempest-AttachVolumeTestJSON-555093534 tempest-AttachVolumeTestJSON-555093534-project] Acquiring lock "1daf4f4c-0e4a-4779-b53a-78c48397ea2f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120741) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 18:02:40.097257 dv-cinder-852009-8-iscsi devstack@n-api.service[120741]: DEBUG oslo_concurrency.lockutils [None req-5493af12-7368-49da-99cc-cf9045edfad4 tempest-AttachVolumeTestJSON-555093534 tempest-AttachVolumeTestJSON-555093534-project] Lock "1daf4f4c-0e4a-4779-b53a-78c48397ea2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120741) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 18:02:40.098046 dv-cinder-852009-8-iscsi devstack@n-api.service[120741]: DEBUG oslo_concurrency.lockutils [None req-5493af12-7368-49da-99cc-cf9045edfad4 tempest-AttachVolumeTestJSON-555093534 tempest-AttachVolumeTestJSON-555093534-project] Lock "1daf4f4c-0e4a-4779-b53a-78c48397ea2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120741) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 18:02:40.100674 dv-cinder-852009-8-iscsi devstack@n-api.service[120740]: DEBUG oslo_concurrency.lockutils [None req-c062daa4-f9ad-4c4c-ae05-89d7874b5bdd tempest-ServerRescueNegativeTestJSON-412251590 tempest-ServerRescueNegativeTestJSON-412251590-project] Acquiring lock "1daf4f4c-0e4a-4779-b53a-78c48397ea2f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120740) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 18:02:40.101177 dv-cinder-852009-8-iscsi devstack@n-api.service[120740]: DEBUG oslo_concurrency.lockutils [None req-c062daa4-f9ad-4c4c-ae05-89d7874b5bdd tempest-ServerRescueNegativeTestJSON-412251590 tempest-ServerRescueNegativeTestJSON-412251590-project] Lock "1daf4f4c-0e4a-4779-b53a-78c48397ea2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120740) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 18:02:40.101610 dv-cinder-852009-8-iscsi devstack@n-api.service[120740]: DEBUG oslo_concurrency.lockutils [None req-c062daa4-f9ad-4c4c-ae05-89d7874b5bdd tempest-ServerRescueNegativeTestJSON-412251590 tempest-ServerRescueNegativeTestJSON-412251590-project] Lock "1daf4f4c-0e4a-4779-b53a-78c48397ea2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120740) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 18:02:40.102367 dv-cinder-852009-8-iscsi devstack@n-api.service[120740]: DEBUG oslo_concurrency.lockutils [None req-c062daa4-f9ad-4c4c-ae05-89d7874b5bdd tempest-ServerRescueNegativeTestJSON-412251590 tempest-ServerRescueNegativeTestJSON-412251590-project] Acquiring lock "1daf4f4c-0e4a-4779-b53a-78c48397ea2f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120740) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 18:02:40.102817 dv-cinder-852009-8-iscsi devstack@n-api.service[120740]: DEBUG oslo_concurrency.lockutils [None req-c062daa4-f9ad-4c4c-ae05-89d7874b5bdd tempest-ServerRescueNegativeTestJSON-412251590 tempest-ServerRescueNegativeTestJSON-412251590-project] Lock "1daf4f4c-0e4a-4779-b53a-78c48397ea2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120740) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 18:02:40.103240 dv-cinder-852009-8-iscsi devstack@n-api.service[120740]: DEBUG oslo_concurrency.lockutils [None req-c062daa4-f9ad-4c4c-ae05-89d7874b5bdd tempest-ServerRescueNegativeTestJSON-412251590 tempest-ServerRescueNegativeTestJSON-412251590-project] Lock "1daf4f4c-0e4a-4779-b53a-78c48397ea2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120740) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 18:02:40.329028 dv-cinder-852009-8-iscsi devstack@n-api.service[120740]: DEBUG nova.policy [None req-c062daa4-f9ad-4c4c-ae05-89d7874b5bdd tempest-ServerRescueNegativeTestJSON-412251590 tempest-ServerRescueNegativeTestJSON-412251590-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '60800cf2774e409d9c1b6f4992669991', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2eae4acecf6c4961830ead78d71b2ad3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120740) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 18:02:40.340910 dv-cinder-852009-8-iscsi devstack@n-api.service[120741]: DEBUG nova.policy [None req-5493af12-7368-49da-99cc-cf9045edfad4 tempest-AttachVolumeTestJSON-555093534 tempest-AttachVolumeTestJSON-555093534-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0625b3113ce044bbac4f6142eaade11c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a279fcbf274c4704a31a2b95061e1469', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120741) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 18:02:40.349470 dv-cinder-852009-8-iscsi devstack@n-api.service[120741]: INFO nova.api.openstack.requestlog [None req-5493af12-7368-49da-99cc-cf9045edfad4 tempest-AttachVolumeTestJSON-555093534 tempest-AttachVolumeTestJSON-555093534-project] 10.222.0.43 "GET /compute/v2.1/servers/b958d409-df20-44c6-aa0e-58cb0a482edf" status: 200 len: 1362 microversion: 2.1 time: 0.269669 Sep 13 18:02:40.350524 dv-cinder-852009-8-iscsi devstack@n-api.service[120740]: INFO nova.api.openstack.requestlog [None req-c062daa4-f9ad-4c4c-ae05-89d7874b5bdd tempest-ServerRescueNegativeTestJSON-412251590 tempest-ServerRescueNegativeTestJSON-412251590-project] 10.222.0.43 "GET /compute/v2.1/servers/8cd29851-35c1-4032-a137-ab9419a2ec5b" status: 200 len: 1516 microversion: 2.1 time: 0.265327 Sep 13 18:02:40.356996 dv-cinder-852009-8-iscsi devstack@n-api.service[120740]: [pid: 120740|app: 0|req: 62/117] 10.222.0.43 () {58 vars in 1236 bytes} [Tue Sep 13 18:02:40 2022] GET /compute/v2.1/servers/8cd29851-35c1-4032-a137-ab9419a2ec5b => generated 1516 bytes in 272 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 13 18:02:40.365124 dv-cinder-852009-8-iscsi devstack@n-api.service[120741]: [pid: 120741|app: 0|req: 56/118] 10.222.0.43 () {58 vars in 1236 bytes} [Tue Sep 13 18:02:40 2022] GET /compute/v2.1/servers/b958d409-df20-44c6-aa0e-58cb0a482edf => generated 1362 bytes in 286 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 13 18:02:40.375156 dv-cinder-852009-8-iscsi devstack@n-api.service[120740]: DEBUG nova.api.openstack.wsgi [None req-b3793d30-4dea-48ed-9058-c2fc4328e156 tempest-ServerRescueNegativeTestJSON-412251590 tempest-ServerRescueNegativeTestJSON-412251590-project] Action: 'action', calling method: >, body: {"rescue": {"adminPass": "***"}} {{(pid=120740) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 13 18:02:40.378275 dv-cinder-852009-8-iscsi devstack@n-api.service[120740]: DEBUG nova.compute.api [None req-b3793d30-4dea-48ed-9058-c2fc4328e156 tempest-ServerRescueNegativeTestJSON-412251590 tempest-ServerRescueNegativeTestJSON-412251590-project] [instance: 8cd29851-35c1-4032-a137-ab9419a2ec5b] Fetching instance by UUID {{(pid=120740) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 18:02:40.385234 dv-cinder-852009-8-iscsi devstack@n-api.service[120740]: DEBUG oslo_concurrency.lockutils [None req-b3793d30-4dea-48ed-9058-c2fc4328e156 tempest-ServerRescueNegativeTestJSON-412251590 tempest-ServerRescueNegativeTestJSON-412251590-project] Acquiring lock "1daf4f4c-0e4a-4779-b53a-78c48397ea2f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120740) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 18:02:40.385727 dv-cinder-852009-8-iscsi devstack@n-api.service[120740]: DEBUG oslo_concurrency.lockutils [None req-b3793d30-4dea-48ed-9058-c2fc4328e156 tempest-ServerRescueNegativeTestJSON-412251590 tempest-ServerRescueNegativeTestJSON-412251590-project] Lock "1daf4f4c-0e4a-4779-b53a-78c48397ea2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120740) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 18:02:40.386161 dv-cinder-852009-8-iscsi devstack@n-api.service[120740]: DEBUG oslo_concurrency.lockutils [None req-b3793d30-4dea-48ed-9058-c2fc4328e156 tempest-ServerRescueNegativeTestJSON-412251590 tempest-ServerRescueNegativeTestJSON-412251590-project] Lock "1daf4f4c-0e4a-4779-b53a-78c48397ea2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120740) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 18:02:40.386872 dv-cinder-852009-8-iscsi devstack@n-api.service[120740]: DEBUG oslo_concurrency.lockutils [None req-b3793d30-4dea-48ed-9058-c2fc4328e156 tempest-ServerRescueNegativeTestJSON-412251590 tempest-ServerRescueNegativeTestJSON-412251590-project] Acquiring lock "1daf4f4c-0e4a-4779-b53a-78c48397ea2f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120740) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 18:02:40.387316 dv-cinder-852009-8-iscsi devstack@n-api.service[120740]: DEBUG oslo_concurrency.lockutils [None req-b3793d30-4dea-48ed-9058-c2fc4328e156 tempest-ServerRescueNegativeTestJSON-412251590 tempest-ServerRescueNegativeTestJSON-412251590-project] Lock "1daf4f4c-0e4a-4779-b53a-78c48397ea2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120740) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 18:02:40.387731 dv-cinder-852009-8-iscsi devstack@n-api.service[120740]: DEBUG oslo_concurrency.lockutils [None req-b3793d30-4dea-48ed-9058-c2fc4328e156 tempest-ServerRescueNegativeTestJSON-412251590 tempest-ServerRescueNegativeTestJSON-412251590-project] Lock "1daf4f4c-0e4a-4779-b53a-78c48397ea2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120740) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 18:02:40.451387 dv-cinder-852009-8-iscsi devstack@n-api.service[120740]: DEBUG nova.objects.instance [None req-b3793d30-4dea-48ed-9058-c2fc4328e156 tempest-ServerRescueNegativeTestJSON-412251590 tempest-ServerRescueNegativeTestJSON-412251590-project] Lazy-loading 'flavor' on Instance uuid 8cd29851-35c1-4032-a137-ab9419a2ec5b {{(pid=120740) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Sep 13 18:02:40.625160 dv-cinder-852009-8-iscsi devstack@n-api.service[120740]: INFO nova.api.openstack.requestlog [None req-b3793d30-4dea-48ed-9058-c2fc4328e156 tempest-ServerRescueNegativeTestJSON-412251590 tempest-ServerRescueNegativeTestJSON-412251590-project] 10.222.0.43 "POST /compute/v2.1/servers/8cd29851-35c1-4032-a137-ab9419a2ec5b/action" status: 200 len: 32 microversion: 2.1 time: 0.253735 Sep 13 18:02:40.632747 dv-cinder-852009-8-iscsi devstack@n-api.service[120740]: [pid: 120740|app: 0|req: 63/119] 10.222.0.43 () {60 vars in 1278 bytes} [Tue Sep 13 18:02:40 2022] POST /compute/v2.1/servers/8cd29851-35c1-4032-a137-ab9419a2ec5b/action => generated 32 bytes in 263 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Sep 13 18:02:40.637479 dv-cinder-852009-8-iscsi devstack@n-api.service[120741]: DEBUG nova.api.openstack.wsgi [None req-271bd1bd-dd4b-4eef-9a7b-63a7954c085c tempest-ServerRescueNegativeTestJSON-412251590 tempest-ServerRescueNegativeTestJSON-412251590-project] Calling method '>' {{(pid=120741) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 18:02:40.638336 dv-cinder-852009-8-iscsi devstack@n-api.service[120741]: DEBUG nova.compute.api [None req-271bd1bd-dd4b-4eef-9a7b-63a7954c085c tempest-ServerRescueNegativeTestJSON-412251590 tempest-ServerRescueNegativeTestJSON-412251590-project] [instance: 8cd29851-35c1-4032-a137-ab9419a2ec5b] Fetching instance by UUID {{(pid=120741) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 18:02:40.647659 dv-cinder-852009-8-iscsi devstack@n-api.service[120741]: DEBUG oslo_concurrency.lockutils [None req-271bd1bd-dd4b-4eef-9a7b-63a7954c085c tempest-ServerRescueNegativeTestJSON-412251590 tempest-ServerRescueNegativeTestJSON-412251590-project] Acquiring lock "1daf4f4c-0e4a-4779-b53a-78c48397ea2f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120741) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 18:02:40.651092 dv-cinder-852009-8-iscsi devstack@n-api.service[120741]: DEBUG oslo_concurrency.lockutils [None req-271bd1bd-dd4b-4eef-9a7b-63a7954c085c tempest-ServerRescueNegativeTestJSON-412251590 tempest-ServerRescueNegativeTestJSON-412251590-project] Lock "1daf4f4c-0e4a-4779-b53a-78c48397ea2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120741) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 18:02:40.651737 dv-cinder-852009-8-iscsi devstack@n-api.service[120741]: DEBUG oslo_concurrency.lockutils [None req-271bd1bd-dd4b-4eef-9a7b-63a7954c085c tempest-ServerRescueNegativeTestJSON-412251590 tempest-ServerRescueNegativeTestJSON-412251590-project] Lock "1daf4f4c-0e4a-4779-b53a-78c48397ea2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120741) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 18:02:40.655084 dv-cinder-852009-8-iscsi devstack@n-api.service[120741]: DEBUG oslo_concurrency.lockutils [None req-271bd1bd-dd4b-4eef-9a7b-63a7954c085c tempest-ServerRescueNegativeTestJSON-412251590 tempest-ServerRescueNegativeTestJSON-412251590-project] Acquiring lock "1daf4f4c-0e4a-4779-b53a-78c48397ea2f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120741) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 18:02:40.657220 dv-cinder-852009-8-iscsi devstack@n-api.service[120741]: DEBUG oslo_concurrency.lockutils [None req-271bd1bd-dd4b-4eef-9a7b-63a7954c085c tempest-ServerRescueNegativeTestJSON-412251590 tempest-ServerRescueNegativeTestJSON-412251590-project] Lock "1daf4f4c-0e4a-4779-b53a-78c48397ea2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120741) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 18:02:40.657662 dv-cinder-852009-8-iscsi devstack@n-api.service[120741]: DEBUG oslo_concurrency.lockutils [None req-271bd1bd-dd4b-4eef-9a7b-63a7954c085c tempest-ServerRescueNegativeTestJSON-412251590 tempest-ServerRescueNegativeTestJSON-412251590-project] Lock "1daf4f4c-0e4a-4779-b53a-78c48397ea2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120741) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 18:02:40.710689 dv-cinder-852009-8-iscsi devstack@n-api.service[120740]: DEBUG nova.api.openstack.wsgi [None req-b4ea2b37-3584-4f55-8057-3bc79a7cecd0 tempest-DeleteServersTestJSON-1632919649 tempest-DeleteServersTestJSON-1632919649-project] Calling method '>' {{(pid=120740) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 18:02:40.711656 dv-cinder-852009-8-iscsi devstack@n-api.service[120740]: DEBUG nova.compute.api [None req-b4ea2b37-3584-4f55-8057-3bc79a7cecd0 tempest-DeleteServersTestJSON-1632919649 tempest-DeleteServersTestJSON-1632919649-project] [instance: 207d1d8d-58a4-4b99-aa09-1c5023c60784] Fetching instance by UUID {{(pid=120740) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 18:02:40.721309 dv-cinder-852009-8-iscsi devstack@n-api.service[120740]: DEBUG oslo_concurrency.lockutils [None req-b4ea2b37-3584-4f55-8057-3bc79a7cecd0 tempest-DeleteServersTestJSON-1632919649 tempest-DeleteServersTestJSON-1632919649-project] Acquiring lock "1daf4f4c-0e4a-4779-b53a-78c48397ea2f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120740) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 18:02:40.723451 dv-cinder-852009-8-iscsi devstack@n-api.service[120740]: DEBUG oslo_concurrency.lockutils [None req-b4ea2b37-3584-4f55-8057-3bc79a7cecd0 tempest-DeleteServersTestJSON-1632919649 tempest-DeleteServersTestJSON-1632919649-project] Lock "1daf4f4c-0e4a-4779-b53a-78c48397ea2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120740) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 18:02:40.725201 dv-cinder-852009-8-iscsi devstack@n-api.service[120740]: DEBUG oslo_concurrency.lockutils [None req-b4ea2b37-3584-4f55-8057-3bc79a7cecd0 tempest-DeleteServersTestJSON-1632919649 tempest-DeleteServersTestJSON-1632919649-project] Lock "1daf4f4c-0e4a-4779-b53a-78c48397ea2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120740) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 18:02:40.726051 dv-cinder-852009-8-iscsi devstack@n-api.service[120740]: DEBUG oslo_concurrency.lockutils [None req-b4ea2b37-3584-4f55-8057-3bc79a7cecd0 tempest-DeleteServersTestJSON-1632919649 tempest-DeleteServersTestJSON-1632919649-project] Acquiring lock "1daf4f4c-0e4a-4779-b53a-78c48397ea2f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120740) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 18:02:40.745874 dv-cinder-852009-8-iscsi devstack@n-api.service[120740]: DEBUG oslo_concurrency.lockutils [None req-b4ea2b37-3584-4f55-8057-3bc79a7cecd0 tempest-DeleteServersTestJSON-1632919649 tempest-DeleteServersTestJSON-1632919649-project] Lock "1daf4f4c-0e4a-4779-b53a-78c48397ea2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.014s {{(pid=120740) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 18:02:40.746579 dv-cinder-852009-8-iscsi devstack@n-api.service[120740]: DEBUG oslo_concurrency.lockutils [None req-b4ea2b37-3584-4f55-8057-3bc79a7cecd0 tempest-DeleteServersTestJSON-1632919649 tempest-DeleteServersTestJSON-1632919649-project] Lock "1daf4f4c-0e4a-4779-b53a-78c48397ea2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=120740) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 18:02:41.241567 dv-cinder-852009-8-iscsi devstack@n-api.service[120741]: DEBUG nova.policy [None req-271bd1bd-dd4b-4eef-9a7b-63a7954c085c tempest-ServerRescueNegativeTestJSON-412251590 tempest-ServerRescueNegativeTestJSON-412251590-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '60800cf2774e409d9c1b6f4992669991', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2eae4acecf6c4961830ead78d71b2ad3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120741) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 18:02:41.250630 dv-cinder-852009-8-iscsi devstack@n-api.service[120741]: INFO nova.api.openstack.requestlog [None req-271bd1bd-dd4b-4eef-9a7b-63a7954c085c tempest-ServerRescueNegativeTestJSON-412251590 tempest-ServerRescueNegativeTestJSON-412251590-project] 10.222.0.43 "GET /compute/v2.1/servers/8cd29851-35c1-4032-a137-ab9419a2ec5b" status: 200 len: 1522 microversion: 2.1 time: 0.617011 Sep 13 18:02:41.254411 dv-cinder-852009-8-iscsi devstack@n-api.service[120740]: DEBUG nova.policy [None req-b4ea2b37-3584-4f55-8057-3bc79a7cecd0 tempest-DeleteServersTestJSON-1632919649 tempest-DeleteServersTestJSON-1632919649-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '51db5ef052144879b53979268ac4ceb5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '66136f123f5b4ad0a824920bbdf9d245', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120740) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 18:02:41.276849 dv-cinder-852009-8-iscsi devstack@n-api.service[120741]: [pid: 120741|app: 0|req: 57/120] 10.222.0.43 () {58 vars in 1236 bytes} [Tue Sep 13 18:02:40 2022] GET /compute/v2.1/servers/8cd29851-35c1-4032-a137-ab9419a2ec5b => generated 1522 bytes in 644 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 13 18:02:41.278035 dv-cinder-852009-8-iscsi devstack@n-api.service[120740]: INFO nova.api.openstack.requestlog [None req-b4ea2b37-3584-4f55-8057-3bc79a7cecd0 tempest-DeleteServersTestJSON-1632919649 tempest-DeleteServersTestJSON-1632919649-project] 10.222.0.43 "GET /compute/v2.1/servers/207d1d8d-58a4-4b99-aa09-1c5023c60784" status: 200 len: 1315 microversion: 2.1 time: 0.571577 Sep 13 18:02:41.287401 dv-cinder-852009-8-iscsi devstack@n-api.service[120740]: [pid: 120740|app: 0|req: 64/121] 10.222.0.43 () {58 vars in 1236 bytes} [Tue Sep 13 18:02:40 2022] GET /compute/v2.1/servers/207d1d8d-58a4-4b99-aa09-1c5023c60784 => generated 1315 bytes in 582 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 13 18:02:41.373445 dv-cinder-852009-8-iscsi devstack@n-api.service[120741]: DEBUG nova.api.openstack.wsgi [None req-ab9eca85-e8bb-45f6-a395-b2182df18415 tempest-AttachVolumeTestJSON-555093534 tempest-AttachVolumeTestJSON-555093534-project] Calling method '>' {{(pid=120741) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 18:02:41.374200 dv-cinder-852009-8-iscsi devstack@n-api.service[120741]: DEBUG nova.compute.api [None req-ab9eca85-e8bb-45f6-a395-b2182df18415 tempest-AttachVolumeTestJSON-555093534 tempest-AttachVolumeTestJSON-555093534-project] [instance: b958d409-df20-44c6-aa0e-58cb0a482edf] Fetching instance by UUID {{(pid=120741) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 18:02:41.380956 dv-cinder-852009-8-iscsi devstack@n-api.service[120741]: DEBUG oslo_concurrency.lockutils [None req-ab9eca85-e8bb-45f6-a395-b2182df18415 tempest-AttachVolumeTestJSON-555093534 tempest-AttachVolumeTestJSON-555093534-project] Acquiring lock "1daf4f4c-0e4a-4779-b53a-78c48397ea2f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120741) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 18:02:41.381676 dv-cinder-852009-8-iscsi devstack@n-api.service[120741]: DEBUG oslo_concurrency.lockutils [None req-ab9eca85-e8bb-45f6-a395-b2182df18415 tempest-AttachVolumeTestJSON-555093534 tempest-AttachVolumeTestJSON-555093534-project] Lock "1daf4f4c-0e4a-4779-b53a-78c48397ea2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120741) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 18:02:41.382357 dv-cinder-852009-8-iscsi devstack@n-api.service[120741]: DEBUG oslo_concurrency.lockutils [None req-ab9eca85-e8bb-45f6-a395-b2182df18415 tempest-AttachVolumeTestJSON-555093534 tempest-AttachVolumeTestJSON-555093534-project] Lock "1daf4f4c-0e4a-4779-b53a-78c48397ea2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120741) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 18:02:41.383258 dv-cinder-852009-8-iscsi devstack@n-api.service[120741]: DEBUG oslo_concurrency.lockutils [None req-ab9eca85-e8bb-45f6-a395-b2182df18415 tempest-AttachVolumeTestJSON-555093534 tempest-AttachVolumeTestJSON-555093534-project] Acquiring lock "1daf4f4c-0e4a-4779-b53a-78c48397ea2f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120741) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 18:02:41.383915 dv-cinder-852009-8-iscsi devstack@n-api.service[120741]: DEBUG oslo_concurrency.lockutils [None req-ab9eca85-e8bb-45f6-a395-b2182df18415 tempest-AttachVolumeTestJSON-555093534 tempest-AttachVolumeTestJSON-555093534-project] Lock "1daf4f4c-0e4a-4779-b53a-78c48397ea2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120741) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 18:02:41.384614 dv-cinder-852009-8-iscsi devstack@n-api.service[120741]: DEBUG oslo_concurrency.lockutils [None req-ab9eca85-e8bb-45f6-a395-b2182df18415 tempest-AttachVolumeTestJSON-555093534 tempest-AttachVolumeTestJSON-555093534-project] Lock "1daf4f4c-0e4a-4779-b53a-78c48397ea2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120741) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 18:02:41.530232 dv-cinder-852009-8-iscsi devstack@n-api.service[120741]: DEBUG nova.policy [None req-ab9eca85-e8bb-45f6-a395-b2182df18415 tempest-AttachVolumeTestJSON-555093534 tempest-AttachVolumeTestJSON-555093534-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0625b3113ce044bbac4f6142eaade11c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a279fcbf274c4704a31a2b95061e1469', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120741) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 18:02:41.538978 dv-cinder-852009-8-iscsi devstack@n-api.service[120741]: INFO nova.api.openstack.requestlog [None req-ab9eca85-e8bb-45f6-a395-b2182df18415 tempest-AttachVolumeTestJSON-555093534 tempest-AttachVolumeTestJSON-555093534-project] 10.222.0.43 "GET /compute/v2.1/servers/b958d409-df20-44c6-aa0e-58cb0a482edf" status: 200 len: 1362 microversion: 2.1 time: 0.169614 Sep 13 18:02:41.539546 dv-cinder-852009-8-iscsi devstack@n-api.service[120741]: [pid: 120741|app: 0|req: 58/122] 10.222.0.43 () {58 vars in 1236 bytes} [Tue Sep 13 18:02:41 2022] GET /compute/v2.1/servers/b958d409-df20-44c6-aa0e-58cb0a482edf => generated 1362 bytes in 171 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 13 18:02:42.285134 dv-cinder-852009-8-iscsi devstack@n-api.service[120740]: DEBUG nova.api.openstack.wsgi [None req-dd8cab05-d90a-4662-9040-6f21c30d97db tempest-ServerRescueNegativeTestJSON-412251590 tempest-ServerRescueNegativeTestJSON-412251590-project] Calling method '>' {{(pid=120740) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 18:02:42.286073 dv-cinder-852009-8-iscsi devstack@n-api.service[120740]: DEBUG nova.compute.api [None req-dd8cab05-d90a-4662-9040-6f21c30d97db tempest-ServerRescueNegativeTestJSON-412251590 tempest-ServerRescueNegativeTestJSON-412251590-project] [instance: 8cd29851-35c1-4032-a137-ab9419a2ec5b] Fetching instance by UUID {{(pid=120740) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 18:02:42.292688 dv-cinder-852009-8-iscsi devstack@n-api.service[120740]: DEBUG oslo_concurrency.lockutils [None req-dd8cab05-d90a-4662-9040-6f21c30d97db tempest-ServerRescueNegativeTestJSON-412251590 tempest-ServerRescueNegativeTestJSON-412251590-project] Acquiring lock "1daf4f4c-0e4a-4779-b53a-78c48397ea2f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120740) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 18:02:42.293207 dv-cinder-852009-8-iscsi devstack@n-api.service[120740]: DEBUG oslo_concurrency.lockutils [None req-dd8cab05-d90a-4662-9040-6f21c30d97db tempest-ServerRescueNegativeTestJSON-412251590 tempest-ServerRescueNegativeTestJSON-412251590-project] Lock "1daf4f4c-0e4a-4779-b53a-78c48397ea2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120740) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 18:02:42.293613 dv-cinder-852009-8-iscsi devstack@n-api.service[120740]: DEBUG oslo_concurrency.lockutils [None req-dd8cab05-d90a-4662-9040-6f21c30d97db tempest-ServerRescueNegativeTestJSON-412251590 tempest-ServerRescueNegativeTestJSON-412251590-project] Lock "1daf4f4c-0e4a-4779-b53a-78c48397ea2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120740) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 18:02:42.294359 dv-cinder-852009-8-iscsi devstack@n-api.service[120740]: DEBUG oslo_concurrency.lockutils [None req-dd8cab05-d90a-4662-9040-6f21c30d97db tempest-ServerRescueNegativeTestJSON-412251590 tempest-ServerRescueNegativeTestJSON-412251590-project] Acquiring lock "1daf4f4c-0e4a-4779-b53a-78c48397ea2f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120740) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 18:02:42.294780 dv-cinder-852009-8-iscsi devstack@n-api.service[120740]: DEBUG oslo_concurrency.lockutils [None req-dd8cab05-d90a-4662-9040-6f21c30d97db tempest-ServerRescueNegativeTestJSON-412251590 tempest-ServerRescueNegativeTestJSON-412251590-project] Lock "1daf4f4c-0e4a-4779-b53a-78c48397ea2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120740) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 18:02:42.295225 dv-cinder-852009-8-iscsi devstack@n-api.service[120740]: DEBUG oslo_concurrency.lockutils [None req-dd8cab05-d90a-4662-9040-6f21c30d97db tempest-ServerRescueNegativeTestJSON-412251590 tempest-ServerRescueNegativeTestJSON-412251590-project] Lock "1daf4f4c-0e4a-4779-b53a-78c48397ea2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120740) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 18:02:42.300889 dv-cinder-852009-8-iscsi devstack@n-api.service[120741]: DEBUG nova.api.openstack.wsgi [None req-57e69ea1-94f6-4662-b818-514dfbec90d5 tempest-DeleteServersTestJSON-1632919649 tempest-DeleteServersTestJSON-1632919649-project] Calling method '>' {{(pid=120741) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 18:02:42.302205 dv-cinder-852009-8-iscsi devstack@n-api.service[120741]: DEBUG nova.compute.api [None req-57e69ea1-94f6-4662-b818-514dfbec90d5 tempest-DeleteServersTestJSON-1632919649 tempest-DeleteServersTestJSON-1632919649-project] [instance: 207d1d8d-58a4-4b99-aa09-1c5023c60784] Fetching instance by UUID {{(pid=120741) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 18:02:42.308290 dv-cinder-852009-8-iscsi devstack@n-api.service[120741]: DEBUG oslo_concurrency.lockutils [None req-57e69ea1-94f6-4662-b818-514dfbec90d5 tempest-DeleteServersTestJSON-1632919649 tempest-DeleteServersTestJSON-1632919649-project] Acquiring lock "1daf4f4c-0e4a-4779-b53a-78c48397ea2f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120741) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 18:02:42.308836 dv-cinder-852009-8-iscsi devstack@n-api.service[120741]: DEBUG oslo_concurrency.lockutils [None req-57e69ea1-94f6-4662-b818-514dfbec90d5 tempest-DeleteServersTestJSON-1632919649 tempest-DeleteServersTestJSON-1632919649-project] Lock "1daf4f4c-0e4a-4779-b53a-78c48397ea2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120741) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 18:02:42.309431 dv-cinder-852009-8-iscsi devstack@n-api.service[120741]: DEBUG oslo_concurrency.lockutils [None req-57e69ea1-94f6-4662-b818-514dfbec90d5 tempest-DeleteServersTestJSON-1632919649 tempest-DeleteServersTestJSON-1632919649-project] Lock "1daf4f4c-0e4a-4779-b53a-78c48397ea2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120741) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 18:02:42.310137 dv-cinder-852009-8-iscsi devstack@n-api.service[120741]: DEBUG oslo_concurrency.lockutils [None req-57e69ea1-94f6-4662-b818-514dfbec90d5 tempest-DeleteServersTestJSON-1632919649 tempest-DeleteServersTestJSON-1632919649-project] Acquiring lock "1daf4f4c-0e4a-4779-b53a-78c48397ea2f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120741) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 18:02:42.310575 dv-cinder-852009-8-iscsi devstack@n-api.service[120741]: DEBUG oslo_concurrency.lockutils [None req-57e69ea1-94f6-4662-b818-514dfbec90d5 tempest-DeleteServersTestJSON-1632919649 tempest-DeleteServersTestJSON-1632919649-project] Lock "1daf4f4c-0e4a-4779-b53a-78c48397ea2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120741) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 18:02:42.310986 dv-cinder-852009-8-iscsi devstack@n-api.service[120741]: DEBUG oslo_concurrency.lockutils [None req-57e69ea1-94f6-4662-b818-514dfbec90d5 tempest-DeleteServersTestJSON-1632919649 tempest-DeleteServersTestJSON-1632919649-project] Lock "1daf4f4c-0e4a-4779-b53a-78c48397ea2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120741) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 18:02:42.338287 dv-cinder-852009-8-iscsi devstack@n-api.service[120741]: DEBUG dbcounter [-] [120741] Writing DB stats nova_cell1:SELECT=100 {{(pid=120741) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 18:02:42.536938 dv-cinder-852009-8-iscsi devstack@n-api.service[120741]: DEBUG nova.policy [None req-57e69ea1-94f6-4662-b818-514dfbec90d5 tempest-DeleteServersTestJSON-1632919649 tempest-DeleteServersTestJSON-1632919649-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '51db5ef052144879b53979268ac4ceb5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '66136f123f5b4ad0a824920bbdf9d245', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120741) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 18:02:42.540859 dv-cinder-852009-8-iscsi devstack@n-api.service[120740]: DEBUG nova.policy [None req-dd8cab05-d90a-4662-9040-6f21c30d97db tempest-ServerRescueNegativeTestJSON-412251590 tempest-ServerRescueNegativeTestJSON-412251590-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '60800cf2774e409d9c1b6f4992669991', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2eae4acecf6c4961830ead78d71b2ad3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120740) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 18:02:42.545808 dv-cinder-852009-8-iscsi devstack@n-api.service[120741]: INFO nova.api.openstack.requestlog [None req-57e69ea1-94f6-4662-b818-514dfbec90d5 tempest-DeleteServersTestJSON-1632919649 tempest-DeleteServersTestJSON-1632919649-project] 10.222.0.43 "GET /compute/v2.1/servers/207d1d8d-58a4-4b99-aa09-1c5023c60784" status: 200 len: 1315 microversion: 2.1 time: 0.249248 Sep 13 18:02:42.549948 dv-cinder-852009-8-iscsi devstack@n-api.service[120740]: INFO nova.api.openstack.requestlog [None req-dd8cab05-d90a-4662-9040-6f21c30d97db tempest-ServerRescueNegativeTestJSON-412251590 tempest-ServerRescueNegativeTestJSON-412251590-project] 10.222.0.43 "GET /compute/v2.1/servers/8cd29851-35c1-4032-a137-ab9419a2ec5b" status: 200 len: 1522 microversion: 2.1 time: 0.270938 Sep 13 18:02:42.562136 dv-cinder-852009-8-iscsi devstack@n-api.service[120741]: [pid: 120741|app: 0|req: 59/123] 10.222.0.43 () {58 vars in 1236 bytes} [Tue Sep 13 18:02:42 2022] GET /compute/v2.1/servers/207d1d8d-58a4-4b99-aa09-1c5023c60784 => generated 1315 bytes in 260 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 13 18:02:42.565712 dv-cinder-852009-8-iscsi devstack@n-api.service[120740]: [pid: 120740|app: 0|req: 65/124] 10.222.0.43 () {58 vars in 1236 bytes} [Tue Sep 13 18:02:42 2022] GET /compute/v2.1/servers/8cd29851-35c1-4032-a137-ab9419a2ec5b => generated 1522 bytes in 287 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 13 18:02:42.568002 dv-cinder-852009-8-iscsi devstack@n-api.service[120741]: DEBUG nova.api.openstack.wsgi [None req-c786e974-6fd8-4758-9e5d-1f1d76e53053 tempest-AttachVolumeTestJSON-555093534 tempest-AttachVolumeTestJSON-555093534-project] Calling method '>' {{(pid=120741) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 18:02:42.568774 dv-cinder-852009-8-iscsi devstack@n-api.service[120741]: DEBUG nova.compute.api [None req-c786e974-6fd8-4758-9e5d-1f1d76e53053 tempest-AttachVolumeTestJSON-555093534 tempest-AttachVolumeTestJSON-555093534-project] [instance: b958d409-df20-44c6-aa0e-58cb0a482edf] Fetching instance by UUID {{(pid=120741) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 18:02:42.574845 dv-cinder-852009-8-iscsi devstack@n-api.service[120741]: DEBUG oslo_concurrency.lockutils [None req-c786e974-6fd8-4758-9e5d-1f1d76e53053 tempest-AttachVolumeTestJSON-555093534 tempest-AttachVolumeTestJSON-555093534-project] Acquiring lock "1daf4f4c-0e4a-4779-b53a-78c48397ea2f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120741) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 18:02:42.575334 dv-cinder-852009-8-iscsi devstack@n-api.service[120741]: DEBUG oslo_concurrency.lockutils [None req-c786e974-6fd8-4758-9e5d-1f1d76e53053 tempest-AttachVolumeTestJSON-555093534 tempest-AttachVolumeTestJSON-555093534-project] Lock "1daf4f4c-0e4a-4779-b53a-78c48397ea2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120741) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 18:02:42.575761 dv-cinder-852009-8-iscsi devstack@n-api.service[120741]: DEBUG oslo_concurrency.lockutils [None req-c786e974-6fd8-4758-9e5d-1f1d76e53053 tempest-AttachVolumeTestJSON-555093534 tempest-AttachVolumeTestJSON-555093534-project] Lock "1daf4f4c-0e4a-4779-b53a-78c48397ea2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120741) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 18:02:42.576476 dv-cinder-852009-8-iscsi devstack@n-api.service[120741]: DEBUG oslo_concurrency.lockutils [None req-c786e974-6fd8-4758-9e5d-1f1d76e53053 tempest-AttachVolumeTestJSON-555093534 tempest-AttachVolumeTestJSON-555093534-project] Acquiring lock "1daf4f4c-0e4a-4779-b53a-78c48397ea2f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120741) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 18:02:42.576927 dv-cinder-852009-8-iscsi devstack@n-api.service[120741]: DEBUG oslo_concurrency.lockutils [None req-c786e974-6fd8-4758-9e5d-1f1d76e53053 tempest-AttachVolumeTestJSON-555093534 tempest-AttachVolumeTestJSON-555093534-project] Lock "1daf4f4c-0e4a-4779-b53a-78c48397ea2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120741) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 18:02:42.577508 dv-cinder-852009-8-iscsi devstack@n-api.service[120741]: DEBUG oslo_concurrency.lockutils [None req-c786e974-6fd8-4758-9e5d-1f1d76e53053 tempest-AttachVolumeTestJSON-555093534 tempest-AttachVolumeTestJSON-555093534-project] Lock "1daf4f4c-0e4a-4779-b53a-78c48397ea2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120741) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 18:02:42.623952 dv-cinder-852009-8-iscsi devstack@n-api.service[120740]: DEBUG nova.api.openstack.wsgi [req-0a6c5d70-c057-4c0f-a646-8e87a3cfbfa1 req-d6c4203f-eb31-4407-b160-af60114f1c24 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "b958d409-df20-44c6-aa0e-58cb0a482edf", "name": "network-vif-plugged", "status": "completed", "tag": "a5580dcb-2c75-47bc-91ef-409ee6db4bdc"}]} {{(pid=120740) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 13 18:02:42.634729 dv-cinder-852009-8-iscsi devstack@n-api.service[120740]: DEBUG oslo_concurrency.lockutils [req-0a6c5d70-c057-4c0f-a646-8e87a3cfbfa1 req-d6c4203f-eb31-4407-b160-af60114f1c24 service nova] Acquiring lock "1daf4f4c-0e4a-4779-b53a-78c48397ea2f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120740) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 18:02:42.635137 dv-cinder-852009-8-iscsi devstack@n-api.service[120740]: DEBUG oslo_concurrency.lockutils [req-0a6c5d70-c057-4c0f-a646-8e87a3cfbfa1 req-d6c4203f-eb31-4407-b160-af60114f1c24 service nova] Lock "1daf4f4c-0e4a-4779-b53a-78c48397ea2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120740) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 18:02:42.635551 dv-cinder-852009-8-iscsi devstack@n-api.service[120740]: DEBUG oslo_concurrency.lockutils [req-0a6c5d70-c057-4c0f-a646-8e87a3cfbfa1 req-d6c4203f-eb31-4407-b160-af60114f1c24 service nova] Lock "1daf4f4c-0e4a-4779-b53a-78c48397ea2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120740) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 18:02:42.657501 dv-cinder-852009-8-iscsi devstack@n-api.service[120740]: INFO nova.api.openstack.compute.server_external_events [req-0a6c5d70-c057-4c0f-a646-8e87a3cfbfa1 req-d6c4203f-eb31-4407-b160-af60114f1c24 service nova] Creating event network-vif-plugged:a5580dcb-2c75-47bc-91ef-409ee6db4bdc for instance b958d409-df20-44c6-aa0e-58cb0a482edf on hv-cinder-85200 Sep 13 18:02:42.676835 dv-cinder-852009-8-iscsi devstack@n-api.service[120740]: INFO nova.api.openstack.requestlog [req-0a6c5d70-c057-4c0f-a646-8e87a3cfbfa1 req-d6c4203f-eb31-4407-b160-af60114f1c24 service nova] 10.222.0.43 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.057166 Sep 13 18:02:42.685388 dv-cinder-852009-8-iscsi devstack@n-api.service[120740]: [pid: 120740|app: 0|req: 66/125] 10.222.0.43 () {64 vars in 1317 bytes} [Tue Sep 13 18:02:42 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 67 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Sep 13 18:02:42.763247 dv-cinder-852009-8-iscsi devstack@n-api.service[120741]: DEBUG nova.policy [None req-c786e974-6fd8-4758-9e5d-1f1d76e53053 tempest-AttachVolumeTestJSON-555093534 tempest-AttachVolumeTestJSON-555093534-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0625b3113ce044bbac4f6142eaade11c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a279fcbf274c4704a31a2b95061e1469', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120741) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 18:02:42.772112 dv-cinder-852009-8-iscsi devstack@n-api.service[120741]: INFO nova.api.openstack.requestlog [None req-c786e974-6fd8-4758-9e5d-1f1d76e53053 tempest-AttachVolumeTestJSON-555093534 tempest-AttachVolumeTestJSON-555093534-project] 10.222.0.43 "GET /compute/v2.1/servers/b958d409-df20-44c6-aa0e-58cb0a482edf" status: 200 len: 1362 microversion: 2.1 time: 0.208378 Sep 13 18:02:42.772696 dv-cinder-852009-8-iscsi devstack@n-api.service[120741]: [pid: 120741|app: 0|req: 60/126] 10.222.0.43 () {58 vars in 1236 bytes} [Tue Sep 13 18:02:42 2022] GET /compute/v2.1/servers/b958d409-df20-44c6-aa0e-58cb0a482edf => generated 1362 bytes in 210 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 13 18:02:43.570690 dv-cinder-852009-8-iscsi devstack@n-api.service[120740]: DEBUG nova.api.openstack.wsgi [None req-9cb66025-f143-4eb2-98a6-ba318dfee54c tempest-DeleteServersTestJSON-1632919649 tempest-DeleteServersTestJSON-1632919649-project] Calling method '>' {{(pid=120740) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 18:02:43.571932 dv-cinder-852009-8-iscsi devstack@n-api.service[120740]: DEBUG nova.compute.api [None req-9cb66025-f143-4eb2-98a6-ba318dfee54c tempest-DeleteServersTestJSON-1632919649 tempest-DeleteServersTestJSON-1632919649-project] [instance: 207d1d8d-58a4-4b99-aa09-1c5023c60784] Fetching instance by UUID {{(pid=120740) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 18:02:43.575310 dv-cinder-852009-8-iscsi devstack@n-api.service[120741]: DEBUG nova.api.openstack.wsgi [None req-ab3bbf47-9b64-432d-8d04-b391854c7eb8 tempest-ServerRescueNegativeTestJSON-412251590 tempest-ServerRescueNegativeTestJSON-412251590-project] Calling method '>' {{(pid=120741) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 18:02:43.575996 dv-cinder-852009-8-iscsi devstack@n-api.service[120741]: DEBUG nova.compute.api [None req-ab3bbf47-9b64-432d-8d04-b391854c7eb8 tempest-ServerRescueNegativeTestJSON-412251590 tempest-ServerRescueNegativeTestJSON-412251590-project] [instance: 8cd29851-35c1-4032-a137-ab9419a2ec5b] Fetching instance by UUID {{(pid=120741) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 18:02:43.578716 dv-cinder-852009-8-iscsi devstack@n-api.service[120740]: DEBUG oslo_concurrency.lockutils [None req-9cb66025-f143-4eb2-98a6-ba318dfee54c tempest-DeleteServersTestJSON-1632919649 tempest-DeleteServersTestJSON-1632919649-project] Acquiring lock "1daf4f4c-0e4a-4779-b53a-78c48397ea2f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120740) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 18:02:43.579400 dv-cinder-852009-8-iscsi devstack@n-api.service[120740]: DEBUG oslo_concurrency.lockutils [None req-9cb66025-f143-4eb2-98a6-ba318dfee54c tempest-DeleteServersTestJSON-1632919649 tempest-DeleteServersTestJSON-1632919649-project] Lock "1daf4f4c-0e4a-4779-b53a-78c48397ea2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120740) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 18:02:43.580593 dv-cinder-852009-8-iscsi devstack@n-api.service[120740]: DEBUG oslo_concurrency.lockutils [None req-9cb66025-f143-4eb2-98a6-ba318dfee54c tempest-DeleteServersTestJSON-1632919649 tempest-DeleteServersTestJSON-1632919649-project] Lock "1daf4f4c-0e4a-4779-b53a-78c48397ea2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120740) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 18:02:43.581268 dv-cinder-852009-8-iscsi devstack@n-api.service[120740]: DEBUG oslo_concurrency.lockutils [None req-9cb66025-f143-4eb2-98a6-ba318dfee54c tempest-DeleteServersTestJSON-1632919649 tempest-DeleteServersTestJSON-1632919649-project] Acquiring lock "1daf4f4c-0e4a-4779-b53a-78c48397ea2f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120740) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 18:02:43.581723 dv-cinder-852009-8-iscsi devstack@n-api.service[120740]: DEBUG oslo_concurrency.lockutils [None req-9cb66025-f143-4eb2-98a6-ba318dfee54c tempest-DeleteServersTestJSON-1632919649 tempest-DeleteServersTestJSON-1632919649-project] Lock "1daf4f4c-0e4a-4779-b53a-78c48397ea2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120740) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 18:02:43.582138 dv-cinder-852009-8-iscsi devstack@n-api.service[120740]: DEBUG oslo_concurrency.lockutils [None req-9cb66025-f143-4eb2-98a6-ba318dfee54c tempest-DeleteServersTestJSON-1632919649 tempest-DeleteServersTestJSON-1632919649-project] Lock "1daf4f4c-0e4a-4779-b53a-78c48397ea2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120740) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 18:02:43.582273 dv-cinder-852009-8-iscsi devstack@n-api.service[120741]: DEBUG oslo_concurrency.lockutils [None req-ab3bbf47-9b64-432d-8d04-b391854c7eb8 tempest-ServerRescueNegativeTestJSON-412251590 tempest-ServerRescueNegativeTestJSON-412251590-project] Acquiring lock "1daf4f4c-0e4a-4779-b53a-78c48397ea2f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120741) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 18:02:43.582747 dv-cinder-852009-8-iscsi devstack@n-api.service[120741]: DEBUG oslo_concurrency.lockutils [None req-ab3bbf47-9b64-432d-8d04-b391854c7eb8 tempest-ServerRescueNegativeTestJSON-412251590 tempest-ServerRescueNegativeTestJSON-412251590-project] Lock "1daf4f4c-0e4a-4779-b53a-78c48397ea2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120741) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 18:02:43.583185 dv-cinder-852009-8-iscsi devstack@n-api.service[120741]: DEBUG oslo_concurrency.lockutils [None req-ab3bbf47-9b64-432d-8d04-b391854c7eb8 tempest-ServerRescueNegativeTestJSON-412251590 tempest-ServerRescueNegativeTestJSON-412251590-project] Lock "1daf4f4c-0e4a-4779-b53a-78c48397ea2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120741) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 18:02:43.584075 dv-cinder-852009-8-iscsi devstack@n-api.service[120741]: DEBUG oslo_concurrency.lockutils [None req-ab3bbf47-9b64-432d-8d04-b391854c7eb8 tempest-ServerRescueNegativeTestJSON-412251590 tempest-ServerRescueNegativeTestJSON-412251590-project] Acquiring lock "1daf4f4c-0e4a-4779-b53a-78c48397ea2f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120741) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 18:02:43.584546 dv-cinder-852009-8-iscsi devstack@n-api.service[120741]: DEBUG oslo_concurrency.lockutils [None req-ab3bbf47-9b64-432d-8d04-b391854c7eb8 tempest-ServerRescueNegativeTestJSON-412251590 tempest-ServerRescueNegativeTestJSON-412251590-project] Lock "1daf4f4c-0e4a-4779-b53a-78c48397ea2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120741) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 18:02:43.584953 dv-cinder-852009-8-iscsi devstack@n-api.service[120741]: DEBUG oslo_concurrency.lockutils [None req-ab3bbf47-9b64-432d-8d04-b391854c7eb8 tempest-ServerRescueNegativeTestJSON-412251590 tempest-ServerRescueNegativeTestJSON-412251590-project] Lock "1daf4f4c-0e4a-4779-b53a-78c48397ea2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120741) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 18:02:43.778311 dv-cinder-852009-8-iscsi devstack@n-api.service[120740]: DEBUG nova.policy [None req-9cb66025-f143-4eb2-98a6-ba318dfee54c tempest-DeleteServersTestJSON-1632919649 tempest-DeleteServersTestJSON-1632919649-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '51db5ef052144879b53979268ac4ceb5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '66136f123f5b4ad0a824920bbdf9d245', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120740) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 18:02:43.781183 dv-cinder-852009-8-iscsi devstack@n-api.service[120741]: DEBUG nova.policy [None req-ab3bbf47-9b64-432d-8d04-b391854c7eb8 tempest-ServerRescueNegativeTestJSON-412251590 tempest-ServerRescueNegativeTestJSON-412251590-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '60800cf2774e409d9c1b6f4992669991', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2eae4acecf6c4961830ead78d71b2ad3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120741) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 18:02:43.786282 dv-cinder-852009-8-iscsi devstack@n-api.service[120740]: INFO nova.api.openstack.requestlog [None req-9cb66025-f143-4eb2-98a6-ba318dfee54c tempest-DeleteServersTestJSON-1632919649 tempest-DeleteServersTestJSON-1632919649-project] 10.222.0.43 "GET /compute/v2.1/servers/207d1d8d-58a4-4b99-aa09-1c5023c60784" status: 200 len: 1315 microversion: 2.1 time: 0.219978 Sep 13 18:02:43.786885 dv-cinder-852009-8-iscsi devstack@n-api.service[120740]: [pid: 120740|app: 0|req: 67/127] 10.222.0.43 () {58 vars in 1236 bytes} [Tue Sep 13 18:02:43 2022] GET /compute/v2.1/servers/207d1d8d-58a4-4b99-aa09-1c5023c60784 => generated 1315 bytes in 221 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 13 18:02:43.788998 dv-cinder-852009-8-iscsi devstack@n-api.service[120741]: INFO nova.api.openstack.requestlog [None req-ab3bbf47-9b64-432d-8d04-b391854c7eb8 tempest-ServerRescueNegativeTestJSON-412251590 tempest-ServerRescueNegativeTestJSON-412251590-project] 10.222.0.43 "GET /compute/v2.1/servers/8cd29851-35c1-4032-a137-ab9419a2ec5b" status: 200 len: 1522 microversion: 2.1 time: 0.217630 Sep 13 18:02:43.789626 dv-cinder-852009-8-iscsi devstack@n-api.service[120741]: [pid: 120741|app: 0|req: 61/128] 10.222.0.43 () {58 vars in 1236 bytes} [Tue Sep 13 18:02:43 2022] GET /compute/v2.1/servers/8cd29851-35c1-4032-a137-ab9419a2ec5b => generated 1522 bytes in 219 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 13 18:02:43.794841 dv-cinder-852009-8-iscsi devstack@n-api.service[120740]: DEBUG nova.api.openstack.wsgi [None req-1cc33dbb-cd18-4ca6-b7fe-654a38cf0ab5 tempest-AttachVolumeTestJSON-555093534 tempest-AttachVolumeTestJSON-555093534-project] Calling method '>' {{(pid=120740) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 18:02:43.795511 dv-cinder-852009-8-iscsi devstack@n-api.service[120740]: DEBUG nova.compute.api [None req-1cc33dbb-cd18-4ca6-b7fe-654a38cf0ab5 tempest-AttachVolumeTestJSON-555093534 tempest-AttachVolumeTestJSON-555093534-project] [instance: b958d409-df20-44c6-aa0e-58cb0a482edf] Fetching instance by UUID {{(pid=120740) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 18:02:43.801555 dv-cinder-852009-8-iscsi devstack@n-api.service[120740]: DEBUG oslo_concurrency.lockutils [None req-1cc33dbb-cd18-4ca6-b7fe-654a38cf0ab5 tempest-AttachVolumeTestJSON-555093534 tempest-AttachVolumeTestJSON-555093534-project] Acquiring lock "1daf4f4c-0e4a-4779-b53a-78c48397ea2f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120740) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 18:02:43.802043 dv-cinder-852009-8-iscsi devstack@n-api.service[120740]: DEBUG oslo_concurrency.lockutils [None req-1cc33dbb-cd18-4ca6-b7fe-654a38cf0ab5 tempest-AttachVolumeTestJSON-555093534 tempest-AttachVolumeTestJSON-555093534-project] Lock "1daf4f4c-0e4a-4779-b53a-78c48397ea2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120740) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 18:02:43.802474 dv-cinder-852009-8-iscsi devstack@n-api.service[120740]: DEBUG oslo_concurrency.lockutils [None req-1cc33dbb-cd18-4ca6-b7fe-654a38cf0ab5 tempest-AttachVolumeTestJSON-555093534 tempest-AttachVolumeTestJSON-555093534-project] Lock "1daf4f4c-0e4a-4779-b53a-78c48397ea2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120740) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 18:02:43.803160 dv-cinder-852009-8-iscsi devstack@n-api.service[120740]: DEBUG oslo_concurrency.lockutils [None req-1cc33dbb-cd18-4ca6-b7fe-654a38cf0ab5 tempest-AttachVolumeTestJSON-555093534 tempest-AttachVolumeTestJSON-555093534-project] Acquiring lock "1daf4f4c-0e4a-4779-b53a-78c48397ea2f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120740) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 18:02:43.803611 dv-cinder-852009-8-iscsi devstack@n-api.service[120740]: DEBUG oslo_concurrency.lockutils [None req-1cc33dbb-cd18-4ca6-b7fe-654a38cf0ab5 tempest-AttachVolumeTestJSON-555093534 tempest-AttachVolumeTestJSON-555093534-project] Lock "1daf4f4c-0e4a-4779-b53a-78c48397ea2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120740) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 18:02:43.804026 dv-cinder-852009-8-iscsi devstack@n-api.service[120740]: DEBUG oslo_concurrency.lockutils [None req-1cc33dbb-cd18-4ca6-b7fe-654a38cf0ab5 tempest-AttachVolumeTestJSON-555093534 tempest-AttachVolumeTestJSON-555093534-project] Lock "1daf4f4c-0e4a-4779-b53a-78c48397ea2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120740) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 18:02:43.937157 dv-cinder-852009-8-iscsi devstack@n-api.service[120740]: DEBUG nova.policy [None req-1cc33dbb-cd18-4ca6-b7fe-654a38cf0ab5 tempest-AttachVolumeTestJSON-555093534 tempest-AttachVolumeTestJSON-555093534-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0625b3113ce044bbac4f6142eaade11c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a279fcbf274c4704a31a2b95061e1469', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120740) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 18:02:43.945660 dv-cinder-852009-8-iscsi devstack@n-api.service[120740]: INFO nova.api.openstack.requestlog [None req-1cc33dbb-cd18-4ca6-b7fe-654a38cf0ab5 tempest-AttachVolumeTestJSON-555093534 tempest-AttachVolumeTestJSON-555093534-project] 10.222.0.43 "GET /compute/v2.1/servers/b958d409-df20-44c6-aa0e-58cb0a482edf" status: 200 len: 1362 microversion: 2.1 time: 0.154319 Sep 13 18:02:43.946333 dv-cinder-852009-8-iscsi devstack@n-api.service[120740]: [pid: 120740|app: 0|req: 68/129] 10.222.0.43 () {58 vars in 1236 bytes} [Tue Sep 13 18:02:43 2022] GET /compute/v2.1/servers/b958d409-df20-44c6-aa0e-58cb0a482edf => generated 1362 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 13 18:02:44.811713 dv-cinder-852009-8-iscsi devstack@n-api.service[120741]: DEBUG nova.api.openstack.wsgi [None req-03b1f3cd-fbf9-44dc-b48b-467efb5c0157 tempest-DeleteServersTestJSON-1632919649 tempest-DeleteServersTestJSON-1632919649-project] Calling method '>' {{(pid=120741) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 18:02:44.812287 dv-cinder-852009-8-iscsi devstack@n-api.service[120741]: DEBUG nova.compute.api [None req-03b1f3cd-fbf9-44dc-b48b-467efb5c0157 tempest-DeleteServersTestJSON-1632919649 tempest-DeleteServersTestJSON-1632919649-project] [instance: 207d1d8d-58a4-4b99-aa09-1c5023c60784] Fetching instance by UUID {{(pid=120741) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 18:02:44.813287 dv-cinder-852009-8-iscsi devstack@n-api.service[120740]: DEBUG nova.api.openstack.wsgi [None req-6fdb2a41-4213-4889-aa23-b065b4e51b2f tempest-ServerRescueNegativeTestJSON-412251590 tempest-ServerRescueNegativeTestJSON-412251590-project] Calling method '>' {{(pid=120740) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 18:02:44.813920 dv-cinder-852009-8-iscsi devstack@n-api.service[120740]: DEBUG nova.compute.api [None req-6fdb2a41-4213-4889-aa23-b065b4e51b2f tempest-ServerRescueNegativeTestJSON-412251590 tempest-ServerRescueNegativeTestJSON-412251590-project] [instance: 8cd29851-35c1-4032-a137-ab9419a2ec5b] Fetching instance by UUID {{(pid=120740) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 18:02:44.819177 dv-cinder-852009-8-iscsi devstack@n-api.service[120741]: DEBUG oslo_concurrency.lockutils [None req-03b1f3cd-fbf9-44dc-b48b-467efb5c0157 tempest-DeleteServersTestJSON-1632919649 tempest-DeleteServersTestJSON-1632919649-project] Acquiring lock "1daf4f4c-0e4a-4779-b53a-78c48397ea2f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120741) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 18:02:44.819799 dv-cinder-852009-8-iscsi devstack@n-api.service[120741]: DEBUG oslo_concurrency.lockutils [None req-03b1f3cd-fbf9-44dc-b48b-467efb5c0157 tempest-DeleteServersTestJSON-1632919649 tempest-DeleteServersTestJSON-1632919649-project] Lock "1daf4f4c-0e4a-4779-b53a-78c48397ea2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120741) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 18:02:44.820235 dv-cinder-852009-8-iscsi devstack@n-api.service[120741]: DEBUG oslo_concurrency.lockutils [None req-03b1f3cd-fbf9-44dc-b48b-467efb5c0157 tempest-DeleteServersTestJSON-1632919649 tempest-DeleteServersTestJSON-1632919649-project] Lock "1daf4f4c-0e4a-4779-b53a-78c48397ea2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120741) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 18:02:44.820998 dv-cinder-852009-8-iscsi devstack@n-api.service[120741]: DEBUG oslo_concurrency.lockutils [None req-03b1f3cd-fbf9-44dc-b48b-467efb5c0157 tempest-DeleteServersTestJSON-1632919649 tempest-DeleteServersTestJSON-1632919649-project] Acquiring lock "1daf4f4c-0e4a-4779-b53a-78c48397ea2f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120741) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 18:02:44.821449 dv-cinder-852009-8-iscsi devstack@n-api.service[120741]: DEBUG oslo_concurrency.lockutils [None req-03b1f3cd-fbf9-44dc-b48b-467efb5c0157 tempest-DeleteServersTestJSON-1632919649 tempest-DeleteServersTestJSON-1632919649-project] Lock "1daf4f4c-0e4a-4779-b53a-78c48397ea2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120741) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 18:02:44.822016 dv-cinder-852009-8-iscsi devstack@n-api.service[120741]: DEBUG oslo_concurrency.lockutils [None req-03b1f3cd-fbf9-44dc-b48b-467efb5c0157 tempest-DeleteServersTestJSON-1632919649 tempest-DeleteServersTestJSON-1632919649-project] Lock "1daf4f4c-0e4a-4779-b53a-78c48397ea2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120741) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 18:02:44.826781 dv-cinder-852009-8-iscsi devstack@n-api.service[120740]: DEBUG oslo_concurrency.lockutils [None req-6fdb2a41-4213-4889-aa23-b065b4e51b2f tempest-ServerRescueNegativeTestJSON-412251590 tempest-ServerRescueNegativeTestJSON-412251590-project] Acquiring lock "1daf4f4c-0e4a-4779-b53a-78c48397ea2f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120740) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 18:02:44.827269 dv-cinder-852009-8-iscsi devstack@n-api.service[120740]: DEBUG oslo_concurrency.lockutils [None req-6fdb2a41-4213-4889-aa23-b065b4e51b2f tempest-ServerRescueNegativeTestJSON-412251590 tempest-ServerRescueNegativeTestJSON-412251590-project] Lock "1daf4f4c-0e4a-4779-b53a-78c48397ea2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120740) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 18:02:44.827696 dv-cinder-852009-8-iscsi devstack@n-api.service[120740]: DEBUG oslo_concurrency.lockutils [None req-6fdb2a41-4213-4889-aa23-b065b4e51b2f tempest-ServerRescueNegativeTestJSON-412251590 tempest-ServerRescueNegativeTestJSON-412251590-project] Lock "1daf4f4c-0e4a-4779-b53a-78c48397ea2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120740) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 18:02:44.828486 dv-cinder-852009-8-iscsi devstack@n-api.service[120740]: DEBUG oslo_concurrency.lockutils [None req-6fdb2a41-4213-4889-aa23-b065b4e51b2f tempest-ServerRescueNegativeTestJSON-412251590 tempest-ServerRescueNegativeTestJSON-412251590-project] Acquiring lock "1daf4f4c-0e4a-4779-b53a-78c48397ea2f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120740) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 18:02:44.828885 dv-cinder-852009-8-iscsi devstack@n-api.service[120740]: DEBUG oslo_concurrency.lockutils [None req-6fdb2a41-4213-4889-aa23-b065b4e51b2f tempest-ServerRescueNegativeTestJSON-412251590 tempest-ServerRescueNegativeTestJSON-412251590-project] Lock "1daf4f4c-0e4a-4779-b53a-78c48397ea2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120740) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 18:02:44.829298 dv-cinder-852009-8-iscsi devstack@n-api.service[120740]: DEBUG oslo_concurrency.lockutils [None req-6fdb2a41-4213-4889-aa23-b065b4e51b2f tempest-ServerRescueNegativeTestJSON-412251590 tempest-ServerRescueNegativeTestJSON-412251590-project] Lock "1daf4f4c-0e4a-4779-b53a-78c48397ea2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120740) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 18:02:45.095705 dv-cinder-852009-8-iscsi devstack@n-api.service[120741]: DEBUG nova.policy [None req-03b1f3cd-fbf9-44dc-b48b-467efb5c0157 tempest-DeleteServersTestJSON-1632919649 tempest-DeleteServersTestJSON-1632919649-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '51db5ef052144879b53979268ac4ceb5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '66136f123f5b4ad0a824920bbdf9d245', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120741) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 18:02:45.105686 dv-cinder-852009-8-iscsi devstack@n-api.service[120741]: INFO nova.api.openstack.requestlog [None req-03b1f3cd-fbf9-44dc-b48b-467efb5c0157 tempest-DeleteServersTestJSON-1632919649 tempest-DeleteServersTestJSON-1632919649-project] 10.222.0.43 "GET /compute/v2.1/servers/207d1d8d-58a4-4b99-aa09-1c5023c60784" status: 200 len: 1315 microversion: 2.1 time: 0.297975 Sep 13 18:02:45.106896 dv-cinder-852009-8-iscsi devstack@n-api.service[120741]: [pid: 120741|app: 0|req: 62/130] 10.222.0.43 () {58 vars in 1236 bytes} [Tue Sep 13 18:02:44 2022] GET /compute/v2.1/servers/207d1d8d-58a4-4b99-aa09-1c5023c60784 => generated 1315 bytes in 301 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 13 18:02:45.112572 dv-cinder-852009-8-iscsi devstack@n-api.service[120741]: DEBUG nova.api.openstack.wsgi [None req-5bbe4d0d-5491-4cbd-9552-ba416d7df6aa tempest-AttachVolumeTestJSON-555093534 tempest-AttachVolumeTestJSON-555093534-project] Calling method '>' {{(pid=120741) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 18:02:45.113914 dv-cinder-852009-8-iscsi devstack@n-api.service[120741]: DEBUG nova.compute.api [None req-5bbe4d0d-5491-4cbd-9552-ba416d7df6aa tempest-AttachVolumeTestJSON-555093534 tempest-AttachVolumeTestJSON-555093534-project] [instance: b958d409-df20-44c6-aa0e-58cb0a482edf] Fetching instance by UUID {{(pid=120741) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 18:02:45.127092 dv-cinder-852009-8-iscsi devstack@n-api.service[120741]: DEBUG oslo_concurrency.lockutils [None req-5bbe4d0d-5491-4cbd-9552-ba416d7df6aa tempest-AttachVolumeTestJSON-555093534 tempest-AttachVolumeTestJSON-555093534-project] Acquiring lock "1daf4f4c-0e4a-4779-b53a-78c48397ea2f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120741) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 18:02:45.128039 dv-cinder-852009-8-iscsi devstack@n-api.service[120740]: DEBUG nova.policy [None req-6fdb2a41-4213-4889-aa23-b065b4e51b2f tempest-ServerRescueNegativeTestJSON-412251590 tempest-ServerRescueNegativeTestJSON-412251590-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '60800cf2774e409d9c1b6f4992669991', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2eae4acecf6c4961830ead78d71b2ad3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120740) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 18:02:45.128573 dv-cinder-852009-8-iscsi devstack@n-api.service[120741]: DEBUG oslo_concurrency.lockutils [None req-5bbe4d0d-5491-4cbd-9552-ba416d7df6aa tempest-AttachVolumeTestJSON-555093534 tempest-AttachVolumeTestJSON-555093534-project] Lock "1daf4f4c-0e4a-4779-b53a-78c48397ea2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120741) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 18:02:45.129228 dv-cinder-852009-8-iscsi devstack@n-api.service[120741]: DEBUG oslo_concurrency.lockutils [None req-5bbe4d0d-5491-4cbd-9552-ba416d7df6aa tempest-AttachVolumeTestJSON-555093534 tempest-AttachVolumeTestJSON-555093534-project] Lock "1daf4f4c-0e4a-4779-b53a-78c48397ea2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120741) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 18:02:45.130078 dv-cinder-852009-8-iscsi devstack@n-api.service[120741]: DEBUG oslo_concurrency.lockutils [None req-5bbe4d0d-5491-4cbd-9552-ba416d7df6aa tempest-AttachVolumeTestJSON-555093534 tempest-AttachVolumeTestJSON-555093534-project] Acquiring lock "1daf4f4c-0e4a-4779-b53a-78c48397ea2f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120741) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 18:02:45.130667 dv-cinder-852009-8-iscsi devstack@n-api.service[120741]: DEBUG oslo_concurrency.lockutils [None req-5bbe4d0d-5491-4cbd-9552-ba416d7df6aa tempest-AttachVolumeTestJSON-555093534 tempest-AttachVolumeTestJSON-555093534-project] Lock "1daf4f4c-0e4a-4779-b53a-78c48397ea2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120741) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 18:02:45.131390 dv-cinder-852009-8-iscsi devstack@n-api.service[120741]: DEBUG oslo_concurrency.lockutils [None req-5bbe4d0d-5491-4cbd-9552-ba416d7df6aa tempest-AttachVolumeTestJSON-555093534 tempest-AttachVolumeTestJSON-555093534-project] Lock "1daf4f4c-0e4a-4779-b53a-78c48397ea2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120741) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 18:02:45.135887 dv-cinder-852009-8-iscsi devstack@n-api.service[120740]: INFO nova.api.openstack.requestlog [None req-6fdb2a41-4213-4889-aa23-b065b4e51b2f tempest-ServerRescueNegativeTestJSON-412251590 tempest-ServerRescueNegativeTestJSON-412251590-project] 10.222.0.43 "GET /compute/v2.1/servers/8cd29851-35c1-4032-a137-ab9419a2ec5b" status: 200 len: 1522 microversion: 2.1 time: 0.328450 Sep 13 18:02:45.151367 dv-cinder-852009-8-iscsi devstack@n-api.service[120740]: [pid: 120740|app: 0|req: 69/131] 10.222.0.43 () {58 vars in 1236 bytes} [Tue Sep 13 18:02:44 2022] GET /compute/v2.1/servers/8cd29851-35c1-4032-a137-ab9419a2ec5b => generated 1522 bytes in 345 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 13 18:02:45.321759 dv-cinder-852009-8-iscsi devstack@n-api.service[120741]: DEBUG nova.policy [None req-5bbe4d0d-5491-4cbd-9552-ba416d7df6aa tempest-AttachVolumeTestJSON-555093534 tempest-AttachVolumeTestJSON-555093534-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0625b3113ce044bbac4f6142eaade11c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a279fcbf274c4704a31a2b95061e1469', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120741) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 18:02:45.329731 dv-cinder-852009-8-iscsi devstack@n-api.service[120741]: INFO nova.api.openstack.requestlog [None req-5bbe4d0d-5491-4cbd-9552-ba416d7df6aa tempest-AttachVolumeTestJSON-555093534 tempest-AttachVolumeTestJSON-555093534-project] 10.222.0.43 "GET /compute/v2.1/servers/b958d409-df20-44c6-aa0e-58cb0a482edf" status: 200 len: 1362 microversion: 2.1 time: 0.221449 Sep 13 18:02:45.330313 dv-cinder-852009-8-iscsi devstack@n-api.service[120741]: [pid: 120741|app: 0|req: 63/132] 10.222.0.43 () {58 vars in 1236 bytes} [Tue Sep 13 18:02:45 2022] GET /compute/v2.1/servers/b958d409-df20-44c6-aa0e-58cb0a482edf => generated 1362 bytes in 223 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 13 18:02:46.137657 dv-cinder-852009-8-iscsi devstack@n-api.service[120740]: DEBUG nova.api.openstack.wsgi [None req-ea73b053-a8de-4730-b71d-5f424342b808 tempest-DeleteServersTestJSON-1632919649 tempest-DeleteServersTestJSON-1632919649-project] Calling method '>' {{(pid=120740) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 18:02:46.138429 dv-cinder-852009-8-iscsi devstack@n-api.service[120740]: DEBUG nova.compute.api [None req-ea73b053-a8de-4730-b71d-5f424342b808 tempest-DeleteServersTestJSON-1632919649 tempest-DeleteServersTestJSON-1632919649-project] [instance: 207d1d8d-58a4-4b99-aa09-1c5023c60784] Fetching instance by UUID {{(pid=120740) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 18:02:46.144781 dv-cinder-852009-8-iscsi devstack@n-api.service[120740]: DEBUG oslo_concurrency.lockutils [None req-ea73b053-a8de-4730-b71d-5f424342b808 tempest-DeleteServersTestJSON-1632919649 tempest-DeleteServersTestJSON-1632919649-project] Acquiring lock "1daf4f4c-0e4a-4779-b53a-78c48397ea2f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120740) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 18:02:46.145284 dv-cinder-852009-8-iscsi devstack@n-api.service[120740]: DEBUG oslo_concurrency.lockutils [None req-ea73b053-a8de-4730-b71d-5f424342b808 tempest-DeleteServersTestJSON-1632919649 tempest-DeleteServersTestJSON-1632919649-project] Lock "1daf4f4c-0e4a-4779-b53a-78c48397ea2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120740) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 18:02:46.145695 dv-cinder-852009-8-iscsi devstack@n-api.service[120740]: DEBUG oslo_concurrency.lockutils [None req-ea73b053-a8de-4730-b71d-5f424342b808 tempest-DeleteServersTestJSON-1632919649 tempest-DeleteServersTestJSON-1632919649-project] Lock "1daf4f4c-0e4a-4779-b53a-78c48397ea2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120740) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 18:02:46.146562 dv-cinder-852009-8-iscsi devstack@n-api.service[120740]: DEBUG oslo_concurrency.lockutils [None req-ea73b053-a8de-4730-b71d-5f424342b808 tempest-DeleteServersTestJSON-1632919649 tempest-DeleteServersTestJSON-1632919649-project] Acquiring lock "1daf4f4c-0e4a-4779-b53a-78c48397ea2f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120740) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 18:02:46.146836 dv-cinder-852009-8-iscsi devstack@n-api.service[120740]: DEBUG oslo_concurrency.lockutils [None req-ea73b053-a8de-4730-b71d-5f424342b808 tempest-DeleteServersTestJSON-1632919649 tempest-DeleteServersTestJSON-1632919649-project] Lock "1daf4f4c-0e4a-4779-b53a-78c48397ea2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120740) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 18:02:46.147263 dv-cinder-852009-8-iscsi devstack@n-api.service[120740]: DEBUG oslo_concurrency.lockutils [None req-ea73b053-a8de-4730-b71d-5f424342b808 tempest-DeleteServersTestJSON-1632919649 tempest-DeleteServersTestJSON-1632919649-project] Lock "1daf4f4c-0e4a-4779-b53a-78c48397ea2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120740) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 18:02:46.158560 dv-cinder-852009-8-iscsi devstack@n-api.service[120741]: DEBUG nova.api.openstack.wsgi [None req-8d595782-4d9d-442e-96fe-da68b43a5d5d tempest-ServerRescueNegativeTestJSON-412251590 tempest-ServerRescueNegativeTestJSON-412251590-project] Calling method '>' {{(pid=120741) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 18:02:46.159190 dv-cinder-852009-8-iscsi devstack@n-api.service[120741]: DEBUG nova.compute.api [None req-8d595782-4d9d-442e-96fe-da68b43a5d5d tempest-ServerRescueNegativeTestJSON-412251590 tempest-ServerRescueNegativeTestJSON-412251590-project] [instance: 8cd29851-35c1-4032-a137-ab9419a2ec5b] Fetching instance by UUID {{(pid=120741) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 18:02:46.166577 dv-cinder-852009-8-iscsi devstack@n-api.service[120741]: DEBUG oslo_concurrency.lockutils [None req-8d595782-4d9d-442e-96fe-da68b43a5d5d tempest-ServerRescueNegativeTestJSON-412251590 tempest-ServerRescueNegativeTestJSON-412251590-project] Acquiring lock "1daf4f4c-0e4a-4779-b53a-78c48397ea2f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120741) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 18:02:46.167107 dv-cinder-852009-8-iscsi devstack@n-api.service[120741]: DEBUG oslo_concurrency.lockutils [None req-8d595782-4d9d-442e-96fe-da68b43a5d5d tempest-ServerRescueNegativeTestJSON-412251590 tempest-ServerRescueNegativeTestJSON-412251590-project] Lock "1daf4f4c-0e4a-4779-b53a-78c48397ea2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120741) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 18:02:46.167617 dv-cinder-852009-8-iscsi devstack@n-api.service[120741]: DEBUG oslo_concurrency.lockutils [None req-8d595782-4d9d-442e-96fe-da68b43a5d5d tempest-ServerRescueNegativeTestJSON-412251590 tempest-ServerRescueNegativeTestJSON-412251590-project] Lock "1daf4f4c-0e4a-4779-b53a-78c48397ea2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120741) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 18:02:46.168377 dv-cinder-852009-8-iscsi devstack@n-api.service[120741]: DEBUG oslo_concurrency.lockutils [None req-8d595782-4d9d-442e-96fe-da68b43a5d5d tempest-ServerRescueNegativeTestJSON-412251590 tempest-ServerRescueNegativeTestJSON-412251590-project] Acquiring lock "1daf4f4c-0e4a-4779-b53a-78c48397ea2f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120741) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 18:02:46.168911 dv-cinder-852009-8-iscsi devstack@n-api.service[120741]: DEBUG oslo_concurrency.lockutils [None req-8d595782-4d9d-442e-96fe-da68b43a5d5d tempest-ServerRescueNegativeTestJSON-412251590 tempest-ServerRescueNegativeTestJSON-412251590-project] Lock "1daf4f4c-0e4a-4779-b53a-78c48397ea2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120741) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 18:02:46.169387 dv-cinder-852009-8-iscsi devstack@n-api.service[120741]: DEBUG oslo_concurrency.lockutils [None req-8d595782-4d9d-442e-96fe-da68b43a5d5d tempest-ServerRescueNegativeTestJSON-412251590 tempest-ServerRescueNegativeTestJSON-412251590-project] Lock "1daf4f4c-0e4a-4779-b53a-78c48397ea2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120741) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 18:02:46.402734 dv-cinder-852009-8-iscsi devstack@n-api.service[120740]: DEBUG nova.policy [None req-ea73b053-a8de-4730-b71d-5f424342b808 tempest-DeleteServersTestJSON-1632919649 tempest-DeleteServersTestJSON-1632919649-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '51db5ef052144879b53979268ac4ceb5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '66136f123f5b4ad0a824920bbdf9d245', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120740) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 18:02:46.417496 dv-cinder-852009-8-iscsi devstack@n-api.service[120740]: INFO nova.api.openstack.requestlog [None req-ea73b053-a8de-4730-b71d-5f424342b808 tempest-DeleteServersTestJSON-1632919649 tempest-DeleteServersTestJSON-1632919649-project] 10.222.0.43 "GET /compute/v2.1/servers/207d1d8d-58a4-4b99-aa09-1c5023c60784" status: 200 len: 1500 microversion: 2.1 time: 0.285483 Sep 13 18:02:46.418936 dv-cinder-852009-8-iscsi devstack@n-api.service[120740]: [pid: 120740|app: 0|req: 70/133] 10.222.0.43 () {58 vars in 1236 bytes} [Tue Sep 13 18:02:46 2022] GET /compute/v2.1/servers/207d1d8d-58a4-4b99-aa09-1c5023c60784 => generated 1500 bytes in 290 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 13 18:02:46.426416 dv-cinder-852009-8-iscsi devstack@n-api.service[120740]: DEBUG nova.api.openstack.wsgi [None req-a22923da-70a4-4ac5-9934-1acebd2de13b tempest-AttachVolumeTestJSON-555093534 tempest-AttachVolumeTestJSON-555093534-project] Calling method '>' {{(pid=120740) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 18:02:46.427509 dv-cinder-852009-8-iscsi devstack@n-api.service[120740]: DEBUG nova.compute.api [None req-a22923da-70a4-4ac5-9934-1acebd2de13b tempest-AttachVolumeTestJSON-555093534 tempest-AttachVolumeTestJSON-555093534-project] [instance: b958d409-df20-44c6-aa0e-58cb0a482edf] Fetching instance by UUID {{(pid=120740) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 18:02:46.428068 dv-cinder-852009-8-iscsi devstack@n-api.service[120741]: DEBUG nova.policy [None req-8d595782-4d9d-442e-96fe-da68b43a5d5d tempest-ServerRescueNegativeTestJSON-412251590 tempest-ServerRescueNegativeTestJSON-412251590-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '60800cf2774e409d9c1b6f4992669991', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2eae4acecf6c4961830ead78d71b2ad3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120741) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 18:02:46.437037 dv-cinder-852009-8-iscsi devstack@n-api.service[120740]: DEBUG oslo_concurrency.lockutils [None req-a22923da-70a4-4ac5-9934-1acebd2de13b tempest-AttachVolumeTestJSON-555093534 tempest-AttachVolumeTestJSON-555093534-project] Acquiring lock "1daf4f4c-0e4a-4779-b53a-78c48397ea2f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120740) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 18:02:46.437542 dv-cinder-852009-8-iscsi devstack@n-api.service[120740]: DEBUG oslo_concurrency.lockutils [None req-a22923da-70a4-4ac5-9934-1acebd2de13b tempest-AttachVolumeTestJSON-555093534 tempest-AttachVolumeTestJSON-555093534-project] Lock "1daf4f4c-0e4a-4779-b53a-78c48397ea2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120740) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 18:02:46.437977 dv-cinder-852009-8-iscsi devstack@n-api.service[120740]: DEBUG oslo_concurrency.lockutils [None req-a22923da-70a4-4ac5-9934-1acebd2de13b tempest-AttachVolumeTestJSON-555093534 tempest-AttachVolumeTestJSON-555093534-project] Lock "1daf4f4c-0e4a-4779-b53a-78c48397ea2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120740) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 18:02:46.438684 dv-cinder-852009-8-iscsi devstack@n-api.service[120740]: DEBUG oslo_concurrency.lockutils [None req-a22923da-70a4-4ac5-9934-1acebd2de13b tempest-AttachVolumeTestJSON-555093534 tempest-AttachVolumeTestJSON-555093534-project] Acquiring lock "1daf4f4c-0e4a-4779-b53a-78c48397ea2f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120740) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 18:02:46.438931 dv-cinder-852009-8-iscsi devstack@n-api.service[120741]: INFO nova.api.openstack.requestlog [None req-8d595782-4d9d-442e-96fe-da68b43a5d5d tempest-ServerRescueNegativeTestJSON-412251590 tempest-ServerRescueNegativeTestJSON-412251590-project] 10.222.0.43 "GET /compute/v2.1/servers/8cd29851-35c1-4032-a137-ab9419a2ec5b" status: 200 len: 1522 microversion: 2.1 time: 0.284387 Sep 13 18:02:46.439131 dv-cinder-852009-8-iscsi devstack@n-api.service[120740]: DEBUG oslo_concurrency.lockutils [None req-a22923da-70a4-4ac5-9934-1acebd2de13b tempest-AttachVolumeTestJSON-555093534 tempest-AttachVolumeTestJSON-555093534-project] Lock "1daf4f4c-0e4a-4779-b53a-78c48397ea2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120740) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 18:02:46.439968 dv-cinder-852009-8-iscsi devstack@n-api.service[120740]: DEBUG oslo_concurrency.lockutils [None req-a22923da-70a4-4ac5-9934-1acebd2de13b tempest-AttachVolumeTestJSON-555093534 tempest-AttachVolumeTestJSON-555093534-project] Lock "1daf4f4c-0e4a-4779-b53a-78c48397ea2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120740) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 18:02:46.440086 dv-cinder-852009-8-iscsi devstack@n-api.service[120741]: [pid: 120741|app: 0|req: 64/134] 10.222.0.43 () {58 vars in 1236 bytes} [Tue Sep 13 18:02:46 2022] GET /compute/v2.1/servers/8cd29851-35c1-4032-a137-ab9419a2ec5b => generated 1522 bytes in 287 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 13 18:02:46.687551 dv-cinder-852009-8-iscsi devstack@n-api.service[120740]: DEBUG nova.policy [None req-a22923da-70a4-4ac5-9934-1acebd2de13b tempest-AttachVolumeTestJSON-555093534 tempest-AttachVolumeTestJSON-555093534-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0625b3113ce044bbac4f6142eaade11c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a279fcbf274c4704a31a2b95061e1469', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120740) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 18:02:46.696661 dv-cinder-852009-8-iscsi devstack@n-api.service[120740]: INFO nova.api.openstack.requestlog [None req-a22923da-70a4-4ac5-9934-1acebd2de13b tempest-AttachVolumeTestJSON-555093534 tempest-AttachVolumeTestJSON-555093534-project] 10.222.0.43 "GET /compute/v2.1/servers/b958d409-df20-44c6-aa0e-58cb0a482edf" status: 200 len: 1362 microversion: 2.1 time: 0.275537 Sep 13 18:02:46.697260 dv-cinder-852009-8-iscsi devstack@n-api.service[120740]: [pid: 120740|app: 0|req: 71/135] 10.222.0.43 () {58 vars in 1236 bytes} [Tue Sep 13 18:02:46 2022] GET /compute/v2.1/servers/b958d409-df20-44c6-aa0e-58cb0a482edf => generated 1362 bytes in 278 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 13 18:02:47.462308 dv-cinder-852009-8-iscsi devstack@n-api.service[120741]: DEBUG nova.api.openstack.wsgi [None req-cbdbe137-25f7-48f6-ae57-74b10c457173 tempest-ServerRescueNegativeTestJSON-412251590 tempest-ServerRescueNegativeTestJSON-412251590-project] Calling method '>' {{(pid=120741) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 18:02:47.462904 dv-cinder-852009-8-iscsi devstack@n-api.service[120741]: DEBUG nova.compute.api [None req-cbdbe137-25f7-48f6-ae57-74b10c457173 tempest-ServerRescueNegativeTestJSON-412251590 tempest-ServerRescueNegativeTestJSON-412251590-project] [instance: 8cd29851-35c1-4032-a137-ab9419a2ec5b] Fetching instance by UUID {{(pid=120741) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 18:02:47.469271 dv-cinder-852009-8-iscsi devstack@n-api.service[120741]: DEBUG oslo_concurrency.lockutils [None req-cbdbe137-25f7-48f6-ae57-74b10c457173 tempest-ServerRescueNegativeTestJSON-412251590 tempest-ServerRescueNegativeTestJSON-412251590-project] Acquiring lock "1daf4f4c-0e4a-4779-b53a-78c48397ea2f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120741) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 18:02:47.469794 dv-cinder-852009-8-iscsi devstack@n-api.service[120741]: DEBUG oslo_concurrency.lockutils [None req-cbdbe137-25f7-48f6-ae57-74b10c457173 tempest-ServerRescueNegativeTestJSON-412251590 tempest-ServerRescueNegativeTestJSON-412251590-project] Lock "1daf4f4c-0e4a-4779-b53a-78c48397ea2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120741) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 18:02:47.470173 dv-cinder-852009-8-iscsi devstack@n-api.service[120741]: DEBUG oslo_concurrency.lockutils [None req-cbdbe137-25f7-48f6-ae57-74b10c457173 tempest-ServerRescueNegativeTestJSON-412251590 tempest-ServerRescueNegativeTestJSON-412251590-project] Lock "1daf4f4c-0e4a-4779-b53a-78c48397ea2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120741) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 18:02:47.471141 dv-cinder-852009-8-iscsi devstack@n-api.service[120741]: DEBUG oslo_concurrency.lockutils [None req-cbdbe137-25f7-48f6-ae57-74b10c457173 tempest-ServerRescueNegativeTestJSON-412251590 tempest-ServerRescueNegativeTestJSON-412251590-project] Acquiring lock "1daf4f4c-0e4a-4779-b53a-78c48397ea2f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120741) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 18:02:47.471738 dv-cinder-852009-8-iscsi devstack@n-api.service[120741]: DEBUG oslo_concurrency.lockutils [None req-cbdbe137-25f7-48f6-ae57-74b10c457173 tempest-ServerRescueNegativeTestJSON-412251590 tempest-ServerRescueNegativeTestJSON-412251590-project] Lock "1daf4f4c-0e4a-4779-b53a-78c48397ea2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120741) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 18:02:47.472302 dv-cinder-852009-8-iscsi devstack@n-api.service[120741]: DEBUG oslo_concurrency.lockutils [None req-cbdbe137-25f7-48f6-ae57-74b10c457173 tempest-ServerRescueNegativeTestJSON-412251590 tempest-ServerRescueNegativeTestJSON-412251590-project] Lock "1daf4f4c-0e4a-4779-b53a-78c48397ea2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120741) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 18:02:47.653995 dv-cinder-852009-8-iscsi devstack@n-api.service[120741]: DEBUG nova.policy [None req-cbdbe137-25f7-48f6-ae57-74b10c457173 tempest-ServerRescueNegativeTestJSON-412251590 tempest-ServerRescueNegativeTestJSON-412251590-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '60800cf2774e409d9c1b6f4992669991', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2eae4acecf6c4961830ead78d71b2ad3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120741) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 18:02:47.662024 dv-cinder-852009-8-iscsi devstack@n-api.service[120741]: INFO nova.api.openstack.requestlog [None req-cbdbe137-25f7-48f6-ae57-74b10c457173 tempest-ServerRescueNegativeTestJSON-412251590 tempest-ServerRescueNegativeTestJSON-412251590-project] 10.222.0.43 "GET /compute/v2.1/servers/8cd29851-35c1-4032-a137-ab9419a2ec5b" status: 200 len: 1522 microversion: 2.1 time: 0.203641 Sep 13 18:02:47.662631 dv-cinder-852009-8-iscsi devstack@n-api.service[120741]: [pid: 120741|app: 0|req: 65/136] 10.222.0.43 () {58 vars in 1236 bytes} [Tue Sep 13 18:02:47 2022] GET /compute/v2.1/servers/8cd29851-35c1-4032-a137-ab9419a2ec5b => generated 1522 bytes in 205 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 13 18:02:47.721583 dv-cinder-852009-8-iscsi devstack@n-api.service[120740]: DEBUG nova.api.openstack.wsgi [None req-bbd140f3-c15f-40ee-ade9-bd1fe838483f tempest-AttachVolumeTestJSON-555093534 tempest-AttachVolumeTestJSON-555093534-project] Calling method '>' {{(pid=120740) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 18:02:47.722161 dv-cinder-852009-8-iscsi devstack@n-api.service[120740]: DEBUG nova.compute.api [None req-bbd140f3-c15f-40ee-ade9-bd1fe838483f tempest-AttachVolumeTestJSON-555093534 tempest-AttachVolumeTestJSON-555093534-project] [instance: b958d409-df20-44c6-aa0e-58cb0a482edf] Fetching instance by UUID {{(pid=120740) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 18:02:47.728524 dv-cinder-852009-8-iscsi devstack@n-api.service[120740]: DEBUG oslo_concurrency.lockutils [None req-bbd140f3-c15f-40ee-ade9-bd1fe838483f tempest-AttachVolumeTestJSON-555093534 tempest-AttachVolumeTestJSON-555093534-project] Acquiring lock "1daf4f4c-0e4a-4779-b53a-78c48397ea2f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120740) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 18:02:47.729016 dv-cinder-852009-8-iscsi devstack@n-api.service[120740]: DEBUG oslo_concurrency.lockutils [None req-bbd140f3-c15f-40ee-ade9-bd1fe838483f tempest-AttachVolumeTestJSON-555093534 tempest-AttachVolumeTestJSON-555093534-project] Lock "1daf4f4c-0e4a-4779-b53a-78c48397ea2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120740) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 18:02:47.729440 dv-cinder-852009-8-iscsi devstack@n-api.service[120740]: DEBUG oslo_concurrency.lockutils [None req-bbd140f3-c15f-40ee-ade9-bd1fe838483f tempest-AttachVolumeTestJSON-555093534 tempest-AttachVolumeTestJSON-555093534-project] Lock "1daf4f4c-0e4a-4779-b53a-78c48397ea2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120740) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 18:02:47.730334 dv-cinder-852009-8-iscsi devstack@n-api.service[120740]: DEBUG oslo_concurrency.lockutils [None req-bbd140f3-c15f-40ee-ade9-bd1fe838483f tempest-AttachVolumeTestJSON-555093534 tempest-AttachVolumeTestJSON-555093534-project] Acquiring lock "1daf4f4c-0e4a-4779-b53a-78c48397ea2f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120740) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 18:02:47.730779 dv-cinder-852009-8-iscsi devstack@n-api.service[120740]: DEBUG oslo_concurrency.lockutils [None req-bbd140f3-c15f-40ee-ade9-bd1fe838483f tempest-AttachVolumeTestJSON-555093534 tempest-AttachVolumeTestJSON-555093534-project] Lock "1daf4f4c-0e4a-4779-b53a-78c48397ea2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120740) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 18:02:47.731194 dv-cinder-852009-8-iscsi devstack@n-api.service[120740]: DEBUG oslo_concurrency.lockutils [None req-bbd140f3-c15f-40ee-ade9-bd1fe838483f tempest-AttachVolumeTestJSON-555093534 tempest-AttachVolumeTestJSON-555093534-project] Lock "1daf4f4c-0e4a-4779-b53a-78c48397ea2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120740) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 18:02:47.886649 dv-cinder-852009-8-iscsi devstack@n-api.service[120740]: DEBUG nova.policy [None req-bbd140f3-c15f-40ee-ade9-bd1fe838483f tempest-AttachVolumeTestJSON-555093534 tempest-AttachVolumeTestJSON-555093534-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0625b3113ce044bbac4f6142eaade11c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a279fcbf274c4704a31a2b95061e1469', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120740) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 18:02:47.890553 dv-cinder-852009-8-iscsi devstack@n-api.service[120740]: DEBUG dbcounter [-] [120740] Writing DB stats nova_cell1:SELECT=97,nova_cell1:UPDATE=2,nova_cell1:INSERT=1 {{(pid=120740) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 18:02:47.895728 dv-cinder-852009-8-iscsi devstack@n-api.service[120740]: INFO nova.api.openstack.requestlog [None req-bbd140f3-c15f-40ee-ade9-bd1fe838483f tempest-AttachVolumeTestJSON-555093534 tempest-AttachVolumeTestJSON-555093534-project] 10.222.0.43 "GET /compute/v2.1/servers/b958d409-df20-44c6-aa0e-58cb0a482edf" status: 200 len: 1362 microversion: 2.1 time: 0.178271 Sep 13 18:02:47.896367 dv-cinder-852009-8-iscsi devstack@n-api.service[120740]: [pid: 120740|app: 0|req: 72/137] 10.222.0.43 () {58 vars in 1236 bytes} [Tue Sep 13 18:02:47 2022] GET /compute/v2.1/servers/b958d409-df20-44c6-aa0e-58cb0a482edf => generated 1362 bytes in 180 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 13 18:02:48.686037 dv-cinder-852009-8-iscsi devstack@n-api.service[120741]: DEBUG nova.api.openstack.wsgi [None req-5cdbf17e-00a6-4787-b0e4-71ddd4b7e0ab tempest-ServerRescueNegativeTestJSON-412251590 tempest-ServerRescueNegativeTestJSON-412251590-project] Calling method '>' {{(pid=120741) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 18:02:48.686996 dv-cinder-852009-8-iscsi devstack@n-api.service[120741]: DEBUG nova.compute.api [None req-5cdbf17e-00a6-4787-b0e4-71ddd4b7e0ab tempest-ServerRescueNegativeTestJSON-412251590 tempest-ServerRescueNegativeTestJSON-412251590-project] [instance: 8cd29851-35c1-4032-a137-ab9419a2ec5b] Fetching instance by UUID {{(pid=120741) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 18:02:48.688975 dv-cinder-852009-8-iscsi devstack@n-api.service[120741]: DEBUG dbcounter [-] [120741] Writing DB stats nova_api:SELECT=94 {{(pid=120741) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 18:02:48.694477 dv-cinder-852009-8-iscsi devstack@n-api.service[120741]: DEBUG oslo_concurrency.lockutils [None req-5cdbf17e-00a6-4787-b0e4-71ddd4b7e0ab tempest-ServerRescueNegativeTestJSON-412251590 tempest-ServerRescueNegativeTestJSON-412251590-project] Acquiring lock "1daf4f4c-0e4a-4779-b53a-78c48397ea2f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120741) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 18:02:48.695069 dv-cinder-852009-8-iscsi devstack@n-api.service[120741]: DEBUG oslo_concurrency.lockutils [None req-5cdbf17e-00a6-4787-b0e4-71ddd4b7e0ab tempest-ServerRescueNegativeTestJSON-412251590 tempest-ServerRescueNegativeTestJSON-412251590-project] Lock "1daf4f4c-0e4a-4779-b53a-78c48397ea2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120741) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 18:02:48.695612 dv-cinder-852009-8-iscsi devstack@n-api.service[120741]: DEBUG oslo_concurrency.lockutils [None req-5cdbf17e-00a6-4787-b0e4-71ddd4b7e0ab tempest-ServerRescueNegativeTestJSON-412251590 tempest-ServerRescueNegativeTestJSON-412251590-project] Lock "1daf4f4c-0e4a-4779-b53a-78c48397ea2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120741) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 18:02:48.696384 dv-cinder-852009-8-iscsi devstack@n-api.service[120741]: DEBUG oslo_concurrency.lockutils [None req-5cdbf17e-00a6-4787-b0e4-71ddd4b7e0ab tempest-ServerRescueNegativeTestJSON-412251590 tempest-ServerRescueNegativeTestJSON-412251590-project] Acquiring lock "1daf4f4c-0e4a-4779-b53a-78c48397ea2f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120741) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 18:02:48.697084 dv-cinder-852009-8-iscsi devstack@n-api.service[120741]: DEBUG oslo_concurrency.lockutils [None req-5cdbf17e-00a6-4787-b0e4-71ddd4b7e0ab tempest-ServerRescueNegativeTestJSON-412251590 tempest-ServerRescueNegativeTestJSON-412251590-project] Lock "1daf4f4c-0e4a-4779-b53a-78c48397ea2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120741) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 18:02:48.697504 dv-cinder-852009-8-iscsi devstack@n-api.service[120741]: DEBUG oslo_concurrency.lockutils [None req-5cdbf17e-00a6-4787-b0e4-71ddd4b7e0ab tempest-ServerRescueNegativeTestJSON-412251590 tempest-ServerRescueNegativeTestJSON-412251590-project] Lock "1daf4f4c-0e4a-4779-b53a-78c48397ea2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120741) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 18:02:48.845416 dv-cinder-852009-8-iscsi devstack@n-api.service[120741]: DEBUG nova.policy [None req-5cdbf17e-00a6-4787-b0e4-71ddd4b7e0ab tempest-ServerRescueNegativeTestJSON-412251590 tempest-ServerRescueNegativeTestJSON-412251590-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '60800cf2774e409d9c1b6f4992669991', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2eae4acecf6c4961830ead78d71b2ad3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120741) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 18:02:48.854027 dv-cinder-852009-8-iscsi devstack@n-api.service[120741]: INFO nova.api.openstack.requestlog [None req-5cdbf17e-00a6-4787-b0e4-71ddd4b7e0ab tempest-ServerRescueNegativeTestJSON-412251590 tempest-ServerRescueNegativeTestJSON-412251590-project] 10.222.0.43 "GET /compute/v2.1/servers/8cd29851-35c1-4032-a137-ab9419a2ec5b" status: 200 len: 1522 microversion: 2.1 time: 0.171847 Sep 13 18:02:48.854605 dv-cinder-852009-8-iscsi devstack@n-api.service[120741]: [pid: 120741|app: 0|req: 66/138] 10.222.0.43 () {58 vars in 1236 bytes} [Tue Sep 13 18:02:48 2022] GET /compute/v2.1/servers/8cd29851-35c1-4032-a137-ab9419a2ec5b => generated 1522 bytes in 173 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 13 18:02:48.918724 dv-cinder-852009-8-iscsi devstack@n-api.service[120740]: DEBUG nova.api.openstack.wsgi [None req-e5242440-960a-470f-aabe-1b55dfb19a6d tempest-AttachVolumeTestJSON-555093534 tempest-AttachVolumeTestJSON-555093534-project] Calling method '>' {{(pid=120740) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 18:02:48.919346 dv-cinder-852009-8-iscsi devstack@n-api.service[120740]: DEBUG nova.compute.api [None req-e5242440-960a-470f-aabe-1b55dfb19a6d tempest-AttachVolumeTestJSON-555093534 tempest-AttachVolumeTestJSON-555093534-project] [instance: b958d409-df20-44c6-aa0e-58cb0a482edf] Fetching instance by UUID {{(pid=120740) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 18:02:48.926267 dv-cinder-852009-8-iscsi devstack@n-api.service[120740]: DEBUG oslo_concurrency.lockutils [None req-e5242440-960a-470f-aabe-1b55dfb19a6d tempest-AttachVolumeTestJSON-555093534 tempest-AttachVolumeTestJSON-555093534-project] Acquiring lock "1daf4f4c-0e4a-4779-b53a-78c48397ea2f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120740) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 18:02:48.926856 dv-cinder-852009-8-iscsi devstack@n-api.service[120740]: DEBUG oslo_concurrency.lockutils [None req-e5242440-960a-470f-aabe-1b55dfb19a6d tempest-AttachVolumeTestJSON-555093534 tempest-AttachVolumeTestJSON-555093534-project] Lock "1daf4f4c-0e4a-4779-b53a-78c48397ea2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120740) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 18:02:48.927293 dv-cinder-852009-8-iscsi devstack@n-api.service[120740]: DEBUG oslo_concurrency.lockutils [None req-e5242440-960a-470f-aabe-1b55dfb19a6d tempest-AttachVolumeTestJSON-555093534 tempest-AttachVolumeTestJSON-555093534-project] Lock "1daf4f4c-0e4a-4779-b53a-78c48397ea2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120740) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 18:02:48.927966 dv-cinder-852009-8-iscsi devstack@n-api.service[120740]: DEBUG oslo_concurrency.lockutils [None req-e5242440-960a-470f-aabe-1b55dfb19a6d tempest-AttachVolumeTestJSON-555093534 tempest-AttachVolumeTestJSON-555093534-project] Acquiring lock "1daf4f4c-0e4a-4779-b53a-78c48397ea2f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120740) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 18:02:48.928503 dv-cinder-852009-8-iscsi devstack@n-api.service[120740]: DEBUG oslo_concurrency.lockutils [None req-e5242440-960a-470f-aabe-1b55dfb19a6d tempest-AttachVolumeTestJSON-555093534 tempest-AttachVolumeTestJSON-555093534-project] Lock "1daf4f4c-0e4a-4779-b53a-78c48397ea2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120740) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 18:02:48.928918 dv-cinder-852009-8-iscsi devstack@n-api.service[120740]: DEBUG oslo_concurrency.lockutils [None req-e5242440-960a-470f-aabe-1b55dfb19a6d tempest-AttachVolumeTestJSON-555093534 tempest-AttachVolumeTestJSON-555093534-project] Lock "1daf4f4c-0e4a-4779-b53a-78c48397ea2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120740) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 18:02:49.067390 dv-cinder-852009-8-iscsi devstack@n-api.service[120740]: DEBUG nova.policy [None req-e5242440-960a-470f-aabe-1b55dfb19a6d tempest-AttachVolumeTestJSON-555093534 tempest-AttachVolumeTestJSON-555093534-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0625b3113ce044bbac4f6142eaade11c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a279fcbf274c4704a31a2b95061e1469', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120740) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 18:02:49.076128 dv-cinder-852009-8-iscsi devstack@n-api.service[120740]: INFO nova.api.openstack.requestlog [None req-e5242440-960a-470f-aabe-1b55dfb19a6d tempest-AttachVolumeTestJSON-555093534 tempest-AttachVolumeTestJSON-555093534-project] 10.222.0.43 "GET /compute/v2.1/servers/b958d409-df20-44c6-aa0e-58cb0a482edf" status: 200 len: 1362 microversion: 2.1 time: 0.161888 Sep 13 18:02:49.076742 dv-cinder-852009-8-iscsi devstack@n-api.service[120740]: [pid: 120740|app: 0|req: 73/139] 10.222.0.43 () {58 vars in 1236 bytes} [Tue Sep 13 18:02:48 2022] GET /compute/v2.1/servers/b958d409-df20-44c6-aa0e-58cb0a482edf => generated 1362 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 13 18:02:49.880761 dv-cinder-852009-8-iscsi devstack@n-api.service[120741]: DEBUG nova.api.openstack.wsgi [None req-a4dadbf3-3dcc-4bd2-bce0-6ef8e58671c0 tempest-ServerRescueNegativeTestJSON-412251590 tempest-ServerRescueNegativeTestJSON-412251590-project] Calling method '>' {{(pid=120741) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 18:02:49.881541 dv-cinder-852009-8-iscsi devstack@n-api.service[120741]: DEBUG nova.compute.api [None req-a4dadbf3-3dcc-4bd2-bce0-6ef8e58671c0 tempest-ServerRescueNegativeTestJSON-412251590 tempest-ServerRescueNegativeTestJSON-412251590-project] [instance: 8cd29851-35c1-4032-a137-ab9419a2ec5b] Fetching instance by UUID {{(pid=120741) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 18:02:49.887990 dv-cinder-852009-8-iscsi devstack@n-api.service[120741]: DEBUG oslo_concurrency.lockutils [None req-a4dadbf3-3dcc-4bd2-bce0-6ef8e58671c0 tempest-ServerRescueNegativeTestJSON-412251590 tempest-ServerRescueNegativeTestJSON-412251590-project] Acquiring lock "1daf4f4c-0e4a-4779-b53a-78c48397ea2f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120741) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 18:02:49.888460 dv-cinder-852009-8-iscsi devstack@n-api.service[120741]: DEBUG oslo_concurrency.lockutils [None req-a4dadbf3-3dcc-4bd2-bce0-6ef8e58671c0 tempest-ServerRescueNegativeTestJSON-412251590 tempest-ServerRescueNegativeTestJSON-412251590-project] Lock "1daf4f4c-0e4a-4779-b53a-78c48397ea2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120741) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 18:02:49.888910 dv-cinder-852009-8-iscsi devstack@n-api.service[120741]: DEBUG oslo_concurrency.lockutils [None req-a4dadbf3-3dcc-4bd2-bce0-6ef8e58671c0 tempest-ServerRescueNegativeTestJSON-412251590 tempest-ServerRescueNegativeTestJSON-412251590-project] Lock "1daf4f4c-0e4a-4779-b53a-78c48397ea2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120741) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 18:02:49.889590 dv-cinder-852009-8-iscsi devstack@n-api.service[120741]: DEBUG oslo_concurrency.lockutils [None req-a4dadbf3-3dcc-4bd2-bce0-6ef8e58671c0 tempest-ServerRescueNegativeTestJSON-412251590 tempest-ServerRescueNegativeTestJSON-412251590-project] Acquiring lock "1daf4f4c-0e4a-4779-b53a-78c48397ea2f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120741) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 18:02:49.890038 dv-cinder-852009-8-iscsi devstack@n-api.service[120741]: DEBUG oslo_concurrency.lockutils [None req-a4dadbf3-3dcc-4bd2-bce0-6ef8e58671c0 tempest-ServerRescueNegativeTestJSON-412251590 tempest-ServerRescueNegativeTestJSON-412251590-project] Lock "1daf4f4c-0e4a-4779-b53a-78c48397ea2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120741) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 18:02:49.890436 dv-cinder-852009-8-iscsi devstack@n-api.service[120741]: DEBUG oslo_concurrency.lockutils [None req-a4dadbf3-3dcc-4bd2-bce0-6ef8e58671c0 tempest-ServerRescueNegativeTestJSON-412251590 tempest-ServerRescueNegativeTestJSON-412251590-project] Lock "1daf4f4c-0e4a-4779-b53a-78c48397ea2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120741) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 18:02:50.025107 dv-cinder-852009-8-iscsi devstack@n-api.service[120741]: DEBUG nova.policy [None req-a4dadbf3-3dcc-4bd2-bce0-6ef8e58671c0 tempest-ServerRescueNegativeTestJSON-412251590 tempest-ServerRescueNegativeTestJSON-412251590-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '60800cf2774e409d9c1b6f4992669991', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2eae4acecf6c4961830ead78d71b2ad3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120741) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 18:02:50.033452 dv-cinder-852009-8-iscsi devstack@n-api.service[120741]: INFO nova.api.openstack.requestlog [None req-a4dadbf3-3dcc-4bd2-bce0-6ef8e58671c0 tempest-ServerRescueNegativeTestJSON-412251590 tempest-ServerRescueNegativeTestJSON-412251590-project] 10.222.0.43 "GET /compute/v2.1/servers/8cd29851-35c1-4032-a137-ab9419a2ec5b" status: 200 len: 1522 microversion: 2.1 time: 0.159255 Sep 13 18:02:50.034023 dv-cinder-852009-8-iscsi devstack@n-api.service[120741]: [pid: 120741|app: 0|req: 67/140] 10.222.0.43 () {58 vars in 1236 bytes} [Tue Sep 13 18:02:49 2022] GET /compute/v2.1/servers/8cd29851-35c1-4032-a137-ab9419a2ec5b => generated 1522 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 13 18:02:50.103431 dv-cinder-852009-8-iscsi devstack@n-api.service[120740]: DEBUG nova.api.openstack.wsgi [None req-5f2b5771-d283-447c-9e47-50337967b57a tempest-AttachVolumeTestJSON-555093534 tempest-AttachVolumeTestJSON-555093534-project] Calling method '>' {{(pid=120740) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 18:02:50.104012 dv-cinder-852009-8-iscsi devstack@n-api.service[120740]: DEBUG nova.compute.api [None req-5f2b5771-d283-447c-9e47-50337967b57a tempest-AttachVolumeTestJSON-555093534 tempest-AttachVolumeTestJSON-555093534-project] [instance: b958d409-df20-44c6-aa0e-58cb0a482edf] Fetching instance by UUID {{(pid=120740) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 18:02:50.106699 dv-cinder-852009-8-iscsi devstack@n-api.service[120740]: DEBUG dbcounter [-] [120740] Writing DB stats nova_api:SELECT=90 {{(pid=120740) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 18:02:50.114140 dv-cinder-852009-8-iscsi devstack@n-api.service[120740]: DEBUG oslo_concurrency.lockutils [None req-5f2b5771-d283-447c-9e47-50337967b57a tempest-AttachVolumeTestJSON-555093534 tempest-AttachVolumeTestJSON-555093534-project] Acquiring lock "1daf4f4c-0e4a-4779-b53a-78c48397ea2f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120740) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 18:02:50.114894 dv-cinder-852009-8-iscsi devstack@n-api.service[120740]: DEBUG oslo_concurrency.lockutils [None req-5f2b5771-d283-447c-9e47-50337967b57a tempest-AttachVolumeTestJSON-555093534 tempest-AttachVolumeTestJSON-555093534-project] Lock "1daf4f4c-0e4a-4779-b53a-78c48397ea2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120740) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 18:02:50.115581 dv-cinder-852009-8-iscsi devstack@n-api.service[120740]: DEBUG oslo_concurrency.lockutils [None req-5f2b5771-d283-447c-9e47-50337967b57a tempest-AttachVolumeTestJSON-555093534 tempest-AttachVolumeTestJSON-555093534-project] Lock "1daf4f4c-0e4a-4779-b53a-78c48397ea2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120740) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 18:02:50.116452 dv-cinder-852009-8-iscsi devstack@n-api.service[120740]: DEBUG oslo_concurrency.lockutils [None req-5f2b5771-d283-447c-9e47-50337967b57a tempest-AttachVolumeTestJSON-555093534 tempest-AttachVolumeTestJSON-555093534-project] Acquiring lock "1daf4f4c-0e4a-4779-b53a-78c48397ea2f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120740) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 18:02:50.116907 dv-cinder-852009-8-iscsi devstack@n-api.service[120740]: DEBUG oslo_concurrency.lockutils [None req-5f2b5771-d283-447c-9e47-50337967b57a tempest-AttachVolumeTestJSON-555093534 tempest-AttachVolumeTestJSON-555093534-project] Lock "1daf4f4c-0e4a-4779-b53a-78c48397ea2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120740) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 18:02:50.117301 dv-cinder-852009-8-iscsi devstack@n-api.service[120740]: DEBUG oslo_concurrency.lockutils [None req-5f2b5771-d283-447c-9e47-50337967b57a tempest-AttachVolumeTestJSON-555093534 tempest-AttachVolumeTestJSON-555093534-project] Lock "1daf4f4c-0e4a-4779-b53a-78c48397ea2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120740) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 18:02:50.258394 dv-cinder-852009-8-iscsi devstack@n-api.service[120740]: DEBUG nova.policy [None req-5f2b5771-d283-447c-9e47-50337967b57a tempest-AttachVolumeTestJSON-555093534 tempest-AttachVolumeTestJSON-555093534-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0625b3113ce044bbac4f6142eaade11c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a279fcbf274c4704a31a2b95061e1469', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120740) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 18:02:50.266446 dv-cinder-852009-8-iscsi devstack@n-api.service[120740]: INFO nova.api.openstack.requestlog [None req-5f2b5771-d283-447c-9e47-50337967b57a tempest-AttachVolumeTestJSON-555093534 tempest-AttachVolumeTestJSON-555093534-project] 10.222.0.43 "GET /compute/v2.1/servers/b958d409-df20-44c6-aa0e-58cb0a482edf" status: 200 len: 1362 microversion: 2.1 time: 0.169048 Sep 13 18:02:50.267032 dv-cinder-852009-8-iscsi devstack@n-api.service[120740]: [pid: 120740|app: 0|req: 74/141] 10.222.0.43 () {58 vars in 1236 bytes} [Tue Sep 13 18:02:50 2022] GET /compute/v2.1/servers/b958d409-df20-44c6-aa0e-58cb0a482edf => generated 1362 bytes in 171 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 13 18:02:51.056632 dv-cinder-852009-8-iscsi devstack@n-api.service[120741]: DEBUG nova.api.openstack.wsgi [None req-c1f7b18f-943c-4111-9342-f11050d6a232 tempest-ServerRescueNegativeTestJSON-412251590 tempest-ServerRescueNegativeTestJSON-412251590-project] Calling method '>' {{(pid=120741) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 18:02:51.057245 dv-cinder-852009-8-iscsi devstack@n-api.service[120741]: DEBUG nova.compute.api [None req-c1f7b18f-943c-4111-9342-f11050d6a232 tempest-ServerRescueNegativeTestJSON-412251590 tempest-ServerRescueNegativeTestJSON-412251590-project] [instance: 8cd29851-35c1-4032-a137-ab9419a2ec5b] Fetching instance by UUID {{(pid=120741) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 18:02:51.063439 dv-cinder-852009-8-iscsi devstack@n-api.service[120741]: DEBUG oslo_concurrency.lockutils [None req-c1f7b18f-943c-4111-9342-f11050d6a232 tempest-ServerRescueNegativeTestJSON-412251590 tempest-ServerRescueNegativeTestJSON-412251590-project] Acquiring lock "1daf4f4c-0e4a-4779-b53a-78c48397ea2f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120741) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 18:02:51.063935 dv-cinder-852009-8-iscsi devstack@n-api.service[120741]: DEBUG oslo_concurrency.lockutils [None req-c1f7b18f-943c-4111-9342-f11050d6a232 tempest-ServerRescueNegativeTestJSON-412251590 tempest-ServerRescueNegativeTestJSON-412251590-project] Lock "1daf4f4c-0e4a-4779-b53a-78c48397ea2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120741) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 18:02:51.064353 dv-cinder-852009-8-iscsi devstack@n-api.service[120741]: DEBUG oslo_concurrency.lockutils [None req-c1f7b18f-943c-4111-9342-f11050d6a232 tempest-ServerRescueNegativeTestJSON-412251590 tempest-ServerRescueNegativeTestJSON-412251590-project] Lock "1daf4f4c-0e4a-4779-b53a-78c48397ea2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120741) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 18:02:51.065080 dv-cinder-852009-8-iscsi devstack@n-api.service[120741]: DEBUG oslo_concurrency.lockutils [None req-c1f7b18f-943c-4111-9342-f11050d6a232 tempest-ServerRescueNegativeTestJSON-412251590 tempest-ServerRescueNegativeTestJSON-412251590-project] Acquiring lock "1daf4f4c-0e4a-4779-b53a-78c48397ea2f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120741) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 18:02:51.065831 dv-cinder-852009-8-iscsi devstack@n-api.service[120741]: DEBUG oslo_concurrency.lockutils [None req-c1f7b18f-943c-4111-9342-f11050d6a232 tempest-ServerRescueNegativeTestJSON-412251590 tempest-ServerRescueNegativeTestJSON-412251590-project] Lock "1daf4f4c-0e4a-4779-b53a-78c48397ea2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120741) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 18:02:51.065986 dv-cinder-852009-8-iscsi devstack@n-api.service[120741]: DEBUG oslo_concurrency.lockutils [None req-c1f7b18f-943c-4111-9342-f11050d6a232 tempest-ServerRescueNegativeTestJSON-412251590 tempest-ServerRescueNegativeTestJSON-412251590-project] Lock "1daf4f4c-0e4a-4779-b53a-78c48397ea2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120741) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 18:02:51.248984 dv-cinder-852009-8-iscsi devstack@n-api.service[120741]: DEBUG nova.policy [None req-c1f7b18f-943c-4111-9342-f11050d6a232 tempest-ServerRescueNegativeTestJSON-412251590 tempest-ServerRescueNegativeTestJSON-412251590-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '60800cf2774e409d9c1b6f4992669991', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2eae4acecf6c4961830ead78d71b2ad3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120741) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 18:02:51.259865 dv-cinder-852009-8-iscsi devstack@n-api.service[120741]: INFO nova.api.openstack.requestlog [None req-c1f7b18f-943c-4111-9342-f11050d6a232 tempest-ServerRescueNegativeTestJSON-412251590 tempest-ServerRescueNegativeTestJSON-412251590-project] 10.222.0.43 "GET /compute/v2.1/servers/8cd29851-35c1-4032-a137-ab9419a2ec5b" status: 200 len: 1522 microversion: 2.1 time: 0.207389 Sep 13 18:02:51.261148 dv-cinder-852009-8-iscsi devstack@n-api.service[120741]: [pid: 120741|app: 0|req: 68/142] 10.222.0.43 () {58 vars in 1236 bytes} [Tue Sep 13 18:02:51 2022] GET /compute/v2.1/servers/8cd29851-35c1-4032-a137-ab9419a2ec5b => generated 1522 bytes in 209 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 13 18:02:51.290048 dv-cinder-852009-8-iscsi devstack@n-api.service[120740]: DEBUG nova.api.openstack.wsgi [None req-4d98c415-f02d-42de-bc73-551cf6caec49 tempest-AttachVolumeTestJSON-555093534 tempest-AttachVolumeTestJSON-555093534-project] Calling method '>' {{(pid=120740) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 18:02:51.290718 dv-cinder-852009-8-iscsi devstack@n-api.service[120740]: DEBUG nova.compute.api [None req-4d98c415-f02d-42de-bc73-551cf6caec49 tempest-AttachVolumeTestJSON-555093534 tempest-AttachVolumeTestJSON-555093534-project] [instance: b958d409-df20-44c6-aa0e-58cb0a482edf] Fetching instance by UUID {{(pid=120740) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 18:02:51.297400 dv-cinder-852009-8-iscsi devstack@n-api.service[120740]: DEBUG oslo_concurrency.lockutils [None req-4d98c415-f02d-42de-bc73-551cf6caec49 tempest-AttachVolumeTestJSON-555093534 tempest-AttachVolumeTestJSON-555093534-project] Acquiring lock "1daf4f4c-0e4a-4779-b53a-78c48397ea2f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120740) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 18:02:51.297891 dv-cinder-852009-8-iscsi devstack@n-api.service[120740]: DEBUG oslo_concurrency.lockutils [None req-4d98c415-f02d-42de-bc73-551cf6caec49 tempest-AttachVolumeTestJSON-555093534 tempest-AttachVolumeTestJSON-555093534-project] Lock "1daf4f4c-0e4a-4779-b53a-78c48397ea2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120740) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 18:02:51.298336 dv-cinder-852009-8-iscsi devstack@n-api.service[120740]: DEBUG oslo_concurrency.lockutils [None req-4d98c415-f02d-42de-bc73-551cf6caec49 tempest-AttachVolumeTestJSON-555093534 tempest-AttachVolumeTestJSON-555093534-project] Lock "1daf4f4c-0e4a-4779-b53a-78c48397ea2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120740) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 18:02:51.299031 dv-cinder-852009-8-iscsi devstack@n-api.service[120740]: DEBUG oslo_concurrency.lockutils [None req-4d98c415-f02d-42de-bc73-551cf6caec49 tempest-AttachVolumeTestJSON-555093534 tempest-AttachVolumeTestJSON-555093534-project] Acquiring lock "1daf4f4c-0e4a-4779-b53a-78c48397ea2f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120740) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 18:02:51.299473 dv-cinder-852009-8-iscsi devstack@n-api.service[120740]: DEBUG oslo_concurrency.lockutils [None req-4d98c415-f02d-42de-bc73-551cf6caec49 tempest-AttachVolumeTestJSON-555093534 tempest-AttachVolumeTestJSON-555093534-project] Lock "1daf4f4c-0e4a-4779-b53a-78c48397ea2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120740) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 18:02:51.299890 dv-cinder-852009-8-iscsi devstack@n-api.service[120740]: DEBUG oslo_concurrency.lockutils [None req-4d98c415-f02d-42de-bc73-551cf6caec49 tempest-AttachVolumeTestJSON-555093534 tempest-AttachVolumeTestJSON-555093534-project] Lock "1daf4f4c-0e4a-4779-b53a-78c48397ea2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120740) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 18:02:51.378052 dv-cinder-852009-8-iscsi devstack@n-api.service[120741]: DEBUG nova.api.openstack.wsgi [None req-ca048ce4-a96e-443a-9aa8-6fbf88c6ee8a tempest-DeleteServersTestJSON-1632919649 tempest-DeleteServersTestJSON-1632919649-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "2cd127e2-fe26-43ed-a89b-62557ad9857f"}} {{(pid=120741) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 13 18:02:51.380671 dv-cinder-852009-8-iscsi devstack@n-api.service[120741]: DEBUG nova.compute.api [None req-ca048ce4-a96e-443a-9aa8-6fbf88c6ee8a tempest-DeleteServersTestJSON-1632919649 tempest-DeleteServersTestJSON-1632919649-project] [instance: 207d1d8d-58a4-4b99-aa09-1c5023c60784] Fetching instance by UUID {{(pid=120741) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 18:02:51.387407 dv-cinder-852009-8-iscsi devstack@n-api.service[120741]: DEBUG oslo_concurrency.lockutils [None req-ca048ce4-a96e-443a-9aa8-6fbf88c6ee8a tempest-DeleteServersTestJSON-1632919649 tempest-DeleteServersTestJSON-1632919649-project] Acquiring lock "1daf4f4c-0e4a-4779-b53a-78c48397ea2f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120741) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 18:02:51.387784 dv-cinder-852009-8-iscsi devstack@n-api.service[120741]: DEBUG oslo_concurrency.lockutils [None req-ca048ce4-a96e-443a-9aa8-6fbf88c6ee8a tempest-DeleteServersTestJSON-1632919649 tempest-DeleteServersTestJSON-1632919649-project] Lock "1daf4f4c-0e4a-4779-b53a-78c48397ea2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120741) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 18:02:51.388205 dv-cinder-852009-8-iscsi devstack@n-api.service[120741]: DEBUG oslo_concurrency.lockutils [None req-ca048ce4-a96e-443a-9aa8-6fbf88c6ee8a tempest-DeleteServersTestJSON-1632919649 tempest-DeleteServersTestJSON-1632919649-project] Lock "1daf4f4c-0e4a-4779-b53a-78c48397ea2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120741) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 18:02:51.388996 dv-cinder-852009-8-iscsi devstack@n-api.service[120741]: DEBUG oslo_concurrency.lockutils [None req-ca048ce4-a96e-443a-9aa8-6fbf88c6ee8a tempest-DeleteServersTestJSON-1632919649 tempest-DeleteServersTestJSON-1632919649-project] Acquiring lock "1daf4f4c-0e4a-4779-b53a-78c48397ea2f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120741) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 18:02:51.389389 dv-cinder-852009-8-iscsi devstack@n-api.service[120741]: DEBUG oslo_concurrency.lockutils [None req-ca048ce4-a96e-443a-9aa8-6fbf88c6ee8a tempest-DeleteServersTestJSON-1632919649 tempest-DeleteServersTestJSON-1632919649-project] Lock "1daf4f4c-0e4a-4779-b53a-78c48397ea2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120741) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 18:02:51.389801 dv-cinder-852009-8-iscsi devstack@n-api.service[120741]: DEBUG oslo_concurrency.lockutils [None req-ca048ce4-a96e-443a-9aa8-6fbf88c6ee8a tempest-DeleteServersTestJSON-1632919649 tempest-DeleteServersTestJSON-1632919649-project] Lock "1daf4f4c-0e4a-4779-b53a-78c48397ea2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120741) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 18:02:51.439155 dv-cinder-852009-8-iscsi devstack@n-api.service[120740]: DEBUG nova.policy [None req-4d98c415-f02d-42de-bc73-551cf6caec49 tempest-AttachVolumeTestJSON-555093534 tempest-AttachVolumeTestJSON-555093534-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0625b3113ce044bbac4f6142eaade11c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a279fcbf274c4704a31a2b95061e1469', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120740) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 18:02:51.447863 dv-cinder-852009-8-iscsi devstack@n-api.service[120740]: INFO nova.api.openstack.requestlog [None req-4d98c415-f02d-42de-bc73-551cf6caec49 tempest-AttachVolumeTestJSON-555093534 tempest-AttachVolumeTestJSON-555093534-project] 10.222.0.43 "GET /compute/v2.1/servers/b958d409-df20-44c6-aa0e-58cb0a482edf" status: 200 len: 1549 microversion: 2.1 time: 0.161456 Sep 13 18:02:51.448561 dv-cinder-852009-8-iscsi devstack@n-api.service[120740]: [pid: 120740|app: 0|req: 75/143] 10.222.0.43 () {58 vars in 1236 bytes} [Tue Sep 13 18:02:51 2022] GET /compute/v2.1/servers/b958d409-df20-44c6-aa0e-58cb0a482edf => generated 1549 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 13 18:02:51.472155 dv-cinder-852009-8-iscsi devstack@n-api.service[120740]: DEBUG nova.api.openstack.wsgi [None req-7985b3f7-26a7-4bf2-8e47-21deee1dc8c7 tempest-AttachVolumeTestJSON-555093534 tempest-AttachVolumeTestJSON-555093534-project] Calling method '>' {{(pid=120740) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 18:02:51.472694 dv-cinder-852009-8-iscsi devstack@n-api.service[120740]: DEBUG nova.compute.api [None req-7985b3f7-26a7-4bf2-8e47-21deee1dc8c7 tempest-AttachVolumeTestJSON-555093534 tempest-AttachVolumeTestJSON-555093534-project] [instance: b958d409-df20-44c6-aa0e-58cb0a482edf] Fetching instance by UUID {{(pid=120740) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 18:02:51.478954 dv-cinder-852009-8-iscsi devstack@n-api.service[120740]: DEBUG oslo_concurrency.lockutils [None req-7985b3f7-26a7-4bf2-8e47-21deee1dc8c7 tempest-AttachVolumeTestJSON-555093534 tempest-AttachVolumeTestJSON-555093534-project] Acquiring lock "1daf4f4c-0e4a-4779-b53a-78c48397ea2f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120740) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 18:02:51.479174 dv-cinder-852009-8-iscsi devstack@n-api.service[120740]: DEBUG oslo_concurrency.lockutils [None req-7985b3f7-26a7-4bf2-8e47-21deee1dc8c7 tempest-AttachVolumeTestJSON-555093534 tempest-AttachVolumeTestJSON-555093534-project] Lock "1daf4f4c-0e4a-4779-b53a-78c48397ea2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120740) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 18:02:51.479659 dv-cinder-852009-8-iscsi devstack@n-api.service[120740]: DEBUG oslo_concurrency.lockutils [None req-7985b3f7-26a7-4bf2-8e47-21deee1dc8c7 tempest-AttachVolumeTestJSON-555093534 tempest-AttachVolumeTestJSON-555093534-project] Lock "1daf4f4c-0e4a-4779-b53a-78c48397ea2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120740) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 18:02:51.480362 dv-cinder-852009-8-iscsi devstack@n-api.service[120740]: DEBUG oslo_concurrency.lockutils [None req-7985b3f7-26a7-4bf2-8e47-21deee1dc8c7 tempest-AttachVolumeTestJSON-555093534 tempest-AttachVolumeTestJSON-555093534-project] Acquiring lock "1daf4f4c-0e4a-4779-b53a-78c48397ea2f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120740) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 18:02:51.480871 dv-cinder-852009-8-iscsi devstack@n-api.service[120740]: DEBUG oslo_concurrency.lockutils [None req-7985b3f7-26a7-4bf2-8e47-21deee1dc8c7 tempest-AttachVolumeTestJSON-555093534 tempest-AttachVolumeTestJSON-555093534-project] Lock "1daf4f4c-0e4a-4779-b53a-78c48397ea2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120740) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 18:02:51.481263 dv-cinder-852009-8-iscsi devstack@n-api.service[120740]: DEBUG oslo_concurrency.lockutils [None req-7985b3f7-26a7-4bf2-8e47-21deee1dc8c7 tempest-AttachVolumeTestJSON-555093534 tempest-AttachVolumeTestJSON-555093534-project] Lock "1daf4f4c-0e4a-4779-b53a-78c48397ea2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120740) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 18:02:51.566564 dv-cinder-852009-8-iscsi devstack@n-api.service[120740]: INFO nova.api.openstack.requestlog [None req-7985b3f7-26a7-4bf2-8e47-21deee1dc8c7 tempest-AttachVolumeTestJSON-555093534 tempest-AttachVolumeTestJSON-555093534-project] 10.222.0.43 "GET /compute/v2.1/servers/b958d409-df20-44c6-aa0e-58cb0a482edf/os-interface" status: 200 len: 285 microversion: 2.1 time: 0.098411 Sep 13 18:02:51.567198 dv-cinder-852009-8-iscsi devstack@n-api.service[120740]: [pid: 120740|app: 0|req: 76/144] 10.222.0.43 () {58 vars in 1275 bytes} [Tue Sep 13 18:02:51 2022] GET /compute/v2.1/servers/b958d409-df20-44c6-aa0e-58cb0a482edf/os-interface => generated 285 bytes in 100 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Sep 13 18:02:52.054186 dv-cinder-852009-8-iscsi devstack@n-api.service[120741]: INFO nova.api.openstack.requestlog [None req-ca048ce4-a96e-443a-9aa8-6fbf88c6ee8a tempest-DeleteServersTestJSON-1632919649 tempest-DeleteServersTestJSON-1632919649-project] 10.222.0.43 "POST /compute/v2.1/servers/207d1d8d-58a4-4b99-aa09-1c5023c60784/os-volume_attachments" status: 200 len: 194 microversion: 2.1 time: 0.680365 Sep 13 18:02:52.054859 dv-cinder-852009-8-iscsi devstack@n-api.service[120741]: [pid: 120741|app: 0|req: 69/145] 10.222.0.43 () {60 vars in 1323 bytes} [Tue Sep 13 18:02:51 2022] POST /compute/v2.1/servers/207d1d8d-58a4-4b99-aa09-1c5023c60784/os-volume_attachments => generated 194 bytes in 682 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 13 18:02:52.283621 dv-cinder-852009-8-iscsi devstack@n-api.service[120740]: DEBUG nova.api.openstack.wsgi [None req-cb1e6419-c0b2-4bba-9cd1-186e711bcdb1 tempest-ServerRescueNegativeTestJSON-412251590 tempest-ServerRescueNegativeTestJSON-412251590-project] Calling method '>' {{(pid=120740) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 18:02:52.284337 dv-cinder-852009-8-iscsi devstack@n-api.service[120740]: DEBUG nova.compute.api [None req-cb1e6419-c0b2-4bba-9cd1-186e711bcdb1 tempest-ServerRescueNegativeTestJSON-412251590 tempest-ServerRescueNegativeTestJSON-412251590-project] [instance: 8cd29851-35c1-4032-a137-ab9419a2ec5b] Fetching instance by UUID {{(pid=120740) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 18:02:52.290963 dv-cinder-852009-8-iscsi devstack@n-api.service[120740]: DEBUG oslo_concurrency.lockutils [None req-cb1e6419-c0b2-4bba-9cd1-186e711bcdb1 tempest-ServerRescueNegativeTestJSON-412251590 tempest-ServerRescueNegativeTestJSON-412251590-project] Acquiring lock "1daf4f4c-0e4a-4779-b53a-78c48397ea2f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120740) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 18:02:52.292315 dv-cinder-852009-8-iscsi devstack@n-api.service[120740]: DEBUG oslo_concurrency.lockutils [None req-cb1e6419-c0b2-4bba-9cd1-186e711bcdb1 tempest-ServerRescueNegativeTestJSON-412251590 tempest-ServerRescueNegativeTestJSON-412251590-project] Lock "1daf4f4c-0e4a-4779-b53a-78c48397ea2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120740) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 18:02:52.292989 dv-cinder-852009-8-iscsi devstack@n-api.service[120740]: DEBUG oslo_concurrency.lockutils [None req-cb1e6419-c0b2-4bba-9cd1-186e711bcdb1 tempest-ServerRescueNegativeTestJSON-412251590 tempest-ServerRescueNegativeTestJSON-412251590-project] Lock "1daf4f4c-0e4a-4779-b53a-78c48397ea2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120740) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 18:02:52.293919 dv-cinder-852009-8-iscsi devstack@n-api.service[120740]: DEBUG oslo_concurrency.lockutils [None req-cb1e6419-c0b2-4bba-9cd1-186e711bcdb1 tempest-ServerRescueNegativeTestJSON-412251590 tempest-ServerRescueNegativeTestJSON-412251590-project] Acquiring lock "1daf4f4c-0e4a-4779-b53a-78c48397ea2f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120740) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 18:02:52.294837 dv-cinder-852009-8-iscsi devstack@n-api.service[120740]: DEBUG oslo_concurrency.lockutils [None req-cb1e6419-c0b2-4bba-9cd1-186e711bcdb1 tempest-ServerRescueNegativeTestJSON-412251590 tempest-ServerRescueNegativeTestJSON-412251590-project] Lock "1daf4f4c-0e4a-4779-b53a-78c48397ea2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120740) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 18:02:52.295477 dv-cinder-852009-8-iscsi devstack@n-api.service[120740]: DEBUG oslo_concurrency.lockutils [None req-cb1e6419-c0b2-4bba-9cd1-186e711bcdb1 tempest-ServerRescueNegativeTestJSON-412251590 tempest-ServerRescueNegativeTestJSON-412251590-project] Lock "1daf4f4c-0e4a-4779-b53a-78c48397ea2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120740) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 18:02:52.763363 dv-cinder-852009-8-iscsi devstack@n-api.service[120740]: DEBUG nova.policy [None req-cb1e6419-c0b2-4bba-9cd1-186e711bcdb1 tempest-ServerRescueNegativeTestJSON-412251590 tempest-ServerRescueNegativeTestJSON-412251590-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '60800cf2774e409d9c1b6f4992669991', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2eae4acecf6c4961830ead78d71b2ad3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120740) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 18:02:52.771144 dv-cinder-852009-8-iscsi devstack@n-api.service[120740]: INFO nova.api.openstack.requestlog [None req-cb1e6419-c0b2-4bba-9cd1-186e711bcdb1 tempest-ServerRescueNegativeTestJSON-412251590 tempest-ServerRescueNegativeTestJSON-412251590-project] 10.222.0.43 "GET /compute/v2.1/servers/8cd29851-35c1-4032-a137-ab9419a2ec5b" status: 200 len: 1522 microversion: 2.1 time: 0.491809 Sep 13 18:02:52.780921 dv-cinder-852009-8-iscsi devstack@n-api.service[120740]: [pid: 120740|app: 0|req: 77/146] 10.222.0.43 () {58 vars in 1236 bytes} [Tue Sep 13 18:02:52 2022] GET /compute/v2.1/servers/8cd29851-35c1-4032-a137-ab9419a2ec5b => generated 1522 bytes in 502 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 13 18:02:53.413515 dv-cinder-852009-8-iscsi devstack@n-api.service[120741]: DEBUG nova.api.openstack.wsgi [req-4909e023-3808-46be-a3c5-a1fad94d2290 req-959771e1-ae4c-43d5-b4c3-30bd142b3798 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "b958d409-df20-44c6-aa0e-58cb0a482edf", "tag": "a5580dcb-2c75-47bc-91ef-409ee6db4bdc"}]} {{(pid=120741) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 13 18:02:53.425768 dv-cinder-852009-8-iscsi devstack@n-api.service[120741]: DEBUG oslo_concurrency.lockutils [req-4909e023-3808-46be-a3c5-a1fad94d2290 req-959771e1-ae4c-43d5-b4c3-30bd142b3798 service nova] Acquiring lock "1daf4f4c-0e4a-4779-b53a-78c48397ea2f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120741) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 18:02:53.426866 dv-cinder-852009-8-iscsi devstack@n-api.service[120741]: DEBUG oslo_concurrency.lockutils [req-4909e023-3808-46be-a3c5-a1fad94d2290 req-959771e1-ae4c-43d5-b4c3-30bd142b3798 service nova] Lock "1daf4f4c-0e4a-4779-b53a-78c48397ea2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120741) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 18:02:53.427510 dv-cinder-852009-8-iscsi devstack@n-api.service[120741]: DEBUG oslo_concurrency.lockutils [req-4909e023-3808-46be-a3c5-a1fad94d2290 req-959771e1-ae4c-43d5-b4c3-30bd142b3798 service nova] Lock "1daf4f4c-0e4a-4779-b53a-78c48397ea2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120741) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 18:02:53.443150 dv-cinder-852009-8-iscsi devstack@n-api.service[120741]: INFO nova.api.openstack.compute.server_external_events [req-4909e023-3808-46be-a3c5-a1fad94d2290 req-959771e1-ae4c-43d5-b4c3-30bd142b3798 service nova] Creating event network-changed:a5580dcb-2c75-47bc-91ef-409ee6db4bdc for instance b958d409-df20-44c6-aa0e-58cb0a482edf on hv-cinder-85200 Sep 13 18:02:53.449598 dv-cinder-852009-8-iscsi devstack@n-api.service[120741]: INFO nova.api.openstack.requestlog [req-4909e023-3808-46be-a3c5-a1fad94d2290 req-959771e1-ae4c-43d5-b4c3-30bd142b3798 service nova] 10.222.0.43 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.040138 Sep 13 18:02:53.450560 dv-cinder-852009-8-iscsi devstack@n-api.service[120741]: [pid: 120741|app: 0|req: 70/147] 10.222.0.43 () {64 vars in 1317 bytes} [Tue Sep 13 18:02:53 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 42 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 13 18:02:53.799579 dv-cinder-852009-8-iscsi devstack@n-api.service[120740]: DEBUG nova.api.openstack.wsgi [None req-57aef0c7-815e-4b99-9e54-bdbd067c54a7 tempest-ServerRescueNegativeTestJSON-412251590 tempest-ServerRescueNegativeTestJSON-412251590-project] Calling method '>' {{(pid=120740) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 18:02:53.800977 dv-cinder-852009-8-iscsi devstack@n-api.service[120740]: DEBUG nova.compute.api [None req-57aef0c7-815e-4b99-9e54-bdbd067c54a7 tempest-ServerRescueNegativeTestJSON-412251590 tempest-ServerRescueNegativeTestJSON-412251590-project] [instance: 8cd29851-35c1-4032-a137-ab9419a2ec5b] Fetching instance by UUID {{(pid=120740) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 18:02:53.808063 dv-cinder-852009-8-iscsi devstack@n-api.service[120740]: DEBUG oslo_concurrency.lockutils [None req-57aef0c7-815e-4b99-9e54-bdbd067c54a7 tempest-ServerRescueNegativeTestJSON-412251590 tempest-ServerRescueNegativeTestJSON-412251590-project] Acquiring lock "1daf4f4c-0e4a-4779-b53a-78c48397ea2f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120740) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 18:02:53.808953 dv-cinder-852009-8-iscsi devstack@n-api.service[120740]: DEBUG oslo_concurrency.lockutils [None req-57aef0c7-815e-4b99-9e54-bdbd067c54a7 tempest-ServerRescueNegativeTestJSON-412251590 tempest-ServerRescueNegativeTestJSON-412251590-project] Lock "1daf4f4c-0e4a-4779-b53a-78c48397ea2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120740) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 18:02:53.809579 dv-cinder-852009-8-iscsi devstack@n-api.service[120740]: DEBUG oslo_concurrency.lockutils [None req-57aef0c7-815e-4b99-9e54-bdbd067c54a7 tempest-ServerRescueNegativeTestJSON-412251590 tempest-ServerRescueNegativeTestJSON-412251590-project] Lock "1daf4f4c-0e4a-4779-b53a-78c48397ea2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120740) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 18:02:53.810536 dv-cinder-852009-8-iscsi devstack@n-api.service[120740]: DEBUG oslo_concurrency.lockutils [None req-57aef0c7-815e-4b99-9e54-bdbd067c54a7 tempest-ServerRescueNegativeTestJSON-412251590 tempest-ServerRescueNegativeTestJSON-412251590-project] Acquiring lock "1daf4f4c-0e4a-4779-b53a-78c48397ea2f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120740) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 18:02:53.811316 dv-cinder-852009-8-iscsi devstack@n-api.service[120740]: DEBUG oslo_concurrency.lockutils [None req-57aef0c7-815e-4b99-9e54-bdbd067c54a7 tempest-ServerRescueNegativeTestJSON-412251590 tempest-ServerRescueNegativeTestJSON-412251590-project] Lock "1daf4f4c-0e4a-4779-b53a-78c48397ea2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120740) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 18:02:53.811988 dv-cinder-852009-8-iscsi devstack@n-api.service[120740]: DEBUG oslo_concurrency.lockutils [None req-57aef0c7-815e-4b99-9e54-bdbd067c54a7 tempest-ServerRescueNegativeTestJSON-412251590 tempest-ServerRescueNegativeTestJSON-412251590-project] Lock "1daf4f4c-0e4a-4779-b53a-78c48397ea2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120740) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 18:02:54.080168 dv-cinder-852009-8-iscsi devstack@n-api.service[120740]: DEBUG nova.policy [None req-57aef0c7-815e-4b99-9e54-bdbd067c54a7 tempest-ServerRescueNegativeTestJSON-412251590 tempest-ServerRescueNegativeTestJSON-412251590-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '60800cf2774e409d9c1b6f4992669991', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2eae4acecf6c4961830ead78d71b2ad3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120740) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 18:02:54.102930 dv-cinder-852009-8-iscsi devstack@n-api.service[120740]: INFO nova.api.openstack.requestlog [None req-57aef0c7-815e-4b99-9e54-bdbd067c54a7 tempest-ServerRescueNegativeTestJSON-412251590 tempest-ServerRescueNegativeTestJSON-412251590-project] 10.222.0.43 "GET /compute/v2.1/servers/8cd29851-35c1-4032-a137-ab9419a2ec5b" status: 200 len: 1522 microversion: 2.1 time: 0.296849 Sep 13 18:02:54.105115 dv-cinder-852009-8-iscsi devstack@n-api.service[120740]: [pid: 120740|app: 0|req: 78/148] 10.222.0.43 () {58 vars in 1236 bytes} [Tue Sep 13 18:02:53 2022] GET /compute/v2.1/servers/8cd29851-35c1-4032-a137-ab9419a2ec5b => generated 1522 bytes in 311 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 13 18:02:55.130852 dv-cinder-852009-8-iscsi devstack@n-api.service[120741]: DEBUG nova.api.openstack.wsgi [None req-f80c6b39-eb58-4513-9eb3-f30ff76bd6b5 tempest-ServerRescueNegativeTestJSON-412251590 tempest-ServerRescueNegativeTestJSON-412251590-project] Calling method '>' {{(pid=120741) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 18:02:55.132783 dv-cinder-852009-8-iscsi devstack@n-api.service[120741]: DEBUG nova.compute.api [None req-f80c6b39-eb58-4513-9eb3-f30ff76bd6b5 tempest-ServerRescueNegativeTestJSON-412251590 tempest-ServerRescueNegativeTestJSON-412251590-project] [instance: 8cd29851-35c1-4032-a137-ab9419a2ec5b] Fetching instance by UUID {{(pid=120741) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 18:02:55.144831 dv-cinder-852009-8-iscsi devstack@n-api.service[120741]: DEBUG oslo_concurrency.lockutils [None req-f80c6b39-eb58-4513-9eb3-f30ff76bd6b5 tempest-ServerRescueNegativeTestJSON-412251590 tempest-ServerRescueNegativeTestJSON-412251590-project] Acquiring lock "1daf4f4c-0e4a-4779-b53a-78c48397ea2f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120741) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 18:02:55.145798 dv-cinder-852009-8-iscsi devstack@n-api.service[120741]: DEBUG oslo_concurrency.lockutils [None req-f80c6b39-eb58-4513-9eb3-f30ff76bd6b5 tempest-ServerRescueNegativeTestJSON-412251590 tempest-ServerRescueNegativeTestJSON-412251590-project] Lock "1daf4f4c-0e4a-4779-b53a-78c48397ea2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120741) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 18:02:55.146551 dv-cinder-852009-8-iscsi devstack@n-api.service[120741]: DEBUG oslo_concurrency.lockutils [None req-f80c6b39-eb58-4513-9eb3-f30ff76bd6b5 tempest-ServerRescueNegativeTestJSON-412251590 tempest-ServerRescueNegativeTestJSON-412251590-project] Lock "1daf4f4c-0e4a-4779-b53a-78c48397ea2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120741) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 18:02:55.147728 dv-cinder-852009-8-iscsi devstack@n-api.service[120741]: DEBUG oslo_concurrency.lockutils [None req-f80c6b39-eb58-4513-9eb3-f30ff76bd6b5 tempest-ServerRescueNegativeTestJSON-412251590 tempest-ServerRescueNegativeTestJSON-412251590-project] Acquiring lock "1daf4f4c-0e4a-4779-b53a-78c48397ea2f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120741) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 18:02:55.148759 dv-cinder-852009-8-iscsi devstack@n-api.service[120741]: DEBUG oslo_concurrency.lockutils [None req-f80c6b39-eb58-4513-9eb3-f30ff76bd6b5 tempest-ServerRescueNegativeTestJSON-412251590 tempest-ServerRescueNegativeTestJSON-412251590-project] Lock "1daf4f4c-0e4a-4779-b53a-78c48397ea2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120741) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 18:02:55.149325 dv-cinder-852009-8-iscsi devstack@n-api.service[120741]: DEBUG oslo_concurrency.lockutils [None req-f80c6b39-eb58-4513-9eb3-f30ff76bd6b5 tempest-ServerRescueNegativeTestJSON-412251590 tempest-ServerRescueNegativeTestJSON-412251590-project] Lock "1daf4f4c-0e4a-4779-b53a-78c48397ea2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120741) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 18:02:55.316699 dv-cinder-852009-8-iscsi devstack@n-api.service[120741]: DEBUG nova.policy [None req-f80c6b39-eb58-4513-9eb3-f30ff76bd6b5 tempest-ServerRescueNegativeTestJSON-412251590 tempest-ServerRescueNegativeTestJSON-412251590-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '60800cf2774e409d9c1b6f4992669991', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2eae4acecf6c4961830ead78d71b2ad3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120741) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 18:02:55.326017 dv-cinder-852009-8-iscsi devstack@n-api.service[120741]: INFO nova.api.openstack.requestlog [None req-f80c6b39-eb58-4513-9eb3-f30ff76bd6b5 tempest-ServerRescueNegativeTestJSON-412251590 tempest-ServerRescueNegativeTestJSON-412251590-project] 10.222.0.43 "GET /compute/v2.1/servers/8cd29851-35c1-4032-a137-ab9419a2ec5b" status: 200 len: 1522 microversion: 2.1 time: 0.202474 Sep 13 18:02:55.327922 dv-cinder-852009-8-iscsi devstack@n-api.service[120741]: [pid: 120741|app: 0|req: 71/149] 10.222.0.43 () {58 vars in 1236 bytes} [Tue Sep 13 18:02:55 2022] GET /compute/v2.1/servers/8cd29851-35c1-4032-a137-ab9419a2ec5b => generated 1522 bytes in 205 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 13 18:02:56.358424 dv-cinder-852009-8-iscsi devstack@n-api.service[120740]: DEBUG nova.api.openstack.wsgi [None req-6488c823-0a64-46c3-8a8b-52e0b4afb09c tempest-ServerRescueNegativeTestJSON-412251590 tempest-ServerRescueNegativeTestJSON-412251590-project] Calling method '>' {{(pid=120740) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 18:02:56.359804 dv-cinder-852009-8-iscsi devstack@n-api.service[120740]: DEBUG nova.compute.api [None req-6488c823-0a64-46c3-8a8b-52e0b4afb09c tempest-ServerRescueNegativeTestJSON-412251590 tempest-ServerRescueNegativeTestJSON-412251590-project] [instance: 8cd29851-35c1-4032-a137-ab9419a2ec5b] Fetching instance by UUID {{(pid=120740) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 18:02:56.373062 dv-cinder-852009-8-iscsi devstack@n-api.service[120740]: DEBUG oslo_concurrency.lockutils [None req-6488c823-0a64-46c3-8a8b-52e0b4afb09c tempest-ServerRescueNegativeTestJSON-412251590 tempest-ServerRescueNegativeTestJSON-412251590-project] Acquiring lock "1daf4f4c-0e4a-4779-b53a-78c48397ea2f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120740) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 18:02:56.374787 dv-cinder-852009-8-iscsi devstack@n-api.service[120740]: DEBUG oslo_concurrency.lockutils [None req-6488c823-0a64-46c3-8a8b-52e0b4afb09c tempest-ServerRescueNegativeTestJSON-412251590 tempest-ServerRescueNegativeTestJSON-412251590-project] Lock "1daf4f4c-0e4a-4779-b53a-78c48397ea2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120740) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 18:02:56.375463 dv-cinder-852009-8-iscsi devstack@n-api.service[120740]: DEBUG oslo_concurrency.lockutils [None req-6488c823-0a64-46c3-8a8b-52e0b4afb09c tempest-ServerRescueNegativeTestJSON-412251590 tempest-ServerRescueNegativeTestJSON-412251590-project] Lock "1daf4f4c-0e4a-4779-b53a-78c48397ea2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120740) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 18:02:56.376465 dv-cinder-852009-8-iscsi devstack@n-api.service[120740]: DEBUG oslo_concurrency.lockutils [None req-6488c823-0a64-46c3-8a8b-52e0b4afb09c tempest-ServerRescueNegativeTestJSON-412251590 tempest-ServerRescueNegativeTestJSON-412251590-project] Acquiring lock "1daf4f4c-0e4a-4779-b53a-78c48397ea2f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120740) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 18:02:56.377131 dv-cinder-852009-8-iscsi devstack@n-api.service[120740]: DEBUG oslo_concurrency.lockutils [None req-6488c823-0a64-46c3-8a8b-52e0b4afb09c tempest-ServerRescueNegativeTestJSON-412251590 tempest-ServerRescueNegativeTestJSON-412251590-project] Lock "1daf4f4c-0e4a-4779-b53a-78c48397ea2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120740) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 18:02:56.378141 dv-cinder-852009-8-iscsi devstack@n-api.service[120740]: DEBUG oslo_concurrency.lockutils [None req-6488c823-0a64-46c3-8a8b-52e0b4afb09c tempest-ServerRescueNegativeTestJSON-412251590 tempest-ServerRescueNegativeTestJSON-412251590-project] Lock "1daf4f4c-0e4a-4779-b53a-78c48397ea2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120740) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 18:02:56.553750 dv-cinder-852009-8-iscsi devstack@n-api.service[120740]: DEBUG nova.policy [None req-6488c823-0a64-46c3-8a8b-52e0b4afb09c tempest-ServerRescueNegativeTestJSON-412251590 tempest-ServerRescueNegativeTestJSON-412251590-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '60800cf2774e409d9c1b6f4992669991', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2eae4acecf6c4961830ead78d71b2ad3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120740) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 18:02:56.561773 dv-cinder-852009-8-iscsi devstack@n-api.service[120740]: INFO nova.api.openstack.requestlog [None req-6488c823-0a64-46c3-8a8b-52e0b4afb09c tempest-ServerRescueNegativeTestJSON-412251590 tempest-ServerRescueNegativeTestJSON-412251590-project] 10.222.0.43 "GET /compute/v2.1/servers/8cd29851-35c1-4032-a137-ab9419a2ec5b" status: 200 len: 1522 microversion: 2.1 time: 0.215863 Sep 13 18:02:56.565474 dv-cinder-852009-8-iscsi devstack@n-api.service[120740]: [pid: 120740|app: 0|req: 79/150] 10.222.0.43 () {58 vars in 1236 bytes} [Tue Sep 13 18:02:56 2022] GET /compute/v2.1/servers/8cd29851-35c1-4032-a137-ab9419a2ec5b => generated 1522 bytes in 220 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 13 18:02:57.590468 dv-cinder-852009-8-iscsi devstack@n-api.service[120741]: DEBUG nova.api.openstack.wsgi [None req-154e23e9-7a25-4ccb-8e47-a484fb315b15 tempest-ServerRescueNegativeTestJSON-412251590 tempest-ServerRescueNegativeTestJSON-412251590-project] Calling method '>' {{(pid=120741) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 18:02:57.591299 dv-cinder-852009-8-iscsi devstack@n-api.service[120741]: DEBUG nova.compute.api [None req-154e23e9-7a25-4ccb-8e47-a484fb315b15 tempest-ServerRescueNegativeTestJSON-412251590 tempest-ServerRescueNegativeTestJSON-412251590-project] [instance: 8cd29851-35c1-4032-a137-ab9419a2ec5b] Fetching instance by UUID {{(pid=120741) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 18:02:57.598292 dv-cinder-852009-8-iscsi devstack@n-api.service[120741]: DEBUG oslo_concurrency.lockutils [None req-154e23e9-7a25-4ccb-8e47-a484fb315b15 tempest-ServerRescueNegativeTestJSON-412251590 tempest-ServerRescueNegativeTestJSON-412251590-project] Acquiring lock "1daf4f4c-0e4a-4779-b53a-78c48397ea2f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120741) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 18:02:57.598779 dv-cinder-852009-8-iscsi devstack@n-api.service[120741]: DEBUG oslo_concurrency.lockutils [None req-154e23e9-7a25-4ccb-8e47-a484fb315b15 tempest-ServerRescueNegativeTestJSON-412251590 tempest-ServerRescueNegativeTestJSON-412251590-project] Lock "1daf4f4c-0e4a-4779-b53a-78c48397ea2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120741) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 18:02:57.599226 dv-cinder-852009-8-iscsi devstack@n-api.service[120741]: DEBUG oslo_concurrency.lockutils [None req-154e23e9-7a25-4ccb-8e47-a484fb315b15 tempest-ServerRescueNegativeTestJSON-412251590 tempest-ServerRescueNegativeTestJSON-412251590-project] Lock "1daf4f4c-0e4a-4779-b53a-78c48397ea2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120741) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 18:02:57.599914 dv-cinder-852009-8-iscsi devstack@n-api.service[120741]: DEBUG oslo_concurrency.lockutils [None req-154e23e9-7a25-4ccb-8e47-a484fb315b15 tempest-ServerRescueNegativeTestJSON-412251590 tempest-ServerRescueNegativeTestJSON-412251590-project] Acquiring lock "1daf4f4c-0e4a-4779-b53a-78c48397ea2f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120741) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 18:02:57.600539 dv-cinder-852009-8-iscsi devstack@n-api.service[120741]: DEBUG oslo_concurrency.lockutils [None req-154e23e9-7a25-4ccb-8e47-a484fb315b15 tempest-ServerRescueNegativeTestJSON-412251590 tempest-ServerRescueNegativeTestJSON-412251590-project] Lock "1daf4f4c-0e4a-4779-b53a-78c48397ea2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120741) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 18:02:57.600971 dv-cinder-852009-8-iscsi devstack@n-api.service[120741]: DEBUG oslo_concurrency.lockutils [None req-154e23e9-7a25-4ccb-8e47-a484fb315b15 tempest-ServerRescueNegativeTestJSON-412251590 tempest-ServerRescueNegativeTestJSON-412251590-project] Lock "1daf4f4c-0e4a-4779-b53a-78c48397ea2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120741) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 18:02:57.775189 dv-cinder-852009-8-iscsi devstack@n-api.service[120741]: DEBUG nova.policy [None req-154e23e9-7a25-4ccb-8e47-a484fb315b15 tempest-ServerRescueNegativeTestJSON-412251590 tempest-ServerRescueNegativeTestJSON-412251590-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '60800cf2774e409d9c1b6f4992669991', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2eae4acecf6c4961830ead78d71b2ad3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120741) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 18:02:57.784358 dv-cinder-852009-8-iscsi devstack@n-api.service[120741]: INFO nova.api.openstack.requestlog [None req-154e23e9-7a25-4ccb-8e47-a484fb315b15 tempest-ServerRescueNegativeTestJSON-412251590 tempest-ServerRescueNegativeTestJSON-412251590-project] 10.222.0.43 "GET /compute/v2.1/servers/8cd29851-35c1-4032-a137-ab9419a2ec5b" status: 200 len: 1522 microversion: 2.1 time: 0.199406 Sep 13 18:02:57.785332 dv-cinder-852009-8-iscsi devstack@n-api.service[120741]: [pid: 120741|app: 0|req: 72/151] 10.222.0.43 () {58 vars in 1236 bytes} [Tue Sep 13 18:02:57 2022] GET /compute/v2.1/servers/8cd29851-35c1-4032-a137-ab9419a2ec5b => generated 1522 bytes in 201 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 13 18:02:58.807588 dv-cinder-852009-8-iscsi devstack@n-api.service[120740]: DEBUG nova.api.openstack.wsgi [None req-5dde6e23-9f1b-42a8-916e-70ffe2902c23 tempest-ServerRescueNegativeTestJSON-412251590 tempest-ServerRescueNegativeTestJSON-412251590-project] Calling method '>' {{(pid=120740) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 18:02:58.808197 dv-cinder-852009-8-iscsi devstack@n-api.service[120740]: DEBUG nova.compute.api [None req-5dde6e23-9f1b-42a8-916e-70ffe2902c23 tempest-ServerRescueNegativeTestJSON-412251590 tempest-ServerRescueNegativeTestJSON-412251590-project] [instance: 8cd29851-35c1-4032-a137-ab9419a2ec5b] Fetching instance by UUID {{(pid=120740) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 18:02:58.817046 dv-cinder-852009-8-iscsi devstack@n-api.service[120740]: DEBUG oslo_concurrency.lockutils [None req-5dde6e23-9f1b-42a8-916e-70ffe2902c23 tempest-ServerRescueNegativeTestJSON-412251590 tempest-ServerRescueNegativeTestJSON-412251590-project] Acquiring lock "1daf4f4c-0e4a-4779-b53a-78c48397ea2f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120740) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 18:02:58.817538 dv-cinder-852009-8-iscsi devstack@n-api.service[120740]: DEBUG oslo_concurrency.lockutils [None req-5dde6e23-9f1b-42a8-916e-70ffe2902c23 tempest-ServerRescueNegativeTestJSON-412251590 tempest-ServerRescueNegativeTestJSON-412251590-project] Lock "1daf4f4c-0e4a-4779-b53a-78c48397ea2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120740) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 18:02:58.820367 dv-cinder-852009-8-iscsi devstack@n-api.service[120740]: DEBUG oslo_concurrency.lockutils [None req-5dde6e23-9f1b-42a8-916e-70ffe2902c23 tempest-ServerRescueNegativeTestJSON-412251590 tempest-ServerRescueNegativeTestJSON-412251590-project] Lock "1daf4f4c-0e4a-4779-b53a-78c48397ea2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120740) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 18:02:58.822799 dv-cinder-852009-8-iscsi devstack@n-api.service[120740]: DEBUG oslo_concurrency.lockutils [None req-5dde6e23-9f1b-42a8-916e-70ffe2902c23 tempest-ServerRescueNegativeTestJSON-412251590 tempest-ServerRescueNegativeTestJSON-412251590-project] Acquiring lock "1daf4f4c-0e4a-4779-b53a-78c48397ea2f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120740) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 18:02:58.823592 dv-cinder-852009-8-iscsi devstack@n-api.service[120740]: DEBUG oslo_concurrency.lockutils [None req-5dde6e23-9f1b-42a8-916e-70ffe2902c23 tempest-ServerRescueNegativeTestJSON-412251590 tempest-ServerRescueNegativeTestJSON-412251590-project] Lock "1daf4f4c-0e4a-4779-b53a-78c48397ea2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120740) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 18:02:58.824170 dv-cinder-852009-8-iscsi devstack@n-api.service[120740]: DEBUG oslo_concurrency.lockutils [None req-5dde6e23-9f1b-42a8-916e-70ffe2902c23 tempest-ServerRescueNegativeTestJSON-412251590 tempest-ServerRescueNegativeTestJSON-412251590-project] Lock "1daf4f4c-0e4a-4779-b53a-78c48397ea2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120740) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 18:02:59.045511 dv-cinder-852009-8-iscsi devstack@n-api.service[120740]: DEBUG nova.policy [None req-5dde6e23-9f1b-42a8-916e-70ffe2902c23 tempest-ServerRescueNegativeTestJSON-412251590 tempest-ServerRescueNegativeTestJSON-412251590-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '60800cf2774e409d9c1b6f4992669991', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2eae4acecf6c4961830ead78d71b2ad3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120740) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 18:02:59.053840 dv-cinder-852009-8-iscsi devstack@n-api.service[120740]: INFO nova.api.openstack.requestlog [None req-5dde6e23-9f1b-42a8-916e-70ffe2902c23 tempest-ServerRescueNegativeTestJSON-412251590 tempest-ServerRescueNegativeTestJSON-412251590-project] 10.222.0.43 "GET /compute/v2.1/servers/8cd29851-35c1-4032-a137-ab9419a2ec5b" status: 200 len: 1522 microversion: 2.1 time: 0.250588 Sep 13 18:02:59.054514 dv-cinder-852009-8-iscsi devstack@n-api.service[120740]: [pid: 120740|app: 0|req: 80/152] 10.222.0.43 () {58 vars in 1236 bytes} [Tue Sep 13 18:02:58 2022] GET /compute/v2.1/servers/8cd29851-35c1-4032-a137-ab9419a2ec5b => generated 1522 bytes in 252 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 13 18:03:00.077457 dv-cinder-852009-8-iscsi devstack@n-api.service[120741]: DEBUG nova.api.openstack.wsgi [None req-75a88095-4932-4761-b0a1-01e947719130 tempest-ServerRescueNegativeTestJSON-412251590 tempest-ServerRescueNegativeTestJSON-412251590-project] Calling method '>' {{(pid=120741) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 18:03:00.078242 dv-cinder-852009-8-iscsi devstack@n-api.service[120741]: DEBUG nova.compute.api [None req-75a88095-4932-4761-b0a1-01e947719130 tempest-ServerRescueNegativeTestJSON-412251590 tempest-ServerRescueNegativeTestJSON-412251590-project] [instance: 8cd29851-35c1-4032-a137-ab9419a2ec5b] Fetching instance by UUID {{(pid=120741) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 18:03:00.085065 dv-cinder-852009-8-iscsi devstack@n-api.service[120741]: DEBUG oslo_concurrency.lockutils [None req-75a88095-4932-4761-b0a1-01e947719130 tempest-ServerRescueNegativeTestJSON-412251590 tempest-ServerRescueNegativeTestJSON-412251590-project] Acquiring lock "1daf4f4c-0e4a-4779-b53a-78c48397ea2f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120741) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 18:03:00.085611 dv-cinder-852009-8-iscsi devstack@n-api.service[120741]: DEBUG oslo_concurrency.lockutils [None req-75a88095-4932-4761-b0a1-01e947719130 tempest-ServerRescueNegativeTestJSON-412251590 tempest-ServerRescueNegativeTestJSON-412251590-project] Lock "1daf4f4c-0e4a-4779-b53a-78c48397ea2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120741) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 18:03:00.086098 dv-cinder-852009-8-iscsi devstack@n-api.service[120741]: DEBUG oslo_concurrency.lockutils [None req-75a88095-4932-4761-b0a1-01e947719130 tempest-ServerRescueNegativeTestJSON-412251590 tempest-ServerRescueNegativeTestJSON-412251590-project] Lock "1daf4f4c-0e4a-4779-b53a-78c48397ea2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120741) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 18:03:00.086911 dv-cinder-852009-8-iscsi devstack@n-api.service[120741]: DEBUG oslo_concurrency.lockutils [None req-75a88095-4932-4761-b0a1-01e947719130 tempest-ServerRescueNegativeTestJSON-412251590 tempest-ServerRescueNegativeTestJSON-412251590-project] Acquiring lock "1daf4f4c-0e4a-4779-b53a-78c48397ea2f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120741) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 18:03:00.087415 dv-cinder-852009-8-iscsi devstack@n-api.service[120741]: DEBUG oslo_concurrency.lockutils [None req-75a88095-4932-4761-b0a1-01e947719130 tempest-ServerRescueNegativeTestJSON-412251590 tempest-ServerRescueNegativeTestJSON-412251590-project] Lock "1daf4f4c-0e4a-4779-b53a-78c48397ea2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120741) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 18:03:00.087893 dv-cinder-852009-8-iscsi devstack@n-api.service[120741]: DEBUG oslo_concurrency.lockutils [None req-75a88095-4932-4761-b0a1-01e947719130 tempest-ServerRescueNegativeTestJSON-412251590 tempest-ServerRescueNegativeTestJSON-412251590-project] Lock "1daf4f4c-0e4a-4779-b53a-78c48397ea2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120741) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 18:03:00.224653 dv-cinder-852009-8-iscsi devstack@n-api.service[120741]: DEBUG nova.policy [None req-75a88095-4932-4761-b0a1-01e947719130 tempest-ServerRescueNegativeTestJSON-412251590 tempest-ServerRescueNegativeTestJSON-412251590-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '60800cf2774e409d9c1b6f4992669991', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2eae4acecf6c4961830ead78d71b2ad3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120741) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 18:03:00.233855 dv-cinder-852009-8-iscsi devstack@n-api.service[120741]: INFO nova.api.openstack.requestlog [None req-75a88095-4932-4761-b0a1-01e947719130 tempest-ServerRescueNegativeTestJSON-412251590 tempest-ServerRescueNegativeTestJSON-412251590-project] 10.222.0.43 "GET /compute/v2.1/servers/8cd29851-35c1-4032-a137-ab9419a2ec5b" status: 200 len: 1522 microversion: 2.1 time: 0.160071 Sep 13 18:03:00.234722 dv-cinder-852009-8-iscsi devstack@n-api.service[120741]: [pid: 120741|app: 0|req: 73/153] 10.222.0.43 () {58 vars in 1236 bytes} [Tue Sep 13 18:03:00 2022] GET /compute/v2.1/servers/8cd29851-35c1-4032-a137-ab9419a2ec5b => generated 1522 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 13 18:03:01.259391 dv-cinder-852009-8-iscsi devstack@n-api.service[120740]: DEBUG nova.api.openstack.wsgi [None req-b42a6c31-3e8b-4ed2-b62e-4e97c3a57a17 tempest-ServerRescueNegativeTestJSON-412251590 tempest-ServerRescueNegativeTestJSON-412251590-project] Calling method '>' {{(pid=120740) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 18:03:01.260764 dv-cinder-852009-8-iscsi devstack@n-api.service[120740]: DEBUG nova.compute.api [None req-b42a6c31-3e8b-4ed2-b62e-4e97c3a57a17 tempest-ServerRescueNegativeTestJSON-412251590 tempest-ServerRescueNegativeTestJSON-412251590-project] [instance: 8cd29851-35c1-4032-a137-ab9419a2ec5b] Fetching instance by UUID {{(pid=120740) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 18:03:01.285608 dv-cinder-852009-8-iscsi devstack@n-api.service[120740]: DEBUG oslo_concurrency.lockutils [None req-b42a6c31-3e8b-4ed2-b62e-4e97c3a57a17 tempest-ServerRescueNegativeTestJSON-412251590 tempest-ServerRescueNegativeTestJSON-412251590-project] Acquiring lock "1daf4f4c-0e4a-4779-b53a-78c48397ea2f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120740) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 18:03:01.287615 dv-cinder-852009-8-iscsi devstack@n-api.service[120740]: DEBUG oslo_concurrency.lockutils [None req-b42a6c31-3e8b-4ed2-b62e-4e97c3a57a17 tempest-ServerRescueNegativeTestJSON-412251590 tempest-ServerRescueNegativeTestJSON-412251590-project] Lock "1daf4f4c-0e4a-4779-b53a-78c48397ea2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120740) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 18:03:01.288070 dv-cinder-852009-8-iscsi devstack@n-api.service[120740]: DEBUG oslo_concurrency.lockutils [None req-b42a6c31-3e8b-4ed2-b62e-4e97c3a57a17 tempest-ServerRescueNegativeTestJSON-412251590 tempest-ServerRescueNegativeTestJSON-412251590-project] Lock "1daf4f4c-0e4a-4779-b53a-78c48397ea2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120740) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 18:03:01.289833 dv-cinder-852009-8-iscsi devstack@n-api.service[120740]: DEBUG oslo_concurrency.lockutils [None req-b42a6c31-3e8b-4ed2-b62e-4e97c3a57a17 tempest-ServerRescueNegativeTestJSON-412251590 tempest-ServerRescueNegativeTestJSON-412251590-project] Acquiring lock "1daf4f4c-0e4a-4779-b53a-78c48397ea2f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120740) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 18:03:01.290628 dv-cinder-852009-8-iscsi devstack@n-api.service[120740]: DEBUG oslo_concurrency.lockutils [None req-b42a6c31-3e8b-4ed2-b62e-4e97c3a57a17 tempest-ServerRescueNegativeTestJSON-412251590 tempest-ServerRescueNegativeTestJSON-412251590-project] Lock "1daf4f4c-0e4a-4779-b53a-78c48397ea2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120740) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 18:03:01.291074 dv-cinder-852009-8-iscsi devstack@n-api.service[120740]: DEBUG oslo_concurrency.lockutils [None req-b42a6c31-3e8b-4ed2-b62e-4e97c3a57a17 tempest-ServerRescueNegativeTestJSON-412251590 tempest-ServerRescueNegativeTestJSON-412251590-project] Lock "1daf4f4c-0e4a-4779-b53a-78c48397ea2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120740) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 18:03:01.509000 dv-cinder-852009-8-iscsi devstack@n-api.service[120740]: DEBUG nova.policy [None req-b42a6c31-3e8b-4ed2-b62e-4e97c3a57a17 tempest-ServerRescueNegativeTestJSON-412251590 tempest-ServerRescueNegativeTestJSON-412251590-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '60800cf2774e409d9c1b6f4992669991', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2eae4acecf6c4961830ead78d71b2ad3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120740) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 18:03:01.518536 dv-cinder-852009-8-iscsi devstack@n-api.service[120740]: INFO nova.api.openstack.requestlog [None req-b42a6c31-3e8b-4ed2-b62e-4e97c3a57a17 tempest-ServerRescueNegativeTestJSON-412251590 tempest-ServerRescueNegativeTestJSON-412251590-project] 10.222.0.43 "GET /compute/v2.1/servers/8cd29851-35c1-4032-a137-ab9419a2ec5b" status: 200 len: 1522 microversion: 2.1 time: 0.264860 Sep 13 18:03:01.519460 dv-cinder-852009-8-iscsi devstack@n-api.service[120740]: [pid: 120740|app: 0|req: 81/154] 10.222.0.43 () {58 vars in 1236 bytes} [Tue Sep 13 18:03:01 2022] GET /compute/v2.1/servers/8cd29851-35c1-4032-a137-ab9419a2ec5b => generated 1522 bytes in 267 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 13 18:03:02.027822 dv-cinder-852009-8-iscsi devstack@n-api.service[120741]: DEBUG nova.api.openstack.wsgi [None req-fc1e0a19-ea49-4b63-85f6-974e4bfcbc8c tempest-DeleteServersTestJSON-1632919649 tempest-DeleteServersTestJSON-1632919649-project] Calling method '>' {{(pid=120741) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 18:03:02.028304 dv-cinder-852009-8-iscsi devstack@n-api.service[120741]: DEBUG nova.compute.api [None req-fc1e0a19-ea49-4b63-85f6-974e4bfcbc8c tempest-DeleteServersTestJSON-1632919649 tempest-DeleteServersTestJSON-1632919649-project] [instance: 207d1d8d-58a4-4b99-aa09-1c5023c60784] Fetching instance by UUID {{(pid=120741) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 18:03:02.035082 dv-cinder-852009-8-iscsi devstack@n-api.service[120741]: DEBUG oslo_concurrency.lockutils [None req-fc1e0a19-ea49-4b63-85f6-974e4bfcbc8c tempest-DeleteServersTestJSON-1632919649 tempest-DeleteServersTestJSON-1632919649-project] Acquiring lock "1daf4f4c-0e4a-4779-b53a-78c48397ea2f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120741) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 18:03:02.035554 dv-cinder-852009-8-iscsi devstack@n-api.service[120741]: DEBUG oslo_concurrency.lockutils [None req-fc1e0a19-ea49-4b63-85f6-974e4bfcbc8c tempest-DeleteServersTestJSON-1632919649 tempest-DeleteServersTestJSON-1632919649-project] Lock "1daf4f4c-0e4a-4779-b53a-78c48397ea2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120741) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 18:03:02.035924 dv-cinder-852009-8-iscsi devstack@n-api.service[120741]: DEBUG oslo_concurrency.lockutils [None req-fc1e0a19-ea49-4b63-85f6-974e4bfcbc8c tempest-DeleteServersTestJSON-1632919649 tempest-DeleteServersTestJSON-1632919649-project] Lock "1daf4f4c-0e4a-4779-b53a-78c48397ea2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120741) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 18:03:02.036677 dv-cinder-852009-8-iscsi devstack@n-api.service[120741]: DEBUG oslo_concurrency.lockutils [None req-fc1e0a19-ea49-4b63-85f6-974e4bfcbc8c tempest-DeleteServersTestJSON-1632919649 tempest-DeleteServersTestJSON-1632919649-project] Acquiring lock "1daf4f4c-0e4a-4779-b53a-78c48397ea2f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120741) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 18:03:02.037117 dv-cinder-852009-8-iscsi devstack@n-api.service[120741]: DEBUG oslo_concurrency.lockutils [None req-fc1e0a19-ea49-4b63-85f6-974e4bfcbc8c tempest-DeleteServersTestJSON-1632919649 tempest-DeleteServersTestJSON-1632919649-project] Lock "1daf4f4c-0e4a-4779-b53a-78c48397ea2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120741) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 18:03:02.037520 dv-cinder-852009-8-iscsi devstack@n-api.service[120741]: DEBUG oslo_concurrency.lockutils [None req-fc1e0a19-ea49-4b63-85f6-974e4bfcbc8c tempest-DeleteServersTestJSON-1632919649 tempest-DeleteServersTestJSON-1632919649-project] Lock "1daf4f4c-0e4a-4779-b53a-78c48397ea2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120741) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 18:03:02.065119 dv-cinder-852009-8-iscsi devstack@n-api.service[120741]: DEBUG nova.compute.api [None req-fc1e0a19-ea49-4b63-85f6-974e4bfcbc8c tempest-DeleteServersTestJSON-1632919649 tempest-DeleteServersTestJSON-1632919649-project] [instance: 207d1d8d-58a4-4b99-aa09-1c5023c60784] Going to try to terminate instance {{(pid=120741) delete /opt/stack/nova/nova/compute/api.py:2719}} Sep 13 18:03:02.094810 dv-cinder-852009-8-iscsi devstack@n-api.service[120741]: DEBUG dbcounter [-] [120741] Writing DB stats nova_cell1:SELECT=97,nova_cell1:UPDATE=2,nova_cell1:INSERT=1 {{(pid=120741) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 18:03:02.158512 dv-cinder-852009-8-iscsi devstack@n-api.service[120741]: INFO nova.api.openstack.requestlog [None req-fc1e0a19-ea49-4b63-85f6-974e4bfcbc8c tempest-DeleteServersTestJSON-1632919649 tempest-DeleteServersTestJSON-1632919649-project] 10.222.0.43 "DELETE /compute/v2.1/servers/207d1d8d-58a4-4b99-aa09-1c5023c60784" status: 204 len: 0 microversion: 2.1 time: 0.134790 Sep 13 18:03:02.158965 dv-cinder-852009-8-iscsi devstack@n-api.service[120741]: [pid: 120741|app: 0|req: 74/155] 10.222.0.43 () {58 vars in 1239 bytes} [Tue Sep 13 18:03:02 2022] DELETE /compute/v2.1/servers/207d1d8d-58a4-4b99-aa09-1c5023c60784 => generated 0 bytes in 136 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Sep 13 18:03:02.167946 dv-cinder-852009-8-iscsi devstack@n-api.service[120740]: DEBUG nova.api.openstack.wsgi [None req-87cf4e47-a42b-4659-8806-62c0cb4bf488 tempest-DeleteServersTestJSON-1632919649 tempest-DeleteServersTestJSON-1632919649-project] Calling method '>' {{(pid=120740) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 18:03:02.169119 dv-cinder-852009-8-iscsi devstack@n-api.service[120740]: DEBUG nova.compute.api [None req-87cf4e47-a42b-4659-8806-62c0cb4bf488 tempest-DeleteServersTestJSON-1632919649 tempest-DeleteServersTestJSON-1632919649-project] [instance: 207d1d8d-58a4-4b99-aa09-1c5023c60784] Fetching instance by UUID {{(pid=120740) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 18:03:02.175728 dv-cinder-852009-8-iscsi devstack@n-api.service[120740]: DEBUG oslo_concurrency.lockutils [None req-87cf4e47-a42b-4659-8806-62c0cb4bf488 tempest-DeleteServersTestJSON-1632919649 tempest-DeleteServersTestJSON-1632919649-project] Acquiring lock "1daf4f4c-0e4a-4779-b53a-78c48397ea2f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120740) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 18:03:02.176198 dv-cinder-852009-8-iscsi devstack@n-api.service[120740]: DEBUG oslo_concurrency.lockutils [None req-87cf4e47-a42b-4659-8806-62c0cb4bf488 tempest-DeleteServersTestJSON-1632919649 tempest-DeleteServersTestJSON-1632919649-project] Lock "1daf4f4c-0e4a-4779-b53a-78c48397ea2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120740) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 18:03:02.176879 dv-cinder-852009-8-iscsi devstack@n-api.service[120740]: DEBUG oslo_concurrency.lockutils [None req-87cf4e47-a42b-4659-8806-62c0cb4bf488 tempest-DeleteServersTestJSON-1632919649 tempest-DeleteServersTestJSON-1632919649-project] Lock "1daf4f4c-0e4a-4779-b53a-78c48397ea2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120740) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 18:03:02.177582 dv-cinder-852009-8-iscsi devstack@n-api.service[120740]: DEBUG oslo_concurrency.lockutils [None req-87cf4e47-a42b-4659-8806-62c0cb4bf488 tempest-DeleteServersTestJSON-1632919649 tempest-DeleteServersTestJSON-1632919649-project] Acquiring lock "1daf4f4c-0e4a-4779-b53a-78c48397ea2f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120740) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 18:03:02.178032 dv-cinder-852009-8-iscsi devstack@n-api.service[120740]: DEBUG oslo_concurrency.lockutils [None req-87cf4e47-a42b-4659-8806-62c0cb4bf488 tempest-DeleteServersTestJSON-1632919649 tempest-DeleteServersTestJSON-1632919649-project] Lock "1daf4f4c-0e4a-4779-b53a-78c48397ea2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120740) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 18:03:02.178453 dv-cinder-852009-8-iscsi devstack@n-api.service[120740]: DEBUG oslo_concurrency.lockutils [None req-87cf4e47-a42b-4659-8806-62c0cb4bf488 tempest-DeleteServersTestJSON-1632919649 tempest-DeleteServersTestJSON-1632919649-project] Lock "1daf4f4c-0e4a-4779-b53a-78c48397ea2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120740) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 18:03:02.341198 dv-cinder-852009-8-iscsi devstack@n-api.service[120740]: DEBUG nova.policy [None req-87cf4e47-a42b-4659-8806-62c0cb4bf488 tempest-DeleteServersTestJSON-1632919649 tempest-DeleteServersTestJSON-1632919649-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '51db5ef052144879b53979268ac4ceb5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '66136f123f5b4ad0a824920bbdf9d245', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120740) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 18:03:02.353189 dv-cinder-852009-8-iscsi devstack@n-api.service[120740]: INFO nova.api.openstack.requestlog [None req-87cf4e47-a42b-4659-8806-62c0cb4bf488 tempest-DeleteServersTestJSON-1632919649 tempest-DeleteServersTestJSON-1632919649-project] 10.222.0.43 "GET /compute/v2.1/servers/207d1d8d-58a4-4b99-aa09-1c5023c60784" status: 200 len: 1552 microversion: 2.1 time: 0.189676 Sep 13 18:03:02.367163 dv-cinder-852009-8-iscsi devstack@n-api.service[120740]: [pid: 120740|app: 0|req: 82/156] 10.222.0.43 () {58 vars in 1236 bytes} [Tue Sep 13 18:03:02 2022] GET /compute/v2.1/servers/207d1d8d-58a4-4b99-aa09-1c5023c60784 => generated 1552 bytes in 204 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 13 18:03:02.544389 dv-cinder-852009-8-iscsi devstack@n-api.service[120741]: DEBUG nova.api.openstack.wsgi [None req-9d62b0d9-f015-49ce-8688-ecbe7b16710f tempest-ServerRescueNegativeTestJSON-412251590 tempest-ServerRescueNegativeTestJSON-412251590-project] Calling method '>' {{(pid=120741) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 18:03:02.545409 dv-cinder-852009-8-iscsi devstack@n-api.service[120741]: DEBUG nova.compute.api [None req-9d62b0d9-f015-49ce-8688-ecbe7b16710f tempest-ServerRescueNegativeTestJSON-412251590 tempest-ServerRescueNegativeTestJSON-412251590-project] [instance: 8cd29851-35c1-4032-a137-ab9419a2ec5b] Fetching instance by UUID {{(pid=120741) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 18:03:02.553174 dv-cinder-852009-8-iscsi devstack@n-api.service[120741]: DEBUG oslo_concurrency.lockutils [None req-9d62b0d9-f015-49ce-8688-ecbe7b16710f tempest-ServerRescueNegativeTestJSON-412251590 tempest-ServerRescueNegativeTestJSON-412251590-project] Acquiring lock "1daf4f4c-0e4a-4779-b53a-78c48397ea2f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120741) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 18:03:02.553968 dv-cinder-852009-8-iscsi devstack@n-api.service[120741]: DEBUG oslo_concurrency.lockutils [None req-9d62b0d9-f015-49ce-8688-ecbe7b16710f tempest-ServerRescueNegativeTestJSON-412251590 tempest-ServerRescueNegativeTestJSON-412251590-project] Lock "1daf4f4c-0e4a-4779-b53a-78c48397ea2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120741) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 18:03:02.554759 dv-cinder-852009-8-iscsi devstack@n-api.service[120741]: DEBUG oslo_concurrency.lockutils [None req-9d62b0d9-f015-49ce-8688-ecbe7b16710f tempest-ServerRescueNegativeTestJSON-412251590 tempest-ServerRescueNegativeTestJSON-412251590-project] Lock "1daf4f4c-0e4a-4779-b53a-78c48397ea2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120741) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 18:03:02.555879 dv-cinder-852009-8-iscsi devstack@n-api.service[120741]: DEBUG oslo_concurrency.lockutils [None req-9d62b0d9-f015-49ce-8688-ecbe7b16710f tempest-ServerRescueNegativeTestJSON-412251590 tempest-ServerRescueNegativeTestJSON-412251590-project] Acquiring lock "1daf4f4c-0e4a-4779-b53a-78c48397ea2f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120741) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 18:03:02.556587 dv-cinder-852009-8-iscsi devstack@n-api.service[120741]: DEBUG oslo_concurrency.lockutils [None req-9d62b0d9-f015-49ce-8688-ecbe7b16710f tempest-ServerRescueNegativeTestJSON-412251590 tempest-ServerRescueNegativeTestJSON-412251590-project] Lock "1daf4f4c-0e4a-4779-b53a-78c48397ea2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120741) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 18:03:02.557103 dv-cinder-852009-8-iscsi devstack@n-api.service[120741]: DEBUG oslo_concurrency.lockutils [None req-9d62b0d9-f015-49ce-8688-ecbe7b16710f tempest-ServerRescueNegativeTestJSON-412251590 tempest-ServerRescueNegativeTestJSON-412251590-project] Lock "1daf4f4c-0e4a-4779-b53a-78c48397ea2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120741) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 18:03:02.711623 dv-cinder-852009-8-iscsi devstack@n-api.service[120741]: DEBUG nova.policy [None req-9d62b0d9-f015-49ce-8688-ecbe7b16710f tempest-ServerRescueNegativeTestJSON-412251590 tempest-ServerRescueNegativeTestJSON-412251590-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '60800cf2774e409d9c1b6f4992669991', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2eae4acecf6c4961830ead78d71b2ad3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120741) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 18:03:02.720458 dv-cinder-852009-8-iscsi devstack@n-api.service[120741]: INFO nova.api.openstack.requestlog [None req-9d62b0d9-f015-49ce-8688-ecbe7b16710f tempest-ServerRescueNegativeTestJSON-412251590 tempest-ServerRescueNegativeTestJSON-412251590-project] 10.222.0.43 "GET /compute/v2.1/servers/8cd29851-35c1-4032-a137-ab9419a2ec5b" status: 200 len: 1522 microversion: 2.1 time: 0.181927 Sep 13 18:03:02.721746 dv-cinder-852009-8-iscsi devstack@n-api.service[120741]: [pid: 120741|app: 0|req: 75/157] 10.222.0.43 () {58 vars in 1236 bytes} [Tue Sep 13 18:03:02 2022] GET /compute/v2.1/servers/8cd29851-35c1-4032-a137-ab9419a2ec5b => generated 1522 bytes in 184 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 13 18:03:03.380448 dv-cinder-852009-8-iscsi devstack@n-api.service[120740]: DEBUG nova.api.openstack.wsgi [None req-9fa93aa8-8952-493c-844d-a30b69680d55 tempest-DeleteServersTestJSON-1632919649 tempest-DeleteServersTestJSON-1632919649-project] Calling method '>' {{(pid=120740) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 18:03:03.381141 dv-cinder-852009-8-iscsi devstack@n-api.service[120740]: DEBUG nova.compute.api [None req-9fa93aa8-8952-493c-844d-a30b69680d55 tempest-DeleteServersTestJSON-1632919649 tempest-DeleteServersTestJSON-1632919649-project] [instance: 207d1d8d-58a4-4b99-aa09-1c5023c60784] Fetching instance by UUID {{(pid=120740) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 18:03:03.388904 dv-cinder-852009-8-iscsi devstack@n-api.service[120740]: DEBUG oslo_concurrency.lockutils [None req-9fa93aa8-8952-493c-844d-a30b69680d55 tempest-DeleteServersTestJSON-1632919649 tempest-DeleteServersTestJSON-1632919649-project] Acquiring lock "1daf4f4c-0e4a-4779-b53a-78c48397ea2f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120740) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 18:03:03.389383 dv-cinder-852009-8-iscsi devstack@n-api.service[120740]: DEBUG oslo_concurrency.lockutils [None req-9fa93aa8-8952-493c-844d-a30b69680d55 tempest-DeleteServersTestJSON-1632919649 tempest-DeleteServersTestJSON-1632919649-project] Lock "1daf4f4c-0e4a-4779-b53a-78c48397ea2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120740) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 18:03:03.389804 dv-cinder-852009-8-iscsi devstack@n-api.service[120740]: DEBUG oslo_concurrency.lockutils [None req-9fa93aa8-8952-493c-844d-a30b69680d55 tempest-DeleteServersTestJSON-1632919649 tempest-DeleteServersTestJSON-1632919649-project] Lock "1daf4f4c-0e4a-4779-b53a-78c48397ea2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120740) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 18:03:03.390495 dv-cinder-852009-8-iscsi devstack@n-api.service[120740]: DEBUG oslo_concurrency.lockutils [None req-9fa93aa8-8952-493c-844d-a30b69680d55 tempest-DeleteServersTestJSON-1632919649 tempest-DeleteServersTestJSON-1632919649-project] Acquiring lock "1daf4f4c-0e4a-4779-b53a-78c48397ea2f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120740) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 18:03:03.390939 dv-cinder-852009-8-iscsi devstack@n-api.service[120740]: DEBUG oslo_concurrency.lockutils [None req-9fa93aa8-8952-493c-844d-a30b69680d55 tempest-DeleteServersTestJSON-1632919649 tempest-DeleteServersTestJSON-1632919649-project] Lock "1daf4f4c-0e4a-4779-b53a-78c48397ea2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120740) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 18:03:03.391353 dv-cinder-852009-8-iscsi devstack@n-api.service[120740]: DEBUG oslo_concurrency.lockutils [None req-9fa93aa8-8952-493c-844d-a30b69680d55 tempest-DeleteServersTestJSON-1632919649 tempest-DeleteServersTestJSON-1632919649-project] Lock "1daf4f4c-0e4a-4779-b53a-78c48397ea2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120740) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 18:03:03.596184 dv-cinder-852009-8-iscsi devstack@n-api.service[120740]: DEBUG nova.policy [None req-9fa93aa8-8952-493c-844d-a30b69680d55 tempest-DeleteServersTestJSON-1632919649 tempest-DeleteServersTestJSON-1632919649-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '51db5ef052144879b53979268ac4ceb5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '66136f123f5b4ad0a824920bbdf9d245', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120740) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 18:03:03.606619 dv-cinder-852009-8-iscsi devstack@n-api.service[120740]: INFO nova.api.openstack.requestlog [None req-9fa93aa8-8952-493c-844d-a30b69680d55 tempest-DeleteServersTestJSON-1632919649 tempest-DeleteServersTestJSON-1632919649-project] 10.222.0.43 "GET /compute/v2.1/servers/207d1d8d-58a4-4b99-aa09-1c5023c60784" status: 200 len: 1552 microversion: 2.1 time: 0.231295 Sep 13 18:03:03.607373 dv-cinder-852009-8-iscsi devstack@n-api.service[120740]: [pid: 120740|app: 0|req: 83/158] 10.222.0.43 () {58 vars in 1236 bytes} [Tue Sep 13 18:03:03 2022] GET /compute/v2.1/servers/207d1d8d-58a4-4b99-aa09-1c5023c60784 => generated 1552 bytes in 233 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 13 18:03:03.744414 dv-cinder-852009-8-iscsi devstack@n-api.service[120741]: DEBUG nova.api.openstack.wsgi [None req-121f4f0d-692e-45f5-808e-2d4690f26f36 tempest-ServerRescueNegativeTestJSON-412251590 tempest-ServerRescueNegativeTestJSON-412251590-project] Calling method '>' {{(pid=120741) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 18:03:03.745272 dv-cinder-852009-8-iscsi devstack@n-api.service[120741]: DEBUG nova.compute.api [None req-121f4f0d-692e-45f5-808e-2d4690f26f36 tempest-ServerRescueNegativeTestJSON-412251590 tempest-ServerRescueNegativeTestJSON-412251590-project] [instance: 8cd29851-35c1-4032-a137-ab9419a2ec5b] Fetching instance by UUID {{(pid=120741) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 18:03:03.761396 dv-cinder-852009-8-iscsi devstack@n-api.service[120741]: DEBUG oslo_concurrency.lockutils [None req-121f4f0d-692e-45f5-808e-2d4690f26f36 tempest-ServerRescueNegativeTestJSON-412251590 tempest-ServerRescueNegativeTestJSON-412251590-project] Acquiring lock "1daf4f4c-0e4a-4779-b53a-78c48397ea2f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120741) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 18:03:03.761991 dv-cinder-852009-8-iscsi devstack@n-api.service[120741]: DEBUG oslo_concurrency.lockutils [None req-121f4f0d-692e-45f5-808e-2d4690f26f36 tempest-ServerRescueNegativeTestJSON-412251590 tempest-ServerRescueNegativeTestJSON-412251590-project] Lock "1daf4f4c-0e4a-4779-b53a-78c48397ea2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120741) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 18:03:03.762765 dv-cinder-852009-8-iscsi devstack@n-api.service[120741]: DEBUG oslo_concurrency.lockutils [None req-121f4f0d-692e-45f5-808e-2d4690f26f36 tempest-ServerRescueNegativeTestJSON-412251590 tempest-ServerRescueNegativeTestJSON-412251590-project] Lock "1daf4f4c-0e4a-4779-b53a-78c48397ea2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120741) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 18:03:03.764108 dv-cinder-852009-8-iscsi devstack@n-api.service[120741]: DEBUG oslo_concurrency.lockutils [None req-121f4f0d-692e-45f5-808e-2d4690f26f36 tempest-ServerRescueNegativeTestJSON-412251590 tempest-ServerRescueNegativeTestJSON-412251590-project] Acquiring lock "1daf4f4c-0e4a-4779-b53a-78c48397ea2f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120741) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 18:03:03.765035 dv-cinder-852009-8-iscsi devstack@n-api.service[120741]: DEBUG oslo_concurrency.lockutils [None req-121f4f0d-692e-45f5-808e-2d4690f26f36 tempest-ServerRescueNegativeTestJSON-412251590 tempest-ServerRescueNegativeTestJSON-412251590-project] Lock "1daf4f4c-0e4a-4779-b53a-78c48397ea2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120741) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 18:03:03.765807 dv-cinder-852009-8-iscsi devstack@n-api.service[120741]: DEBUG oslo_concurrency.lockutils [None req-121f4f0d-692e-45f5-808e-2d4690f26f36 tempest-ServerRescueNegativeTestJSON-412251590 tempest-ServerRescueNegativeTestJSON-412251590-project] Lock "1daf4f4c-0e4a-4779-b53a-78c48397ea2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120741) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 18:03:03.998764 dv-cinder-852009-8-iscsi devstack@n-api.service[120741]: DEBUG nova.policy [None req-121f4f0d-692e-45f5-808e-2d4690f26f36 tempest-ServerRescueNegativeTestJSON-412251590 tempest-ServerRescueNegativeTestJSON-412251590-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '60800cf2774e409d9c1b6f4992669991', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2eae4acecf6c4961830ead78d71b2ad3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120741) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 18:03:04.008164 dv-cinder-852009-8-iscsi devstack@n-api.service[120741]: INFO nova.api.openstack.requestlog [None req-121f4f0d-692e-45f5-808e-2d4690f26f36 tempest-ServerRescueNegativeTestJSON-412251590 tempest-ServerRescueNegativeTestJSON-412251590-project] 10.222.0.43 "GET /compute/v2.1/servers/8cd29851-35c1-4032-a137-ab9419a2ec5b" status: 200 len: 1522 microversion: 2.1 time: 0.268450 Sep 13 18:03:04.009041 dv-cinder-852009-8-iscsi devstack@n-api.service[120741]: [pid: 120741|app: 0|req: 76/159] 10.222.0.43 () {58 vars in 1236 bytes} [Tue Sep 13 18:03:03 2022] GET /compute/v2.1/servers/8cd29851-35c1-4032-a137-ab9419a2ec5b => generated 1522 bytes in 270 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 13 18:03:04.631820 dv-cinder-852009-8-iscsi devstack@n-api.service[120740]: DEBUG nova.api.openstack.wsgi [None req-38a12c1d-058a-4328-aded-5904fbb2524f tempest-DeleteServersTestJSON-1632919649 tempest-DeleteServersTestJSON-1632919649-project] Calling method '>' {{(pid=120740) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 18:03:04.632419 dv-cinder-852009-8-iscsi devstack@n-api.service[120740]: DEBUG nova.compute.api [None req-38a12c1d-058a-4328-aded-5904fbb2524f tempest-DeleteServersTestJSON-1632919649 tempest-DeleteServersTestJSON-1632919649-project] [instance: 207d1d8d-58a4-4b99-aa09-1c5023c60784] Fetching instance by UUID {{(pid=120740) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 18:03:04.639235 dv-cinder-852009-8-iscsi devstack@n-api.service[120740]: DEBUG oslo_concurrency.lockutils [None req-38a12c1d-058a-4328-aded-5904fbb2524f tempest-DeleteServersTestJSON-1632919649 tempest-DeleteServersTestJSON-1632919649-project] Acquiring lock "1daf4f4c-0e4a-4779-b53a-78c48397ea2f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120740) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 18:03:04.639724 dv-cinder-852009-8-iscsi devstack@n-api.service[120740]: DEBUG oslo_concurrency.lockutils [None req-38a12c1d-058a-4328-aded-5904fbb2524f tempest-DeleteServersTestJSON-1632919649 tempest-DeleteServersTestJSON-1632919649-project] Lock "1daf4f4c-0e4a-4779-b53a-78c48397ea2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120740) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 18:03:04.640156 dv-cinder-852009-8-iscsi devstack@n-api.service[120740]: DEBUG oslo_concurrency.lockutils [None req-38a12c1d-058a-4328-aded-5904fbb2524f tempest-DeleteServersTestJSON-1632919649 tempest-DeleteServersTestJSON-1632919649-project] Lock "1daf4f4c-0e4a-4779-b53a-78c48397ea2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120740) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 18:03:04.640884 dv-cinder-852009-8-iscsi devstack@n-api.service[120740]: DEBUG oslo_concurrency.lockutils [None req-38a12c1d-058a-4328-aded-5904fbb2524f tempest-DeleteServersTestJSON-1632919649 tempest-DeleteServersTestJSON-1632919649-project] Acquiring lock "1daf4f4c-0e4a-4779-b53a-78c48397ea2f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120740) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 18:03:04.641336 dv-cinder-852009-8-iscsi devstack@n-api.service[120740]: DEBUG oslo_concurrency.lockutils [None req-38a12c1d-058a-4328-aded-5904fbb2524f tempest-DeleteServersTestJSON-1632919649 tempest-DeleteServersTestJSON-1632919649-project] Lock "1daf4f4c-0e4a-4779-b53a-78c48397ea2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120740) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 18:03:04.641759 dv-cinder-852009-8-iscsi devstack@n-api.service[120740]: DEBUG oslo_concurrency.lockutils [None req-38a12c1d-058a-4328-aded-5904fbb2524f tempest-DeleteServersTestJSON-1632919649 tempest-DeleteServersTestJSON-1632919649-project] Lock "1daf4f4c-0e4a-4779-b53a-78c48397ea2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120740) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 18:03:04.776904 dv-cinder-852009-8-iscsi devstack@n-api.service[120740]: DEBUG nova.policy [None req-38a12c1d-058a-4328-aded-5904fbb2524f tempest-DeleteServersTestJSON-1632919649 tempest-DeleteServersTestJSON-1632919649-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '51db5ef052144879b53979268ac4ceb5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '66136f123f5b4ad0a824920bbdf9d245', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120740) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 18:03:04.785698 dv-cinder-852009-8-iscsi devstack@n-api.service[120740]: INFO nova.api.openstack.requestlog [None req-38a12c1d-058a-4328-aded-5904fbb2524f tempest-DeleteServersTestJSON-1632919649 tempest-DeleteServersTestJSON-1632919649-project] 10.222.0.43 "GET /compute/v2.1/servers/207d1d8d-58a4-4b99-aa09-1c5023c60784" status: 200 len: 1552 microversion: 2.1 time: 0.158125 Sep 13 18:03:04.786473 dv-cinder-852009-8-iscsi devstack@n-api.service[120740]: [pid: 120740|app: 0|req: 84/160] 10.222.0.43 () {58 vars in 1236 bytes} [Tue Sep 13 18:03:04 2022] GET /compute/v2.1/servers/207d1d8d-58a4-4b99-aa09-1c5023c60784 => generated 1552 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 13 18:03:05.032606 dv-cinder-852009-8-iscsi devstack@n-api.service[120741]: DEBUG nova.api.openstack.wsgi [None req-1baed733-ea58-4b6f-87b3-11b17cb8dc1c tempest-ServerRescueNegativeTestJSON-412251590 tempest-ServerRescueNegativeTestJSON-412251590-project] Calling method '>' {{(pid=120741) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 18:03:05.032606 dv-cinder-852009-8-iscsi devstack@n-api.service[120741]: DEBUG nova.compute.api [None req-1baed733-ea58-4b6f-87b3-11b17cb8dc1c tempest-ServerRescueNegativeTestJSON-412251590 tempest-ServerRescueNegativeTestJSON-412251590-project] [instance: 8cd29851-35c1-4032-a137-ab9419a2ec5b] Fetching instance by UUID {{(pid=120741) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 18:03:05.038814 dv-cinder-852009-8-iscsi devstack@n-api.service[120741]: DEBUG oslo_concurrency.lockutils [None req-1baed733-ea58-4b6f-87b3-11b17cb8dc1c tempest-ServerRescueNegativeTestJSON-412251590 tempest-ServerRescueNegativeTestJSON-412251590-project] Acquiring lock "1daf4f4c-0e4a-4779-b53a-78c48397ea2f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120741) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 18:03:05.039382 dv-cinder-852009-8-iscsi devstack@n-api.service[120741]: DEBUG oslo_concurrency.lockutils [None req-1baed733-ea58-4b6f-87b3-11b17cb8dc1c tempest-ServerRescueNegativeTestJSON-412251590 tempest-ServerRescueNegativeTestJSON-412251590-project] Lock "1daf4f4c-0e4a-4779-b53a-78c48397ea2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120741) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 18:03:05.039926 dv-cinder-852009-8-iscsi devstack@n-api.service[120741]: DEBUG oslo_concurrency.lockutils [None req-1baed733-ea58-4b6f-87b3-11b17cb8dc1c tempest-ServerRescueNegativeTestJSON-412251590 tempest-ServerRescueNegativeTestJSON-412251590-project] Lock "1daf4f4c-0e4a-4779-b53a-78c48397ea2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120741) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 18:03:05.040720 dv-cinder-852009-8-iscsi devstack@n-api.service[120741]: DEBUG oslo_concurrency.lockutils [None req-1baed733-ea58-4b6f-87b3-11b17cb8dc1c tempest-ServerRescueNegativeTestJSON-412251590 tempest-ServerRescueNegativeTestJSON-412251590-project] Acquiring lock "1daf4f4c-0e4a-4779-b53a-78c48397ea2f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120741) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 18:03:05.041406 dv-cinder-852009-8-iscsi devstack@n-api.service[120741]: DEBUG oslo_concurrency.lockutils [None req-1baed733-ea58-4b6f-87b3-11b17cb8dc1c tempest-ServerRescueNegativeTestJSON-412251590 tempest-ServerRescueNegativeTestJSON-412251590-project] Lock "1daf4f4c-0e4a-4779-b53a-78c48397ea2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120741) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 18:03:05.042027 dv-cinder-852009-8-iscsi devstack@n-api.service[120741]: DEBUG oslo_concurrency.lockutils [None req-1baed733-ea58-4b6f-87b3-11b17cb8dc1c tempest-ServerRescueNegativeTestJSON-412251590 tempest-ServerRescueNegativeTestJSON-412251590-project] Lock "1daf4f4c-0e4a-4779-b53a-78c48397ea2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120741) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 18:03:05.184991 dv-cinder-852009-8-iscsi devstack@n-api.service[120741]: DEBUG nova.policy [None req-1baed733-ea58-4b6f-87b3-11b17cb8dc1c tempest-ServerRescueNegativeTestJSON-412251590 tempest-ServerRescueNegativeTestJSON-412251590-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '60800cf2774e409d9c1b6f4992669991', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2eae4acecf6c4961830ead78d71b2ad3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120741) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 18:03:05.194202 dv-cinder-852009-8-iscsi devstack@n-api.service[120741]: INFO nova.api.openstack.requestlog [None req-1baed733-ea58-4b6f-87b3-11b17cb8dc1c tempest-ServerRescueNegativeTestJSON-412251590 tempest-ServerRescueNegativeTestJSON-412251590-project] 10.222.0.43 "GET /compute/v2.1/servers/8cd29851-35c1-4032-a137-ab9419a2ec5b" status: 200 len: 1522 microversion: 2.1 time: 0.166659 Sep 13 18:03:05.195356 dv-cinder-852009-8-iscsi devstack@n-api.service[120741]: [pid: 120741|app: 0|req: 77/161] 10.222.0.43 () {58 vars in 1236 bytes} [Tue Sep 13 18:03:05 2022] GET /compute/v2.1/servers/8cd29851-35c1-4032-a137-ab9419a2ec5b => generated 1522 bytes in 169 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 13 18:03:05.808962 dv-cinder-852009-8-iscsi devstack@n-api.service[120740]: DEBUG nova.api.openstack.wsgi [None req-0e7e918d-a658-412d-b5ac-be6e68eeac43 tempest-DeleteServersTestJSON-1632919649 tempest-DeleteServersTestJSON-1632919649-project] Calling method '>' {{(pid=120740) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 18:03:05.809572 dv-cinder-852009-8-iscsi devstack@n-api.service[120740]: DEBUG nova.compute.api [None req-0e7e918d-a658-412d-b5ac-be6e68eeac43 tempest-DeleteServersTestJSON-1632919649 tempest-DeleteServersTestJSON-1632919649-project] [instance: 207d1d8d-58a4-4b99-aa09-1c5023c60784] Fetching instance by UUID {{(pid=120740) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 18:03:05.816094 dv-cinder-852009-8-iscsi devstack@n-api.service[120740]: DEBUG oslo_concurrency.lockutils [None req-0e7e918d-a658-412d-b5ac-be6e68eeac43 tempest-DeleteServersTestJSON-1632919649 tempest-DeleteServersTestJSON-1632919649-project] Acquiring lock "1daf4f4c-0e4a-4779-b53a-78c48397ea2f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120740) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 18:03:05.816592 dv-cinder-852009-8-iscsi devstack@n-api.service[120740]: DEBUG oslo_concurrency.lockutils [None req-0e7e918d-a658-412d-b5ac-be6e68eeac43 tempest-DeleteServersTestJSON-1632919649 tempest-DeleteServersTestJSON-1632919649-project] Lock "1daf4f4c-0e4a-4779-b53a-78c48397ea2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120740) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 18:03:05.817026 dv-cinder-852009-8-iscsi devstack@n-api.service[120740]: DEBUG oslo_concurrency.lockutils [None req-0e7e918d-a658-412d-b5ac-be6e68eeac43 tempest-DeleteServersTestJSON-1632919649 tempest-DeleteServersTestJSON-1632919649-project] Lock "1daf4f4c-0e4a-4779-b53a-78c48397ea2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120740) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 18:03:05.817732 dv-cinder-852009-8-iscsi devstack@n-api.service[120740]: DEBUG oslo_concurrency.lockutils [None req-0e7e918d-a658-412d-b5ac-be6e68eeac43 tempest-DeleteServersTestJSON-1632919649 tempest-DeleteServersTestJSON-1632919649-project] Acquiring lock "1daf4f4c-0e4a-4779-b53a-78c48397ea2f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120740) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 18:03:05.818201 dv-cinder-852009-8-iscsi devstack@n-api.service[120740]: DEBUG oslo_concurrency.lockutils [None req-0e7e918d-a658-412d-b5ac-be6e68eeac43 tempest-DeleteServersTestJSON-1632919649 tempest-DeleteServersTestJSON-1632919649-project] Lock "1daf4f4c-0e4a-4779-b53a-78c48397ea2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120740) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 18:03:05.818623 dv-cinder-852009-8-iscsi devstack@n-api.service[120740]: DEBUG oslo_concurrency.lockutils [None req-0e7e918d-a658-412d-b5ac-be6e68eeac43 tempest-DeleteServersTestJSON-1632919649 tempest-DeleteServersTestJSON-1632919649-project] Lock "1daf4f4c-0e4a-4779-b53a-78c48397ea2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120740) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 18:03:05.955129 dv-cinder-852009-8-iscsi devstack@n-api.service[120740]: DEBUG nova.policy [None req-0e7e918d-a658-412d-b5ac-be6e68eeac43 tempest-DeleteServersTestJSON-1632919649 tempest-DeleteServersTestJSON-1632919649-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '51db5ef052144879b53979268ac4ceb5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '66136f123f5b4ad0a824920bbdf9d245', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120740) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 18:03:05.964774 dv-cinder-852009-8-iscsi devstack@n-api.service[120740]: INFO nova.api.openstack.requestlog [None req-0e7e918d-a658-412d-b5ac-be6e68eeac43 tempest-DeleteServersTestJSON-1632919649 tempest-DeleteServersTestJSON-1632919649-project] 10.222.0.43 "GET /compute/v2.1/servers/207d1d8d-58a4-4b99-aa09-1c5023c60784" status: 200 len: 1552 microversion: 2.1 time: 0.159683 Sep 13 18:03:05.965474 dv-cinder-852009-8-iscsi devstack@n-api.service[120740]: [pid: 120740|app: 0|req: 85/162] 10.222.0.43 () {58 vars in 1236 bytes} [Tue Sep 13 18:03:05 2022] GET /compute/v2.1/servers/207d1d8d-58a4-4b99-aa09-1c5023c60784 => generated 1552 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 13 18:03:06.217294 dv-cinder-852009-8-iscsi devstack@n-api.service[120741]: DEBUG nova.api.openstack.wsgi [None req-c792e4b8-9dcf-4e49-9a5d-c3dfe391fd28 tempest-ServerRescueNegativeTestJSON-412251590 tempest-ServerRescueNegativeTestJSON-412251590-project] Calling method '>' {{(pid=120741) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 18:03:06.218229 dv-cinder-852009-8-iscsi devstack@n-api.service[120741]: DEBUG nova.compute.api [None req-c792e4b8-9dcf-4e49-9a5d-c3dfe391fd28 tempest-ServerRescueNegativeTestJSON-412251590 tempest-ServerRescueNegativeTestJSON-412251590-project] [instance: 8cd29851-35c1-4032-a137-ab9419a2ec5b] Fetching instance by UUID {{(pid=120741) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 18:03:06.224592 dv-cinder-852009-8-iscsi devstack@n-api.service[120741]: DEBUG oslo_concurrency.lockutils [None req-c792e4b8-9dcf-4e49-9a5d-c3dfe391fd28 tempest-ServerRescueNegativeTestJSON-412251590 tempest-ServerRescueNegativeTestJSON-412251590-project] Acquiring lock "1daf4f4c-0e4a-4779-b53a-78c48397ea2f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120741) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 18:03:06.225086 dv-cinder-852009-8-iscsi devstack@n-api.service[120741]: DEBUG oslo_concurrency.lockutils [None req-c792e4b8-9dcf-4e49-9a5d-c3dfe391fd28 tempest-ServerRescueNegativeTestJSON-412251590 tempest-ServerRescueNegativeTestJSON-412251590-project] Lock "1daf4f4c-0e4a-4779-b53a-78c48397ea2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120741) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 18:03:06.225508 dv-cinder-852009-8-iscsi devstack@n-api.service[120741]: DEBUG oslo_concurrency.lockutils [None req-c792e4b8-9dcf-4e49-9a5d-c3dfe391fd28 tempest-ServerRescueNegativeTestJSON-412251590 tempest-ServerRescueNegativeTestJSON-412251590-project] Lock "1daf4f4c-0e4a-4779-b53a-78c48397ea2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120741) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 18:03:06.226199 dv-cinder-852009-8-iscsi devstack@n-api.service[120741]: DEBUG oslo_concurrency.lockutils [None req-c792e4b8-9dcf-4e49-9a5d-c3dfe391fd28 tempest-ServerRescueNegativeTestJSON-412251590 tempest-ServerRescueNegativeTestJSON-412251590-project] Acquiring lock "1daf4f4c-0e4a-4779-b53a-78c48397ea2f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120741) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 18:03:06.226642 dv-cinder-852009-8-iscsi devstack@n-api.service[120741]: DEBUG oslo_concurrency.lockutils [None req-c792e4b8-9dcf-4e49-9a5d-c3dfe391fd28 tempest-ServerRescueNegativeTestJSON-412251590 tempest-ServerRescueNegativeTestJSON-412251590-project] Lock "1daf4f4c-0e4a-4779-b53a-78c48397ea2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120741) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 18:03:06.227066 dv-cinder-852009-8-iscsi devstack@n-api.service[120741]: DEBUG oslo_concurrency.lockutils [None req-c792e4b8-9dcf-4e49-9a5d-c3dfe391fd28 tempest-ServerRescueNegativeTestJSON-412251590 tempest-ServerRescueNegativeTestJSON-412251590-project] Lock "1daf4f4c-0e4a-4779-b53a-78c48397ea2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120741) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 18:03:06.364589 dv-cinder-852009-8-iscsi devstack@n-api.service[120741]: DEBUG nova.policy [None req-c792e4b8-9dcf-4e49-9a5d-c3dfe391fd28 tempest-ServerRescueNegativeTestJSON-412251590 tempest-ServerRescueNegativeTestJSON-412251590-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '60800cf2774e409d9c1b6f4992669991', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2eae4acecf6c4961830ead78d71b2ad3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120741) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 18:03:06.372835 dv-cinder-852009-8-iscsi devstack@n-api.service[120741]: INFO nova.api.openstack.requestlog [None req-c792e4b8-9dcf-4e49-9a5d-c3dfe391fd28 tempest-ServerRescueNegativeTestJSON-412251590 tempest-ServerRescueNegativeTestJSON-412251590-project] 10.222.0.43 "GET /compute/v2.1/servers/8cd29851-35c1-4032-a137-ab9419a2ec5b" status: 200 len: 1522 microversion: 2.1 time: 0.159323 Sep 13 18:03:06.373423 dv-cinder-852009-8-iscsi devstack@n-api.service[120741]: [pid: 120741|app: 0|req: 78/163] 10.222.0.43 () {58 vars in 1236 bytes} [Tue Sep 13 18:03:06 2022] GET /compute/v2.1/servers/8cd29851-35c1-4032-a137-ab9419a2ec5b => generated 1522 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 13 18:03:06.989551 dv-cinder-852009-8-iscsi devstack@n-api.service[120740]: DEBUG nova.api.openstack.wsgi [None req-cd6340fe-5aa7-4377-9527-ca9a50256a92 tempest-DeleteServersTestJSON-1632919649 tempest-DeleteServersTestJSON-1632919649-project] Calling method '>' {{(pid=120740) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 18:03:06.990161 dv-cinder-852009-8-iscsi devstack@n-api.service[120740]: DEBUG nova.compute.api [None req-cd6340fe-5aa7-4377-9527-ca9a50256a92 tempest-DeleteServersTestJSON-1632919649 tempest-DeleteServersTestJSON-1632919649-project] [instance: 207d1d8d-58a4-4b99-aa09-1c5023c60784] Fetching instance by UUID {{(pid=120740) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 18:03:06.996520 dv-cinder-852009-8-iscsi devstack@n-api.service[120740]: DEBUG oslo_concurrency.lockutils [None req-cd6340fe-5aa7-4377-9527-ca9a50256a92 tempest-DeleteServersTestJSON-1632919649 tempest-DeleteServersTestJSON-1632919649-project] Acquiring lock "1daf4f4c-0e4a-4779-b53a-78c48397ea2f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120740) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 18:03:06.997024 dv-cinder-852009-8-iscsi devstack@n-api.service[120740]: DEBUG oslo_concurrency.lockutils [None req-cd6340fe-5aa7-4377-9527-ca9a50256a92 tempest-DeleteServersTestJSON-1632919649 tempest-DeleteServersTestJSON-1632919649-project] Lock "1daf4f4c-0e4a-4779-b53a-78c48397ea2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120740) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 18:03:06.997431 dv-cinder-852009-8-iscsi devstack@n-api.service[120740]: DEBUG oslo_concurrency.lockutils [None req-cd6340fe-5aa7-4377-9527-ca9a50256a92 tempest-DeleteServersTestJSON-1632919649 tempest-DeleteServersTestJSON-1632919649-project] Lock "1daf4f4c-0e4a-4779-b53a-78c48397ea2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120740) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 18:03:06.998149 dv-cinder-852009-8-iscsi devstack@n-api.service[120740]: DEBUG oslo_concurrency.lockutils [None req-cd6340fe-5aa7-4377-9527-ca9a50256a92 tempest-DeleteServersTestJSON-1632919649 tempest-DeleteServersTestJSON-1632919649-project] Acquiring lock "1daf4f4c-0e4a-4779-b53a-78c48397ea2f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120740) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 18:03:06.998588 dv-cinder-852009-8-iscsi devstack@n-api.service[120740]: DEBUG oslo_concurrency.lockutils [None req-cd6340fe-5aa7-4377-9527-ca9a50256a92 tempest-DeleteServersTestJSON-1632919649 tempest-DeleteServersTestJSON-1632919649-project] Lock "1daf4f4c-0e4a-4779-b53a-78c48397ea2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120740) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 18:03:06.999021 dv-cinder-852009-8-iscsi devstack@n-api.service[120740]: DEBUG oslo_concurrency.lockutils [None req-cd6340fe-5aa7-4377-9527-ca9a50256a92 tempest-DeleteServersTestJSON-1632919649 tempest-DeleteServersTestJSON-1632919649-project] Lock "1daf4f4c-0e4a-4779-b53a-78c48397ea2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120740) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 18:03:07.180324 dv-cinder-852009-8-iscsi devstack@n-api.service[120740]: DEBUG nova.policy [None req-cd6340fe-5aa7-4377-9527-ca9a50256a92 tempest-DeleteServersTestJSON-1632919649 tempest-DeleteServersTestJSON-1632919649-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '51db5ef052144879b53979268ac4ceb5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '66136f123f5b4ad0a824920bbdf9d245', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120740) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 18:03:07.193998 dv-cinder-852009-8-iscsi devstack@n-api.service[120740]: INFO nova.api.openstack.requestlog [None req-cd6340fe-5aa7-4377-9527-ca9a50256a92 tempest-DeleteServersTestJSON-1632919649 tempest-DeleteServersTestJSON-1632919649-project] 10.222.0.43 "GET /compute/v2.1/servers/207d1d8d-58a4-4b99-aa09-1c5023c60784" status: 200 len: 1552 microversion: 2.1 time: 0.208311 Sep 13 18:03:07.197590 dv-cinder-852009-8-iscsi devstack@n-api.service[120740]: [pid: 120740|app: 0|req: 86/164] 10.222.0.43 () {58 vars in 1236 bytes} [Tue Sep 13 18:03:06 2022] GET /compute/v2.1/servers/207d1d8d-58a4-4b99-aa09-1c5023c60784 => generated 1552 bytes in 213 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 13 18:03:07.397093 dv-cinder-852009-8-iscsi devstack@n-api.service[120741]: DEBUG nova.api.openstack.wsgi [None req-2296c2fc-25af-4ba2-93ab-d70224d14af2 tempest-ServerRescueNegativeTestJSON-412251590 tempest-ServerRescueNegativeTestJSON-412251590-project] Calling method '>' {{(pid=120741) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 18:03:07.397621 dv-cinder-852009-8-iscsi devstack@n-api.service[120741]: DEBUG nova.compute.api [None req-2296c2fc-25af-4ba2-93ab-d70224d14af2 tempest-ServerRescueNegativeTestJSON-412251590 tempest-ServerRescueNegativeTestJSON-412251590-project] [instance: 8cd29851-35c1-4032-a137-ab9419a2ec5b] Fetching instance by UUID {{(pid=120741) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 18:03:07.404300 dv-cinder-852009-8-iscsi devstack@n-api.service[120741]: DEBUG oslo_concurrency.lockutils [None req-2296c2fc-25af-4ba2-93ab-d70224d14af2 tempest-ServerRescueNegativeTestJSON-412251590 tempest-ServerRescueNegativeTestJSON-412251590-project] Acquiring lock "1daf4f4c-0e4a-4779-b53a-78c48397ea2f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120741) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 18:03:07.404821 dv-cinder-852009-8-iscsi devstack@n-api.service[120741]: DEBUG oslo_concurrency.lockutils [None req-2296c2fc-25af-4ba2-93ab-d70224d14af2 tempest-ServerRescueNegativeTestJSON-412251590 tempest-ServerRescueNegativeTestJSON-412251590-project] Lock "1daf4f4c-0e4a-4779-b53a-78c48397ea2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120741) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 18:03:07.405256 dv-cinder-852009-8-iscsi devstack@n-api.service[120741]: DEBUG oslo_concurrency.lockutils [None req-2296c2fc-25af-4ba2-93ab-d70224d14af2 tempest-ServerRescueNegativeTestJSON-412251590 tempest-ServerRescueNegativeTestJSON-412251590-project] Lock "1daf4f4c-0e4a-4779-b53a-78c48397ea2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120741) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 18:03:07.405956 dv-cinder-852009-8-iscsi devstack@n-api.service[120741]: DEBUG oslo_concurrency.lockutils [None req-2296c2fc-25af-4ba2-93ab-d70224d14af2 tempest-ServerRescueNegativeTestJSON-412251590 tempest-ServerRescueNegativeTestJSON-412251590-project] Acquiring lock "1daf4f4c-0e4a-4779-b53a-78c48397ea2f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120741) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 18:03:07.406401 dv-cinder-852009-8-iscsi devstack@n-api.service[120741]: DEBUG oslo_concurrency.lockutils [None req-2296c2fc-25af-4ba2-93ab-d70224d14af2 tempest-ServerRescueNegativeTestJSON-412251590 tempest-ServerRescueNegativeTestJSON-412251590-project] Lock "1daf4f4c-0e4a-4779-b53a-78c48397ea2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120741) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 18:03:07.406817 dv-cinder-852009-8-iscsi devstack@n-api.service[120741]: DEBUG oslo_concurrency.lockutils [None req-2296c2fc-25af-4ba2-93ab-d70224d14af2 tempest-ServerRescueNegativeTestJSON-412251590 tempest-ServerRescueNegativeTestJSON-412251590-project] Lock "1daf4f4c-0e4a-4779-b53a-78c48397ea2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120741) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 18:03:07.545381 dv-cinder-852009-8-iscsi devstack@n-api.service[120741]: DEBUG nova.policy [None req-2296c2fc-25af-4ba2-93ab-d70224d14af2 tempest-ServerRescueNegativeTestJSON-412251590 tempest-ServerRescueNegativeTestJSON-412251590-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '60800cf2774e409d9c1b6f4992669991', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2eae4acecf6c4961830ead78d71b2ad3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120741) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 18:03:07.553546 dv-cinder-852009-8-iscsi devstack@n-api.service[120741]: INFO nova.api.openstack.requestlog [None req-2296c2fc-25af-4ba2-93ab-d70224d14af2 tempest-ServerRescueNegativeTestJSON-412251590 tempest-ServerRescueNegativeTestJSON-412251590-project] 10.222.0.43 "GET /compute/v2.1/servers/8cd29851-35c1-4032-a137-ab9419a2ec5b" status: 200 len: 1522 microversion: 2.1 time: 0.160358 Sep 13 18:03:07.554435 dv-cinder-852009-8-iscsi devstack@n-api.service[120741]: [pid: 120741|app: 0|req: 79/165] 10.222.0.43 () {58 vars in 1236 bytes} [Tue Sep 13 18:03:07 2022] GET /compute/v2.1/servers/8cd29851-35c1-4032-a137-ab9419a2ec5b => generated 1522 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 13 18:03:08.224588 dv-cinder-852009-8-iscsi devstack@n-api.service[120740]: DEBUG nova.api.openstack.wsgi [None req-ca297668-375b-4d80-9fb5-e1c229048314 tempest-DeleteServersTestJSON-1632919649 tempest-DeleteServersTestJSON-1632919649-project] Calling method '>' {{(pid=120740) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 18:03:08.238783 dv-cinder-852009-8-iscsi devstack@n-api.service[120740]: DEBUG nova.compute.api [None req-ca297668-375b-4d80-9fb5-e1c229048314 tempest-DeleteServersTestJSON-1632919649 tempest-DeleteServersTestJSON-1632919649-project] [instance: 207d1d8d-58a4-4b99-aa09-1c5023c60784] Fetching instance by UUID {{(pid=120740) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 18:03:08.238783 dv-cinder-852009-8-iscsi devstack@n-api.service[120740]: DEBUG oslo_concurrency.lockutils [None req-ca297668-375b-4d80-9fb5-e1c229048314 tempest-DeleteServersTestJSON-1632919649 tempest-DeleteServersTestJSON-1632919649-project] Acquiring lock "1daf4f4c-0e4a-4779-b53a-78c48397ea2f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120740) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 18:03:08.238783 dv-cinder-852009-8-iscsi devstack@n-api.service[120740]: DEBUG oslo_concurrency.lockutils [None req-ca297668-375b-4d80-9fb5-e1c229048314 tempest-DeleteServersTestJSON-1632919649 tempest-DeleteServersTestJSON-1632919649-project] Lock "1daf4f4c-0e4a-4779-b53a-78c48397ea2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120740) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 18:03:08.238783 dv-cinder-852009-8-iscsi devstack@n-api.service[120740]: DEBUG oslo_concurrency.lockutils [None req-ca297668-375b-4d80-9fb5-e1c229048314 tempest-DeleteServersTestJSON-1632919649 tempest-DeleteServersTestJSON-1632919649-project] Lock "1daf4f4c-0e4a-4779-b53a-78c48397ea2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120740) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 18:03:08.239248 dv-cinder-852009-8-iscsi devstack@n-api.service[120740]: DEBUG oslo_concurrency.lockutils [None req-ca297668-375b-4d80-9fb5-e1c229048314 tempest-DeleteServersTestJSON-1632919649 tempest-DeleteServersTestJSON-1632919649-project] Acquiring lock "1daf4f4c-0e4a-4779-b53a-78c48397ea2f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120740) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 18:03:08.239248 dv-cinder-852009-8-iscsi devstack@n-api.service[120740]: DEBUG oslo_concurrency.lockutils [None req-ca297668-375b-4d80-9fb5-e1c229048314 tempest-DeleteServersTestJSON-1632919649 tempest-DeleteServersTestJSON-1632919649-project] Lock "1daf4f4c-0e4a-4779-b53a-78c48397ea2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120740) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 18:03:08.239248 dv-cinder-852009-8-iscsi devstack@n-api.service[120740]: DEBUG oslo_concurrency.lockutils [None req-ca297668-375b-4d80-9fb5-e1c229048314 tempest-DeleteServersTestJSON-1632919649 tempest-DeleteServersTestJSON-1632919649-project] Lock "1daf4f4c-0e4a-4779-b53a-78c48397ea2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120740) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 18:03:08.461594 dv-cinder-852009-8-iscsi devstack@n-api.service[120740]: DEBUG nova.policy [None req-ca297668-375b-4d80-9fb5-e1c229048314 tempest-DeleteServersTestJSON-1632919649 tempest-DeleteServersTestJSON-1632919649-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '51db5ef052144879b53979268ac4ceb5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '66136f123f5b4ad0a824920bbdf9d245', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120740) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 18:03:08.479098 dv-cinder-852009-8-iscsi devstack@n-api.service[120740]: INFO nova.api.openstack.requestlog [None req-ca297668-375b-4d80-9fb5-e1c229048314 tempest-DeleteServersTestJSON-1632919649 tempest-DeleteServersTestJSON-1632919649-project] 10.222.0.43 "GET /compute/v2.1/servers/207d1d8d-58a4-4b99-aa09-1c5023c60784" status: 200 len: 1552 microversion: 2.1 time: 0.261284 Sep 13 18:03:08.480367 dv-cinder-852009-8-iscsi devstack@n-api.service[120740]: [pid: 120740|app: 0|req: 87/166] 10.222.0.43 () {58 vars in 1236 bytes} [Tue Sep 13 18:03:08 2022] GET /compute/v2.1/servers/207d1d8d-58a4-4b99-aa09-1c5023c60784 => generated 1552 bytes in 263 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 13 18:03:08.578255 dv-cinder-852009-8-iscsi devstack@n-api.service[120741]: DEBUG nova.api.openstack.wsgi [None req-cb13380c-9158-4e3a-a9c8-bb532d51476d tempest-ServerRescueNegativeTestJSON-412251590 tempest-ServerRescueNegativeTestJSON-412251590-project] Calling method '>' {{(pid=120741) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 18:03:08.579201 dv-cinder-852009-8-iscsi devstack@n-api.service[120741]: DEBUG nova.compute.api [None req-cb13380c-9158-4e3a-a9c8-bb532d51476d tempest-ServerRescueNegativeTestJSON-412251590 tempest-ServerRescueNegativeTestJSON-412251590-project] [instance: 8cd29851-35c1-4032-a137-ab9419a2ec5b] Fetching instance by UUID {{(pid=120741) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 18:03:08.588023 dv-cinder-852009-8-iscsi devstack@n-api.service[120741]: DEBUG oslo_concurrency.lockutils [None req-cb13380c-9158-4e3a-a9c8-bb532d51476d tempest-ServerRescueNegativeTestJSON-412251590 tempest-ServerRescueNegativeTestJSON-412251590-project] Acquiring lock "1daf4f4c-0e4a-4779-b53a-78c48397ea2f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120741) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 18:03:08.589455 dv-cinder-852009-8-iscsi devstack@n-api.service[120741]: DEBUG oslo_concurrency.lockutils [None req-cb13380c-9158-4e3a-a9c8-bb532d51476d tempest-ServerRescueNegativeTestJSON-412251590 tempest-ServerRescueNegativeTestJSON-412251590-project] Lock "1daf4f4c-0e4a-4779-b53a-78c48397ea2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120741) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 18:03:08.590004 dv-cinder-852009-8-iscsi devstack@n-api.service[120741]: DEBUG oslo_concurrency.lockutils [None req-cb13380c-9158-4e3a-a9c8-bb532d51476d tempest-ServerRescueNegativeTestJSON-412251590 tempest-ServerRescueNegativeTestJSON-412251590-project] Lock "1daf4f4c-0e4a-4779-b53a-78c48397ea2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120741) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 18:03:08.590772 dv-cinder-852009-8-iscsi devstack@n-api.service[120741]: DEBUG oslo_concurrency.lockutils [None req-cb13380c-9158-4e3a-a9c8-bb532d51476d tempest-ServerRescueNegativeTestJSON-412251590 tempest-ServerRescueNegativeTestJSON-412251590-project] Acquiring lock "1daf4f4c-0e4a-4779-b53a-78c48397ea2f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120741) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 18:03:08.591334 dv-cinder-852009-8-iscsi devstack@n-api.service[120741]: DEBUG oslo_concurrency.lockutils [None req-cb13380c-9158-4e3a-a9c8-bb532d51476d tempest-ServerRescueNegativeTestJSON-412251590 tempest-ServerRescueNegativeTestJSON-412251590-project] Lock "1daf4f4c-0e4a-4779-b53a-78c48397ea2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120741) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 18:03:08.591878 dv-cinder-852009-8-iscsi devstack@n-api.service[120741]: DEBUG oslo_concurrency.lockutils [None req-cb13380c-9158-4e3a-a9c8-bb532d51476d tempest-ServerRescueNegativeTestJSON-412251590 tempest-ServerRescueNegativeTestJSON-412251590-project] Lock "1daf4f4c-0e4a-4779-b53a-78c48397ea2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120741) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 18:03:08.798903 dv-cinder-852009-8-iscsi devstack@n-api.service[120741]: DEBUG nova.policy [None req-cb13380c-9158-4e3a-a9c8-bb532d51476d tempest-ServerRescueNegativeTestJSON-412251590 tempest-ServerRescueNegativeTestJSON-412251590-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '60800cf2774e409d9c1b6f4992669991', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2eae4acecf6c4961830ead78d71b2ad3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120741) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 18:03:08.807114 dv-cinder-852009-8-iscsi devstack@n-api.service[120741]: INFO nova.api.openstack.requestlog [None req-cb13380c-9158-4e3a-a9c8-bb532d51476d tempest-ServerRescueNegativeTestJSON-412251590 tempest-ServerRescueNegativeTestJSON-412251590-project] 10.222.0.43 "GET /compute/v2.1/servers/8cd29851-35c1-4032-a137-ab9419a2ec5b" status: 200 len: 1522 microversion: 2.1 time: 0.234027 Sep 13 18:03:08.808068 dv-cinder-852009-8-iscsi devstack@n-api.service[120741]: [pid: 120741|app: 0|req: 80/167] 10.222.0.43 () {58 vars in 1236 bytes} [Tue Sep 13 18:03:08 2022] GET /compute/v2.1/servers/8cd29851-35c1-4032-a137-ab9419a2ec5b => generated 1522 bytes in 236 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 13 18:03:08.943053 dv-cinder-852009-8-iscsi devstack@n-api.service[120740]: DEBUG nova.api.openstack.wsgi [req-4f84b655-be53-41e8-8303-a47424d96268 req-27449493-8322-4fe8-94bb-7b2583334361 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "207d1d8d-58a4-4b99-aa09-1c5023c60784", "name": "network-vif-deleted", "tag": "db9bff9b-84fc-4a92-8b2a-72aa37a0556d"}]} {{(pid=120740) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 13 18:03:08.962629 dv-cinder-852009-8-iscsi devstack@n-api.service[120740]: DEBUG oslo_concurrency.lockutils [req-4f84b655-be53-41e8-8303-a47424d96268 req-27449493-8322-4fe8-94bb-7b2583334361 service nova] Acquiring lock "1daf4f4c-0e4a-4779-b53a-78c48397ea2f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120740) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 18:03:08.963392 dv-cinder-852009-8-iscsi devstack@n-api.service[120740]: DEBUG oslo_concurrency.lockutils [req-4f84b655-be53-41e8-8303-a47424d96268 req-27449493-8322-4fe8-94bb-7b2583334361 service nova] Lock "1daf4f4c-0e4a-4779-b53a-78c48397ea2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120740) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 18:03:08.964065 dv-cinder-852009-8-iscsi devstack@n-api.service[120740]: DEBUG oslo_concurrency.lockutils [req-4f84b655-be53-41e8-8303-a47424d96268 req-27449493-8322-4fe8-94bb-7b2583334361 service nova] Lock "1daf4f4c-0e4a-4779-b53a-78c48397ea2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120740) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 18:03:08.984651 dv-cinder-852009-8-iscsi devstack@n-api.service[120740]: INFO nova.api.openstack.compute.server_external_events [req-4f84b655-be53-41e8-8303-a47424d96268 req-27449493-8322-4fe8-94bb-7b2583334361 service nova] Creating event network-vif-deleted:db9bff9b-84fc-4a92-8b2a-72aa37a0556d for instance 207d1d8d-58a4-4b99-aa09-1c5023c60784 on hv-cinder-85200 Sep 13 18:03:08.992540 dv-cinder-852009-8-iscsi devstack@n-api.service[120740]: INFO nova.api.openstack.requestlog [req-4f84b655-be53-41e8-8303-a47424d96268 req-27449493-8322-4fe8-94bb-7b2583334361 service nova] 10.222.0.43 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.057648 Sep 13 18:03:08.993580 dv-cinder-852009-8-iscsi devstack@n-api.service[120740]: [pid: 120740|app: 0|req: 88/168] 10.222.0.43 () {64 vars in 1317 bytes} [Tue Sep 13 18:03:08 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 60 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 13 18:03:09.503143 dv-cinder-852009-8-iscsi devstack@n-api.service[120741]: DEBUG nova.api.openstack.wsgi [None req-15593078-1ab5-4583-8e95-2186321d5a03 tempest-DeleteServersTestJSON-1632919649 tempest-DeleteServersTestJSON-1632919649-project] Calling method '>' {{(pid=120741) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 18:03:09.503765 dv-cinder-852009-8-iscsi devstack@n-api.service[120741]: DEBUG nova.compute.api [None req-15593078-1ab5-4583-8e95-2186321d5a03 tempest-DeleteServersTestJSON-1632919649 tempest-DeleteServersTestJSON-1632919649-project] [instance: 207d1d8d-58a4-4b99-aa09-1c5023c60784] Fetching instance by UUID {{(pid=120741) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 18:03:09.510147 dv-cinder-852009-8-iscsi devstack@n-api.service[120741]: DEBUG oslo_concurrency.lockutils [None req-15593078-1ab5-4583-8e95-2186321d5a03 tempest-DeleteServersTestJSON-1632919649 tempest-DeleteServersTestJSON-1632919649-project] Acquiring lock "1daf4f4c-0e4a-4779-b53a-78c48397ea2f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120741) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 18:03:09.510624 dv-cinder-852009-8-iscsi devstack@n-api.service[120741]: DEBUG oslo_concurrency.lockutils [None req-15593078-1ab5-4583-8e95-2186321d5a03 tempest-DeleteServersTestJSON-1632919649 tempest-DeleteServersTestJSON-1632919649-project] Lock "1daf4f4c-0e4a-4779-b53a-78c48397ea2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120741) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 18:03:09.511054 dv-cinder-852009-8-iscsi devstack@n-api.service[120741]: DEBUG oslo_concurrency.lockutils [None req-15593078-1ab5-4583-8e95-2186321d5a03 tempest-DeleteServersTestJSON-1632919649 tempest-DeleteServersTestJSON-1632919649-project] Lock "1daf4f4c-0e4a-4779-b53a-78c48397ea2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120741) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 18:03:09.512108 dv-cinder-852009-8-iscsi devstack@n-api.service[120741]: DEBUG oslo_concurrency.lockutils [None req-15593078-1ab5-4583-8e95-2186321d5a03 tempest-DeleteServersTestJSON-1632919649 tempest-DeleteServersTestJSON-1632919649-project] Acquiring lock "1daf4f4c-0e4a-4779-b53a-78c48397ea2f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120741) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 18:03:09.512224 dv-cinder-852009-8-iscsi devstack@n-api.service[120741]: DEBUG oslo_concurrency.lockutils [None req-15593078-1ab5-4583-8e95-2186321d5a03 tempest-DeleteServersTestJSON-1632919649 tempest-DeleteServersTestJSON-1632919649-project] Lock "1daf4f4c-0e4a-4779-b53a-78c48397ea2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120741) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 18:03:09.512912 dv-cinder-852009-8-iscsi devstack@n-api.service[120741]: DEBUG oslo_concurrency.lockutils [None req-15593078-1ab5-4583-8e95-2186321d5a03 tempest-DeleteServersTestJSON-1632919649 tempest-DeleteServersTestJSON-1632919649-project] Lock "1daf4f4c-0e4a-4779-b53a-78c48397ea2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120741) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 18:03:09.574388 dv-cinder-852009-8-iscsi devstack@n-api.service[120741]: DEBUG nova.policy [None req-15593078-1ab5-4583-8e95-2186321d5a03 tempest-DeleteServersTestJSON-1632919649 tempest-DeleteServersTestJSON-1632919649-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '51db5ef052144879b53979268ac4ceb5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '66136f123f5b4ad0a824920bbdf9d245', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120741) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 18:03:09.582791 dv-cinder-852009-8-iscsi devstack@n-api.service[120741]: INFO nova.api.openstack.requestlog [None req-15593078-1ab5-4583-8e95-2186321d5a03 tempest-DeleteServersTestJSON-1632919649 tempest-DeleteServersTestJSON-1632919649-project] 10.222.0.43 "GET /compute/v2.1/servers/207d1d8d-58a4-4b99-aa09-1c5023c60784" status: 200 len: 1346 microversion: 2.1 time: 0.083926 Sep 13 18:03:09.583387 dv-cinder-852009-8-iscsi devstack@n-api.service[120741]: [pid: 120741|app: 0|req: 81/169] 10.222.0.43 () {58 vars in 1236 bytes} [Tue Sep 13 18:03:09 2022] GET /compute/v2.1/servers/207d1d8d-58a4-4b99-aa09-1c5023c60784 => generated 1346 bytes in 85 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 13 18:03:09.831747 dv-cinder-852009-8-iscsi devstack@n-api.service[120740]: DEBUG nova.api.openstack.wsgi [None req-14cae071-a616-41fd-8249-a75a91efaf05 tempest-ServerRescueNegativeTestJSON-412251590 tempest-ServerRescueNegativeTestJSON-412251590-project] Calling method '>' {{(pid=120740) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 18:03:09.832454 dv-cinder-852009-8-iscsi devstack@n-api.service[120740]: DEBUG nova.compute.api [None req-14cae071-a616-41fd-8249-a75a91efaf05 tempest-ServerRescueNegativeTestJSON-412251590 tempest-ServerRescueNegativeTestJSON-412251590-project] [instance: 8cd29851-35c1-4032-a137-ab9419a2ec5b] Fetching instance by UUID {{(pid=120740) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 18:03:09.838820 dv-cinder-852009-8-iscsi devstack@n-api.service[120740]: DEBUG oslo_concurrency.lockutils [None req-14cae071-a616-41fd-8249-a75a91efaf05 tempest-ServerRescueNegativeTestJSON-412251590 tempest-ServerRescueNegativeTestJSON-412251590-project] Acquiring lock "1daf4f4c-0e4a-4779-b53a-78c48397ea2f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120740) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 18:03:09.839307 dv-cinder-852009-8-iscsi devstack@n-api.service[120740]: DEBUG oslo_concurrency.lockutils [None req-14cae071-a616-41fd-8249-a75a91efaf05 tempest-ServerRescueNegativeTestJSON-412251590 tempest-ServerRescueNegativeTestJSON-412251590-project] Lock "1daf4f4c-0e4a-4779-b53a-78c48397ea2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120740) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 18:03:09.839735 dv-cinder-852009-8-iscsi devstack@n-api.service[120740]: DEBUG oslo_concurrency.lockutils [None req-14cae071-a616-41fd-8249-a75a91efaf05 tempest-ServerRescueNegativeTestJSON-412251590 tempest-ServerRescueNegativeTestJSON-412251590-project] Lock "1daf4f4c-0e4a-4779-b53a-78c48397ea2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120740) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 18:03:09.840444 dv-cinder-852009-8-iscsi devstack@n-api.service[120740]: DEBUG oslo_concurrency.lockutils [None req-14cae071-a616-41fd-8249-a75a91efaf05 tempest-ServerRescueNegativeTestJSON-412251590 tempest-ServerRescueNegativeTestJSON-412251590-project] Acquiring lock "1daf4f4c-0e4a-4779-b53a-78c48397ea2f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120740) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 18:03:09.840885 dv-cinder-852009-8-iscsi devstack@n-api.service[120740]: DEBUG oslo_concurrency.lockutils [None req-14cae071-a616-41fd-8249-a75a91efaf05 tempest-ServerRescueNegativeTestJSON-412251590 tempest-ServerRescueNegativeTestJSON-412251590-project] Lock "1daf4f4c-0e4a-4779-b53a-78c48397ea2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120740) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 18:03:09.841284 dv-cinder-852009-8-iscsi devstack@n-api.service[120740]: DEBUG oslo_concurrency.lockutils [None req-14cae071-a616-41fd-8249-a75a91efaf05 tempest-ServerRescueNegativeTestJSON-412251590 tempest-ServerRescueNegativeTestJSON-412251590-project] Lock "1daf4f4c-0e4a-4779-b53a-78c48397ea2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120740) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 18:03:09.975796 dv-cinder-852009-8-iscsi devstack@n-api.service[120740]: DEBUG nova.policy [None req-14cae071-a616-41fd-8249-a75a91efaf05 tempest-ServerRescueNegativeTestJSON-412251590 tempest-ServerRescueNegativeTestJSON-412251590-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '60800cf2774e409d9c1b6f4992669991', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2eae4acecf6c4961830ead78d71b2ad3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120740) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 18:03:09.984602 dv-cinder-852009-8-iscsi devstack@n-api.service[120740]: INFO nova.api.openstack.requestlog [None req-14cae071-a616-41fd-8249-a75a91efaf05 tempest-ServerRescueNegativeTestJSON-412251590 tempest-ServerRescueNegativeTestJSON-412251590-project] 10.222.0.43 "GET /compute/v2.1/servers/8cd29851-35c1-4032-a137-ab9419a2ec5b" status: 200 len: 1522 microversion: 2.1 time: 0.156968 Sep 13 18:03:09.985180 dv-cinder-852009-8-iscsi devstack@n-api.service[120740]: [pid: 120740|app: 0|req: 89/170] 10.222.0.43 () {58 vars in 1236 bytes} [Tue Sep 13 18:03:09 2022] GET /compute/v2.1/servers/8cd29851-35c1-4032-a137-ab9419a2ec5b => generated 1522 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 13 18:03:10.606949 dv-cinder-852009-8-iscsi devstack@n-api.service[120741]: DEBUG nova.api.openstack.wsgi [None req-7ab72619-243b-44b8-92b2-9ff4097b6945 tempest-DeleteServersTestJSON-1632919649 tempest-DeleteServersTestJSON-1632919649-project] Calling method '>' {{(pid=120741) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 18:03:10.607629 dv-cinder-852009-8-iscsi devstack@n-api.service[120741]: DEBUG nova.compute.api [None req-7ab72619-243b-44b8-92b2-9ff4097b6945 tempest-DeleteServersTestJSON-1632919649 tempest-DeleteServersTestJSON-1632919649-project] [instance: 207d1d8d-58a4-4b99-aa09-1c5023c60784] Fetching instance by UUID {{(pid=120741) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 18:03:10.614196 dv-cinder-852009-8-iscsi devstack@n-api.service[120741]: DEBUG oslo_concurrency.lockutils [None req-7ab72619-243b-44b8-92b2-9ff4097b6945 tempest-DeleteServersTestJSON-1632919649 tempest-DeleteServersTestJSON-1632919649-project] Acquiring lock "1daf4f4c-0e4a-4779-b53a-78c48397ea2f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120741) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 18:03:10.614708 dv-cinder-852009-8-iscsi devstack@n-api.service[120741]: DEBUG oslo_concurrency.lockutils [None req-7ab72619-243b-44b8-92b2-9ff4097b6945 tempest-DeleteServersTestJSON-1632919649 tempest-DeleteServersTestJSON-1632919649-project] Lock "1daf4f4c-0e4a-4779-b53a-78c48397ea2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120741) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 18:03:10.615137 dv-cinder-852009-8-iscsi devstack@n-api.service[120741]: DEBUG oslo_concurrency.lockutils [None req-7ab72619-243b-44b8-92b2-9ff4097b6945 tempest-DeleteServersTestJSON-1632919649 tempest-DeleteServersTestJSON-1632919649-project] Lock "1daf4f4c-0e4a-4779-b53a-78c48397ea2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120741) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 18:03:10.615888 dv-cinder-852009-8-iscsi devstack@n-api.service[120741]: DEBUG oslo_concurrency.lockutils [None req-7ab72619-243b-44b8-92b2-9ff4097b6945 tempest-DeleteServersTestJSON-1632919649 tempest-DeleteServersTestJSON-1632919649-project] Acquiring lock "1daf4f4c-0e4a-4779-b53a-78c48397ea2f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120741) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 18:03:10.616341 dv-cinder-852009-8-iscsi devstack@n-api.service[120741]: DEBUG oslo_concurrency.lockutils [None req-7ab72619-243b-44b8-92b2-9ff4097b6945 tempest-DeleteServersTestJSON-1632919649 tempest-DeleteServersTestJSON-1632919649-project] Lock "1daf4f4c-0e4a-4779-b53a-78c48397ea2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120741) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 18:03:10.616842 dv-cinder-852009-8-iscsi devstack@n-api.service[120741]: DEBUG oslo_concurrency.lockutils [None req-7ab72619-243b-44b8-92b2-9ff4097b6945 tempest-DeleteServersTestJSON-1632919649 tempest-DeleteServersTestJSON-1632919649-project] Lock "1daf4f4c-0e4a-4779-b53a-78c48397ea2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120741) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 18:03:10.689503 dv-cinder-852009-8-iscsi devstack@n-api.service[120741]: DEBUG nova.policy [None req-7ab72619-243b-44b8-92b2-9ff4097b6945 tempest-DeleteServersTestJSON-1632919649 tempest-DeleteServersTestJSON-1632919649-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '51db5ef052144879b53979268ac4ceb5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '66136f123f5b4ad0a824920bbdf9d245', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120741) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 18:03:10.697903 dv-cinder-852009-8-iscsi devstack@n-api.service[120741]: INFO nova.api.openstack.requestlog [None req-7ab72619-243b-44b8-92b2-9ff4097b6945 tempest-DeleteServersTestJSON-1632919649 tempest-DeleteServersTestJSON-1632919649-project] 10.222.0.43 "GET /compute/v2.1/servers/207d1d8d-58a4-4b99-aa09-1c5023c60784" status: 200 len: 1346 microversion: 2.1 time: 0.095500 Sep 13 18:03:10.698484 dv-cinder-852009-8-iscsi devstack@n-api.service[120741]: [pid: 120741|app: 0|req: 82/171] 10.222.0.43 () {58 vars in 1236 bytes} [Tue Sep 13 18:03:10 2022] GET /compute/v2.1/servers/207d1d8d-58a4-4b99-aa09-1c5023c60784 => generated 1346 bytes in 97 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 13 18:03:11.008727 dv-cinder-852009-8-iscsi devstack@n-api.service[120740]: DEBUG nova.api.openstack.wsgi [None req-9830f0e8-2907-40aa-b0ab-116b38eeddd9 tempest-ServerRescueNegativeTestJSON-412251590 tempest-ServerRescueNegativeTestJSON-412251590-project] Calling method '>' {{(pid=120740) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 18:03:11.009441 dv-cinder-852009-8-iscsi devstack@n-api.service[120740]: DEBUG nova.compute.api [None req-9830f0e8-2907-40aa-b0ab-116b38eeddd9 tempest-ServerRescueNegativeTestJSON-412251590 tempest-ServerRescueNegativeTestJSON-412251590-project] [instance: 8cd29851-35c1-4032-a137-ab9419a2ec5b] Fetching instance by UUID {{(pid=120740) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 18:03:11.017442 dv-cinder-852009-8-iscsi devstack@n-api.service[120740]: DEBUG oslo_concurrency.lockutils [None req-9830f0e8-2907-40aa-b0ab-116b38eeddd9 tempest-ServerRescueNegativeTestJSON-412251590 tempest-ServerRescueNegativeTestJSON-412251590-project] Acquiring lock "1daf4f4c-0e4a-4779-b53a-78c48397ea2f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120740) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 18:03:11.018096 dv-cinder-852009-8-iscsi devstack@n-api.service[120740]: DEBUG oslo_concurrency.lockutils [None req-9830f0e8-2907-40aa-b0ab-116b38eeddd9 tempest-ServerRescueNegativeTestJSON-412251590 tempest-ServerRescueNegativeTestJSON-412251590-project] Lock "1daf4f4c-0e4a-4779-b53a-78c48397ea2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120740) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 18:03:11.018625 dv-cinder-852009-8-iscsi devstack@n-api.service[120740]: DEBUG oslo_concurrency.lockutils [None req-9830f0e8-2907-40aa-b0ab-116b38eeddd9 tempest-ServerRescueNegativeTestJSON-412251590 tempest-ServerRescueNegativeTestJSON-412251590-project] Lock "1daf4f4c-0e4a-4779-b53a-78c48397ea2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120740) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 18:03:11.019736 dv-cinder-852009-8-iscsi devstack@n-api.service[120740]: DEBUG oslo_concurrency.lockutils [None req-9830f0e8-2907-40aa-b0ab-116b38eeddd9 tempest-ServerRescueNegativeTestJSON-412251590 tempest-ServerRescueNegativeTestJSON-412251590-project] Acquiring lock "1daf4f4c-0e4a-4779-b53a-78c48397ea2f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120740) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 18:03:11.020545 dv-cinder-852009-8-iscsi devstack@n-api.service[120740]: DEBUG oslo_concurrency.lockutils [None req-9830f0e8-2907-40aa-b0ab-116b38eeddd9 tempest-ServerRescueNegativeTestJSON-412251590 tempest-ServerRescueNegativeTestJSON-412251590-project] Lock "1daf4f4c-0e4a-4779-b53a-78c48397ea2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120740) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 18:03:11.022205 dv-cinder-852009-8-iscsi devstack@n-api.service[120740]: DEBUG oslo_concurrency.lockutils [None req-9830f0e8-2907-40aa-b0ab-116b38eeddd9 tempest-ServerRescueNegativeTestJSON-412251590 tempest-ServerRescueNegativeTestJSON-412251590-project] Lock "1daf4f4c-0e4a-4779-b53a-78c48397ea2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120740) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 18:03:11.044515 dv-cinder-852009-8-iscsi devstack@n-api.service[120740]: DEBUG dbcounter [-] [120740] Writing DB stats nova_cell1:SELECT=100 {{(pid=120740) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 18:03:11.174088 dv-cinder-852009-8-iscsi devstack@n-api.service[120740]: DEBUG nova.policy [None req-9830f0e8-2907-40aa-b0ab-116b38eeddd9 tempest-ServerRescueNegativeTestJSON-412251590 tempest-ServerRescueNegativeTestJSON-412251590-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '60800cf2774e409d9c1b6f4992669991', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2eae4acecf6c4961830ead78d71b2ad3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120740) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 18:03:11.184690 dv-cinder-852009-8-iscsi devstack@n-api.service[120740]: INFO nova.api.openstack.requestlog [None req-9830f0e8-2907-40aa-b0ab-116b38eeddd9 tempest-ServerRescueNegativeTestJSON-412251590 tempest-ServerRescueNegativeTestJSON-412251590-project] 10.222.0.43 "GET /compute/v2.1/servers/8cd29851-35c1-4032-a137-ab9419a2ec5b" status: 200 len: 1522 microversion: 2.1 time: 0.180673 Sep 13 18:03:11.185489 dv-cinder-852009-8-iscsi devstack@n-api.service[120740]: [pid: 120740|app: 0|req: 90/172] 10.222.0.43 () {58 vars in 1236 bytes} [Tue Sep 13 18:03:11 2022] GET /compute/v2.1/servers/8cd29851-35c1-4032-a137-ab9419a2ec5b => generated 1522 bytes in 183 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 13 18:03:11.724050 dv-cinder-852009-8-iscsi devstack@n-api.service[120741]: DEBUG nova.api.openstack.wsgi [None req-80eee918-7c8f-4601-88e7-9621fcdb93f9 tempest-DeleteServersTestJSON-1632919649 tempest-DeleteServersTestJSON-1632919649-project] Calling method '>' {{(pid=120741) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 18:03:11.724933 dv-cinder-852009-8-iscsi devstack@n-api.service[120741]: DEBUG nova.compute.api [None req-80eee918-7c8f-4601-88e7-9621fcdb93f9 tempest-DeleteServersTestJSON-1632919649 tempest-DeleteServersTestJSON-1632919649-project] [instance: 207d1d8d-58a4-4b99-aa09-1c5023c60784] Fetching instance by UUID {{(pid=120741) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 18:03:11.732955 dv-cinder-852009-8-iscsi devstack@n-api.service[120741]: DEBUG oslo_concurrency.lockutils [None req-80eee918-7c8f-4601-88e7-9621fcdb93f9 tempest-DeleteServersTestJSON-1632919649 tempest-DeleteServersTestJSON-1632919649-project] Acquiring lock "1daf4f4c-0e4a-4779-b53a-78c48397ea2f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120741) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 18:03:11.735200 dv-cinder-852009-8-iscsi devstack@n-api.service[120741]: DEBUG oslo_concurrency.lockutils [None req-80eee918-7c8f-4601-88e7-9621fcdb93f9 tempest-DeleteServersTestJSON-1632919649 tempest-DeleteServersTestJSON-1632919649-project] Lock "1daf4f4c-0e4a-4779-b53a-78c48397ea2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120741) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 18:03:11.735657 dv-cinder-852009-8-iscsi devstack@n-api.service[120741]: DEBUG oslo_concurrency.lockutils [None req-80eee918-7c8f-4601-88e7-9621fcdb93f9 tempest-DeleteServersTestJSON-1632919649 tempest-DeleteServersTestJSON-1632919649-project] Lock "1daf4f4c-0e4a-4779-b53a-78c48397ea2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120741) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 18:03:11.740190 dv-cinder-852009-8-iscsi devstack@n-api.service[120741]: DEBUG oslo_concurrency.lockutils [None req-80eee918-7c8f-4601-88e7-9621fcdb93f9 tempest-DeleteServersTestJSON-1632919649 tempest-DeleteServersTestJSON-1632919649-project] Acquiring lock "1daf4f4c-0e4a-4779-b53a-78c48397ea2f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120741) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 18:03:11.740897 dv-cinder-852009-8-iscsi devstack@n-api.service[120741]: DEBUG oslo_concurrency.lockutils [None req-80eee918-7c8f-4601-88e7-9621fcdb93f9 tempest-DeleteServersTestJSON-1632919649 tempest-DeleteServersTestJSON-1632919649-project] Lock "1daf4f4c-0e4a-4779-b53a-78c48397ea2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120741) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 18:03:11.741471 dv-cinder-852009-8-iscsi devstack@n-api.service[120741]: DEBUG oslo_concurrency.lockutils [None req-80eee918-7c8f-4601-88e7-9621fcdb93f9 tempest-DeleteServersTestJSON-1632919649 tempest-DeleteServersTestJSON-1632919649-project] Lock "1daf4f4c-0e4a-4779-b53a-78c48397ea2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120741) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 18:03:11.805280 dv-cinder-852009-8-iscsi devstack@n-api.service[120741]: DEBUG oslo_concurrency.lockutils [None req-80eee918-7c8f-4601-88e7-9621fcdb93f9 tempest-DeleteServersTestJSON-1632919649 tempest-DeleteServersTestJSON-1632919649-project] Acquiring lock "1daf4f4c-0e4a-4779-b53a-78c48397ea2f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120741) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 18:03:11.805908 dv-cinder-852009-8-iscsi devstack@n-api.service[120741]: DEBUG oslo_concurrency.lockutils [None req-80eee918-7c8f-4601-88e7-9621fcdb93f9 tempest-DeleteServersTestJSON-1632919649 tempest-DeleteServersTestJSON-1632919649-project] Lock "1daf4f4c-0e4a-4779-b53a-78c48397ea2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120741) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 18:03:11.806375 dv-cinder-852009-8-iscsi devstack@n-api.service[120741]: DEBUG oslo_concurrency.lockutils [None req-80eee918-7c8f-4601-88e7-9621fcdb93f9 tempest-DeleteServersTestJSON-1632919649 tempest-DeleteServersTestJSON-1632919649-project] Lock "1daf4f4c-0e4a-4779-b53a-78c48397ea2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120741) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 18:03:11.806791 dv-cinder-852009-8-iscsi devstack@n-api.service[120741]: DEBUG nova.objects.instance [None req-80eee918-7c8f-4601-88e7-9621fcdb93f9 tempest-DeleteServersTestJSON-1632919649 tempest-DeleteServersTestJSON-1632919649-project] Lazy-loading 'fault' on Instance uuid 207d1d8d-58a4-4b99-aa09-1c5023c60784 {{(pid=120741) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Sep 13 18:03:11.856102 dv-cinder-852009-8-iscsi devstack@n-api.service[120741]: DEBUG nova.policy [None req-80eee918-7c8f-4601-88e7-9621fcdb93f9 tempest-DeleteServersTestJSON-1632919649 tempest-DeleteServersTestJSON-1632919649-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '51db5ef052144879b53979268ac4ceb5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '66136f123f5b4ad0a824920bbdf9d245', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120741) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 18:03:11.864678 dv-cinder-852009-8-iscsi devstack@n-api.service[120741]: INFO nova.api.openstack.requestlog [None req-80eee918-7c8f-4601-88e7-9621fcdb93f9 tempest-DeleteServersTestJSON-1632919649 tempest-DeleteServersTestJSON-1632919649-project] 10.222.0.43 "GET /compute/v2.1/servers/207d1d8d-58a4-4b99-aa09-1c5023c60784" status: 200 len: 1305 microversion: 2.1 time: 0.146931 Sep 13 18:03:11.865279 dv-cinder-852009-8-iscsi devstack@n-api.service[120741]: [pid: 120741|app: 0|req: 83/173] 10.222.0.43 () {58 vars in 1236 bytes} [Tue Sep 13 18:03:11 2022] GET /compute/v2.1/servers/207d1d8d-58a4-4b99-aa09-1c5023c60784 => generated 1305 bytes in 148 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 13 18:03:12.213854 dv-cinder-852009-8-iscsi devstack@n-api.service[120740]: DEBUG nova.api.openstack.wsgi [None req-a88223d2-a9bd-448f-bfb8-ff744b12753a tempest-ServerRescueNegativeTestJSON-412251590 tempest-ServerRescueNegativeTestJSON-412251590-project] Calling method '>' {{(pid=120740) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 18:03:12.214478 dv-cinder-852009-8-iscsi devstack@n-api.service[120740]: DEBUG nova.compute.api [None req-a88223d2-a9bd-448f-bfb8-ff744b12753a tempest-ServerRescueNegativeTestJSON-412251590 tempest-ServerRescueNegativeTestJSON-412251590-project] [instance: 8cd29851-35c1-4032-a137-ab9419a2ec5b] Fetching instance by UUID {{(pid=120740) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 18:03:12.223987 dv-cinder-852009-8-iscsi devstack@n-api.service[120740]: DEBUG oslo_concurrency.lockutils [None req-a88223d2-a9bd-448f-bfb8-ff744b12753a tempest-ServerRescueNegativeTestJSON-412251590 tempest-ServerRescueNegativeTestJSON-412251590-project] Acquiring lock "1daf4f4c-0e4a-4779-b53a-78c48397ea2f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120740) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 18:03:12.224809 dv-cinder-852009-8-iscsi devstack@n-api.service[120740]: DEBUG oslo_concurrency.lockutils [None req-a88223d2-a9bd-448f-bfb8-ff744b12753a tempest-ServerRescueNegativeTestJSON-412251590 tempest-ServerRescueNegativeTestJSON-412251590-project] Lock "1daf4f4c-0e4a-4779-b53a-78c48397ea2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120740) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 18:03:12.225598 dv-cinder-852009-8-iscsi devstack@n-api.service[120740]: DEBUG oslo_concurrency.lockutils [None req-a88223d2-a9bd-448f-bfb8-ff744b12753a tempest-ServerRescueNegativeTestJSON-412251590 tempest-ServerRescueNegativeTestJSON-412251590-project] Lock "1daf4f4c-0e4a-4779-b53a-78c48397ea2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120740) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 18:03:12.226555 dv-cinder-852009-8-iscsi devstack@n-api.service[120740]: DEBUG oslo_concurrency.lockutils [None req-a88223d2-a9bd-448f-bfb8-ff744b12753a tempest-ServerRescueNegativeTestJSON-412251590 tempest-ServerRescueNegativeTestJSON-412251590-project] Acquiring lock "1daf4f4c-0e4a-4779-b53a-78c48397ea2f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120740) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 18:03:12.227678 dv-cinder-852009-8-iscsi devstack@n-api.service[120740]: DEBUG oslo_concurrency.lockutils [None req-a88223d2-a9bd-448f-bfb8-ff744b12753a tempest-ServerRescueNegativeTestJSON-412251590 tempest-ServerRescueNegativeTestJSON-412251590-project] Lock "1daf4f4c-0e4a-4779-b53a-78c48397ea2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120740) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 18:03:12.228855 dv-cinder-852009-8-iscsi devstack@n-api.service[120740]: DEBUG oslo_concurrency.lockutils [None req-a88223d2-a9bd-448f-bfb8-ff744b12753a tempest-ServerRescueNegativeTestJSON-412251590 tempest-ServerRescueNegativeTestJSON-412251590-project] Lock "1daf4f4c-0e4a-4779-b53a-78c48397ea2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120740) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 18:03:12.509063 dv-cinder-852009-8-iscsi devstack@n-api.service[120740]: DEBUG nova.policy [None req-a88223d2-a9bd-448f-bfb8-ff744b12753a tempest-ServerRescueNegativeTestJSON-412251590 tempest-ServerRescueNegativeTestJSON-412251590-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '60800cf2774e409d9c1b6f4992669991', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2eae4acecf6c4961830ead78d71b2ad3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120740) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 18:03:12.519088 dv-cinder-852009-8-iscsi devstack@n-api.service[120740]: INFO nova.api.openstack.requestlog [None req-a88223d2-a9bd-448f-bfb8-ff744b12753a tempest-ServerRescueNegativeTestJSON-412251590 tempest-ServerRescueNegativeTestJSON-412251590-project] 10.222.0.43 "GET /compute/v2.1/servers/8cd29851-35c1-4032-a137-ab9419a2ec5b" status: 200 len: 1522 microversion: 2.1 time: 0.313575 Sep 13 18:03:12.519986 dv-cinder-852009-8-iscsi devstack@n-api.service[120740]: [pid: 120740|app: 0|req: 91/174] 10.222.0.43 () {58 vars in 1236 bytes} [Tue Sep 13 18:03:12 2022] GET /compute/v2.1/servers/8cd29851-35c1-4032-a137-ab9419a2ec5b => generated 1522 bytes in 315 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 13 18:03:12.889119 dv-cinder-852009-8-iscsi devstack@n-api.service[120741]: DEBUG nova.api.openstack.wsgi [None req-635e1046-7d4c-441e-8728-c3535b042016 tempest-DeleteServersTestJSON-1632919649 tempest-DeleteServersTestJSON-1632919649-project] Calling method '>' {{(pid=120741) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 18:03:12.890785 dv-cinder-852009-8-iscsi devstack@n-api.service[120741]: DEBUG nova.compute.api [None req-635e1046-7d4c-441e-8728-c3535b042016 tempest-DeleteServersTestJSON-1632919649 tempest-DeleteServersTestJSON-1632919649-project] [instance: 207d1d8d-58a4-4b99-aa09-1c5023c60784] Fetching instance by UUID {{(pid=120741) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 18:03:12.898441 dv-cinder-852009-8-iscsi devstack@n-api.service[120741]: DEBUG oslo_concurrency.lockutils [None req-635e1046-7d4c-441e-8728-c3535b042016 tempest-DeleteServersTestJSON-1632919649 tempest-DeleteServersTestJSON-1632919649-project] Acquiring lock "1daf4f4c-0e4a-4779-b53a-78c48397ea2f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120741) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 18:03:12.899369 dv-cinder-852009-8-iscsi devstack@n-api.service[120741]: DEBUG oslo_concurrency.lockutils [None req-635e1046-7d4c-441e-8728-c3535b042016 tempest-DeleteServersTestJSON-1632919649 tempest-DeleteServersTestJSON-1632919649-project] Lock "1daf4f4c-0e4a-4779-b53a-78c48397ea2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120741) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 18:03:12.899982 dv-cinder-852009-8-iscsi devstack@n-api.service[120741]: DEBUG oslo_concurrency.lockutils [None req-635e1046-7d4c-441e-8728-c3535b042016 tempest-DeleteServersTestJSON-1632919649 tempest-DeleteServersTestJSON-1632919649-project] Lock "1daf4f4c-0e4a-4779-b53a-78c48397ea2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120741) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 18:03:12.901462 dv-cinder-852009-8-iscsi devstack@n-api.service[120741]: DEBUG oslo_concurrency.lockutils [None req-635e1046-7d4c-441e-8728-c3535b042016 tempest-DeleteServersTestJSON-1632919649 tempest-DeleteServersTestJSON-1632919649-project] Acquiring lock "1daf4f4c-0e4a-4779-b53a-78c48397ea2f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120741) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 18:03:12.902720 dv-cinder-852009-8-iscsi devstack@n-api.service[120741]: DEBUG oslo_concurrency.lockutils [None req-635e1046-7d4c-441e-8728-c3535b042016 tempest-DeleteServersTestJSON-1632919649 tempest-DeleteServersTestJSON-1632919649-project] Lock "1daf4f4c-0e4a-4779-b53a-78c48397ea2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120741) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 18:03:12.903332 dv-cinder-852009-8-iscsi devstack@n-api.service[120741]: DEBUG oslo_concurrency.lockutils [None req-635e1046-7d4c-441e-8728-c3535b042016 tempest-DeleteServersTestJSON-1632919649 tempest-DeleteServersTestJSON-1632919649-project] Lock "1daf4f4c-0e4a-4779-b53a-78c48397ea2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120741) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 18:03:12.932446 dv-cinder-852009-8-iscsi devstack@n-api.service[120741]: INFO nova.api.openstack.wsgi [None req-635e1046-7d4c-441e-8728-c3535b042016 tempest-DeleteServersTestJSON-1632919649 tempest-DeleteServersTestJSON-1632919649-project] HTTP exception thrown: Instance 207d1d8d-58a4-4b99-aa09-1c5023c60784 could not be found. Sep 13 18:03:12.940411 dv-cinder-852009-8-iscsi devstack@n-api.service[120741]: DEBUG nova.api.openstack.wsgi [None req-635e1046-7d4c-441e-8728-c3535b042016 tempest-DeleteServersTestJSON-1632919649 tempest-DeleteServersTestJSON-1632919649-project] Request method failure captured: Sep 13 18:03:12.940411 dv-cinder-852009-8-iscsi devstack@n-api.service[120741]: request: GET /compute/v2.1/servers/207d1d8d-58a4-4b99-aa09-1c5023c60784 HTTP/1.1 Sep 13 18:03:12.940411 dv-cinder-852009-8-iscsi devstack@n-api.service[120741]: Accept: application/json Sep 13 18:03:12.940411 dv-cinder-852009-8-iscsi devstack@n-api.service[120741]: Accept-Encoding: identity Sep 13 18:03:12.940411 dv-cinder-852009-8-iscsi devstack@n-api.service[120741]: Connection: close Sep 13 18:03:12.940411 dv-cinder-852009-8-iscsi devstack@n-api.service[120741]: Content-Length: 0 Sep 13 18:03:12.940411 dv-cinder-852009-8-iscsi devstack@n-api.service[120741]: Content-Type: application/json Sep 13 18:03:12.940411 dv-cinder-852009-8-iscsi devstack@n-api.service[120741]: Host: 10.222.0.43 Sep 13 18:03:12.940411 dv-cinder-852009-8-iscsi devstack@n-api.service[120741]: Openstack-System-Scope: None Sep 13 18:03:12.940411 dv-cinder-852009-8-iscsi devstack@n-api.service[120741]: User-Agent: python-urllib3/1.26.12 Sep 13 18:03:12.940411 dv-cinder-852009-8-iscsi devstack@n-api.service[120741]: X-Auth-Token: gAAAAABjIMWVMMDe5KDUDyQ1qh2SyXN4osdrRMHRWrxwAgozU_uiFEaxhAlwbtNRamVxKX5FGpc_X33ee-4bUVHJ89MgdfmlDZjvRYJy9oXSIbDyzIQgYNsfzS8syp3xNEZ2K7Qs9-s4-SRENoKjj6UnbIpUJwfrXQEbQnFn8PgtswyjTlVPa8E Sep 13 18:03:12.940411 dv-cinder-852009-8-iscsi devstack@n-api.service[120741]: X-Domain-Id: None Sep 13 18:03:12.940411 dv-cinder-852009-8-iscsi devstack@n-api.service[120741]: X-Domain-Name: None Sep 13 18:03:12.940411 dv-cinder-852009-8-iscsi devstack@n-api.service[120741]: X-Identity-Status: Confirmed Sep 13 18:03:12.940411 dv-cinder-852009-8-iscsi devstack@n-api.service[120741]: X-Is-Admin-Project: True Sep 13 18:03:12.940411 dv-cinder-852009-8-iscsi devstack@n-api.service[120741]: X-Project-Domain-Id: default Sep 13 18:03:12.940411 dv-cinder-852009-8-iscsi devstack@n-api.service[120741]: X-Project-Domain-Name: Default Sep 13 18:03:12.940411 dv-cinder-852009-8-iscsi devstack@n-api.service[120741]: X-Project-Id: 66136f123f5b4ad0a824920bbdf9d245 Sep 13 18:03:12.940411 dv-cinder-852009-8-iscsi devstack@n-api.service[120741]: X-Project-Name: tempest-DeleteServersTestJSON-1632919649 Sep 13 18:03:12.940411 dv-cinder-852009-8-iscsi devstack@n-api.service[120741]: X-Role: reader,member Sep 13 18:03:12.940411 dv-cinder-852009-8-iscsi devstack@n-api.service[120741]: X-Roles: reader,member Sep 13 18:03:12.942121 dv-cinder-852009-8-iscsi devstack@n-api.service[120741]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/identity"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/compute/v2/66136f123f5b4ad0a824920bbdf9d245"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.43:8080", "publicURL": "http://10.222.0.43:8080/v1/AUTH_66136f123f5b4ad0a824920bbdf9d245"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43:9696/networking"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/volume/v3/66136f123f5b4ad0a824920bbdf9d245"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/compute/v2.1"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/placement"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/volume/v3/66136f123f5b4ad0a824920bbdf9d245"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/image"}]}] Sep 13 18:03:12.942121 dv-cinder-852009-8-iscsi devstack@n-api.service[120741]: X-Tenant: tempest-DeleteServersTestJSON-1632919649 Sep 13 18:03:12.942121 dv-cinder-852009-8-iscsi devstack@n-api.service[120741]: X-Tenant-Id: 66136f123f5b4ad0a824920bbdf9d245 Sep 13 18:03:12.942121 dv-cinder-852009-8-iscsi devstack@n-api.service[120741]: X-Tenant-Name: tempest-DeleteServersTestJSON-1632919649 Sep 13 18:03:12.942121 dv-cinder-852009-8-iscsi devstack@n-api.service[120741]: X-User: tempest-DeleteServersTestJSON-1632919649-project Sep 13 18:03:12.942121 dv-cinder-852009-8-iscsi devstack@n-api.service[120741]: X-User-Domain-Id: default Sep 13 18:03:12.942121 dv-cinder-852009-8-iscsi devstack@n-api.service[120741]: X-User-Domain-Name: Default Sep 13 18:03:12.942121 dv-cinder-852009-8-iscsi devstack@n-api.service[120741]: X-User-Id: 51db5ef052144879b53979268ac4ceb5 Sep 13 18:03:12.942121 dv-cinder-852009-8-iscsi devstack@n-api.service[120741]: X-User-Name: tempest-DeleteServersTestJSON-1632919649-project Sep 13 18:03:12.942121 dv-cinder-852009-8-iscsi devstack@n-api.service[120741]: method: > Sep 13 18:03:12.942121 dv-cinder-852009-8-iscsi devstack@n-api.service[120741]: exception: Instance 207d1d8d-58a4-4b99-aa09-1c5023c60784 could not be found. Sep 13 18:03:12.942121 dv-cinder-852009-8-iscsi devstack@n-api.service[120741]: action_args: {'id': '207d1d8d-58a4-4b99-aa09-1c5023c60784'} Sep 13 18:03:12.942959 dv-cinder-852009-8-iscsi devstack@n-api.service[120741]: {{(pid=120741) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 13 18:03:12.942959 dv-cinder-852009-8-iscsi devstack@n-api.service[120741]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 13 18:03:12.942959 dv-cinder-852009-8-iscsi devstack@n-api.service[120741]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Sep 13 18:03:12.942959 dv-cinder-852009-8-iscsi devstack@n-api.service[120741]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Sep 13 18:03:12.942959 dv-cinder-852009-8-iscsi devstack@n-api.service[120741]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Sep 13 18:03:12.942959 dv-cinder-852009-8-iscsi devstack@n-api.service[120741]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Sep 13 18:03:12.942959 dv-cinder-852009-8-iscsi devstack@n-api.service[120741]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Sep 13 18:03:12.942959 dv-cinder-852009-8-iscsi devstack@n-api.service[120741]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Sep 13 18:03:12.942959 dv-cinder-852009-8-iscsi devstack@n-api.service[120741]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Sep 13 18:03:12.942959 dv-cinder-852009-8-iscsi devstack@n-api.service[120741]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Sep 13 18:03:12.942959 dv-cinder-852009-8-iscsi devstack@n-api.service[120741]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 207d1d8d-58a4-4b99-aa09-1c5023c60784 could not be found. Sep 13 18:03:12.942959 dv-cinder-852009-8-iscsi devstack@n-api.service[120741]: ERROR nova.api.openstack.wsgi Sep 13 18:03:12.942959 dv-cinder-852009-8-iscsi devstack@n-api.service[120741]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 13 18:03:12.942959 dv-cinder-852009-8-iscsi devstack@n-api.service[120741]: ERROR nova.api.openstack.wsgi Sep 13 18:03:12.942959 dv-cinder-852009-8-iscsi devstack@n-api.service[120741]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 13 18:03:12.942959 dv-cinder-852009-8-iscsi devstack@n-api.service[120741]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 13 18:03:12.942959 dv-cinder-852009-8-iscsi devstack@n-api.service[120741]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 13 18:03:12.942959 dv-cinder-852009-8-iscsi devstack@n-api.service[120741]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 13 18:03:12.942959 dv-cinder-852009-8-iscsi devstack@n-api.service[120741]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 13 18:03:12.942959 dv-cinder-852009-8-iscsi devstack@n-api.service[120741]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 13 18:03:12.944233 dv-cinder-852009-8-iscsi devstack@n-api.service[120741]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 13 18:03:12.944233 dv-cinder-852009-8-iscsi devstack@n-api.service[120741]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Sep 13 18:03:12.944233 dv-cinder-852009-8-iscsi devstack@n-api.service[120741]: ERROR nova.api.openstack.wsgi instance = self._get_server( Sep 13 18:03:12.944233 dv-cinder-852009-8-iscsi devstack@n-api.service[120741]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Sep 13 18:03:12.944233 dv-cinder-852009-8-iscsi devstack@n-api.service[120741]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Sep 13 18:03:12.944233 dv-cinder-852009-8-iscsi devstack@n-api.service[120741]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Sep 13 18:03:12.944233 dv-cinder-852009-8-iscsi devstack@n-api.service[120741]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Sep 13 18:03:12.944233 dv-cinder-852009-8-iscsi devstack@n-api.service[120741]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 207d1d8d-58a4-4b99-aa09-1c5023c60784 could not be found. Sep 13 18:03:12.944233 dv-cinder-852009-8-iscsi devstack@n-api.service[120741]: ERROR nova.api.openstack.wsgi Sep 13 18:03:12.944233 dv-cinder-852009-8-iscsi devstack@n-api.service[120741]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 13 18:03:12.944233 dv-cinder-852009-8-iscsi devstack@n-api.service[120741]: ERROR nova.api.openstack.wsgi Sep 13 18:03:12.944233 dv-cinder-852009-8-iscsi devstack@n-api.service[120741]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 13 18:03:12.944233 dv-cinder-852009-8-iscsi devstack@n-api.service[120741]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 13 18:03:12.944233 dv-cinder-852009-8-iscsi devstack@n-api.service[120741]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 13 18:03:12.944233 dv-cinder-852009-8-iscsi devstack@n-api.service[120741]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 13 18:03:12.944233 dv-cinder-852009-8-iscsi devstack@n-api.service[120741]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 13 18:03:12.944233 dv-cinder-852009-8-iscsi devstack@n-api.service[120741]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 207d1d8d-58a4-4b99-aa09-1c5023c60784 could not be found. Sep 13 18:03:12.944233 dv-cinder-852009-8-iscsi devstack@n-api.service[120741]: ERROR nova.api.openstack.wsgi Sep 13 18:03:12.945473 dv-cinder-852009-8-iscsi devstack@n-api.service[120741]: DEBUG nova.api.openstack.wsgi [None req-635e1046-7d4c-441e-8728-c3535b042016 tempest-DeleteServersTestJSON-1632919649 tempest-DeleteServersTestJSON-1632919649-project] Returning 404 to user: Instance 207d1d8d-58a4-4b99-aa09-1c5023c60784 could not be found. {{(pid=120741) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 13 18:03:12.945473 dv-cinder-852009-8-iscsi devstack@n-api.service[120741]: INFO nova.api.openstack.requestlog [None req-635e1046-7d4c-441e-8728-c3535b042016 tempest-DeleteServersTestJSON-1632919649 tempest-DeleteServersTestJSON-1632919649-project] 10.222.0.43 "GET /compute/v2.1/servers/207d1d8d-58a4-4b99-aa09-1c5023c60784" status: 404 len: 111 microversion: 2.1 time: 0.058829 Sep 13 18:03:12.946479 dv-cinder-852009-8-iscsi devstack@n-api.service[120741]: [pid: 120741|app: 0|req: 84/175] 10.222.0.43 () {58 vars in 1236 bytes} [Tue Sep 13 18:03:12 2022] GET /compute/v2.1/servers/207d1d8d-58a4-4b99-aa09-1c5023c60784 => generated 111 bytes in 63 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Sep 13 18:03:13.101967 dv-cinder-852009-8-iscsi devstack@n-api.service[120740]: DEBUG nova.api.openstack.wsgi [None req-8ee4304e-cb6a-49c4-a9a5-e167588c29f9 tempest-DeleteServersTestJSON-1632919649 tempest-DeleteServersTestJSON-1632919649-project] Calling method '>' {{(pid=120740) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 18:03:13.104468 dv-cinder-852009-8-iscsi devstack@n-api.service[120740]: DEBUG nova.compute.api [None req-8ee4304e-cb6a-49c4-a9a5-e167588c29f9 tempest-DeleteServersTestJSON-1632919649 tempest-DeleteServersTestJSON-1632919649-project] [instance: 207d1d8d-58a4-4b99-aa09-1c5023c60784] Fetching instance by UUID {{(pid=120740) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 18:03:13.110993 dv-cinder-852009-8-iscsi devstack@n-api.service[120740]: DEBUG oslo_concurrency.lockutils [None req-8ee4304e-cb6a-49c4-a9a5-e167588c29f9 tempest-DeleteServersTestJSON-1632919649 tempest-DeleteServersTestJSON-1632919649-project] Acquiring lock "1daf4f4c-0e4a-4779-b53a-78c48397ea2f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120740) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 18:03:13.111738 dv-cinder-852009-8-iscsi devstack@n-api.service[120740]: DEBUG oslo_concurrency.lockutils [None req-8ee4304e-cb6a-49c4-a9a5-e167588c29f9 tempest-DeleteServersTestJSON-1632919649 tempest-DeleteServersTestJSON-1632919649-project] Lock "1daf4f4c-0e4a-4779-b53a-78c48397ea2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120740) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 18:03:13.112350 dv-cinder-852009-8-iscsi devstack@n-api.service[120740]: DEBUG oslo_concurrency.lockutils [None req-8ee4304e-cb6a-49c4-a9a5-e167588c29f9 tempest-DeleteServersTestJSON-1632919649 tempest-DeleteServersTestJSON-1632919649-project] Lock "1daf4f4c-0e4a-4779-b53a-78c48397ea2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120740) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 18:03:13.113389 dv-cinder-852009-8-iscsi devstack@n-api.service[120740]: DEBUG oslo_concurrency.lockutils [None req-8ee4304e-cb6a-49c4-a9a5-e167588c29f9 tempest-DeleteServersTestJSON-1632919649 tempest-DeleteServersTestJSON-1632919649-project] Acquiring lock "1daf4f4c-0e4a-4779-b53a-78c48397ea2f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120740) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 18:03:13.114018 dv-cinder-852009-8-iscsi devstack@n-api.service[120740]: DEBUG oslo_concurrency.lockutils [None req-8ee4304e-cb6a-49c4-a9a5-e167588c29f9 tempest-DeleteServersTestJSON-1632919649 tempest-DeleteServersTestJSON-1632919649-project] Lock "1daf4f4c-0e4a-4779-b53a-78c48397ea2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120740) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 18:03:13.114581 dv-cinder-852009-8-iscsi devstack@n-api.service[120740]: DEBUG oslo_concurrency.lockutils [None req-8ee4304e-cb6a-49c4-a9a5-e167588c29f9 tempest-DeleteServersTestJSON-1632919649 tempest-DeleteServersTestJSON-1632919649-project] Lock "1daf4f4c-0e4a-4779-b53a-78c48397ea2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120740) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 18:03:13.130470 dv-cinder-852009-8-iscsi devstack@n-api.service[120740]: INFO nova.api.openstack.wsgi [None req-8ee4304e-cb6a-49c4-a9a5-e167588c29f9 tempest-DeleteServersTestJSON-1632919649 tempest-DeleteServersTestJSON-1632919649-project] HTTP exception thrown: Instance 207d1d8d-58a4-4b99-aa09-1c5023c60784 could not be found. Sep 13 18:03:13.140799 dv-cinder-852009-8-iscsi devstack@n-api.service[120740]: DEBUG nova.api.openstack.wsgi [None req-8ee4304e-cb6a-49c4-a9a5-e167588c29f9 tempest-DeleteServersTestJSON-1632919649 tempest-DeleteServersTestJSON-1632919649-project] Request method failure captured: Sep 13 18:03:13.140799 dv-cinder-852009-8-iscsi devstack@n-api.service[120740]: request: GET /compute/v2.1/servers/207d1d8d-58a4-4b99-aa09-1c5023c60784/os-volume_attachments HTTP/1.1 Sep 13 18:03:13.140799 dv-cinder-852009-8-iscsi devstack@n-api.service[120740]: Accept: application/json Sep 13 18:03:13.140799 dv-cinder-852009-8-iscsi devstack@n-api.service[120740]: Accept-Encoding: identity Sep 13 18:03:13.140799 dv-cinder-852009-8-iscsi devstack@n-api.service[120740]: Connection: close Sep 13 18:03:13.140799 dv-cinder-852009-8-iscsi devstack@n-api.service[120740]: Content-Length: 0 Sep 13 18:03:13.140799 dv-cinder-852009-8-iscsi devstack@n-api.service[120740]: Content-Type: application/json Sep 13 18:03:13.140799 dv-cinder-852009-8-iscsi devstack@n-api.service[120740]: Host: 10.222.0.43 Sep 13 18:03:13.140799 dv-cinder-852009-8-iscsi devstack@n-api.service[120740]: Openstack-System-Scope: None Sep 13 18:03:13.140799 dv-cinder-852009-8-iscsi devstack@n-api.service[120740]: User-Agent: python-urllib3/1.26.12 Sep 13 18:03:13.140799 dv-cinder-852009-8-iscsi devstack@n-api.service[120740]: X-Auth-Token: gAAAAABjIMWVMMDe5KDUDyQ1qh2SyXN4osdrRMHRWrxwAgozU_uiFEaxhAlwbtNRamVxKX5FGpc_X33ee-4bUVHJ89MgdfmlDZjvRYJy9oXSIbDyzIQgYNsfzS8syp3xNEZ2K7Qs9-s4-SRENoKjj6UnbIpUJwfrXQEbQnFn8PgtswyjTlVPa8E Sep 13 18:03:13.140799 dv-cinder-852009-8-iscsi devstack@n-api.service[120740]: X-Domain-Id: None Sep 13 18:03:13.140799 dv-cinder-852009-8-iscsi devstack@n-api.service[120740]: X-Domain-Name: None Sep 13 18:03:13.140799 dv-cinder-852009-8-iscsi devstack@n-api.service[120740]: X-Identity-Status: Confirmed Sep 13 18:03:13.140799 dv-cinder-852009-8-iscsi devstack@n-api.service[120740]: X-Is-Admin-Project: True Sep 13 18:03:13.140799 dv-cinder-852009-8-iscsi devstack@n-api.service[120740]: X-Project-Domain-Id: default Sep 13 18:03:13.140799 dv-cinder-852009-8-iscsi devstack@n-api.service[120740]: X-Project-Domain-Name: Default Sep 13 18:03:13.140799 dv-cinder-852009-8-iscsi devstack@n-api.service[120740]: X-Project-Id: 66136f123f5b4ad0a824920bbdf9d245 Sep 13 18:03:13.140799 dv-cinder-852009-8-iscsi devstack@n-api.service[120740]: X-Project-Name: tempest-DeleteServersTestJSON-1632919649 Sep 13 18:03:13.140799 dv-cinder-852009-8-iscsi devstack@n-api.service[120740]: X-Role: reader,member Sep 13 18:03:13.140799 dv-cinder-852009-8-iscsi devstack@n-api.service[120740]: X-Roles: reader,member Sep 13 18:03:13.142261 dv-cinder-852009-8-iscsi devstack@n-api.service[120740]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/identity"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/compute/v2/66136f123f5b4ad0a824920bbdf9d245"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.43:8080", "publicURL": "http://10.222.0.43:8080/v1/AUTH_66136f123f5b4ad0a824920bbdf9d245"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43:9696/networking"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/volume/v3/66136f123f5b4ad0a824920bbdf9d245"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/compute/v2.1"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/placement"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/volume/v3/66136f123f5b4ad0a824920bbdf9d245"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/image"}]}] Sep 13 18:03:13.142261 dv-cinder-852009-8-iscsi devstack@n-api.service[120740]: X-Tenant: tempest-DeleteServersTestJSON-1632919649 Sep 13 18:03:13.142261 dv-cinder-852009-8-iscsi devstack@n-api.service[120740]: X-Tenant-Id: 66136f123f5b4ad0a824920bbdf9d245 Sep 13 18:03:13.142261 dv-cinder-852009-8-iscsi devstack@n-api.service[120740]: X-Tenant-Name: tempest-DeleteServersTestJSON-1632919649 Sep 13 18:03:13.142261 dv-cinder-852009-8-iscsi devstack@n-api.service[120740]: X-User: tempest-DeleteServersTestJSON-1632919649-project Sep 13 18:03:13.142261 dv-cinder-852009-8-iscsi devstack@n-api.service[120740]: X-User-Domain-Id: default Sep 13 18:03:13.142261 dv-cinder-852009-8-iscsi devstack@n-api.service[120740]: X-User-Domain-Name: Default Sep 13 18:03:13.142261 dv-cinder-852009-8-iscsi devstack@n-api.service[120740]: X-User-Id: 51db5ef052144879b53979268ac4ceb5 Sep 13 18:03:13.142261 dv-cinder-852009-8-iscsi devstack@n-api.service[120740]: X-User-Name: tempest-DeleteServersTestJSON-1632919649-project Sep 13 18:03:13.142261 dv-cinder-852009-8-iscsi devstack@n-api.service[120740]: method: > Sep 13 18:03:13.142261 dv-cinder-852009-8-iscsi devstack@n-api.service[120740]: exception: Instance 207d1d8d-58a4-4b99-aa09-1c5023c60784 could not be found. Sep 13 18:03:13.142261 dv-cinder-852009-8-iscsi devstack@n-api.service[120740]: action_args: {'server_id': '207d1d8d-58a4-4b99-aa09-1c5023c60784'} Sep 13 18:03:13.143045 dv-cinder-852009-8-iscsi devstack@n-api.service[120740]: {{(pid=120740) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 13 18:03:13.143045 dv-cinder-852009-8-iscsi devstack@n-api.service[120740]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 13 18:03:13.143045 dv-cinder-852009-8-iscsi devstack@n-api.service[120740]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Sep 13 18:03:13.143045 dv-cinder-852009-8-iscsi devstack@n-api.service[120740]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Sep 13 18:03:13.143045 dv-cinder-852009-8-iscsi devstack@n-api.service[120740]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Sep 13 18:03:13.143045 dv-cinder-852009-8-iscsi devstack@n-api.service[120740]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Sep 13 18:03:13.143045 dv-cinder-852009-8-iscsi devstack@n-api.service[120740]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Sep 13 18:03:13.143045 dv-cinder-852009-8-iscsi devstack@n-api.service[120740]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Sep 13 18:03:13.143045 dv-cinder-852009-8-iscsi devstack@n-api.service[120740]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Sep 13 18:03:13.143045 dv-cinder-852009-8-iscsi devstack@n-api.service[120740]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Sep 13 18:03:13.143045 dv-cinder-852009-8-iscsi devstack@n-api.service[120740]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 207d1d8d-58a4-4b99-aa09-1c5023c60784 could not be found. Sep 13 18:03:13.143045 dv-cinder-852009-8-iscsi devstack@n-api.service[120740]: ERROR nova.api.openstack.wsgi Sep 13 18:03:13.143045 dv-cinder-852009-8-iscsi devstack@n-api.service[120740]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 13 18:03:13.143045 dv-cinder-852009-8-iscsi devstack@n-api.service[120740]: ERROR nova.api.openstack.wsgi Sep 13 18:03:13.143045 dv-cinder-852009-8-iscsi devstack@n-api.service[120740]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 13 18:03:13.143045 dv-cinder-852009-8-iscsi devstack@n-api.service[120740]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 13 18:03:13.143045 dv-cinder-852009-8-iscsi devstack@n-api.service[120740]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 13 18:03:13.143045 dv-cinder-852009-8-iscsi devstack@n-api.service[120740]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 13 18:03:13.143045 dv-cinder-852009-8-iscsi devstack@n-api.service[120740]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 13 18:03:13.143045 dv-cinder-852009-8-iscsi devstack@n-api.service[120740]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 13 18:03:13.144318 dv-cinder-852009-8-iscsi devstack@n-api.service[120740]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 13 18:03:13.144318 dv-cinder-852009-8-iscsi devstack@n-api.service[120740]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 192, in wrapper Sep 13 18:03:13.144318 dv-cinder-852009-8-iscsi devstack@n-api.service[120740]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Sep 13 18:03:13.144318 dv-cinder-852009-8-iscsi devstack@n-api.service[120740]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 192, in wrapper Sep 13 18:03:13.144318 dv-cinder-852009-8-iscsi devstack@n-api.service[120740]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Sep 13 18:03:13.144318 dv-cinder-852009-8-iscsi devstack@n-api.service[120740]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 303, in index Sep 13 18:03:13.144318 dv-cinder-852009-8-iscsi devstack@n-api.service[120740]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, server_id) Sep 13 18:03:13.144318 dv-cinder-852009-8-iscsi devstack@n-api.service[120740]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Sep 13 18:03:13.144318 dv-cinder-852009-8-iscsi devstack@n-api.service[120740]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Sep 13 18:03:13.144318 dv-cinder-852009-8-iscsi devstack@n-api.service[120740]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 207d1d8d-58a4-4b99-aa09-1c5023c60784 could not be found. Sep 13 18:03:13.144318 dv-cinder-852009-8-iscsi devstack@n-api.service[120740]: ERROR nova.api.openstack.wsgi Sep 13 18:03:13.144318 dv-cinder-852009-8-iscsi devstack@n-api.service[120740]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 13 18:03:13.144318 dv-cinder-852009-8-iscsi devstack@n-api.service[120740]: ERROR nova.api.openstack.wsgi Sep 13 18:03:13.144318 dv-cinder-852009-8-iscsi devstack@n-api.service[120740]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 13 18:03:13.144318 dv-cinder-852009-8-iscsi devstack@n-api.service[120740]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 13 18:03:13.144318 dv-cinder-852009-8-iscsi devstack@n-api.service[120740]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 13 18:03:13.144318 dv-cinder-852009-8-iscsi devstack@n-api.service[120740]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 13 18:03:13.144318 dv-cinder-852009-8-iscsi devstack@n-api.service[120740]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 13 18:03:13.144318 dv-cinder-852009-8-iscsi devstack@n-api.service[120740]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 207d1d8d-58a4-4b99-aa09-1c5023c60784 could not be found. Sep 13 18:03:13.144318 dv-cinder-852009-8-iscsi devstack@n-api.service[120740]: ERROR nova.api.openstack.wsgi Sep 13 18:03:13.146781 dv-cinder-852009-8-iscsi devstack@n-api.service[120740]: DEBUG nova.api.openstack.wsgi [None req-8ee4304e-cb6a-49c4-a9a5-e167588c29f9 tempest-DeleteServersTestJSON-1632919649 tempest-DeleteServersTestJSON-1632919649-project] Returning 404 to user: Instance 207d1d8d-58a4-4b99-aa09-1c5023c60784 could not be found. {{(pid=120740) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 13 18:03:13.148019 dv-cinder-852009-8-iscsi devstack@n-api.service[120740]: INFO nova.api.openstack.requestlog [None req-8ee4304e-cb6a-49c4-a9a5-e167588c29f9 tempest-DeleteServersTestJSON-1632919649 tempest-DeleteServersTestJSON-1632919649-project] 10.222.0.43 "GET /compute/v2.1/servers/207d1d8d-58a4-4b99-aa09-1c5023c60784/os-volume_attachments" status: 404 len: 111 microversion: 2.1 time: 0.050489 Sep 13 18:03:13.155844 dv-cinder-852009-8-iscsi devstack@n-api.service[120740]: [pid: 120740|app: 0|req: 92/176] 10.222.0.43 () {58 vars in 1302 bytes} [Tue Sep 13 18:03:13 2022] GET /compute/v2.1/servers/207d1d8d-58a4-4b99-aa09-1c5023c60784/os-volume_attachments => generated 111 bytes in 55 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Sep 13 18:03:13.543241 dv-cinder-852009-8-iscsi devstack@n-api.service[120741]: DEBUG nova.api.openstack.wsgi [None req-d8b6a3de-c8bd-4dcd-8a04-09c9beadb817 tempest-ServerRescueNegativeTestJSON-412251590 tempest-ServerRescueNegativeTestJSON-412251590-project] Calling method '>' {{(pid=120741) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 18:03:13.544639 dv-cinder-852009-8-iscsi devstack@n-api.service[120741]: DEBUG nova.compute.api [None req-d8b6a3de-c8bd-4dcd-8a04-09c9beadb817 tempest-ServerRescueNegativeTestJSON-412251590 tempest-ServerRescueNegativeTestJSON-412251590-project] [instance: 8cd29851-35c1-4032-a137-ab9419a2ec5b] Fetching instance by UUID {{(pid=120741) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 18:03:13.552658 dv-cinder-852009-8-iscsi devstack@n-api.service[120741]: DEBUG oslo_concurrency.lockutils [None req-d8b6a3de-c8bd-4dcd-8a04-09c9beadb817 tempest-ServerRescueNegativeTestJSON-412251590 tempest-ServerRescueNegativeTestJSON-412251590-project] Acquiring lock "1daf4f4c-0e4a-4779-b53a-78c48397ea2f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120741) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 18:03:13.553536 dv-cinder-852009-8-iscsi devstack@n-api.service[120741]: DEBUG oslo_concurrency.lockutils [None req-d8b6a3de-c8bd-4dcd-8a04-09c9beadb817 tempest-ServerRescueNegativeTestJSON-412251590 tempest-ServerRescueNegativeTestJSON-412251590-project] Lock "1daf4f4c-0e4a-4779-b53a-78c48397ea2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120741) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 18:03:13.556668 dv-cinder-852009-8-iscsi devstack@n-api.service[120741]: DEBUG oslo_concurrency.lockutils [None req-d8b6a3de-c8bd-4dcd-8a04-09c9beadb817 tempest-ServerRescueNegativeTestJSON-412251590 tempest-ServerRescueNegativeTestJSON-412251590-project] Lock "1daf4f4c-0e4a-4779-b53a-78c48397ea2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120741) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 18:03:13.557862 dv-cinder-852009-8-iscsi devstack@n-api.service[120741]: DEBUG oslo_concurrency.lockutils [None req-d8b6a3de-c8bd-4dcd-8a04-09c9beadb817 tempest-ServerRescueNegativeTestJSON-412251590 tempest-ServerRescueNegativeTestJSON-412251590-project] Acquiring lock "1daf4f4c-0e4a-4779-b53a-78c48397ea2f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120741) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 18:03:13.558554 dv-cinder-852009-8-iscsi devstack@n-api.service[120741]: DEBUG oslo_concurrency.lockutils [None req-d8b6a3de-c8bd-4dcd-8a04-09c9beadb817 tempest-ServerRescueNegativeTestJSON-412251590 tempest-ServerRescueNegativeTestJSON-412251590-project] Lock "1daf4f4c-0e4a-4779-b53a-78c48397ea2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120741) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 18:03:13.559177 dv-cinder-852009-8-iscsi devstack@n-api.service[120741]: DEBUG oslo_concurrency.lockutils [None req-d8b6a3de-c8bd-4dcd-8a04-09c9beadb817 tempest-ServerRescueNegativeTestJSON-412251590 tempest-ServerRescueNegativeTestJSON-412251590-project] Lock "1daf4f4c-0e4a-4779-b53a-78c48397ea2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120741) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 18:03:13.747692 dv-cinder-852009-8-iscsi devstack@n-api.service[120741]: DEBUG nova.policy [None req-d8b6a3de-c8bd-4dcd-8a04-09c9beadb817 tempest-ServerRescueNegativeTestJSON-412251590 tempest-ServerRescueNegativeTestJSON-412251590-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '60800cf2774e409d9c1b6f4992669991', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2eae4acecf6c4961830ead78d71b2ad3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120741) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 18:03:13.759737 dv-cinder-852009-8-iscsi devstack@n-api.service[120741]: INFO nova.api.openstack.requestlog [None req-d8b6a3de-c8bd-4dcd-8a04-09c9beadb817 tempest-ServerRescueNegativeTestJSON-412251590 tempest-ServerRescueNegativeTestJSON-412251590-project] 10.222.0.43 "GET /compute/v2.1/servers/8cd29851-35c1-4032-a137-ab9419a2ec5b" status: 200 len: 1522 microversion: 2.1 time: 0.219347 Sep 13 18:03:13.760255 dv-cinder-852009-8-iscsi devstack@n-api.service[120741]: [pid: 120741|app: 0|req: 85/177] 10.222.0.43 () {58 vars in 1236 bytes} [Tue Sep 13 18:03:13 2022] GET /compute/v2.1/servers/8cd29851-35c1-4032-a137-ab9419a2ec5b => generated 1522 bytes in 222 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 13 18:03:14.416776 dv-cinder-852009-8-iscsi devstack@n-api.service[120740]: DEBUG nova.api.openstack.wsgi [None req-5fb00432-6ca4-44c6-b52c-fb5ffbc32c28 tempest-DeleteServersTestJSON-1632919649 tempest-DeleteServersTestJSON-1632919649-project] Calling method '>' {{(pid=120740) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 18:03:14.417610 dv-cinder-852009-8-iscsi devstack@n-api.service[120740]: DEBUG nova.compute.api [None req-5fb00432-6ca4-44c6-b52c-fb5ffbc32c28 tempest-DeleteServersTestJSON-1632919649 tempest-DeleteServersTestJSON-1632919649-project] [instance: 207d1d8d-58a4-4b99-aa09-1c5023c60784] Fetching instance by UUID {{(pid=120740) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 18:03:14.425287 dv-cinder-852009-8-iscsi devstack@n-api.service[120740]: DEBUG oslo_concurrency.lockutils [None req-5fb00432-6ca4-44c6-b52c-fb5ffbc32c28 tempest-DeleteServersTestJSON-1632919649 tempest-DeleteServersTestJSON-1632919649-project] Acquiring lock "1daf4f4c-0e4a-4779-b53a-78c48397ea2f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120740) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 18:03:14.426084 dv-cinder-852009-8-iscsi devstack@n-api.service[120740]: DEBUG oslo_concurrency.lockutils [None req-5fb00432-6ca4-44c6-b52c-fb5ffbc32c28 tempest-DeleteServersTestJSON-1632919649 tempest-DeleteServersTestJSON-1632919649-project] Lock "1daf4f4c-0e4a-4779-b53a-78c48397ea2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120740) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 18:03:14.426698 dv-cinder-852009-8-iscsi devstack@n-api.service[120740]: DEBUG oslo_concurrency.lockutils [None req-5fb00432-6ca4-44c6-b52c-fb5ffbc32c28 tempest-DeleteServersTestJSON-1632919649 tempest-DeleteServersTestJSON-1632919649-project] Lock "1daf4f4c-0e4a-4779-b53a-78c48397ea2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120740) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 18:03:14.427978 dv-cinder-852009-8-iscsi devstack@n-api.service[120740]: DEBUG oslo_concurrency.lockutils [None req-5fb00432-6ca4-44c6-b52c-fb5ffbc32c28 tempest-DeleteServersTestJSON-1632919649 tempest-DeleteServersTestJSON-1632919649-project] Acquiring lock "1daf4f4c-0e4a-4779-b53a-78c48397ea2f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120740) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 18:03:14.428724 dv-cinder-852009-8-iscsi devstack@n-api.service[120740]: DEBUG oslo_concurrency.lockutils [None req-5fb00432-6ca4-44c6-b52c-fb5ffbc32c28 tempest-DeleteServersTestJSON-1632919649 tempest-DeleteServersTestJSON-1632919649-project] Lock "1daf4f4c-0e4a-4779-b53a-78c48397ea2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120740) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 18:03:14.429770 dv-cinder-852009-8-iscsi devstack@n-api.service[120740]: DEBUG oslo_concurrency.lockutils [None req-5fb00432-6ca4-44c6-b52c-fb5ffbc32c28 tempest-DeleteServersTestJSON-1632919649 tempest-DeleteServersTestJSON-1632919649-project] Lock "1daf4f4c-0e4a-4779-b53a-78c48397ea2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120740) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 18:03:14.449749 dv-cinder-852009-8-iscsi devstack@n-api.service[120740]: INFO nova.api.openstack.wsgi [None req-5fb00432-6ca4-44c6-b52c-fb5ffbc32c28 tempest-DeleteServersTestJSON-1632919649 tempest-DeleteServersTestJSON-1632919649-project] HTTP exception thrown: Instance 207d1d8d-58a4-4b99-aa09-1c5023c60784 could not be found. Sep 13 18:03:14.452182 dv-cinder-852009-8-iscsi devstack@n-api.service[120740]: DEBUG nova.api.openstack.wsgi [None req-5fb00432-6ca4-44c6-b52c-fb5ffbc32c28 tempest-DeleteServersTestJSON-1632919649 tempest-DeleteServersTestJSON-1632919649-project] Request method failure captured: Sep 13 18:03:14.452182 dv-cinder-852009-8-iscsi devstack@n-api.service[120740]: request: DELETE /compute/v2.1/servers/207d1d8d-58a4-4b99-aa09-1c5023c60784 HTTP/1.1 Sep 13 18:03:14.452182 dv-cinder-852009-8-iscsi devstack@n-api.service[120740]: Accept: application/json Sep 13 18:03:14.452182 dv-cinder-852009-8-iscsi devstack@n-api.service[120740]: Accept-Encoding: identity Sep 13 18:03:14.452182 dv-cinder-852009-8-iscsi devstack@n-api.service[120740]: Connection: close Sep 13 18:03:14.452182 dv-cinder-852009-8-iscsi devstack@n-api.service[120740]: Content-Length: 0 Sep 13 18:03:14.452182 dv-cinder-852009-8-iscsi devstack@n-api.service[120740]: Content-Type: application/json Sep 13 18:03:14.452182 dv-cinder-852009-8-iscsi devstack@n-api.service[120740]: Host: 10.222.0.43 Sep 13 18:03:14.452182 dv-cinder-852009-8-iscsi devstack@n-api.service[120740]: Openstack-System-Scope: None Sep 13 18:03:14.452182 dv-cinder-852009-8-iscsi devstack@n-api.service[120740]: User-Agent: python-urllib3/1.26.12 Sep 13 18:03:14.452182 dv-cinder-852009-8-iscsi devstack@n-api.service[120740]: X-Auth-Token: gAAAAABjIMWVMMDe5KDUDyQ1qh2SyXN4osdrRMHRWrxwAgozU_uiFEaxhAlwbtNRamVxKX5FGpc_X33ee-4bUVHJ89MgdfmlDZjvRYJy9oXSIbDyzIQgYNsfzS8syp3xNEZ2K7Qs9-s4-SRENoKjj6UnbIpUJwfrXQEbQnFn8PgtswyjTlVPa8E Sep 13 18:03:14.452182 dv-cinder-852009-8-iscsi devstack@n-api.service[120740]: X-Domain-Id: None Sep 13 18:03:14.452182 dv-cinder-852009-8-iscsi devstack@n-api.service[120740]: X-Domain-Name: None Sep 13 18:03:14.452182 dv-cinder-852009-8-iscsi devstack@n-api.service[120740]: X-Identity-Status: Confirmed Sep 13 18:03:14.452182 dv-cinder-852009-8-iscsi devstack@n-api.service[120740]: X-Is-Admin-Project: True Sep 13 18:03:14.452182 dv-cinder-852009-8-iscsi devstack@n-api.service[120740]: X-Project-Domain-Id: default Sep 13 18:03:14.452182 dv-cinder-852009-8-iscsi devstack@n-api.service[120740]: X-Project-Domain-Name: Default Sep 13 18:03:14.452182 dv-cinder-852009-8-iscsi devstack@n-api.service[120740]: X-Project-Id: 66136f123f5b4ad0a824920bbdf9d245 Sep 13 18:03:14.452182 dv-cinder-852009-8-iscsi devstack@n-api.service[120740]: X-Project-Name: tempest-DeleteServersTestJSON-1632919649 Sep 13 18:03:14.452182 dv-cinder-852009-8-iscsi devstack@n-api.service[120740]: X-Role: reader,member Sep 13 18:03:14.452182 dv-cinder-852009-8-iscsi devstack@n-api.service[120740]: X-Roles: reader,member Sep 13 18:03:14.453424 dv-cinder-852009-8-iscsi devstack@n-api.service[120740]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/identity"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/compute/v2/66136f123f5b4ad0a824920bbdf9d245"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.43:8080", "publicURL": "http://10.222.0.43:8080/v1/AUTH_66136f123f5b4ad0a824920bbdf9d245"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43:9696/networking"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/volume/v3/66136f123f5b4ad0a824920bbdf9d245"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/compute/v2.1"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/placement"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/volume/v3/66136f123f5b4ad0a824920bbdf9d245"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/image"}]}] Sep 13 18:03:14.453424 dv-cinder-852009-8-iscsi devstack@n-api.service[120740]: X-Tenant: tempest-DeleteServersTestJSON-1632919649 Sep 13 18:03:14.453424 dv-cinder-852009-8-iscsi devstack@n-api.service[120740]: X-Tenant-Id: 66136f123f5b4ad0a824920bbdf9d245 Sep 13 18:03:14.453424 dv-cinder-852009-8-iscsi devstack@n-api.service[120740]: X-Tenant-Name: tempest-DeleteServersTestJSON-1632919649 Sep 13 18:03:14.453424 dv-cinder-852009-8-iscsi devstack@n-api.service[120740]: X-User: tempest-DeleteServersTestJSON-1632919649-project Sep 13 18:03:14.453424 dv-cinder-852009-8-iscsi devstack@n-api.service[120740]: X-User-Domain-Id: default Sep 13 18:03:14.453424 dv-cinder-852009-8-iscsi devstack@n-api.service[120740]: X-User-Domain-Name: Default Sep 13 18:03:14.453424 dv-cinder-852009-8-iscsi devstack@n-api.service[120740]: X-User-Id: 51db5ef052144879b53979268ac4ceb5 Sep 13 18:03:14.453424 dv-cinder-852009-8-iscsi devstack@n-api.service[120740]: X-User-Name: tempest-DeleteServersTestJSON-1632919649-project Sep 13 18:03:14.453424 dv-cinder-852009-8-iscsi devstack@n-api.service[120740]: method: > Sep 13 18:03:14.453424 dv-cinder-852009-8-iscsi devstack@n-api.service[120740]: exception: Instance 207d1d8d-58a4-4b99-aa09-1c5023c60784 could not be found. Sep 13 18:03:14.453424 dv-cinder-852009-8-iscsi devstack@n-api.service[120740]: action_args: {'id': '207d1d8d-58a4-4b99-aa09-1c5023c60784'} Sep 13 18:03:14.454098 dv-cinder-852009-8-iscsi devstack@n-api.service[120740]: {{(pid=120740) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 13 18:03:14.454098 dv-cinder-852009-8-iscsi devstack@n-api.service[120740]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 13 18:03:14.454098 dv-cinder-852009-8-iscsi devstack@n-api.service[120740]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Sep 13 18:03:14.454098 dv-cinder-852009-8-iscsi devstack@n-api.service[120740]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Sep 13 18:03:14.454098 dv-cinder-852009-8-iscsi devstack@n-api.service[120740]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Sep 13 18:03:14.454098 dv-cinder-852009-8-iscsi devstack@n-api.service[120740]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Sep 13 18:03:14.454098 dv-cinder-852009-8-iscsi devstack@n-api.service[120740]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Sep 13 18:03:14.454098 dv-cinder-852009-8-iscsi devstack@n-api.service[120740]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Sep 13 18:03:14.454098 dv-cinder-852009-8-iscsi devstack@n-api.service[120740]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Sep 13 18:03:14.454098 dv-cinder-852009-8-iscsi devstack@n-api.service[120740]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Sep 13 18:03:14.454098 dv-cinder-852009-8-iscsi devstack@n-api.service[120740]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 207d1d8d-58a4-4b99-aa09-1c5023c60784 could not be found. Sep 13 18:03:14.454098 dv-cinder-852009-8-iscsi devstack@n-api.service[120740]: ERROR nova.api.openstack.wsgi Sep 13 18:03:14.454098 dv-cinder-852009-8-iscsi devstack@n-api.service[120740]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 13 18:03:14.454098 dv-cinder-852009-8-iscsi devstack@n-api.service[120740]: ERROR nova.api.openstack.wsgi Sep 13 18:03:14.454098 dv-cinder-852009-8-iscsi devstack@n-api.service[120740]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 13 18:03:14.454098 dv-cinder-852009-8-iscsi devstack@n-api.service[120740]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 13 18:03:14.454098 dv-cinder-852009-8-iscsi devstack@n-api.service[120740]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 13 18:03:14.454098 dv-cinder-852009-8-iscsi devstack@n-api.service[120740]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 13 18:03:14.454098 dv-cinder-852009-8-iscsi devstack@n-api.service[120740]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 13 18:03:14.454098 dv-cinder-852009-8-iscsi devstack@n-api.service[120740]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 13 18:03:14.461299 dv-cinder-852009-8-iscsi devstack@n-api.service[120740]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 13 18:03:14.461299 dv-cinder-852009-8-iscsi devstack@n-api.service[120740]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete Sep 13 18:03:14.461299 dv-cinder-852009-8-iscsi devstack@n-api.service[120740]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) Sep 13 18:03:14.461299 dv-cinder-852009-8-iscsi devstack@n-api.service[120740]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete Sep 13 18:03:14.461299 dv-cinder-852009-8-iscsi devstack@n-api.service[120740]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) Sep 13 18:03:14.461299 dv-cinder-852009-8-iscsi devstack@n-api.service[120740]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Sep 13 18:03:14.461299 dv-cinder-852009-8-iscsi devstack@n-api.service[120740]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Sep 13 18:03:14.461299 dv-cinder-852009-8-iscsi devstack@n-api.service[120740]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Sep 13 18:03:14.461299 dv-cinder-852009-8-iscsi devstack@n-api.service[120740]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Sep 13 18:03:14.461299 dv-cinder-852009-8-iscsi devstack@n-api.service[120740]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 207d1d8d-58a4-4b99-aa09-1c5023c60784 could not be found. Sep 13 18:03:14.461299 dv-cinder-852009-8-iscsi devstack@n-api.service[120740]: ERROR nova.api.openstack.wsgi Sep 13 18:03:14.461299 dv-cinder-852009-8-iscsi devstack@n-api.service[120740]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 13 18:03:14.461299 dv-cinder-852009-8-iscsi devstack@n-api.service[120740]: ERROR nova.api.openstack.wsgi Sep 13 18:03:14.461299 dv-cinder-852009-8-iscsi devstack@n-api.service[120740]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 13 18:03:14.461299 dv-cinder-852009-8-iscsi devstack@n-api.service[120740]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 13 18:03:14.461299 dv-cinder-852009-8-iscsi devstack@n-api.service[120740]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 13 18:03:14.461299 dv-cinder-852009-8-iscsi devstack@n-api.service[120740]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 13 18:03:14.461299 dv-cinder-852009-8-iscsi devstack@n-api.service[120740]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 13 18:03:14.461299 dv-cinder-852009-8-iscsi devstack@n-api.service[120740]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 207d1d8d-58a4-4b99-aa09-1c5023c60784 could not be found. Sep 13 18:03:14.461299 dv-cinder-852009-8-iscsi devstack@n-api.service[120740]: ERROR nova.api.openstack.wsgi Sep 13 18:03:14.465367 dv-cinder-852009-8-iscsi devstack@n-api.service[120740]: DEBUG nova.api.openstack.wsgi [None req-5fb00432-6ca4-44c6-b52c-fb5ffbc32c28 tempest-DeleteServersTestJSON-1632919649 tempest-DeleteServersTestJSON-1632919649-project] Returning 404 to user: Instance 207d1d8d-58a4-4b99-aa09-1c5023c60784 could not be found. {{(pid=120740) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 13 18:03:14.465367 dv-cinder-852009-8-iscsi devstack@n-api.service[120740]: INFO nova.api.openstack.requestlog [None req-5fb00432-6ca4-44c6-b52c-fb5ffbc32c28 tempest-DeleteServersTestJSON-1632919649 tempest-DeleteServersTestJSON-1632919649-project] 10.222.0.43 "DELETE /compute/v2.1/servers/207d1d8d-58a4-4b99-aa09-1c5023c60784" status: 404 len: 111 microversion: 2.1 time: 0.042265 Sep 13 18:03:14.465367 dv-cinder-852009-8-iscsi devstack@n-api.service[120740]: [pid: 120740|app: 0|req: 93/178] 10.222.0.43 () {58 vars in 1239 bytes} [Tue Sep 13 18:03:14 2022] DELETE /compute/v2.1/servers/207d1d8d-58a4-4b99-aa09-1c5023c60784 => generated 111 bytes in 44 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Sep 13 18:03:14.472666 dv-cinder-852009-8-iscsi devstack@n-api.service[120741]: DEBUG nova.api.openstack.wsgi [None req-2d155336-a4cd-4a32-b3b9-af592a901dde tempest-DeleteServersTestJSON-1632919649 tempest-DeleteServersTestJSON-1632919649-project] Calling method '>' {{(pid=120741) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 18:03:14.473342 dv-cinder-852009-8-iscsi devstack@n-api.service[120741]: DEBUG nova.compute.api [None req-2d155336-a4cd-4a32-b3b9-af592a901dde tempest-DeleteServersTestJSON-1632919649 tempest-DeleteServersTestJSON-1632919649-project] [instance: 207d1d8d-58a4-4b99-aa09-1c5023c60784] Fetching instance by UUID {{(pid=120741) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 18:03:14.484764 dv-cinder-852009-8-iscsi devstack@n-api.service[120741]: DEBUG oslo_concurrency.lockutils [None req-2d155336-a4cd-4a32-b3b9-af592a901dde tempest-DeleteServersTestJSON-1632919649 tempest-DeleteServersTestJSON-1632919649-project] Acquiring lock "1daf4f4c-0e4a-4779-b53a-78c48397ea2f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120741) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 18:03:14.484764 dv-cinder-852009-8-iscsi devstack@n-api.service[120741]: DEBUG oslo_concurrency.lockutils [None req-2d155336-a4cd-4a32-b3b9-af592a901dde tempest-DeleteServersTestJSON-1632919649 tempest-DeleteServersTestJSON-1632919649-project] Lock "1daf4f4c-0e4a-4779-b53a-78c48397ea2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120741) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 18:03:14.484764 dv-cinder-852009-8-iscsi devstack@n-api.service[120741]: DEBUG oslo_concurrency.lockutils [None req-2d155336-a4cd-4a32-b3b9-af592a901dde tempest-DeleteServersTestJSON-1632919649 tempest-DeleteServersTestJSON-1632919649-project] Lock "1daf4f4c-0e4a-4779-b53a-78c48397ea2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120741) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 18:03:14.484764 dv-cinder-852009-8-iscsi devstack@n-api.service[120741]: DEBUG oslo_concurrency.lockutils [None req-2d155336-a4cd-4a32-b3b9-af592a901dde tempest-DeleteServersTestJSON-1632919649 tempest-DeleteServersTestJSON-1632919649-project] Acquiring lock "1daf4f4c-0e4a-4779-b53a-78c48397ea2f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120741) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 18:03:14.485154 dv-cinder-852009-8-iscsi devstack@n-api.service[120741]: DEBUG oslo_concurrency.lockutils [None req-2d155336-a4cd-4a32-b3b9-af592a901dde tempest-DeleteServersTestJSON-1632919649 tempest-DeleteServersTestJSON-1632919649-project] Lock "1daf4f4c-0e4a-4779-b53a-78c48397ea2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120741) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 18:03:14.485458 dv-cinder-852009-8-iscsi devstack@n-api.service[120741]: DEBUG oslo_concurrency.lockutils [None req-2d155336-a4cd-4a32-b3b9-af592a901dde tempest-DeleteServersTestJSON-1632919649 tempest-DeleteServersTestJSON-1632919649-project] Lock "1daf4f4c-0e4a-4779-b53a-78c48397ea2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120741) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 18:03:14.502731 dv-cinder-852009-8-iscsi devstack@n-api.service[120741]: INFO nova.api.openstack.wsgi [None req-2d155336-a4cd-4a32-b3b9-af592a901dde tempest-DeleteServersTestJSON-1632919649 tempest-DeleteServersTestJSON-1632919649-project] HTTP exception thrown: Instance 207d1d8d-58a4-4b99-aa09-1c5023c60784 could not be found. Sep 13 18:03:14.504983 dv-cinder-852009-8-iscsi devstack@n-api.service[120741]: DEBUG nova.api.openstack.wsgi [None req-2d155336-a4cd-4a32-b3b9-af592a901dde tempest-DeleteServersTestJSON-1632919649 tempest-DeleteServersTestJSON-1632919649-project] Request method failure captured: Sep 13 18:03:14.504983 dv-cinder-852009-8-iscsi devstack@n-api.service[120741]: request: GET /compute/v2.1/servers/207d1d8d-58a4-4b99-aa09-1c5023c60784 HTTP/1.1 Sep 13 18:03:14.504983 dv-cinder-852009-8-iscsi devstack@n-api.service[120741]: Accept: application/json Sep 13 18:03:14.504983 dv-cinder-852009-8-iscsi devstack@n-api.service[120741]: Accept-Encoding: identity Sep 13 18:03:14.504983 dv-cinder-852009-8-iscsi devstack@n-api.service[120741]: Connection: close Sep 13 18:03:14.504983 dv-cinder-852009-8-iscsi devstack@n-api.service[120741]: Content-Length: 0 Sep 13 18:03:14.504983 dv-cinder-852009-8-iscsi devstack@n-api.service[120741]: Content-Type: application/json Sep 13 18:03:14.504983 dv-cinder-852009-8-iscsi devstack@n-api.service[120741]: Host: 10.222.0.43 Sep 13 18:03:14.504983 dv-cinder-852009-8-iscsi devstack@n-api.service[120741]: Openstack-System-Scope: None Sep 13 18:03:14.504983 dv-cinder-852009-8-iscsi devstack@n-api.service[120741]: User-Agent: python-urllib3/1.26.12 Sep 13 18:03:14.504983 dv-cinder-852009-8-iscsi devstack@n-api.service[120741]: X-Auth-Token: gAAAAABjIMWVMMDe5KDUDyQ1qh2SyXN4osdrRMHRWrxwAgozU_uiFEaxhAlwbtNRamVxKX5FGpc_X33ee-4bUVHJ89MgdfmlDZjvRYJy9oXSIbDyzIQgYNsfzS8syp3xNEZ2K7Qs9-s4-SRENoKjj6UnbIpUJwfrXQEbQnFn8PgtswyjTlVPa8E Sep 13 18:03:14.504983 dv-cinder-852009-8-iscsi devstack@n-api.service[120741]: X-Domain-Id: None Sep 13 18:03:14.504983 dv-cinder-852009-8-iscsi devstack@n-api.service[120741]: X-Domain-Name: None Sep 13 18:03:14.504983 dv-cinder-852009-8-iscsi devstack@n-api.service[120741]: X-Identity-Status: Confirmed Sep 13 18:03:14.504983 dv-cinder-852009-8-iscsi devstack@n-api.service[120741]: X-Is-Admin-Project: True Sep 13 18:03:14.504983 dv-cinder-852009-8-iscsi devstack@n-api.service[120741]: X-Project-Domain-Id: default Sep 13 18:03:14.504983 dv-cinder-852009-8-iscsi devstack@n-api.service[120741]: X-Project-Domain-Name: Default Sep 13 18:03:14.504983 dv-cinder-852009-8-iscsi devstack@n-api.service[120741]: X-Project-Id: 66136f123f5b4ad0a824920bbdf9d245 Sep 13 18:03:14.504983 dv-cinder-852009-8-iscsi devstack@n-api.service[120741]: X-Project-Name: tempest-DeleteServersTestJSON-1632919649 Sep 13 18:03:14.504983 dv-cinder-852009-8-iscsi devstack@n-api.service[120741]: X-Role: reader,member Sep 13 18:03:14.504983 dv-cinder-852009-8-iscsi devstack@n-api.service[120741]: X-Roles: reader,member Sep 13 18:03:14.506342 dv-cinder-852009-8-iscsi devstack@n-api.service[120741]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/identity"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/compute/v2/66136f123f5b4ad0a824920bbdf9d245"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.43:8080", "publicURL": "http://10.222.0.43:8080/v1/AUTH_66136f123f5b4ad0a824920bbdf9d245"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43:9696/networking"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/volume/v3/66136f123f5b4ad0a824920bbdf9d245"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/compute/v2.1"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/placement"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/volume/v3/66136f123f5b4ad0a824920bbdf9d245"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/image"}]}] Sep 13 18:03:14.506342 dv-cinder-852009-8-iscsi devstack@n-api.service[120741]: X-Tenant: tempest-DeleteServersTestJSON-1632919649 Sep 13 18:03:14.506342 dv-cinder-852009-8-iscsi devstack@n-api.service[120741]: X-Tenant-Id: 66136f123f5b4ad0a824920bbdf9d245 Sep 13 18:03:14.506342 dv-cinder-852009-8-iscsi devstack@n-api.service[120741]: X-Tenant-Name: tempest-DeleteServersTestJSON-1632919649 Sep 13 18:03:14.506342 dv-cinder-852009-8-iscsi devstack@n-api.service[120741]: X-User: tempest-DeleteServersTestJSON-1632919649-project Sep 13 18:03:14.506342 dv-cinder-852009-8-iscsi devstack@n-api.service[120741]: X-User-Domain-Id: default Sep 13 18:03:14.506342 dv-cinder-852009-8-iscsi devstack@n-api.service[120741]: X-User-Domain-Name: Default Sep 13 18:03:14.506342 dv-cinder-852009-8-iscsi devstack@n-api.service[120741]: X-User-Id: 51db5ef052144879b53979268ac4ceb5 Sep 13 18:03:14.506342 dv-cinder-852009-8-iscsi devstack@n-api.service[120741]: X-User-Name: tempest-DeleteServersTestJSON-1632919649-project Sep 13 18:03:14.506342 dv-cinder-852009-8-iscsi devstack@n-api.service[120741]: method: > Sep 13 18:03:14.506342 dv-cinder-852009-8-iscsi devstack@n-api.service[120741]: exception: Instance 207d1d8d-58a4-4b99-aa09-1c5023c60784 could not be found. Sep 13 18:03:14.506342 dv-cinder-852009-8-iscsi devstack@n-api.service[120741]: action_args: {'id': '207d1d8d-58a4-4b99-aa09-1c5023c60784'} Sep 13 18:03:14.507035 dv-cinder-852009-8-iscsi devstack@n-api.service[120741]: {{(pid=120741) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 13 18:03:14.507035 dv-cinder-852009-8-iscsi devstack@n-api.service[120741]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 13 18:03:14.507035 dv-cinder-852009-8-iscsi devstack@n-api.service[120741]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Sep 13 18:03:14.507035 dv-cinder-852009-8-iscsi devstack@n-api.service[120741]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Sep 13 18:03:14.507035 dv-cinder-852009-8-iscsi devstack@n-api.service[120741]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Sep 13 18:03:14.507035 dv-cinder-852009-8-iscsi devstack@n-api.service[120741]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Sep 13 18:03:14.507035 dv-cinder-852009-8-iscsi devstack@n-api.service[120741]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Sep 13 18:03:14.507035 dv-cinder-852009-8-iscsi devstack@n-api.service[120741]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Sep 13 18:03:14.507035 dv-cinder-852009-8-iscsi devstack@n-api.service[120741]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Sep 13 18:03:14.507035 dv-cinder-852009-8-iscsi devstack@n-api.service[120741]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Sep 13 18:03:14.507035 dv-cinder-852009-8-iscsi devstack@n-api.service[120741]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 207d1d8d-58a4-4b99-aa09-1c5023c60784 could not be found. Sep 13 18:03:14.507035 dv-cinder-852009-8-iscsi devstack@n-api.service[120741]: ERROR nova.api.openstack.wsgi Sep 13 18:03:14.507035 dv-cinder-852009-8-iscsi devstack@n-api.service[120741]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 13 18:03:14.507035 dv-cinder-852009-8-iscsi devstack@n-api.service[120741]: ERROR nova.api.openstack.wsgi Sep 13 18:03:14.507035 dv-cinder-852009-8-iscsi devstack@n-api.service[120741]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 13 18:03:14.507035 dv-cinder-852009-8-iscsi devstack@n-api.service[120741]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 13 18:03:14.507035 dv-cinder-852009-8-iscsi devstack@n-api.service[120741]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 13 18:03:14.507035 dv-cinder-852009-8-iscsi devstack@n-api.service[120741]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 13 18:03:14.507035 dv-cinder-852009-8-iscsi devstack@n-api.service[120741]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 13 18:03:14.507035 dv-cinder-852009-8-iscsi devstack@n-api.service[120741]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 13 18:03:14.508136 dv-cinder-852009-8-iscsi devstack@n-api.service[120741]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 13 18:03:14.508136 dv-cinder-852009-8-iscsi devstack@n-api.service[120741]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Sep 13 18:03:14.508136 dv-cinder-852009-8-iscsi devstack@n-api.service[120741]: ERROR nova.api.openstack.wsgi instance = self._get_server( Sep 13 18:03:14.508136 dv-cinder-852009-8-iscsi devstack@n-api.service[120741]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Sep 13 18:03:14.508136 dv-cinder-852009-8-iscsi devstack@n-api.service[120741]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Sep 13 18:03:14.508136 dv-cinder-852009-8-iscsi devstack@n-api.service[120741]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Sep 13 18:03:14.508136 dv-cinder-852009-8-iscsi devstack@n-api.service[120741]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Sep 13 18:03:14.508136 dv-cinder-852009-8-iscsi devstack@n-api.service[120741]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 207d1d8d-58a4-4b99-aa09-1c5023c60784 could not be found. Sep 13 18:03:14.508136 dv-cinder-852009-8-iscsi devstack@n-api.service[120741]: ERROR nova.api.openstack.wsgi Sep 13 18:03:14.508136 dv-cinder-852009-8-iscsi devstack@n-api.service[120741]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 13 18:03:14.508136 dv-cinder-852009-8-iscsi devstack@n-api.service[120741]: ERROR nova.api.openstack.wsgi Sep 13 18:03:14.508136 dv-cinder-852009-8-iscsi devstack@n-api.service[120741]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 13 18:03:14.508136 dv-cinder-852009-8-iscsi devstack@n-api.service[120741]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 13 18:03:14.508136 dv-cinder-852009-8-iscsi devstack@n-api.service[120741]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 13 18:03:14.508136 dv-cinder-852009-8-iscsi devstack@n-api.service[120741]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 13 18:03:14.508136 dv-cinder-852009-8-iscsi devstack@n-api.service[120741]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 13 18:03:14.508136 dv-cinder-852009-8-iscsi devstack@n-api.service[120741]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 207d1d8d-58a4-4b99-aa09-1c5023c60784 could not be found. Sep 13 18:03:14.508136 dv-cinder-852009-8-iscsi devstack@n-api.service[120741]: ERROR nova.api.openstack.wsgi Sep 13 18:03:14.510979 dv-cinder-852009-8-iscsi devstack@n-api.service[120741]: DEBUG nova.api.openstack.wsgi [None req-2d155336-a4cd-4a32-b3b9-af592a901dde tempest-DeleteServersTestJSON-1632919649 tempest-DeleteServersTestJSON-1632919649-project] Returning 404 to user: Instance 207d1d8d-58a4-4b99-aa09-1c5023c60784 could not be found. {{(pid=120741) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 13 18:03:14.512037 dv-cinder-852009-8-iscsi devstack@n-api.service[120741]: INFO nova.api.openstack.requestlog [None req-2d155336-a4cd-4a32-b3b9-af592a901dde tempest-DeleteServersTestJSON-1632919649 tempest-DeleteServersTestJSON-1632919649-project] 10.222.0.43 "GET /compute/v2.1/servers/207d1d8d-58a4-4b99-aa09-1c5023c60784" status: 404 len: 111 microversion: 2.1 time: 0.044322 Sep 13 18:03:14.516872 dv-cinder-852009-8-iscsi devstack@n-api.service[120741]: [pid: 120741|app: 0|req: 86/179] 10.222.0.43 () {58 vars in 1236 bytes} [Tue Sep 13 18:03:14 2022] GET /compute/v2.1/servers/207d1d8d-58a4-4b99-aa09-1c5023c60784 => generated 111 bytes in 50 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Sep 13 18:03:14.784394 dv-cinder-852009-8-iscsi devstack@n-api.service[120740]: DEBUG nova.api.openstack.wsgi [None req-b406f1fb-4618-4d0c-a45a-43569d63d9d7 tempest-ServerRescueNegativeTestJSON-412251590 tempest-ServerRescueNegativeTestJSON-412251590-project] Calling method '>' {{(pid=120740) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 18:03:14.785055 dv-cinder-852009-8-iscsi devstack@n-api.service[120740]: DEBUG nova.compute.api [None req-b406f1fb-4618-4d0c-a45a-43569d63d9d7 tempest-ServerRescueNegativeTestJSON-412251590 tempest-ServerRescueNegativeTestJSON-412251590-project] [instance: 8cd29851-35c1-4032-a137-ab9419a2ec5b] Fetching instance by UUID {{(pid=120740) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 18:03:14.799997 dv-cinder-852009-8-iscsi devstack@n-api.service[120740]: DEBUG oslo_concurrency.lockutils [None req-b406f1fb-4618-4d0c-a45a-43569d63d9d7 tempest-ServerRescueNegativeTestJSON-412251590 tempest-ServerRescueNegativeTestJSON-412251590-project] Acquiring lock "1daf4f4c-0e4a-4779-b53a-78c48397ea2f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120740) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 18:03:14.801785 dv-cinder-852009-8-iscsi devstack@n-api.service[120740]: DEBUG oslo_concurrency.lockutils [None req-b406f1fb-4618-4d0c-a45a-43569d63d9d7 tempest-ServerRescueNegativeTestJSON-412251590 tempest-ServerRescueNegativeTestJSON-412251590-project] Lock "1daf4f4c-0e4a-4779-b53a-78c48397ea2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120740) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 18:03:14.802346 dv-cinder-852009-8-iscsi devstack@n-api.service[120740]: DEBUG oslo_concurrency.lockutils [None req-b406f1fb-4618-4d0c-a45a-43569d63d9d7 tempest-ServerRescueNegativeTestJSON-412251590 tempest-ServerRescueNegativeTestJSON-412251590-project] Lock "1daf4f4c-0e4a-4779-b53a-78c48397ea2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120740) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 18:03:14.803647 dv-cinder-852009-8-iscsi devstack@n-api.service[120740]: DEBUG oslo_concurrency.lockutils [None req-b406f1fb-4618-4d0c-a45a-43569d63d9d7 tempest-ServerRescueNegativeTestJSON-412251590 tempest-ServerRescueNegativeTestJSON-412251590-project] Acquiring lock "1daf4f4c-0e4a-4779-b53a-78c48397ea2f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120740) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 18:03:14.805037 dv-cinder-852009-8-iscsi devstack@n-api.service[120740]: DEBUG oslo_concurrency.lockutils [None req-b406f1fb-4618-4d0c-a45a-43569d63d9d7 tempest-ServerRescueNegativeTestJSON-412251590 tempest-ServerRescueNegativeTestJSON-412251590-project] Lock "1daf4f4c-0e4a-4779-b53a-78c48397ea2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120740) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 18:03:14.805865 dv-cinder-852009-8-iscsi devstack@n-api.service[120740]: DEBUG oslo_concurrency.lockutils [None req-b406f1fb-4618-4d0c-a45a-43569d63d9d7 tempest-ServerRescueNegativeTestJSON-412251590 tempest-ServerRescueNegativeTestJSON-412251590-project] Lock "1daf4f4c-0e4a-4779-b53a-78c48397ea2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120740) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 18:03:14.979370 dv-cinder-852009-8-iscsi devstack@n-api.service[120740]: DEBUG nova.policy [None req-b406f1fb-4618-4d0c-a45a-43569d63d9d7 tempest-ServerRescueNegativeTestJSON-412251590 tempest-ServerRescueNegativeTestJSON-412251590-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '60800cf2774e409d9c1b6f4992669991', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2eae4acecf6c4961830ead78d71b2ad3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120740) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 18:03:14.988725 dv-cinder-852009-8-iscsi devstack@n-api.service[120740]: INFO nova.api.openstack.requestlog [None req-b406f1fb-4618-4d0c-a45a-43569d63d9d7 tempest-ServerRescueNegativeTestJSON-412251590 tempest-ServerRescueNegativeTestJSON-412251590-project] 10.222.0.43 "GET /compute/v2.1/servers/8cd29851-35c1-4032-a137-ab9419a2ec5b" status: 200 len: 1522 microversion: 2.1 time: 0.209166 Sep 13 18:03:14.996470 dv-cinder-852009-8-iscsi devstack@n-api.service[120740]: [pid: 120740|app: 0|req: 94/180] 10.222.0.43 () {58 vars in 1236 bytes} [Tue Sep 13 18:03:14 2022] GET /compute/v2.1/servers/8cd29851-35c1-4032-a137-ab9419a2ec5b => generated 1522 bytes in 211 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 13 18:03:16.013150 dv-cinder-852009-8-iscsi devstack@n-api.service[120741]: DEBUG nova.api.openstack.wsgi [None req-9ea174c6-584b-4922-b0e7-13eff6dcad83 tempest-ServerRescueNegativeTestJSON-412251590 tempest-ServerRescueNegativeTestJSON-412251590-project] Calling method '>' {{(pid=120741) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 18:03:16.013764 dv-cinder-852009-8-iscsi devstack@n-api.service[120741]: DEBUG nova.compute.api [None req-9ea174c6-584b-4922-b0e7-13eff6dcad83 tempest-ServerRescueNegativeTestJSON-412251590 tempest-ServerRescueNegativeTestJSON-412251590-project] [instance: 8cd29851-35c1-4032-a137-ab9419a2ec5b] Fetching instance by UUID {{(pid=120741) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 18:03:16.026569 dv-cinder-852009-8-iscsi devstack@n-api.service[120741]: DEBUG oslo_concurrency.lockutils [None req-9ea174c6-584b-4922-b0e7-13eff6dcad83 tempest-ServerRescueNegativeTestJSON-412251590 tempest-ServerRescueNegativeTestJSON-412251590-project] Acquiring lock "1daf4f4c-0e4a-4779-b53a-78c48397ea2f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120741) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 18:03:16.027163 dv-cinder-852009-8-iscsi devstack@n-api.service[120741]: DEBUG oslo_concurrency.lockutils [None req-9ea174c6-584b-4922-b0e7-13eff6dcad83 tempest-ServerRescueNegativeTestJSON-412251590 tempest-ServerRescueNegativeTestJSON-412251590-project] Lock "1daf4f4c-0e4a-4779-b53a-78c48397ea2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120741) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 18:03:16.027604 dv-cinder-852009-8-iscsi devstack@n-api.service[120741]: DEBUG oslo_concurrency.lockutils [None req-9ea174c6-584b-4922-b0e7-13eff6dcad83 tempest-ServerRescueNegativeTestJSON-412251590 tempest-ServerRescueNegativeTestJSON-412251590-project] Lock "1daf4f4c-0e4a-4779-b53a-78c48397ea2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120741) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 18:03:16.028325 dv-cinder-852009-8-iscsi devstack@n-api.service[120741]: DEBUG oslo_concurrency.lockutils [None req-9ea174c6-584b-4922-b0e7-13eff6dcad83 tempest-ServerRescueNegativeTestJSON-412251590 tempest-ServerRescueNegativeTestJSON-412251590-project] Acquiring lock "1daf4f4c-0e4a-4779-b53a-78c48397ea2f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120741) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 18:03:16.031990 dv-cinder-852009-8-iscsi devstack@n-api.service[120741]: DEBUG oslo_concurrency.lockutils [None req-9ea174c6-584b-4922-b0e7-13eff6dcad83 tempest-ServerRescueNegativeTestJSON-412251590 tempest-ServerRescueNegativeTestJSON-412251590-project] Lock "1daf4f4c-0e4a-4779-b53a-78c48397ea2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120741) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 18:03:16.032473 dv-cinder-852009-8-iscsi devstack@n-api.service[120741]: DEBUG oslo_concurrency.lockutils [None req-9ea174c6-584b-4922-b0e7-13eff6dcad83 tempest-ServerRescueNegativeTestJSON-412251590 tempest-ServerRescueNegativeTestJSON-412251590-project] Lock "1daf4f4c-0e4a-4779-b53a-78c48397ea2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=120741) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 18:03:16.286353 dv-cinder-852009-8-iscsi devstack@n-api.service[120741]: DEBUG nova.policy [None req-9ea174c6-584b-4922-b0e7-13eff6dcad83 tempest-ServerRescueNegativeTestJSON-412251590 tempest-ServerRescueNegativeTestJSON-412251590-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '60800cf2774e409d9c1b6f4992669991', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2eae4acecf6c4961830ead78d71b2ad3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120741) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 18:03:16.316098 dv-cinder-852009-8-iscsi devstack@n-api.service[120741]: INFO nova.api.openstack.requestlog [None req-9ea174c6-584b-4922-b0e7-13eff6dcad83 tempest-ServerRescueNegativeTestJSON-412251590 tempest-ServerRescueNegativeTestJSON-412251590-project] 10.222.0.43 "GET /compute/v2.1/servers/8cd29851-35c1-4032-a137-ab9419a2ec5b" status: 200 len: 1522 microversion: 2.1 time: 0.307030 Sep 13 18:03:16.318314 dv-cinder-852009-8-iscsi devstack@n-api.service[120741]: [pid: 120741|app: 0|req: 87/181] 10.222.0.43 () {58 vars in 1236 bytes} [Tue Sep 13 18:03:16 2022] GET /compute/v2.1/servers/8cd29851-35c1-4032-a137-ab9419a2ec5b => generated 1522 bytes in 310 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 13 18:03:17.350080 dv-cinder-852009-8-iscsi devstack@n-api.service[120740]: DEBUG nova.api.openstack.wsgi [None req-f81aa594-404e-462e-b087-c3e6b77bc478 tempest-ServerRescueNegativeTestJSON-412251590 tempest-ServerRescueNegativeTestJSON-412251590-project] Calling method '>' {{(pid=120740) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 18:03:17.350710 dv-cinder-852009-8-iscsi devstack@n-api.service[120740]: DEBUG nova.compute.api [None req-f81aa594-404e-462e-b087-c3e6b77bc478 tempest-ServerRescueNegativeTestJSON-412251590 tempest-ServerRescueNegativeTestJSON-412251590-project] [instance: 8cd29851-35c1-4032-a137-ab9419a2ec5b] Fetching instance by UUID {{(pid=120740) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 18:03:17.360561 dv-cinder-852009-8-iscsi devstack@n-api.service[120740]: DEBUG oslo_concurrency.lockutils [None req-f81aa594-404e-462e-b087-c3e6b77bc478 tempest-ServerRescueNegativeTestJSON-412251590 tempest-ServerRescueNegativeTestJSON-412251590-project] Acquiring lock "1daf4f4c-0e4a-4779-b53a-78c48397ea2f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120740) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 18:03:17.361058 dv-cinder-852009-8-iscsi devstack@n-api.service[120740]: DEBUG oslo_concurrency.lockutils [None req-f81aa594-404e-462e-b087-c3e6b77bc478 tempest-ServerRescueNegativeTestJSON-412251590 tempest-ServerRescueNegativeTestJSON-412251590-project] Lock "1daf4f4c-0e4a-4779-b53a-78c48397ea2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120740) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 18:03:17.365239 dv-cinder-852009-8-iscsi devstack@n-api.service[120740]: DEBUG oslo_concurrency.lockutils [None req-f81aa594-404e-462e-b087-c3e6b77bc478 tempest-ServerRescueNegativeTestJSON-412251590 tempest-ServerRescueNegativeTestJSON-412251590-project] Lock "1daf4f4c-0e4a-4779-b53a-78c48397ea2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=120740) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 18:03:17.368439 dv-cinder-852009-8-iscsi devstack@n-api.service[120740]: DEBUG oslo_concurrency.lockutils [None req-f81aa594-404e-462e-b087-c3e6b77bc478 tempest-ServerRescueNegativeTestJSON-412251590 tempest-ServerRescueNegativeTestJSON-412251590-project] Acquiring lock "1daf4f4c-0e4a-4779-b53a-78c48397ea2f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120740) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 18:03:17.370272 dv-cinder-852009-8-iscsi devstack@n-api.service[120740]: DEBUG oslo_concurrency.lockutils [None req-f81aa594-404e-462e-b087-c3e6b77bc478 tempest-ServerRescueNegativeTestJSON-412251590 tempest-ServerRescueNegativeTestJSON-412251590-project] Lock "1daf4f4c-0e4a-4779-b53a-78c48397ea2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120740) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 18:03:17.371037 dv-cinder-852009-8-iscsi devstack@n-api.service[120740]: DEBUG oslo_concurrency.lockutils [None req-f81aa594-404e-462e-b087-c3e6b77bc478 tempest-ServerRescueNegativeTestJSON-412251590 tempest-ServerRescueNegativeTestJSON-412251590-project] Lock "1daf4f4c-0e4a-4779-b53a-78c48397ea2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120740) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 18:03:17.689051 dv-cinder-852009-8-iscsi devstack@n-api.service[120740]: DEBUG nova.policy [None req-f81aa594-404e-462e-b087-c3e6b77bc478 tempest-ServerRescueNegativeTestJSON-412251590 tempest-ServerRescueNegativeTestJSON-412251590-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '60800cf2774e409d9c1b6f4992669991', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2eae4acecf6c4961830ead78d71b2ad3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120740) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 18:03:17.697208 dv-cinder-852009-8-iscsi devstack@n-api.service[120740]: INFO nova.api.openstack.requestlog [None req-f81aa594-404e-462e-b087-c3e6b77bc478 tempest-ServerRescueNegativeTestJSON-412251590 tempest-ServerRescueNegativeTestJSON-412251590-project] 10.222.0.43 "GET /compute/v2.1/servers/8cd29851-35c1-4032-a137-ab9419a2ec5b" status: 200 len: 1522 microversion: 2.1 time: 0.350992 Sep 13 18:03:17.697783 dv-cinder-852009-8-iscsi devstack@n-api.service[120740]: [pid: 120740|app: 0|req: 95/182] 10.222.0.43 () {58 vars in 1236 bytes} [Tue Sep 13 18:03:17 2022] GET /compute/v2.1/servers/8cd29851-35c1-4032-a137-ab9419a2ec5b => generated 1522 bytes in 352 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 13 18:03:18.723721 dv-cinder-852009-8-iscsi devstack@n-api.service[120741]: DEBUG nova.api.openstack.wsgi [None req-b4d5f537-3632-45f7-8223-a93de5bcef07 tempest-ServerRescueNegativeTestJSON-412251590 tempest-ServerRescueNegativeTestJSON-412251590-project] Calling method '>' {{(pid=120741) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 18:03:18.724398 dv-cinder-852009-8-iscsi devstack@n-api.service[120741]: DEBUG nova.compute.api [None req-b4d5f537-3632-45f7-8223-a93de5bcef07 tempest-ServerRescueNegativeTestJSON-412251590 tempest-ServerRescueNegativeTestJSON-412251590-project] [instance: 8cd29851-35c1-4032-a137-ab9419a2ec5b] Fetching instance by UUID {{(pid=120741) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 18:03:18.728101 dv-cinder-852009-8-iscsi devstack@n-api.service[120741]: DEBUG dbcounter [-] [120741] Writing DB stats nova_api:SELECT=51,nova_api:UPDATE=1 {{(pid=120741) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 18:03:18.742622 dv-cinder-852009-8-iscsi devstack@n-api.service[120741]: DEBUG oslo_concurrency.lockutils [None req-b4d5f537-3632-45f7-8223-a93de5bcef07 tempest-ServerRescueNegativeTestJSON-412251590 tempest-ServerRescueNegativeTestJSON-412251590-project] Acquiring lock "1daf4f4c-0e4a-4779-b53a-78c48397ea2f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120741) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 18:03:18.743396 dv-cinder-852009-8-iscsi devstack@n-api.service[120741]: DEBUG oslo_concurrency.lockutils [None req-b4d5f537-3632-45f7-8223-a93de5bcef07 tempest-ServerRescueNegativeTestJSON-412251590 tempest-ServerRescueNegativeTestJSON-412251590-project] Lock "1daf4f4c-0e4a-4779-b53a-78c48397ea2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120741) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 18:03:18.743991 dv-cinder-852009-8-iscsi devstack@n-api.service[120741]: DEBUG oslo_concurrency.lockutils [None req-b4d5f537-3632-45f7-8223-a93de5bcef07 tempest-ServerRescueNegativeTestJSON-412251590 tempest-ServerRescueNegativeTestJSON-412251590-project] Lock "1daf4f4c-0e4a-4779-b53a-78c48397ea2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120741) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 18:03:18.745652 dv-cinder-852009-8-iscsi devstack@n-api.service[120741]: DEBUG oslo_concurrency.lockutils [None req-b4d5f537-3632-45f7-8223-a93de5bcef07 tempest-ServerRescueNegativeTestJSON-412251590 tempest-ServerRescueNegativeTestJSON-412251590-project] Acquiring lock "1daf4f4c-0e4a-4779-b53a-78c48397ea2f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120741) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 18:03:18.746442 dv-cinder-852009-8-iscsi devstack@n-api.service[120741]: DEBUG oslo_concurrency.lockutils [None req-b4d5f537-3632-45f7-8223-a93de5bcef07 tempest-ServerRescueNegativeTestJSON-412251590 tempest-ServerRescueNegativeTestJSON-412251590-project] Lock "1daf4f4c-0e4a-4779-b53a-78c48397ea2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120741) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 18:03:18.747026 dv-cinder-852009-8-iscsi devstack@n-api.service[120741]: DEBUG oslo_concurrency.lockutils [None req-b4d5f537-3632-45f7-8223-a93de5bcef07 tempest-ServerRescueNegativeTestJSON-412251590 tempest-ServerRescueNegativeTestJSON-412251590-project] Lock "1daf4f4c-0e4a-4779-b53a-78c48397ea2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120741) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 18:03:18.927124 dv-cinder-852009-8-iscsi devstack@n-api.service[120741]: DEBUG nova.policy [None req-b4d5f537-3632-45f7-8223-a93de5bcef07 tempest-ServerRescueNegativeTestJSON-412251590 tempest-ServerRescueNegativeTestJSON-412251590-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '60800cf2774e409d9c1b6f4992669991', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2eae4acecf6c4961830ead78d71b2ad3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120741) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 18:03:18.935372 dv-cinder-852009-8-iscsi devstack@n-api.service[120741]: INFO nova.api.openstack.requestlog [None req-b4d5f537-3632-45f7-8223-a93de5bcef07 tempest-ServerRescueNegativeTestJSON-412251590 tempest-ServerRescueNegativeTestJSON-412251590-project] 10.222.0.43 "GET /compute/v2.1/servers/8cd29851-35c1-4032-a137-ab9419a2ec5b" status: 200 len: 1522 microversion: 2.1 time: 0.216703 Sep 13 18:03:18.936151 dv-cinder-852009-8-iscsi devstack@n-api.service[120741]: [pid: 120741|app: 0|req: 88/183] 10.222.0.43 () {58 vars in 1236 bytes} [Tue Sep 13 18:03:18 2022] GET /compute/v2.1/servers/8cd29851-35c1-4032-a137-ab9419a2ec5b => generated 1522 bytes in 219 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 13 18:03:19.967021 dv-cinder-852009-8-iscsi devstack@n-api.service[120740]: DEBUG nova.api.openstack.wsgi [None req-015ec390-a458-4bc2-bb95-1ac2571a4044 tempest-ServerRescueNegativeTestJSON-412251590 tempest-ServerRescueNegativeTestJSON-412251590-project] Calling method '>' {{(pid=120740) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 18:03:19.967709 dv-cinder-852009-8-iscsi devstack@n-api.service[120740]: DEBUG nova.compute.api [None req-015ec390-a458-4bc2-bb95-1ac2571a4044 tempest-ServerRescueNegativeTestJSON-412251590 tempest-ServerRescueNegativeTestJSON-412251590-project] [instance: 8cd29851-35c1-4032-a137-ab9419a2ec5b] Fetching instance by UUID {{(pid=120740) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 18:03:19.990353 dv-cinder-852009-8-iscsi devstack@n-api.service[120740]: DEBUG oslo_concurrency.lockutils [None req-015ec390-a458-4bc2-bb95-1ac2571a4044 tempest-ServerRescueNegativeTestJSON-412251590 tempest-ServerRescueNegativeTestJSON-412251590-project] Acquiring lock "1daf4f4c-0e4a-4779-b53a-78c48397ea2f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120740) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 18:03:19.990833 dv-cinder-852009-8-iscsi devstack@n-api.service[120740]: DEBUG oslo_concurrency.lockutils [None req-015ec390-a458-4bc2-bb95-1ac2571a4044 tempest-ServerRescueNegativeTestJSON-412251590 tempest-ServerRescueNegativeTestJSON-412251590-project] Lock "1daf4f4c-0e4a-4779-b53a-78c48397ea2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120740) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 18:03:19.991258 dv-cinder-852009-8-iscsi devstack@n-api.service[120740]: DEBUG oslo_concurrency.lockutils [None req-015ec390-a458-4bc2-bb95-1ac2571a4044 tempest-ServerRescueNegativeTestJSON-412251590 tempest-ServerRescueNegativeTestJSON-412251590-project] Lock "1daf4f4c-0e4a-4779-b53a-78c48397ea2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120740) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 18:03:19.992023 dv-cinder-852009-8-iscsi devstack@n-api.service[120740]: DEBUG oslo_concurrency.lockutils [None req-015ec390-a458-4bc2-bb95-1ac2571a4044 tempest-ServerRescueNegativeTestJSON-412251590 tempest-ServerRescueNegativeTestJSON-412251590-project] Acquiring lock "1daf4f4c-0e4a-4779-b53a-78c48397ea2f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120740) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 18:03:19.992607 dv-cinder-852009-8-iscsi devstack@n-api.service[120740]: DEBUG oslo_concurrency.lockutils [None req-015ec390-a458-4bc2-bb95-1ac2571a4044 tempest-ServerRescueNegativeTestJSON-412251590 tempest-ServerRescueNegativeTestJSON-412251590-project] Lock "1daf4f4c-0e4a-4779-b53a-78c48397ea2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120740) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 18:03:19.993126 dv-cinder-852009-8-iscsi devstack@n-api.service[120740]: DEBUG oslo_concurrency.lockutils [None req-015ec390-a458-4bc2-bb95-1ac2571a4044 tempest-ServerRescueNegativeTestJSON-412251590 tempest-ServerRescueNegativeTestJSON-412251590-project] Lock "1daf4f4c-0e4a-4779-b53a-78c48397ea2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120740) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 18:03:20.540339 dv-cinder-852009-8-iscsi devstack@n-api.service[120740]: DEBUG nova.policy [None req-015ec390-a458-4bc2-bb95-1ac2571a4044 tempest-ServerRescueNegativeTestJSON-412251590 tempest-ServerRescueNegativeTestJSON-412251590-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '60800cf2774e409d9c1b6f4992669991', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2eae4acecf6c4961830ead78d71b2ad3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120740) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 18:03:20.557793 dv-cinder-852009-8-iscsi devstack@n-api.service[120740]: INFO nova.api.openstack.requestlog [None req-015ec390-a458-4bc2-bb95-1ac2571a4044 tempest-ServerRescueNegativeTestJSON-412251590 tempest-ServerRescueNegativeTestJSON-412251590-project] 10.222.0.43 "GET /compute/v2.1/servers/8cd29851-35c1-4032-a137-ab9419a2ec5b" status: 200 len: 1522 microversion: 2.1 time: 0.598900 Sep 13 18:03:20.558674 dv-cinder-852009-8-iscsi devstack@n-api.service[120740]: [pid: 120740|app: 0|req: 96/184] 10.222.0.43 () {58 vars in 1236 bytes} [Tue Sep 13 18:03:19 2022] GET /compute/v2.1/servers/8cd29851-35c1-4032-a137-ab9419a2ec5b => generated 1522 bytes in 604 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 13 18:03:21.585543 dv-cinder-852009-8-iscsi devstack@n-api.service[120741]: DEBUG nova.api.openstack.wsgi [None req-c91d928d-dd50-4c3b-8ac6-d6dbec529ec6 tempest-ServerRescueNegativeTestJSON-412251590 tempest-ServerRescueNegativeTestJSON-412251590-project] Calling method '>' {{(pid=120741) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 18:03:21.586250 dv-cinder-852009-8-iscsi devstack@n-api.service[120741]: DEBUG nova.compute.api [None req-c91d928d-dd50-4c3b-8ac6-d6dbec529ec6 tempest-ServerRescueNegativeTestJSON-412251590 tempest-ServerRescueNegativeTestJSON-412251590-project] [instance: 8cd29851-35c1-4032-a137-ab9419a2ec5b] Fetching instance by UUID {{(pid=120741) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 18:03:21.594603 dv-cinder-852009-8-iscsi devstack@n-api.service[120741]: DEBUG oslo_concurrency.lockutils [None req-c91d928d-dd50-4c3b-8ac6-d6dbec529ec6 tempest-ServerRescueNegativeTestJSON-412251590 tempest-ServerRescueNegativeTestJSON-412251590-project] Acquiring lock "1daf4f4c-0e4a-4779-b53a-78c48397ea2f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120741) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 18:03:21.595155 dv-cinder-852009-8-iscsi devstack@n-api.service[120741]: DEBUG oslo_concurrency.lockutils [None req-c91d928d-dd50-4c3b-8ac6-d6dbec529ec6 tempest-ServerRescueNegativeTestJSON-412251590 tempest-ServerRescueNegativeTestJSON-412251590-project] Lock "1daf4f4c-0e4a-4779-b53a-78c48397ea2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120741) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 18:03:21.595644 dv-cinder-852009-8-iscsi devstack@n-api.service[120741]: DEBUG oslo_concurrency.lockutils [None req-c91d928d-dd50-4c3b-8ac6-d6dbec529ec6 tempest-ServerRescueNegativeTestJSON-412251590 tempest-ServerRescueNegativeTestJSON-412251590-project] Lock "1daf4f4c-0e4a-4779-b53a-78c48397ea2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120741) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 18:03:21.596547 dv-cinder-852009-8-iscsi devstack@n-api.service[120741]: DEBUG oslo_concurrency.lockutils [None req-c91d928d-dd50-4c3b-8ac6-d6dbec529ec6 tempest-ServerRescueNegativeTestJSON-412251590 tempest-ServerRescueNegativeTestJSON-412251590-project] Acquiring lock "1daf4f4c-0e4a-4779-b53a-78c48397ea2f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120741) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 18:03:21.597086 dv-cinder-852009-8-iscsi devstack@n-api.service[120741]: DEBUG oslo_concurrency.lockutils [None req-c91d928d-dd50-4c3b-8ac6-d6dbec529ec6 tempest-ServerRescueNegativeTestJSON-412251590 tempest-ServerRescueNegativeTestJSON-412251590-project] Lock "1daf4f4c-0e4a-4779-b53a-78c48397ea2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120741) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 18:03:21.597640 dv-cinder-852009-8-iscsi devstack@n-api.service[120741]: DEBUG oslo_concurrency.lockutils [None req-c91d928d-dd50-4c3b-8ac6-d6dbec529ec6 tempest-ServerRescueNegativeTestJSON-412251590 tempest-ServerRescueNegativeTestJSON-412251590-project] Lock "1daf4f4c-0e4a-4779-b53a-78c48397ea2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120741) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 18:03:21.868818 dv-cinder-852009-8-iscsi devstack@n-api.service[120741]: DEBUG nova.policy [None req-c91d928d-dd50-4c3b-8ac6-d6dbec529ec6 tempest-ServerRescueNegativeTestJSON-412251590 tempest-ServerRescueNegativeTestJSON-412251590-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '60800cf2774e409d9c1b6f4992669991', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2eae4acecf6c4961830ead78d71b2ad3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120741) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 18:03:21.879981 dv-cinder-852009-8-iscsi devstack@n-api.service[120741]: INFO nova.api.openstack.requestlog [None req-c91d928d-dd50-4c3b-8ac6-d6dbec529ec6 tempest-ServerRescueNegativeTestJSON-412251590 tempest-ServerRescueNegativeTestJSON-412251590-project] 10.222.0.43 "GET /compute/v2.1/servers/8cd29851-35c1-4032-a137-ab9419a2ec5b" status: 200 len: 1502 microversion: 2.1 time: 0.299856 Sep 13 18:03:21.880596 dv-cinder-852009-8-iscsi devstack@n-api.service[120741]: [pid: 120741|app: 0|req: 89/185] 10.222.0.43 () {58 vars in 1236 bytes} [Tue Sep 13 18:03:21 2022] GET /compute/v2.1/servers/8cd29851-35c1-4032-a137-ab9419a2ec5b => generated 1502 bytes in 302 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 13 18:03:21.909971 dv-cinder-852009-8-iscsi devstack@n-api.service[120740]: DEBUG nova.api.openstack.wsgi [None req-4cfc6dbc-cf97-441d-b221-4d592f189ca2 tempest-ServerRescueNegativeTestJSON-412251590 tempest-ServerRescueNegativeTestJSON-412251590-project] Calling method '>' {{(pid=120740) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 18:03:21.912054 dv-cinder-852009-8-iscsi devstack@n-api.service[120740]: DEBUG nova.compute.api [None req-4cfc6dbc-cf97-441d-b221-4d592f189ca2 tempest-ServerRescueNegativeTestJSON-412251590 tempest-ServerRescueNegativeTestJSON-412251590-project] [instance: a9c22f82-a945-4a94-b3c9-fe95265053bd] Fetching instance by UUID {{(pid=120740) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 18:03:21.921376 dv-cinder-852009-8-iscsi devstack@n-api.service[120740]: DEBUG dbcounter [-] [120740] Writing DB stats nova_api:SELECT=46 {{(pid=120740) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 18:03:21.924219 dv-cinder-852009-8-iscsi devstack@n-api.service[120740]: DEBUG oslo_concurrency.lockutils [None req-4cfc6dbc-cf97-441d-b221-4d592f189ca2 tempest-ServerRescueNegativeTestJSON-412251590 tempest-ServerRescueNegativeTestJSON-412251590-project] Acquiring lock "1daf4f4c-0e4a-4779-b53a-78c48397ea2f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120740) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 18:03:21.925809 dv-cinder-852009-8-iscsi devstack@n-api.service[120740]: DEBUG oslo_concurrency.lockutils [None req-4cfc6dbc-cf97-441d-b221-4d592f189ca2 tempest-ServerRescueNegativeTestJSON-412251590 tempest-ServerRescueNegativeTestJSON-412251590-project] Lock "1daf4f4c-0e4a-4779-b53a-78c48397ea2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120740) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 18:03:21.926992 dv-cinder-852009-8-iscsi devstack@n-api.service[120740]: DEBUG oslo_concurrency.lockutils [None req-4cfc6dbc-cf97-441d-b221-4d592f189ca2 tempest-ServerRescueNegativeTestJSON-412251590 tempest-ServerRescueNegativeTestJSON-412251590-project] Lock "1daf4f4c-0e4a-4779-b53a-78c48397ea2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120740) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 18:03:21.928221 dv-cinder-852009-8-iscsi devstack@n-api.service[120740]: DEBUG oslo_concurrency.lockutils [None req-4cfc6dbc-cf97-441d-b221-4d592f189ca2 tempest-ServerRescueNegativeTestJSON-412251590 tempest-ServerRescueNegativeTestJSON-412251590-project] Acquiring lock "1daf4f4c-0e4a-4779-b53a-78c48397ea2f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120740) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 18:03:21.928964 dv-cinder-852009-8-iscsi devstack@n-api.service[120740]: DEBUG oslo_concurrency.lockutils [None req-4cfc6dbc-cf97-441d-b221-4d592f189ca2 tempest-ServerRescueNegativeTestJSON-412251590 tempest-ServerRescueNegativeTestJSON-412251590-project] Lock "1daf4f4c-0e4a-4779-b53a-78c48397ea2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120740) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 18:03:21.929584 dv-cinder-852009-8-iscsi devstack@n-api.service[120740]: DEBUG oslo_concurrency.lockutils [None req-4cfc6dbc-cf97-441d-b221-4d592f189ca2 tempest-ServerRescueNegativeTestJSON-412251590 tempest-ServerRescueNegativeTestJSON-412251590-project] Lock "1daf4f4c-0e4a-4779-b53a-78c48397ea2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120740) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 18:03:22.411221 dv-cinder-852009-8-iscsi devstack@n-api.service[120741]: DEBUG nova.api.openstack.wsgi [None req-8cb35319-fa55-432d-9840-8dd4ad9e2012 tempest-VolumesSnapshotsTestJSON-299457566 tempest-VolumesSnapshotsTestJSON-299457566-project] Action: 'create', calling method: .version_select at 0x7fa626d333a0>, body: {"volume": {"size": 1, "display_name": "tempest-VolumesSnapshotsTestJSON-volume-971945815"}} {{(pid=120741) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 13 18:03:22.476576 dv-cinder-852009-8-iscsi devstack@n-api.service[120740]: DEBUG nova.policy [None req-4cfc6dbc-cf97-441d-b221-4d592f189ca2 tempest-ServerRescueNegativeTestJSON-412251590 tempest-ServerRescueNegativeTestJSON-412251590-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '60800cf2774e409d9c1b6f4992669991', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2eae4acecf6c4961830ead78d71b2ad3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120740) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 18:03:22.499018 dv-cinder-852009-8-iscsi devstack@n-api.service[120740]: INFO nova.api.openstack.requestlog [None req-4cfc6dbc-cf97-441d-b221-4d592f189ca2 tempest-ServerRescueNegativeTestJSON-412251590 tempest-ServerRescueNegativeTestJSON-412251590-project] 10.222.0.43 "GET /compute/v2.1/servers/a9c22f82-a945-4a94-b3c9-fe95265053bd" status: 200 len: 1517 microversion: 2.1 time: 0.584907 Sep 13 18:03:22.499018 dv-cinder-852009-8-iscsi devstack@n-api.service[120740]: [pid: 120740|app: 0|req: 97/186] 10.222.0.43 () {58 vars in 1236 bytes} [Tue Sep 13 18:03:21 2022] GET /compute/v2.1/servers/a9c22f82-a945-4a94-b3c9-fe95265053bd => generated 1517 bytes in 586 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 13 18:03:22.979444 dv-cinder-852009-8-iscsi devstack@n-api.service[120741]: INFO nova.api.openstack.requestlog [None req-8cb35319-fa55-432d-9840-8dd4ad9e2012 tempest-VolumesSnapshotsTestJSON-299457566 tempest-VolumesSnapshotsTestJSON-299457566-project] 10.222.0.43 "POST /compute/v2.1/os-volumes" status: 200 len: 344 microversion: 2.1 time: 0.772243 Sep 13 18:03:22.981301 dv-cinder-852009-8-iscsi devstack@n-api.service[120741]: [pid: 120741|app: 0|req: 90/187] 10.222.0.43 () {60 vars in 1155 bytes} [Tue Sep 13 18:03:22 2022] POST /compute/v2.1/os-volumes => generated 344 bytes in 775 msecs (HTTP/1.1 200) 10 headers in 448 bytes (2 switches on core 0) Sep 13 18:03:23.003371 dv-cinder-852009-8-iscsi devstack@n-api.service[120740]: DEBUG nova.api.openstack.wsgi [None req-91380166-0022-4e38-b3fc-72805c3cac6b tempest-VolumesSnapshotsTestJSON-299457566 tempest-VolumesSnapshotsTestJSON-299457566-project] Calling method '.version_select at 0x7fa626dfbca0>' {{(pid=120740) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 18:03:23.149354 dv-cinder-852009-8-iscsi devstack@n-api.service[120740]: INFO nova.api.openstack.requestlog [None req-91380166-0022-4e38-b3fc-72805c3cac6b tempest-VolumesSnapshotsTestJSON-299457566 tempest-VolumesSnapshotsTestJSON-299457566-project] 10.222.0.43 "GET /compute/v2.1/os-volumes/e165ea51-6ca4-4f26-bcb2-46dcccc4b432" status: 200 len: 344 microversion: 2.1 time: 0.157535 Sep 13 18:03:23.150014 dv-cinder-852009-8-iscsi devstack@n-api.service[120740]: [pid: 120740|app: 0|req: 98/188] 10.222.0.43 () {58 vars in 1245 bytes} [Tue Sep 13 18:03:22 2022] GET /compute/v2.1/os-volumes/e165ea51-6ca4-4f26-bcb2-46dcccc4b432 => generated 344 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 13 18:03:24.146229 dv-cinder-852009-8-iscsi devstack@n-api.service[120741]: DEBUG nova.api.openstack.wsgi [None req-a7180885-f171-4c09-a9b8-a8d50a36d060 tempest-ServerRescueNegativeTestJSON-412251590 tempest-ServerRescueNegativeTestJSON-412251590-project] Action: 'action', calling method: >, body: {"rescue": {"adminPass": "***"}} {{(pid=120741) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 13 18:03:24.148513 dv-cinder-852009-8-iscsi devstack@n-api.service[120741]: DEBUG nova.compute.api [None req-a7180885-f171-4c09-a9b8-a8d50a36d060 tempest-ServerRescueNegativeTestJSON-412251590 tempest-ServerRescueNegativeTestJSON-412251590-project] [instance: a9c22f82-a945-4a94-b3c9-fe95265053bd] Fetching instance by UUID {{(pid=120741) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 18:03:24.155692 dv-cinder-852009-8-iscsi devstack@n-api.service[120741]: DEBUG oslo_concurrency.lockutils [None req-a7180885-f171-4c09-a9b8-a8d50a36d060 tempest-ServerRescueNegativeTestJSON-412251590 tempest-ServerRescueNegativeTestJSON-412251590-project] Acquiring lock "1daf4f4c-0e4a-4779-b53a-78c48397ea2f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120741) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 18:03:24.156244 dv-cinder-852009-8-iscsi devstack@n-api.service[120741]: DEBUG oslo_concurrency.lockutils [None req-a7180885-f171-4c09-a9b8-a8d50a36d060 tempest-ServerRescueNegativeTestJSON-412251590 tempest-ServerRescueNegativeTestJSON-412251590-project] Lock "1daf4f4c-0e4a-4779-b53a-78c48397ea2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120741) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 18:03:24.156861 dv-cinder-852009-8-iscsi devstack@n-api.service[120741]: DEBUG oslo_concurrency.lockutils [None req-a7180885-f171-4c09-a9b8-a8d50a36d060 tempest-ServerRescueNegativeTestJSON-412251590 tempest-ServerRescueNegativeTestJSON-412251590-project] Lock "1daf4f4c-0e4a-4779-b53a-78c48397ea2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120741) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 18:03:24.157617 dv-cinder-852009-8-iscsi devstack@n-api.service[120741]: DEBUG oslo_concurrency.lockutils [None req-a7180885-f171-4c09-a9b8-a8d50a36d060 tempest-ServerRescueNegativeTestJSON-412251590 tempest-ServerRescueNegativeTestJSON-412251590-project] Acquiring lock "1daf4f4c-0e4a-4779-b53a-78c48397ea2f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120741) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 18:03:24.164000 dv-cinder-852009-8-iscsi devstack@n-api.service[120740]: DEBUG nova.api.openstack.wsgi [None req-c56ac689-20e8-4c10-b0d2-45525b020e9b tempest-VolumesSnapshotsTestJSON-299457566 tempest-VolumesSnapshotsTestJSON-299457566-project] Calling method '.version_select at 0x7fa626d659d0>' {{(pid=120740) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 18:03:24.171456 dv-cinder-852009-8-iscsi devstack@n-api.service[120741]: DEBUG oslo_concurrency.lockutils [None req-a7180885-f171-4c09-a9b8-a8d50a36d060 tempest-ServerRescueNegativeTestJSON-412251590 tempest-ServerRescueNegativeTestJSON-412251590-project] Lock "1daf4f4c-0e4a-4779-b53a-78c48397ea2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120741) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 18:03:24.172263 dv-cinder-852009-8-iscsi devstack@n-api.service[120741]: DEBUG oslo_concurrency.lockutils [None req-a7180885-f171-4c09-a9b8-a8d50a36d060 tempest-ServerRescueNegativeTestJSON-412251590 tempest-ServerRescueNegativeTestJSON-412251590-project] Lock "1daf4f4c-0e4a-4779-b53a-78c48397ea2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.014s {{(pid=120741) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 18:03:24.210843 dv-cinder-852009-8-iscsi devstack@n-api.service[120741]: DEBUG nova.objects.instance [None req-a7180885-f171-4c09-a9b8-a8d50a36d060 tempest-ServerRescueNegativeTestJSON-412251590 tempest-ServerRescueNegativeTestJSON-412251590-project] Lazy-loading 'flavor' on Instance uuid a9c22f82-a945-4a94-b3c9-fe95265053bd {{(pid=120741) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Sep 13 18:03:24.236577 dv-cinder-852009-8-iscsi devstack@n-api.service[120740]: INFO nova.api.openstack.requestlog [None req-c56ac689-20e8-4c10-b0d2-45525b020e9b tempest-VolumesSnapshotsTestJSON-299457566 tempest-VolumesSnapshotsTestJSON-299457566-project] 10.222.0.43 "GET /compute/v2.1/os-volumes/e165ea51-6ca4-4f26-bcb2-46dcccc4b432" status: 200 len: 345 microversion: 2.1 time: 0.076748 Sep 13 18:03:24.238280 dv-cinder-852009-8-iscsi devstack@n-api.service[120740]: [pid: 120740|app: 0|req: 99/189] 10.222.0.43 () {58 vars in 1245 bytes} [Tue Sep 13 18:03:24 2022] GET /compute/v2.1/os-volumes/e165ea51-6ca4-4f26-bcb2-46dcccc4b432 => generated 345 bytes in 79 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 13 18:03:24.254330 dv-cinder-852009-8-iscsi devstack@n-api.service[120740]: DEBUG nova.api.openstack.wsgi [None req-970cf8e3-0760-450d-a1c7-0a5f0620e201 tempest-VolumesSnapshotsTestJSON-299457566 tempest-VolumesSnapshotsTestJSON-299457566-project] Action: 'create', calling method: .version_select at 0x7fa626d73040>, body: {"snapshot": {"volume_id": "e165ea51-6ca4-4f26-bcb2-46dcccc4b432", "display_name": "tempest-VolumesSnapshotsTestJSON-Snapshot-718131629"}} {{(pid=120740) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 13 18:03:24.298874 dv-cinder-852009-8-iscsi devstack@n-api.service[120741]: DEBUG dbcounter [-] [120741] Writing DB stats nova_cell1:UPDATE=2,nova_cell1:SELECT=97,nova_cell1:INSERT=1 {{(pid=120741) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 18:03:24.371190 dv-cinder-852009-8-iscsi devstack@n-api.service[120741]: INFO nova.api.openstack.requestlog [None req-a7180885-f171-4c09-a9b8-a8d50a36d060 tempest-ServerRescueNegativeTestJSON-412251590 tempest-ServerRescueNegativeTestJSON-412251590-project] 10.222.0.43 "POST /compute/v2.1/servers/a9c22f82-a945-4a94-b3c9-fe95265053bd/action" status: 200 len: 32 microversion: 2.1 time: 0.229373 Sep 13 18:03:24.372236 dv-cinder-852009-8-iscsi devstack@n-api.service[120741]: [pid: 120741|app: 0|req: 91/190] 10.222.0.43 () {60 vars in 1278 bytes} [Tue Sep 13 18:03:24 2022] POST /compute/v2.1/servers/a9c22f82-a945-4a94-b3c9-fe95265053bd/action => generated 32 bytes in 232 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Sep 13 18:03:24.404829 dv-cinder-852009-8-iscsi devstack@n-api.service[120741]: DEBUG nova.api.openstack.wsgi [None req-888c90ac-aa80-499d-9715-b0106f6402a4 tempest-ServerRescueNegativeTestJSON-412251590 tempest-ServerRescueNegativeTestJSON-412251590-project] Calling method '>' {{(pid=120741) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 18:03:24.406423 dv-cinder-852009-8-iscsi devstack@n-api.service[120741]: DEBUG nova.compute.api [None req-888c90ac-aa80-499d-9715-b0106f6402a4 tempest-ServerRescueNegativeTestJSON-412251590 tempest-ServerRescueNegativeTestJSON-412251590-project] [instance: a9c22f82-a945-4a94-b3c9-fe95265053bd] Fetching instance by UUID {{(pid=120741) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 18:03:24.447893 dv-cinder-852009-8-iscsi devstack@n-api.service[120741]: DEBUG oslo_concurrency.lockutils [None req-888c90ac-aa80-499d-9715-b0106f6402a4 tempest-ServerRescueNegativeTestJSON-412251590 tempest-ServerRescueNegativeTestJSON-412251590-project] Acquiring lock "1daf4f4c-0e4a-4779-b53a-78c48397ea2f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120741) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 18:03:24.449773 dv-cinder-852009-8-iscsi devstack@n-api.service[120741]: DEBUG oslo_concurrency.lockutils [None req-888c90ac-aa80-499d-9715-b0106f6402a4 tempest-ServerRescueNegativeTestJSON-412251590 tempest-ServerRescueNegativeTestJSON-412251590-project] Lock "1daf4f4c-0e4a-4779-b53a-78c48397ea2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120741) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 18:03:24.450236 dv-cinder-852009-8-iscsi devstack@n-api.service[120741]: DEBUG oslo_concurrency.lockutils [None req-888c90ac-aa80-499d-9715-b0106f6402a4 tempest-ServerRescueNegativeTestJSON-412251590 tempest-ServerRescueNegativeTestJSON-412251590-project] Lock "1daf4f4c-0e4a-4779-b53a-78c48397ea2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120741) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 18:03:24.451716 dv-cinder-852009-8-iscsi devstack@n-api.service[120741]: DEBUG oslo_concurrency.lockutils [None req-888c90ac-aa80-499d-9715-b0106f6402a4 tempest-ServerRescueNegativeTestJSON-412251590 tempest-ServerRescueNegativeTestJSON-412251590-project] Acquiring lock "1daf4f4c-0e4a-4779-b53a-78c48397ea2f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120741) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 18:03:24.454257 dv-cinder-852009-8-iscsi devstack@n-api.service[120741]: DEBUG oslo_concurrency.lockutils [None req-888c90ac-aa80-499d-9715-b0106f6402a4 tempest-ServerRescueNegativeTestJSON-412251590 tempest-ServerRescueNegativeTestJSON-412251590-project] Lock "1daf4f4c-0e4a-4779-b53a-78c48397ea2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120741) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 18:03:24.454704 dv-cinder-852009-8-iscsi devstack@n-api.service[120741]: DEBUG oslo_concurrency.lockutils [None req-888c90ac-aa80-499d-9715-b0106f6402a4 tempest-ServerRescueNegativeTestJSON-412251590 tempest-ServerRescueNegativeTestJSON-412251590-project] Lock "1daf4f4c-0e4a-4779-b53a-78c48397ea2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=120741) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 18:03:24.607344 dv-cinder-852009-8-iscsi devstack@n-api.service[120740]: INFO nova.api.openstack.requestlog [None req-970cf8e3-0760-450d-a1c7-0a5f0620e201 tempest-VolumesSnapshotsTestJSON-299457566 tempest-VolumesSnapshotsTestJSON-299457566-project] 10.222.0.43 "POST /compute/v2.1/os-snapshots" status: 200 len: 286 microversion: 2.1 time: 0.358575 Sep 13 18:03:24.614212 dv-cinder-852009-8-iscsi devstack@n-api.service[120740]: [pid: 120740|app: 0|req: 100/191] 10.222.0.43 () {60 vars in 1162 bytes} [Tue Sep 13 18:03:24 2022] POST /compute/v2.1/os-snapshots => generated 286 bytes in 366 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Sep 13 18:03:24.620981 dv-cinder-852009-8-iscsi devstack@n-api.service[120740]: DEBUG nova.api.openstack.wsgi [None req-a21cc7cb-607d-4a0a-acb1-bdae056c7d27 tempest-VolumesSnapshotsTestJSON-299457566 tempest-VolumesSnapshotsTestJSON-299457566-project] Calling method '.version_select at 0x7fa626d73940>' {{(pid=120740) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 18:03:24.666226 dv-cinder-852009-8-iscsi devstack@n-api.service[120740]: INFO nova.api.openstack.requestlog [None req-a21cc7cb-607d-4a0a-acb1-bdae056c7d27 tempest-VolumesSnapshotsTestJSON-299457566 tempest-VolumesSnapshotsTestJSON-299457566-project] 10.222.0.43 "GET /compute/v2.1/os-snapshots/38c83dd3-4252-4d9a-ba0f-739f8564d221" status: 200 len: 286 microversion: 2.1 time: 0.050533 Sep 13 18:03:24.667514 dv-cinder-852009-8-iscsi devstack@n-api.service[120740]: [pid: 120740|app: 0|req: 101/192] 10.222.0.43 () {58 vars in 1251 bytes} [Tue Sep 13 18:03:24 2022] GET /compute/v2.1/os-snapshots/38c83dd3-4252-4d9a-ba0f-739f8564d221 => generated 286 bytes in 52 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 13 18:03:24.673653 dv-cinder-852009-8-iscsi devstack@n-api.service[120741]: DEBUG nova.policy [None req-888c90ac-aa80-499d-9715-b0106f6402a4 tempest-ServerRescueNegativeTestJSON-412251590 tempest-ServerRescueNegativeTestJSON-412251590-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '60800cf2774e409d9c1b6f4992669991', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2eae4acecf6c4961830ead78d71b2ad3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120741) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 18:03:24.680015 dv-cinder-852009-8-iscsi devstack@n-api.service[120740]: DEBUG nova.api.openstack.wsgi [None req-1c0c9103-40ba-47fb-baee-7c352a6645e5 tempest-VolumesSnapshotsTestJSON-299457566 tempest-VolumesSnapshotsTestJSON-299457566-project] Calling method '.version_select at 0x7fa626d7c040>' {{(pid=120740) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 18:03:24.683761 dv-cinder-852009-8-iscsi devstack@n-api.service[120741]: INFO nova.api.openstack.requestlog [None req-888c90ac-aa80-499d-9715-b0106f6402a4 tempest-ServerRescueNegativeTestJSON-412251590 tempest-ServerRescueNegativeTestJSON-412251590-project] 10.222.0.43 "GET /compute/v2.1/servers/a9c22f82-a945-4a94-b3c9-fe95265053bd" status: 200 len: 1523 microversion: 2.1 time: 0.304571 Sep 13 18:03:24.684284 dv-cinder-852009-8-iscsi devstack@n-api.service[120741]: [pid: 120741|app: 0|req: 92/193] 10.222.0.43 () {58 vars in 1236 bytes} [Tue Sep 13 18:03:24 2022] GET /compute/v2.1/servers/a9c22f82-a945-4a94-b3c9-fe95265053bd => generated 1523 bytes in 306 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 13 18:03:24.717322 dv-cinder-852009-8-iscsi devstack@n-api.service[120740]: INFO nova.api.openstack.requestlog [None req-1c0c9103-40ba-47fb-baee-7c352a6645e5 tempest-VolumesSnapshotsTestJSON-299457566 tempest-VolumesSnapshotsTestJSON-299457566-project] 10.222.0.43 "GET /compute/v2.1/os-snapshots" status: 200 len: 289 microversion: 2.1 time: 0.042302 Sep 13 18:03:24.721090 dv-cinder-852009-8-iscsi devstack@n-api.service[120740]: [pid: 120740|app: 0|req: 102/194] 10.222.0.43 () {58 vars in 1140 bytes} [Tue Sep 13 18:03:24 2022] GET /compute/v2.1/os-snapshots => generated 289 bytes in 47 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 13 18:03:24.736773 dv-cinder-852009-8-iscsi devstack@n-api.service[120741]: DEBUG nova.api.openstack.wsgi [None req-9d1f9b2c-df36-40dc-95a1-acef765accae tempest-VolumesSnapshotsTestJSON-299457566 tempest-VolumesSnapshotsTestJSON-299457566-project] Calling method '.version_select at 0x7fa626f051f0>' {{(pid=120741) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 18:03:24.781457 dv-cinder-852009-8-iscsi devstack@n-api.service[120741]: INFO nova.api.openstack.requestlog [None req-9d1f9b2c-df36-40dc-95a1-acef765accae tempest-VolumesSnapshotsTestJSON-299457566 tempest-VolumesSnapshotsTestJSON-299457566-project] 10.222.0.43 "GET /compute/v2.1/os-snapshots/38c83dd3-4252-4d9a-ba0f-739f8564d221" status: 200 len: 286 microversion: 2.1 time: 0.050640 Sep 13 18:03:24.782356 dv-cinder-852009-8-iscsi devstack@n-api.service[120741]: [pid: 120741|app: 0|req: 93/195] 10.222.0.43 () {58 vars in 1251 bytes} [Tue Sep 13 18:03:24 2022] GET /compute/v2.1/os-snapshots/38c83dd3-4252-4d9a-ba0f-739f8564d221 => generated 286 bytes in 53 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 13 18:03:25.725496 dv-cinder-852009-8-iscsi devstack@n-api.service[120740]: DEBUG nova.api.openstack.wsgi [None req-e24b762f-225e-4b62-9f35-c720d3ca6571 tempest-ServerRescueNegativeTestJSON-412251590 tempest-ServerRescueNegativeTestJSON-412251590-project] Calling method '>' {{(pid=120740) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 18:03:25.726743 dv-cinder-852009-8-iscsi devstack@n-api.service[120740]: DEBUG nova.compute.api [None req-e24b762f-225e-4b62-9f35-c720d3ca6571 tempest-ServerRescueNegativeTestJSON-412251590 tempest-ServerRescueNegativeTestJSON-412251590-project] [instance: a9c22f82-a945-4a94-b3c9-fe95265053bd] Fetching instance by UUID {{(pid=120740) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 18:03:25.741051 dv-cinder-852009-8-iscsi devstack@n-api.service[120740]: DEBUG oslo_concurrency.lockutils [None req-e24b762f-225e-4b62-9f35-c720d3ca6571 tempest-ServerRescueNegativeTestJSON-412251590 tempest-ServerRescueNegativeTestJSON-412251590-project] Acquiring lock "1daf4f4c-0e4a-4779-b53a-78c48397ea2f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120740) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 18:03:25.741799 dv-cinder-852009-8-iscsi devstack@n-api.service[120740]: DEBUG oslo_concurrency.lockutils [None req-e24b762f-225e-4b62-9f35-c720d3ca6571 tempest-ServerRescueNegativeTestJSON-412251590 tempest-ServerRescueNegativeTestJSON-412251590-project] Lock "1daf4f4c-0e4a-4779-b53a-78c48397ea2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120740) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 18:03:25.742455 dv-cinder-852009-8-iscsi devstack@n-api.service[120740]: DEBUG oslo_concurrency.lockutils [None req-e24b762f-225e-4b62-9f35-c720d3ca6571 tempest-ServerRescueNegativeTestJSON-412251590 tempest-ServerRescueNegativeTestJSON-412251590-project] Lock "1daf4f4c-0e4a-4779-b53a-78c48397ea2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120740) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 18:03:25.743461 dv-cinder-852009-8-iscsi devstack@n-api.service[120740]: DEBUG oslo_concurrency.lockutils [None req-e24b762f-225e-4b62-9f35-c720d3ca6571 tempest-ServerRescueNegativeTestJSON-412251590 tempest-ServerRescueNegativeTestJSON-412251590-project] Acquiring lock "1daf4f4c-0e4a-4779-b53a-78c48397ea2f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120740) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 18:03:25.744329 dv-cinder-852009-8-iscsi devstack@n-api.service[120740]: DEBUG oslo_concurrency.lockutils [None req-e24b762f-225e-4b62-9f35-c720d3ca6571 tempest-ServerRescueNegativeTestJSON-412251590 tempest-ServerRescueNegativeTestJSON-412251590-project] Lock "1daf4f4c-0e4a-4779-b53a-78c48397ea2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120740) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 18:03:25.745037 dv-cinder-852009-8-iscsi devstack@n-api.service[120740]: DEBUG oslo_concurrency.lockutils [None req-e24b762f-225e-4b62-9f35-c720d3ca6571 tempest-ServerRescueNegativeTestJSON-412251590 tempest-ServerRescueNegativeTestJSON-412251590-project] Lock "1daf4f4c-0e4a-4779-b53a-78c48397ea2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120740) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 18:03:25.795841 dv-cinder-852009-8-iscsi devstack@n-api.service[120741]: DEBUG nova.api.openstack.wsgi [None req-4f4c67d1-292d-4dcc-bfab-20022b827123 tempest-VolumesSnapshotsTestJSON-299457566 tempest-VolumesSnapshotsTestJSON-299457566-project] Calling method '.version_select at 0x7fa626d33160>' {{(pid=120741) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 18:03:25.829948 dv-cinder-852009-8-iscsi devstack@n-api.service[120741]: INFO nova.api.openstack.requestlog [None req-4f4c67d1-292d-4dcc-bfab-20022b827123 tempest-VolumesSnapshotsTestJSON-299457566 tempest-VolumesSnapshotsTestJSON-299457566-project] 10.222.0.43 "GET /compute/v2.1/os-snapshots/38c83dd3-4252-4d9a-ba0f-739f8564d221" status: 200 len: 286 microversion: 2.1 time: 0.038397 Sep 13 18:03:25.835772 dv-cinder-852009-8-iscsi devstack@n-api.service[120741]: [pid: 120741|app: 0|req: 94/196] 10.222.0.43 () {58 vars in 1251 bytes} [Tue Sep 13 18:03:25 2022] GET /compute/v2.1/os-snapshots/38c83dd3-4252-4d9a-ba0f-739f8564d221 => generated 286 bytes in 40 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 13 18:03:25.956601 dv-cinder-852009-8-iscsi devstack@n-api.service[120740]: DEBUG nova.policy [None req-e24b762f-225e-4b62-9f35-c720d3ca6571 tempest-ServerRescueNegativeTestJSON-412251590 tempest-ServerRescueNegativeTestJSON-412251590-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '60800cf2774e409d9c1b6f4992669991', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2eae4acecf6c4961830ead78d71b2ad3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120740) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 18:03:25.968407 dv-cinder-852009-8-iscsi devstack@n-api.service[120740]: INFO nova.api.openstack.requestlog [None req-e24b762f-225e-4b62-9f35-c720d3ca6571 tempest-ServerRescueNegativeTestJSON-412251590 tempest-ServerRescueNegativeTestJSON-412251590-project] 10.222.0.43 "GET /compute/v2.1/servers/a9c22f82-a945-4a94-b3c9-fe95265053bd" status: 200 len: 1523 microversion: 2.1 time: 0.249926 Sep 13 18:03:25.982095 dv-cinder-852009-8-iscsi devstack@n-api.service[120740]: [pid: 120740|app: 0|req: 103/197] 10.222.0.43 () {58 vars in 1236 bytes} [Tue Sep 13 18:03:25 2022] GET /compute/v2.1/servers/a9c22f82-a945-4a94-b3c9-fe95265053bd => generated 1523 bytes in 265 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 13 18:03:26.844775 dv-cinder-852009-8-iscsi devstack@n-api.service[120741]: DEBUG nova.api.openstack.wsgi [None req-1a595cc4-2b48-4f2f-8c56-95d0d6939858 tempest-VolumesSnapshotsTestJSON-299457566 tempest-VolumesSnapshotsTestJSON-299457566-project] Calling method '.version_select at 0x7fa626d359d0>' {{(pid=120741) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 18:03:26.876004 dv-cinder-852009-8-iscsi devstack@n-api.service[120741]: INFO nova.api.openstack.requestlog [None req-1a595cc4-2b48-4f2f-8c56-95d0d6939858 tempest-VolumesSnapshotsTestJSON-299457566 tempest-VolumesSnapshotsTestJSON-299457566-project] 10.222.0.43 "GET /compute/v2.1/os-snapshots/38c83dd3-4252-4d9a-ba0f-739f8564d221" status: 200 len: 286 microversion: 2.1 time: 0.036841 Sep 13 18:03:26.881806 dv-cinder-852009-8-iscsi devstack@n-api.service[120741]: [pid: 120741|app: 0|req: 95/198] 10.222.0.43 () {58 vars in 1251 bytes} [Tue Sep 13 18:03:26 2022] GET /compute/v2.1/os-snapshots/38c83dd3-4252-4d9a-ba0f-739f8564d221 => generated 286 bytes in 44 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 13 18:03:26.996188 dv-cinder-852009-8-iscsi devstack@n-api.service[120740]: DEBUG nova.api.openstack.wsgi [None req-d46b7054-3487-4f35-ae7a-0183823a326e tempest-ServerRescueNegativeTestJSON-412251590 tempest-ServerRescueNegativeTestJSON-412251590-project] Calling method '>' {{(pid=120740) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 18:03:26.997539 dv-cinder-852009-8-iscsi devstack@n-api.service[120740]: DEBUG nova.compute.api [None req-d46b7054-3487-4f35-ae7a-0183823a326e tempest-ServerRescueNegativeTestJSON-412251590 tempest-ServerRescueNegativeTestJSON-412251590-project] [instance: a9c22f82-a945-4a94-b3c9-fe95265053bd] Fetching instance by UUID {{(pid=120740) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 18:03:27.007359 dv-cinder-852009-8-iscsi devstack@n-api.service[120740]: DEBUG oslo_concurrency.lockutils [None req-d46b7054-3487-4f35-ae7a-0183823a326e tempest-ServerRescueNegativeTestJSON-412251590 tempest-ServerRescueNegativeTestJSON-412251590-project] Acquiring lock "1daf4f4c-0e4a-4779-b53a-78c48397ea2f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120740) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 18:03:27.009396 dv-cinder-852009-8-iscsi devstack@n-api.service[120740]: DEBUG oslo_concurrency.lockutils [None req-d46b7054-3487-4f35-ae7a-0183823a326e tempest-ServerRescueNegativeTestJSON-412251590 tempest-ServerRescueNegativeTestJSON-412251590-project] Lock "1daf4f4c-0e4a-4779-b53a-78c48397ea2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120740) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 18:03:27.010128 dv-cinder-852009-8-iscsi devstack@n-api.service[120740]: DEBUG oslo_concurrency.lockutils [None req-d46b7054-3487-4f35-ae7a-0183823a326e tempest-ServerRescueNegativeTestJSON-412251590 tempest-ServerRescueNegativeTestJSON-412251590-project] Lock "1daf4f4c-0e4a-4779-b53a-78c48397ea2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120740) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 18:03:27.011073 dv-cinder-852009-8-iscsi devstack@n-api.service[120740]: DEBUG oslo_concurrency.lockutils [None req-d46b7054-3487-4f35-ae7a-0183823a326e tempest-ServerRescueNegativeTestJSON-412251590 tempest-ServerRescueNegativeTestJSON-412251590-project] Acquiring lock "1daf4f4c-0e4a-4779-b53a-78c48397ea2f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120740) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 18:03:27.011745 dv-cinder-852009-8-iscsi devstack@n-api.service[120740]: DEBUG oslo_concurrency.lockutils [None req-d46b7054-3487-4f35-ae7a-0183823a326e tempest-ServerRescueNegativeTestJSON-412251590 tempest-ServerRescueNegativeTestJSON-412251590-project] Lock "1daf4f4c-0e4a-4779-b53a-78c48397ea2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120740) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 18:03:27.012439 dv-cinder-852009-8-iscsi devstack@n-api.service[120740]: DEBUG oslo_concurrency.lockutils [None req-d46b7054-3487-4f35-ae7a-0183823a326e tempest-ServerRescueNegativeTestJSON-412251590 tempest-ServerRescueNegativeTestJSON-412251590-project] Lock "1daf4f4c-0e4a-4779-b53a-78c48397ea2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120740) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 18:03:27.183045 dv-cinder-852009-8-iscsi devstack@n-api.service[120740]: DEBUG nova.policy [None req-d46b7054-3487-4f35-ae7a-0183823a326e tempest-ServerRescueNegativeTestJSON-412251590 tempest-ServerRescueNegativeTestJSON-412251590-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '60800cf2774e409d9c1b6f4992669991', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2eae4acecf6c4961830ead78d71b2ad3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120740) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 18:03:27.192591 dv-cinder-852009-8-iscsi devstack@n-api.service[120740]: INFO nova.api.openstack.requestlog [None req-d46b7054-3487-4f35-ae7a-0183823a326e tempest-ServerRescueNegativeTestJSON-412251590 tempest-ServerRescueNegativeTestJSON-412251590-project] 10.222.0.43 "GET /compute/v2.1/servers/a9c22f82-a945-4a94-b3c9-fe95265053bd" status: 200 len: 1523 microversion: 2.1 time: 0.202877 Sep 13 18:03:27.193717 dv-cinder-852009-8-iscsi devstack@n-api.service[120740]: [pid: 120740|app: 0|req: 104/199] 10.222.0.43 () {58 vars in 1236 bytes} [Tue Sep 13 18:03:26 2022] GET /compute/v2.1/servers/a9c22f82-a945-4a94-b3c9-fe95265053bd => generated 1523 bytes in 204 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 13 18:03:27.892471 dv-cinder-852009-8-iscsi devstack@n-api.service[120741]: DEBUG nova.api.openstack.wsgi [None req-0e6ba513-af18-45bc-af7d-87e605002294 tempest-VolumesSnapshotsTestJSON-299457566 tempest-VolumesSnapshotsTestJSON-299457566-project] Calling method '.version_select at 0x7fa626ef1b80>' {{(pid=120741) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 18:03:27.938474 dv-cinder-852009-8-iscsi devstack@n-api.service[120741]: INFO nova.api.openstack.requestlog [None req-0e6ba513-af18-45bc-af7d-87e605002294 tempest-VolumesSnapshotsTestJSON-299457566 tempest-VolumesSnapshotsTestJSON-299457566-project] 10.222.0.43 "GET /compute/v2.1/os-snapshots/38c83dd3-4252-4d9a-ba0f-739f8564d221" status: 200 len: 286 microversion: 2.1 time: 0.051249 Sep 13 18:03:27.939424 dv-cinder-852009-8-iscsi devstack@n-api.service[120741]: [pid: 120741|app: 0|req: 96/200] 10.222.0.43 () {58 vars in 1251 bytes} [Tue Sep 13 18:03:27 2022] GET /compute/v2.1/os-snapshots/38c83dd3-4252-4d9a-ba0f-739f8564d221 => generated 286 bytes in 55 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 13 18:03:28.225918 dv-cinder-852009-8-iscsi devstack@n-api.service[120740]: DEBUG nova.api.openstack.wsgi [None req-e90f7e64-e77e-40e2-a8e0-f38c6a1ad129 tempest-ServerRescueNegativeTestJSON-412251590 tempest-ServerRescueNegativeTestJSON-412251590-project] Calling method '>' {{(pid=120740) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 18:03:28.226524 dv-cinder-852009-8-iscsi devstack@n-api.service[120740]: DEBUG nova.compute.api [None req-e90f7e64-e77e-40e2-a8e0-f38c6a1ad129 tempest-ServerRescueNegativeTestJSON-412251590 tempest-ServerRescueNegativeTestJSON-412251590-project] [instance: a9c22f82-a945-4a94-b3c9-fe95265053bd] Fetching instance by UUID {{(pid=120740) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 18:03:28.235215 dv-cinder-852009-8-iscsi devstack@n-api.service[120740]: DEBUG oslo_concurrency.lockutils [None req-e90f7e64-e77e-40e2-a8e0-f38c6a1ad129 tempest-ServerRescueNegativeTestJSON-412251590 tempest-ServerRescueNegativeTestJSON-412251590-project] Acquiring lock "1daf4f4c-0e4a-4779-b53a-78c48397ea2f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120740) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 18:03:28.236305 dv-cinder-852009-8-iscsi devstack@n-api.service[120740]: DEBUG oslo_concurrency.lockutils [None req-e90f7e64-e77e-40e2-a8e0-f38c6a1ad129 tempest-ServerRescueNegativeTestJSON-412251590 tempest-ServerRescueNegativeTestJSON-412251590-project] Lock "1daf4f4c-0e4a-4779-b53a-78c48397ea2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120740) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 18:03:28.236769 dv-cinder-852009-8-iscsi devstack@n-api.service[120740]: DEBUG oslo_concurrency.lockutils [None req-e90f7e64-e77e-40e2-a8e0-f38c6a1ad129 tempest-ServerRescueNegativeTestJSON-412251590 tempest-ServerRescueNegativeTestJSON-412251590-project] Lock "1daf4f4c-0e4a-4779-b53a-78c48397ea2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120740) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 18:03:28.237682 dv-cinder-852009-8-iscsi devstack@n-api.service[120740]: DEBUG oslo_concurrency.lockutils [None req-e90f7e64-e77e-40e2-a8e0-f38c6a1ad129 tempest-ServerRescueNegativeTestJSON-412251590 tempest-ServerRescueNegativeTestJSON-412251590-project] Acquiring lock "1daf4f4c-0e4a-4779-b53a-78c48397ea2f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120740) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 18:03:28.238530 dv-cinder-852009-8-iscsi devstack@n-api.service[120740]: DEBUG oslo_concurrency.lockutils [None req-e90f7e64-e77e-40e2-a8e0-f38c6a1ad129 tempest-ServerRescueNegativeTestJSON-412251590 tempest-ServerRescueNegativeTestJSON-412251590-project] Lock "1daf4f4c-0e4a-4779-b53a-78c48397ea2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120740) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 18:03:28.239183 dv-cinder-852009-8-iscsi devstack@n-api.service[120740]: DEBUG oslo_concurrency.lockutils [None req-e90f7e64-e77e-40e2-a8e0-f38c6a1ad129 tempest-ServerRescueNegativeTestJSON-412251590 tempest-ServerRescueNegativeTestJSON-412251590-project] Lock "1daf4f4c-0e4a-4779-b53a-78c48397ea2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120740) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 18:03:28.495789 dv-cinder-852009-8-iscsi devstack@n-api.service[120740]: DEBUG nova.policy [None req-e90f7e64-e77e-40e2-a8e0-f38c6a1ad129 tempest-ServerRescueNegativeTestJSON-412251590 tempest-ServerRescueNegativeTestJSON-412251590-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '60800cf2774e409d9c1b6f4992669991', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2eae4acecf6c4961830ead78d71b2ad3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120740) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 18:03:28.505807 dv-cinder-852009-8-iscsi devstack@n-api.service[120740]: INFO nova.api.openstack.requestlog [None req-e90f7e64-e77e-40e2-a8e0-f38c6a1ad129 tempest-ServerRescueNegativeTestJSON-412251590 tempest-ServerRescueNegativeTestJSON-412251590-project] 10.222.0.43 "GET /compute/v2.1/servers/a9c22f82-a945-4a94-b3c9-fe95265053bd" status: 200 len: 1523 microversion: 2.1 time: 0.294419 Sep 13 18:03:28.526031 dv-cinder-852009-8-iscsi devstack@n-api.service[120740]: [pid: 120740|app: 0|req: 105/201] 10.222.0.43 () {58 vars in 1236 bytes} [Tue Sep 13 18:03:28 2022] GET /compute/v2.1/servers/a9c22f82-a945-4a94-b3c9-fe95265053bd => generated 1523 bytes in 313 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 13 18:03:28.952962 dv-cinder-852009-8-iscsi devstack@n-api.service[120741]: DEBUG nova.api.openstack.wsgi [None req-8a7f9ae5-cec2-41a3-a0ee-4dac4a243317 tempest-VolumesSnapshotsTestJSON-299457566 tempest-VolumesSnapshotsTestJSON-299457566-project] Calling method '.version_select at 0x7fa626ead550>' {{(pid=120741) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 18:03:29.005215 dv-cinder-852009-8-iscsi devstack@n-api.service[120741]: INFO nova.api.openstack.requestlog [None req-8a7f9ae5-cec2-41a3-a0ee-4dac4a243317 tempest-VolumesSnapshotsTestJSON-299457566 tempest-VolumesSnapshotsTestJSON-299457566-project] 10.222.0.43 "GET /compute/v2.1/os-snapshots/38c83dd3-4252-4d9a-ba0f-739f8564d221" status: 200 len: 287 microversion: 2.1 time: 0.056967 Sep 13 18:03:29.006397 dv-cinder-852009-8-iscsi devstack@n-api.service[120741]: [pid: 120741|app: 0|req: 97/202] 10.222.0.43 () {58 vars in 1251 bytes} [Tue Sep 13 18:03:28 2022] GET /compute/v2.1/os-snapshots/38c83dd3-4252-4d9a-ba0f-739f8564d221 => generated 287 bytes in 59 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 13 18:03:29.022886 dv-cinder-852009-8-iscsi devstack@n-api.service[120740]: DEBUG nova.api.openstack.wsgi [None req-562fdb6b-e105-4d14-b6fa-03785f285b32 tempest-VolumesSnapshotsTestJSON-299457566 tempest-VolumesSnapshotsTestJSON-299457566-project] Calling method '.version_select at 0x7fa626d65af0>' {{(pid=120740) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 18:03:29.104059 dv-cinder-852009-8-iscsi devstack@n-api.service[120740]: INFO nova.api.openstack.requestlog [None req-562fdb6b-e105-4d14-b6fa-03785f285b32 tempest-VolumesSnapshotsTestJSON-299457566 tempest-VolumesSnapshotsTestJSON-299457566-project] 10.222.0.43 "DELETE /compute/v2.1/os-snapshots/38c83dd3-4252-4d9a-ba0f-739f8564d221" status: 202 len: 0 microversion: 2.1 time: 0.085947 Sep 13 18:03:29.105366 dv-cinder-852009-8-iscsi devstack@n-api.service[120740]: [pid: 120740|app: 0|req: 106/203] 10.222.0.43 () {58 vars in 1254 bytes} [Tue Sep 13 18:03:29 2022] DELETE /compute/v2.1/os-snapshots/38c83dd3-4252-4d9a-ba0f-739f8564d221 => generated 0 bytes in 88 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Sep 13 18:03:29.113303 dv-cinder-852009-8-iscsi devstack@n-api.service[120741]: DEBUG nova.api.openstack.wsgi [None req-1acf2378-aa2e-4ad7-8b0f-d008b1e36ed3 tempest-VolumesSnapshotsTestJSON-299457566 tempest-VolumesSnapshotsTestJSON-299457566-project] Calling method '.version_select at 0x7fa626d35f70>' {{(pid=120741) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 18:03:29.149311 dv-cinder-852009-8-iscsi devstack@n-api.service[120741]: INFO nova.api.openstack.requestlog [None req-1acf2378-aa2e-4ad7-8b0f-d008b1e36ed3 tempest-VolumesSnapshotsTestJSON-299457566 tempest-VolumesSnapshotsTestJSON-299457566-project] 10.222.0.43 "GET /compute/v2.1/os-snapshots/38c83dd3-4252-4d9a-ba0f-739f8564d221" status: 200 len: 286 microversion: 2.1 time: 0.039752 Sep 13 18:03:29.149893 dv-cinder-852009-8-iscsi devstack@n-api.service[120741]: [pid: 120741|app: 0|req: 98/204] 10.222.0.43 () {58 vars in 1251 bytes} [Tue Sep 13 18:03:29 2022] GET /compute/v2.1/os-snapshots/38c83dd3-4252-4d9a-ba0f-739f8564d221 => generated 286 bytes in 41 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 13 18:03:29.537874 dv-cinder-852009-8-iscsi devstack@n-api.service[120740]: DEBUG nova.api.openstack.wsgi [None req-e6d30c51-c96b-4ca9-a15c-dd7235070fd9 tempest-ServerRescueNegativeTestJSON-412251590 tempest-ServerRescueNegativeTestJSON-412251590-project] Calling method '>' {{(pid=120740) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 18:03:29.552786 dv-cinder-852009-8-iscsi devstack@n-api.service[120740]: DEBUG nova.compute.api [None req-e6d30c51-c96b-4ca9-a15c-dd7235070fd9 tempest-ServerRescueNegativeTestJSON-412251590 tempest-ServerRescueNegativeTestJSON-412251590-project] [instance: a9c22f82-a945-4a94-b3c9-fe95265053bd] Fetching instance by UUID {{(pid=120740) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 18:03:29.562656 dv-cinder-852009-8-iscsi devstack@n-api.service[120740]: DEBUG oslo_concurrency.lockutils [None req-e6d30c51-c96b-4ca9-a15c-dd7235070fd9 tempest-ServerRescueNegativeTestJSON-412251590 tempest-ServerRescueNegativeTestJSON-412251590-project] Acquiring lock "1daf4f4c-0e4a-4779-b53a-78c48397ea2f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120740) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 18:03:29.563416 dv-cinder-852009-8-iscsi devstack@n-api.service[120740]: DEBUG oslo_concurrency.lockutils [None req-e6d30c51-c96b-4ca9-a15c-dd7235070fd9 tempest-ServerRescueNegativeTestJSON-412251590 tempest-ServerRescueNegativeTestJSON-412251590-project] Lock "1daf4f4c-0e4a-4779-b53a-78c48397ea2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120740) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 18:03:29.564016 dv-cinder-852009-8-iscsi devstack@n-api.service[120740]: DEBUG oslo_concurrency.lockutils [None req-e6d30c51-c96b-4ca9-a15c-dd7235070fd9 tempest-ServerRescueNegativeTestJSON-412251590 tempest-ServerRescueNegativeTestJSON-412251590-project] Lock "1daf4f4c-0e4a-4779-b53a-78c48397ea2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120740) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 18:03:29.565290 dv-cinder-852009-8-iscsi devstack@n-api.service[120740]: DEBUG oslo_concurrency.lockutils [None req-e6d30c51-c96b-4ca9-a15c-dd7235070fd9 tempest-ServerRescueNegativeTestJSON-412251590 tempest-ServerRescueNegativeTestJSON-412251590-project] Acquiring lock "1daf4f4c-0e4a-4779-b53a-78c48397ea2f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120740) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 18:03:29.566039 dv-cinder-852009-8-iscsi devstack@n-api.service[120740]: DEBUG oslo_concurrency.lockutils [None req-e6d30c51-c96b-4ca9-a15c-dd7235070fd9 tempest-ServerRescueNegativeTestJSON-412251590 tempest-ServerRescueNegativeTestJSON-412251590-project] Lock "1daf4f4c-0e4a-4779-b53a-78c48397ea2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120740) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 18:03:29.566807 dv-cinder-852009-8-iscsi devstack@n-api.service[120740]: DEBUG oslo_concurrency.lockutils [None req-e6d30c51-c96b-4ca9-a15c-dd7235070fd9 tempest-ServerRescueNegativeTestJSON-412251590 tempest-ServerRescueNegativeTestJSON-412251590-project] Lock "1daf4f4c-0e4a-4779-b53a-78c48397ea2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120740) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 18:03:29.781460 dv-cinder-852009-8-iscsi devstack@n-api.service[120740]: DEBUG nova.policy [None req-e6d30c51-c96b-4ca9-a15c-dd7235070fd9 tempest-ServerRescueNegativeTestJSON-412251590 tempest-ServerRescueNegativeTestJSON-412251590-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '60800cf2774e409d9c1b6f4992669991', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2eae4acecf6c4961830ead78d71b2ad3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120740) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 18:03:29.790372 dv-cinder-852009-8-iscsi devstack@n-api.service[120740]: INFO nova.api.openstack.requestlog [None req-e6d30c51-c96b-4ca9-a15c-dd7235070fd9 tempest-ServerRescueNegativeTestJSON-412251590 tempest-ServerRescueNegativeTestJSON-412251590-project] 10.222.0.43 "GET /compute/v2.1/servers/a9c22f82-a945-4a94-b3c9-fe95265053bd" status: 200 len: 1523 microversion: 2.1 time: 0.259553 Sep 13 18:03:29.791093 dv-cinder-852009-8-iscsi devstack@n-api.service[120740]: [pid: 120740|app: 0|req: 107/205] 10.222.0.43 () {58 vars in 1236 bytes} [Tue Sep 13 18:03:29 2022] GET /compute/v2.1/servers/a9c22f82-a945-4a94-b3c9-fe95265053bd => generated 1523 bytes in 261 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 13 18:03:30.166206 dv-cinder-852009-8-iscsi devstack@n-api.service[120741]: DEBUG nova.api.openstack.wsgi [None req-34b0f096-d4e7-4c86-8307-b9da9e2c3e50 tempest-VolumesSnapshotsTestJSON-299457566 tempest-VolumesSnapshotsTestJSON-299457566-project] Calling method '.version_select at 0x7fa626ead3a0>' {{(pid=120741) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 18:03:30.325777 dv-cinder-852009-8-iscsi devstack@n-api.service[120741]: INFO nova.api.openstack.wsgi [None req-34b0f096-d4e7-4c86-8307-b9da9e2c3e50 tempest-VolumesSnapshotsTestJSON-299457566 tempest-VolumesSnapshotsTestJSON-299457566-project] HTTP exception thrown: Snapshot 38c83dd3-4252-4d9a-ba0f-739f8564d221 could not be found. Sep 13 18:03:30.329457 dv-cinder-852009-8-iscsi devstack@n-api.service[120741]: DEBUG nova.api.openstack.wsgi [None req-34b0f096-d4e7-4c86-8307-b9da9e2c3e50 tempest-VolumesSnapshotsTestJSON-299457566 tempest-VolumesSnapshotsTestJSON-299457566-project] Request method failure captured: Sep 13 18:03:30.329457 dv-cinder-852009-8-iscsi devstack@n-api.service[120741]: request: GET /compute/v2.1/os-snapshots/38c83dd3-4252-4d9a-ba0f-739f8564d221 HTTP/1.1 Sep 13 18:03:30.329457 dv-cinder-852009-8-iscsi devstack@n-api.service[120741]: Accept: application/json Sep 13 18:03:30.329457 dv-cinder-852009-8-iscsi devstack@n-api.service[120741]: Accept-Encoding: identity Sep 13 18:03:30.329457 dv-cinder-852009-8-iscsi devstack@n-api.service[120741]: Connection: close Sep 13 18:03:30.329457 dv-cinder-852009-8-iscsi devstack@n-api.service[120741]: Content-Length: 0 Sep 13 18:03:30.329457 dv-cinder-852009-8-iscsi devstack@n-api.service[120741]: Content-Type: application/json Sep 13 18:03:30.329457 dv-cinder-852009-8-iscsi devstack@n-api.service[120741]: Host: 10.222.0.43 Sep 13 18:03:30.329457 dv-cinder-852009-8-iscsi devstack@n-api.service[120741]: Openstack-System-Scope: None Sep 13 18:03:30.329457 dv-cinder-852009-8-iscsi devstack@n-api.service[120741]: User-Agent: python-urllib3/1.26.12 Sep 13 18:03:30.329457 dv-cinder-852009-8-iscsi devstack@n-api.service[120741]: X-Auth-Token: gAAAAABjIMXqlKroAwSP-QzhGjwyxIjAEo0IfICx6G8FIr2gTxNQsSLtqOvOj90UNI2FEG-QBjDhnBK3L_L3EjCgVz80EoZrHN8MdXRGpEPQ5HgryNFIo2wFLkAY5JyGAxEHe5jyp03U9Zb0gu4QCIh3TiSaxnvYtgs-mt9NwL77NQSNyv35nFc Sep 13 18:03:30.329457 dv-cinder-852009-8-iscsi devstack@n-api.service[120741]: X-Domain-Id: None Sep 13 18:03:30.329457 dv-cinder-852009-8-iscsi devstack@n-api.service[120741]: X-Domain-Name: None Sep 13 18:03:30.329457 dv-cinder-852009-8-iscsi devstack@n-api.service[120741]: X-Identity-Status: Confirmed Sep 13 18:03:30.329457 dv-cinder-852009-8-iscsi devstack@n-api.service[120741]: X-Is-Admin-Project: True Sep 13 18:03:30.329457 dv-cinder-852009-8-iscsi devstack@n-api.service[120741]: X-Project-Domain-Id: default Sep 13 18:03:30.329457 dv-cinder-852009-8-iscsi devstack@n-api.service[120741]: X-Project-Domain-Name: Default Sep 13 18:03:30.329457 dv-cinder-852009-8-iscsi devstack@n-api.service[120741]: X-Project-Id: d8dea26ee3b04f11a491c5d2fc843350 Sep 13 18:03:30.329457 dv-cinder-852009-8-iscsi devstack@n-api.service[120741]: X-Project-Name: tempest-VolumesSnapshotsTestJSON-299457566 Sep 13 18:03:30.329457 dv-cinder-852009-8-iscsi devstack@n-api.service[120741]: X-Role: reader,member Sep 13 18:03:30.329457 dv-cinder-852009-8-iscsi devstack@n-api.service[120741]: X-Roles: reader,member Sep 13 18:03:30.330708 dv-cinder-852009-8-iscsi devstack@n-api.service[120741]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/identity"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/compute/v2/d8dea26ee3b04f11a491c5d2fc843350"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.43:8080", "publicURL": "http://10.222.0.43:8080/v1/AUTH_d8dea26ee3b04f11a491c5d2fc843350"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43:9696/networking"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/volume/v3/d8dea26ee3b04f11a491c5d2fc843350"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/compute/v2.1"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/placement"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/volume/v3/d8dea26ee3b04f11a491c5d2fc843350"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/image"}]}] Sep 13 18:03:30.330708 dv-cinder-852009-8-iscsi devstack@n-api.service[120741]: X-Tenant: tempest-VolumesSnapshotsTestJSON-299457566 Sep 13 18:03:30.330708 dv-cinder-852009-8-iscsi devstack@n-api.service[120741]: X-Tenant-Id: d8dea26ee3b04f11a491c5d2fc843350 Sep 13 18:03:30.330708 dv-cinder-852009-8-iscsi devstack@n-api.service[120741]: X-Tenant-Name: tempest-VolumesSnapshotsTestJSON-299457566 Sep 13 18:03:30.330708 dv-cinder-852009-8-iscsi devstack@n-api.service[120741]: X-User: tempest-VolumesSnapshotsTestJSON-299457566-project Sep 13 18:03:30.330708 dv-cinder-852009-8-iscsi devstack@n-api.service[120741]: X-User-Domain-Id: default Sep 13 18:03:30.330708 dv-cinder-852009-8-iscsi devstack@n-api.service[120741]: X-User-Domain-Name: Default Sep 13 18:03:30.330708 dv-cinder-852009-8-iscsi devstack@n-api.service[120741]: X-User-Id: b03e7a8ab6c34868af811ade7426e09c Sep 13 18:03:30.330708 dv-cinder-852009-8-iscsi devstack@n-api.service[120741]: X-User-Name: tempest-VolumesSnapshotsTestJSON-299457566-project Sep 13 18:03:30.330708 dv-cinder-852009-8-iscsi devstack@n-api.service[120741]: method: Sep 13 18:03:30.330708 dv-cinder-852009-8-iscsi devstack@n-api.service[120741]: exception: Snapshot 38c83dd3-4252-4d9a-ba0f-739f8564d221 could not be found. Sep 13 18:03:30.330708 dv-cinder-852009-8-iscsi devstack@n-api.service[120741]: action_args: {'id': '38c83dd3-4252-4d9a-ba0f-739f8564d221'} Sep 13 18:03:30.330708 dv-cinder-852009-8-iscsi devstack@n-api.service[120741]: {{(pid=120741) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 13 18:03:30.334909 dv-cinder-852009-8-iscsi devstack@n-api.service[120741]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 13 18:03:30.334909 dv-cinder-852009-8-iscsi devstack@n-api.service[120741]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 464, in wrapper Sep 13 18:03:30.334909 dv-cinder-852009-8-iscsi devstack@n-api.service[120741]: ERROR nova.api.openstack.wsgi res = method(self, ctx, snapshot_id, *args, **kwargs) Sep 13 18:03:30.334909 dv-cinder-852009-8-iscsi devstack@n-api.service[120741]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 701, in get_snapshot Sep 13 18:03:30.334909 dv-cinder-852009-8-iscsi devstack@n-api.service[120741]: ERROR nova.api.openstack.wsgi item = cinderclient(context).volume_snapshots.get(snapshot_id) Sep 13 18:03:30.334909 dv-cinder-852009-8-iscsi devstack@n-api.service[120741]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volume_snapshots.py", line 160, in get Sep 13 18:03:30.334909 dv-cinder-852009-8-iscsi devstack@n-api.service[120741]: ERROR nova.api.openstack.wsgi return self._get("/snapshots/%s" % snapshot_id, "snapshot") Sep 13 18:03:30.334909 dv-cinder-852009-8-iscsi devstack@n-api.service[120741]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/base.py", line 297, in _get Sep 13 18:03:30.334909 dv-cinder-852009-8-iscsi devstack@n-api.service[120741]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.get(url) Sep 13 18:03:30.334909 dv-cinder-852009-8-iscsi devstack@n-api.service[120741]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 224, in get Sep 13 18:03:30.334909 dv-cinder-852009-8-iscsi devstack@n-api.service[120741]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'GET', **kwargs) Sep 13 18:03:30.334909 dv-cinder-852009-8-iscsi devstack@n-api.service[120741]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 215, in _cs_request Sep 13 18:03:30.334909 dv-cinder-852009-8-iscsi devstack@n-api.service[120741]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) Sep 13 18:03:30.334909 dv-cinder-852009-8-iscsi devstack@n-api.service[120741]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 201, in request Sep 13 18:03:30.334909 dv-cinder-852009-8-iscsi devstack@n-api.service[120741]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) Sep 13 18:03:30.334909 dv-cinder-852009-8-iscsi devstack@n-api.service[120741]: ERROR nova.api.openstack.wsgi cinderclient.exceptions.NotFound: Snapshot 38c83dd3-4252-4d9a-ba0f-739f8564d221 could not be found. (HTTP 404) (Request-ID: req-83223de4-5fb4-45ba-8b09-702b118fbaa1) Sep 13 18:03:30.334909 dv-cinder-852009-8-iscsi devstack@n-api.service[120741]: ERROR nova.api.openstack.wsgi Sep 13 18:03:30.334909 dv-cinder-852009-8-iscsi devstack@n-api.service[120741]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 13 18:03:30.336028 dv-cinder-852009-8-iscsi devstack@n-api.service[120741]: ERROR nova.api.openstack.wsgi Sep 13 18:03:30.336028 dv-cinder-852009-8-iscsi devstack@n-api.service[120741]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 13 18:03:30.336028 dv-cinder-852009-8-iscsi devstack@n-api.service[120741]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 617, in show Sep 13 18:03:30.336028 dv-cinder-852009-8-iscsi devstack@n-api.service[120741]: ERROR nova.api.openstack.wsgi vol = self.volume_api.get_snapshot(context, id) Sep 13 18:03:30.336028 dv-cinder-852009-8-iscsi devstack@n-api.service[120741]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 395, in wrapper Sep 13 18:03:30.336028 dv-cinder-852009-8-iscsi devstack@n-api.service[120741]: ERROR nova.api.openstack.wsgi res = method(self, ctx, *args, **kwargs) Sep 13 18:03:30.336028 dv-cinder-852009-8-iscsi devstack@n-api.service[120741]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 466, in wrapper Sep 13 18:03:30.336028 dv-cinder-852009-8-iscsi devstack@n-api.service[120741]: ERROR nova.api.openstack.wsgi _reraise(exception.SnapshotNotFound(snapshot_id=snapshot_id)) Sep 13 18:03:30.336028 dv-cinder-852009-8-iscsi devstack@n-api.service[120741]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 486, in _reraise Sep 13 18:03:30.336028 dv-cinder-852009-8-iscsi devstack@n-api.service[120741]: ERROR nova.api.openstack.wsgi raise desired_exc.with_traceback(sys.exc_info()[2]) Sep 13 18:03:30.336028 dv-cinder-852009-8-iscsi devstack@n-api.service[120741]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 464, in wrapper Sep 13 18:03:30.336028 dv-cinder-852009-8-iscsi devstack@n-api.service[120741]: ERROR nova.api.openstack.wsgi res = method(self, ctx, snapshot_id, *args, **kwargs) Sep 13 18:03:30.336028 dv-cinder-852009-8-iscsi devstack@n-api.service[120741]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 701, in get_snapshot Sep 13 18:03:30.336028 dv-cinder-852009-8-iscsi devstack@n-api.service[120741]: ERROR nova.api.openstack.wsgi item = cinderclient(context).volume_snapshots.get(snapshot_id) Sep 13 18:03:30.336028 dv-cinder-852009-8-iscsi devstack@n-api.service[120741]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volume_snapshots.py", line 160, in get Sep 13 18:03:30.336028 dv-cinder-852009-8-iscsi devstack@n-api.service[120741]: ERROR nova.api.openstack.wsgi return self._get("/snapshots/%s" % snapshot_id, "snapshot") Sep 13 18:03:30.336028 dv-cinder-852009-8-iscsi devstack@n-api.service[120741]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/base.py", line 297, in _get Sep 13 18:03:30.336028 dv-cinder-852009-8-iscsi devstack@n-api.service[120741]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.get(url) Sep 13 18:03:30.336028 dv-cinder-852009-8-iscsi devstack@n-api.service[120741]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 224, in get Sep 13 18:03:30.337432 dv-cinder-852009-8-iscsi devstack@n-api.service[120741]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'GET', **kwargs) Sep 13 18:03:30.337432 dv-cinder-852009-8-iscsi devstack@n-api.service[120741]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 215, in _cs_request Sep 13 18:03:30.337432 dv-cinder-852009-8-iscsi devstack@n-api.service[120741]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) Sep 13 18:03:30.337432 dv-cinder-852009-8-iscsi devstack@n-api.service[120741]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 201, in request Sep 13 18:03:30.337432 dv-cinder-852009-8-iscsi devstack@n-api.service[120741]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) Sep 13 18:03:30.337432 dv-cinder-852009-8-iscsi devstack@n-api.service[120741]: ERROR nova.api.openstack.wsgi nova.exception.SnapshotNotFound: Snapshot 38c83dd3-4252-4d9a-ba0f-739f8564d221 could not be found. Sep 13 18:03:30.337432 dv-cinder-852009-8-iscsi devstack@n-api.service[120741]: ERROR nova.api.openstack.wsgi Sep 13 18:03:30.337432 dv-cinder-852009-8-iscsi devstack@n-api.service[120741]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 13 18:03:30.337432 dv-cinder-852009-8-iscsi devstack@n-api.service[120741]: ERROR nova.api.openstack.wsgi Sep 13 18:03:30.337432 dv-cinder-852009-8-iscsi devstack@n-api.service[120741]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 13 18:03:30.337432 dv-cinder-852009-8-iscsi devstack@n-api.service[120741]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 13 18:03:30.337432 dv-cinder-852009-8-iscsi devstack@n-api.service[120741]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 13 18:03:30.337432 dv-cinder-852009-8-iscsi devstack@n-api.service[120741]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 13 18:03:30.337432 dv-cinder-852009-8-iscsi devstack@n-api.service[120741]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 13 18:03:30.337432 dv-cinder-852009-8-iscsi devstack@n-api.service[120741]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Sep 13 18:03:30.337432 dv-cinder-852009-8-iscsi devstack@n-api.service[120741]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Sep 13 18:03:30.337432 dv-cinder-852009-8-iscsi devstack@n-api.service[120741]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 13 18:03:30.337432 dv-cinder-852009-8-iscsi devstack@n-api.service[120741]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 13 18:03:30.337432 dv-cinder-852009-8-iscsi devstack@n-api.service[120741]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 619, in show Sep 13 18:03:30.337432 dv-cinder-852009-8-iscsi devstack@n-api.service[120741]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Sep 13 18:03:30.338542 dv-cinder-852009-8-iscsi devstack@n-api.service[120741]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Snapshot 38c83dd3-4252-4d9a-ba0f-739f8564d221 could not be found. Sep 13 18:03:30.338542 dv-cinder-852009-8-iscsi devstack@n-api.service[120741]: ERROR nova.api.openstack.wsgi Sep 13 18:03:30.338542 dv-cinder-852009-8-iscsi devstack@n-api.service[120741]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 13 18:03:30.338542 dv-cinder-852009-8-iscsi devstack@n-api.service[120741]: ERROR nova.api.openstack.wsgi Sep 13 18:03:30.338542 dv-cinder-852009-8-iscsi devstack@n-api.service[120741]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 13 18:03:30.338542 dv-cinder-852009-8-iscsi devstack@n-api.service[120741]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 13 18:03:30.338542 dv-cinder-852009-8-iscsi devstack@n-api.service[120741]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 13 18:03:30.338542 dv-cinder-852009-8-iscsi devstack@n-api.service[120741]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 13 18:03:30.338542 dv-cinder-852009-8-iscsi devstack@n-api.service[120741]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 13 18:03:30.338542 dv-cinder-852009-8-iscsi devstack@n-api.service[120741]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Snapshot 38c83dd3-4252-4d9a-ba0f-739f8564d221 could not be found. Sep 13 18:03:30.338542 dv-cinder-852009-8-iscsi devstack@n-api.service[120741]: ERROR nova.api.openstack.wsgi Sep 13 18:03:30.338542 dv-cinder-852009-8-iscsi devstack@n-api.service[120741]: DEBUG nova.api.openstack.wsgi [None req-34b0f096-d4e7-4c86-8307-b9da9e2c3e50 tempest-VolumesSnapshotsTestJSON-299457566 tempest-VolumesSnapshotsTestJSON-299457566-project] Returning 404 to user: Snapshot 38c83dd3-4252-4d9a-ba0f-739f8564d221 could not be found. {{(pid=120741) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 13 18:03:30.338542 dv-cinder-852009-8-iscsi devstack@n-api.service[120741]: INFO nova.api.openstack.requestlog [None req-34b0f096-d4e7-4c86-8307-b9da9e2c3e50 tempest-VolumesSnapshotsTestJSON-299457566 tempest-VolumesSnapshotsTestJSON-299457566-project] 10.222.0.43 "GET /compute/v2.1/os-snapshots/38c83dd3-4252-4d9a-ba0f-739f8564d221" status: 404 len: 111 microversion: 2.1 time: 0.173390 Sep 13 18:03:30.338542 dv-cinder-852009-8-iscsi devstack@n-api.service[120741]: [pid: 120741|app: 0|req: 99/206] 10.222.0.43 () {58 vars in 1251 bytes} [Tue Sep 13 18:03:30 2022] GET /compute/v2.1/os-snapshots/38c83dd3-4252-4d9a-ba0f-739f8564d221 => generated 111 bytes in 175 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Sep 13 18:03:30.340965 dv-cinder-852009-8-iscsi devstack@n-api.service[120740]: DEBUG nova.api.openstack.wsgi [None req-dc5fd4d0-944b-453a-b380-934da0ac4a90 tempest-VolumesSnapshotsTestJSON-299457566 tempest-VolumesSnapshotsTestJSON-299457566-project] Calling method '.version_select at 0x7fa626dfb8b0>' {{(pid=120740) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 18:03:30.517282 dv-cinder-852009-8-iscsi devstack@n-api.service[120740]: INFO nova.api.openstack.requestlog [None req-dc5fd4d0-944b-453a-b380-934da0ac4a90 tempest-VolumesSnapshotsTestJSON-299457566 tempest-VolumesSnapshotsTestJSON-299457566-project] 10.222.0.43 "DELETE /compute/v2.1/os-volumes/e165ea51-6ca4-4f26-bcb2-46dcccc4b432" status: 202 len: 0 microversion: 2.1 time: 0.181282 Sep 13 18:03:30.518075 dv-cinder-852009-8-iscsi devstack@n-api.service[120740]: [pid: 120740|app: 0|req: 108/207] 10.222.0.43 () {58 vars in 1248 bytes} [Tue Sep 13 18:03:30 2022] DELETE /compute/v2.1/os-volumes/e165ea51-6ca4-4f26-bcb2-46dcccc4b432 => generated 0 bytes in 183 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Sep 13 18:03:30.528456 dv-cinder-852009-8-iscsi devstack@n-api.service[120741]: DEBUG nova.api.openstack.wsgi [None req-c8b7334d-c988-4783-b634-ed48a10f357f tempest-VolumesSnapshotsTestJSON-299457566 tempest-VolumesSnapshotsTestJSON-299457566-project] Calling method '.version_select at 0x7fa626d073a0>' {{(pid=120741) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 18:03:30.624597 dv-cinder-852009-8-iscsi devstack@n-api.service[120741]: INFO nova.api.openstack.requestlog [None req-c8b7334d-c988-4783-b634-ed48a10f357f tempest-VolumesSnapshotsTestJSON-299457566 tempest-VolumesSnapshotsTestJSON-299457566-project] 10.222.0.43 "GET /compute/v2.1/os-volumes/e165ea51-6ca4-4f26-bcb2-46dcccc4b432" status: 200 len: 344 microversion: 2.1 time: 0.101607 Sep 13 18:03:30.625511 dv-cinder-852009-8-iscsi devstack@n-api.service[120741]: [pid: 120741|app: 0|req: 100/208] 10.222.0.43 () {58 vars in 1245 bytes} [Tue Sep 13 18:03:30 2022] GET /compute/v2.1/os-volumes/e165ea51-6ca4-4f26-bcb2-46dcccc4b432 => generated 344 bytes in 103 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 13 18:03:30.818664 dv-cinder-852009-8-iscsi devstack@n-api.service[120740]: DEBUG nova.api.openstack.wsgi [None req-bfd4bdc4-aabd-4ab5-bed6-b4a8e8442085 tempest-ServerRescueNegativeTestJSON-412251590 tempest-ServerRescueNegativeTestJSON-412251590-project] Calling method '>' {{(pid=120740) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 18:03:30.821135 dv-cinder-852009-8-iscsi devstack@n-api.service[120740]: DEBUG nova.compute.api [None req-bfd4bdc4-aabd-4ab5-bed6-b4a8e8442085 tempest-ServerRescueNegativeTestJSON-412251590 tempest-ServerRescueNegativeTestJSON-412251590-project] [instance: a9c22f82-a945-4a94-b3c9-fe95265053bd] Fetching instance by UUID {{(pid=120740) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 18:03:30.828773 dv-cinder-852009-8-iscsi devstack@n-api.service[120740]: DEBUG oslo_concurrency.lockutils [None req-bfd4bdc4-aabd-4ab5-bed6-b4a8e8442085 tempest-ServerRescueNegativeTestJSON-412251590 tempest-ServerRescueNegativeTestJSON-412251590-project] Acquiring lock "1daf4f4c-0e4a-4779-b53a-78c48397ea2f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120740) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 18:03:30.830471 dv-cinder-852009-8-iscsi devstack@n-api.service[120740]: DEBUG oslo_concurrency.lockutils [None req-bfd4bdc4-aabd-4ab5-bed6-b4a8e8442085 tempest-ServerRescueNegativeTestJSON-412251590 tempest-ServerRescueNegativeTestJSON-412251590-project] Lock "1daf4f4c-0e4a-4779-b53a-78c48397ea2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120740) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 18:03:30.831348 dv-cinder-852009-8-iscsi devstack@n-api.service[120740]: DEBUG oslo_concurrency.lockutils [None req-bfd4bdc4-aabd-4ab5-bed6-b4a8e8442085 tempest-ServerRescueNegativeTestJSON-412251590 tempest-ServerRescueNegativeTestJSON-412251590-project] Lock "1daf4f4c-0e4a-4779-b53a-78c48397ea2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120740) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 18:03:30.833411 dv-cinder-852009-8-iscsi devstack@n-api.service[120740]: DEBUG oslo_concurrency.lockutils [None req-bfd4bdc4-aabd-4ab5-bed6-b4a8e8442085 tempest-ServerRescueNegativeTestJSON-412251590 tempest-ServerRescueNegativeTestJSON-412251590-project] Acquiring lock "1daf4f4c-0e4a-4779-b53a-78c48397ea2f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120740) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 18:03:30.835635 dv-cinder-852009-8-iscsi devstack@n-api.service[120740]: DEBUG oslo_concurrency.lockutils [None req-bfd4bdc4-aabd-4ab5-bed6-b4a8e8442085 tempest-ServerRescueNegativeTestJSON-412251590 tempest-ServerRescueNegativeTestJSON-412251590-project] Lock "1daf4f4c-0e4a-4779-b53a-78c48397ea2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120740) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 18:03:30.836521 dv-cinder-852009-8-iscsi devstack@n-api.service[120740]: DEBUG oslo_concurrency.lockutils [None req-bfd4bdc4-aabd-4ab5-bed6-b4a8e8442085 tempest-ServerRescueNegativeTestJSON-412251590 tempest-ServerRescueNegativeTestJSON-412251590-project] Lock "1daf4f4c-0e4a-4779-b53a-78c48397ea2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120740) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 18:03:31.032006 dv-cinder-852009-8-iscsi devstack@n-api.service[120740]: DEBUG nova.policy [None req-bfd4bdc4-aabd-4ab5-bed6-b4a8e8442085 tempest-ServerRescueNegativeTestJSON-412251590 tempest-ServerRescueNegativeTestJSON-412251590-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '60800cf2774e409d9c1b6f4992669991', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2eae4acecf6c4961830ead78d71b2ad3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120740) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 18:03:31.045597 dv-cinder-852009-8-iscsi devstack@n-api.service[120740]: INFO nova.api.openstack.requestlog [None req-bfd4bdc4-aabd-4ab5-bed6-b4a8e8442085 tempest-ServerRescueNegativeTestJSON-412251590 tempest-ServerRescueNegativeTestJSON-412251590-project] 10.222.0.43 "GET /compute/v2.1/servers/a9c22f82-a945-4a94-b3c9-fe95265053bd" status: 200 len: 1523 microversion: 2.1 time: 0.234526 Sep 13 18:03:31.047548 dv-cinder-852009-8-iscsi devstack@n-api.service[120740]: [pid: 120740|app: 0|req: 109/209] 10.222.0.43 () {58 vars in 1236 bytes} [Tue Sep 13 18:03:30 2022] GET /compute/v2.1/servers/a9c22f82-a945-4a94-b3c9-fe95265053bd => generated 1523 bytes in 237 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 13 18:03:31.641883 dv-cinder-852009-8-iscsi devstack@n-api.service[120741]: DEBUG nova.api.openstack.wsgi [None req-894dca04-5c78-42bc-8a23-f54723c450e7 tempest-VolumesSnapshotsTestJSON-299457566 tempest-VolumesSnapshotsTestJSON-299457566-project] Calling method '.version_select at 0x7fa626f04280>' {{(pid=120741) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 18:03:31.701451 dv-cinder-852009-8-iscsi devstack@n-api.service[120741]: INFO nova.api.openstack.wsgi [None req-894dca04-5c78-42bc-8a23-f54723c450e7 tempest-VolumesSnapshotsTestJSON-299457566 tempest-VolumesSnapshotsTestJSON-299457566-project] HTTP exception thrown: Volume e165ea51-6ca4-4f26-bcb2-46dcccc4b432 could not be found. Sep 13 18:03:31.714341 dv-cinder-852009-8-iscsi devstack@n-api.service[120741]: DEBUG nova.api.openstack.wsgi [None req-894dca04-5c78-42bc-8a23-f54723c450e7 tempest-VolumesSnapshotsTestJSON-299457566 tempest-VolumesSnapshotsTestJSON-299457566-project] Request method failure captured: Sep 13 18:03:31.714341 dv-cinder-852009-8-iscsi devstack@n-api.service[120741]: request: GET /compute/v2.1/os-volumes/e165ea51-6ca4-4f26-bcb2-46dcccc4b432 HTTP/1.1 Sep 13 18:03:31.714341 dv-cinder-852009-8-iscsi devstack@n-api.service[120741]: Accept: application/json Sep 13 18:03:31.714341 dv-cinder-852009-8-iscsi devstack@n-api.service[120741]: Accept-Encoding: identity Sep 13 18:03:31.714341 dv-cinder-852009-8-iscsi devstack@n-api.service[120741]: Connection: close Sep 13 18:03:31.714341 dv-cinder-852009-8-iscsi devstack@n-api.service[120741]: Content-Length: 0 Sep 13 18:03:31.714341 dv-cinder-852009-8-iscsi devstack@n-api.service[120741]: Content-Type: application/json Sep 13 18:03:31.714341 dv-cinder-852009-8-iscsi devstack@n-api.service[120741]: Host: 10.222.0.43 Sep 13 18:03:31.714341 dv-cinder-852009-8-iscsi devstack@n-api.service[120741]: Openstack-System-Scope: None Sep 13 18:03:31.714341 dv-cinder-852009-8-iscsi devstack@n-api.service[120741]: User-Agent: python-urllib3/1.26.12 Sep 13 18:03:31.714341 dv-cinder-852009-8-iscsi devstack@n-api.service[120741]: X-Auth-Token: gAAAAABjIMXqlKroAwSP-QzhGjwyxIjAEo0IfICx6G8FIr2gTxNQsSLtqOvOj90UNI2FEG-QBjDhnBK3L_L3EjCgVz80EoZrHN8MdXRGpEPQ5HgryNFIo2wFLkAY5JyGAxEHe5jyp03U9Zb0gu4QCIh3TiSaxnvYtgs-mt9NwL77NQSNyv35nFc Sep 13 18:03:31.714341 dv-cinder-852009-8-iscsi devstack@n-api.service[120741]: X-Domain-Id: None Sep 13 18:03:31.714341 dv-cinder-852009-8-iscsi devstack@n-api.service[120741]: X-Domain-Name: None Sep 13 18:03:31.714341 dv-cinder-852009-8-iscsi devstack@n-api.service[120741]: X-Identity-Status: Confirmed Sep 13 18:03:31.714341 dv-cinder-852009-8-iscsi devstack@n-api.service[120741]: X-Is-Admin-Project: True Sep 13 18:03:31.714341 dv-cinder-852009-8-iscsi devstack@n-api.service[120741]: X-Project-Domain-Id: default Sep 13 18:03:31.714341 dv-cinder-852009-8-iscsi devstack@n-api.service[120741]: X-Project-Domain-Name: Default Sep 13 18:03:31.714341 dv-cinder-852009-8-iscsi devstack@n-api.service[120741]: X-Project-Id: d8dea26ee3b04f11a491c5d2fc843350 Sep 13 18:03:31.714341 dv-cinder-852009-8-iscsi devstack@n-api.service[120741]: X-Project-Name: tempest-VolumesSnapshotsTestJSON-299457566 Sep 13 18:03:31.714341 dv-cinder-852009-8-iscsi devstack@n-api.service[120741]: X-Role: reader,member Sep 13 18:03:31.714341 dv-cinder-852009-8-iscsi devstack@n-api.service[120741]: X-Roles: reader,member Sep 13 18:03:31.715622 dv-cinder-852009-8-iscsi devstack@n-api.service[120741]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/identity"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/compute/v2/d8dea26ee3b04f11a491c5d2fc843350"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.43:8080", "publicURL": "http://10.222.0.43:8080/v1/AUTH_d8dea26ee3b04f11a491c5d2fc843350"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43:9696/networking"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/volume/v3/d8dea26ee3b04f11a491c5d2fc843350"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/compute/v2.1"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/placement"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/volume/v3/d8dea26ee3b04f11a491c5d2fc843350"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/image"}]}] Sep 13 18:03:31.715622 dv-cinder-852009-8-iscsi devstack@n-api.service[120741]: X-Tenant: tempest-VolumesSnapshotsTestJSON-299457566 Sep 13 18:03:31.715622 dv-cinder-852009-8-iscsi devstack@n-api.service[120741]: X-Tenant-Id: d8dea26ee3b04f11a491c5d2fc843350 Sep 13 18:03:31.715622 dv-cinder-852009-8-iscsi devstack@n-api.service[120741]: X-Tenant-Name: tempest-VolumesSnapshotsTestJSON-299457566 Sep 13 18:03:31.715622 dv-cinder-852009-8-iscsi devstack@n-api.service[120741]: X-User: tempest-VolumesSnapshotsTestJSON-299457566-project Sep 13 18:03:31.715622 dv-cinder-852009-8-iscsi devstack@n-api.service[120741]: X-User-Domain-Id: default Sep 13 18:03:31.715622 dv-cinder-852009-8-iscsi devstack@n-api.service[120741]: X-User-Domain-Name: Default Sep 13 18:03:31.715622 dv-cinder-852009-8-iscsi devstack@n-api.service[120741]: X-User-Id: b03e7a8ab6c34868af811ade7426e09c Sep 13 18:03:31.715622 dv-cinder-852009-8-iscsi devstack@n-api.service[120741]: X-User-Name: tempest-VolumesSnapshotsTestJSON-299457566-project Sep 13 18:03:31.715622 dv-cinder-852009-8-iscsi devstack@n-api.service[120741]: method: Sep 13 18:03:31.715622 dv-cinder-852009-8-iscsi devstack@n-api.service[120741]: exception: Volume e165ea51-6ca4-4f26-bcb2-46dcccc4b432 could not be found. Sep 13 18:03:31.715622 dv-cinder-852009-8-iscsi devstack@n-api.service[120741]: action_args: {'id': 'e165ea51-6ca4-4f26-bcb2-46dcccc4b432'} Sep 13 18:03:31.715622 dv-cinder-852009-8-iscsi devstack@n-api.service[120741]: {{(pid=120741) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 13 18:03:31.716608 dv-cinder-852009-8-iscsi devstack@n-api.service[120741]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 13 18:03:31.716608 dv-cinder-852009-8-iscsi devstack@n-api.service[120741]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 433, in wrapper Sep 13 18:03:31.716608 dv-cinder-852009-8-iscsi devstack@n-api.service[120741]: ERROR nova.api.openstack.wsgi res = method(self, ctx, volume_id, *args, **kwargs) Sep 13 18:03:31.716608 dv-cinder-852009-8-iscsi devstack@n-api.service[120741]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 502, in get Sep 13 18:03:31.716608 dv-cinder-852009-8-iscsi devstack@n-api.service[120741]: ERROR nova.api.openstack.wsgi item = cinderclient( Sep 13 18:03:31.716608 dv-cinder-852009-8-iscsi devstack@n-api.service[120741]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volumes_base.py", line 202, in get Sep 13 18:03:31.716608 dv-cinder-852009-8-iscsi devstack@n-api.service[120741]: ERROR nova.api.openstack.wsgi return self._get("/volumes/%s" % volume_id, "volume") Sep 13 18:03:31.716608 dv-cinder-852009-8-iscsi devstack@n-api.service[120741]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/base.py", line 297, in _get Sep 13 18:03:31.716608 dv-cinder-852009-8-iscsi devstack@n-api.service[120741]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.get(url) Sep 13 18:03:31.716608 dv-cinder-852009-8-iscsi devstack@n-api.service[120741]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 224, in get Sep 13 18:03:31.716608 dv-cinder-852009-8-iscsi devstack@n-api.service[120741]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'GET', **kwargs) Sep 13 18:03:31.716608 dv-cinder-852009-8-iscsi devstack@n-api.service[120741]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 215, in _cs_request Sep 13 18:03:31.716608 dv-cinder-852009-8-iscsi devstack@n-api.service[120741]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) Sep 13 18:03:31.716608 dv-cinder-852009-8-iscsi devstack@n-api.service[120741]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 201, in request Sep 13 18:03:31.716608 dv-cinder-852009-8-iscsi devstack@n-api.service[120741]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) Sep 13 18:03:31.716608 dv-cinder-852009-8-iscsi devstack@n-api.service[120741]: ERROR nova.api.openstack.wsgi cinderclient.exceptions.NotFound: Volume e165ea51-6ca4-4f26-bcb2-46dcccc4b432 could not be found. (HTTP 404) (Request-ID: req-822d18c0-1fef-4fbf-981e-28b5ced34673) Sep 13 18:03:31.716608 dv-cinder-852009-8-iscsi devstack@n-api.service[120741]: ERROR nova.api.openstack.wsgi Sep 13 18:03:31.716608 dv-cinder-852009-8-iscsi devstack@n-api.service[120741]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 13 18:03:31.716608 dv-cinder-852009-8-iscsi devstack@n-api.service[120741]: ERROR nova.api.openstack.wsgi Sep 13 18:03:31.717635 dv-cinder-852009-8-iscsi devstack@n-api.service[120741]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 13 18:03:31.717635 dv-cinder-852009-8-iscsi devstack@n-api.service[120741]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 120, in show Sep 13 18:03:31.717635 dv-cinder-852009-8-iscsi devstack@n-api.service[120741]: ERROR nova.api.openstack.wsgi vol = self.volume_api.get(context, id) Sep 13 18:03:31.717635 dv-cinder-852009-8-iscsi devstack@n-api.service[120741]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 395, in wrapper Sep 13 18:03:31.717635 dv-cinder-852009-8-iscsi devstack@n-api.service[120741]: ERROR nova.api.openstack.wsgi res = method(self, ctx, *args, **kwargs) Sep 13 18:03:31.717635 dv-cinder-852009-8-iscsi devstack@n-api.service[120741]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 435, in wrapper Sep 13 18:03:31.717635 dv-cinder-852009-8-iscsi devstack@n-api.service[120741]: ERROR nova.api.openstack.wsgi _reraise(exception.VolumeNotFound(volume_id=volume_id)) Sep 13 18:03:31.717635 dv-cinder-852009-8-iscsi devstack@n-api.service[120741]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 486, in _reraise Sep 13 18:03:31.717635 dv-cinder-852009-8-iscsi devstack@n-api.service[120741]: ERROR nova.api.openstack.wsgi raise desired_exc.with_traceback(sys.exc_info()[2]) Sep 13 18:03:31.717635 dv-cinder-852009-8-iscsi devstack@n-api.service[120741]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 433, in wrapper Sep 13 18:03:31.717635 dv-cinder-852009-8-iscsi devstack@n-api.service[120741]: ERROR nova.api.openstack.wsgi res = method(self, ctx, volume_id, *args, **kwargs) Sep 13 18:03:31.717635 dv-cinder-852009-8-iscsi devstack@n-api.service[120741]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 502, in get Sep 13 18:03:31.717635 dv-cinder-852009-8-iscsi devstack@n-api.service[120741]: ERROR nova.api.openstack.wsgi item = cinderclient( Sep 13 18:03:31.717635 dv-cinder-852009-8-iscsi devstack@n-api.service[120741]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volumes_base.py", line 202, in get Sep 13 18:03:31.717635 dv-cinder-852009-8-iscsi devstack@n-api.service[120741]: ERROR nova.api.openstack.wsgi return self._get("/volumes/%s" % volume_id, "volume") Sep 13 18:03:31.717635 dv-cinder-852009-8-iscsi devstack@n-api.service[120741]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/base.py", line 297, in _get Sep 13 18:03:31.717635 dv-cinder-852009-8-iscsi devstack@n-api.service[120741]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.get(url) Sep 13 18:03:31.717635 dv-cinder-852009-8-iscsi devstack@n-api.service[120741]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 224, in get Sep 13 18:03:31.717635 dv-cinder-852009-8-iscsi devstack@n-api.service[120741]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'GET', **kwargs) Sep 13 18:03:31.718693 dv-cinder-852009-8-iscsi devstack@n-api.service[120741]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 215, in _cs_request Sep 13 18:03:31.718693 dv-cinder-852009-8-iscsi devstack@n-api.service[120741]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) Sep 13 18:03:31.718693 dv-cinder-852009-8-iscsi devstack@n-api.service[120741]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 201, in request Sep 13 18:03:31.718693 dv-cinder-852009-8-iscsi devstack@n-api.service[120741]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) Sep 13 18:03:31.718693 dv-cinder-852009-8-iscsi devstack@n-api.service[120741]: ERROR nova.api.openstack.wsgi nova.exception.VolumeNotFound: Volume e165ea51-6ca4-4f26-bcb2-46dcccc4b432 could not be found. Sep 13 18:03:31.718693 dv-cinder-852009-8-iscsi devstack@n-api.service[120741]: ERROR nova.api.openstack.wsgi Sep 13 18:03:31.718693 dv-cinder-852009-8-iscsi devstack@n-api.service[120741]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 13 18:03:31.718693 dv-cinder-852009-8-iscsi devstack@n-api.service[120741]: ERROR nova.api.openstack.wsgi Sep 13 18:03:31.718693 dv-cinder-852009-8-iscsi devstack@n-api.service[120741]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 13 18:03:31.718693 dv-cinder-852009-8-iscsi devstack@n-api.service[120741]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 13 18:03:31.718693 dv-cinder-852009-8-iscsi devstack@n-api.service[120741]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 13 18:03:31.718693 dv-cinder-852009-8-iscsi devstack@n-api.service[120741]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 13 18:03:31.718693 dv-cinder-852009-8-iscsi devstack@n-api.service[120741]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 13 18:03:31.718693 dv-cinder-852009-8-iscsi devstack@n-api.service[120741]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Sep 13 18:03:31.718693 dv-cinder-852009-8-iscsi devstack@n-api.service[120741]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Sep 13 18:03:31.718693 dv-cinder-852009-8-iscsi devstack@n-api.service[120741]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 13 18:03:31.718693 dv-cinder-852009-8-iscsi devstack@n-api.service[120741]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 13 18:03:31.718693 dv-cinder-852009-8-iscsi devstack@n-api.service[120741]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 122, in show Sep 13 18:03:31.718693 dv-cinder-852009-8-iscsi devstack@n-api.service[120741]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Sep 13 18:03:31.722279 dv-cinder-852009-8-iscsi devstack@n-api.service[120741]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Volume e165ea51-6ca4-4f26-bcb2-46dcccc4b432 could not be found. Sep 13 18:03:31.722279 dv-cinder-852009-8-iscsi devstack@n-api.service[120741]: ERROR nova.api.openstack.wsgi Sep 13 18:03:31.722279 dv-cinder-852009-8-iscsi devstack@n-api.service[120741]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 13 18:03:31.722279 dv-cinder-852009-8-iscsi devstack@n-api.service[120741]: ERROR nova.api.openstack.wsgi Sep 13 18:03:31.722279 dv-cinder-852009-8-iscsi devstack@n-api.service[120741]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 13 18:03:31.722279 dv-cinder-852009-8-iscsi devstack@n-api.service[120741]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 13 18:03:31.722279 dv-cinder-852009-8-iscsi devstack@n-api.service[120741]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 13 18:03:31.722279 dv-cinder-852009-8-iscsi devstack@n-api.service[120741]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 13 18:03:31.722279 dv-cinder-852009-8-iscsi devstack@n-api.service[120741]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 13 18:03:31.722279 dv-cinder-852009-8-iscsi devstack@n-api.service[120741]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Volume e165ea51-6ca4-4f26-bcb2-46dcccc4b432 could not be found. Sep 13 18:03:31.722279 dv-cinder-852009-8-iscsi devstack@n-api.service[120741]: ERROR nova.api.openstack.wsgi Sep 13 18:03:31.726140 dv-cinder-852009-8-iscsi devstack@n-api.service[120741]: DEBUG nova.api.openstack.wsgi [None req-894dca04-5c78-42bc-8a23-f54723c450e7 tempest-VolumesSnapshotsTestJSON-299457566 tempest-VolumesSnapshotsTestJSON-299457566-project] Returning 404 to user: Volume e165ea51-6ca4-4f26-bcb2-46dcccc4b432 could not be found. {{(pid=120741) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 13 18:03:31.728905 dv-cinder-852009-8-iscsi devstack@n-api.service[120741]: INFO nova.api.openstack.requestlog [None req-894dca04-5c78-42bc-8a23-f54723c450e7 tempest-VolumesSnapshotsTestJSON-299457566 tempest-VolumesSnapshotsTestJSON-299457566-project] 10.222.0.43 "GET /compute/v2.1/os-volumes/e165ea51-6ca4-4f26-bcb2-46dcccc4b432" status: 404 len: 109 microversion: 2.1 time: 0.093046 Sep 13 18:03:31.743215 dv-cinder-852009-8-iscsi devstack@n-api.service[120741]: [pid: 120741|app: 0|req: 101/210] 10.222.0.43 () {58 vars in 1245 bytes} [Tue Sep 13 18:03:31 2022] GET /compute/v2.1/os-volumes/e165ea51-6ca4-4f26-bcb2-46dcccc4b432 => generated 109 bytes in 106 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Sep 13 18:03:31.754942 dv-cinder-852009-8-iscsi devstack@n-api.service[120740]: DEBUG nova.api.openstack.wsgi [None req-dde4a536-ca30-4900-9934-dc10f82a8d22 tempest-VolumesSnapshotsTestJSON-299457566 tempest-VolumesSnapshotsTestJSON-299457566-project] Calling method '.version_select at 0x7fa626d73790>' {{(pid=120740) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 18:03:31.823238 dv-cinder-852009-8-iscsi devstack@n-api.service[120740]: INFO nova.api.openstack.wsgi [None req-dde4a536-ca30-4900-9934-dc10f82a8d22 tempest-VolumesSnapshotsTestJSON-299457566 tempest-VolumesSnapshotsTestJSON-299457566-project] HTTP exception thrown: Volume e165ea51-6ca4-4f26-bcb2-46dcccc4b432 could not be found. Sep 13 18:03:31.828004 dv-cinder-852009-8-iscsi devstack@n-api.service[120740]: DEBUG nova.api.openstack.wsgi [None req-dde4a536-ca30-4900-9934-dc10f82a8d22 tempest-VolumesSnapshotsTestJSON-299457566 tempest-VolumesSnapshotsTestJSON-299457566-project] Request method failure captured: Sep 13 18:03:31.828004 dv-cinder-852009-8-iscsi devstack@n-api.service[120740]: request: DELETE /compute/v2.1/os-volumes/e165ea51-6ca4-4f26-bcb2-46dcccc4b432 HTTP/1.1 Sep 13 18:03:31.828004 dv-cinder-852009-8-iscsi devstack@n-api.service[120740]: Accept: application/json Sep 13 18:03:31.828004 dv-cinder-852009-8-iscsi devstack@n-api.service[120740]: Accept-Encoding: identity Sep 13 18:03:31.828004 dv-cinder-852009-8-iscsi devstack@n-api.service[120740]: Connection: close Sep 13 18:03:31.828004 dv-cinder-852009-8-iscsi devstack@n-api.service[120740]: Content-Length: 0 Sep 13 18:03:31.828004 dv-cinder-852009-8-iscsi devstack@n-api.service[120740]: Content-Type: application/json Sep 13 18:03:31.828004 dv-cinder-852009-8-iscsi devstack@n-api.service[120740]: Host: 10.222.0.43 Sep 13 18:03:31.828004 dv-cinder-852009-8-iscsi devstack@n-api.service[120740]: Openstack-System-Scope: None Sep 13 18:03:31.828004 dv-cinder-852009-8-iscsi devstack@n-api.service[120740]: User-Agent: python-urllib3/1.26.12 Sep 13 18:03:31.828004 dv-cinder-852009-8-iscsi devstack@n-api.service[120740]: X-Auth-Token: gAAAAABjIMXqlKroAwSP-QzhGjwyxIjAEo0IfICx6G8FIr2gTxNQsSLtqOvOj90UNI2FEG-QBjDhnBK3L_L3EjCgVz80EoZrHN8MdXRGpEPQ5HgryNFIo2wFLkAY5JyGAxEHe5jyp03U9Zb0gu4QCIh3TiSaxnvYtgs-mt9NwL77NQSNyv35nFc Sep 13 18:03:31.828004 dv-cinder-852009-8-iscsi devstack@n-api.service[120740]: X-Domain-Id: None Sep 13 18:03:31.828004 dv-cinder-852009-8-iscsi devstack@n-api.service[120740]: X-Domain-Name: None Sep 13 18:03:31.828004 dv-cinder-852009-8-iscsi devstack@n-api.service[120740]: X-Identity-Status: Confirmed Sep 13 18:03:31.828004 dv-cinder-852009-8-iscsi devstack@n-api.service[120740]: X-Is-Admin-Project: True Sep 13 18:03:31.828004 dv-cinder-852009-8-iscsi devstack@n-api.service[120740]: X-Project-Domain-Id: default Sep 13 18:03:31.828004 dv-cinder-852009-8-iscsi devstack@n-api.service[120740]: X-Project-Domain-Name: Default Sep 13 18:03:31.828004 dv-cinder-852009-8-iscsi devstack@n-api.service[120740]: X-Project-Id: d8dea26ee3b04f11a491c5d2fc843350 Sep 13 18:03:31.828004 dv-cinder-852009-8-iscsi devstack@n-api.service[120740]: X-Project-Name: tempest-VolumesSnapshotsTestJSON-299457566 Sep 13 18:03:31.828004 dv-cinder-852009-8-iscsi devstack@n-api.service[120740]: X-Role: reader,member Sep 13 18:03:31.828004 dv-cinder-852009-8-iscsi devstack@n-api.service[120740]: X-Roles: reader,member Sep 13 18:03:31.829511 dv-cinder-852009-8-iscsi devstack@n-api.service[120740]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/identity"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/compute/v2/d8dea26ee3b04f11a491c5d2fc843350"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.43:8080", "publicURL": "http://10.222.0.43:8080/v1/AUTH_d8dea26ee3b04f11a491c5d2fc843350"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43:9696/networking"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/volume/v3/d8dea26ee3b04f11a491c5d2fc843350"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/compute/v2.1"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/placement"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/volume/v3/d8dea26ee3b04f11a491c5d2fc843350"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/image"}]}] Sep 13 18:03:31.829511 dv-cinder-852009-8-iscsi devstack@n-api.service[120740]: X-Tenant: tempest-VolumesSnapshotsTestJSON-299457566 Sep 13 18:03:31.829511 dv-cinder-852009-8-iscsi devstack@n-api.service[120740]: X-Tenant-Id: d8dea26ee3b04f11a491c5d2fc843350 Sep 13 18:03:31.829511 dv-cinder-852009-8-iscsi devstack@n-api.service[120740]: X-Tenant-Name: tempest-VolumesSnapshotsTestJSON-299457566 Sep 13 18:03:31.829511 dv-cinder-852009-8-iscsi devstack@n-api.service[120740]: X-User: tempest-VolumesSnapshotsTestJSON-299457566-project Sep 13 18:03:31.829511 dv-cinder-852009-8-iscsi devstack@n-api.service[120740]: X-User-Domain-Id: default Sep 13 18:03:31.829511 dv-cinder-852009-8-iscsi devstack@n-api.service[120740]: X-User-Domain-Name: Default Sep 13 18:03:31.829511 dv-cinder-852009-8-iscsi devstack@n-api.service[120740]: X-User-Id: b03e7a8ab6c34868af811ade7426e09c Sep 13 18:03:31.829511 dv-cinder-852009-8-iscsi devstack@n-api.service[120740]: X-User-Name: tempest-VolumesSnapshotsTestJSON-299457566-project Sep 13 18:03:31.829511 dv-cinder-852009-8-iscsi devstack@n-api.service[120740]: method: Sep 13 18:03:31.829511 dv-cinder-852009-8-iscsi devstack@n-api.service[120740]: exception: Volume e165ea51-6ca4-4f26-bcb2-46dcccc4b432 could not be found. Sep 13 18:03:31.829511 dv-cinder-852009-8-iscsi devstack@n-api.service[120740]: action_args: {'id': 'e165ea51-6ca4-4f26-bcb2-46dcccc4b432'} Sep 13 18:03:31.829511 dv-cinder-852009-8-iscsi devstack@n-api.service[120740]: {{(pid=120740) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 13 18:03:31.831112 dv-cinder-852009-8-iscsi devstack@n-api.service[120740]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 13 18:03:31.831112 dv-cinder-852009-8-iscsi devstack@n-api.service[120740]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 433, in wrapper Sep 13 18:03:31.831112 dv-cinder-852009-8-iscsi devstack@n-api.service[120740]: ERROR nova.api.openstack.wsgi res = method(self, ctx, volume_id, *args, **kwargs) Sep 13 18:03:31.831112 dv-cinder-852009-8-iscsi devstack@n-api.service[120740]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 676, in delete Sep 13 18:03:31.831112 dv-cinder-852009-8-iscsi devstack@n-api.service[120740]: ERROR nova.api.openstack.wsgi cinderclient(context).volumes.delete(volume_id) Sep 13 18:03:31.831112 dv-cinder-852009-8-iscsi devstack@n-api.service[120740]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volumes_base.py", line 235, in delete Sep 13 18:03:31.831112 dv-cinder-852009-8-iscsi devstack@n-api.service[120740]: ERROR nova.api.openstack.wsgi return self._delete(loc) Sep 13 18:03:31.831112 dv-cinder-852009-8-iscsi devstack@n-api.service[120740]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/base.py", line 313, in _delete Sep 13 18:03:31.831112 dv-cinder-852009-8-iscsi devstack@n-api.service[120740]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.delete(url) Sep 13 18:03:31.831112 dv-cinder-852009-8-iscsi devstack@n-api.service[120740]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 233, in delete Sep 13 18:03:31.831112 dv-cinder-852009-8-iscsi devstack@n-api.service[120740]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'DELETE', **kwargs) Sep 13 18:03:31.831112 dv-cinder-852009-8-iscsi devstack@n-api.service[120740]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 215, in _cs_request Sep 13 18:03:31.831112 dv-cinder-852009-8-iscsi devstack@n-api.service[120740]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) Sep 13 18:03:31.831112 dv-cinder-852009-8-iscsi devstack@n-api.service[120740]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 201, in request Sep 13 18:03:31.831112 dv-cinder-852009-8-iscsi devstack@n-api.service[120740]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) Sep 13 18:03:31.831112 dv-cinder-852009-8-iscsi devstack@n-api.service[120740]: ERROR nova.api.openstack.wsgi cinderclient.exceptions.NotFound: Volume e165ea51-6ca4-4f26-bcb2-46dcccc4b432 could not be found. (HTTP 404) (Request-ID: req-998bfe96-75c7-4059-995c-79d7c1df15c5) Sep 13 18:03:31.831112 dv-cinder-852009-8-iscsi devstack@n-api.service[120740]: ERROR nova.api.openstack.wsgi Sep 13 18:03:31.831112 dv-cinder-852009-8-iscsi devstack@n-api.service[120740]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 13 18:03:31.831112 dv-cinder-852009-8-iscsi devstack@n-api.service[120740]: ERROR nova.api.openstack.wsgi Sep 13 18:03:31.832710 dv-cinder-852009-8-iscsi devstack@n-api.service[120740]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 13 18:03:31.832710 dv-cinder-852009-8-iscsi devstack@n-api.service[120740]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 136, in delete Sep 13 18:03:31.832710 dv-cinder-852009-8-iscsi devstack@n-api.service[120740]: ERROR nova.api.openstack.wsgi self.volume_api.delete(context, id) Sep 13 18:03:31.832710 dv-cinder-852009-8-iscsi devstack@n-api.service[120740]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 395, in wrapper Sep 13 18:03:31.832710 dv-cinder-852009-8-iscsi devstack@n-api.service[120740]: ERROR nova.api.openstack.wsgi res = method(self, ctx, *args, **kwargs) Sep 13 18:03:31.832710 dv-cinder-852009-8-iscsi devstack@n-api.service[120740]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 435, in wrapper Sep 13 18:03:31.832710 dv-cinder-852009-8-iscsi devstack@n-api.service[120740]: ERROR nova.api.openstack.wsgi _reraise(exception.VolumeNotFound(volume_id=volume_id)) Sep 13 18:03:31.832710 dv-cinder-852009-8-iscsi devstack@n-api.service[120740]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 486, in _reraise Sep 13 18:03:31.832710 dv-cinder-852009-8-iscsi devstack@n-api.service[120740]: ERROR nova.api.openstack.wsgi raise desired_exc.with_traceback(sys.exc_info()[2]) Sep 13 18:03:31.832710 dv-cinder-852009-8-iscsi devstack@n-api.service[120740]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 433, in wrapper Sep 13 18:03:31.832710 dv-cinder-852009-8-iscsi devstack@n-api.service[120740]: ERROR nova.api.openstack.wsgi res = method(self, ctx, volume_id, *args, **kwargs) Sep 13 18:03:31.832710 dv-cinder-852009-8-iscsi devstack@n-api.service[120740]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 676, in delete Sep 13 18:03:31.832710 dv-cinder-852009-8-iscsi devstack@n-api.service[120740]: ERROR nova.api.openstack.wsgi cinderclient(context).volumes.delete(volume_id) Sep 13 18:03:31.832710 dv-cinder-852009-8-iscsi devstack@n-api.service[120740]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volumes_base.py", line 235, in delete Sep 13 18:03:31.832710 dv-cinder-852009-8-iscsi devstack@n-api.service[120740]: ERROR nova.api.openstack.wsgi return self._delete(loc) Sep 13 18:03:31.832710 dv-cinder-852009-8-iscsi devstack@n-api.service[120740]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/base.py", line 313, in _delete Sep 13 18:03:31.832710 dv-cinder-852009-8-iscsi devstack@n-api.service[120740]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.delete(url) Sep 13 18:03:31.832710 dv-cinder-852009-8-iscsi devstack@n-api.service[120740]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 233, in delete Sep 13 18:03:31.832710 dv-cinder-852009-8-iscsi devstack@n-api.service[120740]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'DELETE', **kwargs) Sep 13 18:03:31.833934 dv-cinder-852009-8-iscsi devstack@n-api.service[120740]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 215, in _cs_request Sep 13 18:03:31.833934 dv-cinder-852009-8-iscsi devstack@n-api.service[120740]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) Sep 13 18:03:31.833934 dv-cinder-852009-8-iscsi devstack@n-api.service[120740]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 201, in request Sep 13 18:03:31.833934 dv-cinder-852009-8-iscsi devstack@n-api.service[120740]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) Sep 13 18:03:31.833934 dv-cinder-852009-8-iscsi devstack@n-api.service[120740]: ERROR nova.api.openstack.wsgi nova.exception.VolumeNotFound: Volume e165ea51-6ca4-4f26-bcb2-46dcccc4b432 could not be found. Sep 13 18:03:31.833934 dv-cinder-852009-8-iscsi devstack@n-api.service[120740]: ERROR nova.api.openstack.wsgi Sep 13 18:03:31.833934 dv-cinder-852009-8-iscsi devstack@n-api.service[120740]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 13 18:03:31.833934 dv-cinder-852009-8-iscsi devstack@n-api.service[120740]: ERROR nova.api.openstack.wsgi Sep 13 18:03:31.833934 dv-cinder-852009-8-iscsi devstack@n-api.service[120740]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 13 18:03:31.833934 dv-cinder-852009-8-iscsi devstack@n-api.service[120740]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 13 18:03:31.833934 dv-cinder-852009-8-iscsi devstack@n-api.service[120740]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 13 18:03:31.833934 dv-cinder-852009-8-iscsi devstack@n-api.service[120740]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 13 18:03:31.833934 dv-cinder-852009-8-iscsi devstack@n-api.service[120740]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 13 18:03:31.833934 dv-cinder-852009-8-iscsi devstack@n-api.service[120740]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Sep 13 18:03:31.833934 dv-cinder-852009-8-iscsi devstack@n-api.service[120740]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Sep 13 18:03:31.833934 dv-cinder-852009-8-iscsi devstack@n-api.service[120740]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 13 18:03:31.833934 dv-cinder-852009-8-iscsi devstack@n-api.service[120740]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 13 18:03:31.833934 dv-cinder-852009-8-iscsi devstack@n-api.service[120740]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 140, in delete Sep 13 18:03:31.833934 dv-cinder-852009-8-iscsi devstack@n-api.service[120740]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Sep 13 18:03:31.835237 dv-cinder-852009-8-iscsi devstack@n-api.service[120740]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Volume e165ea51-6ca4-4f26-bcb2-46dcccc4b432 could not be found. Sep 13 18:03:31.835237 dv-cinder-852009-8-iscsi devstack@n-api.service[120740]: ERROR nova.api.openstack.wsgi Sep 13 18:03:31.835237 dv-cinder-852009-8-iscsi devstack@n-api.service[120740]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 13 18:03:31.835237 dv-cinder-852009-8-iscsi devstack@n-api.service[120740]: ERROR nova.api.openstack.wsgi Sep 13 18:03:31.835237 dv-cinder-852009-8-iscsi devstack@n-api.service[120740]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 13 18:03:31.835237 dv-cinder-852009-8-iscsi devstack@n-api.service[120740]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 13 18:03:31.835237 dv-cinder-852009-8-iscsi devstack@n-api.service[120740]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 13 18:03:31.835237 dv-cinder-852009-8-iscsi devstack@n-api.service[120740]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 13 18:03:31.835237 dv-cinder-852009-8-iscsi devstack@n-api.service[120740]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 13 18:03:31.835237 dv-cinder-852009-8-iscsi devstack@n-api.service[120740]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Volume e165ea51-6ca4-4f26-bcb2-46dcccc4b432 could not be found. Sep 13 18:03:31.835237 dv-cinder-852009-8-iscsi devstack@n-api.service[120740]: ERROR nova.api.openstack.wsgi Sep 13 18:03:31.837048 dv-cinder-852009-8-iscsi devstack@n-api.service[120740]: DEBUG nova.api.openstack.wsgi [None req-dde4a536-ca30-4900-9934-dc10f82a8d22 tempest-VolumesSnapshotsTestJSON-299457566 tempest-VolumesSnapshotsTestJSON-299457566-project] Returning 404 to user: Volume e165ea51-6ca4-4f26-bcb2-46dcccc4b432 could not be found. {{(pid=120740) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 13 18:03:31.838933 dv-cinder-852009-8-iscsi devstack@n-api.service[120740]: INFO nova.api.openstack.requestlog [None req-dde4a536-ca30-4900-9934-dc10f82a8d22 tempest-VolumesSnapshotsTestJSON-299457566 tempest-VolumesSnapshotsTestJSON-299457566-project] 10.222.0.43 "DELETE /compute/v2.1/os-volumes/e165ea51-6ca4-4f26-bcb2-46dcccc4b432" status: 404 len: 109 microversion: 2.1 time: 0.090382 Sep 13 18:03:31.839666 dv-cinder-852009-8-iscsi devstack@n-api.service[120740]: [pid: 120740|app: 0|req: 110/211] 10.222.0.43 () {58 vars in 1248 bytes} [Tue Sep 13 18:03:31 2022] DELETE /compute/v2.1/os-volumes/e165ea51-6ca4-4f26-bcb2-46dcccc4b432 => generated 109 bytes in 93 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Sep 13 18:03:31.851896 dv-cinder-852009-8-iscsi devstack@n-api.service[120741]: DEBUG nova.api.openstack.wsgi [None req-5ae53448-d3e7-495e-97c6-445833453931 tempest-VolumesSnapshotsTestJSON-299457566 tempest-VolumesSnapshotsTestJSON-299457566-project] Calling method '.version_select at 0x7fa626ccf430>' {{(pid=120741) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 18:03:32.019359 dv-cinder-852009-8-iscsi devstack@n-api.service[120741]: INFO nova.api.openstack.wsgi [None req-5ae53448-d3e7-495e-97c6-445833453931 tempest-VolumesSnapshotsTestJSON-299457566 tempest-VolumesSnapshotsTestJSON-299457566-project] HTTP exception thrown: Volume e165ea51-6ca4-4f26-bcb2-46dcccc4b432 could not be found. Sep 13 18:03:32.022110 dv-cinder-852009-8-iscsi devstack@n-api.service[120741]: DEBUG nova.api.openstack.wsgi [None req-5ae53448-d3e7-495e-97c6-445833453931 tempest-VolumesSnapshotsTestJSON-299457566 tempest-VolumesSnapshotsTestJSON-299457566-project] Request method failure captured: Sep 13 18:03:32.022110 dv-cinder-852009-8-iscsi devstack@n-api.service[120741]: request: GET /compute/v2.1/os-volumes/e165ea51-6ca4-4f26-bcb2-46dcccc4b432 HTTP/1.1 Sep 13 18:03:32.022110 dv-cinder-852009-8-iscsi devstack@n-api.service[120741]: Accept: application/json Sep 13 18:03:32.022110 dv-cinder-852009-8-iscsi devstack@n-api.service[120741]: Accept-Encoding: identity Sep 13 18:03:32.022110 dv-cinder-852009-8-iscsi devstack@n-api.service[120741]: Connection: close Sep 13 18:03:32.022110 dv-cinder-852009-8-iscsi devstack@n-api.service[120741]: Content-Length: 0 Sep 13 18:03:32.022110 dv-cinder-852009-8-iscsi devstack@n-api.service[120741]: Content-Type: application/json Sep 13 18:03:32.022110 dv-cinder-852009-8-iscsi devstack@n-api.service[120741]: Host: 10.222.0.43 Sep 13 18:03:32.022110 dv-cinder-852009-8-iscsi devstack@n-api.service[120741]: Openstack-System-Scope: None Sep 13 18:03:32.022110 dv-cinder-852009-8-iscsi devstack@n-api.service[120741]: User-Agent: python-urllib3/1.26.12 Sep 13 18:03:32.022110 dv-cinder-852009-8-iscsi devstack@n-api.service[120741]: X-Auth-Token: gAAAAABjIMXqlKroAwSP-QzhGjwyxIjAEo0IfICx6G8FIr2gTxNQsSLtqOvOj90UNI2FEG-QBjDhnBK3L_L3EjCgVz80EoZrHN8MdXRGpEPQ5HgryNFIo2wFLkAY5JyGAxEHe5jyp03U9Zb0gu4QCIh3TiSaxnvYtgs-mt9NwL77NQSNyv35nFc Sep 13 18:03:32.022110 dv-cinder-852009-8-iscsi devstack@n-api.service[120741]: X-Domain-Id: None Sep 13 18:03:32.022110 dv-cinder-852009-8-iscsi devstack@n-api.service[120741]: X-Domain-Name: None Sep 13 18:03:32.022110 dv-cinder-852009-8-iscsi devstack@n-api.service[120741]: X-Identity-Status: Confirmed Sep 13 18:03:32.022110 dv-cinder-852009-8-iscsi devstack@n-api.service[120741]: X-Is-Admin-Project: True Sep 13 18:03:32.022110 dv-cinder-852009-8-iscsi devstack@n-api.service[120741]: X-Project-Domain-Id: default Sep 13 18:03:32.022110 dv-cinder-852009-8-iscsi devstack@n-api.service[120741]: X-Project-Domain-Name: Default Sep 13 18:03:32.022110 dv-cinder-852009-8-iscsi devstack@n-api.service[120741]: X-Project-Id: d8dea26ee3b04f11a491c5d2fc843350 Sep 13 18:03:32.022110 dv-cinder-852009-8-iscsi devstack@n-api.service[120741]: X-Project-Name: tempest-VolumesSnapshotsTestJSON-299457566 Sep 13 18:03:32.022110 dv-cinder-852009-8-iscsi devstack@n-api.service[120741]: X-Role: reader,member Sep 13 18:03:32.022110 dv-cinder-852009-8-iscsi devstack@n-api.service[120741]: X-Roles: reader,member Sep 13 18:03:32.023363 dv-cinder-852009-8-iscsi devstack@n-api.service[120741]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/identity"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/compute/v2/d8dea26ee3b04f11a491c5d2fc843350"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.43:8080", "publicURL": "http://10.222.0.43:8080/v1/AUTH_d8dea26ee3b04f11a491c5d2fc843350"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43:9696/networking"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/volume/v3/d8dea26ee3b04f11a491c5d2fc843350"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/compute/v2.1"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/placement"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/volume/v3/d8dea26ee3b04f11a491c5d2fc843350"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/image"}]}] Sep 13 18:03:32.023363 dv-cinder-852009-8-iscsi devstack@n-api.service[120741]: X-Tenant: tempest-VolumesSnapshotsTestJSON-299457566 Sep 13 18:03:32.023363 dv-cinder-852009-8-iscsi devstack@n-api.service[120741]: X-Tenant-Id: d8dea26ee3b04f11a491c5d2fc843350 Sep 13 18:03:32.023363 dv-cinder-852009-8-iscsi devstack@n-api.service[120741]: X-Tenant-Name: tempest-VolumesSnapshotsTestJSON-299457566 Sep 13 18:03:32.023363 dv-cinder-852009-8-iscsi devstack@n-api.service[120741]: X-User: tempest-VolumesSnapshotsTestJSON-299457566-project Sep 13 18:03:32.023363 dv-cinder-852009-8-iscsi devstack@n-api.service[120741]: X-User-Domain-Id: default Sep 13 18:03:32.023363 dv-cinder-852009-8-iscsi devstack@n-api.service[120741]: X-User-Domain-Name: Default Sep 13 18:03:32.023363 dv-cinder-852009-8-iscsi devstack@n-api.service[120741]: X-User-Id: b03e7a8ab6c34868af811ade7426e09c Sep 13 18:03:32.023363 dv-cinder-852009-8-iscsi devstack@n-api.service[120741]: X-User-Name: tempest-VolumesSnapshotsTestJSON-299457566-project Sep 13 18:03:32.023363 dv-cinder-852009-8-iscsi devstack@n-api.service[120741]: method: Sep 13 18:03:32.023363 dv-cinder-852009-8-iscsi devstack@n-api.service[120741]: exception: Volume e165ea51-6ca4-4f26-bcb2-46dcccc4b432 could not be found. Sep 13 18:03:32.023363 dv-cinder-852009-8-iscsi devstack@n-api.service[120741]: action_args: {'id': 'e165ea51-6ca4-4f26-bcb2-46dcccc4b432'} Sep 13 18:03:32.023363 dv-cinder-852009-8-iscsi devstack@n-api.service[120741]: {{(pid=120741) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 13 18:03:32.024356 dv-cinder-852009-8-iscsi devstack@n-api.service[120741]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 13 18:03:32.024356 dv-cinder-852009-8-iscsi devstack@n-api.service[120741]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 433, in wrapper Sep 13 18:03:32.024356 dv-cinder-852009-8-iscsi devstack@n-api.service[120741]: ERROR nova.api.openstack.wsgi res = method(self, ctx, volume_id, *args, **kwargs) Sep 13 18:03:32.024356 dv-cinder-852009-8-iscsi devstack@n-api.service[120741]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 502, in get Sep 13 18:03:32.024356 dv-cinder-852009-8-iscsi devstack@n-api.service[120741]: ERROR nova.api.openstack.wsgi item = cinderclient( Sep 13 18:03:32.024356 dv-cinder-852009-8-iscsi devstack@n-api.service[120741]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volumes_base.py", line 202, in get Sep 13 18:03:32.024356 dv-cinder-852009-8-iscsi devstack@n-api.service[120741]: ERROR nova.api.openstack.wsgi return self._get("/volumes/%s" % volume_id, "volume") Sep 13 18:03:32.024356 dv-cinder-852009-8-iscsi devstack@n-api.service[120741]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/base.py", line 297, in _get Sep 13 18:03:32.024356 dv-cinder-852009-8-iscsi devstack@n-api.service[120741]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.get(url) Sep 13 18:03:32.024356 dv-cinder-852009-8-iscsi devstack@n-api.service[120741]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 224, in get Sep 13 18:03:32.024356 dv-cinder-852009-8-iscsi devstack@n-api.service[120741]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'GET', **kwargs) Sep 13 18:03:32.024356 dv-cinder-852009-8-iscsi devstack@n-api.service[120741]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 215, in _cs_request Sep 13 18:03:32.024356 dv-cinder-852009-8-iscsi devstack@n-api.service[120741]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) Sep 13 18:03:32.024356 dv-cinder-852009-8-iscsi devstack@n-api.service[120741]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 201, in request Sep 13 18:03:32.024356 dv-cinder-852009-8-iscsi devstack@n-api.service[120741]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) Sep 13 18:03:32.024356 dv-cinder-852009-8-iscsi devstack@n-api.service[120741]: ERROR nova.api.openstack.wsgi cinderclient.exceptions.NotFound: Volume e165ea51-6ca4-4f26-bcb2-46dcccc4b432 could not be found. (HTTP 404) (Request-ID: req-7cb5611c-625b-4e45-b22f-850a7dd4f69f) Sep 13 18:03:32.024356 dv-cinder-852009-8-iscsi devstack@n-api.service[120741]: ERROR nova.api.openstack.wsgi Sep 13 18:03:32.024356 dv-cinder-852009-8-iscsi devstack@n-api.service[120741]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 13 18:03:32.024356 dv-cinder-852009-8-iscsi devstack@n-api.service[120741]: ERROR nova.api.openstack.wsgi Sep 13 18:03:32.025458 dv-cinder-852009-8-iscsi devstack@n-api.service[120741]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 13 18:03:32.025458 dv-cinder-852009-8-iscsi devstack@n-api.service[120741]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 120, in show Sep 13 18:03:32.025458 dv-cinder-852009-8-iscsi devstack@n-api.service[120741]: ERROR nova.api.openstack.wsgi vol = self.volume_api.get(context, id) Sep 13 18:03:32.025458 dv-cinder-852009-8-iscsi devstack@n-api.service[120741]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 395, in wrapper Sep 13 18:03:32.025458 dv-cinder-852009-8-iscsi devstack@n-api.service[120741]: ERROR nova.api.openstack.wsgi res = method(self, ctx, *args, **kwargs) Sep 13 18:03:32.025458 dv-cinder-852009-8-iscsi devstack@n-api.service[120741]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 435, in wrapper Sep 13 18:03:32.025458 dv-cinder-852009-8-iscsi devstack@n-api.service[120741]: ERROR nova.api.openstack.wsgi _reraise(exception.VolumeNotFound(volume_id=volume_id)) Sep 13 18:03:32.025458 dv-cinder-852009-8-iscsi devstack@n-api.service[120741]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 486, in _reraise Sep 13 18:03:32.025458 dv-cinder-852009-8-iscsi devstack@n-api.service[120741]: ERROR nova.api.openstack.wsgi raise desired_exc.with_traceback(sys.exc_info()[2]) Sep 13 18:03:32.025458 dv-cinder-852009-8-iscsi devstack@n-api.service[120741]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 433, in wrapper Sep 13 18:03:32.025458 dv-cinder-852009-8-iscsi devstack@n-api.service[120741]: ERROR nova.api.openstack.wsgi res = method(self, ctx, volume_id, *args, **kwargs) Sep 13 18:03:32.025458 dv-cinder-852009-8-iscsi devstack@n-api.service[120741]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 502, in get Sep 13 18:03:32.025458 dv-cinder-852009-8-iscsi devstack@n-api.service[120741]: ERROR nova.api.openstack.wsgi item = cinderclient( Sep 13 18:03:32.025458 dv-cinder-852009-8-iscsi devstack@n-api.service[120741]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volumes_base.py", line 202, in get Sep 13 18:03:32.025458 dv-cinder-852009-8-iscsi devstack@n-api.service[120741]: ERROR nova.api.openstack.wsgi return self._get("/volumes/%s" % volume_id, "volume") Sep 13 18:03:32.025458 dv-cinder-852009-8-iscsi devstack@n-api.service[120741]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/base.py", line 297, in _get Sep 13 18:03:32.025458 dv-cinder-852009-8-iscsi devstack@n-api.service[120741]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.get(url) Sep 13 18:03:32.025458 dv-cinder-852009-8-iscsi devstack@n-api.service[120741]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 224, in get Sep 13 18:03:32.025458 dv-cinder-852009-8-iscsi devstack@n-api.service[120741]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'GET', **kwargs) Sep 13 18:03:32.026477 dv-cinder-852009-8-iscsi devstack@n-api.service[120741]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 215, in _cs_request Sep 13 18:03:32.026477 dv-cinder-852009-8-iscsi devstack@n-api.service[120741]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) Sep 13 18:03:32.026477 dv-cinder-852009-8-iscsi devstack@n-api.service[120741]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 201, in request Sep 13 18:03:32.026477 dv-cinder-852009-8-iscsi devstack@n-api.service[120741]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) Sep 13 18:03:32.026477 dv-cinder-852009-8-iscsi devstack@n-api.service[120741]: ERROR nova.api.openstack.wsgi nova.exception.VolumeNotFound: Volume e165ea51-6ca4-4f26-bcb2-46dcccc4b432 could not be found. Sep 13 18:03:32.026477 dv-cinder-852009-8-iscsi devstack@n-api.service[120741]: ERROR nova.api.openstack.wsgi Sep 13 18:03:32.026477 dv-cinder-852009-8-iscsi devstack@n-api.service[120741]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 13 18:03:32.026477 dv-cinder-852009-8-iscsi devstack@n-api.service[120741]: ERROR nova.api.openstack.wsgi Sep 13 18:03:32.026477 dv-cinder-852009-8-iscsi devstack@n-api.service[120741]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 13 18:03:32.026477 dv-cinder-852009-8-iscsi devstack@n-api.service[120741]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 13 18:03:32.026477 dv-cinder-852009-8-iscsi devstack@n-api.service[120741]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 13 18:03:32.026477 dv-cinder-852009-8-iscsi devstack@n-api.service[120741]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 13 18:03:32.026477 dv-cinder-852009-8-iscsi devstack@n-api.service[120741]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 13 18:03:32.026477 dv-cinder-852009-8-iscsi devstack@n-api.service[120741]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Sep 13 18:03:32.026477 dv-cinder-852009-8-iscsi devstack@n-api.service[120741]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Sep 13 18:03:32.026477 dv-cinder-852009-8-iscsi devstack@n-api.service[120741]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 13 18:03:32.026477 dv-cinder-852009-8-iscsi devstack@n-api.service[120741]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 13 18:03:32.026477 dv-cinder-852009-8-iscsi devstack@n-api.service[120741]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 122, in show Sep 13 18:03:32.026477 dv-cinder-852009-8-iscsi devstack@n-api.service[120741]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Sep 13 18:03:32.028220 dv-cinder-852009-8-iscsi devstack@n-api.service[120741]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Volume e165ea51-6ca4-4f26-bcb2-46dcccc4b432 could not be found. Sep 13 18:03:32.028220 dv-cinder-852009-8-iscsi devstack@n-api.service[120741]: ERROR nova.api.openstack.wsgi Sep 13 18:03:32.028220 dv-cinder-852009-8-iscsi devstack@n-api.service[120741]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 13 18:03:32.028220 dv-cinder-852009-8-iscsi devstack@n-api.service[120741]: ERROR nova.api.openstack.wsgi Sep 13 18:03:32.028220 dv-cinder-852009-8-iscsi devstack@n-api.service[120741]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 13 18:03:32.028220 dv-cinder-852009-8-iscsi devstack@n-api.service[120741]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 13 18:03:32.028220 dv-cinder-852009-8-iscsi devstack@n-api.service[120741]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 13 18:03:32.028220 dv-cinder-852009-8-iscsi devstack@n-api.service[120741]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 13 18:03:32.028220 dv-cinder-852009-8-iscsi devstack@n-api.service[120741]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 13 18:03:32.028220 dv-cinder-852009-8-iscsi devstack@n-api.service[120741]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Volume e165ea51-6ca4-4f26-bcb2-46dcccc4b432 could not be found. Sep 13 18:03:32.028220 dv-cinder-852009-8-iscsi devstack@n-api.service[120741]: ERROR nova.api.openstack.wsgi Sep 13 18:03:32.028220 dv-cinder-852009-8-iscsi devstack@n-api.service[120741]: DEBUG nova.api.openstack.wsgi [None req-5ae53448-d3e7-495e-97c6-445833453931 tempest-VolumesSnapshotsTestJSON-299457566 tempest-VolumesSnapshotsTestJSON-299457566-project] Returning 404 to user: Volume e165ea51-6ca4-4f26-bcb2-46dcccc4b432 could not be found. {{(pid=120741) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 13 18:03:32.028220 dv-cinder-852009-8-iscsi devstack@n-api.service[120741]: INFO nova.api.openstack.requestlog [None req-5ae53448-d3e7-495e-97c6-445833453931 tempest-VolumesSnapshotsTestJSON-299457566 tempest-VolumesSnapshotsTestJSON-299457566-project] 10.222.0.43 "GET /compute/v2.1/os-volumes/e165ea51-6ca4-4f26-bcb2-46dcccc4b432" status: 404 len: 109 microversion: 2.1 time: 0.177583 Sep 13 18:03:32.028220 dv-cinder-852009-8-iscsi devstack@n-api.service[120741]: [pid: 120741|app: 0|req: 102/212] 10.222.0.43 () {58 vars in 1245 bytes} [Tue Sep 13 18:03:31 2022] GET /compute/v2.1/os-volumes/e165ea51-6ca4-4f26-bcb2-46dcccc4b432 => generated 109 bytes in 179 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Sep 13 18:03:32.085319 dv-cinder-852009-8-iscsi devstack@n-api.service[120740]: DEBUG nova.api.openstack.wsgi [None req-471183b4-041c-4a36-830e-3ad8a3953b33 tempest-ServerRescueNegativeTestJSON-412251590 tempest-ServerRescueNegativeTestJSON-412251590-project] Calling method '>' {{(pid=120740) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 18:03:32.086118 dv-cinder-852009-8-iscsi devstack@n-api.service[120740]: DEBUG nova.compute.api [None req-471183b4-041c-4a36-830e-3ad8a3953b33 tempest-ServerRescueNegativeTestJSON-412251590 tempest-ServerRescueNegativeTestJSON-412251590-project] [instance: a9c22f82-a945-4a94-b3c9-fe95265053bd] Fetching instance by UUID {{(pid=120740) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 18:03:32.097236 dv-cinder-852009-8-iscsi devstack@n-api.service[120740]: DEBUG oslo_concurrency.lockutils [None req-471183b4-041c-4a36-830e-3ad8a3953b33 tempest-ServerRescueNegativeTestJSON-412251590 tempest-ServerRescueNegativeTestJSON-412251590-project] Acquiring lock "1daf4f4c-0e4a-4779-b53a-78c48397ea2f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120740) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 18:03:32.102959 dv-cinder-852009-8-iscsi devstack@n-api.service[120740]: DEBUG oslo_concurrency.lockutils [None req-471183b4-041c-4a36-830e-3ad8a3953b33 tempest-ServerRescueNegativeTestJSON-412251590 tempest-ServerRescueNegativeTestJSON-412251590-project] Lock "1daf4f4c-0e4a-4779-b53a-78c48397ea2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120740) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 18:03:32.107821 dv-cinder-852009-8-iscsi devstack@n-api.service[120740]: DEBUG oslo_concurrency.lockutils [None req-471183b4-041c-4a36-830e-3ad8a3953b33 tempest-ServerRescueNegativeTestJSON-412251590 tempest-ServerRescueNegativeTestJSON-412251590-project] Lock "1daf4f4c-0e4a-4779-b53a-78c48397ea2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=120740) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 18:03:32.108922 dv-cinder-852009-8-iscsi devstack@n-api.service[120740]: DEBUG oslo_concurrency.lockutils [None req-471183b4-041c-4a36-830e-3ad8a3953b33 tempest-ServerRescueNegativeTestJSON-412251590 tempest-ServerRescueNegativeTestJSON-412251590-project] Acquiring lock "1daf4f4c-0e4a-4779-b53a-78c48397ea2f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120740) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 18:03:32.109625 dv-cinder-852009-8-iscsi devstack@n-api.service[120740]: DEBUG oslo_concurrency.lockutils [None req-471183b4-041c-4a36-830e-3ad8a3953b33 tempest-ServerRescueNegativeTestJSON-412251590 tempest-ServerRescueNegativeTestJSON-412251590-project] Lock "1daf4f4c-0e4a-4779-b53a-78c48397ea2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120740) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 18:03:32.113039 dv-cinder-852009-8-iscsi devstack@n-api.service[120740]: DEBUG oslo_concurrency.lockutils [None req-471183b4-041c-4a36-830e-3ad8a3953b33 tempest-ServerRescueNegativeTestJSON-412251590 tempest-ServerRescueNegativeTestJSON-412251590-project] Lock "1daf4f4c-0e4a-4779-b53a-78c48397ea2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120740) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 18:03:32.493398 dv-cinder-852009-8-iscsi devstack@n-api.service[120740]: DEBUG nova.policy [None req-471183b4-041c-4a36-830e-3ad8a3953b33 tempest-ServerRescueNegativeTestJSON-412251590 tempest-ServerRescueNegativeTestJSON-412251590-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '60800cf2774e409d9c1b6f4992669991', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2eae4acecf6c4961830ead78d71b2ad3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120740) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 18:03:32.505357 dv-cinder-852009-8-iscsi devstack@n-api.service[120740]: INFO nova.api.openstack.requestlog [None req-471183b4-041c-4a36-830e-3ad8a3953b33 tempest-ServerRescueNegativeTestJSON-412251590 tempest-ServerRescueNegativeTestJSON-412251590-project] 10.222.0.43 "GET /compute/v2.1/servers/a9c22f82-a945-4a94-b3c9-fe95265053bd" status: 200 len: 1523 microversion: 2.1 time: 0.439123 Sep 13 18:03:32.525142 dv-cinder-852009-8-iscsi devstack@n-api.service[120740]: [pid: 120740|app: 0|req: 111/213] 10.222.0.43 () {58 vars in 1236 bytes} [Tue Sep 13 18:03:32 2022] GET /compute/v2.1/servers/a9c22f82-a945-4a94-b3c9-fe95265053bd => generated 1523 bytes in 460 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 13 18:03:33.532680 dv-cinder-852009-8-iscsi devstack@n-api.service[120741]: DEBUG nova.api.openstack.wsgi [None req-0d1d87b8-b6cc-4905-95eb-01c37b3437cc tempest-ServerRescueNegativeTestJSON-412251590 tempest-ServerRescueNegativeTestJSON-412251590-project] Calling method '>' {{(pid=120741) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 18:03:33.534231 dv-cinder-852009-8-iscsi devstack@n-api.service[120741]: DEBUG nova.compute.api [None req-0d1d87b8-b6cc-4905-95eb-01c37b3437cc tempest-ServerRescueNegativeTestJSON-412251590 tempest-ServerRescueNegativeTestJSON-412251590-project] [instance: a9c22f82-a945-4a94-b3c9-fe95265053bd] Fetching instance by UUID {{(pid=120741) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 18:03:33.542263 dv-cinder-852009-8-iscsi devstack@n-api.service[120741]: DEBUG oslo_concurrency.lockutils [None req-0d1d87b8-b6cc-4905-95eb-01c37b3437cc tempest-ServerRescueNegativeTestJSON-412251590 tempest-ServerRescueNegativeTestJSON-412251590-project] Acquiring lock "1daf4f4c-0e4a-4779-b53a-78c48397ea2f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120741) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 18:03:33.543122 dv-cinder-852009-8-iscsi devstack@n-api.service[120741]: DEBUG oslo_concurrency.lockutils [None req-0d1d87b8-b6cc-4905-95eb-01c37b3437cc tempest-ServerRescueNegativeTestJSON-412251590 tempest-ServerRescueNegativeTestJSON-412251590-project] Lock "1daf4f4c-0e4a-4779-b53a-78c48397ea2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120741) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 18:03:33.545240 dv-cinder-852009-8-iscsi devstack@n-api.service[120741]: DEBUG oslo_concurrency.lockutils [None req-0d1d87b8-b6cc-4905-95eb-01c37b3437cc tempest-ServerRescueNegativeTestJSON-412251590 tempest-ServerRescueNegativeTestJSON-412251590-project] Lock "1daf4f4c-0e4a-4779-b53a-78c48397ea2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120741) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 18:03:33.547080 dv-cinder-852009-8-iscsi devstack@n-api.service[120741]: DEBUG oslo_concurrency.lockutils [None req-0d1d87b8-b6cc-4905-95eb-01c37b3437cc tempest-ServerRescueNegativeTestJSON-412251590 tempest-ServerRescueNegativeTestJSON-412251590-project] Acquiring lock "1daf4f4c-0e4a-4779-b53a-78c48397ea2f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120741) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 18:03:33.548999 dv-cinder-852009-8-iscsi devstack@n-api.service[120741]: DEBUG oslo_concurrency.lockutils [None req-0d1d87b8-b6cc-4905-95eb-01c37b3437cc tempest-ServerRescueNegativeTestJSON-412251590 tempest-ServerRescueNegativeTestJSON-412251590-project] Lock "1daf4f4c-0e4a-4779-b53a-78c48397ea2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120741) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 18:03:33.550495 dv-cinder-852009-8-iscsi devstack@n-api.service[120741]: DEBUG oslo_concurrency.lockutils [None req-0d1d87b8-b6cc-4905-95eb-01c37b3437cc tempest-ServerRescueNegativeTestJSON-412251590 tempest-ServerRescueNegativeTestJSON-412251590-project] Lock "1daf4f4c-0e4a-4779-b53a-78c48397ea2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120741) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 18:03:33.927118 dv-cinder-852009-8-iscsi devstack@n-api.service[120741]: DEBUG nova.policy [None req-0d1d87b8-b6cc-4905-95eb-01c37b3437cc tempest-ServerRescueNegativeTestJSON-412251590 tempest-ServerRescueNegativeTestJSON-412251590-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '60800cf2774e409d9c1b6f4992669991', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2eae4acecf6c4961830ead78d71b2ad3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120741) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 18:03:33.943177 dv-cinder-852009-8-iscsi devstack@n-api.service[120741]: INFO nova.api.openstack.requestlog [None req-0d1d87b8-b6cc-4905-95eb-01c37b3437cc tempest-ServerRescueNegativeTestJSON-412251590 tempest-ServerRescueNegativeTestJSON-412251590-project] 10.222.0.43 "GET /compute/v2.1/servers/a9c22f82-a945-4a94-b3c9-fe95265053bd" status: 200 len: 1523 microversion: 2.1 time: 0.418353 Sep 13 18:03:33.955729 dv-cinder-852009-8-iscsi devstack@n-api.service[120741]: [pid: 120741|app: 0|req: 103/214] 10.222.0.43 () {58 vars in 1236 bytes} [Tue Sep 13 18:03:33 2022] GET /compute/v2.1/servers/a9c22f82-a945-4a94-b3c9-fe95265053bd => generated 1523 bytes in 431 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 13 18:03:34.650964 dv-cinder-852009-8-iscsi devstack@n-api.service[120740]: DEBUG nova.api.openstack.wsgi [None req-3660ca2f-425b-4cc7-9749-59816f468878 tempest-TestShelveInstance-6258502 tempest-TestShelveInstance-6258502-project] Action: 'create', calling method: .version_select at 0x7fa626d734c0>, body: {"keypair": {"name": "tempest-TestShelveInstance-1588373406", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBJfTCfgr/7w7xLbcVne7cvod3iON0WB7xjJ/PDK8t2KhhHtBQMK/GxIa/Z3pfzVhX9/urcH2p//BRy4cUJVr+y3nU/HGbPZQrvftOQWCHBkBlugHxHuNRkHvJYurmDXcUg=="}} {{(pid=120740) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 13 18:03:34.688596 dv-cinder-852009-8-iscsi devstack@n-api.service[120740]: DEBUG nova.quota [None req-3660ca2f-425b-4cc7-9749-59816f468878 tempest-TestShelveInstance-6258502 tempest-TestShelveInstance-6258502-project] Getting quotas for project 5eafd54351bd4049b87ad308a3638f80. Resources: {'key_pairs'} {{(pid=120740) _get_quotas /opt/stack/nova/nova/quota.py:393}} Sep 13 18:03:34.695505 dv-cinder-852009-8-iscsi devstack@n-api.service[120740]: DEBUG nova.quota [None req-3660ca2f-425b-4cc7-9749-59816f468878 tempest-TestShelveInstance-6258502 tempest-TestShelveInstance-6258502-project] Getting quotas for user 2ab9930d6ce54cacbb3d4fd6313294d5 and project 5eafd54351bd4049b87ad308a3638f80. Resources: {'key_pairs'} {{(pid=120740) _get_quotas /opt/stack/nova/nova/quota.py:383}} Sep 13 18:03:34.729490 dv-cinder-852009-8-iscsi devstack@n-api.service[120740]: INFO nova.api.openstack.requestlog [None req-3660ca2f-425b-4cc7-9749-59816f468878 tempest-TestShelveInstance-6258502 tempest-TestShelveInstance-6258502-project] 10.222.0.43 "POST /compute/v2.1/os-keypairs" status: 200 len: 397 microversion: 2.1 time: 0.440411 Sep 13 18:03:34.733161 dv-cinder-852009-8-iscsi devstack@n-api.service[120740]: [pid: 120740|app: 0|req: 112/215] 10.222.0.43 () {60 vars in 1159 bytes} [Tue Sep 13 18:03:34 2022] POST /compute/v2.1/os-keypairs => generated 397 bytes in 445 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 13 18:03:34.941842 dv-cinder-852009-8-iscsi devstack@n-api.service[120741]: DEBUG nova.api.openstack.wsgi [None req-d5e765d4-1073-4485-a1a1-296a2e4b72ca tempest-AttachVolumeShelveTestJSON-385853788 tempest-AttachVolumeShelveTestJSON-385853788-project] Calling method '>' {{(pid=120741) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 18:03:34.942402 dv-cinder-852009-8-iscsi devstack@n-api.service[120741]: DEBUG nova.compute.api [None req-d5e765d4-1073-4485-a1a1-296a2e4b72ca tempest-AttachVolumeShelveTestJSON-385853788 tempest-AttachVolumeShelveTestJSON-385853788-project] [instance: 11d2616a-96f9-4a7a-aab8-219219986a8b] Fetching instance by UUID {{(pid=120741) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 18:03:34.953400 dv-cinder-852009-8-iscsi devstack@n-api.service[120741]: DEBUG oslo_concurrency.lockutils [None req-d5e765d4-1073-4485-a1a1-296a2e4b72ca tempest-AttachVolumeShelveTestJSON-385853788 tempest-AttachVolumeShelveTestJSON-385853788-project] Acquiring lock "1daf4f4c-0e4a-4779-b53a-78c48397ea2f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120741) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 18:03:34.956240 dv-cinder-852009-8-iscsi devstack@n-api.service[120741]: DEBUG oslo_concurrency.lockutils [None req-d5e765d4-1073-4485-a1a1-296a2e4b72ca tempest-AttachVolumeShelveTestJSON-385853788 tempest-AttachVolumeShelveTestJSON-385853788-project] Lock "1daf4f4c-0e4a-4779-b53a-78c48397ea2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120741) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 18:03:34.958545 dv-cinder-852009-8-iscsi devstack@n-api.service[120741]: DEBUG oslo_concurrency.lockutils [None req-d5e765d4-1073-4485-a1a1-296a2e4b72ca tempest-AttachVolumeShelveTestJSON-385853788 tempest-AttachVolumeShelveTestJSON-385853788-project] Lock "1daf4f4c-0e4a-4779-b53a-78c48397ea2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120741) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 18:03:34.959779 dv-cinder-852009-8-iscsi devstack@n-api.service[120741]: DEBUG oslo_concurrency.lockutils [None req-d5e765d4-1073-4485-a1a1-296a2e4b72ca tempest-AttachVolumeShelveTestJSON-385853788 tempest-AttachVolumeShelveTestJSON-385853788-project] Acquiring lock "1daf4f4c-0e4a-4779-b53a-78c48397ea2f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120741) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 18:03:34.961700 dv-cinder-852009-8-iscsi devstack@n-api.service[120741]: DEBUG oslo_concurrency.lockutils [None req-d5e765d4-1073-4485-a1a1-296a2e4b72ca tempest-AttachVolumeShelveTestJSON-385853788 tempest-AttachVolumeShelveTestJSON-385853788-project] Lock "1daf4f4c-0e4a-4779-b53a-78c48397ea2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120741) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 18:03:34.963756 dv-cinder-852009-8-iscsi devstack@n-api.service[120741]: DEBUG oslo_concurrency.lockutils [None req-d5e765d4-1073-4485-a1a1-296a2e4b72ca tempest-AttachVolumeShelveTestJSON-385853788 tempest-AttachVolumeShelveTestJSON-385853788-project] Lock "1daf4f4c-0e4a-4779-b53a-78c48397ea2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120741) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 18:03:34.997585 dv-cinder-852009-8-iscsi devstack@n-api.service[120740]: DEBUG nova.api.openstack.wsgi [None req-e89b8955-a23e-458d-b293-421c8778b9c7 tempest-ServerRescueNegativeTestJSON-412251590 tempest-ServerRescueNegativeTestJSON-412251590-project] Calling method '>' {{(pid=120740) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 18:03:34.998291 dv-cinder-852009-8-iscsi devstack@n-api.service[120740]: DEBUG nova.compute.api [None req-e89b8955-a23e-458d-b293-421c8778b9c7 tempest-ServerRescueNegativeTestJSON-412251590 tempest-ServerRescueNegativeTestJSON-412251590-project] [instance: a9c22f82-a945-4a94-b3c9-fe95265053bd] Fetching instance by UUID {{(pid=120740) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 18:03:35.008710 dv-cinder-852009-8-iscsi devstack@n-api.service[120740]: DEBUG oslo_concurrency.lockutils [None req-e89b8955-a23e-458d-b293-421c8778b9c7 tempest-ServerRescueNegativeTestJSON-412251590 tempest-ServerRescueNegativeTestJSON-412251590-project] Acquiring lock "1daf4f4c-0e4a-4779-b53a-78c48397ea2f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120740) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 18:03:35.012026 dv-cinder-852009-8-iscsi devstack@n-api.service[120740]: DEBUG oslo_concurrency.lockutils [None req-e89b8955-a23e-458d-b293-421c8778b9c7 tempest-ServerRescueNegativeTestJSON-412251590 tempest-ServerRescueNegativeTestJSON-412251590-project] Lock "1daf4f4c-0e4a-4779-b53a-78c48397ea2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120740) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 18:03:35.013375 dv-cinder-852009-8-iscsi devstack@n-api.service[120740]: DEBUG oslo_concurrency.lockutils [None req-e89b8955-a23e-458d-b293-421c8778b9c7 tempest-ServerRescueNegativeTestJSON-412251590 tempest-ServerRescueNegativeTestJSON-412251590-project] Lock "1daf4f4c-0e4a-4779-b53a-78c48397ea2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=120740) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 18:03:35.025562 dv-cinder-852009-8-iscsi devstack@n-api.service[120740]: DEBUG oslo_concurrency.lockutils [None req-e89b8955-a23e-458d-b293-421c8778b9c7 tempest-ServerRescueNegativeTestJSON-412251590 tempest-ServerRescueNegativeTestJSON-412251590-project] Acquiring lock "1daf4f4c-0e4a-4779-b53a-78c48397ea2f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120740) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 18:03:35.026939 dv-cinder-852009-8-iscsi devstack@n-api.service[120740]: DEBUG oslo_concurrency.lockutils [None req-e89b8955-a23e-458d-b293-421c8778b9c7 tempest-ServerRescueNegativeTestJSON-412251590 tempest-ServerRescueNegativeTestJSON-412251590-project] Lock "1daf4f4c-0e4a-4779-b53a-78c48397ea2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120740) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 18:03:35.027566 dv-cinder-852009-8-iscsi devstack@n-api.service[120740]: DEBUG oslo_concurrency.lockutils [None req-e89b8955-a23e-458d-b293-421c8778b9c7 tempest-ServerRescueNegativeTestJSON-412251590 tempest-ServerRescueNegativeTestJSON-412251590-project] Lock "1daf4f4c-0e4a-4779-b53a-78c48397ea2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120740) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 18:03:35.039658 dv-cinder-852009-8-iscsi devstack@n-api.service[120741]: INFO nova.api.openstack.requestlog [None req-d5e765d4-1073-4485-a1a1-296a2e4b72ca tempest-AttachVolumeShelveTestJSON-385853788 tempest-AttachVolumeShelveTestJSON-385853788-project] 10.222.0.43 "GET /compute/v2.1/servers/11d2616a-96f9-4a7a-aab8-219219986a8b/ips" status: 200 len: 152 microversion: 2.20 time: 0.102353 Sep 13 18:03:35.055308 dv-cinder-852009-8-iscsi devstack@n-api.service[120741]: [pid: 120741|app: 0|req: 104/216] 10.222.0.43 () {60 vars in 1289 bytes} [Tue Sep 13 18:03:34 2022] GET /compute/v2.1/servers/11d2616a-96f9-4a7a-aab8-219219986a8b/ips => generated 152 bytes in 119 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Sep 13 18:03:35.238546 dv-cinder-852009-8-iscsi devstack@n-api.service[120740]: DEBUG nova.policy [None req-e89b8955-a23e-458d-b293-421c8778b9c7 tempest-ServerRescueNegativeTestJSON-412251590 tempest-ServerRescueNegativeTestJSON-412251590-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '60800cf2774e409d9c1b6f4992669991', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2eae4acecf6c4961830ead78d71b2ad3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120740) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 18:03:35.259906 dv-cinder-852009-8-iscsi devstack@n-api.service[120740]: INFO nova.api.openstack.requestlog [None req-e89b8955-a23e-458d-b293-421c8778b9c7 tempest-ServerRescueNegativeTestJSON-412251590 tempest-ServerRescueNegativeTestJSON-412251590-project] 10.222.0.43 "GET /compute/v2.1/servers/a9c22f82-a945-4a94-b3c9-fe95265053bd" status: 200 len: 1523 microversion: 2.1 time: 0.267009 Sep 13 18:03:35.261122 dv-cinder-852009-8-iscsi devstack@n-api.service[120740]: [pid: 120740|app: 0|req: 113/217] 10.222.0.43 () {58 vars in 1236 bytes} [Tue Sep 13 18:03:34 2022] GET /compute/v2.1/servers/a9c22f82-a945-4a94-b3c9-fe95265053bd => generated 1523 bytes in 270 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 13 18:03:36.283783 dv-cinder-852009-8-iscsi devstack@n-api.service[120741]: DEBUG nova.api.openstack.wsgi [None req-8fe11962-0804-4db4-8794-fde162a278b6 tempest-ServerRescueNegativeTestJSON-412251590 tempest-ServerRescueNegativeTestJSON-412251590-project] Calling method '>' {{(pid=120741) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 18:03:36.284861 dv-cinder-852009-8-iscsi devstack@n-api.service[120741]: DEBUG nova.compute.api [None req-8fe11962-0804-4db4-8794-fde162a278b6 tempest-ServerRescueNegativeTestJSON-412251590 tempest-ServerRescueNegativeTestJSON-412251590-project] [instance: a9c22f82-a945-4a94-b3c9-fe95265053bd] Fetching instance by UUID {{(pid=120741) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 18:03:36.320349 dv-cinder-852009-8-iscsi devstack@n-api.service[120741]: DEBUG oslo_concurrency.lockutils [None req-8fe11962-0804-4db4-8794-fde162a278b6 tempest-ServerRescueNegativeTestJSON-412251590 tempest-ServerRescueNegativeTestJSON-412251590-project] Acquiring lock "1daf4f4c-0e4a-4779-b53a-78c48397ea2f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120741) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 18:03:36.325754 dv-cinder-852009-8-iscsi devstack@n-api.service[120741]: DEBUG oslo_concurrency.lockutils [None req-8fe11962-0804-4db4-8794-fde162a278b6 tempest-ServerRescueNegativeTestJSON-412251590 tempest-ServerRescueNegativeTestJSON-412251590-project] Lock "1daf4f4c-0e4a-4779-b53a-78c48397ea2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=120741) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 18:03:36.326630 dv-cinder-852009-8-iscsi devstack@n-api.service[120741]: DEBUG oslo_concurrency.lockutils [None req-8fe11962-0804-4db4-8794-fde162a278b6 tempest-ServerRescueNegativeTestJSON-412251590 tempest-ServerRescueNegativeTestJSON-412251590-project] Lock "1daf4f4c-0e4a-4779-b53a-78c48397ea2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120741) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 18:03:36.331427 dv-cinder-852009-8-iscsi devstack@n-api.service[120741]: DEBUG oslo_concurrency.lockutils [None req-8fe11962-0804-4db4-8794-fde162a278b6 tempest-ServerRescueNegativeTestJSON-412251590 tempest-ServerRescueNegativeTestJSON-412251590-project] Acquiring lock "1daf4f4c-0e4a-4779-b53a-78c48397ea2f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120741) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 18:03:36.332049 dv-cinder-852009-8-iscsi devstack@n-api.service[120741]: DEBUG oslo_concurrency.lockutils [None req-8fe11962-0804-4db4-8794-fde162a278b6 tempest-ServerRescueNegativeTestJSON-412251590 tempest-ServerRescueNegativeTestJSON-412251590-project] Lock "1daf4f4c-0e4a-4779-b53a-78c48397ea2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=120741) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 18:03:36.332530 dv-cinder-852009-8-iscsi devstack@n-api.service[120741]: DEBUG oslo_concurrency.lockutils [None req-8fe11962-0804-4db4-8794-fde162a278b6 tempest-ServerRescueNegativeTestJSON-412251590 tempest-ServerRescueNegativeTestJSON-412251590-project] Lock "1daf4f4c-0e4a-4779-b53a-78c48397ea2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120741) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 18:03:36.646626 dv-cinder-852009-8-iscsi devstack@n-api.service[120741]: DEBUG nova.policy [None req-8fe11962-0804-4db4-8794-fde162a278b6 tempest-ServerRescueNegativeTestJSON-412251590 tempest-ServerRescueNegativeTestJSON-412251590-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '60800cf2774e409d9c1b6f4992669991', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2eae4acecf6c4961830ead78d71b2ad3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120741) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 18:03:36.665377 dv-cinder-852009-8-iscsi devstack@n-api.service[120741]: INFO nova.api.openstack.requestlog [None req-8fe11962-0804-4db4-8794-fde162a278b6 tempest-ServerRescueNegativeTestJSON-412251590 tempest-ServerRescueNegativeTestJSON-412251590-project] 10.222.0.43 "GET /compute/v2.1/servers/a9c22f82-a945-4a94-b3c9-fe95265053bd" status: 200 len: 1523 microversion: 2.1 time: 0.382239 Sep 13 18:03:36.666119 dv-cinder-852009-8-iscsi devstack@n-api.service[120741]: [pid: 120741|app: 0|req: 105/218] 10.222.0.43 () {58 vars in 1236 bytes} [Tue Sep 13 18:03:36 2022] GET /compute/v2.1/servers/a9c22f82-a945-4a94-b3c9-fe95265053bd => generated 1523 bytes in 387 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 13 18:03:37.416078 dv-cinder-852009-8-iscsi devstack@n-api.service[120740]: DEBUG nova.api.openstack.wsgi [None req-062870dc-9970-4990-85ab-3587c8df81bf tempest-AttachVolumeShelveTestJSON-385853788 tempest-AttachVolumeShelveTestJSON-385853788-project] Action: 'action', calling method: >, body: {"shelve": {}} {{(pid=120740) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 13 18:03:37.417206 dv-cinder-852009-8-iscsi devstack@n-api.service[120740]: DEBUG nova.compute.api [None req-062870dc-9970-4990-85ab-3587c8df81bf tempest-AttachVolumeShelveTestJSON-385853788 tempest-AttachVolumeShelveTestJSON-385853788-project] [instance: 11d2616a-96f9-4a7a-aab8-219219986a8b] Fetching instance by UUID {{(pid=120740) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 18:03:37.424744 dv-cinder-852009-8-iscsi devstack@n-api.service[120740]: DEBUG oslo_concurrency.lockutils [None req-062870dc-9970-4990-85ab-3587c8df81bf tempest-AttachVolumeShelveTestJSON-385853788 tempest-AttachVolumeShelveTestJSON-385853788-project] Acquiring lock "1daf4f4c-0e4a-4779-b53a-78c48397ea2f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120740) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 18:03:37.425437 dv-cinder-852009-8-iscsi devstack@n-api.service[120740]: DEBUG oslo_concurrency.lockutils [None req-062870dc-9970-4990-85ab-3587c8df81bf tempest-AttachVolumeShelveTestJSON-385853788 tempest-AttachVolumeShelveTestJSON-385853788-project] Lock "1daf4f4c-0e4a-4779-b53a-78c48397ea2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120740) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 18:03:37.426182 dv-cinder-852009-8-iscsi devstack@n-api.service[120740]: DEBUG oslo_concurrency.lockutils [None req-062870dc-9970-4990-85ab-3587c8df81bf tempest-AttachVolumeShelveTestJSON-385853788 tempest-AttachVolumeShelveTestJSON-385853788-project] Lock "1daf4f4c-0e4a-4779-b53a-78c48397ea2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120740) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 18:03:37.429213 dv-cinder-852009-8-iscsi devstack@n-api.service[120740]: DEBUG oslo_concurrency.lockutils [None req-062870dc-9970-4990-85ab-3587c8df81bf tempest-AttachVolumeShelveTestJSON-385853788 tempest-AttachVolumeShelveTestJSON-385853788-project] Acquiring lock "1daf4f4c-0e4a-4779-b53a-78c48397ea2f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120740) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 18:03:37.429852 dv-cinder-852009-8-iscsi devstack@n-api.service[120740]: DEBUG oslo_concurrency.lockutils [None req-062870dc-9970-4990-85ab-3587c8df81bf tempest-AttachVolumeShelveTestJSON-385853788 tempest-AttachVolumeShelveTestJSON-385853788-project] Lock "1daf4f4c-0e4a-4779-b53a-78c48397ea2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120740) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 18:03:37.430518 dv-cinder-852009-8-iscsi devstack@n-api.service[120740]: DEBUG oslo_concurrency.lockutils [None req-062870dc-9970-4990-85ab-3587c8df81bf tempest-AttachVolumeShelveTestJSON-385853788 tempest-AttachVolumeShelveTestJSON-385853788-project] Lock "1daf4f4c-0e4a-4779-b53a-78c48397ea2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120740) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 18:03:37.477532 dv-cinder-852009-8-iscsi devstack@n-api.service[120740]: DEBUG nova.objects.instance [None req-062870dc-9970-4990-85ab-3587c8df81bf tempest-AttachVolumeShelveTestJSON-385853788 tempest-AttachVolumeShelveTestJSON-385853788-project] Lazy-loading 'flavor' on Instance uuid 11d2616a-96f9-4a7a-aab8-219219986a8b {{(pid=120740) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Sep 13 18:03:37.695946 dv-cinder-852009-8-iscsi devstack@n-api.service[120741]: DEBUG nova.api.openstack.wsgi [None req-eaef41ab-3709-440f-950e-3c8f894be25f tempest-ServerRescueNegativeTestJSON-412251590 tempest-ServerRescueNegativeTestJSON-412251590-project] Calling method '>' {{(pid=120741) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 18:03:37.698286 dv-cinder-852009-8-iscsi devstack@n-api.service[120741]: DEBUG nova.compute.api [None req-eaef41ab-3709-440f-950e-3c8f894be25f tempest-ServerRescueNegativeTestJSON-412251590 tempest-ServerRescueNegativeTestJSON-412251590-project] [instance: a9c22f82-a945-4a94-b3c9-fe95265053bd] Fetching instance by UUID {{(pid=120741) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 18:03:37.713738 dv-cinder-852009-8-iscsi devstack@n-api.service[120741]: DEBUG oslo_concurrency.lockutils [None req-eaef41ab-3709-440f-950e-3c8f894be25f tempest-ServerRescueNegativeTestJSON-412251590 tempest-ServerRescueNegativeTestJSON-412251590-project] Acquiring lock "1daf4f4c-0e4a-4779-b53a-78c48397ea2f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120741) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 18:03:37.715205 dv-cinder-852009-8-iscsi devstack@n-api.service[120741]: DEBUG oslo_concurrency.lockutils [None req-eaef41ab-3709-440f-950e-3c8f894be25f tempest-ServerRescueNegativeTestJSON-412251590 tempest-ServerRescueNegativeTestJSON-412251590-project] Lock "1daf4f4c-0e4a-4779-b53a-78c48397ea2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120741) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 18:03:37.715973 dv-cinder-852009-8-iscsi devstack@n-api.service[120741]: DEBUG oslo_concurrency.lockutils [None req-eaef41ab-3709-440f-950e-3c8f894be25f tempest-ServerRescueNegativeTestJSON-412251590 tempest-ServerRescueNegativeTestJSON-412251590-project] Lock "1daf4f4c-0e4a-4779-b53a-78c48397ea2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120741) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 18:03:37.717229 dv-cinder-852009-8-iscsi devstack@n-api.service[120741]: DEBUG oslo_concurrency.lockutils [None req-eaef41ab-3709-440f-950e-3c8f894be25f tempest-ServerRescueNegativeTestJSON-412251590 tempest-ServerRescueNegativeTestJSON-412251590-project] Acquiring lock "1daf4f4c-0e4a-4779-b53a-78c48397ea2f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120741) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 18:03:37.717883 dv-cinder-852009-8-iscsi devstack@n-api.service[120741]: DEBUG oslo_concurrency.lockutils [None req-eaef41ab-3709-440f-950e-3c8f894be25f tempest-ServerRescueNegativeTestJSON-412251590 tempest-ServerRescueNegativeTestJSON-412251590-project] Lock "1daf4f4c-0e4a-4779-b53a-78c48397ea2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120741) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 18:03:37.718540 dv-cinder-852009-8-iscsi devstack@n-api.service[120741]: DEBUG oslo_concurrency.lockutils [None req-eaef41ab-3709-440f-950e-3c8f894be25f tempest-ServerRescueNegativeTestJSON-412251590 tempest-ServerRescueNegativeTestJSON-412251590-project] Lock "1daf4f4c-0e4a-4779-b53a-78c48397ea2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120741) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 18:03:37.749326 dv-cinder-852009-8-iscsi devstack@n-api.service[120740]: INFO nova.api.openstack.requestlog [None req-062870dc-9970-4990-85ab-3587c8df81bf tempest-AttachVolumeShelveTestJSON-385853788 tempest-AttachVolumeShelveTestJSON-385853788-project] 10.222.0.43 "POST /compute/v2.1/servers/11d2616a-96f9-4a7a-aab8-219219986a8b/action" status: 202 len: 0 microversion: 2.20 time: 0.339101 Sep 13 18:03:37.750445 dv-cinder-852009-8-iscsi devstack@n-api.service[120740]: [pid: 120740|app: 0|req: 114/219] 10.222.0.43 () {62 vars in 1319 bytes} [Tue Sep 13 18:03:37 2022] POST /compute/v2.1/servers/11d2616a-96f9-4a7a-aab8-219219986a8b/action => generated 0 bytes in 341 msecs (HTTP/1.1 202) 9 headers in 363 bytes (1 switches on core 0) Sep 13 18:03:37.760679 dv-cinder-852009-8-iscsi devstack@n-api.service[120740]: DEBUG nova.api.openstack.wsgi [None req-7682e18f-1986-4a9b-b42e-20a8072a70e6 tempest-AttachVolumeShelveTestJSON-385853788 tempest-AttachVolumeShelveTestJSON-385853788-project] Calling method '>' {{(pid=120740) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 18:03:37.761542 dv-cinder-852009-8-iscsi devstack@n-api.service[120740]: DEBUG nova.compute.api [None req-7682e18f-1986-4a9b-b42e-20a8072a70e6 tempest-AttachVolumeShelveTestJSON-385853788 tempest-AttachVolumeShelveTestJSON-385853788-project] [instance: 11d2616a-96f9-4a7a-aab8-219219986a8b] Fetching instance by UUID {{(pid=120740) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 18:03:37.768648 dv-cinder-852009-8-iscsi devstack@n-api.service[120740]: DEBUG oslo_concurrency.lockutils [None req-7682e18f-1986-4a9b-b42e-20a8072a70e6 tempest-AttachVolumeShelveTestJSON-385853788 tempest-AttachVolumeShelveTestJSON-385853788-project] Acquiring lock "1daf4f4c-0e4a-4779-b53a-78c48397ea2f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120740) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 18:03:37.769505 dv-cinder-852009-8-iscsi devstack@n-api.service[120740]: DEBUG oslo_concurrency.lockutils [None req-7682e18f-1986-4a9b-b42e-20a8072a70e6 tempest-AttachVolumeShelveTestJSON-385853788 tempest-AttachVolumeShelveTestJSON-385853788-project] Lock "1daf4f4c-0e4a-4779-b53a-78c48397ea2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120740) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 18:03:37.770135 dv-cinder-852009-8-iscsi devstack@n-api.service[120740]: DEBUG oslo_concurrency.lockutils [None req-7682e18f-1986-4a9b-b42e-20a8072a70e6 tempest-AttachVolumeShelveTestJSON-385853788 tempest-AttachVolumeShelveTestJSON-385853788-project] Lock "1daf4f4c-0e4a-4779-b53a-78c48397ea2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120740) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 18:03:37.771054 dv-cinder-852009-8-iscsi devstack@n-api.service[120740]: DEBUG oslo_concurrency.lockutils [None req-7682e18f-1986-4a9b-b42e-20a8072a70e6 tempest-AttachVolumeShelveTestJSON-385853788 tempest-AttachVolumeShelveTestJSON-385853788-project] Acquiring lock "1daf4f4c-0e4a-4779-b53a-78c48397ea2f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120740) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 18:03:37.771694 dv-cinder-852009-8-iscsi devstack@n-api.service[120740]: DEBUG oslo_concurrency.lockutils [None req-7682e18f-1986-4a9b-b42e-20a8072a70e6 tempest-AttachVolumeShelveTestJSON-385853788 tempest-AttachVolumeShelveTestJSON-385853788-project] Lock "1daf4f4c-0e4a-4779-b53a-78c48397ea2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120740) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 18:03:37.772687 dv-cinder-852009-8-iscsi devstack@n-api.service[120740]: DEBUG oslo_concurrency.lockutils [None req-7682e18f-1986-4a9b-b42e-20a8072a70e6 tempest-AttachVolumeShelveTestJSON-385853788 tempest-AttachVolumeShelveTestJSON-385853788-project] Lock "1daf4f4c-0e4a-4779-b53a-78c48397ea2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120740) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 18:03:37.795542 dv-cinder-852009-8-iscsi devstack@n-api.service[120740]: DEBUG dbcounter [-] [120740] Writing DB stats nova_cell1:SELECT=97,nova_cell1:UPDATE=2,nova_cell1:INSERT=1 {{(pid=120740) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 18:03:38.018703 dv-cinder-852009-8-iscsi devstack@n-api.service[120741]: DEBUG nova.policy [None req-eaef41ab-3709-440f-950e-3c8f894be25f tempest-ServerRescueNegativeTestJSON-412251590 tempest-ServerRescueNegativeTestJSON-412251590-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '60800cf2774e409d9c1b6f4992669991', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2eae4acecf6c4961830ead78d71b2ad3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120741) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 18:03:38.021685 dv-cinder-852009-8-iscsi devstack@n-api.service[120740]: DEBUG nova.policy [None req-7682e18f-1986-4a9b-b42e-20a8072a70e6 tempest-AttachVolumeShelveTestJSON-385853788 tempest-AttachVolumeShelveTestJSON-385853788-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e68ecd9b3ca643539b109f75bb242d6f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '75e14fd88bfb4cd896fa7b070a0fac47', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120740) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 18:03:38.030226 dv-cinder-852009-8-iscsi devstack@n-api.service[120741]: INFO nova.api.openstack.requestlog [None req-eaef41ab-3709-440f-950e-3c8f894be25f tempest-ServerRescueNegativeTestJSON-412251590 tempest-ServerRescueNegativeTestJSON-412251590-project] 10.222.0.43 "GET /compute/v2.1/servers/a9c22f82-a945-4a94-b3c9-fe95265053bd" status: 200 len: 1523 microversion: 2.1 time: 0.344621 Sep 13 18:03:38.033455 dv-cinder-852009-8-iscsi devstack@n-api.service[120740]: DEBUG nova.policy [None req-7682e18f-1986-4a9b-b42e-20a8072a70e6 tempest-AttachVolumeShelveTestJSON-385853788 tempest-AttachVolumeShelveTestJSON-385853788-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'e68ecd9b3ca643539b109f75bb242d6f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '75e14fd88bfb4cd896fa7b070a0fac47', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120740) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 18:03:38.034171 dv-cinder-852009-8-iscsi devstack@n-api.service[120741]: [pid: 120741|app: 0|req: 106/220] 10.222.0.43 () {58 vars in 1236 bytes} [Tue Sep 13 18:03:37 2022] GET /compute/v2.1/servers/a9c22f82-a945-4a94-b3c9-fe95265053bd => generated 1523 bytes in 349 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 13 18:03:38.036784 dv-cinder-852009-8-iscsi devstack@n-api.service[120740]: DEBUG nova.policy [None req-7682e18f-1986-4a9b-b42e-20a8072a70e6 tempest-AttachVolumeShelveTestJSON-385853788 tempest-AttachVolumeShelveTestJSON-385853788-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'e68ecd9b3ca643539b109f75bb242d6f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '75e14fd88bfb4cd896fa7b070a0fac47', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120740) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 18:03:38.038768 dv-cinder-852009-8-iscsi devstack@n-api.service[120740]: INFO nova.api.openstack.requestlog [None req-7682e18f-1986-4a9b-b42e-20a8072a70e6 tempest-AttachVolumeShelveTestJSON-385853788 tempest-AttachVolumeShelveTestJSON-385853788-project] 10.222.0.43 "GET /compute/v2.1/servers/11d2616a-96f9-4a7a-aab8-219219986a8b" status: 200 len: 1722 microversion: 2.20 time: 0.282666 Sep 13 18:03:38.039554 dv-cinder-852009-8-iscsi devstack@n-api.service[120740]: [pid: 120740|app: 0|req: 115/221] 10.222.0.43 () {60 vars in 1277 bytes} [Tue Sep 13 18:03:37 2022] GET /compute/v2.1/servers/11d2616a-96f9-4a7a-aab8-219219986a8b => generated 1722 bytes in 284 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 13 18:03:39.059965 dv-cinder-852009-8-iscsi devstack@n-api.service[120741]: DEBUG nova.api.openstack.wsgi [None req-506c80ba-1cbf-48f9-9623-7a7a35b0d363 tempest-ServerRescueNegativeTestJSON-412251590 tempest-ServerRescueNegativeTestJSON-412251590-project] Calling method '>' {{(pid=120741) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 18:03:39.060664 dv-cinder-852009-8-iscsi devstack@n-api.service[120741]: DEBUG nova.compute.api [None req-506c80ba-1cbf-48f9-9623-7a7a35b0d363 tempest-ServerRescueNegativeTestJSON-412251590 tempest-ServerRescueNegativeTestJSON-412251590-project] [instance: a9c22f82-a945-4a94-b3c9-fe95265053bd] Fetching instance by UUID {{(pid=120741) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 18:03:39.067821 dv-cinder-852009-8-iscsi devstack@n-api.service[120741]: DEBUG oslo_concurrency.lockutils [None req-506c80ba-1cbf-48f9-9623-7a7a35b0d363 tempest-ServerRescueNegativeTestJSON-412251590 tempest-ServerRescueNegativeTestJSON-412251590-project] Acquiring lock "1daf4f4c-0e4a-4779-b53a-78c48397ea2f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120741) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 18:03:39.069227 dv-cinder-852009-8-iscsi devstack@n-api.service[120741]: DEBUG oslo_concurrency.lockutils [None req-506c80ba-1cbf-48f9-9623-7a7a35b0d363 tempest-ServerRescueNegativeTestJSON-412251590 tempest-ServerRescueNegativeTestJSON-412251590-project] Lock "1daf4f4c-0e4a-4779-b53a-78c48397ea2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120741) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 18:03:39.069833 dv-cinder-852009-8-iscsi devstack@n-api.service[120741]: DEBUG oslo_concurrency.lockutils [None req-506c80ba-1cbf-48f9-9623-7a7a35b0d363 tempest-ServerRescueNegativeTestJSON-412251590 tempest-ServerRescueNegativeTestJSON-412251590-project] Lock "1daf4f4c-0e4a-4779-b53a-78c48397ea2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120741) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 18:03:39.070780 dv-cinder-852009-8-iscsi devstack@n-api.service[120741]: DEBUG oslo_concurrency.lockutils [None req-506c80ba-1cbf-48f9-9623-7a7a35b0d363 tempest-ServerRescueNegativeTestJSON-412251590 tempest-ServerRescueNegativeTestJSON-412251590-project] Acquiring lock "1daf4f4c-0e4a-4779-b53a-78c48397ea2f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120741) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 18:03:39.071388 dv-cinder-852009-8-iscsi devstack@n-api.service[120741]: DEBUG oslo_concurrency.lockutils [None req-506c80ba-1cbf-48f9-9623-7a7a35b0d363 tempest-ServerRescueNegativeTestJSON-412251590 tempest-ServerRescueNegativeTestJSON-412251590-project] Lock "1daf4f4c-0e4a-4779-b53a-78c48397ea2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120741) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 18:03:39.071964 dv-cinder-852009-8-iscsi devstack@n-api.service[120741]: DEBUG oslo_concurrency.lockutils [None req-506c80ba-1cbf-48f9-9623-7a7a35b0d363 tempest-ServerRescueNegativeTestJSON-412251590 tempest-ServerRescueNegativeTestJSON-412251590-project] Lock "1daf4f4c-0e4a-4779-b53a-78c48397ea2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120741) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 18:03:39.073763 dv-cinder-852009-8-iscsi devstack@n-api.service[120740]: DEBUG nova.api.openstack.wsgi [None req-88fb1093-35de-4015-b7ea-9a763d425b97 tempest-AttachVolumeShelveTestJSON-385853788 tempest-AttachVolumeShelveTestJSON-385853788-project] Calling method '>' {{(pid=120740) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 18:03:39.075592 dv-cinder-852009-8-iscsi devstack@n-api.service[120740]: DEBUG nova.compute.api [None req-88fb1093-35de-4015-b7ea-9a763d425b97 tempest-AttachVolumeShelveTestJSON-385853788 tempest-AttachVolumeShelveTestJSON-385853788-project] [instance: 11d2616a-96f9-4a7a-aab8-219219986a8b] Fetching instance by UUID {{(pid=120740) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 18:03:39.084638 dv-cinder-852009-8-iscsi devstack@n-api.service[120740]: DEBUG oslo_concurrency.lockutils [None req-88fb1093-35de-4015-b7ea-9a763d425b97 tempest-AttachVolumeShelveTestJSON-385853788 tempest-AttachVolumeShelveTestJSON-385853788-project] Acquiring lock "1daf4f4c-0e4a-4779-b53a-78c48397ea2f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120740) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 18:03:39.086691 dv-cinder-852009-8-iscsi devstack@n-api.service[120740]: DEBUG oslo_concurrency.lockutils [None req-88fb1093-35de-4015-b7ea-9a763d425b97 tempest-AttachVolumeShelveTestJSON-385853788 tempest-AttachVolumeShelveTestJSON-385853788-project] Lock "1daf4f4c-0e4a-4779-b53a-78c48397ea2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120740) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 18:03:39.087260 dv-cinder-852009-8-iscsi devstack@n-api.service[120740]: DEBUG oslo_concurrency.lockutils [None req-88fb1093-35de-4015-b7ea-9a763d425b97 tempest-AttachVolumeShelveTestJSON-385853788 tempest-AttachVolumeShelveTestJSON-385853788-project] Lock "1daf4f4c-0e4a-4779-b53a-78c48397ea2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120740) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 18:03:39.088093 dv-cinder-852009-8-iscsi devstack@n-api.service[120740]: DEBUG oslo_concurrency.lockutils [None req-88fb1093-35de-4015-b7ea-9a763d425b97 tempest-AttachVolumeShelveTestJSON-385853788 tempest-AttachVolumeShelveTestJSON-385853788-project] Acquiring lock "1daf4f4c-0e4a-4779-b53a-78c48397ea2f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120740) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 18:03:39.089424 dv-cinder-852009-8-iscsi devstack@n-api.service[120740]: DEBUG oslo_concurrency.lockutils [None req-88fb1093-35de-4015-b7ea-9a763d425b97 tempest-AttachVolumeShelveTestJSON-385853788 tempest-AttachVolumeShelveTestJSON-385853788-project] Lock "1daf4f4c-0e4a-4779-b53a-78c48397ea2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120740) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 18:03:39.089983 dv-cinder-852009-8-iscsi devstack@n-api.service[120740]: DEBUG oslo_concurrency.lockutils [None req-88fb1093-35de-4015-b7ea-9a763d425b97 tempest-AttachVolumeShelveTestJSON-385853788 tempest-AttachVolumeShelveTestJSON-385853788-project] Lock "1daf4f4c-0e4a-4779-b53a-78c48397ea2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120740) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 18:03:39.306821 dv-cinder-852009-8-iscsi devstack@n-api.service[120740]: DEBUG nova.policy [None req-88fb1093-35de-4015-b7ea-9a763d425b97 tempest-AttachVolumeShelveTestJSON-385853788 tempest-AttachVolumeShelveTestJSON-385853788-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e68ecd9b3ca643539b109f75bb242d6f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '75e14fd88bfb4cd896fa7b070a0fac47', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120740) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 18:03:39.308985 dv-cinder-852009-8-iscsi devstack@n-api.service[120741]: DEBUG nova.policy [None req-506c80ba-1cbf-48f9-9623-7a7a35b0d363 tempest-ServerRescueNegativeTestJSON-412251590 tempest-ServerRescueNegativeTestJSON-412251590-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '60800cf2774e409d9c1b6f4992669991', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2eae4acecf6c4961830ead78d71b2ad3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120741) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 18:03:39.315904 dv-cinder-852009-8-iscsi devstack@n-api.service[120740]: DEBUG nova.policy [None req-88fb1093-35de-4015-b7ea-9a763d425b97 tempest-AttachVolumeShelveTestJSON-385853788 tempest-AttachVolumeShelveTestJSON-385853788-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'e68ecd9b3ca643539b109f75bb242d6f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '75e14fd88bfb4cd896fa7b070a0fac47', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120740) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 18:03:39.317529 dv-cinder-852009-8-iscsi devstack@n-api.service[120740]: DEBUG nova.policy [None req-88fb1093-35de-4015-b7ea-9a763d425b97 tempest-AttachVolumeShelveTestJSON-385853788 tempest-AttachVolumeShelveTestJSON-385853788-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'e68ecd9b3ca643539b109f75bb242d6f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '75e14fd88bfb4cd896fa7b070a0fac47', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120740) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 18:03:39.318729 dv-cinder-852009-8-iscsi devstack@n-api.service[120740]: INFO nova.api.openstack.requestlog [None req-88fb1093-35de-4015-b7ea-9a763d425b97 tempest-AttachVolumeShelveTestJSON-385853788 tempest-AttachVolumeShelveTestJSON-385853788-project] 10.222.0.43 "GET /compute/v2.1/servers/11d2616a-96f9-4a7a-aab8-219219986a8b" status: 200 len: 1722 microversion: 2.20 time: 0.250559 Sep 13 18:03:39.319295 dv-cinder-852009-8-iscsi devstack@n-api.service[120740]: [pid: 120740|app: 0|req: 116/222] 10.222.0.43 () {60 vars in 1277 bytes} [Tue Sep 13 18:03:39 2022] GET /compute/v2.1/servers/11d2616a-96f9-4a7a-aab8-219219986a8b => generated 1722 bytes in 252 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 13 18:03:39.322897 dv-cinder-852009-8-iscsi devstack@n-api.service[120741]: INFO nova.api.openstack.requestlog [None req-506c80ba-1cbf-48f9-9623-7a7a35b0d363 tempest-ServerRescueNegativeTestJSON-412251590 tempest-ServerRescueNegativeTestJSON-412251590-project] 10.222.0.43 "GET /compute/v2.1/servers/a9c22f82-a945-4a94-b3c9-fe95265053bd" status: 200 len: 1523 microversion: 2.1 time: 0.265563 Sep 13 18:03:39.324255 dv-cinder-852009-8-iscsi devstack@n-api.service[120741]: [pid: 120741|app: 0|req: 107/223] 10.222.0.43 () {58 vars in 1236 bytes} [Tue Sep 13 18:03:39 2022] GET /compute/v2.1/servers/a9c22f82-a945-4a94-b3c9-fe95265053bd => generated 1523 bytes in 269 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 13 18:03:40.357024 dv-cinder-852009-8-iscsi devstack@n-api.service[120740]: DEBUG nova.api.openstack.wsgi [None req-4c5c4d93-a546-45c4-9b56-55c8419b82e3 tempest-ServerRescueNegativeTestJSON-412251590 tempest-ServerRescueNegativeTestJSON-412251590-project] Calling method '>' {{(pid=120740) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 18:03:40.357623 dv-cinder-852009-8-iscsi devstack@n-api.service[120740]: DEBUG nova.compute.api [None req-4c5c4d93-a546-45c4-9b56-55c8419b82e3 tempest-ServerRescueNegativeTestJSON-412251590 tempest-ServerRescueNegativeTestJSON-412251590-project] [instance: a9c22f82-a945-4a94-b3c9-fe95265053bd] Fetching instance by UUID {{(pid=120740) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 18:03:40.360677 dv-cinder-852009-8-iscsi devstack@n-api.service[120741]: DEBUG nova.api.openstack.wsgi [None req-638e5dc5-a3df-41f6-8069-c8b90852fd30 tempest-AttachVolumeShelveTestJSON-385853788 tempest-AttachVolumeShelveTestJSON-385853788-project] Calling method '>' {{(pid=120741) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 18:03:40.361275 dv-cinder-852009-8-iscsi devstack@n-api.service[120741]: DEBUG nova.compute.api [None req-638e5dc5-a3df-41f6-8069-c8b90852fd30 tempest-AttachVolumeShelveTestJSON-385853788 tempest-AttachVolumeShelveTestJSON-385853788-project] [instance: 11d2616a-96f9-4a7a-aab8-219219986a8b] Fetching instance by UUID {{(pid=120741) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 18:03:40.368414 dv-cinder-852009-8-iscsi devstack@n-api.service[120740]: DEBUG oslo_concurrency.lockutils [None req-4c5c4d93-a546-45c4-9b56-55c8419b82e3 tempest-ServerRescueNegativeTestJSON-412251590 tempest-ServerRescueNegativeTestJSON-412251590-project] Acquiring lock "1daf4f4c-0e4a-4779-b53a-78c48397ea2f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120740) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 18:03:40.368990 dv-cinder-852009-8-iscsi devstack@n-api.service[120740]: DEBUG oslo_concurrency.lockutils [None req-4c5c4d93-a546-45c4-9b56-55c8419b82e3 tempest-ServerRescueNegativeTestJSON-412251590 tempest-ServerRescueNegativeTestJSON-412251590-project] Lock "1daf4f4c-0e4a-4779-b53a-78c48397ea2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120740) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 18:03:40.369409 dv-cinder-852009-8-iscsi devstack@n-api.service[120740]: DEBUG oslo_concurrency.lockutils [None req-4c5c4d93-a546-45c4-9b56-55c8419b82e3 tempest-ServerRescueNegativeTestJSON-412251590 tempest-ServerRescueNegativeTestJSON-412251590-project] Lock "1daf4f4c-0e4a-4779-b53a-78c48397ea2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120740) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 18:03:40.370132 dv-cinder-852009-8-iscsi devstack@n-api.service[120740]: DEBUG oslo_concurrency.lockutils [None req-4c5c4d93-a546-45c4-9b56-55c8419b82e3 tempest-ServerRescueNegativeTestJSON-412251590 tempest-ServerRescueNegativeTestJSON-412251590-project] Acquiring lock "1daf4f4c-0e4a-4779-b53a-78c48397ea2f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120740) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 18:03:40.370747 dv-cinder-852009-8-iscsi devstack@n-api.service[120740]: DEBUG oslo_concurrency.lockutils [None req-4c5c4d93-a546-45c4-9b56-55c8419b82e3 tempest-ServerRescueNegativeTestJSON-412251590 tempest-ServerRescueNegativeTestJSON-412251590-project] Lock "1daf4f4c-0e4a-4779-b53a-78c48397ea2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120740) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 18:03:40.371175 dv-cinder-852009-8-iscsi devstack@n-api.service[120740]: DEBUG oslo_concurrency.lockutils [None req-4c5c4d93-a546-45c4-9b56-55c8419b82e3 tempest-ServerRescueNegativeTestJSON-412251590 tempest-ServerRescueNegativeTestJSON-412251590-project] Lock "1daf4f4c-0e4a-4779-b53a-78c48397ea2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120740) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 18:03:40.388267 dv-cinder-852009-8-iscsi devstack@n-api.service[120741]: DEBUG oslo_concurrency.lockutils [None req-638e5dc5-a3df-41f6-8069-c8b90852fd30 tempest-AttachVolumeShelveTestJSON-385853788 tempest-AttachVolumeShelveTestJSON-385853788-project] Acquiring lock "1daf4f4c-0e4a-4779-b53a-78c48397ea2f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120741) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 18:03:40.389061 dv-cinder-852009-8-iscsi devstack@n-api.service[120741]: DEBUG oslo_concurrency.lockutils [None req-638e5dc5-a3df-41f6-8069-c8b90852fd30 tempest-AttachVolumeShelveTestJSON-385853788 tempest-AttachVolumeShelveTestJSON-385853788-project] Lock "1daf4f4c-0e4a-4779-b53a-78c48397ea2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120741) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 18:03:40.389486 dv-cinder-852009-8-iscsi devstack@n-api.service[120741]: DEBUG oslo_concurrency.lockutils [None req-638e5dc5-a3df-41f6-8069-c8b90852fd30 tempest-AttachVolumeShelveTestJSON-385853788 tempest-AttachVolumeShelveTestJSON-385853788-project] Lock "1daf4f4c-0e4a-4779-b53a-78c48397ea2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120741) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 18:03:40.390199 dv-cinder-852009-8-iscsi devstack@n-api.service[120741]: DEBUG oslo_concurrency.lockutils [None req-638e5dc5-a3df-41f6-8069-c8b90852fd30 tempest-AttachVolumeShelveTestJSON-385853788 tempest-AttachVolumeShelveTestJSON-385853788-project] Acquiring lock "1daf4f4c-0e4a-4779-b53a-78c48397ea2f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120741) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 18:03:40.390641 dv-cinder-852009-8-iscsi devstack@n-api.service[120741]: DEBUG oslo_concurrency.lockutils [None req-638e5dc5-a3df-41f6-8069-c8b90852fd30 tempest-AttachVolumeShelveTestJSON-385853788 tempest-AttachVolumeShelveTestJSON-385853788-project] Lock "1daf4f4c-0e4a-4779-b53a-78c48397ea2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120741) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 18:03:40.391381 dv-cinder-852009-8-iscsi devstack@n-api.service[120741]: DEBUG oslo_concurrency.lockutils [None req-638e5dc5-a3df-41f6-8069-c8b90852fd30 tempest-AttachVolumeShelveTestJSON-385853788 tempest-AttachVolumeShelveTestJSON-385853788-project] Lock "1daf4f4c-0e4a-4779-b53a-78c48397ea2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120741) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 18:03:40.671254 dv-cinder-852009-8-iscsi devstack@n-api.service[120741]: DEBUG nova.policy [None req-638e5dc5-a3df-41f6-8069-c8b90852fd30 tempest-AttachVolumeShelveTestJSON-385853788 tempest-AttachVolumeShelveTestJSON-385853788-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e68ecd9b3ca643539b109f75bb242d6f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '75e14fd88bfb4cd896fa7b070a0fac47', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120741) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 18:03:40.687549 dv-cinder-852009-8-iscsi devstack@n-api.service[120741]: DEBUG nova.policy [None req-638e5dc5-a3df-41f6-8069-c8b90852fd30 tempest-AttachVolumeShelveTestJSON-385853788 tempest-AttachVolumeShelveTestJSON-385853788-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'e68ecd9b3ca643539b109f75bb242d6f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '75e14fd88bfb4cd896fa7b070a0fac47', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120741) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 18:03:40.707442 dv-cinder-852009-8-iscsi devstack@n-api.service[120741]: DEBUG nova.policy [None req-638e5dc5-a3df-41f6-8069-c8b90852fd30 tempest-AttachVolumeShelveTestJSON-385853788 tempest-AttachVolumeShelveTestJSON-385853788-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'e68ecd9b3ca643539b109f75bb242d6f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '75e14fd88bfb4cd896fa7b070a0fac47', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120741) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 18:03:40.709428 dv-cinder-852009-8-iscsi devstack@n-api.service[120741]: INFO nova.api.openstack.requestlog [None req-638e5dc5-a3df-41f6-8069-c8b90852fd30 tempest-AttachVolumeShelveTestJSON-385853788 tempest-AttachVolumeShelveTestJSON-385853788-project] 10.222.0.43 "GET /compute/v2.1/servers/11d2616a-96f9-4a7a-aab8-219219986a8b" status: 200 len: 1722 microversion: 2.20 time: 0.353107 Sep 13 18:03:40.717357 dv-cinder-852009-8-iscsi devstack@n-api.service[120740]: DEBUG nova.policy [None req-4c5c4d93-a546-45c4-9b56-55c8419b82e3 tempest-ServerRescueNegativeTestJSON-412251590 tempest-ServerRescueNegativeTestJSON-412251590-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '60800cf2774e409d9c1b6f4992669991', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2eae4acecf6c4961830ead78d71b2ad3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120740) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 18:03:40.730519 dv-cinder-852009-8-iscsi devstack@n-api.service[120741]: [pid: 120741|app: 0|req: 108/224] 10.222.0.43 () {60 vars in 1277 bytes} [Tue Sep 13 18:03:40 2022] GET /compute/v2.1/servers/11d2616a-96f9-4a7a-aab8-219219986a8b => generated 1722 bytes in 371 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Sep 13 18:03:40.746786 dv-cinder-852009-8-iscsi devstack@n-api.service[120740]: INFO nova.api.openstack.requestlog [None req-4c5c4d93-a546-45c4-9b56-55c8419b82e3 tempest-ServerRescueNegativeTestJSON-412251590 tempest-ServerRescueNegativeTestJSON-412251590-project] 10.222.0.43 "GET /compute/v2.1/servers/a9c22f82-a945-4a94-b3c9-fe95265053bd" status: 200 len: 1523 microversion: 2.1 time: 0.393762 Sep 13 18:03:40.756875 dv-cinder-852009-8-iscsi devstack@n-api.service[120740]: [pid: 120740|app: 0|req: 117/225] 10.222.0.43 () {58 vars in 1236 bytes} [Tue Sep 13 18:03:40 2022] GET /compute/v2.1/servers/a9c22f82-a945-4a94-b3c9-fe95265053bd => generated 1523 bytes in 400 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 13 18:03:41.737832 dv-cinder-852009-8-iscsi devstack@n-api.service[120741]: DEBUG nova.api.openstack.wsgi [None req-0c7dd8d6-ac51-49b9-b2ef-e5f60e188326 tempest-AttachVolumeShelveTestJSON-385853788 tempest-AttachVolumeShelveTestJSON-385853788-project] Calling method '>' {{(pid=120741) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 18:03:41.738432 dv-cinder-852009-8-iscsi devstack@n-api.service[120741]: DEBUG nova.compute.api [None req-0c7dd8d6-ac51-49b9-b2ef-e5f60e188326 tempest-AttachVolumeShelveTestJSON-385853788 tempest-AttachVolumeShelveTestJSON-385853788-project] [instance: 11d2616a-96f9-4a7a-aab8-219219986a8b] Fetching instance by UUID {{(pid=120741) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 18:03:41.745040 dv-cinder-852009-8-iscsi devstack@n-api.service[120741]: DEBUG oslo_concurrency.lockutils [None req-0c7dd8d6-ac51-49b9-b2ef-e5f60e188326 tempest-AttachVolumeShelveTestJSON-385853788 tempest-AttachVolumeShelveTestJSON-385853788-project] Acquiring lock "1daf4f4c-0e4a-4779-b53a-78c48397ea2f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120741) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 18:03:41.745580 dv-cinder-852009-8-iscsi devstack@n-api.service[120741]: DEBUG oslo_concurrency.lockutils [None req-0c7dd8d6-ac51-49b9-b2ef-e5f60e188326 tempest-AttachVolumeShelveTestJSON-385853788 tempest-AttachVolumeShelveTestJSON-385853788-project] Lock "1daf4f4c-0e4a-4779-b53a-78c48397ea2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120741) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 18:03:41.746005 dv-cinder-852009-8-iscsi devstack@n-api.service[120741]: DEBUG oslo_concurrency.lockutils [None req-0c7dd8d6-ac51-49b9-b2ef-e5f60e188326 tempest-AttachVolumeShelveTestJSON-385853788 tempest-AttachVolumeShelveTestJSON-385853788-project] Lock "1daf4f4c-0e4a-4779-b53a-78c48397ea2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120741) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 18:03:41.746706 dv-cinder-852009-8-iscsi devstack@n-api.service[120741]: DEBUG oslo_concurrency.lockutils [None req-0c7dd8d6-ac51-49b9-b2ef-e5f60e188326 tempest-AttachVolumeShelveTestJSON-385853788 tempest-AttachVolumeShelveTestJSON-385853788-project] Acquiring lock "1daf4f4c-0e4a-4779-b53a-78c48397ea2f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120741) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 18:03:41.747145 dv-cinder-852009-8-iscsi devstack@n-api.service[120741]: DEBUG oslo_concurrency.lockutils [None req-0c7dd8d6-ac51-49b9-b2ef-e5f60e188326 tempest-AttachVolumeShelveTestJSON-385853788 tempest-AttachVolumeShelveTestJSON-385853788-project] Lock "1daf4f4c-0e4a-4779-b53a-78c48397ea2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120741) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 18:03:41.747560 dv-cinder-852009-8-iscsi devstack@n-api.service[120741]: DEBUG oslo_concurrency.lockutils [None req-0c7dd8d6-ac51-49b9-b2ef-e5f60e188326 tempest-AttachVolumeShelveTestJSON-385853788 tempest-AttachVolumeShelveTestJSON-385853788-project] Lock "1daf4f4c-0e4a-4779-b53a-78c48397ea2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120741) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 18:03:41.770768 dv-cinder-852009-8-iscsi devstack@n-api.service[120740]: DEBUG nova.api.openstack.wsgi [None req-533ac6fa-c0a6-4454-b36f-ac733a0be0be tempest-ServerRescueNegativeTestJSON-412251590 tempest-ServerRescueNegativeTestJSON-412251590-project] Calling method '>' {{(pid=120740) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 18:03:41.771373 dv-cinder-852009-8-iscsi devstack@n-api.service[120740]: DEBUG nova.compute.api [None req-533ac6fa-c0a6-4454-b36f-ac733a0be0be tempest-ServerRescueNegativeTestJSON-412251590 tempest-ServerRescueNegativeTestJSON-412251590-project] [instance: a9c22f82-a945-4a94-b3c9-fe95265053bd] Fetching instance by UUID {{(pid=120740) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 18:03:41.777722 dv-cinder-852009-8-iscsi devstack@n-api.service[120740]: DEBUG oslo_concurrency.lockutils [None req-533ac6fa-c0a6-4454-b36f-ac733a0be0be tempest-ServerRescueNegativeTestJSON-412251590 tempest-ServerRescueNegativeTestJSON-412251590-project] Acquiring lock "1daf4f4c-0e4a-4779-b53a-78c48397ea2f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120740) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 18:03:41.778214 dv-cinder-852009-8-iscsi devstack@n-api.service[120740]: DEBUG oslo_concurrency.lockutils [None req-533ac6fa-c0a6-4454-b36f-ac733a0be0be tempest-ServerRescueNegativeTestJSON-412251590 tempest-ServerRescueNegativeTestJSON-412251590-project] Lock "1daf4f4c-0e4a-4779-b53a-78c48397ea2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120740) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 18:03:41.778641 dv-cinder-852009-8-iscsi devstack@n-api.service[120740]: DEBUG oslo_concurrency.lockutils [None req-533ac6fa-c0a6-4454-b36f-ac733a0be0be tempest-ServerRescueNegativeTestJSON-412251590 tempest-ServerRescueNegativeTestJSON-412251590-project] Lock "1daf4f4c-0e4a-4779-b53a-78c48397ea2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120740) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 18:03:41.779329 dv-cinder-852009-8-iscsi devstack@n-api.service[120740]: DEBUG oslo_concurrency.lockutils [None req-533ac6fa-c0a6-4454-b36f-ac733a0be0be tempest-ServerRescueNegativeTestJSON-412251590 tempest-ServerRescueNegativeTestJSON-412251590-project] Acquiring lock "1daf4f4c-0e4a-4779-b53a-78c48397ea2f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120740) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 18:03:41.779776 dv-cinder-852009-8-iscsi devstack@n-api.service[120740]: DEBUG oslo_concurrency.lockutils [None req-533ac6fa-c0a6-4454-b36f-ac733a0be0be tempest-ServerRescueNegativeTestJSON-412251590 tempest-ServerRescueNegativeTestJSON-412251590-project] Lock "1daf4f4c-0e4a-4779-b53a-78c48397ea2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120740) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 18:03:41.780196 dv-cinder-852009-8-iscsi devstack@n-api.service[120740]: DEBUG oslo_concurrency.lockutils [None req-533ac6fa-c0a6-4454-b36f-ac733a0be0be tempest-ServerRescueNegativeTestJSON-412251590 tempest-ServerRescueNegativeTestJSON-412251590-project] Lock "1daf4f4c-0e4a-4779-b53a-78c48397ea2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120740) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 18:03:41.948045 dv-cinder-852009-8-iscsi devstack@n-api.service[120741]: DEBUG nova.policy [None req-0c7dd8d6-ac51-49b9-b2ef-e5f60e188326 tempest-AttachVolumeShelveTestJSON-385853788 tempest-AttachVolumeShelveTestJSON-385853788-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e68ecd9b3ca643539b109f75bb242d6f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '75e14fd88bfb4cd896fa7b070a0fac47', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120741) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 18:03:41.952254 dv-cinder-852009-8-iscsi devstack@n-api.service[120740]: DEBUG nova.policy [None req-533ac6fa-c0a6-4454-b36f-ac733a0be0be tempest-ServerRescueNegativeTestJSON-412251590 tempest-ServerRescueNegativeTestJSON-412251590-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '60800cf2774e409d9c1b6f4992669991', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2eae4acecf6c4961830ead78d71b2ad3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120740) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 18:03:41.956692 dv-cinder-852009-8-iscsi devstack@n-api.service[120741]: DEBUG nova.policy [None req-0c7dd8d6-ac51-49b9-b2ef-e5f60e188326 tempest-AttachVolumeShelveTestJSON-385853788 tempest-AttachVolumeShelveTestJSON-385853788-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'e68ecd9b3ca643539b109f75bb242d6f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '75e14fd88bfb4cd896fa7b070a0fac47', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120741) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 18:03:41.958230 dv-cinder-852009-8-iscsi devstack@n-api.service[120741]: DEBUG nova.policy [None req-0c7dd8d6-ac51-49b9-b2ef-e5f60e188326 tempest-AttachVolumeShelveTestJSON-385853788 tempest-AttachVolumeShelveTestJSON-385853788-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'e68ecd9b3ca643539b109f75bb242d6f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '75e14fd88bfb4cd896fa7b070a0fac47', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120741) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 18:03:41.959450 dv-cinder-852009-8-iscsi devstack@n-api.service[120741]: INFO nova.api.openstack.requestlog [None req-0c7dd8d6-ac51-49b9-b2ef-e5f60e188326 tempest-AttachVolumeShelveTestJSON-385853788 tempest-AttachVolumeShelveTestJSON-385853788-project] 10.222.0.43 "GET /compute/v2.1/servers/11d2616a-96f9-4a7a-aab8-219219986a8b" status: 200 len: 1722 microversion: 2.20 time: 0.225625 Sep 13 18:03:41.960189 dv-cinder-852009-8-iscsi devstack@n-api.service[120741]: [pid: 120741|app: 0|req: 109/226] 10.222.0.43 () {60 vars in 1277 bytes} [Tue Sep 13 18:03:41 2022] GET /compute/v2.1/servers/11d2616a-96f9-4a7a-aab8-219219986a8b => generated 1722 bytes in 227 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 13 18:03:41.961327 dv-cinder-852009-8-iscsi devstack@n-api.service[120740]: INFO nova.api.openstack.requestlog [None req-533ac6fa-c0a6-4454-b36f-ac733a0be0be tempest-ServerRescueNegativeTestJSON-412251590 tempest-ServerRescueNegativeTestJSON-412251590-project] 10.222.0.43 "GET /compute/v2.1/servers/a9c22f82-a945-4a94-b3c9-fe95265053bd" status: 200 len: 1523 microversion: 2.1 time: 0.194876 Sep 13 18:03:41.962150 dv-cinder-852009-8-iscsi devstack@n-api.service[120740]: [pid: 120740|app: 0|req: 118/227] 10.222.0.43 () {58 vars in 1236 bytes} [Tue Sep 13 18:03:41 2022] GET /compute/v2.1/servers/a9c22f82-a945-4a94-b3c9-fe95265053bd => generated 1523 bytes in 196 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 13 18:03:42.986660 dv-cinder-852009-8-iscsi devstack@n-api.service[120741]: DEBUG nova.api.openstack.wsgi [None req-6eaa1063-839f-4115-9fd3-4d2691b2f11e tempest-ServerRescueNegativeTestJSON-412251590 tempest-ServerRescueNegativeTestJSON-412251590-project] Calling method '>' {{(pid=120741) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 18:03:42.987331 dv-cinder-852009-8-iscsi devstack@n-api.service[120740]: DEBUG nova.api.openstack.wsgi [None req-3c6ad1ab-6701-4095-b921-9f1724d68a4a tempest-AttachVolumeShelveTestJSON-385853788 tempest-AttachVolumeShelveTestJSON-385853788-project] Calling method '>' {{(pid=120740) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 18:03:42.987772 dv-cinder-852009-8-iscsi devstack@n-api.service[120741]: DEBUG nova.compute.api [None req-6eaa1063-839f-4115-9fd3-4d2691b2f11e tempest-ServerRescueNegativeTestJSON-412251590 tempest-ServerRescueNegativeTestJSON-412251590-project] [instance: a9c22f82-a945-4a94-b3c9-fe95265053bd] Fetching instance by UUID {{(pid=120741) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 18:03:42.987890 dv-cinder-852009-8-iscsi devstack@n-api.service[120740]: DEBUG nova.compute.api [None req-3c6ad1ab-6701-4095-b921-9f1724d68a4a tempest-AttachVolumeShelveTestJSON-385853788 tempest-AttachVolumeShelveTestJSON-385853788-project] [instance: 11d2616a-96f9-4a7a-aab8-219219986a8b] Fetching instance by UUID {{(pid=120740) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 18:03:42.995697 dv-cinder-852009-8-iscsi devstack@n-api.service[120740]: DEBUG oslo_concurrency.lockutils [None req-3c6ad1ab-6701-4095-b921-9f1724d68a4a tempest-AttachVolumeShelveTestJSON-385853788 tempest-AttachVolumeShelveTestJSON-385853788-project] Acquiring lock "1daf4f4c-0e4a-4779-b53a-78c48397ea2f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120740) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 18:03:42.995893 dv-cinder-852009-8-iscsi devstack@n-api.service[120741]: DEBUG oslo_concurrency.lockutils [None req-6eaa1063-839f-4115-9fd3-4d2691b2f11e tempest-ServerRescueNegativeTestJSON-412251590 tempest-ServerRescueNegativeTestJSON-412251590-project] Acquiring lock "1daf4f4c-0e4a-4779-b53a-78c48397ea2f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120741) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 18:03:42.996319 dv-cinder-852009-8-iscsi devstack@n-api.service[120740]: DEBUG oslo_concurrency.lockutils [None req-3c6ad1ab-6701-4095-b921-9f1724d68a4a tempest-AttachVolumeShelveTestJSON-385853788 tempest-AttachVolumeShelveTestJSON-385853788-project] Lock "1daf4f4c-0e4a-4779-b53a-78c48397ea2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120740) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 18:03:42.996516 dv-cinder-852009-8-iscsi devstack@n-api.service[120741]: DEBUG oslo_concurrency.lockutils [None req-6eaa1063-839f-4115-9fd3-4d2691b2f11e tempest-ServerRescueNegativeTestJSON-412251590 tempest-ServerRescueNegativeTestJSON-412251590-project] Lock "1daf4f4c-0e4a-4779-b53a-78c48397ea2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120741) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 18:03:42.996902 dv-cinder-852009-8-iscsi devstack@n-api.service[120740]: DEBUG oslo_concurrency.lockutils [None req-3c6ad1ab-6701-4095-b921-9f1724d68a4a tempest-AttachVolumeShelveTestJSON-385853788 tempest-AttachVolumeShelveTestJSON-385853788-project] Lock "1daf4f4c-0e4a-4779-b53a-78c48397ea2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120740) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 18:03:42.997081 dv-cinder-852009-8-iscsi devstack@n-api.service[120741]: DEBUG oslo_concurrency.lockutils [None req-6eaa1063-839f-4115-9fd3-4d2691b2f11e tempest-ServerRescueNegativeTestJSON-412251590 tempest-ServerRescueNegativeTestJSON-412251590-project] Lock "1daf4f4c-0e4a-4779-b53a-78c48397ea2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120741) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 18:03:42.997745 dv-cinder-852009-8-iscsi devstack@n-api.service[120740]: DEBUG oslo_concurrency.lockutils [None req-3c6ad1ab-6701-4095-b921-9f1724d68a4a tempest-AttachVolumeShelveTestJSON-385853788 tempest-AttachVolumeShelveTestJSON-385853788-project] Acquiring lock "1daf4f4c-0e4a-4779-b53a-78c48397ea2f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120740) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 18:03:42.997873 dv-cinder-852009-8-iscsi devstack@n-api.service[120741]: DEBUG oslo_concurrency.lockutils [None req-6eaa1063-839f-4115-9fd3-4d2691b2f11e tempest-ServerRescueNegativeTestJSON-412251590 tempest-ServerRescueNegativeTestJSON-412251590-project] Acquiring lock "1daf4f4c-0e4a-4779-b53a-78c48397ea2f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120741) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 18:03:42.998289 dv-cinder-852009-8-iscsi devstack@n-api.service[120740]: DEBUG oslo_concurrency.lockutils [None req-3c6ad1ab-6701-4095-b921-9f1724d68a4a tempest-AttachVolumeShelveTestJSON-385853788 tempest-AttachVolumeShelveTestJSON-385853788-project] Lock "1daf4f4c-0e4a-4779-b53a-78c48397ea2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120740) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 18:03:42.998435 dv-cinder-852009-8-iscsi devstack@n-api.service[120741]: DEBUG oslo_concurrency.lockutils [None req-6eaa1063-839f-4115-9fd3-4d2691b2f11e tempest-ServerRescueNegativeTestJSON-412251590 tempest-ServerRescueNegativeTestJSON-412251590-project] Lock "1daf4f4c-0e4a-4779-b53a-78c48397ea2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120741) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 18:03:43.000001 dv-cinder-852009-8-iscsi devstack@n-api.service[120740]: DEBUG oslo_concurrency.lockutils [None req-3c6ad1ab-6701-4095-b921-9f1724d68a4a tempest-AttachVolumeShelveTestJSON-385853788 tempest-AttachVolumeShelveTestJSON-385853788-project] Lock "1daf4f4c-0e4a-4779-b53a-78c48397ea2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120740) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 18:03:43.000683 dv-cinder-852009-8-iscsi devstack@n-api.service[120741]: DEBUG oslo_concurrency.lockutils [None req-6eaa1063-839f-4115-9fd3-4d2691b2f11e tempest-ServerRescueNegativeTestJSON-412251590 tempest-ServerRescueNegativeTestJSON-412251590-project] Lock "1daf4f4c-0e4a-4779-b53a-78c48397ea2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120741) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 18:03:43.197649 dv-cinder-852009-8-iscsi devstack@n-api.service[120741]: DEBUG nova.policy [None req-6eaa1063-839f-4115-9fd3-4d2691b2f11e tempest-ServerRescueNegativeTestJSON-412251590 tempest-ServerRescueNegativeTestJSON-412251590-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '60800cf2774e409d9c1b6f4992669991', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2eae4acecf6c4961830ead78d71b2ad3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120741) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 18:03:43.206145 dv-cinder-852009-8-iscsi devstack@n-api.service[120740]: DEBUG nova.policy [None req-3c6ad1ab-6701-4095-b921-9f1724d68a4a tempest-AttachVolumeShelveTestJSON-385853788 tempest-AttachVolumeShelveTestJSON-385853788-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e68ecd9b3ca643539b109f75bb242d6f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '75e14fd88bfb4cd896fa7b070a0fac47', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120740) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 18:03:43.206456 dv-cinder-852009-8-iscsi devstack@n-api.service[120741]: INFO nova.api.openstack.requestlog [None req-6eaa1063-839f-4115-9fd3-4d2691b2f11e tempest-ServerRescueNegativeTestJSON-412251590 tempest-ServerRescueNegativeTestJSON-412251590-project] 10.222.0.43 "GET /compute/v2.1/servers/a9c22f82-a945-4a94-b3c9-fe95265053bd" status: 200 len: 1523 microversion: 2.1 time: 0.224663 Sep 13 18:03:43.207181 dv-cinder-852009-8-iscsi devstack@n-api.service[120741]: [pid: 120741|app: 0|req: 110/228] 10.222.0.43 () {58 vars in 1236 bytes} [Tue Sep 13 18:03:42 2022] GET /compute/v2.1/servers/a9c22f82-a945-4a94-b3c9-fe95265053bd => generated 1523 bytes in 226 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 13 18:03:43.215090 dv-cinder-852009-8-iscsi devstack@n-api.service[120740]: DEBUG nova.policy [None req-3c6ad1ab-6701-4095-b921-9f1724d68a4a tempest-AttachVolumeShelveTestJSON-385853788 tempest-AttachVolumeShelveTestJSON-385853788-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'e68ecd9b3ca643539b109f75bb242d6f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '75e14fd88bfb4cd896fa7b070a0fac47', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120740) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 18:03:43.216714 dv-cinder-852009-8-iscsi devstack@n-api.service[120740]: DEBUG nova.policy [None req-3c6ad1ab-6701-4095-b921-9f1724d68a4a tempest-AttachVolumeShelveTestJSON-385853788 tempest-AttachVolumeShelveTestJSON-385853788-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'e68ecd9b3ca643539b109f75bb242d6f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '75e14fd88bfb4cd896fa7b070a0fac47', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120740) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 18:03:43.218013 dv-cinder-852009-8-iscsi devstack@n-api.service[120740]: INFO nova.api.openstack.requestlog [None req-3c6ad1ab-6701-4095-b921-9f1724d68a4a tempest-AttachVolumeShelveTestJSON-385853788 tempest-AttachVolumeShelveTestJSON-385853788-project] 10.222.0.43 "GET /compute/v2.1/servers/11d2616a-96f9-4a7a-aab8-219219986a8b" status: 200 len: 1722 microversion: 2.20 time: 0.236086 Sep 13 18:03:43.218639 dv-cinder-852009-8-iscsi devstack@n-api.service[120740]: [pid: 120740|app: 0|req: 119/229] 10.222.0.43 () {60 vars in 1277 bytes} [Tue Sep 13 18:03:42 2022] GET /compute/v2.1/servers/11d2616a-96f9-4a7a-aab8-219219986a8b => generated 1722 bytes in 237 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 13 18:03:44.237172 dv-cinder-852009-8-iscsi devstack@n-api.service[120741]: DEBUG nova.api.openstack.wsgi [None req-9dcac5e4-e5c7-4ad6-b562-cb81f7fbe181 tempest-ServerRescueNegativeTestJSON-412251590 tempest-ServerRescueNegativeTestJSON-412251590-project] Calling method '>' {{(pid=120741) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 18:03:44.238765 dv-cinder-852009-8-iscsi devstack@n-api.service[120741]: DEBUG nova.compute.api [None req-9dcac5e4-e5c7-4ad6-b562-cb81f7fbe181 tempest-ServerRescueNegativeTestJSON-412251590 tempest-ServerRescueNegativeTestJSON-412251590-project] [instance: a9c22f82-a945-4a94-b3c9-fe95265053bd] Fetching instance by UUID {{(pid=120741) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 18:03:44.246827 dv-cinder-852009-8-iscsi devstack@n-api.service[120740]: DEBUG nova.api.openstack.wsgi [None req-9dc094cd-e1ce-461b-b685-a07294bf3941 tempest-AttachVolumeShelveTestJSON-385853788 tempest-AttachVolumeShelveTestJSON-385853788-project] Calling method '>' {{(pid=120740) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 18:03:44.248104 dv-cinder-852009-8-iscsi devstack@n-api.service[120740]: DEBUG nova.compute.api [None req-9dc094cd-e1ce-461b-b685-a07294bf3941 tempest-AttachVolumeShelveTestJSON-385853788 tempest-AttachVolumeShelveTestJSON-385853788-project] [instance: 11d2616a-96f9-4a7a-aab8-219219986a8b] Fetching instance by UUID {{(pid=120740) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 18:03:44.250338 dv-cinder-852009-8-iscsi devstack@n-api.service[120741]: DEBUG oslo_concurrency.lockutils [None req-9dcac5e4-e5c7-4ad6-b562-cb81f7fbe181 tempest-ServerRescueNegativeTestJSON-412251590 tempest-ServerRescueNegativeTestJSON-412251590-project] Acquiring lock "1daf4f4c-0e4a-4779-b53a-78c48397ea2f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120741) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 18:03:44.251054 dv-cinder-852009-8-iscsi devstack@n-api.service[120741]: DEBUG oslo_concurrency.lockutils [None req-9dcac5e4-e5c7-4ad6-b562-cb81f7fbe181 tempest-ServerRescueNegativeTestJSON-412251590 tempest-ServerRescueNegativeTestJSON-412251590-project] Lock "1daf4f4c-0e4a-4779-b53a-78c48397ea2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120741) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 18:03:44.251803 dv-cinder-852009-8-iscsi devstack@n-api.service[120741]: DEBUG oslo_concurrency.lockutils [None req-9dcac5e4-e5c7-4ad6-b562-cb81f7fbe181 tempest-ServerRescueNegativeTestJSON-412251590 tempest-ServerRescueNegativeTestJSON-412251590-project] Lock "1daf4f4c-0e4a-4779-b53a-78c48397ea2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120741) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 18:03:44.253630 dv-cinder-852009-8-iscsi devstack@n-api.service[120741]: DEBUG oslo_concurrency.lockutils [None req-9dcac5e4-e5c7-4ad6-b562-cb81f7fbe181 tempest-ServerRescueNegativeTestJSON-412251590 tempest-ServerRescueNegativeTestJSON-412251590-project] Acquiring lock "1daf4f4c-0e4a-4779-b53a-78c48397ea2f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120741) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 18:03:44.254312 dv-cinder-852009-8-iscsi devstack@n-api.service[120741]: DEBUG oslo_concurrency.lockutils [None req-9dcac5e4-e5c7-4ad6-b562-cb81f7fbe181 tempest-ServerRescueNegativeTestJSON-412251590 tempest-ServerRescueNegativeTestJSON-412251590-project] Lock "1daf4f4c-0e4a-4779-b53a-78c48397ea2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120741) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 18:03:44.255124 dv-cinder-852009-8-iscsi devstack@n-api.service[120741]: DEBUG oslo_concurrency.lockutils [None req-9dcac5e4-e5c7-4ad6-b562-cb81f7fbe181 tempest-ServerRescueNegativeTestJSON-412251590 tempest-ServerRescueNegativeTestJSON-412251590-project] Lock "1daf4f4c-0e4a-4779-b53a-78c48397ea2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120741) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 18:03:44.259138 dv-cinder-852009-8-iscsi devstack@n-api.service[120740]: DEBUG oslo_concurrency.lockutils [None req-9dc094cd-e1ce-461b-b685-a07294bf3941 tempest-AttachVolumeShelveTestJSON-385853788 tempest-AttachVolumeShelveTestJSON-385853788-project] Acquiring lock "1daf4f4c-0e4a-4779-b53a-78c48397ea2f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120740) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 18:03:44.259904 dv-cinder-852009-8-iscsi devstack@n-api.service[120740]: DEBUG oslo_concurrency.lockutils [None req-9dc094cd-e1ce-461b-b685-a07294bf3941 tempest-AttachVolumeShelveTestJSON-385853788 tempest-AttachVolumeShelveTestJSON-385853788-project] Lock "1daf4f4c-0e4a-4779-b53a-78c48397ea2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120740) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 18:03:44.260546 dv-cinder-852009-8-iscsi devstack@n-api.service[120740]: DEBUG oslo_concurrency.lockutils [None req-9dc094cd-e1ce-461b-b685-a07294bf3941 tempest-AttachVolumeShelveTestJSON-385853788 tempest-AttachVolumeShelveTestJSON-385853788-project] Lock "1daf4f4c-0e4a-4779-b53a-78c48397ea2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120740) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 18:03:44.261600 dv-cinder-852009-8-iscsi devstack@n-api.service[120740]: DEBUG oslo_concurrency.lockutils [None req-9dc094cd-e1ce-461b-b685-a07294bf3941 tempest-AttachVolumeShelveTestJSON-385853788 tempest-AttachVolumeShelveTestJSON-385853788-project] Acquiring lock "1daf4f4c-0e4a-4779-b53a-78c48397ea2f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120740) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 18:03:44.262477 dv-cinder-852009-8-iscsi devstack@n-api.service[120740]: DEBUG oslo_concurrency.lockutils [None req-9dc094cd-e1ce-461b-b685-a07294bf3941 tempest-AttachVolumeShelveTestJSON-385853788 tempest-AttachVolumeShelveTestJSON-385853788-project] Lock "1daf4f4c-0e4a-4779-b53a-78c48397ea2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120740) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 18:03:44.263096 dv-cinder-852009-8-iscsi devstack@n-api.service[120740]: DEBUG oslo_concurrency.lockutils [None req-9dc094cd-e1ce-461b-b685-a07294bf3941 tempest-AttachVolumeShelveTestJSON-385853788 tempest-AttachVolumeShelveTestJSON-385853788-project] Lock "1daf4f4c-0e4a-4779-b53a-78c48397ea2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120740) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 18:03:44.480139 dv-cinder-852009-8-iscsi devstack@n-api.service[120740]: DEBUG nova.policy [None req-9dc094cd-e1ce-461b-b685-a07294bf3941 tempest-AttachVolumeShelveTestJSON-385853788 tempest-AttachVolumeShelveTestJSON-385853788-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e68ecd9b3ca643539b109f75bb242d6f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '75e14fd88bfb4cd896fa7b070a0fac47', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120740) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 18:03:44.488042 dv-cinder-852009-8-iscsi devstack@n-api.service[120741]: DEBUG nova.policy [None req-9dcac5e4-e5c7-4ad6-b562-cb81f7fbe181 tempest-ServerRescueNegativeTestJSON-412251590 tempest-ServerRescueNegativeTestJSON-412251590-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '60800cf2774e409d9c1b6f4992669991', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2eae4acecf6c4961830ead78d71b2ad3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120741) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 18:03:44.488929 dv-cinder-852009-8-iscsi devstack@n-api.service[120740]: DEBUG nova.policy [None req-9dc094cd-e1ce-461b-b685-a07294bf3941 tempest-AttachVolumeShelveTestJSON-385853788 tempest-AttachVolumeShelveTestJSON-385853788-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'e68ecd9b3ca643539b109f75bb242d6f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '75e14fd88bfb4cd896fa7b070a0fac47', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120740) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 18:03:44.490388 dv-cinder-852009-8-iscsi devstack@n-api.service[120740]: DEBUG nova.policy [None req-9dc094cd-e1ce-461b-b685-a07294bf3941 tempest-AttachVolumeShelveTestJSON-385853788 tempest-AttachVolumeShelveTestJSON-385853788-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'e68ecd9b3ca643539b109f75bb242d6f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '75e14fd88bfb4cd896fa7b070a0fac47', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120740) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 18:03:44.491569 dv-cinder-852009-8-iscsi devstack@n-api.service[120740]: INFO nova.api.openstack.requestlog [None req-9dc094cd-e1ce-461b-b685-a07294bf3941 tempest-AttachVolumeShelveTestJSON-385853788 tempest-AttachVolumeShelveTestJSON-385853788-project] 10.222.0.43 "GET /compute/v2.1/servers/11d2616a-96f9-4a7a-aab8-219219986a8b" status: 200 len: 1722 microversion: 2.20 time: 0.250995 Sep 13 18:03:44.492238 dv-cinder-852009-8-iscsi devstack@n-api.service[120740]: [pid: 120740|app: 0|req: 120/230] 10.222.0.43 () {60 vars in 1277 bytes} [Tue Sep 13 18:03:44 2022] GET /compute/v2.1/servers/11d2616a-96f9-4a7a-aab8-219219986a8b => generated 1722 bytes in 252 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 13 18:03:44.497845 dv-cinder-852009-8-iscsi devstack@n-api.service[120741]: INFO nova.api.openstack.requestlog [None req-9dcac5e4-e5c7-4ad6-b562-cb81f7fbe181 tempest-ServerRescueNegativeTestJSON-412251590 tempest-ServerRescueNegativeTestJSON-412251590-project] 10.222.0.43 "GET /compute/v2.1/servers/a9c22f82-a945-4a94-b3c9-fe95265053bd" status: 200 len: 1523 microversion: 2.1 time: 0.265795 Sep 13 18:03:44.504828 dv-cinder-852009-8-iscsi devstack@n-api.service[120741]: [pid: 120741|app: 0|req: 111/231] 10.222.0.43 () {58 vars in 1236 bytes} [Tue Sep 13 18:03:44 2022] GET /compute/v2.1/servers/a9c22f82-a945-4a94-b3c9-fe95265053bd => generated 1523 bytes in 274 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 13 18:03:45.523120 dv-cinder-852009-8-iscsi devstack@n-api.service[120741]: DEBUG nova.api.openstack.wsgi [None req-d9dbccff-28d5-44d1-97cb-dff3bca8e8e4 tempest-ServerRescueNegativeTestJSON-412251590 tempest-ServerRescueNegativeTestJSON-412251590-project] Calling method '>' {{(pid=120741) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 18:03:45.523739 dv-cinder-852009-8-iscsi devstack@n-api.service[120740]: DEBUG nova.api.openstack.wsgi [None req-ed454c49-f7a8-48d4-9cfe-c1db9c026507 tempest-AttachVolumeShelveTestJSON-385853788 tempest-AttachVolumeShelveTestJSON-385853788-project] Calling method '>' {{(pid=120740) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 18:03:45.524140 dv-cinder-852009-8-iscsi devstack@n-api.service[120741]: DEBUG nova.compute.api [None req-d9dbccff-28d5-44d1-97cb-dff3bca8e8e4 tempest-ServerRescueNegativeTestJSON-412251590 tempest-ServerRescueNegativeTestJSON-412251590-project] [instance: a9c22f82-a945-4a94-b3c9-fe95265053bd] Fetching instance by UUID {{(pid=120741) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 18:03:45.524714 dv-cinder-852009-8-iscsi devstack@n-api.service[120740]: DEBUG nova.compute.api [None req-ed454c49-f7a8-48d4-9cfe-c1db9c026507 tempest-AttachVolumeShelveTestJSON-385853788 tempest-AttachVolumeShelveTestJSON-385853788-project] [instance: 11d2616a-96f9-4a7a-aab8-219219986a8b] Fetching instance by UUID {{(pid=120740) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 18:03:45.533583 dv-cinder-852009-8-iscsi devstack@n-api.service[120740]: DEBUG dbcounter [-] [120740] Writing DB stats nova_cell0:SELECT=4 {{(pid=120740) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 18:03:45.536788 dv-cinder-852009-8-iscsi devstack@n-api.service[120740]: DEBUG oslo_concurrency.lockutils [None req-ed454c49-f7a8-48d4-9cfe-c1db9c026507 tempest-AttachVolumeShelveTestJSON-385853788 tempest-AttachVolumeShelveTestJSON-385853788-project] Acquiring lock "1daf4f4c-0e4a-4779-b53a-78c48397ea2f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120740) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 18:03:45.537189 dv-cinder-852009-8-iscsi devstack@n-api.service[120740]: DEBUG oslo_concurrency.lockutils [None req-ed454c49-f7a8-48d4-9cfe-c1db9c026507 tempest-AttachVolumeShelveTestJSON-385853788 tempest-AttachVolumeShelveTestJSON-385853788-project] Lock "1daf4f4c-0e4a-4779-b53a-78c48397ea2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120740) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 18:03:45.537818 dv-cinder-852009-8-iscsi devstack@n-api.service[120740]: DEBUG oslo_concurrency.lockutils [None req-ed454c49-f7a8-48d4-9cfe-c1db9c026507 tempest-AttachVolumeShelveTestJSON-385853788 tempest-AttachVolumeShelveTestJSON-385853788-project] Lock "1daf4f4c-0e4a-4779-b53a-78c48397ea2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120740) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 18:03:45.538830 dv-cinder-852009-8-iscsi devstack@n-api.service[120740]: DEBUG oslo_concurrency.lockutils [None req-ed454c49-f7a8-48d4-9cfe-c1db9c026507 tempest-AttachVolumeShelveTestJSON-385853788 tempest-AttachVolumeShelveTestJSON-385853788-project] Acquiring lock "1daf4f4c-0e4a-4779-b53a-78c48397ea2f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120740) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 18:03:45.540283 dv-cinder-852009-8-iscsi devstack@n-api.service[120740]: DEBUG oslo_concurrency.lockutils [None req-ed454c49-f7a8-48d4-9cfe-c1db9c026507 tempest-AttachVolumeShelveTestJSON-385853788 tempest-AttachVolumeShelveTestJSON-385853788-project] Lock "1daf4f4c-0e4a-4779-b53a-78c48397ea2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120740) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 18:03:45.540874 dv-cinder-852009-8-iscsi devstack@n-api.service[120741]: DEBUG oslo_concurrency.lockutils [None req-d9dbccff-28d5-44d1-97cb-dff3bca8e8e4 tempest-ServerRescueNegativeTestJSON-412251590 tempest-ServerRescueNegativeTestJSON-412251590-project] Acquiring lock "1daf4f4c-0e4a-4779-b53a-78c48397ea2f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120741) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 18:03:45.541224 dv-cinder-852009-8-iscsi devstack@n-api.service[120740]: DEBUG oslo_concurrency.lockutils [None req-ed454c49-f7a8-48d4-9cfe-c1db9c026507 tempest-AttachVolumeShelveTestJSON-385853788 tempest-AttachVolumeShelveTestJSON-385853788-project] Lock "1daf4f4c-0e4a-4779-b53a-78c48397ea2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120740) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 18:03:45.541681 dv-cinder-852009-8-iscsi devstack@n-api.service[120741]: DEBUG oslo_concurrency.lockutils [None req-d9dbccff-28d5-44d1-97cb-dff3bca8e8e4 tempest-ServerRescueNegativeTestJSON-412251590 tempest-ServerRescueNegativeTestJSON-412251590-project] Lock "1daf4f4c-0e4a-4779-b53a-78c48397ea2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120741) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 18:03:45.542113 dv-cinder-852009-8-iscsi devstack@n-api.service[120741]: DEBUG oslo_concurrency.lockutils [None req-d9dbccff-28d5-44d1-97cb-dff3bca8e8e4 tempest-ServerRescueNegativeTestJSON-412251590 tempest-ServerRescueNegativeTestJSON-412251590-project] Lock "1daf4f4c-0e4a-4779-b53a-78c48397ea2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120741) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 18:03:45.542810 dv-cinder-852009-8-iscsi devstack@n-api.service[120741]: DEBUG oslo_concurrency.lockutils [None req-d9dbccff-28d5-44d1-97cb-dff3bca8e8e4 tempest-ServerRescueNegativeTestJSON-412251590 tempest-ServerRescueNegativeTestJSON-412251590-project] Acquiring lock "1daf4f4c-0e4a-4779-b53a-78c48397ea2f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120741) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 18:03:45.543255 dv-cinder-852009-8-iscsi devstack@n-api.service[120741]: DEBUG oslo_concurrency.lockutils [None req-d9dbccff-28d5-44d1-97cb-dff3bca8e8e4 tempest-ServerRescueNegativeTestJSON-412251590 tempest-ServerRescueNegativeTestJSON-412251590-project] Lock "1daf4f4c-0e4a-4779-b53a-78c48397ea2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120741) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 18:03:45.543656 dv-cinder-852009-8-iscsi devstack@n-api.service[120741]: DEBUG oslo_concurrency.lockutils [None req-d9dbccff-28d5-44d1-97cb-dff3bca8e8e4 tempest-ServerRescueNegativeTestJSON-412251590 tempest-ServerRescueNegativeTestJSON-412251590-project] Lock "1daf4f4c-0e4a-4779-b53a-78c48397ea2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120741) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 18:03:45.772364 dv-cinder-852009-8-iscsi devstack@n-api.service[120740]: DEBUG nova.policy [None req-ed454c49-f7a8-48d4-9cfe-c1db9c026507 tempest-AttachVolumeShelveTestJSON-385853788 tempest-AttachVolumeShelveTestJSON-385853788-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e68ecd9b3ca643539b109f75bb242d6f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '75e14fd88bfb4cd896fa7b070a0fac47', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120740) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 18:03:45.784360 dv-cinder-852009-8-iscsi devstack@n-api.service[120740]: DEBUG nova.policy [None req-ed454c49-f7a8-48d4-9cfe-c1db9c026507 tempest-AttachVolumeShelveTestJSON-385853788 tempest-AttachVolumeShelveTestJSON-385853788-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'e68ecd9b3ca643539b109f75bb242d6f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '75e14fd88bfb4cd896fa7b070a0fac47', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120740) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 18:03:45.785899 dv-cinder-852009-8-iscsi devstack@n-api.service[120740]: DEBUG nova.policy [None req-ed454c49-f7a8-48d4-9cfe-c1db9c026507 tempest-AttachVolumeShelveTestJSON-385853788 tempest-AttachVolumeShelveTestJSON-385853788-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'e68ecd9b3ca643539b109f75bb242d6f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '75e14fd88bfb4cd896fa7b070a0fac47', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120740) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 18:03:45.786494 dv-cinder-852009-8-iscsi devstack@n-api.service[120741]: DEBUG nova.policy [None req-d9dbccff-28d5-44d1-97cb-dff3bca8e8e4 tempest-ServerRescueNegativeTestJSON-412251590 tempest-ServerRescueNegativeTestJSON-412251590-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '60800cf2774e409d9c1b6f4992669991', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2eae4acecf6c4961830ead78d71b2ad3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120741) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 18:03:45.787513 dv-cinder-852009-8-iscsi devstack@n-api.service[120740]: INFO nova.api.openstack.requestlog [None req-ed454c49-f7a8-48d4-9cfe-c1db9c026507 tempest-AttachVolumeShelveTestJSON-385853788 tempest-AttachVolumeShelveTestJSON-385853788-project] 10.222.0.43 "GET /compute/v2.1/servers/11d2616a-96f9-4a7a-aab8-219219986a8b" status: 200 len: 1722 microversion: 2.20 time: 0.269374 Sep 13 18:03:45.788240 dv-cinder-852009-8-iscsi devstack@n-api.service[120740]: [pid: 120740|app: 0|req: 121/232] 10.222.0.43 () {60 vars in 1277 bytes} [Tue Sep 13 18:03:45 2022] GET /compute/v2.1/servers/11d2616a-96f9-4a7a-aab8-219219986a8b => generated 1722 bytes in 271 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 13 18:03:45.794874 dv-cinder-852009-8-iscsi devstack@n-api.service[120741]: INFO nova.api.openstack.requestlog [None req-d9dbccff-28d5-44d1-97cb-dff3bca8e8e4 tempest-ServerRescueNegativeTestJSON-412251590 tempest-ServerRescueNegativeTestJSON-412251590-project] 10.222.0.43 "GET /compute/v2.1/servers/a9c22f82-a945-4a94-b3c9-fe95265053bd" status: 200 len: 1523 microversion: 2.1 time: 0.275765 Sep 13 18:03:45.796458 dv-cinder-852009-8-iscsi devstack@n-api.service[120741]: [pid: 120741|app: 0|req: 112/233] 10.222.0.43 () {58 vars in 1236 bytes} [Tue Sep 13 18:03:45 2022] GET /compute/v2.1/servers/a9c22f82-a945-4a94-b3c9-fe95265053bd => generated 1523 bytes in 277 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 13 18:03:46.817665 dv-cinder-852009-8-iscsi devstack@n-api.service[120740]: DEBUG nova.api.openstack.wsgi [None req-32293770-edda-43fe-8558-63dfbfa89c4c tempest-AttachVolumeShelveTestJSON-385853788 tempest-AttachVolumeShelveTestJSON-385853788-project] Calling method '>' {{(pid=120740) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 18:03:46.818437 dv-cinder-852009-8-iscsi devstack@n-api.service[120741]: DEBUG nova.api.openstack.wsgi [None req-4baf92a0-0571-44a4-ade3-7b4af288e3dd tempest-ServerRescueNegativeTestJSON-412251590 tempest-ServerRescueNegativeTestJSON-412251590-project] Calling method '>' {{(pid=120741) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 18:03:46.819648 dv-cinder-852009-8-iscsi devstack@n-api.service[120741]: DEBUG nova.compute.api [None req-4baf92a0-0571-44a4-ade3-7b4af288e3dd tempest-ServerRescueNegativeTestJSON-412251590 tempest-ServerRescueNegativeTestJSON-412251590-project] [instance: a9c22f82-a945-4a94-b3c9-fe95265053bd] Fetching instance by UUID {{(pid=120741) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 18:03:46.820624 dv-cinder-852009-8-iscsi devstack@n-api.service[120740]: DEBUG nova.compute.api [None req-32293770-edda-43fe-8558-63dfbfa89c4c tempest-AttachVolumeShelveTestJSON-385853788 tempest-AttachVolumeShelveTestJSON-385853788-project] [instance: 11d2616a-96f9-4a7a-aab8-219219986a8b] Fetching instance by UUID {{(pid=120740) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 18:03:46.827364 dv-cinder-852009-8-iscsi devstack@n-api.service[120740]: DEBUG oslo_concurrency.lockutils [None req-32293770-edda-43fe-8558-63dfbfa89c4c tempest-AttachVolumeShelveTestJSON-385853788 tempest-AttachVolumeShelveTestJSON-385853788-project] Acquiring lock "1daf4f4c-0e4a-4779-b53a-78c48397ea2f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120740) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 18:03:46.828084 dv-cinder-852009-8-iscsi devstack@n-api.service[120740]: DEBUG oslo_concurrency.lockutils [None req-32293770-edda-43fe-8558-63dfbfa89c4c tempest-AttachVolumeShelveTestJSON-385853788 tempest-AttachVolumeShelveTestJSON-385853788-project] Lock "1daf4f4c-0e4a-4779-b53a-78c48397ea2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120740) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 18:03:46.828794 dv-cinder-852009-8-iscsi devstack@n-api.service[120740]: DEBUG oslo_concurrency.lockutils [None req-32293770-edda-43fe-8558-63dfbfa89c4c tempest-AttachVolumeShelveTestJSON-385853788 tempest-AttachVolumeShelveTestJSON-385853788-project] Lock "1daf4f4c-0e4a-4779-b53a-78c48397ea2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120740) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 18:03:46.829971 dv-cinder-852009-8-iscsi devstack@n-api.service[120740]: DEBUG oslo_concurrency.lockutils [None req-32293770-edda-43fe-8558-63dfbfa89c4c tempest-AttachVolumeShelveTestJSON-385853788 tempest-AttachVolumeShelveTestJSON-385853788-project] Acquiring lock "1daf4f4c-0e4a-4779-b53a-78c48397ea2f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120740) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 18:03:46.830540 dv-cinder-852009-8-iscsi devstack@n-api.service[120741]: DEBUG oslo_concurrency.lockutils [None req-4baf92a0-0571-44a4-ade3-7b4af288e3dd tempest-ServerRescueNegativeTestJSON-412251590 tempest-ServerRescueNegativeTestJSON-412251590-project] Acquiring lock "1daf4f4c-0e4a-4779-b53a-78c48397ea2f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120741) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 18:03:46.831030 dv-cinder-852009-8-iscsi devstack@n-api.service[120741]: DEBUG oslo_concurrency.lockutils [None req-4baf92a0-0571-44a4-ade3-7b4af288e3dd tempest-ServerRescueNegativeTestJSON-412251590 tempest-ServerRescueNegativeTestJSON-412251590-project] Lock "1daf4f4c-0e4a-4779-b53a-78c48397ea2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120741) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 18:03:46.831491 dv-cinder-852009-8-iscsi devstack@n-api.service[120741]: DEBUG oslo_concurrency.lockutils [None req-4baf92a0-0571-44a4-ade3-7b4af288e3dd tempest-ServerRescueNegativeTestJSON-412251590 tempest-ServerRescueNegativeTestJSON-412251590-project] Lock "1daf4f4c-0e4a-4779-b53a-78c48397ea2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120741) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 18:03:46.831852 dv-cinder-852009-8-iscsi devstack@n-api.service[120740]: DEBUG oslo_concurrency.lockutils [None req-32293770-edda-43fe-8558-63dfbfa89c4c tempest-AttachVolumeShelveTestJSON-385853788 tempest-AttachVolumeShelveTestJSON-385853788-project] Lock "1daf4f4c-0e4a-4779-b53a-78c48397ea2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120740) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 18:03:46.832155 dv-cinder-852009-8-iscsi devstack@n-api.service[120741]: DEBUG oslo_concurrency.lockutils [None req-4baf92a0-0571-44a4-ade3-7b4af288e3dd tempest-ServerRescueNegativeTestJSON-412251590 tempest-ServerRescueNegativeTestJSON-412251590-project] Acquiring lock "1daf4f4c-0e4a-4779-b53a-78c48397ea2f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120741) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 18:03:46.832377 dv-cinder-852009-8-iscsi devstack@n-api.service[120740]: DEBUG oslo_concurrency.lockutils [None req-32293770-edda-43fe-8558-63dfbfa89c4c tempest-AttachVolumeShelveTestJSON-385853788 tempest-AttachVolumeShelveTestJSON-385853788-project] Lock "1daf4f4c-0e4a-4779-b53a-78c48397ea2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120740) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 18:03:46.832639 dv-cinder-852009-8-iscsi devstack@n-api.service[120741]: DEBUG oslo_concurrency.lockutils [None req-4baf92a0-0571-44a4-ade3-7b4af288e3dd tempest-ServerRescueNegativeTestJSON-412251590 tempest-ServerRescueNegativeTestJSON-412251590-project] Lock "1daf4f4c-0e4a-4779-b53a-78c48397ea2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120741) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 18:03:46.838002 dv-cinder-852009-8-iscsi devstack@n-api.service[120741]: DEBUG oslo_concurrency.lockutils [None req-4baf92a0-0571-44a4-ade3-7b4af288e3dd tempest-ServerRescueNegativeTestJSON-412251590 tempest-ServerRescueNegativeTestJSON-412251590-project] Lock "1daf4f4c-0e4a-4779-b53a-78c48397ea2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120741) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 18:03:47.080719 dv-cinder-852009-8-iscsi devstack@n-api.service[120740]: DEBUG nova.policy [None req-32293770-edda-43fe-8558-63dfbfa89c4c tempest-AttachVolumeShelveTestJSON-385853788 tempest-AttachVolumeShelveTestJSON-385853788-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e68ecd9b3ca643539b109f75bb242d6f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '75e14fd88bfb4cd896fa7b070a0fac47', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120740) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 18:03:47.091805 dv-cinder-852009-8-iscsi devstack@n-api.service[120740]: DEBUG nova.policy [None req-32293770-edda-43fe-8558-63dfbfa89c4c tempest-AttachVolumeShelveTestJSON-385853788 tempest-AttachVolumeShelveTestJSON-385853788-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'e68ecd9b3ca643539b109f75bb242d6f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '75e14fd88bfb4cd896fa7b070a0fac47', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120740) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 18:03:47.093466 dv-cinder-852009-8-iscsi devstack@n-api.service[120740]: DEBUG nova.policy [None req-32293770-edda-43fe-8558-63dfbfa89c4c tempest-AttachVolumeShelveTestJSON-385853788 tempest-AttachVolumeShelveTestJSON-385853788-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'e68ecd9b3ca643539b109f75bb242d6f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '75e14fd88bfb4cd896fa7b070a0fac47', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120740) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 18:03:47.094594 dv-cinder-852009-8-iscsi devstack@n-api.service[120740]: INFO nova.api.openstack.requestlog [None req-32293770-edda-43fe-8558-63dfbfa89c4c tempest-AttachVolumeShelveTestJSON-385853788 tempest-AttachVolumeShelveTestJSON-385853788-project] 10.222.0.43 "GET /compute/v2.1/servers/11d2616a-96f9-4a7a-aab8-219219986a8b" status: 200 len: 1722 microversion: 2.20 time: 0.283446 Sep 13 18:03:47.095656 dv-cinder-852009-8-iscsi devstack@n-api.service[120740]: [pid: 120740|app: 0|req: 122/234] 10.222.0.43 () {60 vars in 1277 bytes} [Tue Sep 13 18:03:46 2022] GET /compute/v2.1/servers/11d2616a-96f9-4a7a-aab8-219219986a8b => generated 1722 bytes in 285 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 13 18:03:47.096152 dv-cinder-852009-8-iscsi devstack@n-api.service[120741]: DEBUG nova.policy [None req-4baf92a0-0571-44a4-ade3-7b4af288e3dd tempest-ServerRescueNegativeTestJSON-412251590 tempest-ServerRescueNegativeTestJSON-412251590-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '60800cf2774e409d9c1b6f4992669991', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2eae4acecf6c4961830ead78d71b2ad3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120741) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 18:03:47.105050 dv-cinder-852009-8-iscsi devstack@n-api.service[120741]: INFO nova.api.openstack.requestlog [None req-4baf92a0-0571-44a4-ade3-7b4af288e3dd tempest-ServerRescueNegativeTestJSON-412251590 tempest-ServerRescueNegativeTestJSON-412251590-project] 10.222.0.43 "GET /compute/v2.1/servers/a9c22f82-a945-4a94-b3c9-fe95265053bd" status: 200 len: 1503 microversion: 2.1 time: 0.290291 Sep 13 18:03:47.106490 dv-cinder-852009-8-iscsi devstack@n-api.service[120741]: [pid: 120741|app: 0|req: 113/235] 10.222.0.43 () {58 vars in 1236 bytes} [Tue Sep 13 18:03:46 2022] GET /compute/v2.1/servers/a9c22f82-a945-4a94-b3c9-fe95265053bd => generated 1503 bytes in 292 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 13 18:03:47.128766 dv-cinder-852009-8-iscsi devstack@n-api.service[120740]: DEBUG nova.api.openstack.wsgi [None req-d2599d8e-f146-46e7-88e7-c868b38d09e3 tempest-ServerRescueNegativeTestJSON-412251590 tempest-ServerRescueNegativeTestJSON-412251590-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "4e066aac-511c-4d98-9f43-afe1cc054bb1"}} {{(pid=120740) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 13 18:03:47.131189 dv-cinder-852009-8-iscsi devstack@n-api.service[120740]: DEBUG nova.compute.api [None req-d2599d8e-f146-46e7-88e7-c868b38d09e3 tempest-ServerRescueNegativeTestJSON-412251590 tempest-ServerRescueNegativeTestJSON-412251590-project] [instance: a9c22f82-a945-4a94-b3c9-fe95265053bd] Fetching instance by UUID {{(pid=120740) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 18:03:47.137756 dv-cinder-852009-8-iscsi devstack@n-api.service[120740]: DEBUG oslo_concurrency.lockutils [None req-d2599d8e-f146-46e7-88e7-c868b38d09e3 tempest-ServerRescueNegativeTestJSON-412251590 tempest-ServerRescueNegativeTestJSON-412251590-project] Acquiring lock "1daf4f4c-0e4a-4779-b53a-78c48397ea2f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120740) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 18:03:47.138252 dv-cinder-852009-8-iscsi devstack@n-api.service[120740]: DEBUG oslo_concurrency.lockutils [None req-d2599d8e-f146-46e7-88e7-c868b38d09e3 tempest-ServerRescueNegativeTestJSON-412251590 tempest-ServerRescueNegativeTestJSON-412251590-project] Lock "1daf4f4c-0e4a-4779-b53a-78c48397ea2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120740) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 18:03:47.139326 dv-cinder-852009-8-iscsi devstack@n-api.service[120740]: DEBUG oslo_concurrency.lockutils [None req-d2599d8e-f146-46e7-88e7-c868b38d09e3 tempest-ServerRescueNegativeTestJSON-412251590 tempest-ServerRescueNegativeTestJSON-412251590-project] Lock "1daf4f4c-0e4a-4779-b53a-78c48397ea2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120740) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 18:03:47.140197 dv-cinder-852009-8-iscsi devstack@n-api.service[120740]: DEBUG oslo_concurrency.lockutils [None req-d2599d8e-f146-46e7-88e7-c868b38d09e3 tempest-ServerRescueNegativeTestJSON-412251590 tempest-ServerRescueNegativeTestJSON-412251590-project] Acquiring lock "1daf4f4c-0e4a-4779-b53a-78c48397ea2f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120740) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 18:03:47.140845 dv-cinder-852009-8-iscsi devstack@n-api.service[120740]: DEBUG oslo_concurrency.lockutils [None req-d2599d8e-f146-46e7-88e7-c868b38d09e3 tempest-ServerRescueNegativeTestJSON-412251590 tempest-ServerRescueNegativeTestJSON-412251590-project] Lock "1daf4f4c-0e4a-4779-b53a-78c48397ea2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120740) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 18:03:47.141267 dv-cinder-852009-8-iscsi devstack@n-api.service[120740]: DEBUG oslo_concurrency.lockutils [None req-d2599d8e-f146-46e7-88e7-c868b38d09e3 tempest-ServerRescueNegativeTestJSON-412251590 tempest-ServerRescueNegativeTestJSON-412251590-project] Lock "1daf4f4c-0e4a-4779-b53a-78c48397ea2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120740) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 18:03:47.173042 dv-cinder-852009-8-iscsi devstack@n-api.service[120740]: INFO nova.api.openstack.wsgi [None req-d2599d8e-f146-46e7-88e7-c868b38d09e3 tempest-ServerRescueNegativeTestJSON-412251590 tempest-ServerRescueNegativeTestJSON-412251590-project] HTTP exception thrown: Cannot 'attach_volume' instance a9c22f82-a945-4a94-b3c9-fe95265053bd while it is in vm_state rescued Sep 13 18:03:47.174835 dv-cinder-852009-8-iscsi devstack@n-api.service[120740]: DEBUG nova.api.openstack.wsgi [None req-d2599d8e-f146-46e7-88e7-c868b38d09e3 tempest-ServerRescueNegativeTestJSON-412251590 tempest-ServerRescueNegativeTestJSON-412251590-project] Request method failure captured: Sep 13 18:03:47.174835 dv-cinder-852009-8-iscsi devstack@n-api.service[120740]: request: POST /compute/v2.1/servers/a9c22f82-a945-4a94-b3c9-fe95265053bd/os-volume_attachments HTTP/1.1 Sep 13 18:03:47.174835 dv-cinder-852009-8-iscsi devstack@n-api.service[120740]: Accept: application/json Sep 13 18:03:47.174835 dv-cinder-852009-8-iscsi devstack@n-api.service[120740]: Accept-Encoding: identity Sep 13 18:03:47.174835 dv-cinder-852009-8-iscsi devstack@n-api.service[120740]: Connection: close Sep 13 18:03:47.174835 dv-cinder-852009-8-iscsi devstack@n-api.service[120740]: Content-Length: 74 Sep 13 18:03:47.174835 dv-cinder-852009-8-iscsi devstack@n-api.service[120740]: Content-Type: application/json Sep 13 18:03:47.174835 dv-cinder-852009-8-iscsi devstack@n-api.service[120740]: Host: 10.222.0.43 Sep 13 18:03:47.174835 dv-cinder-852009-8-iscsi devstack@n-api.service[120740]: Openstack-System-Scope: None Sep 13 18:03:47.174835 dv-cinder-852009-8-iscsi devstack@n-api.service[120740]: User-Agent: python-urllib3/1.26.12 Sep 13 18:03:47.174835 dv-cinder-852009-8-iscsi devstack@n-api.service[120740]: X-Auth-Token: gAAAAABjIMWLGCNoeMW1liDJB1gW9y5zhqmLF-sp8LIXP_r2MtlxdDHDtH71A_-WwD3h6pxNpP_1J3-5dl1onM_1dz3k03VMJo2rjFEdcnLe1SaUhiMh3RVhtixTQiirGhUKXyKFRgOaQ5UOSPmq2sc9F0EVe-crpqJDqeSJGSsHbG1iIfI3v08 Sep 13 18:03:47.174835 dv-cinder-852009-8-iscsi devstack@n-api.service[120740]: X-Domain-Id: None Sep 13 18:03:47.174835 dv-cinder-852009-8-iscsi devstack@n-api.service[120740]: X-Domain-Name: None Sep 13 18:03:47.174835 dv-cinder-852009-8-iscsi devstack@n-api.service[120740]: X-Identity-Status: Confirmed Sep 13 18:03:47.174835 dv-cinder-852009-8-iscsi devstack@n-api.service[120740]: X-Is-Admin-Project: True Sep 13 18:03:47.174835 dv-cinder-852009-8-iscsi devstack@n-api.service[120740]: X-Project-Domain-Id: default Sep 13 18:03:47.174835 dv-cinder-852009-8-iscsi devstack@n-api.service[120740]: X-Project-Domain-Name: Default Sep 13 18:03:47.174835 dv-cinder-852009-8-iscsi devstack@n-api.service[120740]: X-Project-Id: 2eae4acecf6c4961830ead78d71b2ad3 Sep 13 18:03:47.174835 dv-cinder-852009-8-iscsi devstack@n-api.service[120740]: X-Project-Name: tempest-ServerRescueNegativeTestJSON-412251590 Sep 13 18:03:47.174835 dv-cinder-852009-8-iscsi devstack@n-api.service[120740]: X-Role: reader,member Sep 13 18:03:47.174835 dv-cinder-852009-8-iscsi devstack@n-api.service[120740]: X-Roles: reader,member Sep 13 18:03:47.176340 dv-cinder-852009-8-iscsi devstack@n-api.service[120740]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/identity"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/compute/v2/2eae4acecf6c4961830ead78d71b2ad3"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.43:8080", "publicURL": "http://10.222.0.43:8080/v1/AUTH_2eae4acecf6c4961830ead78d71b2ad3"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43:9696/networking"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/volume/v3/2eae4acecf6c4961830ead78d71b2ad3"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/compute/v2.1"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/placement"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/volume/v3/2eae4acecf6c4961830ead78d71b2ad3"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/image"}]}] Sep 13 18:03:47.176340 dv-cinder-852009-8-iscsi devstack@n-api.service[120740]: X-Tenant: tempest-ServerRescueNegativeTestJSON-412251590 Sep 13 18:03:47.176340 dv-cinder-852009-8-iscsi devstack@n-api.service[120740]: X-Tenant-Id: 2eae4acecf6c4961830ead78d71b2ad3 Sep 13 18:03:47.176340 dv-cinder-852009-8-iscsi devstack@n-api.service[120740]: X-Tenant-Name: tempest-ServerRescueNegativeTestJSON-412251590 Sep 13 18:03:47.176340 dv-cinder-852009-8-iscsi devstack@n-api.service[120740]: X-User: tempest-ServerRescueNegativeTestJSON-412251590-project Sep 13 18:03:47.176340 dv-cinder-852009-8-iscsi devstack@n-api.service[120740]: X-User-Domain-Id: default Sep 13 18:03:47.176340 dv-cinder-852009-8-iscsi devstack@n-api.service[120740]: X-User-Domain-Name: Default Sep 13 18:03:47.176340 dv-cinder-852009-8-iscsi devstack@n-api.service[120740]: X-User-Id: 60800cf2774e409d9c1b6f4992669991 Sep 13 18:03:47.176340 dv-cinder-852009-8-iscsi devstack@n-api.service[120740]: X-User-Name: tempest-ServerRescueNegativeTestJSON-412251590-project Sep 13 18:03:47.176340 dv-cinder-852009-8-iscsi devstack@n-api.service[120740]: Sep 13 18:03:47.176340 dv-cinder-852009-8-iscsi devstack@n-api.service[120740]: {"volumeAttachment": {"volumeId": "4e066aac-511c-4d98-9f43-afe1cc054bb1"}} Sep 13 18:03:47.176340 dv-cinder-852009-8-iscsi devstack@n-api.service[120740]: method: > Sep 13 18:03:47.177260 dv-cinder-852009-8-iscsi devstack@n-api.service[120740]: exception: Cannot 'attach_volume' instance a9c22f82-a945-4a94-b3c9-fe95265053bd while it is in vm_state rescued Sep 13 18:03:47.177260 dv-cinder-852009-8-iscsi devstack@n-api.service[120740]: action_args: {'server_id': 'a9c22f82-a945-4a94-b3c9-fe95265053bd', 'body': {'volumeAttachment': {'volumeId': '4e066aac-511c-4d98-9f43-afe1cc054bb1'}}} Sep 13 18:03:47.177260 dv-cinder-852009-8-iscsi devstack@n-api.service[120740]: {{(pid=120740) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 13 18:03:47.177260 dv-cinder-852009-8-iscsi devstack@n-api.service[120740]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 13 18:03:47.177260 dv-cinder-852009-8-iscsi devstack@n-api.service[120740]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 388, in create Sep 13 18:03:47.177260 dv-cinder-852009-8-iscsi devstack@n-api.service[120740]: ERROR nova.api.openstack.wsgi device = self.compute_api.attach_volume( Sep 13 18:03:47.177260 dv-cinder-852009-8-iscsi devstack@n-api.service[120740]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 241, in inner Sep 13 18:03:47.177260 dv-cinder-852009-8-iscsi devstack@n-api.service[120740]: ERROR nova.api.openstack.wsgi return function(self, context, instance, *args, **kwargs) Sep 13 18:03:47.177260 dv-cinder-852009-8-iscsi devstack@n-api.service[120740]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 148, in inner Sep 13 18:03:47.177260 dv-cinder-852009-8-iscsi devstack@n-api.service[120740]: ERROR nova.api.openstack.wsgi raise exception.InstanceInvalidState( Sep 13 18:03:47.177260 dv-cinder-852009-8-iscsi devstack@n-api.service[120740]: ERROR nova.api.openstack.wsgi nova.exception.InstanceInvalidState: Instance a9c22f82-a945-4a94-b3c9-fe95265053bd in vm_state rescued. Cannot attach_volume while the instance is in this state. Sep 13 18:03:47.177260 dv-cinder-852009-8-iscsi devstack@n-api.service[120740]: ERROR nova.api.openstack.wsgi Sep 13 18:03:47.177260 dv-cinder-852009-8-iscsi devstack@n-api.service[120740]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 13 18:03:47.177260 dv-cinder-852009-8-iscsi devstack@n-api.service[120740]: ERROR nova.api.openstack.wsgi Sep 13 18:03:47.177260 dv-cinder-852009-8-iscsi devstack@n-api.service[120740]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 13 18:03:47.177260 dv-cinder-852009-8-iscsi devstack@n-api.service[120740]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 13 18:03:47.177260 dv-cinder-852009-8-iscsi devstack@n-api.service[120740]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 13 18:03:47.177260 dv-cinder-852009-8-iscsi devstack@n-api.service[120740]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 13 18:03:47.177260 dv-cinder-852009-8-iscsi devstack@n-api.service[120740]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 13 18:03:47.178643 dv-cinder-852009-8-iscsi devstack@n-api.service[120740]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 13 18:03:47.178643 dv-cinder-852009-8-iscsi devstack@n-api.service[120740]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 13 18:03:47.178643 dv-cinder-852009-8-iscsi devstack@n-api.service[120740]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Sep 13 18:03:47.178643 dv-cinder-852009-8-iscsi devstack@n-api.service[120740]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Sep 13 18:03:47.178643 dv-cinder-852009-8-iscsi devstack@n-api.service[120740]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Sep 13 18:03:47.178643 dv-cinder-852009-8-iscsi devstack@n-api.service[120740]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Sep 13 18:03:47.178643 dv-cinder-852009-8-iscsi devstack@n-api.service[120740]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Sep 13 18:03:47.178643 dv-cinder-852009-8-iscsi devstack@n-api.service[120740]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Sep 13 18:03:47.178643 dv-cinder-852009-8-iscsi devstack@n-api.service[120740]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 398, in create Sep 13 18:03:47.178643 dv-cinder-852009-8-iscsi devstack@n-api.service[120740]: ERROR nova.api.openstack.wsgi common.raise_http_conflict_for_instance_invalid_state(state_error, Sep 13 18:03:47.178643 dv-cinder-852009-8-iscsi devstack@n-api.service[120740]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 347, in raise_http_conflict_for_instance_invalid_state Sep 13 18:03:47.178643 dv-cinder-852009-8-iscsi devstack@n-api.service[120740]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPConflict(explanation=msg) Sep 13 18:03:47.178643 dv-cinder-852009-8-iscsi devstack@n-api.service[120740]: ERROR nova.api.openstack.wsgi webob.exc.HTTPConflict: Cannot 'attach_volume' instance a9c22f82-a945-4a94-b3c9-fe95265053bd while it is in vm_state rescued Sep 13 18:03:47.178643 dv-cinder-852009-8-iscsi devstack@n-api.service[120740]: ERROR nova.api.openstack.wsgi Sep 13 18:03:47.178643 dv-cinder-852009-8-iscsi devstack@n-api.service[120740]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 13 18:03:47.178643 dv-cinder-852009-8-iscsi devstack@n-api.service[120740]: ERROR nova.api.openstack.wsgi Sep 13 18:03:47.178643 dv-cinder-852009-8-iscsi devstack@n-api.service[120740]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 13 18:03:47.178643 dv-cinder-852009-8-iscsi devstack@n-api.service[120740]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 13 18:03:47.178643 dv-cinder-852009-8-iscsi devstack@n-api.service[120740]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 13 18:03:47.179870 dv-cinder-852009-8-iscsi devstack@n-api.service[120740]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 13 18:03:47.179870 dv-cinder-852009-8-iscsi devstack@n-api.service[120740]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 13 18:03:47.179870 dv-cinder-852009-8-iscsi devstack@n-api.service[120740]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Cannot 'attach_volume' instance a9c22f82-a945-4a94-b3c9-fe95265053bd while it is in vm_state rescued Sep 13 18:03:47.179870 dv-cinder-852009-8-iscsi devstack@n-api.service[120740]: ERROR nova.api.openstack.wsgi Sep 13 18:03:47.179870 dv-cinder-852009-8-iscsi devstack@n-api.service[120740]: DEBUG nova.api.openstack.wsgi [None req-d2599d8e-f146-46e7-88e7-c868b38d09e3 tempest-ServerRescueNegativeTestJSON-412251590 tempest-ServerRescueNegativeTestJSON-412251590-project] Returning 409 to user: Cannot 'attach_volume' instance a9c22f82-a945-4a94-b3c9-fe95265053bd while it is in vm_state rescued {{(pid=120740) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 13 18:03:47.179870 dv-cinder-852009-8-iscsi devstack@n-api.service[120740]: INFO nova.api.openstack.requestlog [None req-d2599d8e-f146-46e7-88e7-c868b38d09e3 tempest-ServerRescueNegativeTestJSON-412251590 tempest-ServerRescueNegativeTestJSON-412251590-project] 10.222.0.43 "POST /compute/v2.1/servers/a9c22f82-a945-4a94-b3c9-fe95265053bd/os-volume_attachments" status: 409 len: 152 microversion: 2.1 time: 0.053534 Sep 13 18:03:47.179870 dv-cinder-852009-8-iscsi devstack@n-api.service[120740]: [pid: 120740|app: 0|req: 123/236] 10.222.0.43 () {60 vars in 1323 bytes} [Tue Sep 13 18:03:47 2022] POST /compute/v2.1/servers/a9c22f82-a945-4a94-b3c9-fe95265053bd/os-volume_attachments => generated 152 bytes in 56 msecs (HTTP/1.1 409) 9 headers in 378 bytes (1 switches on core 0) Sep 13 18:03:47.191926 dv-cinder-852009-8-iscsi devstack@n-api.service[120741]: DEBUG nova.api.openstack.wsgi [None req-fc20301a-6cc3-476d-8368-5330f2cb3290 tempest-ServerRescueNegativeTestJSON-412251590 tempest-ServerRescueNegativeTestJSON-412251590-project] Action: 'action', calling method: >, body: {"unrescue": {}} {{(pid=120741) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 13 18:03:47.193596 dv-cinder-852009-8-iscsi devstack@n-api.service[120741]: DEBUG nova.compute.api [None req-fc20301a-6cc3-476d-8368-5330f2cb3290 tempest-ServerRescueNegativeTestJSON-412251590 tempest-ServerRescueNegativeTestJSON-412251590-project] [instance: a9c22f82-a945-4a94-b3c9-fe95265053bd] Fetching instance by UUID {{(pid=120741) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 18:03:47.201775 dv-cinder-852009-8-iscsi devstack@n-api.service[120741]: DEBUG oslo_concurrency.lockutils [None req-fc20301a-6cc3-476d-8368-5330f2cb3290 tempest-ServerRescueNegativeTestJSON-412251590 tempest-ServerRescueNegativeTestJSON-412251590-project] Acquiring lock "1daf4f4c-0e4a-4779-b53a-78c48397ea2f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120741) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 18:03:47.202262 dv-cinder-852009-8-iscsi devstack@n-api.service[120741]: DEBUG oslo_concurrency.lockutils [None req-fc20301a-6cc3-476d-8368-5330f2cb3290 tempest-ServerRescueNegativeTestJSON-412251590 tempest-ServerRescueNegativeTestJSON-412251590-project] Lock "1daf4f4c-0e4a-4779-b53a-78c48397ea2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120741) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 18:03:47.202689 dv-cinder-852009-8-iscsi devstack@n-api.service[120741]: DEBUG oslo_concurrency.lockutils [None req-fc20301a-6cc3-476d-8368-5330f2cb3290 tempest-ServerRescueNegativeTestJSON-412251590 tempest-ServerRescueNegativeTestJSON-412251590-project] Lock "1daf4f4c-0e4a-4779-b53a-78c48397ea2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120741) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 18:03:47.203477 dv-cinder-852009-8-iscsi devstack@n-api.service[120741]: DEBUG oslo_concurrency.lockutils [None req-fc20301a-6cc3-476d-8368-5330f2cb3290 tempest-ServerRescueNegativeTestJSON-412251590 tempest-ServerRescueNegativeTestJSON-412251590-project] Acquiring lock "1daf4f4c-0e4a-4779-b53a-78c48397ea2f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120741) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 18:03:47.203912 dv-cinder-852009-8-iscsi devstack@n-api.service[120741]: DEBUG oslo_concurrency.lockutils [None req-fc20301a-6cc3-476d-8368-5330f2cb3290 tempest-ServerRescueNegativeTestJSON-412251590 tempest-ServerRescueNegativeTestJSON-412251590-project] Lock "1daf4f4c-0e4a-4779-b53a-78c48397ea2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120741) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 18:03:47.204368 dv-cinder-852009-8-iscsi devstack@n-api.service[120741]: DEBUG oslo_concurrency.lockutils [None req-fc20301a-6cc3-476d-8368-5330f2cb3290 tempest-ServerRescueNegativeTestJSON-412251590 tempest-ServerRescueNegativeTestJSON-412251590-project] Lock "1daf4f4c-0e4a-4779-b53a-78c48397ea2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120741) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 18:03:47.438896 dv-cinder-852009-8-iscsi devstack@n-api.service[120741]: INFO nova.api.openstack.requestlog [None req-fc20301a-6cc3-476d-8368-5330f2cb3290 tempest-ServerRescueNegativeTestJSON-412251590 tempest-ServerRescueNegativeTestJSON-412251590-project] 10.222.0.43 "POST /compute/v2.1/servers/a9c22f82-a945-4a94-b3c9-fe95265053bd/action" status: 202 len: 0 microversion: 2.1 time: 0.253388 Sep 13 18:03:47.442919 dv-cinder-852009-8-iscsi devstack@n-api.service[120741]: [pid: 120741|app: 0|req: 114/237] 10.222.0.43 () {60 vars in 1278 bytes} [Tue Sep 13 18:03:47 2022] POST /compute/v2.1/servers/a9c22f82-a945-4a94-b3c9-fe95265053bd/action => generated 0 bytes in 257 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Sep 13 18:03:47.448314 dv-cinder-852009-8-iscsi devstack@n-api.service[120740]: DEBUG nova.api.openstack.wsgi [None req-75d67c4c-e17f-4356-948e-607f5d51db96 tempest-ServerRescueNegativeTestJSON-412251590 tempest-ServerRescueNegativeTestJSON-412251590-project] Calling method '>' {{(pid=120740) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 18:03:47.448961 dv-cinder-852009-8-iscsi devstack@n-api.service[120740]: DEBUG nova.compute.api [None req-75d67c4c-e17f-4356-948e-607f5d51db96 tempest-ServerRescueNegativeTestJSON-412251590 tempest-ServerRescueNegativeTestJSON-412251590-project] [instance: a9c22f82-a945-4a94-b3c9-fe95265053bd] Fetching instance by UUID {{(pid=120740) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 18:03:47.455591 dv-cinder-852009-8-iscsi devstack@n-api.service[120740]: DEBUG oslo_concurrency.lockutils [None req-75d67c4c-e17f-4356-948e-607f5d51db96 tempest-ServerRescueNegativeTestJSON-412251590 tempest-ServerRescueNegativeTestJSON-412251590-project] Acquiring lock "1daf4f4c-0e4a-4779-b53a-78c48397ea2f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120740) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 18:03:47.456108 dv-cinder-852009-8-iscsi devstack@n-api.service[120740]: DEBUG oslo_concurrency.lockutils [None req-75d67c4c-e17f-4356-948e-607f5d51db96 tempest-ServerRescueNegativeTestJSON-412251590 tempest-ServerRescueNegativeTestJSON-412251590-project] Lock "1daf4f4c-0e4a-4779-b53a-78c48397ea2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120740) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 18:03:47.456564 dv-cinder-852009-8-iscsi devstack@n-api.service[120740]: DEBUG oslo_concurrency.lockutils [None req-75d67c4c-e17f-4356-948e-607f5d51db96 tempest-ServerRescueNegativeTestJSON-412251590 tempest-ServerRescueNegativeTestJSON-412251590-project] Lock "1daf4f4c-0e4a-4779-b53a-78c48397ea2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120740) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 18:03:47.457261 dv-cinder-852009-8-iscsi devstack@n-api.service[120740]: DEBUG oslo_concurrency.lockutils [None req-75d67c4c-e17f-4356-948e-607f5d51db96 tempest-ServerRescueNegativeTestJSON-412251590 tempest-ServerRescueNegativeTestJSON-412251590-project] Acquiring lock "1daf4f4c-0e4a-4779-b53a-78c48397ea2f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120740) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 18:03:47.457939 dv-cinder-852009-8-iscsi devstack@n-api.service[120740]: DEBUG oslo_concurrency.lockutils [None req-75d67c4c-e17f-4356-948e-607f5d51db96 tempest-ServerRescueNegativeTestJSON-412251590 tempest-ServerRescueNegativeTestJSON-412251590-project] Lock "1daf4f4c-0e4a-4779-b53a-78c48397ea2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120740) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 18:03:47.458358 dv-cinder-852009-8-iscsi devstack@n-api.service[120740]: DEBUG oslo_concurrency.lockutils [None req-75d67c4c-e17f-4356-948e-607f5d51db96 tempest-ServerRescueNegativeTestJSON-412251590 tempest-ServerRescueNegativeTestJSON-412251590-project] Lock "1daf4f4c-0e4a-4779-b53a-78c48397ea2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120740) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 18:03:47.646532 dv-cinder-852009-8-iscsi devstack@n-api.service[120740]: DEBUG nova.policy [None req-75d67c4c-e17f-4356-948e-607f5d51db96 tempest-ServerRescueNegativeTestJSON-412251590 tempest-ServerRescueNegativeTestJSON-412251590-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '60800cf2774e409d9c1b6f4992669991', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2eae4acecf6c4961830ead78d71b2ad3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120740) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 18:03:47.654987 dv-cinder-852009-8-iscsi devstack@n-api.service[120740]: INFO nova.api.openstack.requestlog [None req-75d67c4c-e17f-4356-948e-607f5d51db96 tempest-ServerRescueNegativeTestJSON-412251590 tempest-ServerRescueNegativeTestJSON-412251590-project] 10.222.0.43 "GET /compute/v2.1/servers/a9c22f82-a945-4a94-b3c9-fe95265053bd" status: 200 len: 1511 microversion: 2.1 time: 0.210243 Sep 13 18:03:47.655453 dv-cinder-852009-8-iscsi devstack@n-api.service[120740]: [pid: 120740|app: 0|req: 124/238] 10.222.0.43 () {58 vars in 1236 bytes} [Tue Sep 13 18:03:47 2022] GET /compute/v2.1/servers/a9c22f82-a945-4a94-b3c9-fe95265053bd => generated 1511 bytes in 212 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 13 18:03:48.124964 dv-cinder-852009-8-iscsi devstack@n-api.service[120741]: DEBUG nova.api.openstack.wsgi [None req-67f5d7c3-2442-48a5-ab97-7d9b334c5b4b tempest-AttachVolumeShelveTestJSON-385853788 tempest-AttachVolumeShelveTestJSON-385853788-project] Calling method '>' {{(pid=120741) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 18:03:48.126916 dv-cinder-852009-8-iscsi devstack@n-api.service[120741]: DEBUG nova.compute.api [None req-67f5d7c3-2442-48a5-ab97-7d9b334c5b4b tempest-AttachVolumeShelveTestJSON-385853788 tempest-AttachVolumeShelveTestJSON-385853788-project] [instance: 11d2616a-96f9-4a7a-aab8-219219986a8b] Fetching instance by UUID {{(pid=120741) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 18:03:48.135332 dv-cinder-852009-8-iscsi devstack@n-api.service[120741]: DEBUG oslo_concurrency.lockutils [None req-67f5d7c3-2442-48a5-ab97-7d9b334c5b4b tempest-AttachVolumeShelveTestJSON-385853788 tempest-AttachVolumeShelveTestJSON-385853788-project] Acquiring lock "1daf4f4c-0e4a-4779-b53a-78c48397ea2f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120741) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 18:03:48.135948 dv-cinder-852009-8-iscsi devstack@n-api.service[120741]: DEBUG oslo_concurrency.lockutils [None req-67f5d7c3-2442-48a5-ab97-7d9b334c5b4b tempest-AttachVolumeShelveTestJSON-385853788 tempest-AttachVolumeShelveTestJSON-385853788-project] Lock "1daf4f4c-0e4a-4779-b53a-78c48397ea2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120741) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 18:03:48.136498 dv-cinder-852009-8-iscsi devstack@n-api.service[120741]: DEBUG oslo_concurrency.lockutils [None req-67f5d7c3-2442-48a5-ab97-7d9b334c5b4b tempest-AttachVolumeShelveTestJSON-385853788 tempest-AttachVolumeShelveTestJSON-385853788-project] Lock "1daf4f4c-0e4a-4779-b53a-78c48397ea2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120741) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 18:03:48.138047 dv-cinder-852009-8-iscsi devstack@n-api.service[120741]: DEBUG oslo_concurrency.lockutils [None req-67f5d7c3-2442-48a5-ab97-7d9b334c5b4b tempest-AttachVolumeShelveTestJSON-385853788 tempest-AttachVolumeShelveTestJSON-385853788-project] Acquiring lock "1daf4f4c-0e4a-4779-b53a-78c48397ea2f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120741) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 18:03:48.139059 dv-cinder-852009-8-iscsi devstack@n-api.service[120741]: DEBUG oslo_concurrency.lockutils [None req-67f5d7c3-2442-48a5-ab97-7d9b334c5b4b tempest-AttachVolumeShelveTestJSON-385853788 tempest-AttachVolumeShelveTestJSON-385853788-project] Lock "1daf4f4c-0e4a-4779-b53a-78c48397ea2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120741) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 18:03:48.139523 dv-cinder-852009-8-iscsi devstack@n-api.service[120741]: DEBUG oslo_concurrency.lockutils [None req-67f5d7c3-2442-48a5-ab97-7d9b334c5b4b tempest-AttachVolumeShelveTestJSON-385853788 tempest-AttachVolumeShelveTestJSON-385853788-project] Lock "1daf4f4c-0e4a-4779-b53a-78c48397ea2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120741) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 18:03:48.311174 dv-cinder-852009-8-iscsi devstack@n-api.service[120741]: DEBUG nova.policy [None req-67f5d7c3-2442-48a5-ab97-7d9b334c5b4b tempest-AttachVolumeShelveTestJSON-385853788 tempest-AttachVolumeShelveTestJSON-385853788-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e68ecd9b3ca643539b109f75bb242d6f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '75e14fd88bfb4cd896fa7b070a0fac47', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120741) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 18:03:48.319576 dv-cinder-852009-8-iscsi devstack@n-api.service[120741]: DEBUG nova.policy [None req-67f5d7c3-2442-48a5-ab97-7d9b334c5b4b tempest-AttachVolumeShelveTestJSON-385853788 tempest-AttachVolumeShelveTestJSON-385853788-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'e68ecd9b3ca643539b109f75bb242d6f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '75e14fd88bfb4cd896fa7b070a0fac47', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120741) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 18:03:48.321000 dv-cinder-852009-8-iscsi devstack@n-api.service[120741]: DEBUG nova.policy [None req-67f5d7c3-2442-48a5-ab97-7d9b334c5b4b tempest-AttachVolumeShelveTestJSON-385853788 tempest-AttachVolumeShelveTestJSON-385853788-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'e68ecd9b3ca643539b109f75bb242d6f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '75e14fd88bfb4cd896fa7b070a0fac47', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120741) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 18:03:48.322242 dv-cinder-852009-8-iscsi devstack@n-api.service[120741]: INFO nova.api.openstack.requestlog [None req-67f5d7c3-2442-48a5-ab97-7d9b334c5b4b tempest-AttachVolumeShelveTestJSON-385853788 tempest-AttachVolumeShelveTestJSON-385853788-project] 10.222.0.43 "GET /compute/v2.1/servers/11d2616a-96f9-4a7a-aab8-219219986a8b" status: 200 len: 1722 microversion: 2.20 time: 0.203157 Sep 13 18:03:48.331034 dv-cinder-852009-8-iscsi devstack@n-api.service[120741]: [pid: 120741|app: 0|req: 115/239] 10.222.0.43 () {60 vars in 1277 bytes} [Tue Sep 13 18:03:48 2022] GET /compute/v2.1/servers/11d2616a-96f9-4a7a-aab8-219219986a8b => generated 1722 bytes in 205 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 13 18:03:48.679072 dv-cinder-852009-8-iscsi devstack@n-api.service[120740]: DEBUG nova.api.openstack.wsgi [None req-dfd7e7a1-66bc-4521-aa58-ab4ad55b5d82 tempest-ServerRescueNegativeTestJSON-412251590 tempest-ServerRescueNegativeTestJSON-412251590-project] Calling method '>' {{(pid=120740) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 18:03:48.680533 dv-cinder-852009-8-iscsi devstack@n-api.service[120740]: DEBUG nova.compute.api [None req-dfd7e7a1-66bc-4521-aa58-ab4ad55b5d82 tempest-ServerRescueNegativeTestJSON-412251590 tempest-ServerRescueNegativeTestJSON-412251590-project] [instance: a9c22f82-a945-4a94-b3c9-fe95265053bd] Fetching instance by UUID {{(pid=120740) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 18:03:48.688732 dv-cinder-852009-8-iscsi devstack@n-api.service[120740]: DEBUG oslo_concurrency.lockutils [None req-dfd7e7a1-66bc-4521-aa58-ab4ad55b5d82 tempest-ServerRescueNegativeTestJSON-412251590 tempest-ServerRescueNegativeTestJSON-412251590-project] Acquiring lock "1daf4f4c-0e4a-4779-b53a-78c48397ea2f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120740) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 18:03:48.689231 dv-cinder-852009-8-iscsi devstack@n-api.service[120740]: DEBUG oslo_concurrency.lockutils [None req-dfd7e7a1-66bc-4521-aa58-ab4ad55b5d82 tempest-ServerRescueNegativeTestJSON-412251590 tempest-ServerRescueNegativeTestJSON-412251590-project] Lock "1daf4f4c-0e4a-4779-b53a-78c48397ea2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120740) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 18:03:48.689657 dv-cinder-852009-8-iscsi devstack@n-api.service[120740]: DEBUG oslo_concurrency.lockutils [None req-dfd7e7a1-66bc-4521-aa58-ab4ad55b5d82 tempest-ServerRescueNegativeTestJSON-412251590 tempest-ServerRescueNegativeTestJSON-412251590-project] Lock "1daf4f4c-0e4a-4779-b53a-78c48397ea2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120740) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 18:03:48.690492 dv-cinder-852009-8-iscsi devstack@n-api.service[120740]: DEBUG oslo_concurrency.lockutils [None req-dfd7e7a1-66bc-4521-aa58-ab4ad55b5d82 tempest-ServerRescueNegativeTestJSON-412251590 tempest-ServerRescueNegativeTestJSON-412251590-project] Acquiring lock "1daf4f4c-0e4a-4779-b53a-78c48397ea2f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120740) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 18:03:48.690944 dv-cinder-852009-8-iscsi devstack@n-api.service[120740]: DEBUG oslo_concurrency.lockutils [None req-dfd7e7a1-66bc-4521-aa58-ab4ad55b5d82 tempest-ServerRescueNegativeTestJSON-412251590 tempest-ServerRescueNegativeTestJSON-412251590-project] Lock "1daf4f4c-0e4a-4779-b53a-78c48397ea2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120740) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 18:03:48.691756 dv-cinder-852009-8-iscsi devstack@n-api.service[120740]: DEBUG oslo_concurrency.lockutils [None req-dfd7e7a1-66bc-4521-aa58-ab4ad55b5d82 tempest-ServerRescueNegativeTestJSON-412251590 tempest-ServerRescueNegativeTestJSON-412251590-project] Lock "1daf4f4c-0e4a-4779-b53a-78c48397ea2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120740) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 18:03:48.822378 dv-cinder-852009-8-iscsi devstack@n-api.service[120740]: DEBUG nova.policy [None req-dfd7e7a1-66bc-4521-aa58-ab4ad55b5d82 tempest-ServerRescueNegativeTestJSON-412251590 tempest-ServerRescueNegativeTestJSON-412251590-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '60800cf2774e409d9c1b6f4992669991', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2eae4acecf6c4961830ead78d71b2ad3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120740) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 18:03:48.831185 dv-cinder-852009-8-iscsi devstack@n-api.service[120740]: INFO nova.api.openstack.requestlog [None req-dfd7e7a1-66bc-4521-aa58-ab4ad55b5d82 tempest-ServerRescueNegativeTestJSON-412251590 tempest-ServerRescueNegativeTestJSON-412251590-project] 10.222.0.43 "GET /compute/v2.1/servers/a9c22f82-a945-4a94-b3c9-fe95265053bd" status: 200 len: 1511 microversion: 2.1 time: 0.157068 Sep 13 18:03:48.831774 dv-cinder-852009-8-iscsi devstack@n-api.service[120740]: [pid: 120740|app: 0|req: 125/240] 10.222.0.43 () {58 vars in 1236 bytes} [Tue Sep 13 18:03:48 2022] GET /compute/v2.1/servers/a9c22f82-a945-4a94-b3c9-fe95265053bd => generated 1511 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 13 18:03:49.108316 dv-cinder-852009-8-iscsi devstack@n-api.service[120741]: DEBUG nova.api.openstack.wsgi [None req-aaf001cf-7256-4d30-8ae6-ea3ea501a350 tempest-AttachVolumeTestJSON-555093534 tempest-AttachVolumeTestJSON-555093534-project] Calling method '>' {{(pid=120741) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 18:03:49.109072 dv-cinder-852009-8-iscsi devstack@n-api.service[120741]: DEBUG nova.compute.api [None req-aaf001cf-7256-4d30-8ae6-ea3ea501a350 tempest-AttachVolumeTestJSON-555093534 tempest-AttachVolumeTestJSON-555093534-project] [instance: b958d409-df20-44c6-aa0e-58cb0a482edf] Fetching instance by UUID {{(pid=120741) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 18:03:49.112377 dv-cinder-852009-8-iscsi devstack@n-api.service[120741]: DEBUG dbcounter [-] [120741] Writing DB stats nova_api:SELECT=34 {{(pid=120741) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 18:03:49.116017 dv-cinder-852009-8-iscsi devstack@n-api.service[120741]: DEBUG oslo_concurrency.lockutils [None req-aaf001cf-7256-4d30-8ae6-ea3ea501a350 tempest-AttachVolumeTestJSON-555093534 tempest-AttachVolumeTestJSON-555093534-project] Acquiring lock "1daf4f4c-0e4a-4779-b53a-78c48397ea2f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120741) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 18:03:49.116576 dv-cinder-852009-8-iscsi devstack@n-api.service[120741]: DEBUG oslo_concurrency.lockutils [None req-aaf001cf-7256-4d30-8ae6-ea3ea501a350 tempest-AttachVolumeTestJSON-555093534 tempest-AttachVolumeTestJSON-555093534-project] Lock "1daf4f4c-0e4a-4779-b53a-78c48397ea2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120741) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 18:03:49.117023 dv-cinder-852009-8-iscsi devstack@n-api.service[120741]: DEBUG oslo_concurrency.lockutils [None req-aaf001cf-7256-4d30-8ae6-ea3ea501a350 tempest-AttachVolumeTestJSON-555093534 tempest-AttachVolumeTestJSON-555093534-project] Lock "1daf4f4c-0e4a-4779-b53a-78c48397ea2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120741) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 18:03:49.117767 dv-cinder-852009-8-iscsi devstack@n-api.service[120741]: DEBUG oslo_concurrency.lockutils [None req-aaf001cf-7256-4d30-8ae6-ea3ea501a350 tempest-AttachVolumeTestJSON-555093534 tempest-AttachVolumeTestJSON-555093534-project] Acquiring lock "1daf4f4c-0e4a-4779-b53a-78c48397ea2f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120741) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 18:03:49.118261 dv-cinder-852009-8-iscsi devstack@n-api.service[120741]: DEBUG oslo_concurrency.lockutils [None req-aaf001cf-7256-4d30-8ae6-ea3ea501a350 tempest-AttachVolumeTestJSON-555093534 tempest-AttachVolumeTestJSON-555093534-project] Lock "1daf4f4c-0e4a-4779-b53a-78c48397ea2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120741) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 18:03:49.118752 dv-cinder-852009-8-iscsi devstack@n-api.service[120741]: DEBUG oslo_concurrency.lockutils [None req-aaf001cf-7256-4d30-8ae6-ea3ea501a350 tempest-AttachVolumeTestJSON-555093534 tempest-AttachVolumeTestJSON-555093534-project] Lock "1daf4f4c-0e4a-4779-b53a-78c48397ea2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120741) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 18:03:49.136919 dv-cinder-852009-8-iscsi devstack@n-api.service[120741]: DEBUG dbcounter [-] [120741] Writing DB stats nova_cell1:SELECT=96,nova_cell1:UPDATE=2,nova_cell1:INSERT=2 {{(pid=120741) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 18:03:49.147100 dv-cinder-852009-8-iscsi devstack@n-api.service[120741]: INFO nova.api.openstack.requestlog [None req-aaf001cf-7256-4d30-8ae6-ea3ea501a350 tempest-AttachVolumeTestJSON-555093534 tempest-AttachVolumeTestJSON-555093534-project] 10.222.0.43 "GET /compute/v2.1/servers/b958d409-df20-44c6-aa0e-58cb0a482edf/ips" status: 200 len: 147 microversion: 2.1 time: 0.042461 Sep 13 18:03:49.147670 dv-cinder-852009-8-iscsi devstack@n-api.service[120741]: [pid: 120741|app: 0|req: 116/241] 10.222.0.43 () {58 vars in 1248 bytes} [Tue Sep 13 18:03:49 2022] GET /compute/v2.1/servers/b958d409-df20-44c6-aa0e-58cb0a482edf/ips => generated 147 bytes in 44 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 13 18:03:49.356379 dv-cinder-852009-8-iscsi devstack@n-api.service[120740]: DEBUG nova.api.openstack.wsgi [None req-b8584824-3679-48d0-a209-5dd4bb5ee2fc tempest-AttachVolumeShelveTestJSON-385853788 tempest-AttachVolumeShelveTestJSON-385853788-project] Calling method '>' {{(pid=120740) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 18:03:49.357417 dv-cinder-852009-8-iscsi devstack@n-api.service[120740]: DEBUG nova.compute.api [None req-b8584824-3679-48d0-a209-5dd4bb5ee2fc tempest-AttachVolumeShelveTestJSON-385853788 tempest-AttachVolumeShelveTestJSON-385853788-project] [instance: 11d2616a-96f9-4a7a-aab8-219219986a8b] Fetching instance by UUID {{(pid=120740) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 18:03:49.365710 dv-cinder-852009-8-iscsi devstack@n-api.service[120740]: DEBUG oslo_concurrency.lockutils [None req-b8584824-3679-48d0-a209-5dd4bb5ee2fc tempest-AttachVolumeShelveTestJSON-385853788 tempest-AttachVolumeShelveTestJSON-385853788-project] Acquiring lock "1daf4f4c-0e4a-4779-b53a-78c48397ea2f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120740) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 18:03:49.366130 dv-cinder-852009-8-iscsi devstack@n-api.service[120740]: DEBUG oslo_concurrency.lockutils [None req-b8584824-3679-48d0-a209-5dd4bb5ee2fc tempest-AttachVolumeShelveTestJSON-385853788 tempest-AttachVolumeShelveTestJSON-385853788-project] Lock "1daf4f4c-0e4a-4779-b53a-78c48397ea2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120740) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 18:03:49.366552 dv-cinder-852009-8-iscsi devstack@n-api.service[120740]: DEBUG oslo_concurrency.lockutils [None req-b8584824-3679-48d0-a209-5dd4bb5ee2fc tempest-AttachVolumeShelveTestJSON-385853788 tempest-AttachVolumeShelveTestJSON-385853788-project] Lock "1daf4f4c-0e4a-4779-b53a-78c48397ea2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120740) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 18:03:49.367248 dv-cinder-852009-8-iscsi devstack@n-api.service[120740]: DEBUG oslo_concurrency.lockutils [None req-b8584824-3679-48d0-a209-5dd4bb5ee2fc tempest-AttachVolumeShelveTestJSON-385853788 tempest-AttachVolumeShelveTestJSON-385853788-project] Acquiring lock "1daf4f4c-0e4a-4779-b53a-78c48397ea2f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120740) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 18:03:49.367688 dv-cinder-852009-8-iscsi devstack@n-api.service[120740]: DEBUG oslo_concurrency.lockutils [None req-b8584824-3679-48d0-a209-5dd4bb5ee2fc tempest-AttachVolumeShelveTestJSON-385853788 tempest-AttachVolumeShelveTestJSON-385853788-project] Lock "1daf4f4c-0e4a-4779-b53a-78c48397ea2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120740) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 18:03:49.368093 dv-cinder-852009-8-iscsi devstack@n-api.service[120740]: DEBUG oslo_concurrency.lockutils [None req-b8584824-3679-48d0-a209-5dd4bb5ee2fc tempest-AttachVolumeShelveTestJSON-385853788 tempest-AttachVolumeShelveTestJSON-385853788-project] Lock "1daf4f4c-0e4a-4779-b53a-78c48397ea2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120740) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 18:03:49.580597 dv-cinder-852009-8-iscsi devstack@n-api.service[120740]: DEBUG nova.policy [None req-b8584824-3679-48d0-a209-5dd4bb5ee2fc tempest-AttachVolumeShelveTestJSON-385853788 tempest-AttachVolumeShelveTestJSON-385853788-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e68ecd9b3ca643539b109f75bb242d6f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '75e14fd88bfb4cd896fa7b070a0fac47', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120740) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 18:03:49.602552 dv-cinder-852009-8-iscsi devstack@n-api.service[120740]: DEBUG nova.policy [None req-b8584824-3679-48d0-a209-5dd4bb5ee2fc tempest-AttachVolumeShelveTestJSON-385853788 tempest-AttachVolumeShelveTestJSON-385853788-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'e68ecd9b3ca643539b109f75bb242d6f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '75e14fd88bfb4cd896fa7b070a0fac47', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120740) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 18:03:49.604109 dv-cinder-852009-8-iscsi devstack@n-api.service[120740]: DEBUG nova.policy [None req-b8584824-3679-48d0-a209-5dd4bb5ee2fc tempest-AttachVolumeShelveTestJSON-385853788 tempest-AttachVolumeShelveTestJSON-385853788-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'e68ecd9b3ca643539b109f75bb242d6f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '75e14fd88bfb4cd896fa7b070a0fac47', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120740) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 18:03:49.605459 dv-cinder-852009-8-iscsi devstack@n-api.service[120740]: INFO nova.api.openstack.requestlog [None req-b8584824-3679-48d0-a209-5dd4bb5ee2fc tempest-AttachVolumeShelveTestJSON-385853788 tempest-AttachVolumeShelveTestJSON-385853788-project] 10.222.0.43 "GET /compute/v2.1/servers/11d2616a-96f9-4a7a-aab8-219219986a8b" status: 200 len: 1722 microversion: 2.20 time: 0.261185 Sep 13 18:03:49.608027 dv-cinder-852009-8-iscsi devstack@n-api.service[120740]: [pid: 120740|app: 0|req: 126/242] 10.222.0.43 () {60 vars in 1277 bytes} [Tue Sep 13 18:03:49 2022] GET /compute/v2.1/servers/11d2616a-96f9-4a7a-aab8-219219986a8b => generated 1722 bytes in 262 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 13 18:03:49.856115 dv-cinder-852009-8-iscsi devstack@n-api.service[120741]: DEBUG nova.api.openstack.wsgi [None req-f06a1d2b-b0e8-444a-bbe8-3f974f7924da tempest-ServerRescueNegativeTestJSON-412251590 tempest-ServerRescueNegativeTestJSON-412251590-project] Calling method '>' {{(pid=120741) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 18:03:49.856870 dv-cinder-852009-8-iscsi devstack@n-api.service[120741]: DEBUG nova.compute.api [None req-f06a1d2b-b0e8-444a-bbe8-3f974f7924da tempest-ServerRescueNegativeTestJSON-412251590 tempest-ServerRescueNegativeTestJSON-412251590-project] [instance: a9c22f82-a945-4a94-b3c9-fe95265053bd] Fetching instance by UUID {{(pid=120741) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 18:03:49.864859 dv-cinder-852009-8-iscsi devstack@n-api.service[120741]: DEBUG oslo_concurrency.lockutils [None req-f06a1d2b-b0e8-444a-bbe8-3f974f7924da tempest-ServerRescueNegativeTestJSON-412251590 tempest-ServerRescueNegativeTestJSON-412251590-project] Acquiring lock "1daf4f4c-0e4a-4779-b53a-78c48397ea2f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120741) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 18:03:49.865692 dv-cinder-852009-8-iscsi devstack@n-api.service[120741]: DEBUG oslo_concurrency.lockutils [None req-f06a1d2b-b0e8-444a-bbe8-3f974f7924da tempest-ServerRescueNegativeTestJSON-412251590 tempest-ServerRescueNegativeTestJSON-412251590-project] Lock "1daf4f4c-0e4a-4779-b53a-78c48397ea2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120741) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 18:03:49.866387 dv-cinder-852009-8-iscsi devstack@n-api.service[120741]: DEBUG oslo_concurrency.lockutils [None req-f06a1d2b-b0e8-444a-bbe8-3f974f7924da tempest-ServerRescueNegativeTestJSON-412251590 tempest-ServerRescueNegativeTestJSON-412251590-project] Lock "1daf4f4c-0e4a-4779-b53a-78c48397ea2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120741) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 18:03:49.867582 dv-cinder-852009-8-iscsi devstack@n-api.service[120741]: DEBUG oslo_concurrency.lockutils [None req-f06a1d2b-b0e8-444a-bbe8-3f974f7924da tempest-ServerRescueNegativeTestJSON-412251590 tempest-ServerRescueNegativeTestJSON-412251590-project] Acquiring lock "1daf4f4c-0e4a-4779-b53a-78c48397ea2f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120741) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 18:03:49.868146 dv-cinder-852009-8-iscsi devstack@n-api.service[120741]: DEBUG oslo_concurrency.lockutils [None req-f06a1d2b-b0e8-444a-bbe8-3f974f7924da tempest-ServerRescueNegativeTestJSON-412251590 tempest-ServerRescueNegativeTestJSON-412251590-project] Lock "1daf4f4c-0e4a-4779-b53a-78c48397ea2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120741) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 18:03:49.868647 dv-cinder-852009-8-iscsi devstack@n-api.service[120741]: DEBUG oslo_concurrency.lockutils [None req-f06a1d2b-b0e8-444a-bbe8-3f974f7924da tempest-ServerRescueNegativeTestJSON-412251590 tempest-ServerRescueNegativeTestJSON-412251590-project] Lock "1daf4f4c-0e4a-4779-b53a-78c48397ea2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120741) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 18:03:50.014339 dv-cinder-852009-8-iscsi devstack@n-api.service[120741]: DEBUG nova.policy [None req-f06a1d2b-b0e8-444a-bbe8-3f974f7924da tempest-ServerRescueNegativeTestJSON-412251590 tempest-ServerRescueNegativeTestJSON-412251590-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '60800cf2774e409d9c1b6f4992669991', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2eae4acecf6c4961830ead78d71b2ad3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120741) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 18:03:50.023629 dv-cinder-852009-8-iscsi devstack@n-api.service[120741]: INFO nova.api.openstack.requestlog [None req-f06a1d2b-b0e8-444a-bbe8-3f974f7924da tempest-ServerRescueNegativeTestJSON-412251590 tempest-ServerRescueNegativeTestJSON-412251590-project] 10.222.0.43 "GET /compute/v2.1/servers/a9c22f82-a945-4a94-b3c9-fe95265053bd" status: 200 len: 1511 microversion: 2.1 time: 0.172064 Sep 13 18:03:50.024281 dv-cinder-852009-8-iscsi devstack@n-api.service[120741]: [pid: 120741|app: 0|req: 117/243] 10.222.0.43 () {58 vars in 1236 bytes} [Tue Sep 13 18:03:49 2022] GET /compute/v2.1/servers/a9c22f82-a945-4a94-b3c9-fe95265053bd => generated 1511 bytes in 173 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 13 18:03:50.632769 dv-cinder-852009-8-iscsi devstack@n-api.service[120740]: DEBUG nova.api.openstack.wsgi [None req-c2f9767d-2531-4354-b3e2-0f73e8bcd316 tempest-AttachVolumeShelveTestJSON-385853788 tempest-AttachVolumeShelveTestJSON-385853788-project] Calling method '>' {{(pid=120740) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 18:03:50.633572 dv-cinder-852009-8-iscsi devstack@n-api.service[120740]: DEBUG nova.compute.api [None req-c2f9767d-2531-4354-b3e2-0f73e8bcd316 tempest-AttachVolumeShelveTestJSON-385853788 tempest-AttachVolumeShelveTestJSON-385853788-project] [instance: 11d2616a-96f9-4a7a-aab8-219219986a8b] Fetching instance by UUID {{(pid=120740) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 18:03:50.640288 dv-cinder-852009-8-iscsi devstack@n-api.service[120740]: DEBUG oslo_concurrency.lockutils [None req-c2f9767d-2531-4354-b3e2-0f73e8bcd316 tempest-AttachVolumeShelveTestJSON-385853788 tempest-AttachVolumeShelveTestJSON-385853788-project] Acquiring lock "1daf4f4c-0e4a-4779-b53a-78c48397ea2f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120740) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 18:03:50.640802 dv-cinder-852009-8-iscsi devstack@n-api.service[120740]: DEBUG oslo_concurrency.lockutils [None req-c2f9767d-2531-4354-b3e2-0f73e8bcd316 tempest-AttachVolumeShelveTestJSON-385853788 tempest-AttachVolumeShelveTestJSON-385853788-project] Lock "1daf4f4c-0e4a-4779-b53a-78c48397ea2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120740) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 18:03:50.641229 dv-cinder-852009-8-iscsi devstack@n-api.service[120740]: DEBUG oslo_concurrency.lockutils [None req-c2f9767d-2531-4354-b3e2-0f73e8bcd316 tempest-AttachVolumeShelveTestJSON-385853788 tempest-AttachVolumeShelveTestJSON-385853788-project] Lock "1daf4f4c-0e4a-4779-b53a-78c48397ea2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120740) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 18:03:50.642078 dv-cinder-852009-8-iscsi devstack@n-api.service[120740]: DEBUG oslo_concurrency.lockutils [None req-c2f9767d-2531-4354-b3e2-0f73e8bcd316 tempest-AttachVolumeShelveTestJSON-385853788 tempest-AttachVolumeShelveTestJSON-385853788-project] Acquiring lock "1daf4f4c-0e4a-4779-b53a-78c48397ea2f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120740) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 18:03:50.642524 dv-cinder-852009-8-iscsi devstack@n-api.service[120740]: DEBUG oslo_concurrency.lockutils [None req-c2f9767d-2531-4354-b3e2-0f73e8bcd316 tempest-AttachVolumeShelveTestJSON-385853788 tempest-AttachVolumeShelveTestJSON-385853788-project] Lock "1daf4f4c-0e4a-4779-b53a-78c48397ea2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120740) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 18:03:50.643524 dv-cinder-852009-8-iscsi devstack@n-api.service[120740]: DEBUG oslo_concurrency.lockutils [None req-c2f9767d-2531-4354-b3e2-0f73e8bcd316 tempest-AttachVolumeShelveTestJSON-385853788 tempest-AttachVolumeShelveTestJSON-385853788-project] Lock "1daf4f4c-0e4a-4779-b53a-78c48397ea2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120740) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 18:03:50.797314 dv-cinder-852009-8-iscsi devstack@n-api.service[120740]: DEBUG nova.policy [None req-c2f9767d-2531-4354-b3e2-0f73e8bcd316 tempest-AttachVolumeShelveTestJSON-385853788 tempest-AttachVolumeShelveTestJSON-385853788-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e68ecd9b3ca643539b109f75bb242d6f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '75e14fd88bfb4cd896fa7b070a0fac47', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120740) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 18:03:50.809040 dv-cinder-852009-8-iscsi devstack@n-api.service[120740]: DEBUG nova.policy [None req-c2f9767d-2531-4354-b3e2-0f73e8bcd316 tempest-AttachVolumeShelveTestJSON-385853788 tempest-AttachVolumeShelveTestJSON-385853788-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'e68ecd9b3ca643539b109f75bb242d6f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '75e14fd88bfb4cd896fa7b070a0fac47', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120740) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 18:03:50.811652 dv-cinder-852009-8-iscsi devstack@n-api.service[120740]: DEBUG nova.policy [None req-c2f9767d-2531-4354-b3e2-0f73e8bcd316 tempest-AttachVolumeShelveTestJSON-385853788 tempest-AttachVolumeShelveTestJSON-385853788-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'e68ecd9b3ca643539b109f75bb242d6f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '75e14fd88bfb4cd896fa7b070a0fac47', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120740) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 18:03:50.813009 dv-cinder-852009-8-iscsi devstack@n-api.service[120740]: INFO nova.api.openstack.requestlog [None req-c2f9767d-2531-4354-b3e2-0f73e8bcd316 tempest-AttachVolumeShelveTestJSON-385853788 tempest-AttachVolumeShelveTestJSON-385853788-project] 10.222.0.43 "GET /compute/v2.1/servers/11d2616a-96f9-4a7a-aab8-219219986a8b" status: 200 len: 1722 microversion: 2.20 time: 0.184206 Sep 13 18:03:50.820739 dv-cinder-852009-8-iscsi devstack@n-api.service[120740]: [pid: 120740|app: 0|req: 127/244] 10.222.0.43 () {60 vars in 1277 bytes} [Tue Sep 13 18:03:50 2022] GET /compute/v2.1/servers/11d2616a-96f9-4a7a-aab8-219219986a8b => generated 1722 bytes in 192 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 13 18:03:51.046823 dv-cinder-852009-8-iscsi devstack@n-api.service[120741]: DEBUG nova.api.openstack.wsgi [None req-8b8d300f-65b8-42e5-b392-6a563e04054a tempest-ServerRescueNegativeTestJSON-412251590 tempest-ServerRescueNegativeTestJSON-412251590-project] Calling method '>' {{(pid=120741) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 18:03:51.047497 dv-cinder-852009-8-iscsi devstack@n-api.service[120741]: DEBUG nova.compute.api [None req-8b8d300f-65b8-42e5-b392-6a563e04054a tempest-ServerRescueNegativeTestJSON-412251590 tempest-ServerRescueNegativeTestJSON-412251590-project] [instance: a9c22f82-a945-4a94-b3c9-fe95265053bd] Fetching instance by UUID {{(pid=120741) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 18:03:51.055113 dv-cinder-852009-8-iscsi devstack@n-api.service[120741]: DEBUG oslo_concurrency.lockutils [None req-8b8d300f-65b8-42e5-b392-6a563e04054a tempest-ServerRescueNegativeTestJSON-412251590 tempest-ServerRescueNegativeTestJSON-412251590-project] Acquiring lock "1daf4f4c-0e4a-4779-b53a-78c48397ea2f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120741) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 18:03:51.055714 dv-cinder-852009-8-iscsi devstack@n-api.service[120741]: DEBUG oslo_concurrency.lockutils [None req-8b8d300f-65b8-42e5-b392-6a563e04054a tempest-ServerRescueNegativeTestJSON-412251590 tempest-ServerRescueNegativeTestJSON-412251590-project] Lock "1daf4f4c-0e4a-4779-b53a-78c48397ea2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120741) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 18:03:51.056346 dv-cinder-852009-8-iscsi devstack@n-api.service[120741]: DEBUG oslo_concurrency.lockutils [None req-8b8d300f-65b8-42e5-b392-6a563e04054a tempest-ServerRescueNegativeTestJSON-412251590 tempest-ServerRescueNegativeTestJSON-412251590-project] Lock "1daf4f4c-0e4a-4779-b53a-78c48397ea2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120741) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 18:03:51.057218 dv-cinder-852009-8-iscsi devstack@n-api.service[120741]: DEBUG oslo_concurrency.lockutils [None req-8b8d300f-65b8-42e5-b392-6a563e04054a tempest-ServerRescueNegativeTestJSON-412251590 tempest-ServerRescueNegativeTestJSON-412251590-project] Acquiring lock "1daf4f4c-0e4a-4779-b53a-78c48397ea2f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120741) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 18:03:51.057845 dv-cinder-852009-8-iscsi devstack@n-api.service[120741]: DEBUG oslo_concurrency.lockutils [None req-8b8d300f-65b8-42e5-b392-6a563e04054a tempest-ServerRescueNegativeTestJSON-412251590 tempest-ServerRescueNegativeTestJSON-412251590-project] Lock "1daf4f4c-0e4a-4779-b53a-78c48397ea2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120741) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 18:03:51.058270 dv-cinder-852009-8-iscsi devstack@n-api.service[120741]: DEBUG oslo_concurrency.lockutils [None req-8b8d300f-65b8-42e5-b392-6a563e04054a tempest-ServerRescueNegativeTestJSON-412251590 tempest-ServerRescueNegativeTestJSON-412251590-project] Lock "1daf4f4c-0e4a-4779-b53a-78c48397ea2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120741) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 18:03:51.200879 dv-cinder-852009-8-iscsi devstack@n-api.service[120741]: DEBUG nova.policy [None req-8b8d300f-65b8-42e5-b392-6a563e04054a tempest-ServerRescueNegativeTestJSON-412251590 tempest-ServerRescueNegativeTestJSON-412251590-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '60800cf2774e409d9c1b6f4992669991', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2eae4acecf6c4961830ead78d71b2ad3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120741) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 18:03:51.209026 dv-cinder-852009-8-iscsi devstack@n-api.service[120741]: INFO nova.api.openstack.requestlog [None req-8b8d300f-65b8-42e5-b392-6a563e04054a tempest-ServerRescueNegativeTestJSON-412251590 tempest-ServerRescueNegativeTestJSON-412251590-project] 10.222.0.43 "GET /compute/v2.1/servers/a9c22f82-a945-4a94-b3c9-fe95265053bd" status: 200 len: 1511 microversion: 2.1 time: 0.166272 Sep 13 18:03:51.209619 dv-cinder-852009-8-iscsi devstack@n-api.service[120741]: [pid: 120741|app: 0|req: 118/245] 10.222.0.43 () {58 vars in 1236 bytes} [Tue Sep 13 18:03:51 2022] GET /compute/v2.1/servers/a9c22f82-a945-4a94-b3c9-fe95265053bd => generated 1511 bytes in 167 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 13 18:03:51.844934 dv-cinder-852009-8-iscsi devstack@n-api.service[120740]: DEBUG nova.api.openstack.wsgi [None req-31079324-0549-4c2b-a30e-237376ea250d tempest-AttachVolumeShelveTestJSON-385853788 tempest-AttachVolumeShelveTestJSON-385853788-project] Calling method '>' {{(pid=120740) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 18:03:51.844934 dv-cinder-852009-8-iscsi devstack@n-api.service[120740]: DEBUG nova.compute.api [None req-31079324-0549-4c2b-a30e-237376ea250d tempest-AttachVolumeShelveTestJSON-385853788 tempest-AttachVolumeShelveTestJSON-385853788-project] [instance: 11d2616a-96f9-4a7a-aab8-219219986a8b] Fetching instance by UUID {{(pid=120740) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 18:03:51.851401 dv-cinder-852009-8-iscsi devstack@n-api.service[120740]: DEBUG oslo_concurrency.lockutils [None req-31079324-0549-4c2b-a30e-237376ea250d tempest-AttachVolumeShelveTestJSON-385853788 tempest-AttachVolumeShelveTestJSON-385853788-project] Acquiring lock "1daf4f4c-0e4a-4779-b53a-78c48397ea2f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120740) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 18:03:51.851955 dv-cinder-852009-8-iscsi devstack@n-api.service[120740]: DEBUG oslo_concurrency.lockutils [None req-31079324-0549-4c2b-a30e-237376ea250d tempest-AttachVolumeShelveTestJSON-385853788 tempest-AttachVolumeShelveTestJSON-385853788-project] Lock "1daf4f4c-0e4a-4779-b53a-78c48397ea2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120740) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 18:03:51.852593 dv-cinder-852009-8-iscsi devstack@n-api.service[120740]: DEBUG oslo_concurrency.lockutils [None req-31079324-0549-4c2b-a30e-237376ea250d tempest-AttachVolumeShelveTestJSON-385853788 tempest-AttachVolumeShelveTestJSON-385853788-project] Lock "1daf4f4c-0e4a-4779-b53a-78c48397ea2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120740) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 18:03:51.853685 dv-cinder-852009-8-iscsi devstack@n-api.service[120740]: DEBUG oslo_concurrency.lockutils [None req-31079324-0549-4c2b-a30e-237376ea250d tempest-AttachVolumeShelveTestJSON-385853788 tempest-AttachVolumeShelveTestJSON-385853788-project] Acquiring lock "1daf4f4c-0e4a-4779-b53a-78c48397ea2f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120740) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 18:03:51.854314 dv-cinder-852009-8-iscsi devstack@n-api.service[120740]: DEBUG oslo_concurrency.lockutils [None req-31079324-0549-4c2b-a30e-237376ea250d tempest-AttachVolumeShelveTestJSON-385853788 tempest-AttachVolumeShelveTestJSON-385853788-project] Lock "1daf4f4c-0e4a-4779-b53a-78c48397ea2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120740) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 18:03:51.854736 dv-cinder-852009-8-iscsi devstack@n-api.service[120740]: DEBUG oslo_concurrency.lockutils [None req-31079324-0549-4c2b-a30e-237376ea250d tempest-AttachVolumeShelveTestJSON-385853788 tempest-AttachVolumeShelveTestJSON-385853788-project] Lock "1daf4f4c-0e4a-4779-b53a-78c48397ea2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120740) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 18:03:52.001839 dv-cinder-852009-8-iscsi devstack@n-api.service[120740]: DEBUG nova.policy [None req-31079324-0549-4c2b-a30e-237376ea250d tempest-AttachVolumeShelveTestJSON-385853788 tempest-AttachVolumeShelveTestJSON-385853788-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e68ecd9b3ca643539b109f75bb242d6f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '75e14fd88bfb4cd896fa7b070a0fac47', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120740) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 18:03:52.011335 dv-cinder-852009-8-iscsi devstack@n-api.service[120740]: DEBUG nova.policy [None req-31079324-0549-4c2b-a30e-237376ea250d tempest-AttachVolumeShelveTestJSON-385853788 tempest-AttachVolumeShelveTestJSON-385853788-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'e68ecd9b3ca643539b109f75bb242d6f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '75e14fd88bfb4cd896fa7b070a0fac47', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120740) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 18:03:52.012856 dv-cinder-852009-8-iscsi devstack@n-api.service[120740]: DEBUG nova.policy [None req-31079324-0549-4c2b-a30e-237376ea250d tempest-AttachVolumeShelveTestJSON-385853788 tempest-AttachVolumeShelveTestJSON-385853788-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'e68ecd9b3ca643539b109f75bb242d6f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '75e14fd88bfb4cd896fa7b070a0fac47', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120740) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 18:03:52.014010 dv-cinder-852009-8-iscsi devstack@n-api.service[120740]: INFO nova.api.openstack.requestlog [None req-31079324-0549-4c2b-a30e-237376ea250d tempest-AttachVolumeShelveTestJSON-385853788 tempest-AttachVolumeShelveTestJSON-385853788-project] 10.222.0.43 "GET /compute/v2.1/servers/11d2616a-96f9-4a7a-aab8-219219986a8b" status: 200 len: 1722 microversion: 2.20 time: 0.175531 Sep 13 18:03:52.014559 dv-cinder-852009-8-iscsi devstack@n-api.service[120740]: [pid: 120740|app: 0|req: 128/246] 10.222.0.43 () {60 vars in 1277 bytes} [Tue Sep 13 18:03:51 2022] GET /compute/v2.1/servers/11d2616a-96f9-4a7a-aab8-219219986a8b => generated 1722 bytes in 180 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 13 18:03:52.234933 dv-cinder-852009-8-iscsi devstack@n-api.service[120741]: DEBUG nova.api.openstack.wsgi [None req-8d9d4633-a83f-44dd-b3f1-9d467cbdfa0f tempest-ServerRescueNegativeTestJSON-412251590 tempest-ServerRescueNegativeTestJSON-412251590-project] Calling method '>' {{(pid=120741) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 18:03:52.236301 dv-cinder-852009-8-iscsi devstack@n-api.service[120741]: DEBUG nova.compute.api [None req-8d9d4633-a83f-44dd-b3f1-9d467cbdfa0f tempest-ServerRescueNegativeTestJSON-412251590 tempest-ServerRescueNegativeTestJSON-412251590-project] [instance: a9c22f82-a945-4a94-b3c9-fe95265053bd] Fetching instance by UUID {{(pid=120741) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 18:03:52.243000 dv-cinder-852009-8-iscsi devstack@n-api.service[120741]: DEBUG oslo_concurrency.lockutils [None req-8d9d4633-a83f-44dd-b3f1-9d467cbdfa0f tempest-ServerRescueNegativeTestJSON-412251590 tempest-ServerRescueNegativeTestJSON-412251590-project] Acquiring lock "1daf4f4c-0e4a-4779-b53a-78c48397ea2f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120741) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 18:03:52.243776 dv-cinder-852009-8-iscsi devstack@n-api.service[120741]: DEBUG oslo_concurrency.lockutils [None req-8d9d4633-a83f-44dd-b3f1-9d467cbdfa0f tempest-ServerRescueNegativeTestJSON-412251590 tempest-ServerRescueNegativeTestJSON-412251590-project] Lock "1daf4f4c-0e4a-4779-b53a-78c48397ea2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120741) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 18:03:52.244290 dv-cinder-852009-8-iscsi devstack@n-api.service[120741]: DEBUG oslo_concurrency.lockutils [None req-8d9d4633-a83f-44dd-b3f1-9d467cbdfa0f tempest-ServerRescueNegativeTestJSON-412251590 tempest-ServerRescueNegativeTestJSON-412251590-project] Lock "1daf4f4c-0e4a-4779-b53a-78c48397ea2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120741) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 18:03:52.245243 dv-cinder-852009-8-iscsi devstack@n-api.service[120741]: DEBUG oslo_concurrency.lockutils [None req-8d9d4633-a83f-44dd-b3f1-9d467cbdfa0f tempest-ServerRescueNegativeTestJSON-412251590 tempest-ServerRescueNegativeTestJSON-412251590-project] Acquiring lock "1daf4f4c-0e4a-4779-b53a-78c48397ea2f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120741) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 18:03:52.245934 dv-cinder-852009-8-iscsi devstack@n-api.service[120741]: DEBUG oslo_concurrency.lockutils [None req-8d9d4633-a83f-44dd-b3f1-9d467cbdfa0f tempest-ServerRescueNegativeTestJSON-412251590 tempest-ServerRescueNegativeTestJSON-412251590-project] Lock "1daf4f4c-0e4a-4779-b53a-78c48397ea2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120741) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 18:03:52.246404 dv-cinder-852009-8-iscsi devstack@n-api.service[120741]: DEBUG oslo_concurrency.lockutils [None req-8d9d4633-a83f-44dd-b3f1-9d467cbdfa0f tempest-ServerRescueNegativeTestJSON-412251590 tempest-ServerRescueNegativeTestJSON-412251590-project] Lock "1daf4f4c-0e4a-4779-b53a-78c48397ea2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120741) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 18:03:52.401955 dv-cinder-852009-8-iscsi devstack@n-api.service[120741]: DEBUG nova.policy [None req-8d9d4633-a83f-44dd-b3f1-9d467cbdfa0f tempest-ServerRescueNegativeTestJSON-412251590 tempest-ServerRescueNegativeTestJSON-412251590-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '60800cf2774e409d9c1b6f4992669991', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2eae4acecf6c4961830ead78d71b2ad3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120741) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 18:03:52.410501 dv-cinder-852009-8-iscsi devstack@n-api.service[120741]: INFO nova.api.openstack.requestlog [None req-8d9d4633-a83f-44dd-b3f1-9d467cbdfa0f tempest-ServerRescueNegativeTestJSON-412251590 tempest-ServerRescueNegativeTestJSON-412251590-project] 10.222.0.43 "GET /compute/v2.1/servers/a9c22f82-a945-4a94-b3c9-fe95265053bd" status: 200 len: 1511 microversion: 2.1 time: 0.180967 Sep 13 18:03:52.411151 dv-cinder-852009-8-iscsi devstack@n-api.service[120741]: [pid: 120741|app: 0|req: 119/247] 10.222.0.43 () {58 vars in 1236 bytes} [Tue Sep 13 18:03:52 2022] GET /compute/v2.1/servers/a9c22f82-a945-4a94-b3c9-fe95265053bd => generated 1511 bytes in 182 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 13 18:03:53.039964 dv-cinder-852009-8-iscsi devstack@n-api.service[120740]: DEBUG nova.api.openstack.wsgi [None req-f87dd108-bd2e-4147-9259-e35f4eacf0d5 tempest-AttachVolumeShelveTestJSON-385853788 tempest-AttachVolumeShelveTestJSON-385853788-project] Calling method '>' {{(pid=120740) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 18:03:53.040643 dv-cinder-852009-8-iscsi devstack@n-api.service[120740]: DEBUG nova.compute.api [None req-f87dd108-bd2e-4147-9259-e35f4eacf0d5 tempest-AttachVolumeShelveTestJSON-385853788 tempest-AttachVolumeShelveTestJSON-385853788-project] [instance: 11d2616a-96f9-4a7a-aab8-219219986a8b] Fetching instance by UUID {{(pid=120740) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 18:03:53.042868 dv-cinder-852009-8-iscsi devstack@n-api.service[120740]: DEBUG dbcounter [-] [120740] Writing DB stats nova_api:SELECT=57,nova_api:INSERT=1 {{(pid=120740) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 18:03:53.054999 dv-cinder-852009-8-iscsi devstack@n-api.service[120740]: DEBUG oslo_concurrency.lockutils [None req-f87dd108-bd2e-4147-9259-e35f4eacf0d5 tempest-AttachVolumeShelveTestJSON-385853788 tempest-AttachVolumeShelveTestJSON-385853788-project] Acquiring lock "1daf4f4c-0e4a-4779-b53a-78c48397ea2f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120740) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 18:03:53.055554 dv-cinder-852009-8-iscsi devstack@n-api.service[120740]: DEBUG oslo_concurrency.lockutils [None req-f87dd108-bd2e-4147-9259-e35f4eacf0d5 tempest-AttachVolumeShelveTestJSON-385853788 tempest-AttachVolumeShelveTestJSON-385853788-project] Lock "1daf4f4c-0e4a-4779-b53a-78c48397ea2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120740) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 18:03:53.055985 dv-cinder-852009-8-iscsi devstack@n-api.service[120740]: DEBUG oslo_concurrency.lockutils [None req-f87dd108-bd2e-4147-9259-e35f4eacf0d5 tempest-AttachVolumeShelveTestJSON-385853788 tempest-AttachVolumeShelveTestJSON-385853788-project] Lock "1daf4f4c-0e4a-4779-b53a-78c48397ea2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120740) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 18:03:53.057294 dv-cinder-852009-8-iscsi devstack@n-api.service[120740]: DEBUG oslo_concurrency.lockutils [None req-f87dd108-bd2e-4147-9259-e35f4eacf0d5 tempest-AttachVolumeShelveTestJSON-385853788 tempest-AttachVolumeShelveTestJSON-385853788-project] Acquiring lock "1daf4f4c-0e4a-4779-b53a-78c48397ea2f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120740) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 18:03:53.057899 dv-cinder-852009-8-iscsi devstack@n-api.service[120740]: DEBUG oslo_concurrency.lockutils [None req-f87dd108-bd2e-4147-9259-e35f4eacf0d5 tempest-AttachVolumeShelveTestJSON-385853788 tempest-AttachVolumeShelveTestJSON-385853788-project] Lock "1daf4f4c-0e4a-4779-b53a-78c48397ea2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120740) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 18:03:53.058559 dv-cinder-852009-8-iscsi devstack@n-api.service[120740]: DEBUG oslo_concurrency.lockutils [None req-f87dd108-bd2e-4147-9259-e35f4eacf0d5 tempest-AttachVolumeShelveTestJSON-385853788 tempest-AttachVolumeShelveTestJSON-385853788-project] Lock "1daf4f4c-0e4a-4779-b53a-78c48397ea2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120740) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 18:03:53.200706 dv-cinder-852009-8-iscsi devstack@n-api.service[120740]: DEBUG nova.policy [None req-f87dd108-bd2e-4147-9259-e35f4eacf0d5 tempest-AttachVolumeShelveTestJSON-385853788 tempest-AttachVolumeShelveTestJSON-385853788-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e68ecd9b3ca643539b109f75bb242d6f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '75e14fd88bfb4cd896fa7b070a0fac47', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120740) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 18:03:53.209101 dv-cinder-852009-8-iscsi devstack@n-api.service[120740]: DEBUG nova.policy [None req-f87dd108-bd2e-4147-9259-e35f4eacf0d5 tempest-AttachVolumeShelveTestJSON-385853788 tempest-AttachVolumeShelveTestJSON-385853788-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'e68ecd9b3ca643539b109f75bb242d6f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '75e14fd88bfb4cd896fa7b070a0fac47', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120740) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 18:03:53.210560 dv-cinder-852009-8-iscsi devstack@n-api.service[120740]: DEBUG nova.policy [None req-f87dd108-bd2e-4147-9259-e35f4eacf0d5 tempest-AttachVolumeShelveTestJSON-385853788 tempest-AttachVolumeShelveTestJSON-385853788-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'e68ecd9b3ca643539b109f75bb242d6f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '75e14fd88bfb4cd896fa7b070a0fac47', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120740) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 18:03:53.211809 dv-cinder-852009-8-iscsi devstack@n-api.service[120740]: INFO nova.api.openstack.requestlog [None req-f87dd108-bd2e-4147-9259-e35f4eacf0d5 tempest-AttachVolumeShelveTestJSON-385853788 tempest-AttachVolumeShelveTestJSON-385853788-project] 10.222.0.43 "GET /compute/v2.1/servers/11d2616a-96f9-4a7a-aab8-219219986a8b" status: 200 len: 1722 microversion: 2.20 time: 0.176268 Sep 13 18:03:53.212774 dv-cinder-852009-8-iscsi devstack@n-api.service[120740]: [pid: 120740|app: 0|req: 129/248] 10.222.0.43 () {60 vars in 1277 bytes} [Tue Sep 13 18:03:53 2022] GET /compute/v2.1/servers/11d2616a-96f9-4a7a-aab8-219219986a8b => generated 1722 bytes in 177 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 13 18:03:53.437141 dv-cinder-852009-8-iscsi devstack@n-api.service[120741]: DEBUG nova.api.openstack.wsgi [None req-a82d52ae-39dc-4f81-a917-01c9d988779b tempest-ServerRescueNegativeTestJSON-412251590 tempest-ServerRescueNegativeTestJSON-412251590-project] Calling method '>' {{(pid=120741) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 18:03:53.437964 dv-cinder-852009-8-iscsi devstack@n-api.service[120741]: DEBUG nova.compute.api [None req-a82d52ae-39dc-4f81-a917-01c9d988779b tempest-ServerRescueNegativeTestJSON-412251590 tempest-ServerRescueNegativeTestJSON-412251590-project] [instance: a9c22f82-a945-4a94-b3c9-fe95265053bd] Fetching instance by UUID {{(pid=120741) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 18:03:53.444402 dv-cinder-852009-8-iscsi devstack@n-api.service[120741]: DEBUG oslo_concurrency.lockutils [None req-a82d52ae-39dc-4f81-a917-01c9d988779b tempest-ServerRescueNegativeTestJSON-412251590 tempest-ServerRescueNegativeTestJSON-412251590-project] Acquiring lock "1daf4f4c-0e4a-4779-b53a-78c48397ea2f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120741) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 18:03:53.444935 dv-cinder-852009-8-iscsi devstack@n-api.service[120741]: DEBUG oslo_concurrency.lockutils [None req-a82d52ae-39dc-4f81-a917-01c9d988779b tempest-ServerRescueNegativeTestJSON-412251590 tempest-ServerRescueNegativeTestJSON-412251590-project] Lock "1daf4f4c-0e4a-4779-b53a-78c48397ea2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120741) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 18:03:53.445384 dv-cinder-852009-8-iscsi devstack@n-api.service[120741]: DEBUG oslo_concurrency.lockutils [None req-a82d52ae-39dc-4f81-a917-01c9d988779b tempest-ServerRescueNegativeTestJSON-412251590 tempest-ServerRescueNegativeTestJSON-412251590-project] Lock "1daf4f4c-0e4a-4779-b53a-78c48397ea2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120741) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 18:03:53.446119 dv-cinder-852009-8-iscsi devstack@n-api.service[120741]: DEBUG oslo_concurrency.lockutils [None req-a82d52ae-39dc-4f81-a917-01c9d988779b tempest-ServerRescueNegativeTestJSON-412251590 tempest-ServerRescueNegativeTestJSON-412251590-project] Acquiring lock "1daf4f4c-0e4a-4779-b53a-78c48397ea2f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120741) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 18:03:53.446604 dv-cinder-852009-8-iscsi devstack@n-api.service[120741]: DEBUG oslo_concurrency.lockutils [None req-a82d52ae-39dc-4f81-a917-01c9d988779b tempest-ServerRescueNegativeTestJSON-412251590 tempest-ServerRescueNegativeTestJSON-412251590-project] Lock "1daf4f4c-0e4a-4779-b53a-78c48397ea2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120741) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 18:03:53.447191 dv-cinder-852009-8-iscsi devstack@n-api.service[120741]: DEBUG oslo_concurrency.lockutils [None req-a82d52ae-39dc-4f81-a917-01c9d988779b tempest-ServerRescueNegativeTestJSON-412251590 tempest-ServerRescueNegativeTestJSON-412251590-project] Lock "1daf4f4c-0e4a-4779-b53a-78c48397ea2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120741) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 18:03:53.622934 dv-cinder-852009-8-iscsi devstack@n-api.service[120741]: DEBUG nova.policy [None req-a82d52ae-39dc-4f81-a917-01c9d988779b tempest-ServerRescueNegativeTestJSON-412251590 tempest-ServerRescueNegativeTestJSON-412251590-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '60800cf2774e409d9c1b6f4992669991', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2eae4acecf6c4961830ead78d71b2ad3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120741) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 18:03:53.634666 dv-cinder-852009-8-iscsi devstack@n-api.service[120741]: INFO nova.api.openstack.requestlog [None req-a82d52ae-39dc-4f81-a917-01c9d988779b tempest-ServerRescueNegativeTestJSON-412251590 tempest-ServerRescueNegativeTestJSON-412251590-project] 10.222.0.43 "GET /compute/v2.1/servers/a9c22f82-a945-4a94-b3c9-fe95265053bd" status: 200 len: 1517 microversion: 2.1 time: 0.201566 Sep 13 18:03:53.636445 dv-cinder-852009-8-iscsi devstack@n-api.service[120741]: [pid: 120741|app: 0|req: 120/249] 10.222.0.43 () {58 vars in 1236 bytes} [Tue Sep 13 18:03:53 2022] GET /compute/v2.1/servers/a9c22f82-a945-4a94-b3c9-fe95265053bd => generated 1517 bytes in 204 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 13 18:03:54.149355 dv-cinder-852009-8-iscsi devstack@n-api.service[120740]: DEBUG nova.api.openstack.wsgi [None req-398ba517-3256-4bf8-8974-fb66a406165a tempest-AttachVolumeTestJSON-555093534 tempest-AttachVolumeTestJSON-555093534-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "b2ed4383-e3fc-44cc-916c-b102e81a7295"}} {{(pid=120740) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 13 18:03:54.151783 dv-cinder-852009-8-iscsi devstack@n-api.service[120740]: DEBUG nova.compute.api [None req-398ba517-3256-4bf8-8974-fb66a406165a tempest-AttachVolumeTestJSON-555093534 tempest-AttachVolumeTestJSON-555093534-project] [instance: b958d409-df20-44c6-aa0e-58cb0a482edf] Fetching instance by UUID {{(pid=120740) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 18:03:54.157987 dv-cinder-852009-8-iscsi devstack@n-api.service[120740]: DEBUG oslo_concurrency.lockutils [None req-398ba517-3256-4bf8-8974-fb66a406165a tempest-AttachVolumeTestJSON-555093534 tempest-AttachVolumeTestJSON-555093534-project] Acquiring lock "1daf4f4c-0e4a-4779-b53a-78c48397ea2f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120740) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 18:03:54.165013 dv-cinder-852009-8-iscsi devstack@n-api.service[120740]: DEBUG oslo_concurrency.lockutils [None req-398ba517-3256-4bf8-8974-fb66a406165a tempest-AttachVolumeTestJSON-555093534 tempest-AttachVolumeTestJSON-555093534-project] Lock "1daf4f4c-0e4a-4779-b53a-78c48397ea2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120740) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 18:03:54.165532 dv-cinder-852009-8-iscsi devstack@n-api.service[120740]: DEBUG oslo_concurrency.lockutils [None req-398ba517-3256-4bf8-8974-fb66a406165a tempest-AttachVolumeTestJSON-555093534 tempest-AttachVolumeTestJSON-555093534-project] Lock "1daf4f4c-0e4a-4779-b53a-78c48397ea2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=120740) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 18:03:54.166367 dv-cinder-852009-8-iscsi devstack@n-api.service[120740]: DEBUG oslo_concurrency.lockutils [None req-398ba517-3256-4bf8-8974-fb66a406165a tempest-AttachVolumeTestJSON-555093534 tempest-AttachVolumeTestJSON-555093534-project] Acquiring lock "1daf4f4c-0e4a-4779-b53a-78c48397ea2f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120740) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 18:03:54.166834 dv-cinder-852009-8-iscsi devstack@n-api.service[120740]: DEBUG oslo_concurrency.lockutils [None req-398ba517-3256-4bf8-8974-fb66a406165a tempest-AttachVolumeTestJSON-555093534 tempest-AttachVolumeTestJSON-555093534-project] Lock "1daf4f4c-0e4a-4779-b53a-78c48397ea2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120740) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 18:03:54.167263 dv-cinder-852009-8-iscsi devstack@n-api.service[120740]: DEBUG oslo_concurrency.lockutils [None req-398ba517-3256-4bf8-8974-fb66a406165a tempest-AttachVolumeTestJSON-555093534 tempest-AttachVolumeTestJSON-555093534-project] Lock "1daf4f4c-0e4a-4779-b53a-78c48397ea2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120740) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 18:03:54.237890 dv-cinder-852009-8-iscsi devstack@n-api.service[120741]: DEBUG nova.api.openstack.wsgi [None req-dda51872-83b3-4742-a076-b1495da69729 tempest-AttachVolumeShelveTestJSON-385853788 tempest-AttachVolumeShelveTestJSON-385853788-project] Calling method '>' {{(pid=120741) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 18:03:54.238561 dv-cinder-852009-8-iscsi devstack@n-api.service[120741]: DEBUG nova.compute.api [None req-dda51872-83b3-4742-a076-b1495da69729 tempest-AttachVolumeShelveTestJSON-385853788 tempest-AttachVolumeShelveTestJSON-385853788-project] [instance: 11d2616a-96f9-4a7a-aab8-219219986a8b] Fetching instance by UUID {{(pid=120741) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 18:03:54.245297 dv-cinder-852009-8-iscsi devstack@n-api.service[120741]: DEBUG oslo_concurrency.lockutils [None req-dda51872-83b3-4742-a076-b1495da69729 tempest-AttachVolumeShelveTestJSON-385853788 tempest-AttachVolumeShelveTestJSON-385853788-project] Acquiring lock "1daf4f4c-0e4a-4779-b53a-78c48397ea2f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120741) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 18:03:54.245869 dv-cinder-852009-8-iscsi devstack@n-api.service[120741]: DEBUG oslo_concurrency.lockutils [None req-dda51872-83b3-4742-a076-b1495da69729 tempest-AttachVolumeShelveTestJSON-385853788 tempest-AttachVolumeShelveTestJSON-385853788-project] Lock "1daf4f4c-0e4a-4779-b53a-78c48397ea2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120741) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 18:03:54.246470 dv-cinder-852009-8-iscsi devstack@n-api.service[120741]: DEBUG oslo_concurrency.lockutils [None req-dda51872-83b3-4742-a076-b1495da69729 tempest-AttachVolumeShelveTestJSON-385853788 tempest-AttachVolumeShelveTestJSON-385853788-project] Lock "1daf4f4c-0e4a-4779-b53a-78c48397ea2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120741) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 18:03:54.247168 dv-cinder-852009-8-iscsi devstack@n-api.service[120741]: DEBUG oslo_concurrency.lockutils [None req-dda51872-83b3-4742-a076-b1495da69729 tempest-AttachVolumeShelveTestJSON-385853788 tempest-AttachVolumeShelveTestJSON-385853788-project] Acquiring lock "1daf4f4c-0e4a-4779-b53a-78c48397ea2f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120741) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 18:03:54.247645 dv-cinder-852009-8-iscsi devstack@n-api.service[120741]: DEBUG oslo_concurrency.lockutils [None req-dda51872-83b3-4742-a076-b1495da69729 tempest-AttachVolumeShelveTestJSON-385853788 tempest-AttachVolumeShelveTestJSON-385853788-project] Lock "1daf4f4c-0e4a-4779-b53a-78c48397ea2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120741) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 18:03:54.248058 dv-cinder-852009-8-iscsi devstack@n-api.service[120741]: DEBUG oslo_concurrency.lockutils [None req-dda51872-83b3-4742-a076-b1495da69729 tempest-AttachVolumeShelveTestJSON-385853788 tempest-AttachVolumeShelveTestJSON-385853788-project] Lock "1daf4f4c-0e4a-4779-b53a-78c48397ea2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120741) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 18:03:54.424931 dv-cinder-852009-8-iscsi devstack@n-api.service[120741]: DEBUG nova.policy [None req-dda51872-83b3-4742-a076-b1495da69729 tempest-AttachVolumeShelveTestJSON-385853788 tempest-AttachVolumeShelveTestJSON-385853788-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e68ecd9b3ca643539b109f75bb242d6f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '75e14fd88bfb4cd896fa7b070a0fac47', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120741) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 18:03:54.434480 dv-cinder-852009-8-iscsi devstack@n-api.service[120741]: DEBUG nova.policy [None req-dda51872-83b3-4742-a076-b1495da69729 tempest-AttachVolumeShelveTestJSON-385853788 tempest-AttachVolumeShelveTestJSON-385853788-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'e68ecd9b3ca643539b109f75bb242d6f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '75e14fd88bfb4cd896fa7b070a0fac47', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120741) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 18:03:54.436408 dv-cinder-852009-8-iscsi devstack@n-api.service[120741]: DEBUG nova.policy [None req-dda51872-83b3-4742-a076-b1495da69729 tempest-AttachVolumeShelveTestJSON-385853788 tempest-AttachVolumeShelveTestJSON-385853788-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'e68ecd9b3ca643539b109f75bb242d6f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '75e14fd88bfb4cd896fa7b070a0fac47', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120741) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 18:03:54.438780 dv-cinder-852009-8-iscsi devstack@n-api.service[120741]: INFO nova.api.openstack.requestlog [None req-dda51872-83b3-4742-a076-b1495da69729 tempest-AttachVolumeShelveTestJSON-385853788 tempest-AttachVolumeShelveTestJSON-385853788-project] 10.222.0.43 "GET /compute/v2.1/servers/11d2616a-96f9-4a7a-aab8-219219986a8b" status: 200 len: 1722 microversion: 2.20 time: 0.204921 Sep 13 18:03:54.439360 dv-cinder-852009-8-iscsi devstack@n-api.service[120741]: [pid: 120741|app: 0|req: 121/250] 10.222.0.43 () {60 vars in 1277 bytes} [Tue Sep 13 18:03:54 2022] GET /compute/v2.1/servers/11d2616a-96f9-4a7a-aab8-219219986a8b => generated 1722 bytes in 206 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Sep 13 18:03:54.477114 dv-cinder-852009-8-iscsi devstack@n-api.service[120740]: INFO nova.api.openstack.requestlog [None req-398ba517-3256-4bf8-8974-fb66a406165a tempest-AttachVolumeTestJSON-555093534 tempest-AttachVolumeTestJSON-555093534-project] 10.222.0.43 "POST /compute/v2.1/servers/b958d409-df20-44c6-aa0e-58cb0a482edf/os-volume_attachments" status: 200 len: 194 microversion: 2.1 time: 0.332006 Sep 13 18:03:54.480677 dv-cinder-852009-8-iscsi devstack@n-api.service[120740]: [pid: 120740|app: 0|req: 130/251] 10.222.0.43 () {60 vars in 1323 bytes} [Tue Sep 13 18:03:54 2022] POST /compute/v2.1/servers/b958d409-df20-44c6-aa0e-58cb0a482edf/os-volume_attachments => generated 194 bytes in 334 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 13 18:03:55.112372 dv-cinder-852009-8-iscsi devstack@n-api.service[120741]: DEBUG nova.api.openstack.wsgi [None req-e9b23577-4c9a-4f4e-b6ce-cd707da995d6 tempest-ServerRescueNegativeTestJSON-412251590 tempest-ServerRescueNegativeTestJSON-412251590-project] Action: 'create', calling method: .version_select at 0x7fa626d35280>, body: {"keypair": {"name": "tempest-keypair-1939634926", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBIC2/PquBfKkW6/lq4ZadklGfC+aEnL2ZonNQklDMuEfArECjXA3Yql9/szCSYpAFIxLXltEMXtHOTCJaIQPjFia3jVxX9Q1YJW7qnGVyiODlLcWIQVkbMVESq2gzClsEA=="}} {{(pid=120741) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 13 18:03:55.131481 dv-cinder-852009-8-iscsi devstack@n-api.service[120741]: DEBUG nova.quota [None req-e9b23577-4c9a-4f4e-b6ce-cd707da995d6 tempest-ServerRescueNegativeTestJSON-412251590 tempest-ServerRescueNegativeTestJSON-412251590-project] Getting quotas for project 2eae4acecf6c4961830ead78d71b2ad3. Resources: {'key_pairs'} {{(pid=120741) _get_quotas /opt/stack/nova/nova/quota.py:393}} Sep 13 18:03:55.136952 dv-cinder-852009-8-iscsi devstack@n-api.service[120741]: DEBUG nova.quota [None req-e9b23577-4c9a-4f4e-b6ce-cd707da995d6 tempest-ServerRescueNegativeTestJSON-412251590 tempest-ServerRescueNegativeTestJSON-412251590-project] Getting quotas for user 60800cf2774e409d9c1b6f4992669991 and project 2eae4acecf6c4961830ead78d71b2ad3. Resources: {'key_pairs'} {{(pid=120741) _get_quotas /opt/stack/nova/nova/quota.py:383}} Sep 13 18:03:55.163022 dv-cinder-852009-8-iscsi devstack@n-api.service[120741]: INFO nova.api.openstack.requestlog [None req-e9b23577-4c9a-4f4e-b6ce-cd707da995d6 tempest-ServerRescueNegativeTestJSON-412251590 tempest-ServerRescueNegativeTestJSON-412251590-project] 10.222.0.43 "POST /compute/v2.1/os-keypairs" status: 200 len: 386 microversion: 2.1 time: 0.055745 Sep 13 18:03:55.163633 dv-cinder-852009-8-iscsi devstack@n-api.service[120741]: [pid: 120741|app: 0|req: 122/252] 10.222.0.43 () {60 vars in 1159 bytes} [Tue Sep 13 18:03:55 2022] POST /compute/v2.1/os-keypairs => generated 386 bytes in 57 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Sep 13 18:03:55.465900 dv-cinder-852009-8-iscsi devstack@n-api.service[120740]: DEBUG nova.api.openstack.wsgi [None req-4dad7074-2b2b-4887-9fe7-2cc3a80ddf15 tempest-AttachVolumeShelveTestJSON-385853788 tempest-AttachVolumeShelveTestJSON-385853788-project] Calling method '>' {{(pid=120740) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 18:03:55.466612 dv-cinder-852009-8-iscsi devstack@n-api.service[120740]: DEBUG nova.compute.api [None req-4dad7074-2b2b-4887-9fe7-2cc3a80ddf15 tempest-AttachVolumeShelveTestJSON-385853788 tempest-AttachVolumeShelveTestJSON-385853788-project] [instance: 11d2616a-96f9-4a7a-aab8-219219986a8b] Fetching instance by UUID {{(pid=120740) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 18:03:55.476044 dv-cinder-852009-8-iscsi devstack@n-api.service[120740]: DEBUG oslo_concurrency.lockutils [None req-4dad7074-2b2b-4887-9fe7-2cc3a80ddf15 tempest-AttachVolumeShelveTestJSON-385853788 tempest-AttachVolumeShelveTestJSON-385853788-project] Acquiring lock "1daf4f4c-0e4a-4779-b53a-78c48397ea2f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120740) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 18:03:55.476520 dv-cinder-852009-8-iscsi devstack@n-api.service[120740]: DEBUG oslo_concurrency.lockutils [None req-4dad7074-2b2b-4887-9fe7-2cc3a80ddf15 tempest-AttachVolumeShelveTestJSON-385853788 tempest-AttachVolumeShelveTestJSON-385853788-project] Lock "1daf4f4c-0e4a-4779-b53a-78c48397ea2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120740) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 18:03:55.477168 dv-cinder-852009-8-iscsi devstack@n-api.service[120740]: DEBUG oslo_concurrency.lockutils [None req-4dad7074-2b2b-4887-9fe7-2cc3a80ddf15 tempest-AttachVolumeShelveTestJSON-385853788 tempest-AttachVolumeShelveTestJSON-385853788-project] Lock "1daf4f4c-0e4a-4779-b53a-78c48397ea2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120740) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 18:03:55.477844 dv-cinder-852009-8-iscsi devstack@n-api.service[120740]: DEBUG oslo_concurrency.lockutils [None req-4dad7074-2b2b-4887-9fe7-2cc3a80ddf15 tempest-AttachVolumeShelveTestJSON-385853788 tempest-AttachVolumeShelveTestJSON-385853788-project] Acquiring lock "1daf4f4c-0e4a-4779-b53a-78c48397ea2f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120740) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 18:03:55.479037 dv-cinder-852009-8-iscsi devstack@n-api.service[120740]: DEBUG oslo_concurrency.lockutils [None req-4dad7074-2b2b-4887-9fe7-2cc3a80ddf15 tempest-AttachVolumeShelveTestJSON-385853788 tempest-AttachVolumeShelveTestJSON-385853788-project] Lock "1daf4f4c-0e4a-4779-b53a-78c48397ea2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120740) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 18:03:55.479620 dv-cinder-852009-8-iscsi devstack@n-api.service[120740]: DEBUG oslo_concurrency.lockutils [None req-4dad7074-2b2b-4887-9fe7-2cc3a80ddf15 tempest-AttachVolumeShelveTestJSON-385853788 tempest-AttachVolumeShelveTestJSON-385853788-project] Lock "1daf4f4c-0e4a-4779-b53a-78c48397ea2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120740) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 18:03:55.484174 dv-cinder-852009-8-iscsi devstack@n-api.service[120740]: DEBUG dbcounter [-] [120740] Writing DB stats nova_cell1:SELECT=97,nova_cell1:UPDATE=2,nova_cell1:INSERT=1 {{(pid=120740) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 18:03:55.674534 dv-cinder-852009-8-iscsi devstack@n-api.service[120740]: DEBUG nova.policy [None req-4dad7074-2b2b-4887-9fe7-2cc3a80ddf15 tempest-AttachVolumeShelveTestJSON-385853788 tempest-AttachVolumeShelveTestJSON-385853788-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e68ecd9b3ca643539b109f75bb242d6f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '75e14fd88bfb4cd896fa7b070a0fac47', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120740) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 18:03:55.690547 dv-cinder-852009-8-iscsi devstack@n-api.service[120740]: DEBUG nova.policy [None req-4dad7074-2b2b-4887-9fe7-2cc3a80ddf15 tempest-AttachVolumeShelveTestJSON-385853788 tempest-AttachVolumeShelveTestJSON-385853788-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'e68ecd9b3ca643539b109f75bb242d6f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '75e14fd88bfb4cd896fa7b070a0fac47', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120740) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 18:03:55.691996 dv-cinder-852009-8-iscsi devstack@n-api.service[120740]: DEBUG nova.policy [None req-4dad7074-2b2b-4887-9fe7-2cc3a80ddf15 tempest-AttachVolumeShelveTestJSON-385853788 tempest-AttachVolumeShelveTestJSON-385853788-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'e68ecd9b3ca643539b109f75bb242d6f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '75e14fd88bfb4cd896fa7b070a0fac47', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120740) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 18:03:55.693206 dv-cinder-852009-8-iscsi devstack@n-api.service[120740]: INFO nova.api.openstack.requestlog [None req-4dad7074-2b2b-4887-9fe7-2cc3a80ddf15 tempest-AttachVolumeShelveTestJSON-385853788 tempest-AttachVolumeShelveTestJSON-385853788-project] 10.222.0.43 "GET /compute/v2.1/servers/11d2616a-96f9-4a7a-aab8-219219986a8b" status: 200 len: 1722 microversion: 2.20 time: 0.232024 Sep 13 18:03:55.693765 dv-cinder-852009-8-iscsi devstack@n-api.service[120740]: [pid: 120740|app: 0|req: 131/253] 10.222.0.43 () {60 vars in 1277 bytes} [Tue Sep 13 18:03:55 2022] GET /compute/v2.1/servers/11d2616a-96f9-4a7a-aab8-219219986a8b => generated 1722 bytes in 233 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 13 18:03:56.703736 dv-cinder-852009-8-iscsi devstack@n-api.service[120741]: DEBUG nova.api.openstack.wsgi [None req-e9cb9e1f-f437-400b-905e-8d07285ed153 tempest-ServerRescueNegativeTestJSON-412251590 tempest-ServerRescueNegativeTestJSON-412251590-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServerRescueNegativeTestJSON-server-1831035205", "imageRef": "33034e36-e6b2-4847-92a1-ff3188c05a4a", "flavorRef": "452", "adminPass": "***", "networks": [{"uuid": "59c975bb-abd7-408b-a2d1-e892c96db606"}], "security_groups": [{"name": "tempest-securitygroup--306468565"}], "key_name": "tempest-keypair-1939634926", "user_data": "}} {{(pid=120741) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 13 18:03:56.726022 dv-cinder-852009-8-iscsi devstack@n-api.service[120740]: DEBUG nova.api.openstack.wsgi [None req-97064327-43a4-482f-94b5-e54e17515ace tempest-AttachVolumeShelveTestJSON-385853788 tempest-AttachVolumeShelveTestJSON-385853788-project] Calling method '>' {{(pid=120740) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 18:03:56.729896 dv-cinder-852009-8-iscsi devstack@n-api.service[120740]: DEBUG nova.compute.api [None req-97064327-43a4-482f-94b5-e54e17515ace tempest-AttachVolumeShelveTestJSON-385853788 tempest-AttachVolumeShelveTestJSON-385853788-project] [instance: 11d2616a-96f9-4a7a-aab8-219219986a8b] Fetching instance by UUID {{(pid=120740) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 18:03:56.745992 dv-cinder-852009-8-iscsi devstack@n-api.service[120740]: DEBUG oslo_concurrency.lockutils [None req-97064327-43a4-482f-94b5-e54e17515ace tempest-AttachVolumeShelveTestJSON-385853788 tempest-AttachVolumeShelveTestJSON-385853788-project] Acquiring lock "1daf4f4c-0e4a-4779-b53a-78c48397ea2f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120740) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 18:03:56.746565 dv-cinder-852009-8-iscsi devstack@n-api.service[120740]: DEBUG oslo_concurrency.lockutils [None req-97064327-43a4-482f-94b5-e54e17515ace tempest-AttachVolumeShelveTestJSON-385853788 tempest-AttachVolumeShelveTestJSON-385853788-project] Lock "1daf4f4c-0e4a-4779-b53a-78c48397ea2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120740) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 18:03:56.747180 dv-cinder-852009-8-iscsi devstack@n-api.service[120740]: DEBUG oslo_concurrency.lockutils [None req-97064327-43a4-482f-94b5-e54e17515ace tempest-AttachVolumeShelveTestJSON-385853788 tempest-AttachVolumeShelveTestJSON-385853788-project] Lock "1daf4f4c-0e4a-4779-b53a-78c48397ea2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120740) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 18:03:56.747779 dv-cinder-852009-8-iscsi devstack@n-api.service[120740]: DEBUG oslo_concurrency.lockutils [None req-97064327-43a4-482f-94b5-e54e17515ace tempest-AttachVolumeShelveTestJSON-385853788 tempest-AttachVolumeShelveTestJSON-385853788-project] Acquiring lock "1daf4f4c-0e4a-4779-b53a-78c48397ea2f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120740) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 18:03:56.748231 dv-cinder-852009-8-iscsi devstack@n-api.service[120740]: DEBUG oslo_concurrency.lockutils [None req-97064327-43a4-482f-94b5-e54e17515ace tempest-AttachVolumeShelveTestJSON-385853788 tempest-AttachVolumeShelveTestJSON-385853788-project] Lock "1daf4f4c-0e4a-4779-b53a-78c48397ea2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120740) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 18:03:56.748727 dv-cinder-852009-8-iscsi devstack@n-api.service[120740]: DEBUG oslo_concurrency.lockutils [None req-97064327-43a4-482f-94b5-e54e17515ace tempest-AttachVolumeShelveTestJSON-385853788 tempest-AttachVolumeShelveTestJSON-385853788-project] Lock "1daf4f4c-0e4a-4779-b53a-78c48397ea2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120740) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 18:03:56.887161 dv-cinder-852009-8-iscsi devstack@n-api.service[120741]: DEBUG nova.network.neutron [None req-e9cb9e1f-f437-400b-905e-8d07285ed153 tempest-ServerRescueNegativeTestJSON-412251590 tempest-ServerRescueNegativeTestJSON-412251590-project] validate_networks() for [('59c975bb-abd7-408b-a2d1-e892c96db606', None, None, None, None, None)] {{(pid=120741) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Sep 13 18:03:56.989050 dv-cinder-852009-8-iscsi devstack@n-api.service[120740]: DEBUG nova.policy [None req-97064327-43a4-482f-94b5-e54e17515ace tempest-AttachVolumeShelveTestJSON-385853788 tempest-AttachVolumeShelveTestJSON-385853788-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e68ecd9b3ca643539b109f75bb242d6f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '75e14fd88bfb4cd896fa7b070a0fac47', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120740) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 18:03:56.998058 dv-cinder-852009-8-iscsi devstack@n-api.service[120740]: DEBUG nova.policy [None req-97064327-43a4-482f-94b5-e54e17515ace tempest-AttachVolumeShelveTestJSON-385853788 tempest-AttachVolumeShelveTestJSON-385853788-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'e68ecd9b3ca643539b109f75bb242d6f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '75e14fd88bfb4cd896fa7b070a0fac47', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120740) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 18:03:56.999664 dv-cinder-852009-8-iscsi devstack@n-api.service[120740]: DEBUG nova.policy [None req-97064327-43a4-482f-94b5-e54e17515ace tempest-AttachVolumeShelveTestJSON-385853788 tempest-AttachVolumeShelveTestJSON-385853788-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'e68ecd9b3ca643539b109f75bb242d6f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '75e14fd88bfb4cd896fa7b070a0fac47', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120740) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 18:03:57.001186 dv-cinder-852009-8-iscsi devstack@n-api.service[120740]: INFO nova.api.openstack.requestlog [None req-97064327-43a4-482f-94b5-e54e17515ace tempest-AttachVolumeShelveTestJSON-385853788 tempest-AttachVolumeShelveTestJSON-385853788-project] 10.222.0.43 "GET /compute/v2.1/servers/11d2616a-96f9-4a7a-aab8-219219986a8b" status: 200 len: 1722 microversion: 2.20 time: 0.285759 Sep 13 18:03:57.002656 dv-cinder-852009-8-iscsi devstack@n-api.service[120740]: [pid: 120740|app: 0|req: 132/254] 10.222.0.43 () {60 vars in 1277 bytes} [Tue Sep 13 18:03:56 2022] GET /compute/v2.1/servers/11d2616a-96f9-4a7a-aab8-219219986a8b => generated 1722 bytes in 287 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 13 18:03:57.289618 dv-cinder-852009-8-iscsi devstack@n-api.service[120740]: DEBUG nova.api.openstack.wsgi [None req-e0e59d29-2704-4256-ae78-f01af6cd73b9 tempest-TestShelveInstance-6258502 tempest-TestShelveInstance-6258502-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-TestShelveInstance-server-1536807967", "imageRef": "", "flavorRef": "452", "key_name": "tempest-TestShelveInstance-1588373406", "security_groups": [{"name": "tempest-secgroup-smoke-1406392154"}], "networks": [{"uuid": "fb01c28a-bec9-4945-9036-09a8bf339002"}], "block_device_mapping_v2": [{"uuid": "2309fc80-ab8e-433a-8d37-6abec225bea1", "source_type": "volume", "destination_type": "volume", "boot_index": 0, "delete_on_termination": true}]}} {{(pid=120740) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 13 18:03:57.328117 dv-cinder-852009-8-iscsi devstack@n-api.service[120741]: DEBUG nova.virt.hardware [None req-e9cb9e1f-f437-400b-905e-8d07285ed153 tempest-ServerRescueNegativeTestJSON-412251590 tempest-ServerRescueNegativeTestJSON-412251590-project] Flavor limits 0:0:0 {{(pid=120741) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Sep 13 18:03:57.328561 dv-cinder-852009-8-iscsi devstack@n-api.service[120741]: DEBUG nova.virt.hardware [None req-e9cb9e1f-f437-400b-905e-8d07285ed153 tempest-ServerRescueNegativeTestJSON-412251590 tempest-ServerRescueNegativeTestJSON-412251590-project] Image limits 0:0:0 {{(pid=120741) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Sep 13 18:03:57.329025 dv-cinder-852009-8-iscsi devstack@n-api.service[120741]: DEBUG nova.virt.hardware [None req-e9cb9e1f-f437-400b-905e-8d07285ed153 tempest-ServerRescueNegativeTestJSON-412251590 tempest-ServerRescueNegativeTestJSON-412251590-project] Flavor pref 0:0:0 {{(pid=120741) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Sep 13 18:03:57.329591 dv-cinder-852009-8-iscsi devstack@n-api.service[120741]: DEBUG nova.virt.hardware [None req-e9cb9e1f-f437-400b-905e-8d07285ed153 tempest-ServerRescueNegativeTestJSON-412251590 tempest-ServerRescueNegativeTestJSON-412251590-project] Image pref 0:0:0 {{(pid=120741) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Sep 13 18:03:57.329994 dv-cinder-852009-8-iscsi devstack@n-api.service[120741]: DEBUG nova.virt.hardware [None req-e9cb9e1f-f437-400b-905e-8d07285ed153 tempest-ServerRescueNegativeTestJSON-412251590 tempest-ServerRescueNegativeTestJSON-412251590-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=120741) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Sep 13 18:03:57.339110 dv-cinder-852009-8-iscsi devstack@n-api.service[120741]: DEBUG oslo_concurrency.lockutils [None req-e9cb9e1f-f437-400b-905e-8d07285ed153 tempest-ServerRescueNegativeTestJSON-412251590 tempest-ServerRescueNegativeTestJSON-412251590-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120741) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 18:03:57.339766 dv-cinder-852009-8-iscsi devstack@n-api.service[120741]: DEBUG oslo_concurrency.lockutils [None req-e9cb9e1f-f437-400b-905e-8d07285ed153 tempest-ServerRescueNegativeTestJSON-412251590 tempest-ServerRescueNegativeTestJSON-412251590-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120741) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 18:03:57.340349 dv-cinder-852009-8-iscsi devstack@n-api.service[120741]: DEBUG oslo_concurrency.lockutils [None req-e9cb9e1f-f437-400b-905e-8d07285ed153 tempest-ServerRescueNegativeTestJSON-412251590 tempest-ServerRescueNegativeTestJSON-412251590-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120741) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 18:03:57.341250 dv-cinder-852009-8-iscsi devstack@n-api.service[120741]: DEBUG oslo_concurrency.lockutils [None req-e9cb9e1f-f437-400b-905e-8d07285ed153 tempest-ServerRescueNegativeTestJSON-412251590 tempest-ServerRescueNegativeTestJSON-412251590-project] Acquiring lock "1daf4f4c-0e4a-4779-b53a-78c48397ea2f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120741) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 18:03:57.342136 dv-cinder-852009-8-iscsi devstack@n-api.service[120741]: DEBUG oslo_concurrency.lockutils [None req-e9cb9e1f-f437-400b-905e-8d07285ed153 tempest-ServerRescueNegativeTestJSON-412251590 tempest-ServerRescueNegativeTestJSON-412251590-project] Lock "1daf4f4c-0e4a-4779-b53a-78c48397ea2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120741) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 18:03:57.342487 dv-cinder-852009-8-iscsi devstack@n-api.service[120741]: DEBUG oslo_concurrency.lockutils [None req-e9cb9e1f-f437-400b-905e-8d07285ed153 tempest-ServerRescueNegativeTestJSON-412251590 tempest-ServerRescueNegativeTestJSON-412251590-project] Lock "1daf4f4c-0e4a-4779-b53a-78c48397ea2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120741) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 18:03:57.361255 dv-cinder-852009-8-iscsi devstack@n-api.service[120741]: DEBUG nova.quota [None req-e9cb9e1f-f437-400b-905e-8d07285ed153 tempest-ServerRescueNegativeTestJSON-412251590 tempest-ServerRescueNegativeTestJSON-412251590-project] Getting quotas for project 2eae4acecf6c4961830ead78d71b2ad3. Resources: {'cores', 'ram', 'instances'} {{(pid=120741) _get_quotas /opt/stack/nova/nova/quota.py:393}} Sep 13 18:03:57.365441 dv-cinder-852009-8-iscsi devstack@n-api.service[120741]: DEBUG nova.quota [None req-e9cb9e1f-f437-400b-905e-8d07285ed153 tempest-ServerRescueNegativeTestJSON-412251590 tempest-ServerRescueNegativeTestJSON-412251590-project] Getting quotas for user 60800cf2774e409d9c1b6f4992669991 and project 2eae4acecf6c4961830ead78d71b2ad3. Resources: {'cores', 'ram', 'instances'} {{(pid=120741) _get_quotas /opt/stack/nova/nova/quota.py:383}} Sep 13 18:03:57.378776 dv-cinder-852009-8-iscsi devstack@n-api.service[120741]: DEBUG nova.compute.api [None req-e9cb9e1f-f437-400b-905e-8d07285ed153 tempest-ServerRescueNegativeTestJSON-412251590 tempest-ServerRescueNegativeTestJSON-412251590-project] Going to run 1 instances... {{(pid=120741) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Sep 13 18:03:57.381178 dv-cinder-852009-8-iscsi devstack@n-api.service[120741]: DEBUG nova.compute.api [None req-e9cb9e1f-f437-400b-905e-8d07285ed153 tempest-ServerRescueNegativeTestJSON-412251590 tempest-ServerRescueNegativeTestJSON-412251590-project] [instance: e8ce7158-6b73-4586-9f78-8e821988e71c] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='33034e36-e6b2-4847-92a1-ff3188c05a4a',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=120741) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Sep 13 18:03:57.420089 dv-cinder-852009-8-iscsi devstack@n-api.service[120740]: DEBUG nova.network.neutron [None req-e0e59d29-2704-4256-ae78-f01af6cd73b9 tempest-TestShelveInstance-6258502 tempest-TestShelveInstance-6258502-project] validate_networks() for [('fb01c28a-bec9-4945-9036-09a8bf339002', None, None, None, None, None)] {{(pid=120740) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Sep 13 18:03:57.432017 dv-cinder-852009-8-iscsi devstack@n-api.service[120741]: INFO nova.api.openstack.requestlog [None req-e9cb9e1f-f437-400b-905e-8d07285ed153 tempest-ServerRescueNegativeTestJSON-412251590 tempest-ServerRescueNegativeTestJSON-412251590-project] 10.222.0.43 "POST /compute/v2.1/servers" status: 202 len: 408 microversion: 2.1 time: 0.733596 Sep 13 18:03:57.432712 dv-cinder-852009-8-iscsi devstack@n-api.service[120741]: [pid: 120741|app: 0|req: 123/255] 10.222.0.43 () {60 vars in 1147 bytes} [Tue Sep 13 18:03:56 2022] POST /compute/v2.1/servers => generated 408 bytes in 735 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Sep 13 18:03:57.445098 dv-cinder-852009-8-iscsi devstack@n-api.service[120741]: DEBUG nova.api.openstack.wsgi [None req-5ec10c52-0b9e-4da1-b532-20398a8112ca tempest-ServerRescueNegativeTestJSON-412251590 tempest-ServerRescueNegativeTestJSON-412251590-project] Calling method '>' {{(pid=120741) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 18:03:57.445710 dv-cinder-852009-8-iscsi devstack@n-api.service[120741]: DEBUG nova.compute.api [None req-5ec10c52-0b9e-4da1-b532-20398a8112ca tempest-ServerRescueNegativeTestJSON-412251590 tempest-ServerRescueNegativeTestJSON-412251590-project] [instance: e8ce7158-6b73-4586-9f78-8e821988e71c] Fetching instance by UUID {{(pid=120741) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 18:03:57.747788 dv-cinder-852009-8-iscsi devstack@n-api.service[120741]: DEBUG nova.policy [None req-5ec10c52-0b9e-4da1-b532-20398a8112ca tempest-ServerRescueNegativeTestJSON-412251590 tempest-ServerRescueNegativeTestJSON-412251590-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '60800cf2774e409d9c1b6f4992669991', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2eae4acecf6c4961830ead78d71b2ad3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120741) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 18:03:57.755689 dv-cinder-852009-8-iscsi devstack@n-api.service[120741]: INFO nova.api.openstack.requestlog [None req-5ec10c52-0b9e-4da1-b532-20398a8112ca tempest-ServerRescueNegativeTestJSON-412251590 tempest-ServerRescueNegativeTestJSON-412251590-project] 10.222.0.43 "GET /compute/v2.1/servers/e8ce7158-6b73-4586-9f78-8e821988e71c" status: 200 len: 1246 microversion: 2.1 time: 0.315371 Sep 13 18:03:57.756264 dv-cinder-852009-8-iscsi devstack@n-api.service[120741]: [pid: 120741|app: 0|req: 124/256] 10.222.0.43 () {58 vars in 1236 bytes} [Tue Sep 13 18:03:57 2022] GET /compute/v2.1/servers/e8ce7158-6b73-4586-9f78-8e821988e71c => generated 1246 bytes in 317 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 13 18:03:58.030573 dv-cinder-852009-8-iscsi devstack@n-api.service[120741]: DEBUG nova.api.openstack.wsgi [None req-a3924fd5-cb41-4114-bd58-299b265b31d9 tempest-AttachVolumeShelveTestJSON-385853788 tempest-AttachVolumeShelveTestJSON-385853788-project] Calling method '>' {{(pid=120741) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 18:03:58.031480 dv-cinder-852009-8-iscsi devstack@n-api.service[120741]: DEBUG nova.compute.api [None req-a3924fd5-cb41-4114-bd58-299b265b31d9 tempest-AttachVolumeShelveTestJSON-385853788 tempest-AttachVolumeShelveTestJSON-385853788-project] [instance: 11d2616a-96f9-4a7a-aab8-219219986a8b] Fetching instance by UUID {{(pid=120741) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 18:03:58.038275 dv-cinder-852009-8-iscsi devstack@n-api.service[120741]: DEBUG oslo_concurrency.lockutils [None req-a3924fd5-cb41-4114-bd58-299b265b31d9 tempest-AttachVolumeShelveTestJSON-385853788 tempest-AttachVolumeShelveTestJSON-385853788-project] Acquiring lock "1daf4f4c-0e4a-4779-b53a-78c48397ea2f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120741) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 18:03:58.038780 dv-cinder-852009-8-iscsi devstack@n-api.service[120741]: DEBUG oslo_concurrency.lockutils [None req-a3924fd5-cb41-4114-bd58-299b265b31d9 tempest-AttachVolumeShelveTestJSON-385853788 tempest-AttachVolumeShelveTestJSON-385853788-project] Lock "1daf4f4c-0e4a-4779-b53a-78c48397ea2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120741) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 18:03:58.039213 dv-cinder-852009-8-iscsi devstack@n-api.service[120741]: DEBUG oslo_concurrency.lockutils [None req-a3924fd5-cb41-4114-bd58-299b265b31d9 tempest-AttachVolumeShelveTestJSON-385853788 tempest-AttachVolumeShelveTestJSON-385853788-project] Lock "1daf4f4c-0e4a-4779-b53a-78c48397ea2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120741) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 18:03:58.039906 dv-cinder-852009-8-iscsi devstack@n-api.service[120741]: DEBUG oslo_concurrency.lockutils [None req-a3924fd5-cb41-4114-bd58-299b265b31d9 tempest-AttachVolumeShelveTestJSON-385853788 tempest-AttachVolumeShelveTestJSON-385853788-project] Acquiring lock "1daf4f4c-0e4a-4779-b53a-78c48397ea2f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120741) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 18:03:58.040372 dv-cinder-852009-8-iscsi devstack@n-api.service[120741]: DEBUG oslo_concurrency.lockutils [None req-a3924fd5-cb41-4114-bd58-299b265b31d9 tempest-AttachVolumeShelveTestJSON-385853788 tempest-AttachVolumeShelveTestJSON-385853788-project] Lock "1daf4f4c-0e4a-4779-b53a-78c48397ea2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120741) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 18:03:58.040944 dv-cinder-852009-8-iscsi devstack@n-api.service[120741]: DEBUG oslo_concurrency.lockutils [None req-a3924fd5-cb41-4114-bd58-299b265b31d9 tempest-AttachVolumeShelveTestJSON-385853788 tempest-AttachVolumeShelveTestJSON-385853788-project] Lock "1daf4f4c-0e4a-4779-b53a-78c48397ea2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120741) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 18:03:58.096523 dv-cinder-852009-8-iscsi devstack@n-api.service[120740]: DEBUG nova.virt.hardware [None req-e0e59d29-2704-4256-ae78-f01af6cd73b9 tempest-TestShelveInstance-6258502 tempest-TestShelveInstance-6258502-project] Flavor limits 0:0:0 {{(pid=120740) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Sep 13 18:03:58.097086 dv-cinder-852009-8-iscsi devstack@n-api.service[120740]: DEBUG nova.virt.hardware [None req-e0e59d29-2704-4256-ae78-f01af6cd73b9 tempest-TestShelveInstance-6258502 tempest-TestShelveInstance-6258502-project] Image limits 0:0:0 {{(pid=120740) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Sep 13 18:03:58.097421 dv-cinder-852009-8-iscsi devstack@n-api.service[120740]: DEBUG nova.virt.hardware [None req-e0e59d29-2704-4256-ae78-f01af6cd73b9 tempest-TestShelveInstance-6258502 tempest-TestShelveInstance-6258502-project] Flavor pref 0:0:0 {{(pid=120740) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Sep 13 18:03:58.097998 dv-cinder-852009-8-iscsi devstack@n-api.service[120740]: DEBUG nova.virt.hardware [None req-e0e59d29-2704-4256-ae78-f01af6cd73b9 tempest-TestShelveInstance-6258502 tempest-TestShelveInstance-6258502-project] Image pref 0:0:0 {{(pid=120740) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Sep 13 18:03:58.098640 dv-cinder-852009-8-iscsi devstack@n-api.service[120740]: DEBUG nova.virt.hardware [None req-e0e59d29-2704-4256-ae78-f01af6cd73b9 tempest-TestShelveInstance-6258502 tempest-TestShelveInstance-6258502-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=120740) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Sep 13 18:03:58.109895 dv-cinder-852009-8-iscsi devstack@n-api.service[120740]: DEBUG oslo_concurrency.lockutils [None req-e0e59d29-2704-4256-ae78-f01af6cd73b9 tempest-TestShelveInstance-6258502 tempest-TestShelveInstance-6258502-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120740) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 18:03:58.110371 dv-cinder-852009-8-iscsi devstack@n-api.service[120740]: DEBUG oslo_concurrency.lockutils [None req-e0e59d29-2704-4256-ae78-f01af6cd73b9 tempest-TestShelveInstance-6258502 tempest-TestShelveInstance-6258502-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120740) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 18:03:58.110789 dv-cinder-852009-8-iscsi devstack@n-api.service[120740]: DEBUG oslo_concurrency.lockutils [None req-e0e59d29-2704-4256-ae78-f01af6cd73b9 tempest-TestShelveInstance-6258502 tempest-TestShelveInstance-6258502-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120740) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 18:03:58.111496 dv-cinder-852009-8-iscsi devstack@n-api.service[120740]: DEBUG oslo_concurrency.lockutils [None req-e0e59d29-2704-4256-ae78-f01af6cd73b9 tempest-TestShelveInstance-6258502 tempest-TestShelveInstance-6258502-project] Acquiring lock "1daf4f4c-0e4a-4779-b53a-78c48397ea2f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120740) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 18:03:58.111936 dv-cinder-852009-8-iscsi devstack@n-api.service[120740]: DEBUG oslo_concurrency.lockutils [None req-e0e59d29-2704-4256-ae78-f01af6cd73b9 tempest-TestShelveInstance-6258502 tempest-TestShelveInstance-6258502-project] Lock "1daf4f4c-0e4a-4779-b53a-78c48397ea2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120740) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 18:03:58.112346 dv-cinder-852009-8-iscsi devstack@n-api.service[120740]: DEBUG oslo_concurrency.lockutils [None req-e0e59d29-2704-4256-ae78-f01af6cd73b9 tempest-TestShelveInstance-6258502 tempest-TestShelveInstance-6258502-project] Lock "1daf4f4c-0e4a-4779-b53a-78c48397ea2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120740) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 18:03:58.129974 dv-cinder-852009-8-iscsi devstack@n-api.service[120740]: DEBUG nova.quota [None req-e0e59d29-2704-4256-ae78-f01af6cd73b9 tempest-TestShelveInstance-6258502 tempest-TestShelveInstance-6258502-project] Getting quotas for project 5eafd54351bd4049b87ad308a3638f80. Resources: {'cores', 'ram', 'instances'} {{(pid=120740) _get_quotas /opt/stack/nova/nova/quota.py:393}} Sep 13 18:03:58.134029 dv-cinder-852009-8-iscsi devstack@n-api.service[120740]: DEBUG nova.quota [None req-e0e59d29-2704-4256-ae78-f01af6cd73b9 tempest-TestShelveInstance-6258502 tempest-TestShelveInstance-6258502-project] Getting quotas for user 2ab9930d6ce54cacbb3d4fd6313294d5 and project 5eafd54351bd4049b87ad308a3638f80. Resources: {'cores', 'ram', 'instances'} {{(pid=120740) _get_quotas /opt/stack/nova/nova/quota.py:383}} Sep 13 18:03:58.183694 dv-cinder-852009-8-iscsi devstack@n-api.service[120741]: DEBUG nova.policy [None req-a3924fd5-cb41-4114-bd58-299b265b31d9 tempest-AttachVolumeShelveTestJSON-385853788 tempest-AttachVolumeShelveTestJSON-385853788-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e68ecd9b3ca643539b109f75bb242d6f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '75e14fd88bfb4cd896fa7b070a0fac47', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120741) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 18:03:58.192237 dv-cinder-852009-8-iscsi devstack@n-api.service[120741]: DEBUG nova.policy [None req-a3924fd5-cb41-4114-bd58-299b265b31d9 tempest-AttachVolumeShelveTestJSON-385853788 tempest-AttachVolumeShelveTestJSON-385853788-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'e68ecd9b3ca643539b109f75bb242d6f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '75e14fd88bfb4cd896fa7b070a0fac47', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120741) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 18:03:58.193928 dv-cinder-852009-8-iscsi devstack@n-api.service[120741]: DEBUG nova.policy [None req-a3924fd5-cb41-4114-bd58-299b265b31d9 tempest-AttachVolumeShelveTestJSON-385853788 tempest-AttachVolumeShelveTestJSON-385853788-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'e68ecd9b3ca643539b109f75bb242d6f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '75e14fd88bfb4cd896fa7b070a0fac47', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120741) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 18:03:58.195290 dv-cinder-852009-8-iscsi devstack@n-api.service[120741]: INFO nova.api.openstack.requestlog [None req-a3924fd5-cb41-4114-bd58-299b265b31d9 tempest-AttachVolumeShelveTestJSON-385853788 tempest-AttachVolumeShelveTestJSON-385853788-project] 10.222.0.43 "GET /compute/v2.1/servers/11d2616a-96f9-4a7a-aab8-219219986a8b" status: 200 len: 1722 microversion: 2.20 time: 0.168605 Sep 13 18:03:58.203023 dv-cinder-852009-8-iscsi devstack@n-api.service[120740]: DEBUG nova.compute.api [None req-e0e59d29-2704-4256-ae78-f01af6cd73b9 tempest-TestShelveInstance-6258502 tempest-TestShelveInstance-6258502-project] Going to run 1 instances... {{(pid=120740) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Sep 13 18:03:58.205426 dv-cinder-852009-8-iscsi devstack@n-api.service[120740]: DEBUG nova.compute.api [None req-e0e59d29-2704-4256-ae78-f01af6cd73b9 tempest-TestShelveInstance-6258502 tempest-TestShelveInstance-6258502-project] [instance: 2d60cc6d-a699-417d-aa20-fe3e1bfc351e] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='volume',device_name=None,device_type=None,disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id=None,instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='volume',tag=None,updated_at=,uuid=,volume_id='2309fc80-ab8e-433a-8d37-6abec225bea1',volume_size=None,volume_type=None)] {{(pid=120740) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Sep 13 18:03:58.206747 dv-cinder-852009-8-iscsi devstack@n-api.service[120741]: [pid: 120741|app: 0|req: 125/257] 10.222.0.43 () {60 vars in 1277 bytes} [Tue Sep 13 18:03:58 2022] GET /compute/v2.1/servers/11d2616a-96f9-4a7a-aab8-219219986a8b => generated 1722 bytes in 181 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 13 18:03:58.345189 dv-cinder-852009-8-iscsi devstack@n-api.service[120740]: INFO nova.api.openstack.requestlog [None req-e0e59d29-2704-4256-ae78-f01af6cd73b9 tempest-TestShelveInstance-6258502 tempest-TestShelveInstance-6258502-project] 10.222.0.43 "POST /compute/v2.1/servers" status: 202 len: 406 microversion: 2.1 time: 1.059974 Sep 13 18:03:58.352102 dv-cinder-852009-8-iscsi devstack@n-api.service[120740]: [pid: 120740|app: 0|req: 133/258] 10.222.0.43 () {60 vars in 1147 bytes} [Tue Sep 13 18:03:57 2022] POST /compute/v2.1/servers => generated 406 bytes in 1061 msecs (HTTP/1.1 202) 10 headers in 451 bytes (2 switches on core 0) Sep 13 18:03:58.357620 dv-cinder-852009-8-iscsi devstack@n-api.service[120741]: DEBUG nova.api.openstack.wsgi [None req-ec485331-33cd-4661-9c1b-7368aab19779 tempest-TestShelveInstance-6258502 tempest-TestShelveInstance-6258502-project] Calling method '>' {{(pid=120741) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 18:03:58.358411 dv-cinder-852009-8-iscsi devstack@n-api.service[120741]: DEBUG nova.compute.api [None req-ec485331-33cd-4661-9c1b-7368aab19779 tempest-TestShelveInstance-6258502 tempest-TestShelveInstance-6258502-project] [instance: 2d60cc6d-a699-417d-aa20-fe3e1bfc351e] Fetching instance by UUID {{(pid=120741) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 18:03:58.423364 dv-cinder-852009-8-iscsi devstack@n-api.service[120741]: DEBUG nova.policy [None req-ec485331-33cd-4661-9c1b-7368aab19779 tempest-TestShelveInstance-6258502 tempest-TestShelveInstance-6258502-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2ab9930d6ce54cacbb3d4fd6313294d5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5eafd54351bd4049b87ad308a3638f80', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120741) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 18:03:58.431074 dv-cinder-852009-8-iscsi devstack@n-api.service[120741]: INFO nova.api.openstack.requestlog [None req-ec485331-33cd-4661-9c1b-7368aab19779 tempest-TestShelveInstance-6258502 tempest-TestShelveInstance-6258502-project] 10.222.0.43 "GET /compute/v2.1/servers/2d60cc6d-a699-417d-aa20-fe3e1bfc351e" status: 200 len: 1089 microversion: 2.1 time: 0.077620 Sep 13 18:03:58.432010 dv-cinder-852009-8-iscsi devstack@n-api.service[120741]: [pid: 120741|app: 0|req: 126/259] 10.222.0.43 () {58 vars in 1236 bytes} [Tue Sep 13 18:03:58 2022] GET /compute/v2.1/servers/2d60cc6d-a699-417d-aa20-fe3e1bfc351e => generated 1089 bytes in 79 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 13 18:03:58.778638 dv-cinder-852009-8-iscsi devstack@n-api.service[120740]: DEBUG nova.api.openstack.wsgi [None req-17d2f585-b108-408c-b829-02f3d67d6585 tempest-ServerRescueNegativeTestJSON-412251590 tempest-ServerRescueNegativeTestJSON-412251590-project] Calling method '>' {{(pid=120740) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 18:03:58.779250 dv-cinder-852009-8-iscsi devstack@n-api.service[120740]: DEBUG nova.compute.api [None req-17d2f585-b108-408c-b829-02f3d67d6585 tempest-ServerRescueNegativeTestJSON-412251590 tempest-ServerRescueNegativeTestJSON-412251590-project] [instance: e8ce7158-6b73-4586-9f78-8e821988e71c] Fetching instance by UUID {{(pid=120740) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 18:03:58.788010 dv-cinder-852009-8-iscsi devstack@n-api.service[120740]: DEBUG oslo_concurrency.lockutils [None req-17d2f585-b108-408c-b829-02f3d67d6585 tempest-ServerRescueNegativeTestJSON-412251590 tempest-ServerRescueNegativeTestJSON-412251590-project] Acquiring lock "1daf4f4c-0e4a-4779-b53a-78c48397ea2f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120740) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 18:03:58.789218 dv-cinder-852009-8-iscsi devstack@n-api.service[120740]: DEBUG oslo_concurrency.lockutils [None req-17d2f585-b108-408c-b829-02f3d67d6585 tempest-ServerRescueNegativeTestJSON-412251590 tempest-ServerRescueNegativeTestJSON-412251590-project] Lock "1daf4f4c-0e4a-4779-b53a-78c48397ea2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120740) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 18:03:58.789965 dv-cinder-852009-8-iscsi devstack@n-api.service[120740]: DEBUG oslo_concurrency.lockutils [None req-17d2f585-b108-408c-b829-02f3d67d6585 tempest-ServerRescueNegativeTestJSON-412251590 tempest-ServerRescueNegativeTestJSON-412251590-project] Lock "1daf4f4c-0e4a-4779-b53a-78c48397ea2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120740) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 18:03:58.791132 dv-cinder-852009-8-iscsi devstack@n-api.service[120740]: DEBUG oslo_concurrency.lockutils [None req-17d2f585-b108-408c-b829-02f3d67d6585 tempest-ServerRescueNegativeTestJSON-412251590 tempest-ServerRescueNegativeTestJSON-412251590-project] Acquiring lock "1daf4f4c-0e4a-4779-b53a-78c48397ea2f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120740) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 18:03:58.792078 dv-cinder-852009-8-iscsi devstack@n-api.service[120740]: DEBUG oslo_concurrency.lockutils [None req-17d2f585-b108-408c-b829-02f3d67d6585 tempest-ServerRescueNegativeTestJSON-412251590 tempest-ServerRescueNegativeTestJSON-412251590-project] Lock "1daf4f4c-0e4a-4779-b53a-78c48397ea2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120740) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 18:03:58.792926 dv-cinder-852009-8-iscsi devstack@n-api.service[120740]: DEBUG oslo_concurrency.lockutils [None req-17d2f585-b108-408c-b829-02f3d67d6585 tempest-ServerRescueNegativeTestJSON-412251590 tempest-ServerRescueNegativeTestJSON-412251590-project] Lock "1daf4f4c-0e4a-4779-b53a-78c48397ea2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120740) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 18:03:58.882847 dv-cinder-852009-8-iscsi devstack@n-api.service[120740]: DEBUG nova.policy [None req-17d2f585-b108-408c-b829-02f3d67d6585 tempest-ServerRescueNegativeTestJSON-412251590 tempest-ServerRescueNegativeTestJSON-412251590-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '60800cf2774e409d9c1b6f4992669991', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2eae4acecf6c4961830ead78d71b2ad3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120740) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 18:03:58.891278 dv-cinder-852009-8-iscsi devstack@n-api.service[120740]: INFO nova.api.openstack.requestlog [None req-17d2f585-b108-408c-b829-02f3d67d6585 tempest-ServerRescueNegativeTestJSON-412251590 tempest-ServerRescueNegativeTestJSON-412251590-project] 10.222.0.43 "GET /compute/v2.1/servers/e8ce7158-6b73-4586-9f78-8e821988e71c" status: 200 len: 1298 microversion: 2.1 time: 0.116466 Sep 13 18:03:58.892042 dv-cinder-852009-8-iscsi devstack@n-api.service[120740]: [pid: 120740|app: 0|req: 134/260] 10.222.0.43 () {58 vars in 1236 bytes} [Tue Sep 13 18:03:58 2022] GET /compute/v2.1/servers/e8ce7158-6b73-4586-9f78-8e821988e71c => generated 1298 bytes in 118 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 13 18:03:59.221956 dv-cinder-852009-8-iscsi devstack@n-api.service[120741]: DEBUG nova.api.openstack.wsgi [None req-5b5d12bc-1b7e-4107-8f30-b8bce5ceb897 tempest-AttachVolumeShelveTestJSON-385853788 tempest-AttachVolumeShelveTestJSON-385853788-project] Calling method '>' {{(pid=120741) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 18:03:59.222676 dv-cinder-852009-8-iscsi devstack@n-api.service[120741]: DEBUG nova.compute.api [None req-5b5d12bc-1b7e-4107-8f30-b8bce5ceb897 tempest-AttachVolumeShelveTestJSON-385853788 tempest-AttachVolumeShelveTestJSON-385853788-project] [instance: 11d2616a-96f9-4a7a-aab8-219219986a8b] Fetching instance by UUID {{(pid=120741) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 18:03:59.229454 dv-cinder-852009-8-iscsi devstack@n-api.service[120741]: DEBUG oslo_concurrency.lockutils [None req-5b5d12bc-1b7e-4107-8f30-b8bce5ceb897 tempest-AttachVolumeShelveTestJSON-385853788 tempest-AttachVolumeShelveTestJSON-385853788-project] Acquiring lock "1daf4f4c-0e4a-4779-b53a-78c48397ea2f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120741) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 18:03:59.230018 dv-cinder-852009-8-iscsi devstack@n-api.service[120741]: DEBUG oslo_concurrency.lockutils [None req-5b5d12bc-1b7e-4107-8f30-b8bce5ceb897 tempest-AttachVolumeShelveTestJSON-385853788 tempest-AttachVolumeShelveTestJSON-385853788-project] Lock "1daf4f4c-0e4a-4779-b53a-78c48397ea2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120741) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 18:03:59.230519 dv-cinder-852009-8-iscsi devstack@n-api.service[120741]: DEBUG oslo_concurrency.lockutils [None req-5b5d12bc-1b7e-4107-8f30-b8bce5ceb897 tempest-AttachVolumeShelveTestJSON-385853788 tempest-AttachVolumeShelveTestJSON-385853788-project] Lock "1daf4f4c-0e4a-4779-b53a-78c48397ea2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120741) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 18:03:59.231285 dv-cinder-852009-8-iscsi devstack@n-api.service[120741]: DEBUG oslo_concurrency.lockutils [None req-5b5d12bc-1b7e-4107-8f30-b8bce5ceb897 tempest-AttachVolumeShelveTestJSON-385853788 tempest-AttachVolumeShelveTestJSON-385853788-project] Acquiring lock "1daf4f4c-0e4a-4779-b53a-78c48397ea2f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120741) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 18:03:59.231801 dv-cinder-852009-8-iscsi devstack@n-api.service[120741]: DEBUG oslo_concurrency.lockutils [None req-5b5d12bc-1b7e-4107-8f30-b8bce5ceb897 tempest-AttachVolumeShelveTestJSON-385853788 tempest-AttachVolumeShelveTestJSON-385853788-project] Lock "1daf4f4c-0e4a-4779-b53a-78c48397ea2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120741) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 18:03:59.232288 dv-cinder-852009-8-iscsi devstack@n-api.service[120741]: DEBUG oslo_concurrency.lockutils [None req-5b5d12bc-1b7e-4107-8f30-b8bce5ceb897 tempest-AttachVolumeShelveTestJSON-385853788 tempest-AttachVolumeShelveTestJSON-385853788-project] Lock "1daf4f4c-0e4a-4779-b53a-78c48397ea2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120741) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 18:03:59.375861 dv-cinder-852009-8-iscsi devstack@n-api.service[120741]: DEBUG nova.policy [None req-5b5d12bc-1b7e-4107-8f30-b8bce5ceb897 tempest-AttachVolumeShelveTestJSON-385853788 tempest-AttachVolumeShelveTestJSON-385853788-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e68ecd9b3ca643539b109f75bb242d6f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '75e14fd88bfb4cd896fa7b070a0fac47', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120741) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 18:03:59.385563 dv-cinder-852009-8-iscsi devstack@n-api.service[120741]: DEBUG nova.policy [None req-5b5d12bc-1b7e-4107-8f30-b8bce5ceb897 tempest-AttachVolumeShelveTestJSON-385853788 tempest-AttachVolumeShelveTestJSON-385853788-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'e68ecd9b3ca643539b109f75bb242d6f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '75e14fd88bfb4cd896fa7b070a0fac47', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120741) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 18:03:59.387007 dv-cinder-852009-8-iscsi devstack@n-api.service[120741]: DEBUG nova.policy [None req-5b5d12bc-1b7e-4107-8f30-b8bce5ceb897 tempest-AttachVolumeShelveTestJSON-385853788 tempest-AttachVolumeShelveTestJSON-385853788-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'e68ecd9b3ca643539b109f75bb242d6f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '75e14fd88bfb4cd896fa7b070a0fac47', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120741) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 18:03:59.388193 dv-cinder-852009-8-iscsi devstack@n-api.service[120741]: INFO nova.api.openstack.requestlog [None req-5b5d12bc-1b7e-4107-8f30-b8bce5ceb897 tempest-AttachVolumeShelveTestJSON-385853788 tempest-AttachVolumeShelveTestJSON-385853788-project] 10.222.0.43 "GET /compute/v2.1/servers/11d2616a-96f9-4a7a-aab8-219219986a8b" status: 200 len: 1743 microversion: 2.20 time: 0.170254 Sep 13 18:03:59.388768 dv-cinder-852009-8-iscsi devstack@n-api.service[120741]: [pid: 120741|app: 0|req: 127/261] 10.222.0.43 () {60 vars in 1277 bytes} [Tue Sep 13 18:03:59 2022] GET /compute/v2.1/servers/11d2616a-96f9-4a7a-aab8-219219986a8b => generated 1743 bytes in 172 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 13 18:03:59.454761 dv-cinder-852009-8-iscsi devstack@n-api.service[120740]: DEBUG nova.api.openstack.wsgi [None req-4e48ea54-3ab4-42a3-bac2-4b4007c8d06b tempest-TestShelveInstance-6258502 tempest-TestShelveInstance-6258502-project] Calling method '>' {{(pid=120740) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 18:03:59.455960 dv-cinder-852009-8-iscsi devstack@n-api.service[120740]: DEBUG nova.compute.api [None req-4e48ea54-3ab4-42a3-bac2-4b4007c8d06b tempest-TestShelveInstance-6258502 tempest-TestShelveInstance-6258502-project] [instance: 2d60cc6d-a699-417d-aa20-fe3e1bfc351e] Fetching instance by UUID {{(pid=120740) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 18:03:59.462526 dv-cinder-852009-8-iscsi devstack@n-api.service[120740]: DEBUG oslo_concurrency.lockutils [None req-4e48ea54-3ab4-42a3-bac2-4b4007c8d06b tempest-TestShelveInstance-6258502 tempest-TestShelveInstance-6258502-project] Acquiring lock "1daf4f4c-0e4a-4779-b53a-78c48397ea2f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120740) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 18:03:59.463139 dv-cinder-852009-8-iscsi devstack@n-api.service[120740]: DEBUG oslo_concurrency.lockutils [None req-4e48ea54-3ab4-42a3-bac2-4b4007c8d06b tempest-TestShelveInstance-6258502 tempest-TestShelveInstance-6258502-project] Lock "1daf4f4c-0e4a-4779-b53a-78c48397ea2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120740) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 18:03:59.463558 dv-cinder-852009-8-iscsi devstack@n-api.service[120740]: DEBUG oslo_concurrency.lockutils [None req-4e48ea54-3ab4-42a3-bac2-4b4007c8d06b tempest-TestShelveInstance-6258502 tempest-TestShelveInstance-6258502-project] Lock "1daf4f4c-0e4a-4779-b53a-78c48397ea2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120740) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 18:03:59.464612 dv-cinder-852009-8-iscsi devstack@n-api.service[120740]: DEBUG oslo_concurrency.lockutils [None req-4e48ea54-3ab4-42a3-bac2-4b4007c8d06b tempest-TestShelveInstance-6258502 tempest-TestShelveInstance-6258502-project] Acquiring lock "1daf4f4c-0e4a-4779-b53a-78c48397ea2f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120740) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 18:03:59.464919 dv-cinder-852009-8-iscsi devstack@n-api.service[120740]: DEBUG oslo_concurrency.lockutils [None req-4e48ea54-3ab4-42a3-bac2-4b4007c8d06b tempest-TestShelveInstance-6258502 tempest-TestShelveInstance-6258502-project] Lock "1daf4f4c-0e4a-4779-b53a-78c48397ea2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120740) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 18:03:59.465334 dv-cinder-852009-8-iscsi devstack@n-api.service[120740]: DEBUG oslo_concurrency.lockutils [None req-4e48ea54-3ab4-42a3-bac2-4b4007c8d06b tempest-TestShelveInstance-6258502 tempest-TestShelveInstance-6258502-project] Lock "1daf4f4c-0e4a-4779-b53a-78c48397ea2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120740) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 18:03:59.531251 dv-cinder-852009-8-iscsi devstack@n-api.service[120740]: DEBUG nova.policy [None req-4e48ea54-3ab4-42a3-bac2-4b4007c8d06b tempest-TestShelveInstance-6258502 tempest-TestShelveInstance-6258502-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2ab9930d6ce54cacbb3d4fd6313294d5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5eafd54351bd4049b87ad308a3638f80', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120740) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 18:03:59.539543 dv-cinder-852009-8-iscsi devstack@n-api.service[120740]: INFO nova.api.openstack.requestlog [None req-4e48ea54-3ab4-42a3-bac2-4b4007c8d06b tempest-TestShelveInstance-6258502 tempest-TestShelveInstance-6258502-project] 10.222.0.43 "GET /compute/v2.1/servers/2d60cc6d-a699-417d-aa20-fe3e1bfc351e" status: 200 len: 1187 microversion: 2.1 time: 0.088804 Sep 13 18:03:59.540154 dv-cinder-852009-8-iscsi devstack@n-api.service[120740]: [pid: 120740|app: 0|req: 135/262] 10.222.0.43 () {58 vars in 1236 bytes} [Tue Sep 13 18:03:59 2022] GET /compute/v2.1/servers/2d60cc6d-a699-417d-aa20-fe3e1bfc351e => generated 1187 bytes in 90 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 13 18:03:59.916415 dv-cinder-852009-8-iscsi devstack@n-api.service[120741]: DEBUG nova.api.openstack.wsgi [None req-24f8ae37-20c3-455a-842b-a5773f902ada tempest-ServerRescueNegativeTestJSON-412251590 tempest-ServerRescueNegativeTestJSON-412251590-project] Calling method '>' {{(pid=120741) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 18:03:59.917222 dv-cinder-852009-8-iscsi devstack@n-api.service[120741]: DEBUG nova.compute.api [None req-24f8ae37-20c3-455a-842b-a5773f902ada tempest-ServerRescueNegativeTestJSON-412251590 tempest-ServerRescueNegativeTestJSON-412251590-project] [instance: e8ce7158-6b73-4586-9f78-8e821988e71c] Fetching instance by UUID {{(pid=120741) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 18:03:59.926432 dv-cinder-852009-8-iscsi devstack@n-api.service[120741]: DEBUG oslo_concurrency.lockutils [None req-24f8ae37-20c3-455a-842b-a5773f902ada tempest-ServerRescueNegativeTestJSON-412251590 tempest-ServerRescueNegativeTestJSON-412251590-project] Acquiring lock "1daf4f4c-0e4a-4779-b53a-78c48397ea2f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120741) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 18:03:59.927054 dv-cinder-852009-8-iscsi devstack@n-api.service[120741]: DEBUG oslo_concurrency.lockutils [None req-24f8ae37-20c3-455a-842b-a5773f902ada tempest-ServerRescueNegativeTestJSON-412251590 tempest-ServerRescueNegativeTestJSON-412251590-project] Lock "1daf4f4c-0e4a-4779-b53a-78c48397ea2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120741) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 18:03:59.927590 dv-cinder-852009-8-iscsi devstack@n-api.service[120741]: DEBUG oslo_concurrency.lockutils [None req-24f8ae37-20c3-455a-842b-a5773f902ada tempest-ServerRescueNegativeTestJSON-412251590 tempest-ServerRescueNegativeTestJSON-412251590-project] Lock "1daf4f4c-0e4a-4779-b53a-78c48397ea2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120741) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 18:03:59.928390 dv-cinder-852009-8-iscsi devstack@n-api.service[120741]: DEBUG oslo_concurrency.lockutils [None req-24f8ae37-20c3-455a-842b-a5773f902ada tempest-ServerRescueNegativeTestJSON-412251590 tempest-ServerRescueNegativeTestJSON-412251590-project] Acquiring lock "1daf4f4c-0e4a-4779-b53a-78c48397ea2f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120741) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 18:03:59.928973 dv-cinder-852009-8-iscsi devstack@n-api.service[120741]: DEBUG oslo_concurrency.lockutils [None req-24f8ae37-20c3-455a-842b-a5773f902ada tempest-ServerRescueNegativeTestJSON-412251590 tempest-ServerRescueNegativeTestJSON-412251590-project] Lock "1daf4f4c-0e4a-4779-b53a-78c48397ea2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120741) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 18:03:59.929496 dv-cinder-852009-8-iscsi devstack@n-api.service[120741]: DEBUG oslo_concurrency.lockutils [None req-24f8ae37-20c3-455a-842b-a5773f902ada tempest-ServerRescueNegativeTestJSON-412251590 tempest-ServerRescueNegativeTestJSON-412251590-project] Lock "1daf4f4c-0e4a-4779-b53a-78c48397ea2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120741) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 18:04:00.160518 dv-cinder-852009-8-iscsi devstack@n-api.service[120741]: DEBUG nova.policy [None req-24f8ae37-20c3-455a-842b-a5773f902ada tempest-ServerRescueNegativeTestJSON-412251590 tempest-ServerRescueNegativeTestJSON-412251590-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '60800cf2774e409d9c1b6f4992669991', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2eae4acecf6c4961830ead78d71b2ad3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120741) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 18:04:00.170234 dv-cinder-852009-8-iscsi devstack@n-api.service[120741]: INFO nova.api.openstack.requestlog [None req-24f8ae37-20c3-455a-842b-a5773f902ada tempest-ServerRescueNegativeTestJSON-412251590 tempest-ServerRescueNegativeTestJSON-412251590-project] 10.222.0.43 "GET /compute/v2.1/servers/e8ce7158-6b73-4586-9f78-8e821988e71c" status: 200 len: 1371 microversion: 2.1 time: 0.258383 Sep 13 18:04:00.170899 dv-cinder-852009-8-iscsi devstack@n-api.service[120741]: [pid: 120741|app: 0|req: 128/263] 10.222.0.43 () {58 vars in 1236 bytes} [Tue Sep 13 18:03:59 2022] GET /compute/v2.1/servers/e8ce7158-6b73-4586-9f78-8e821988e71c => generated 1371 bytes in 260 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 13 18:04:00.415604 dv-cinder-852009-8-iscsi devstack@n-api.service[120740]: DEBUG nova.api.openstack.wsgi [None req-56a711f5-0473-4ec5-8bc5-1fbf92309164 tempest-AttachVolumeShelveTestJSON-385853788 tempest-AttachVolumeShelveTestJSON-385853788-project] Calling method '>' {{(pid=120740) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 18:04:00.416360 dv-cinder-852009-8-iscsi devstack@n-api.service[120740]: DEBUG nova.compute.api [None req-56a711f5-0473-4ec5-8bc5-1fbf92309164 tempest-AttachVolumeShelveTestJSON-385853788 tempest-AttachVolumeShelveTestJSON-385853788-project] [instance: 11d2616a-96f9-4a7a-aab8-219219986a8b] Fetching instance by UUID {{(pid=120740) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 18:04:00.424212 dv-cinder-852009-8-iscsi devstack@n-api.service[120740]: DEBUG oslo_concurrency.lockutils [None req-56a711f5-0473-4ec5-8bc5-1fbf92309164 tempest-AttachVolumeShelveTestJSON-385853788 tempest-AttachVolumeShelveTestJSON-385853788-project] Acquiring lock "1daf4f4c-0e4a-4779-b53a-78c48397ea2f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120740) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 18:04:00.428375 dv-cinder-852009-8-iscsi devstack@n-api.service[120740]: DEBUG oslo_concurrency.lockutils [None req-56a711f5-0473-4ec5-8bc5-1fbf92309164 tempest-AttachVolumeShelveTestJSON-385853788 tempest-AttachVolumeShelveTestJSON-385853788-project] Lock "1daf4f4c-0e4a-4779-b53a-78c48397ea2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120740) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 18:04:00.428951 dv-cinder-852009-8-iscsi devstack@n-api.service[120740]: DEBUG oslo_concurrency.lockutils [None req-56a711f5-0473-4ec5-8bc5-1fbf92309164 tempest-AttachVolumeShelveTestJSON-385853788 tempest-AttachVolumeShelveTestJSON-385853788-project] Lock "1daf4f4c-0e4a-4779-b53a-78c48397ea2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=120740) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 18:04:00.430886 dv-cinder-852009-8-iscsi devstack@n-api.service[120740]: DEBUG oslo_concurrency.lockutils [None req-56a711f5-0473-4ec5-8bc5-1fbf92309164 tempest-AttachVolumeShelveTestJSON-385853788 tempest-AttachVolumeShelveTestJSON-385853788-project] Acquiring lock "1daf4f4c-0e4a-4779-b53a-78c48397ea2f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120740) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 18:04:00.431430 dv-cinder-852009-8-iscsi devstack@n-api.service[120740]: DEBUG oslo_concurrency.lockutils [None req-56a711f5-0473-4ec5-8bc5-1fbf92309164 tempest-AttachVolumeShelveTestJSON-385853788 tempest-AttachVolumeShelveTestJSON-385853788-project] Lock "1daf4f4c-0e4a-4779-b53a-78c48397ea2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120740) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 18:04:00.431871 dv-cinder-852009-8-iscsi devstack@n-api.service[120740]: DEBUG oslo_concurrency.lockutils [None req-56a711f5-0473-4ec5-8bc5-1fbf92309164 tempest-AttachVolumeShelveTestJSON-385853788 tempest-AttachVolumeShelveTestJSON-385853788-project] Lock "1daf4f4c-0e4a-4779-b53a-78c48397ea2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120740) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 18:04:00.563564 dv-cinder-852009-8-iscsi devstack@n-api.service[120741]: DEBUG nova.api.openstack.wsgi [None req-c46b9bb2-3128-40f3-a56b-7e3df4ff1e76 tempest-TestShelveInstance-6258502 tempest-TestShelveInstance-6258502-project] Calling method '>' {{(pid=120741) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 18:04:00.564150 dv-cinder-852009-8-iscsi devstack@n-api.service[120741]: DEBUG nova.compute.api [None req-c46b9bb2-3128-40f3-a56b-7e3df4ff1e76 tempest-TestShelveInstance-6258502 tempest-TestShelveInstance-6258502-project] [instance: 2d60cc6d-a699-417d-aa20-fe3e1bfc351e] Fetching instance by UUID {{(pid=120741) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 18:04:00.584131 dv-cinder-852009-8-iscsi devstack@n-api.service[120741]: DEBUG oslo_concurrency.lockutils [None req-c46b9bb2-3128-40f3-a56b-7e3df4ff1e76 tempest-TestShelveInstance-6258502 tempest-TestShelveInstance-6258502-project] Acquiring lock "1daf4f4c-0e4a-4779-b53a-78c48397ea2f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120741) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 18:04:00.585021 dv-cinder-852009-8-iscsi devstack@n-api.service[120741]: DEBUG oslo_concurrency.lockutils [None req-c46b9bb2-3128-40f3-a56b-7e3df4ff1e76 tempest-TestShelveInstance-6258502 tempest-TestShelveInstance-6258502-project] Lock "1daf4f4c-0e4a-4779-b53a-78c48397ea2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120741) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 18:04:00.585627 dv-cinder-852009-8-iscsi devstack@n-api.service[120741]: DEBUG oslo_concurrency.lockutils [None req-c46b9bb2-3128-40f3-a56b-7e3df4ff1e76 tempest-TestShelveInstance-6258502 tempest-TestShelveInstance-6258502-project] Lock "1daf4f4c-0e4a-4779-b53a-78c48397ea2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120741) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 18:04:00.587251 dv-cinder-852009-8-iscsi devstack@n-api.service[120741]: DEBUG oslo_concurrency.lockutils [None req-c46b9bb2-3128-40f3-a56b-7e3df4ff1e76 tempest-TestShelveInstance-6258502 tempest-TestShelveInstance-6258502-project] Acquiring lock "1daf4f4c-0e4a-4779-b53a-78c48397ea2f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120741) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 18:04:00.587942 dv-cinder-852009-8-iscsi devstack@n-api.service[120741]: DEBUG oslo_concurrency.lockutils [None req-c46b9bb2-3128-40f3-a56b-7e3df4ff1e76 tempest-TestShelveInstance-6258502 tempest-TestShelveInstance-6258502-project] Lock "1daf4f4c-0e4a-4779-b53a-78c48397ea2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120741) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 18:04:00.588766 dv-cinder-852009-8-iscsi devstack@n-api.service[120741]: DEBUG oslo_concurrency.lockutils [None req-c46b9bb2-3128-40f3-a56b-7e3df4ff1e76 tempest-TestShelveInstance-6258502 tempest-TestShelveInstance-6258502-project] Lock "1daf4f4c-0e4a-4779-b53a-78c48397ea2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120741) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 18:04:00.686757 dv-cinder-852009-8-iscsi devstack@n-api.service[120741]: DEBUG nova.policy [None req-c46b9bb2-3128-40f3-a56b-7e3df4ff1e76 tempest-TestShelveInstance-6258502 tempest-TestShelveInstance-6258502-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2ab9930d6ce54cacbb3d4fd6313294d5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5eafd54351bd4049b87ad308a3638f80', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120741) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 18:04:00.702508 dv-cinder-852009-8-iscsi devstack@n-api.service[120741]: INFO nova.api.openstack.requestlog [None req-c46b9bb2-3128-40f3-a56b-7e3df4ff1e76 tempest-TestShelveInstance-6258502 tempest-TestShelveInstance-6258502-project] 10.222.0.43 "GET /compute/v2.1/servers/2d60cc6d-a699-417d-aa20-fe3e1bfc351e" status: 200 len: 1205 microversion: 2.1 time: 0.142768 Sep 13 18:04:00.704093 dv-cinder-852009-8-iscsi devstack@n-api.service[120741]: [pid: 120741|app: 0|req: 129/264] 10.222.0.43 () {58 vars in 1236 bytes} [Tue Sep 13 18:04:00 2022] GET /compute/v2.1/servers/2d60cc6d-a699-417d-aa20-fe3e1bfc351e => generated 1205 bytes in 145 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 13 18:04:00.722646 dv-cinder-852009-8-iscsi devstack@n-api.service[120740]: DEBUG nova.policy [None req-56a711f5-0473-4ec5-8bc5-1fbf92309164 tempest-AttachVolumeShelveTestJSON-385853788 tempest-AttachVolumeShelveTestJSON-385853788-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e68ecd9b3ca643539b109f75bb242d6f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '75e14fd88bfb4cd896fa7b070a0fac47', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120740) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 18:04:00.723432 dv-cinder-852009-8-iscsi devstack@n-api.service[120741]: DEBUG nova.api.openstack.wsgi [req-84b8b466-5302-4bae-af0b-e7144e091026 req-2771a0fe-9484-4855-a441-696427239255 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "e8ce7158-6b73-4586-9f78-8e821988e71c", "tag": "ea32c59b-537c-405f-b361-3a6b70e328d4"}]} {{(pid=120741) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 13 18:04:00.740696 dv-cinder-852009-8-iscsi devstack@n-api.service[120740]: DEBUG nova.policy [None req-56a711f5-0473-4ec5-8bc5-1fbf92309164 tempest-AttachVolumeShelveTestJSON-385853788 tempest-AttachVolumeShelveTestJSON-385853788-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'e68ecd9b3ca643539b109f75bb242d6f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '75e14fd88bfb4cd896fa7b070a0fac47', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120740) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 18:04:00.743123 dv-cinder-852009-8-iscsi devstack@n-api.service[120740]: DEBUG nova.policy [None req-56a711f5-0473-4ec5-8bc5-1fbf92309164 tempest-AttachVolumeShelveTestJSON-385853788 tempest-AttachVolumeShelveTestJSON-385853788-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'e68ecd9b3ca643539b109f75bb242d6f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '75e14fd88bfb4cd896fa7b070a0fac47', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120740) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 18:04:00.753154 dv-cinder-852009-8-iscsi devstack@n-api.service[120740]: INFO nova.api.openstack.requestlog [None req-56a711f5-0473-4ec5-8bc5-1fbf92309164 tempest-AttachVolumeShelveTestJSON-385853788 tempest-AttachVolumeShelveTestJSON-385853788-project] 10.222.0.43 "GET /compute/v2.1/servers/11d2616a-96f9-4a7a-aab8-219219986a8b" status: 200 len: 1743 microversion: 2.20 time: 0.334577 Sep 13 18:04:00.754350 dv-cinder-852009-8-iscsi devstack@n-api.service[120740]: [pid: 120740|app: 0|req: 136/265] 10.222.0.43 () {60 vars in 1277 bytes} [Tue Sep 13 18:04:00 2022] GET /compute/v2.1/servers/11d2616a-96f9-4a7a-aab8-219219986a8b => generated 1743 bytes in 345 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 13 18:04:00.778258 dv-cinder-852009-8-iscsi devstack@n-api.service[120741]: DEBUG oslo_concurrency.lockutils [req-84b8b466-5302-4bae-af0b-e7144e091026 req-2771a0fe-9484-4855-a441-696427239255 service nova] Acquiring lock "1daf4f4c-0e4a-4779-b53a-78c48397ea2f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120741) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 18:04:00.778891 dv-cinder-852009-8-iscsi devstack@n-api.service[120741]: DEBUG oslo_concurrency.lockutils [req-84b8b466-5302-4bae-af0b-e7144e091026 req-2771a0fe-9484-4855-a441-696427239255 service nova] Lock "1daf4f4c-0e4a-4779-b53a-78c48397ea2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120741) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 18:04:00.779351 dv-cinder-852009-8-iscsi devstack@n-api.service[120741]: DEBUG oslo_concurrency.lockutils [req-84b8b466-5302-4bae-af0b-e7144e091026 req-2771a0fe-9484-4855-a441-696427239255 service nova] Lock "1daf4f4c-0e4a-4779-b53a-78c48397ea2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120741) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 18:04:00.811408 dv-cinder-852009-8-iscsi devstack@n-api.service[120741]: INFO nova.api.openstack.compute.server_external_events [req-84b8b466-5302-4bae-af0b-e7144e091026 req-2771a0fe-9484-4855-a441-696427239255 service nova] Creating event network-changed:ea32c59b-537c-405f-b361-3a6b70e328d4 for instance e8ce7158-6b73-4586-9f78-8e821988e71c on hv-cinder-85200 Sep 13 18:04:00.823100 dv-cinder-852009-8-iscsi devstack@n-api.service[120741]: INFO nova.api.openstack.requestlog [req-84b8b466-5302-4bae-af0b-e7144e091026 req-2771a0fe-9484-4855-a441-696427239255 service nova] 10.222.0.43 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.104870 Sep 13 18:04:00.823726 dv-cinder-852009-8-iscsi devstack@n-api.service[120741]: [pid: 120741|app: 0|req: 130/266] 10.222.0.43 () {64 vars in 1317 bytes} [Tue Sep 13 18:04:00 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 106 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 13 18:04:01.193902 dv-cinder-852009-8-iscsi devstack@n-api.service[120740]: DEBUG nova.api.openstack.wsgi [None req-013a9fa7-42aa-4644-bb3f-617340ca3104 tempest-ServerRescueNegativeTestJSON-412251590 tempest-ServerRescueNegativeTestJSON-412251590-project] Calling method '>' {{(pid=120740) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 18:04:01.194577 dv-cinder-852009-8-iscsi devstack@n-api.service[120740]: DEBUG nova.compute.api [None req-013a9fa7-42aa-4644-bb3f-617340ca3104 tempest-ServerRescueNegativeTestJSON-412251590 tempest-ServerRescueNegativeTestJSON-412251590-project] [instance: e8ce7158-6b73-4586-9f78-8e821988e71c] Fetching instance by UUID {{(pid=120740) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 18:04:01.208536 dv-cinder-852009-8-iscsi devstack@n-api.service[120740]: DEBUG oslo_concurrency.lockutils [None req-013a9fa7-42aa-4644-bb3f-617340ca3104 tempest-ServerRescueNegativeTestJSON-412251590 tempest-ServerRescueNegativeTestJSON-412251590-project] Acquiring lock "1daf4f4c-0e4a-4779-b53a-78c48397ea2f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120740) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 18:04:01.208536 dv-cinder-852009-8-iscsi devstack@n-api.service[120740]: DEBUG oslo_concurrency.lockutils [None req-013a9fa7-42aa-4644-bb3f-617340ca3104 tempest-ServerRescueNegativeTestJSON-412251590 tempest-ServerRescueNegativeTestJSON-412251590-project] Lock "1daf4f4c-0e4a-4779-b53a-78c48397ea2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120740) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 18:04:01.208536 dv-cinder-852009-8-iscsi devstack@n-api.service[120740]: DEBUG oslo_concurrency.lockutils [None req-013a9fa7-42aa-4644-bb3f-617340ca3104 tempest-ServerRescueNegativeTestJSON-412251590 tempest-ServerRescueNegativeTestJSON-412251590-project] Lock "1daf4f4c-0e4a-4779-b53a-78c48397ea2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120740) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 18:04:01.208928 dv-cinder-852009-8-iscsi devstack@n-api.service[120740]: DEBUG oslo_concurrency.lockutils [None req-013a9fa7-42aa-4644-bb3f-617340ca3104 tempest-ServerRescueNegativeTestJSON-412251590 tempest-ServerRescueNegativeTestJSON-412251590-project] Acquiring lock "1daf4f4c-0e4a-4779-b53a-78c48397ea2f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120740) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 18:04:01.209376 dv-cinder-852009-8-iscsi devstack@n-api.service[120740]: DEBUG oslo_concurrency.lockutils [None req-013a9fa7-42aa-4644-bb3f-617340ca3104 tempest-ServerRescueNegativeTestJSON-412251590 tempest-ServerRescueNegativeTestJSON-412251590-project] Lock "1daf4f4c-0e4a-4779-b53a-78c48397ea2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120740) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 18:04:01.212886 dv-cinder-852009-8-iscsi devstack@n-api.service[120740]: DEBUG oslo_concurrency.lockutils [None req-013a9fa7-42aa-4644-bb3f-617340ca3104 tempest-ServerRescueNegativeTestJSON-412251590 tempest-ServerRescueNegativeTestJSON-412251590-project] Lock "1daf4f4c-0e4a-4779-b53a-78c48397ea2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=120740) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 18:04:01.491438 dv-cinder-852009-8-iscsi devstack@n-api.service[120740]: DEBUG nova.policy [None req-013a9fa7-42aa-4644-bb3f-617340ca3104 tempest-ServerRescueNegativeTestJSON-412251590 tempest-ServerRescueNegativeTestJSON-412251590-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '60800cf2774e409d9c1b6f4992669991', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2eae4acecf6c4961830ead78d71b2ad3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120740) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 18:04:01.506899 dv-cinder-852009-8-iscsi devstack@n-api.service[120740]: INFO nova.api.openstack.requestlog [None req-013a9fa7-42aa-4644-bb3f-617340ca3104 tempest-ServerRescueNegativeTestJSON-412251590 tempest-ServerRescueNegativeTestJSON-412251590-project] 10.222.0.43 "GET /compute/v2.1/servers/e8ce7158-6b73-4586-9f78-8e821988e71c" status: 200 len: 1371 microversion: 2.1 time: 0.312923 Sep 13 18:04:01.508855 dv-cinder-852009-8-iscsi devstack@n-api.service[120740]: [pid: 120740|app: 0|req: 137/267] 10.222.0.43 () {58 vars in 1236 bytes} [Tue Sep 13 18:04:01 2022] GET /compute/v2.1/servers/e8ce7158-6b73-4586-9f78-8e821988e71c => generated 1371 bytes in 320 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 13 18:04:01.732362 dv-cinder-852009-8-iscsi devstack@n-api.service[120741]: DEBUG nova.api.openstack.wsgi [None req-899d05c0-ef85-4956-9bd4-dfb31943770d tempest-TestShelveInstance-6258502 tempest-TestShelveInstance-6258502-project] Calling method '>' {{(pid=120741) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 18:04:01.733101 dv-cinder-852009-8-iscsi devstack@n-api.service[120741]: DEBUG nova.compute.api [None req-899d05c0-ef85-4956-9bd4-dfb31943770d tempest-TestShelveInstance-6258502 tempest-TestShelveInstance-6258502-project] [instance: 2d60cc6d-a699-417d-aa20-fe3e1bfc351e] Fetching instance by UUID {{(pid=120741) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 18:04:01.757970 dv-cinder-852009-8-iscsi devstack@n-api.service[120741]: DEBUG oslo_concurrency.lockutils [None req-899d05c0-ef85-4956-9bd4-dfb31943770d tempest-TestShelveInstance-6258502 tempest-TestShelveInstance-6258502-project] Acquiring lock "1daf4f4c-0e4a-4779-b53a-78c48397ea2f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120741) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 18:04:01.761610 dv-cinder-852009-8-iscsi devstack@n-api.service[120741]: DEBUG oslo_concurrency.lockutils [None req-899d05c0-ef85-4956-9bd4-dfb31943770d tempest-TestShelveInstance-6258502 tempest-TestShelveInstance-6258502-project] Lock "1daf4f4c-0e4a-4779-b53a-78c48397ea2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120741) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 18:04:01.763236 dv-cinder-852009-8-iscsi devstack@n-api.service[120741]: DEBUG oslo_concurrency.lockutils [None req-899d05c0-ef85-4956-9bd4-dfb31943770d tempest-TestShelveInstance-6258502 tempest-TestShelveInstance-6258502-project] Lock "1daf4f4c-0e4a-4779-b53a-78c48397ea2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=120741) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 18:04:01.764490 dv-cinder-852009-8-iscsi devstack@n-api.service[120741]: DEBUG oslo_concurrency.lockutils [None req-899d05c0-ef85-4956-9bd4-dfb31943770d tempest-TestShelveInstance-6258502 tempest-TestShelveInstance-6258502-project] Acquiring lock "1daf4f4c-0e4a-4779-b53a-78c48397ea2f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120741) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 18:04:01.765539 dv-cinder-852009-8-iscsi devstack@n-api.service[120741]: DEBUG oslo_concurrency.lockutils [None req-899d05c0-ef85-4956-9bd4-dfb31943770d tempest-TestShelveInstance-6258502 tempest-TestShelveInstance-6258502-project] Lock "1daf4f4c-0e4a-4779-b53a-78c48397ea2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120741) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 18:04:01.767031 dv-cinder-852009-8-iscsi devstack@n-api.service[120741]: DEBUG oslo_concurrency.lockutils [None req-899d05c0-ef85-4956-9bd4-dfb31943770d tempest-TestShelveInstance-6258502 tempest-TestShelveInstance-6258502-project] Lock "1daf4f4c-0e4a-4779-b53a-78c48397ea2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120741) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 18:04:01.780291 dv-cinder-852009-8-iscsi devstack@n-api.service[120740]: DEBUG nova.api.openstack.wsgi [None req-cb55fe98-43a0-4bc6-8a8c-eed809d6c52e tempest-AttachVolumeShelveTestJSON-385853788 tempest-AttachVolumeShelveTestJSON-385853788-project] Calling method '>' {{(pid=120740) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 18:04:01.782055 dv-cinder-852009-8-iscsi devstack@n-api.service[120740]: DEBUG nova.compute.api [None req-cb55fe98-43a0-4bc6-8a8c-eed809d6c52e tempest-AttachVolumeShelveTestJSON-385853788 tempest-AttachVolumeShelveTestJSON-385853788-project] [instance: 11d2616a-96f9-4a7a-aab8-219219986a8b] Fetching instance by UUID {{(pid=120740) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 18:04:01.798140 dv-cinder-852009-8-iscsi devstack@n-api.service[120740]: DEBUG oslo_concurrency.lockutils [None req-cb55fe98-43a0-4bc6-8a8c-eed809d6c52e tempest-AttachVolumeShelveTestJSON-385853788 tempest-AttachVolumeShelveTestJSON-385853788-project] Acquiring lock "1daf4f4c-0e4a-4779-b53a-78c48397ea2f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120740) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 18:04:01.798888 dv-cinder-852009-8-iscsi devstack@n-api.service[120740]: DEBUG oslo_concurrency.lockutils [None req-cb55fe98-43a0-4bc6-8a8c-eed809d6c52e tempest-AttachVolumeShelveTestJSON-385853788 tempest-AttachVolumeShelveTestJSON-385853788-project] Lock "1daf4f4c-0e4a-4779-b53a-78c48397ea2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120740) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 18:04:01.799549 dv-cinder-852009-8-iscsi devstack@n-api.service[120740]: DEBUG oslo_concurrency.lockutils [None req-cb55fe98-43a0-4bc6-8a8c-eed809d6c52e tempest-AttachVolumeShelveTestJSON-385853788 tempest-AttachVolumeShelveTestJSON-385853788-project] Lock "1daf4f4c-0e4a-4779-b53a-78c48397ea2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120740) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 18:04:01.802912 dv-cinder-852009-8-iscsi devstack@n-api.service[120740]: DEBUG oslo_concurrency.lockutils [None req-cb55fe98-43a0-4bc6-8a8c-eed809d6c52e tempest-AttachVolumeShelveTestJSON-385853788 tempest-AttachVolumeShelveTestJSON-385853788-project] Acquiring lock "1daf4f4c-0e4a-4779-b53a-78c48397ea2f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120740) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 18:04:01.804710 dv-cinder-852009-8-iscsi devstack@n-api.service[120740]: DEBUG oslo_concurrency.lockutils [None req-cb55fe98-43a0-4bc6-8a8c-eed809d6c52e tempest-AttachVolumeShelveTestJSON-385853788 tempest-AttachVolumeShelveTestJSON-385853788-project] Lock "1daf4f4c-0e4a-4779-b53a-78c48397ea2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120740) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 18:04:01.805766 dv-cinder-852009-8-iscsi devstack@n-api.service[120740]: DEBUG oslo_concurrency.lockutils [None req-cb55fe98-43a0-4bc6-8a8c-eed809d6c52e tempest-AttachVolumeShelveTestJSON-385853788 tempest-AttachVolumeShelveTestJSON-385853788-project] Lock "1daf4f4c-0e4a-4779-b53a-78c48397ea2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120740) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 18:04:02.174068 dv-cinder-852009-8-iscsi devstack@n-api.service[120741]: DEBUG nova.policy [None req-899d05c0-ef85-4956-9bd4-dfb31943770d tempest-TestShelveInstance-6258502 tempest-TestShelveInstance-6258502-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2ab9930d6ce54cacbb3d4fd6313294d5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5eafd54351bd4049b87ad308a3638f80', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120741) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 18:04:02.186446 dv-cinder-852009-8-iscsi devstack@n-api.service[120741]: INFO nova.api.openstack.requestlog [None req-899d05c0-ef85-4956-9bd4-dfb31943770d tempest-TestShelveInstance-6258502 tempest-TestShelveInstance-6258502-project] 10.222.0.43 "GET /compute/v2.1/servers/2d60cc6d-a699-417d-aa20-fe3e1bfc351e" status: 200 len: 1273 microversion: 2.1 time: 0.461143 Sep 13 18:04:02.196876 dv-cinder-852009-8-iscsi devstack@n-api.service[120741]: [pid: 120741|app: 0|req: 131/268] 10.222.0.43 () {58 vars in 1236 bytes} [Tue Sep 13 18:04:01 2022] GET /compute/v2.1/servers/2d60cc6d-a699-417d-aa20-fe3e1bfc351e => generated 1273 bytes in 472 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 13 18:04:02.213254 dv-cinder-852009-8-iscsi devstack@n-api.service[120741]: DEBUG nova.api.openstack.wsgi [None req-672e3e53-51e7-4574-8e19-4e116d590ba9 tempest-AttachVolumeTestJSON-555093534 tempest-AttachVolumeTestJSON-555093534-project] Action: 'action', calling method: >, body: {"os-stop": {}} {{(pid=120741) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 13 18:04:02.222416 dv-cinder-852009-8-iscsi devstack@n-api.service[120741]: DEBUG oslo_concurrency.lockutils [None req-672e3e53-51e7-4574-8e19-4e116d590ba9 tempest-AttachVolumeTestJSON-555093534 tempest-AttachVolumeTestJSON-555093534-project] Acquiring lock "1daf4f4c-0e4a-4779-b53a-78c48397ea2f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120741) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 18:04:02.223398 dv-cinder-852009-8-iscsi devstack@n-api.service[120741]: DEBUG oslo_concurrency.lockutils [None req-672e3e53-51e7-4574-8e19-4e116d590ba9 tempest-AttachVolumeTestJSON-555093534 tempest-AttachVolumeTestJSON-555093534-project] Lock "1daf4f4c-0e4a-4779-b53a-78c48397ea2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120741) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 18:04:02.224314 dv-cinder-852009-8-iscsi devstack@n-api.service[120741]: DEBUG oslo_concurrency.lockutils [None req-672e3e53-51e7-4574-8e19-4e116d590ba9 tempest-AttachVolumeTestJSON-555093534 tempest-AttachVolumeTestJSON-555093534-project] Lock "1daf4f4c-0e4a-4779-b53a-78c48397ea2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120741) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 18:04:02.252469 dv-cinder-852009-8-iscsi devstack@n-api.service[120740]: DEBUG nova.policy [None req-cb55fe98-43a0-4bc6-8a8c-eed809d6c52e tempest-AttachVolumeShelveTestJSON-385853788 tempest-AttachVolumeShelveTestJSON-385853788-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e68ecd9b3ca643539b109f75bb242d6f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '75e14fd88bfb4cd896fa7b070a0fac47', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120740) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 18:04:02.261221 dv-cinder-852009-8-iscsi devstack@n-api.service[120740]: DEBUG nova.policy [None req-cb55fe98-43a0-4bc6-8a8c-eed809d6c52e tempest-AttachVolumeShelveTestJSON-385853788 tempest-AttachVolumeShelveTestJSON-385853788-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'e68ecd9b3ca643539b109f75bb242d6f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '75e14fd88bfb4cd896fa7b070a0fac47', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120740) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 18:04:02.262926 dv-cinder-852009-8-iscsi devstack@n-api.service[120740]: DEBUG nova.policy [None req-cb55fe98-43a0-4bc6-8a8c-eed809d6c52e tempest-AttachVolumeShelveTestJSON-385853788 tempest-AttachVolumeShelveTestJSON-385853788-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'e68ecd9b3ca643539b109f75bb242d6f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '75e14fd88bfb4cd896fa7b070a0fac47', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120740) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 18:04:02.264289 dv-cinder-852009-8-iscsi devstack@n-api.service[120740]: INFO nova.api.openstack.requestlog [None req-cb55fe98-43a0-4bc6-8a8c-eed809d6c52e tempest-AttachVolumeShelveTestJSON-385853788 tempest-AttachVolumeShelveTestJSON-385853788-project] 10.222.0.43 "GET /compute/v2.1/servers/11d2616a-96f9-4a7a-aab8-219219986a8b" status: 200 len: 1738 microversion: 2.20 time: 0.488916 Sep 13 18:04:02.277712 dv-cinder-852009-8-iscsi devstack@n-api.service[120740]: [pid: 120740|app: 0|req: 138/269] 10.222.0.43 () {60 vars in 1277 bytes} [Tue Sep 13 18:04:01 2022] GET /compute/v2.1/servers/11d2616a-96f9-4a7a-aab8-219219986a8b => generated 1738 bytes in 503 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 13 18:04:02.351427 dv-cinder-852009-8-iscsi devstack@n-api.service[120741]: DEBUG nova.compute.api [None req-672e3e53-51e7-4574-8e19-4e116d590ba9 tempest-AttachVolumeTestJSON-555093534 tempest-AttachVolumeTestJSON-555093534-project] [instance: b958d409-df20-44c6-aa0e-58cb0a482edf] Going to try to stop instance {{(pid=120741) force_stop /opt/stack/nova/nova/compute/api.py:2762}} Sep 13 18:04:02.366081 dv-cinder-852009-8-iscsi devstack@n-api.service[120740]: DEBUG nova.api.openstack.wsgi [req-d2091534-f16f-47ac-974e-41f923a03406 req-c82b3ddd-d4ec-421a-bcdc-f9d6e08ef3ee service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "2d60cc6d-a699-417d-aa20-fe3e1bfc351e", "tag": "fa199ada-f924-4f1a-9116-5daf985f618d"}]} {{(pid=120740) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 13 18:04:02.388090 dv-cinder-852009-8-iscsi devstack@n-api.service[120740]: DEBUG oslo_concurrency.lockutils [req-d2091534-f16f-47ac-974e-41f923a03406 req-c82b3ddd-d4ec-421a-bcdc-f9d6e08ef3ee service nova] Acquiring lock "1daf4f4c-0e4a-4779-b53a-78c48397ea2f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120740) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 18:04:02.391377 dv-cinder-852009-8-iscsi devstack@n-api.service[120740]: DEBUG oslo_concurrency.lockutils [req-d2091534-f16f-47ac-974e-41f923a03406 req-c82b3ddd-d4ec-421a-bcdc-f9d6e08ef3ee service nova] Lock "1daf4f4c-0e4a-4779-b53a-78c48397ea2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120740) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 18:04:02.392001 dv-cinder-852009-8-iscsi devstack@n-api.service[120740]: DEBUG oslo_concurrency.lockutils [req-d2091534-f16f-47ac-974e-41f923a03406 req-c82b3ddd-d4ec-421a-bcdc-f9d6e08ef3ee service nova] Lock "1daf4f4c-0e4a-4779-b53a-78c48397ea2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120740) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 18:04:02.424545 dv-cinder-852009-8-iscsi devstack@n-api.service[120740]: INFO nova.api.openstack.compute.server_external_events [req-d2091534-f16f-47ac-974e-41f923a03406 req-c82b3ddd-d4ec-421a-bcdc-f9d6e08ef3ee service nova] Creating event network-changed:fa199ada-f924-4f1a-9116-5daf985f618d for instance 2d60cc6d-a699-417d-aa20-fe3e1bfc351e on hv-cinder-85200 Sep 13 18:04:02.437052 dv-cinder-852009-8-iscsi devstack@n-api.service[120740]: INFO nova.api.openstack.requestlog [req-d2091534-f16f-47ac-974e-41f923a03406 req-c82b3ddd-d4ec-421a-bcdc-f9d6e08ef3ee service nova] 10.222.0.43 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.072863 Sep 13 18:04:02.438001 dv-cinder-852009-8-iscsi devstack@n-api.service[120740]: [pid: 120740|app: 0|req: 139/270] 10.222.0.43 () {64 vars in 1317 bytes} [Tue Sep 13 18:04:02 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 77 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 13 18:04:02.456020 dv-cinder-852009-8-iscsi devstack@n-api.service[120741]: INFO nova.api.openstack.requestlog [None req-672e3e53-51e7-4574-8e19-4e116d590ba9 tempest-AttachVolumeTestJSON-555093534 tempest-AttachVolumeTestJSON-555093534-project] 10.222.0.43 "POST /compute/v2.1/servers/b958d409-df20-44c6-aa0e-58cb0a482edf/action" status: 202 len: 0 microversion: 2.1 time: 0.252021 Sep 13 18:04:02.456961 dv-cinder-852009-8-iscsi devstack@n-api.service[120741]: [pid: 120741|app: 0|req: 132/271] 10.222.0.43 () {60 vars in 1278 bytes} [Tue Sep 13 18:04:02 2022] POST /compute/v2.1/servers/b958d409-df20-44c6-aa0e-58cb0a482edf/action => generated 0 bytes in 256 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Sep 13 18:04:02.466753 dv-cinder-852009-8-iscsi devstack@n-api.service[120740]: DEBUG nova.api.openstack.wsgi [None req-6f0a1341-ef69-4f3d-8756-1d9aeb29b621 tempest-AttachVolumeTestJSON-555093534 tempest-AttachVolumeTestJSON-555093534-project] Calling method '>' {{(pid=120740) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 18:04:02.467429 dv-cinder-852009-8-iscsi devstack@n-api.service[120740]: DEBUG nova.compute.api [None req-6f0a1341-ef69-4f3d-8756-1d9aeb29b621 tempest-AttachVolumeTestJSON-555093534 tempest-AttachVolumeTestJSON-555093534-project] [instance: b958d409-df20-44c6-aa0e-58cb0a482edf] Fetching instance by UUID {{(pid=120740) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 18:04:02.475876 dv-cinder-852009-8-iscsi devstack@n-api.service[120740]: DEBUG oslo_concurrency.lockutils [None req-6f0a1341-ef69-4f3d-8756-1d9aeb29b621 tempest-AttachVolumeTestJSON-555093534 tempest-AttachVolumeTestJSON-555093534-project] Acquiring lock "1daf4f4c-0e4a-4779-b53a-78c48397ea2f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120740) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 18:04:02.477877 dv-cinder-852009-8-iscsi devstack@n-api.service[120740]: DEBUG oslo_concurrency.lockutils [None req-6f0a1341-ef69-4f3d-8756-1d9aeb29b621 tempest-AttachVolumeTestJSON-555093534 tempest-AttachVolumeTestJSON-555093534-project] Lock "1daf4f4c-0e4a-4779-b53a-78c48397ea2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120740) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 18:04:02.478622 dv-cinder-852009-8-iscsi devstack@n-api.service[120740]: DEBUG oslo_concurrency.lockutils [None req-6f0a1341-ef69-4f3d-8756-1d9aeb29b621 tempest-AttachVolumeTestJSON-555093534 tempest-AttachVolumeTestJSON-555093534-project] Lock "1daf4f4c-0e4a-4779-b53a-78c48397ea2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120740) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 18:04:02.479541 dv-cinder-852009-8-iscsi devstack@n-api.service[120740]: DEBUG oslo_concurrency.lockutils [None req-6f0a1341-ef69-4f3d-8756-1d9aeb29b621 tempest-AttachVolumeTestJSON-555093534 tempest-AttachVolumeTestJSON-555093534-project] Acquiring lock "1daf4f4c-0e4a-4779-b53a-78c48397ea2f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120740) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 18:04:02.481095 dv-cinder-852009-8-iscsi devstack@n-api.service[120740]: DEBUG oslo_concurrency.lockutils [None req-6f0a1341-ef69-4f3d-8756-1d9aeb29b621 tempest-AttachVolumeTestJSON-555093534 tempest-AttachVolumeTestJSON-555093534-project] Lock "1daf4f4c-0e4a-4779-b53a-78c48397ea2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120740) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 18:04:02.481690 dv-cinder-852009-8-iscsi devstack@n-api.service[120740]: DEBUG oslo_concurrency.lockutils [None req-6f0a1341-ef69-4f3d-8756-1d9aeb29b621 tempest-AttachVolumeTestJSON-555093534 tempest-AttachVolumeTestJSON-555093534-project] Lock "1daf4f4c-0e4a-4779-b53a-78c48397ea2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120740) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 18:04:02.531512 dv-cinder-852009-8-iscsi devstack@n-api.service[120741]: DEBUG nova.api.openstack.wsgi [None req-dc030b63-af86-43cd-812b-ea2180eed7e9 tempest-ServerRescueNegativeTestJSON-412251590 tempest-ServerRescueNegativeTestJSON-412251590-project] Calling method '>' {{(pid=120741) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 18:04:02.532720 dv-cinder-852009-8-iscsi devstack@n-api.service[120741]: DEBUG nova.compute.api [None req-dc030b63-af86-43cd-812b-ea2180eed7e9 tempest-ServerRescueNegativeTestJSON-412251590 tempest-ServerRescueNegativeTestJSON-412251590-project] [instance: e8ce7158-6b73-4586-9f78-8e821988e71c] Fetching instance by UUID {{(pid=120741) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 18:04:02.540354 dv-cinder-852009-8-iscsi devstack@n-api.service[120741]: DEBUG oslo_concurrency.lockutils [None req-dc030b63-af86-43cd-812b-ea2180eed7e9 tempest-ServerRescueNegativeTestJSON-412251590 tempest-ServerRescueNegativeTestJSON-412251590-project] Acquiring lock "1daf4f4c-0e4a-4779-b53a-78c48397ea2f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120741) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 18:04:02.541306 dv-cinder-852009-8-iscsi devstack@n-api.service[120741]: DEBUG oslo_concurrency.lockutils [None req-dc030b63-af86-43cd-812b-ea2180eed7e9 tempest-ServerRescueNegativeTestJSON-412251590 tempest-ServerRescueNegativeTestJSON-412251590-project] Lock "1daf4f4c-0e4a-4779-b53a-78c48397ea2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120741) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 18:04:02.542062 dv-cinder-852009-8-iscsi devstack@n-api.service[120741]: DEBUG oslo_concurrency.lockutils [None req-dc030b63-af86-43cd-812b-ea2180eed7e9 tempest-ServerRescueNegativeTestJSON-412251590 tempest-ServerRescueNegativeTestJSON-412251590-project] Lock "1daf4f4c-0e4a-4779-b53a-78c48397ea2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120741) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 18:04:02.543062 dv-cinder-852009-8-iscsi devstack@n-api.service[120741]: DEBUG oslo_concurrency.lockutils [None req-dc030b63-af86-43cd-812b-ea2180eed7e9 tempest-ServerRescueNegativeTestJSON-412251590 tempest-ServerRescueNegativeTestJSON-412251590-project] Acquiring lock "1daf4f4c-0e4a-4779-b53a-78c48397ea2f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120741) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 18:04:02.543681 dv-cinder-852009-8-iscsi devstack@n-api.service[120741]: DEBUG oslo_concurrency.lockutils [None req-dc030b63-af86-43cd-812b-ea2180eed7e9 tempest-ServerRescueNegativeTestJSON-412251590 tempest-ServerRescueNegativeTestJSON-412251590-project] Lock "1daf4f4c-0e4a-4779-b53a-78c48397ea2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120741) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 18:04:02.544598 dv-cinder-852009-8-iscsi devstack@n-api.service[120741]: DEBUG oslo_concurrency.lockutils [None req-dc030b63-af86-43cd-812b-ea2180eed7e9 tempest-ServerRescueNegativeTestJSON-412251590 tempest-ServerRescueNegativeTestJSON-412251590-project] Lock "1daf4f4c-0e4a-4779-b53a-78c48397ea2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120741) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 18:04:02.751463 dv-cinder-852009-8-iscsi devstack@n-api.service[120740]: DEBUG nova.policy [None req-6f0a1341-ef69-4f3d-8756-1d9aeb29b621 tempest-AttachVolumeTestJSON-555093534 tempest-AttachVolumeTestJSON-555093534-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0625b3113ce044bbac4f6142eaade11c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a279fcbf274c4704a31a2b95061e1469', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120740) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 18:04:02.760628 dv-cinder-852009-8-iscsi devstack@n-api.service[120740]: INFO nova.api.openstack.requestlog [None req-6f0a1341-ef69-4f3d-8756-1d9aeb29b621 tempest-AttachVolumeTestJSON-555093534 tempest-AttachVolumeTestJSON-555093534-project] 10.222.0.43 "GET /compute/v2.1/servers/b958d409-df20-44c6-aa0e-58cb0a482edf" status: 200 len: 1724 microversion: 2.1 time: 0.299080 Sep 13 18:04:02.761602 dv-cinder-852009-8-iscsi devstack@n-api.service[120740]: [pid: 120740|app: 0|req: 140/272] 10.222.0.43 () {58 vars in 1236 bytes} [Tue Sep 13 18:04:02 2022] GET /compute/v2.1/servers/b958d409-df20-44c6-aa0e-58cb0a482edf => generated 1724 bytes in 301 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 13 18:04:02.769233 dv-cinder-852009-8-iscsi devstack@n-api.service[120740]: DEBUG nova.api.openstack.wsgi [req-7c39ae51-7772-4505-9e52-0ce1025863d6 req-36076f84-e557-42eb-acc2-938b11f5d0ee service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "11d2616a-96f9-4a7a-aab8-219219986a8b", "name": "network-vif-plugged", "status": "completed", "tag": "85bfb53c-ec3d-49bc-ade7-acdfac253331"}]} {{(pid=120740) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 13 18:04:02.781041 dv-cinder-852009-8-iscsi devstack@n-api.service[120740]: DEBUG oslo_concurrency.lockutils [req-7c39ae51-7772-4505-9e52-0ce1025863d6 req-36076f84-e557-42eb-acc2-938b11f5d0ee service nova] Acquiring lock "1daf4f4c-0e4a-4779-b53a-78c48397ea2f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120740) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 18:04:02.782307 dv-cinder-852009-8-iscsi devstack@n-api.service[120740]: DEBUG oslo_concurrency.lockutils [req-7c39ae51-7772-4505-9e52-0ce1025863d6 req-36076f84-e557-42eb-acc2-938b11f5d0ee service nova] Lock "1daf4f4c-0e4a-4779-b53a-78c48397ea2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120740) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 18:04:02.782918 dv-cinder-852009-8-iscsi devstack@n-api.service[120740]: DEBUG oslo_concurrency.lockutils [req-7c39ae51-7772-4505-9e52-0ce1025863d6 req-36076f84-e557-42eb-acc2-938b11f5d0ee service nova] Lock "1daf4f4c-0e4a-4779-b53a-78c48397ea2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120740) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 18:04:02.797173 dv-cinder-852009-8-iscsi devstack@n-api.service[120740]: INFO nova.api.openstack.compute.server_external_events [req-7c39ae51-7772-4505-9e52-0ce1025863d6 req-36076f84-e557-42eb-acc2-938b11f5d0ee service nova] Creating event network-vif-plugged:85bfb53c-ec3d-49bc-ade7-acdfac253331 for instance 11d2616a-96f9-4a7a-aab8-219219986a8b on hv-cinder-85200 Sep 13 18:04:02.802835 dv-cinder-852009-8-iscsi devstack@n-api.service[120740]: INFO nova.api.openstack.requestlog [req-7c39ae51-7772-4505-9e52-0ce1025863d6 req-36076f84-e557-42eb-acc2-938b11f5d0ee service nova] 10.222.0.43 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.040022 Sep 13 18:04:02.803934 dv-cinder-852009-8-iscsi devstack@n-api.service[120740]: [pid: 120740|app: 0|req: 141/273] 10.222.0.43 () {64 vars in 1317 bytes} [Tue Sep 13 18:04:02 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 42 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 13 18:04:02.811136 dv-cinder-852009-8-iscsi devstack@n-api.service[120741]: DEBUG nova.policy [None req-dc030b63-af86-43cd-812b-ea2180eed7e9 tempest-ServerRescueNegativeTestJSON-412251590 tempest-ServerRescueNegativeTestJSON-412251590-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '60800cf2774e409d9c1b6f4992669991', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2eae4acecf6c4961830ead78d71b2ad3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120741) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 18:04:02.821642 dv-cinder-852009-8-iscsi devstack@n-api.service[120741]: INFO nova.api.openstack.requestlog [None req-dc030b63-af86-43cd-812b-ea2180eed7e9 tempest-ServerRescueNegativeTestJSON-412251590 tempest-ServerRescueNegativeTestJSON-412251590-project] 10.222.0.43 "GET /compute/v2.1/servers/e8ce7158-6b73-4586-9f78-8e821988e71c" status: 200 len: 1371 microversion: 2.1 time: 0.294478 Sep 13 18:04:02.822437 dv-cinder-852009-8-iscsi devstack@n-api.service[120741]: [pid: 120741|app: 0|req: 133/274] 10.222.0.43 () {58 vars in 1236 bytes} [Tue Sep 13 18:04:02 2022] GET /compute/v2.1/servers/e8ce7158-6b73-4586-9f78-8e821988e71c => generated 1371 bytes in 296 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 13 18:04:03.216708 dv-cinder-852009-8-iscsi devstack@n-api.service[120740]: DEBUG nova.api.openstack.wsgi [None req-d73f98ee-e5c9-4cd7-9590-13d82bbaa578 tempest-TestShelveInstance-6258502 tempest-TestShelveInstance-6258502-project] Calling method '>' {{(pid=120740) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 18:04:03.217771 dv-cinder-852009-8-iscsi devstack@n-api.service[120740]: DEBUG nova.compute.api [None req-d73f98ee-e5c9-4cd7-9590-13d82bbaa578 tempest-TestShelveInstance-6258502 tempest-TestShelveInstance-6258502-project] [instance: 2d60cc6d-a699-417d-aa20-fe3e1bfc351e] Fetching instance by UUID {{(pid=120740) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 18:04:03.228468 dv-cinder-852009-8-iscsi devstack@n-api.service[120740]: DEBUG oslo_concurrency.lockutils [None req-d73f98ee-e5c9-4cd7-9590-13d82bbaa578 tempest-TestShelveInstance-6258502 tempest-TestShelveInstance-6258502-project] Acquiring lock "1daf4f4c-0e4a-4779-b53a-78c48397ea2f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120740) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 18:04:03.232105 dv-cinder-852009-8-iscsi devstack@n-api.service[120740]: DEBUG oslo_concurrency.lockutils [None req-d73f98ee-e5c9-4cd7-9590-13d82bbaa578 tempest-TestShelveInstance-6258502 tempest-TestShelveInstance-6258502-project] Lock "1daf4f4c-0e4a-4779-b53a-78c48397ea2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=120740) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 18:04:03.233315 dv-cinder-852009-8-iscsi devstack@n-api.service[120740]: DEBUG oslo_concurrency.lockutils [None req-d73f98ee-e5c9-4cd7-9590-13d82bbaa578 tempest-TestShelveInstance-6258502 tempest-TestShelveInstance-6258502-project] Lock "1daf4f4c-0e4a-4779-b53a-78c48397ea2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120740) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 18:04:03.234459 dv-cinder-852009-8-iscsi devstack@n-api.service[120740]: DEBUG oslo_concurrency.lockutils [None req-d73f98ee-e5c9-4cd7-9590-13d82bbaa578 tempest-TestShelveInstance-6258502 tempest-TestShelveInstance-6258502-project] Acquiring lock "1daf4f4c-0e4a-4779-b53a-78c48397ea2f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120740) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 18:04:03.235519 dv-cinder-852009-8-iscsi devstack@n-api.service[120740]: DEBUG oslo_concurrency.lockutils [None req-d73f98ee-e5c9-4cd7-9590-13d82bbaa578 tempest-TestShelveInstance-6258502 tempest-TestShelveInstance-6258502-project] Lock "1daf4f4c-0e4a-4779-b53a-78c48397ea2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120740) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 18:04:03.236526 dv-cinder-852009-8-iscsi devstack@n-api.service[120740]: DEBUG oslo_concurrency.lockutils [None req-d73f98ee-e5c9-4cd7-9590-13d82bbaa578 tempest-TestShelveInstance-6258502 tempest-TestShelveInstance-6258502-project] Lock "1daf4f4c-0e4a-4779-b53a-78c48397ea2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120740) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 18:04:03.296014 dv-cinder-852009-8-iscsi devstack@n-api.service[120741]: DEBUG nova.api.openstack.wsgi [None req-aea36170-9302-480f-b520-84655d5dc1da tempest-AttachVolumeShelveTestJSON-385853788 tempest-AttachVolumeShelveTestJSON-385853788-project] Calling method '>' {{(pid=120741) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 18:04:03.296694 dv-cinder-852009-8-iscsi devstack@n-api.service[120741]: DEBUG nova.compute.api [None req-aea36170-9302-480f-b520-84655d5dc1da tempest-AttachVolumeShelveTestJSON-385853788 tempest-AttachVolumeShelveTestJSON-385853788-project] [instance: 11d2616a-96f9-4a7a-aab8-219219986a8b] Fetching instance by UUID {{(pid=120741) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 18:04:03.307907 dv-cinder-852009-8-iscsi devstack@n-api.service[120741]: DEBUG oslo_concurrency.lockutils [None req-aea36170-9302-480f-b520-84655d5dc1da tempest-AttachVolumeShelveTestJSON-385853788 tempest-AttachVolumeShelveTestJSON-385853788-project] Acquiring lock "1daf4f4c-0e4a-4779-b53a-78c48397ea2f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120741) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 18:04:03.308802 dv-cinder-852009-8-iscsi devstack@n-api.service[120741]: DEBUG oslo_concurrency.lockutils [None req-aea36170-9302-480f-b520-84655d5dc1da tempest-AttachVolumeShelveTestJSON-385853788 tempest-AttachVolumeShelveTestJSON-385853788-project] Lock "1daf4f4c-0e4a-4779-b53a-78c48397ea2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120741) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 18:04:03.309974 dv-cinder-852009-8-iscsi devstack@n-api.service[120741]: DEBUG oslo_concurrency.lockutils [None req-aea36170-9302-480f-b520-84655d5dc1da tempest-AttachVolumeShelveTestJSON-385853788 tempest-AttachVolumeShelveTestJSON-385853788-project] Lock "1daf4f4c-0e4a-4779-b53a-78c48397ea2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120741) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 18:04:03.310835 dv-cinder-852009-8-iscsi devstack@n-api.service[120741]: DEBUG oslo_concurrency.lockutils [None req-aea36170-9302-480f-b520-84655d5dc1da tempest-AttachVolumeShelveTestJSON-385853788 tempest-AttachVolumeShelveTestJSON-385853788-project] Acquiring lock "1daf4f4c-0e4a-4779-b53a-78c48397ea2f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120741) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 18:04:03.312091 dv-cinder-852009-8-iscsi devstack@n-api.service[120741]: DEBUG oslo_concurrency.lockutils [None req-aea36170-9302-480f-b520-84655d5dc1da tempest-AttachVolumeShelveTestJSON-385853788 tempest-AttachVolumeShelveTestJSON-385853788-project] Lock "1daf4f4c-0e4a-4779-b53a-78c48397ea2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120741) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 18:04:03.313190 dv-cinder-852009-8-iscsi devstack@n-api.service[120741]: DEBUG oslo_concurrency.lockutils [None req-aea36170-9302-480f-b520-84655d5dc1da tempest-AttachVolumeShelveTestJSON-385853788 tempest-AttachVolumeShelveTestJSON-385853788-project] Lock "1daf4f4c-0e4a-4779-b53a-78c48397ea2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120741) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 18:04:03.624460 dv-cinder-852009-8-iscsi devstack@n-api.service[120740]: DEBUG nova.policy [None req-d73f98ee-e5c9-4cd7-9590-13d82bbaa578 tempest-TestShelveInstance-6258502 tempest-TestShelveInstance-6258502-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2ab9930d6ce54cacbb3d4fd6313294d5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5eafd54351bd4049b87ad308a3638f80', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120740) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 18:04:03.635493 dv-cinder-852009-8-iscsi devstack@n-api.service[120740]: INFO nova.api.openstack.requestlog [None req-d73f98ee-e5c9-4cd7-9590-13d82bbaa578 tempest-TestShelveInstance-6258502 tempest-TestShelveInstance-6258502-project] 10.222.0.43 "GET /compute/v2.1/servers/2d60cc6d-a699-417d-aa20-fe3e1bfc351e" status: 200 len: 1261 microversion: 2.1 time: 0.423865 Sep 13 18:04:03.639260 dv-cinder-852009-8-iscsi devstack@n-api.service[120740]: [pid: 120740|app: 0|req: 142/275] 10.222.0.43 () {58 vars in 1236 bytes} [Tue Sep 13 18:04:03 2022] GET /compute/v2.1/servers/2d60cc6d-a699-417d-aa20-fe3e1bfc351e => generated 1261 bytes in 428 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 13 18:04:03.737038 dv-cinder-852009-8-iscsi devstack@n-api.service[120741]: DEBUG nova.policy [None req-aea36170-9302-480f-b520-84655d5dc1da tempest-AttachVolumeShelveTestJSON-385853788 tempest-AttachVolumeShelveTestJSON-385853788-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e68ecd9b3ca643539b109f75bb242d6f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '75e14fd88bfb4cd896fa7b070a0fac47', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120741) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 18:04:03.746690 dv-cinder-852009-8-iscsi devstack@n-api.service[120741]: DEBUG nova.policy [None req-aea36170-9302-480f-b520-84655d5dc1da tempest-AttachVolumeShelveTestJSON-385853788 tempest-AttachVolumeShelveTestJSON-385853788-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'e68ecd9b3ca643539b109f75bb242d6f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '75e14fd88bfb4cd896fa7b070a0fac47', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120741) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 18:04:03.748453 dv-cinder-852009-8-iscsi devstack@n-api.service[120741]: DEBUG nova.policy [None req-aea36170-9302-480f-b520-84655d5dc1da tempest-AttachVolumeShelveTestJSON-385853788 tempest-AttachVolumeShelveTestJSON-385853788-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'e68ecd9b3ca643539b109f75bb242d6f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '75e14fd88bfb4cd896fa7b070a0fac47', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120741) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 18:04:03.749645 dv-cinder-852009-8-iscsi devstack@n-api.service[120741]: INFO nova.api.openstack.requestlog [None req-aea36170-9302-480f-b520-84655d5dc1da tempest-AttachVolumeShelveTestJSON-385853788 tempest-AttachVolumeShelveTestJSON-385853788-project] 10.222.0.43 "GET /compute/v2.1/servers/11d2616a-96f9-4a7a-aab8-219219986a8b" status: 200 len: 1738 microversion: 2.20 time: 0.458051 Sep 13 18:04:03.750534 dv-cinder-852009-8-iscsi devstack@n-api.service[120741]: [pid: 120741|app: 0|req: 134/276] 10.222.0.43 () {60 vars in 1277 bytes} [Tue Sep 13 18:04:03 2022] GET /compute/v2.1/servers/11d2616a-96f9-4a7a-aab8-219219986a8b => generated 1738 bytes in 460 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Sep 13 18:04:03.788013 dv-cinder-852009-8-iscsi devstack@n-api.service[120740]: DEBUG nova.api.openstack.wsgi [None req-f16c2a9b-f2b1-479d-960f-44ed68984540 tempest-AttachVolumeTestJSON-555093534 tempest-AttachVolumeTestJSON-555093534-project] Calling method '>' {{(pid=120740) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 18:04:03.789281 dv-cinder-852009-8-iscsi devstack@n-api.service[120740]: DEBUG nova.compute.api [None req-f16c2a9b-f2b1-479d-960f-44ed68984540 tempest-AttachVolumeTestJSON-555093534 tempest-AttachVolumeTestJSON-555093534-project] [instance: b958d409-df20-44c6-aa0e-58cb0a482edf] Fetching instance by UUID {{(pid=120740) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 18:04:03.800966 dv-cinder-852009-8-iscsi devstack@n-api.service[120740]: DEBUG oslo_concurrency.lockutils [None req-f16c2a9b-f2b1-479d-960f-44ed68984540 tempest-AttachVolumeTestJSON-555093534 tempest-AttachVolumeTestJSON-555093534-project] Acquiring lock "1daf4f4c-0e4a-4779-b53a-78c48397ea2f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120740) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 18:04:03.801455 dv-cinder-852009-8-iscsi devstack@n-api.service[120740]: DEBUG oslo_concurrency.lockutils [None req-f16c2a9b-f2b1-479d-960f-44ed68984540 tempest-AttachVolumeTestJSON-555093534 tempest-AttachVolumeTestJSON-555093534-project] Lock "1daf4f4c-0e4a-4779-b53a-78c48397ea2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120740) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 18:04:03.802298 dv-cinder-852009-8-iscsi devstack@n-api.service[120740]: DEBUG oslo_concurrency.lockutils [None req-f16c2a9b-f2b1-479d-960f-44ed68984540 tempest-AttachVolumeTestJSON-555093534 tempest-AttachVolumeTestJSON-555093534-project] Lock "1daf4f4c-0e4a-4779-b53a-78c48397ea2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120740) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 18:04:03.803158 dv-cinder-852009-8-iscsi devstack@n-api.service[120740]: DEBUG oslo_concurrency.lockutils [None req-f16c2a9b-f2b1-479d-960f-44ed68984540 tempest-AttachVolumeTestJSON-555093534 tempest-AttachVolumeTestJSON-555093534-project] Acquiring lock "1daf4f4c-0e4a-4779-b53a-78c48397ea2f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120740) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 18:04:03.803466 dv-cinder-852009-8-iscsi devstack@n-api.service[120740]: DEBUG oslo_concurrency.lockutils [None req-f16c2a9b-f2b1-479d-960f-44ed68984540 tempest-AttachVolumeTestJSON-555093534 tempest-AttachVolumeTestJSON-555093534-project] Lock "1daf4f4c-0e4a-4779-b53a-78c48397ea2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120740) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 18:04:03.803876 dv-cinder-852009-8-iscsi devstack@n-api.service[120740]: DEBUG oslo_concurrency.lockutils [None req-f16c2a9b-f2b1-479d-960f-44ed68984540 tempest-AttachVolumeTestJSON-555093534 tempest-AttachVolumeTestJSON-555093534-project] Lock "1daf4f4c-0e4a-4779-b53a-78c48397ea2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120740) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 18:04:03.846040 dv-cinder-852009-8-iscsi devstack@n-api.service[120741]: DEBUG nova.api.openstack.wsgi [None req-fa9e73c7-3827-4733-924a-ce6f6b380789 tempest-ServerRescueNegativeTestJSON-412251590 tempest-ServerRescueNegativeTestJSON-412251590-project] Calling method '>' {{(pid=120741) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 18:04:03.847279 dv-cinder-852009-8-iscsi devstack@n-api.service[120741]: DEBUG nova.compute.api [None req-fa9e73c7-3827-4733-924a-ce6f6b380789 tempest-ServerRescueNegativeTestJSON-412251590 tempest-ServerRescueNegativeTestJSON-412251590-project] [instance: e8ce7158-6b73-4586-9f78-8e821988e71c] Fetching instance by UUID {{(pid=120741) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 18:04:03.863638 dv-cinder-852009-8-iscsi devstack@n-api.service[120741]: DEBUG oslo_concurrency.lockutils [None req-fa9e73c7-3827-4733-924a-ce6f6b380789 tempest-ServerRescueNegativeTestJSON-412251590 tempest-ServerRescueNegativeTestJSON-412251590-project] Acquiring lock "1daf4f4c-0e4a-4779-b53a-78c48397ea2f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120741) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 18:04:03.864140 dv-cinder-852009-8-iscsi devstack@n-api.service[120741]: DEBUG oslo_concurrency.lockutils [None req-fa9e73c7-3827-4733-924a-ce6f6b380789 tempest-ServerRescueNegativeTestJSON-412251590 tempest-ServerRescueNegativeTestJSON-412251590-project] Lock "1daf4f4c-0e4a-4779-b53a-78c48397ea2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120741) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 18:04:03.864612 dv-cinder-852009-8-iscsi devstack@n-api.service[120741]: DEBUG oslo_concurrency.lockutils [None req-fa9e73c7-3827-4733-924a-ce6f6b380789 tempest-ServerRescueNegativeTestJSON-412251590 tempest-ServerRescueNegativeTestJSON-412251590-project] Lock "1daf4f4c-0e4a-4779-b53a-78c48397ea2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120741) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 18:04:03.865334 dv-cinder-852009-8-iscsi devstack@n-api.service[120741]: DEBUG oslo_concurrency.lockutils [None req-fa9e73c7-3827-4733-924a-ce6f6b380789 tempest-ServerRescueNegativeTestJSON-412251590 tempest-ServerRescueNegativeTestJSON-412251590-project] Acquiring lock "1daf4f4c-0e4a-4779-b53a-78c48397ea2f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120741) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 18:04:03.865791 dv-cinder-852009-8-iscsi devstack@n-api.service[120741]: DEBUG oslo_concurrency.lockutils [None req-fa9e73c7-3827-4733-924a-ce6f6b380789 tempest-ServerRescueNegativeTestJSON-412251590 tempest-ServerRescueNegativeTestJSON-412251590-project] Lock "1daf4f4c-0e4a-4779-b53a-78c48397ea2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120741) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 18:04:03.866221 dv-cinder-852009-8-iscsi devstack@n-api.service[120741]: DEBUG oslo_concurrency.lockutils [None req-fa9e73c7-3827-4733-924a-ce6f6b380789 tempest-ServerRescueNegativeTestJSON-412251590 tempest-ServerRescueNegativeTestJSON-412251590-project] Lock "1daf4f4c-0e4a-4779-b53a-78c48397ea2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120741) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 18:04:04.402728 dv-cinder-852009-8-iscsi devstack@n-api.service[120740]: DEBUG nova.policy [None req-f16c2a9b-f2b1-479d-960f-44ed68984540 tempest-AttachVolumeTestJSON-555093534 tempest-AttachVolumeTestJSON-555093534-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0625b3113ce044bbac4f6142eaade11c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a279fcbf274c4704a31a2b95061e1469', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120740) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 18:04:04.411397 dv-cinder-852009-8-iscsi devstack@n-api.service[120740]: INFO nova.api.openstack.requestlog [None req-f16c2a9b-f2b1-479d-960f-44ed68984540 tempest-AttachVolumeTestJSON-555093534 tempest-AttachVolumeTestJSON-555093534-project] 10.222.0.43 "GET /compute/v2.1/servers/b958d409-df20-44c6-aa0e-58cb0a482edf" status: 200 len: 1724 microversion: 2.1 time: 0.629030 Sep 13 18:04:04.434456 dv-cinder-852009-8-iscsi devstack@n-api.service[120740]: [pid: 120740|app: 0|req: 143/277] 10.222.0.43 () {58 vars in 1236 bytes} [Tue Sep 13 18:04:03 2022] GET /compute/v2.1/servers/b958d409-df20-44c6-aa0e-58cb0a482edf => generated 1724 bytes in 653 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 13 18:04:04.494830 dv-cinder-852009-8-iscsi devstack@n-api.service[120741]: DEBUG nova.policy [None req-fa9e73c7-3827-4733-924a-ce6f6b380789 tempest-ServerRescueNegativeTestJSON-412251590 tempest-ServerRescueNegativeTestJSON-412251590-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '60800cf2774e409d9c1b6f4992669991', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2eae4acecf6c4961830ead78d71b2ad3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120741) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 18:04:04.506752 dv-cinder-852009-8-iscsi devstack@n-api.service[120741]: INFO nova.api.openstack.requestlog [None req-fa9e73c7-3827-4733-924a-ce6f6b380789 tempest-ServerRescueNegativeTestJSON-412251590 tempest-ServerRescueNegativeTestJSON-412251590-project] 10.222.0.43 "GET /compute/v2.1/servers/e8ce7158-6b73-4586-9f78-8e821988e71c" status: 200 len: 1371 microversion: 2.1 time: 0.664654 Sep 13 18:04:04.509162 dv-cinder-852009-8-iscsi devstack@n-api.service[120741]: [pid: 120741|app: 0|req: 135/278] 10.222.0.43 () {58 vars in 1236 bytes} [Tue Sep 13 18:04:03 2022] GET /compute/v2.1/servers/e8ce7158-6b73-4586-9f78-8e821988e71c => generated 1371 bytes in 668 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 13 18:04:04.661814 dv-cinder-852009-8-iscsi devstack@n-api.service[120740]: DEBUG nova.api.openstack.wsgi [None req-768690f6-5727-49dd-b591-63a6c9a2a2a9 tempest-TestShelveInstance-6258502 tempest-TestShelveInstance-6258502-project] Calling method '>' {{(pid=120740) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 18:04:04.662765 dv-cinder-852009-8-iscsi devstack@n-api.service[120740]: DEBUG nova.compute.api [None req-768690f6-5727-49dd-b591-63a6c9a2a2a9 tempest-TestShelveInstance-6258502 tempest-TestShelveInstance-6258502-project] [instance: 2d60cc6d-a699-417d-aa20-fe3e1bfc351e] Fetching instance by UUID {{(pid=120740) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 18:04:04.671934 dv-cinder-852009-8-iscsi devstack@n-api.service[120740]: DEBUG oslo_concurrency.lockutils [None req-768690f6-5727-49dd-b591-63a6c9a2a2a9 tempest-TestShelveInstance-6258502 tempest-TestShelveInstance-6258502-project] Acquiring lock "1daf4f4c-0e4a-4779-b53a-78c48397ea2f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120740) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 18:04:04.672943 dv-cinder-852009-8-iscsi devstack@n-api.service[120740]: DEBUG oslo_concurrency.lockutils [None req-768690f6-5727-49dd-b591-63a6c9a2a2a9 tempest-TestShelveInstance-6258502 tempest-TestShelveInstance-6258502-project] Lock "1daf4f4c-0e4a-4779-b53a-78c48397ea2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120740) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 18:04:04.673826 dv-cinder-852009-8-iscsi devstack@n-api.service[120740]: DEBUG oslo_concurrency.lockutils [None req-768690f6-5727-49dd-b591-63a6c9a2a2a9 tempest-TestShelveInstance-6258502 tempest-TestShelveInstance-6258502-project] Lock "1daf4f4c-0e4a-4779-b53a-78c48397ea2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120740) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 18:04:04.674820 dv-cinder-852009-8-iscsi devstack@n-api.service[120740]: DEBUG oslo_concurrency.lockutils [None req-768690f6-5727-49dd-b591-63a6c9a2a2a9 tempest-TestShelveInstance-6258502 tempest-TestShelveInstance-6258502-project] Acquiring lock "1daf4f4c-0e4a-4779-b53a-78c48397ea2f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120740) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 18:04:04.675674 dv-cinder-852009-8-iscsi devstack@n-api.service[120740]: DEBUG oslo_concurrency.lockutils [None req-768690f6-5727-49dd-b591-63a6c9a2a2a9 tempest-TestShelveInstance-6258502 tempest-TestShelveInstance-6258502-project] Lock "1daf4f4c-0e4a-4779-b53a-78c48397ea2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120740) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 18:04:04.677012 dv-cinder-852009-8-iscsi devstack@n-api.service[120740]: DEBUG oslo_concurrency.lockutils [None req-768690f6-5727-49dd-b591-63a6c9a2a2a9 tempest-TestShelveInstance-6258502 tempest-TestShelveInstance-6258502-project] Lock "1daf4f4c-0e4a-4779-b53a-78c48397ea2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120740) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 18:04:04.779417 dv-cinder-852009-8-iscsi devstack@n-api.service[120741]: DEBUG nova.api.openstack.wsgi [None req-1ebd4b5a-3662-4bb1-9daf-80137fe05be2 tempest-AttachVolumeShelveTestJSON-385853788 tempest-AttachVolumeShelveTestJSON-385853788-project] Calling method '>' {{(pid=120741) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 18:04:04.780109 dv-cinder-852009-8-iscsi devstack@n-api.service[120741]: DEBUG nova.compute.api [None req-1ebd4b5a-3662-4bb1-9daf-80137fe05be2 tempest-AttachVolumeShelveTestJSON-385853788 tempest-AttachVolumeShelveTestJSON-385853788-project] [instance: 11d2616a-96f9-4a7a-aab8-219219986a8b] Fetching instance by UUID {{(pid=120741) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 18:04:04.790150 dv-cinder-852009-8-iscsi devstack@n-api.service[120741]: DEBUG oslo_concurrency.lockutils [None req-1ebd4b5a-3662-4bb1-9daf-80137fe05be2 tempest-AttachVolumeShelveTestJSON-385853788 tempest-AttachVolumeShelveTestJSON-385853788-project] Acquiring lock "1daf4f4c-0e4a-4779-b53a-78c48397ea2f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120741) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 18:04:04.790979 dv-cinder-852009-8-iscsi devstack@n-api.service[120741]: DEBUG oslo_concurrency.lockutils [None req-1ebd4b5a-3662-4bb1-9daf-80137fe05be2 tempest-AttachVolumeShelveTestJSON-385853788 tempest-AttachVolumeShelveTestJSON-385853788-project] Lock "1daf4f4c-0e4a-4779-b53a-78c48397ea2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120741) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 18:04:04.794859 dv-cinder-852009-8-iscsi devstack@n-api.service[120741]: DEBUG oslo_concurrency.lockutils [None req-1ebd4b5a-3662-4bb1-9daf-80137fe05be2 tempest-AttachVolumeShelveTestJSON-385853788 tempest-AttachVolumeShelveTestJSON-385853788-project] Lock "1daf4f4c-0e4a-4779-b53a-78c48397ea2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=120741) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 18:04:04.795755 dv-cinder-852009-8-iscsi devstack@n-api.service[120741]: DEBUG oslo_concurrency.lockutils [None req-1ebd4b5a-3662-4bb1-9daf-80137fe05be2 tempest-AttachVolumeShelveTestJSON-385853788 tempest-AttachVolumeShelveTestJSON-385853788-project] Acquiring lock "1daf4f4c-0e4a-4779-b53a-78c48397ea2f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120741) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 18:04:04.796358 dv-cinder-852009-8-iscsi devstack@n-api.service[120741]: DEBUG oslo_concurrency.lockutils [None req-1ebd4b5a-3662-4bb1-9daf-80137fe05be2 tempest-AttachVolumeShelveTestJSON-385853788 tempest-AttachVolumeShelveTestJSON-385853788-project] Lock "1daf4f4c-0e4a-4779-b53a-78c48397ea2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120741) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 18:04:04.797053 dv-cinder-852009-8-iscsi devstack@n-api.service[120741]: DEBUG oslo_concurrency.lockutils [None req-1ebd4b5a-3662-4bb1-9daf-80137fe05be2 tempest-AttachVolumeShelveTestJSON-385853788 tempest-AttachVolumeShelveTestJSON-385853788-project] Lock "1daf4f4c-0e4a-4779-b53a-78c48397ea2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120741) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 18:04:04.969105 dv-cinder-852009-8-iscsi devstack@n-api.service[120740]: DEBUG nova.policy [None req-768690f6-5727-49dd-b591-63a6c9a2a2a9 tempest-TestShelveInstance-6258502 tempest-TestShelveInstance-6258502-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2ab9930d6ce54cacbb3d4fd6313294d5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5eafd54351bd4049b87ad308a3638f80', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120740) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 18:04:04.996779 dv-cinder-852009-8-iscsi devstack@n-api.service[120740]: INFO nova.api.openstack.requestlog [None req-768690f6-5727-49dd-b591-63a6c9a2a2a9 tempest-TestShelveInstance-6258502 tempest-TestShelveInstance-6258502-project] 10.222.0.43 "GET /compute/v2.1/servers/2d60cc6d-a699-417d-aa20-fe3e1bfc351e" status: 200 len: 1261 microversion: 2.1 time: 0.338712 Sep 13 18:04:05.002599 dv-cinder-852009-8-iscsi devstack@n-api.service[120740]: [pid: 120740|app: 0|req: 144/279] 10.222.0.43 () {58 vars in 1236 bytes} [Tue Sep 13 18:04:04 2022] GET /compute/v2.1/servers/2d60cc6d-a699-417d-aa20-fe3e1bfc351e => generated 1261 bytes in 345 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 13 18:04:05.081015 dv-cinder-852009-8-iscsi devstack@n-api.service[120741]: DEBUG nova.policy [None req-1ebd4b5a-3662-4bb1-9daf-80137fe05be2 tempest-AttachVolumeShelveTestJSON-385853788 tempest-AttachVolumeShelveTestJSON-385853788-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e68ecd9b3ca643539b109f75bb242d6f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '75e14fd88bfb4cd896fa7b070a0fac47', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120741) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 18:04:05.086341 dv-cinder-852009-8-iscsi devstack@n-api.service[120741]: DEBUG dbcounter [-] [120741] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=120741) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 18:04:05.099292 dv-cinder-852009-8-iscsi devstack@n-api.service[120741]: DEBUG nova.policy [None req-1ebd4b5a-3662-4bb1-9daf-80137fe05be2 tempest-AttachVolumeShelveTestJSON-385853788 tempest-AttachVolumeShelveTestJSON-385853788-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'e68ecd9b3ca643539b109f75bb242d6f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '75e14fd88bfb4cd896fa7b070a0fac47', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120741) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 18:04:05.104355 dv-cinder-852009-8-iscsi devstack@n-api.service[120741]: DEBUG nova.policy [None req-1ebd4b5a-3662-4bb1-9daf-80137fe05be2 tempest-AttachVolumeShelveTestJSON-385853788 tempest-AttachVolumeShelveTestJSON-385853788-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'e68ecd9b3ca643539b109f75bb242d6f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '75e14fd88bfb4cd896fa7b070a0fac47', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120741) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 18:04:05.106066 dv-cinder-852009-8-iscsi devstack@n-api.service[120741]: INFO nova.api.openstack.requestlog [None req-1ebd4b5a-3662-4bb1-9daf-80137fe05be2 tempest-AttachVolumeShelveTestJSON-385853788 tempest-AttachVolumeShelveTestJSON-385853788-project] 10.222.0.43 "GET /compute/v2.1/servers/11d2616a-96f9-4a7a-aab8-219219986a8b" status: 200 len: 1738 microversion: 2.20 time: 0.331815 Sep 13 18:04:05.107038 dv-cinder-852009-8-iscsi devstack@n-api.service[120741]: [pid: 120741|app: 0|req: 136/280] 10.222.0.43 () {60 vars in 1277 bytes} [Tue Sep 13 18:04:04 2022] GET /compute/v2.1/servers/11d2616a-96f9-4a7a-aab8-219219986a8b => generated 1738 bytes in 333 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Sep 13 18:04:05.452042 dv-cinder-852009-8-iscsi devstack@n-api.service[120740]: DEBUG nova.api.openstack.wsgi [None req-1f8adb50-0d50-49a6-a276-6d97d3220e22 tempest-AttachVolumeTestJSON-555093534 tempest-AttachVolumeTestJSON-555093534-project] Calling method '>' {{(pid=120740) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 18:04:05.453075 dv-cinder-852009-8-iscsi devstack@n-api.service[120740]: DEBUG nova.compute.api [None req-1f8adb50-0d50-49a6-a276-6d97d3220e22 tempest-AttachVolumeTestJSON-555093534 tempest-AttachVolumeTestJSON-555093534-project] [instance: b958d409-df20-44c6-aa0e-58cb0a482edf] Fetching instance by UUID {{(pid=120740) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 18:04:05.460309 dv-cinder-852009-8-iscsi devstack@n-api.service[120740]: DEBUG oslo_concurrency.lockutils [None req-1f8adb50-0d50-49a6-a276-6d97d3220e22 tempest-AttachVolumeTestJSON-555093534 tempest-AttachVolumeTestJSON-555093534-project] Acquiring lock "1daf4f4c-0e4a-4779-b53a-78c48397ea2f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120740) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 18:04:05.461209 dv-cinder-852009-8-iscsi devstack@n-api.service[120740]: DEBUG oslo_concurrency.lockutils [None req-1f8adb50-0d50-49a6-a276-6d97d3220e22 tempest-AttachVolumeTestJSON-555093534 tempest-AttachVolumeTestJSON-555093534-project] Lock "1daf4f4c-0e4a-4779-b53a-78c48397ea2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120740) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 18:04:05.461851 dv-cinder-852009-8-iscsi devstack@n-api.service[120740]: DEBUG oslo_concurrency.lockutils [None req-1f8adb50-0d50-49a6-a276-6d97d3220e22 tempest-AttachVolumeTestJSON-555093534 tempest-AttachVolumeTestJSON-555093534-project] Lock "1daf4f4c-0e4a-4779-b53a-78c48397ea2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120740) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 18:04:05.462808 dv-cinder-852009-8-iscsi devstack@n-api.service[120740]: DEBUG oslo_concurrency.lockutils [None req-1f8adb50-0d50-49a6-a276-6d97d3220e22 tempest-AttachVolumeTestJSON-555093534 tempest-AttachVolumeTestJSON-555093534-project] Acquiring lock "1daf4f4c-0e4a-4779-b53a-78c48397ea2f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120740) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 18:04:05.463423 dv-cinder-852009-8-iscsi devstack@n-api.service[120740]: DEBUG oslo_concurrency.lockutils [None req-1f8adb50-0d50-49a6-a276-6d97d3220e22 tempest-AttachVolumeTestJSON-555093534 tempest-AttachVolumeTestJSON-555093534-project] Lock "1daf4f4c-0e4a-4779-b53a-78c48397ea2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120740) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 18:04:05.464016 dv-cinder-852009-8-iscsi devstack@n-api.service[120740]: DEBUG oslo_concurrency.lockutils [None req-1f8adb50-0d50-49a6-a276-6d97d3220e22 tempest-AttachVolumeTestJSON-555093534 tempest-AttachVolumeTestJSON-555093534-project] Lock "1daf4f4c-0e4a-4779-b53a-78c48397ea2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120740) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 18:04:05.565809 dv-cinder-852009-8-iscsi devstack@n-api.service[120741]: DEBUG nova.api.openstack.wsgi [None req-8acb8280-3f9c-44b1-b0a1-b645a8c2d5e3 tempest-ServerRescueNegativeTestJSON-412251590 tempest-ServerRescueNegativeTestJSON-412251590-project] Calling method '>' {{(pid=120741) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 18:04:05.567159 dv-cinder-852009-8-iscsi devstack@n-api.service[120741]: DEBUG nova.compute.api [None req-8acb8280-3f9c-44b1-b0a1-b645a8c2d5e3 tempest-ServerRescueNegativeTestJSON-412251590 tempest-ServerRescueNegativeTestJSON-412251590-project] [instance: e8ce7158-6b73-4586-9f78-8e821988e71c] Fetching instance by UUID {{(pid=120741) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 18:04:05.595620 dv-cinder-852009-8-iscsi devstack@n-api.service[120741]: DEBUG oslo_concurrency.lockutils [None req-8acb8280-3f9c-44b1-b0a1-b645a8c2d5e3 tempest-ServerRescueNegativeTestJSON-412251590 tempest-ServerRescueNegativeTestJSON-412251590-project] Acquiring lock "1daf4f4c-0e4a-4779-b53a-78c48397ea2f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120741) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 18:04:05.596757 dv-cinder-852009-8-iscsi devstack@n-api.service[120741]: DEBUG oslo_concurrency.lockutils [None req-8acb8280-3f9c-44b1-b0a1-b645a8c2d5e3 tempest-ServerRescueNegativeTestJSON-412251590 tempest-ServerRescueNegativeTestJSON-412251590-project] Lock "1daf4f4c-0e4a-4779-b53a-78c48397ea2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120741) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 18:04:05.598276 dv-cinder-852009-8-iscsi devstack@n-api.service[120741]: DEBUG oslo_concurrency.lockutils [None req-8acb8280-3f9c-44b1-b0a1-b645a8c2d5e3 tempest-ServerRescueNegativeTestJSON-412251590 tempest-ServerRescueNegativeTestJSON-412251590-project] Lock "1daf4f4c-0e4a-4779-b53a-78c48397ea2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120741) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 18:04:05.600095 dv-cinder-852009-8-iscsi devstack@n-api.service[120741]: DEBUG oslo_concurrency.lockutils [None req-8acb8280-3f9c-44b1-b0a1-b645a8c2d5e3 tempest-ServerRescueNegativeTestJSON-412251590 tempest-ServerRescueNegativeTestJSON-412251590-project] Acquiring lock "1daf4f4c-0e4a-4779-b53a-78c48397ea2f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120741) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 18:04:05.600982 dv-cinder-852009-8-iscsi devstack@n-api.service[120741]: DEBUG oslo_concurrency.lockutils [None req-8acb8280-3f9c-44b1-b0a1-b645a8c2d5e3 tempest-ServerRescueNegativeTestJSON-412251590 tempest-ServerRescueNegativeTestJSON-412251590-project] Lock "1daf4f4c-0e4a-4779-b53a-78c48397ea2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120741) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 18:04:05.601422 dv-cinder-852009-8-iscsi devstack@n-api.service[120741]: DEBUG oslo_concurrency.lockutils [None req-8acb8280-3f9c-44b1-b0a1-b645a8c2d5e3 tempest-ServerRescueNegativeTestJSON-412251590 tempest-ServerRescueNegativeTestJSON-412251590-project] Lock "1daf4f4c-0e4a-4779-b53a-78c48397ea2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120741) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 18:04:05.803996 dv-cinder-852009-8-iscsi devstack@n-api.service[120740]: DEBUG nova.policy [None req-1f8adb50-0d50-49a6-a276-6d97d3220e22 tempest-AttachVolumeTestJSON-555093534 tempest-AttachVolumeTestJSON-555093534-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0625b3113ce044bbac4f6142eaade11c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a279fcbf274c4704a31a2b95061e1469', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120740) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 18:04:05.812695 dv-cinder-852009-8-iscsi devstack@n-api.service[120740]: INFO nova.api.openstack.requestlog [None req-1f8adb50-0d50-49a6-a276-6d97d3220e22 tempest-AttachVolumeTestJSON-555093534 tempest-AttachVolumeTestJSON-555093534-project] 10.222.0.43 "GET /compute/v2.1/servers/b958d409-df20-44c6-aa0e-58cb0a482edf" status: 200 len: 1724 microversion: 2.1 time: 0.368966 Sep 13 18:04:05.813270 dv-cinder-852009-8-iscsi devstack@n-api.service[120740]: [pid: 120740|app: 0|req: 145/281] 10.222.0.43 () {58 vars in 1236 bytes} [Tue Sep 13 18:04:05 2022] GET /compute/v2.1/servers/b958d409-df20-44c6-aa0e-58cb0a482edf => generated 1724 bytes in 370 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 13 18:04:05.848402 dv-cinder-852009-8-iscsi devstack@n-api.service[120741]: DEBUG nova.policy [None req-8acb8280-3f9c-44b1-b0a1-b645a8c2d5e3 tempest-ServerRescueNegativeTestJSON-412251590 tempest-ServerRescueNegativeTestJSON-412251590-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '60800cf2774e409d9c1b6f4992669991', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2eae4acecf6c4961830ead78d71b2ad3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120741) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 18:04:05.857023 dv-cinder-852009-8-iscsi devstack@n-api.service[120741]: INFO nova.api.openstack.requestlog [None req-8acb8280-3f9c-44b1-b0a1-b645a8c2d5e3 tempest-ServerRescueNegativeTestJSON-412251590 tempest-ServerRescueNegativeTestJSON-412251590-project] 10.222.0.43 "GET /compute/v2.1/servers/e8ce7158-6b73-4586-9f78-8e821988e71c" status: 200 len: 1371 microversion: 2.1 time: 0.327843 Sep 13 18:04:05.857743 dv-cinder-852009-8-iscsi devstack@n-api.service[120741]: [pid: 120741|app: 0|req: 137/282] 10.222.0.43 () {58 vars in 1236 bytes} [Tue Sep 13 18:04:05 2022] GET /compute/v2.1/servers/e8ce7158-6b73-4586-9f78-8e821988e71c => generated 1371 bytes in 331 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 13 18:04:06.023820 dv-cinder-852009-8-iscsi devstack@n-api.service[120740]: DEBUG nova.api.openstack.wsgi [None req-c5326ead-2aec-4107-a296-e66e38431a80 tempest-TestShelveInstance-6258502 tempest-TestShelveInstance-6258502-project] Calling method '>' {{(pid=120740) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 18:04:06.024512 dv-cinder-852009-8-iscsi devstack@n-api.service[120740]: DEBUG nova.compute.api [None req-c5326ead-2aec-4107-a296-e66e38431a80 tempest-TestShelveInstance-6258502 tempest-TestShelveInstance-6258502-project] [instance: 2d60cc6d-a699-417d-aa20-fe3e1bfc351e] Fetching instance by UUID {{(pid=120740) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 18:04:06.030660 dv-cinder-852009-8-iscsi devstack@n-api.service[120740]: DEBUG oslo_concurrency.lockutils [None req-c5326ead-2aec-4107-a296-e66e38431a80 tempest-TestShelveInstance-6258502 tempest-TestShelveInstance-6258502-project] Acquiring lock "1daf4f4c-0e4a-4779-b53a-78c48397ea2f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120740) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 18:04:06.031607 dv-cinder-852009-8-iscsi devstack@n-api.service[120740]: DEBUG oslo_concurrency.lockutils [None req-c5326ead-2aec-4107-a296-e66e38431a80 tempest-TestShelveInstance-6258502 tempest-TestShelveInstance-6258502-project] Lock "1daf4f4c-0e4a-4779-b53a-78c48397ea2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120740) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 18:04:06.032240 dv-cinder-852009-8-iscsi devstack@n-api.service[120740]: DEBUG oslo_concurrency.lockutils [None req-c5326ead-2aec-4107-a296-e66e38431a80 tempest-TestShelveInstance-6258502 tempest-TestShelveInstance-6258502-project] Lock "1daf4f4c-0e4a-4779-b53a-78c48397ea2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120740) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 18:04:06.033310 dv-cinder-852009-8-iscsi devstack@n-api.service[120740]: DEBUG oslo_concurrency.lockutils [None req-c5326ead-2aec-4107-a296-e66e38431a80 tempest-TestShelveInstance-6258502 tempest-TestShelveInstance-6258502-project] Acquiring lock "1daf4f4c-0e4a-4779-b53a-78c48397ea2f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120740) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 18:04:06.033824 dv-cinder-852009-8-iscsi devstack@n-api.service[120740]: DEBUG oslo_concurrency.lockutils [None req-c5326ead-2aec-4107-a296-e66e38431a80 tempest-TestShelveInstance-6258502 tempest-TestShelveInstance-6258502-project] Lock "1daf4f4c-0e4a-4779-b53a-78c48397ea2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120740) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 18:04:06.034311 dv-cinder-852009-8-iscsi devstack@n-api.service[120740]: DEBUG oslo_concurrency.lockutils [None req-c5326ead-2aec-4107-a296-e66e38431a80 tempest-TestShelveInstance-6258502 tempest-TestShelveInstance-6258502-project] Lock "1daf4f4c-0e4a-4779-b53a-78c48397ea2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120740) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 18:04:06.141027 dv-cinder-852009-8-iscsi devstack@n-api.service[120741]: DEBUG nova.api.openstack.wsgi [None req-090105d4-e818-4c91-bdca-b3c512a86035 tempest-AttachVolumeShelveTestJSON-385853788 tempest-AttachVolumeShelveTestJSON-385853788-project] Calling method '>' {{(pid=120741) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 18:04:06.142379 dv-cinder-852009-8-iscsi devstack@n-api.service[120741]: DEBUG nova.compute.api [None req-090105d4-e818-4c91-bdca-b3c512a86035 tempest-AttachVolumeShelveTestJSON-385853788 tempest-AttachVolumeShelveTestJSON-385853788-project] [instance: 11d2616a-96f9-4a7a-aab8-219219986a8b] Fetching instance by UUID {{(pid=120741) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 18:04:06.149464 dv-cinder-852009-8-iscsi devstack@n-api.service[120741]: DEBUG oslo_concurrency.lockutils [None req-090105d4-e818-4c91-bdca-b3c512a86035 tempest-AttachVolumeShelveTestJSON-385853788 tempest-AttachVolumeShelveTestJSON-385853788-project] Acquiring lock "1daf4f4c-0e4a-4779-b53a-78c48397ea2f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120741) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 18:04:06.150431 dv-cinder-852009-8-iscsi devstack@n-api.service[120741]: DEBUG oslo_concurrency.lockutils [None req-090105d4-e818-4c91-bdca-b3c512a86035 tempest-AttachVolumeShelveTestJSON-385853788 tempest-AttachVolumeShelveTestJSON-385853788-project] Lock "1daf4f4c-0e4a-4779-b53a-78c48397ea2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120741) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 18:04:06.151110 dv-cinder-852009-8-iscsi devstack@n-api.service[120741]: DEBUG oslo_concurrency.lockutils [None req-090105d4-e818-4c91-bdca-b3c512a86035 tempest-AttachVolumeShelveTestJSON-385853788 tempest-AttachVolumeShelveTestJSON-385853788-project] Lock "1daf4f4c-0e4a-4779-b53a-78c48397ea2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120741) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 18:04:06.152102 dv-cinder-852009-8-iscsi devstack@n-api.service[120741]: DEBUG oslo_concurrency.lockutils [None req-090105d4-e818-4c91-bdca-b3c512a86035 tempest-AttachVolumeShelveTestJSON-385853788 tempest-AttachVolumeShelveTestJSON-385853788-project] Acquiring lock "1daf4f4c-0e4a-4779-b53a-78c48397ea2f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120741) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 18:04:06.152792 dv-cinder-852009-8-iscsi devstack@n-api.service[120741]: DEBUG oslo_concurrency.lockutils [None req-090105d4-e818-4c91-bdca-b3c512a86035 tempest-AttachVolumeShelveTestJSON-385853788 tempest-AttachVolumeShelveTestJSON-385853788-project] Lock "1daf4f4c-0e4a-4779-b53a-78c48397ea2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120741) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 18:04:06.153424 dv-cinder-852009-8-iscsi devstack@n-api.service[120741]: DEBUG oslo_concurrency.lockutils [None req-090105d4-e818-4c91-bdca-b3c512a86035 tempest-AttachVolumeShelveTestJSON-385853788 tempest-AttachVolumeShelveTestJSON-385853788-project] Lock "1daf4f4c-0e4a-4779-b53a-78c48397ea2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120741) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 18:04:06.217228 dv-cinder-852009-8-iscsi devstack@n-api.service[120740]: DEBUG nova.policy [None req-c5326ead-2aec-4107-a296-e66e38431a80 tempest-TestShelveInstance-6258502 tempest-TestShelveInstance-6258502-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2ab9930d6ce54cacbb3d4fd6313294d5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5eafd54351bd4049b87ad308a3638f80', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120740) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 18:04:06.226615 dv-cinder-852009-8-iscsi devstack@n-api.service[120740]: INFO nova.api.openstack.requestlog [None req-c5326ead-2aec-4107-a296-e66e38431a80 tempest-TestShelveInstance-6258502 tempest-TestShelveInstance-6258502-project] 10.222.0.43 "GET /compute/v2.1/servers/2d60cc6d-a699-417d-aa20-fe3e1bfc351e" status: 200 len: 1261 microversion: 2.1 time: 0.206973 Sep 13 18:04:06.240456 dv-cinder-852009-8-iscsi devstack@n-api.service[120740]: [pid: 120740|app: 0|req: 146/283] 10.222.0.43 () {58 vars in 1236 bytes} [Tue Sep 13 18:04:06 2022] GET /compute/v2.1/servers/2d60cc6d-a699-417d-aa20-fe3e1bfc351e => generated 1261 bytes in 217 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 13 18:04:06.336552 dv-cinder-852009-8-iscsi devstack@n-api.service[120741]: DEBUG nova.policy [None req-090105d4-e818-4c91-bdca-b3c512a86035 tempest-AttachVolumeShelveTestJSON-385853788 tempest-AttachVolumeShelveTestJSON-385853788-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e68ecd9b3ca643539b109f75bb242d6f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '75e14fd88bfb4cd896fa7b070a0fac47', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120741) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 18:04:06.350017 dv-cinder-852009-8-iscsi devstack@n-api.service[120741]: DEBUG nova.policy [None req-090105d4-e818-4c91-bdca-b3c512a86035 tempest-AttachVolumeShelveTestJSON-385853788 tempest-AttachVolumeShelveTestJSON-385853788-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'e68ecd9b3ca643539b109f75bb242d6f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '75e14fd88bfb4cd896fa7b070a0fac47', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120741) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 18:04:06.352272 dv-cinder-852009-8-iscsi devstack@n-api.service[120741]: DEBUG nova.policy [None req-090105d4-e818-4c91-bdca-b3c512a86035 tempest-AttachVolumeShelveTestJSON-385853788 tempest-AttachVolumeShelveTestJSON-385853788-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'e68ecd9b3ca643539b109f75bb242d6f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '75e14fd88bfb4cd896fa7b070a0fac47', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120741) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 18:04:06.354050 dv-cinder-852009-8-iscsi devstack@n-api.service[120741]: INFO nova.api.openstack.requestlog [None req-090105d4-e818-4c91-bdca-b3c512a86035 tempest-AttachVolumeShelveTestJSON-385853788 tempest-AttachVolumeShelveTestJSON-385853788-project] 10.222.0.43 "GET /compute/v2.1/servers/11d2616a-96f9-4a7a-aab8-219219986a8b" status: 200 len: 1738 microversion: 2.20 time: 0.216957 Sep 13 18:04:06.369460 dv-cinder-852009-8-iscsi devstack@n-api.service[120741]: [pid: 120741|app: 0|req: 138/284] 10.222.0.43 () {60 vars in 1277 bytes} [Tue Sep 13 18:04:06 2022] GET /compute/v2.1/servers/11d2616a-96f9-4a7a-aab8-219219986a8b => generated 1738 bytes in 233 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Sep 13 18:04:06.531074 dv-cinder-852009-8-iscsi devstack@n-api.service[120740]: DEBUG nova.api.openstack.wsgi [req-c7a73b07-fa35-4bd7-a449-0663a6e7df2c req-6a35594d-abca-49df-ad39-a7e0f27bbe28 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "e8ce7158-6b73-4586-9f78-8e821988e71c", "name": "network-vif-plugged", "status": "completed", "tag": "ea32c59b-537c-405f-b361-3a6b70e328d4"}]} {{(pid=120740) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 13 18:04:06.540827 dv-cinder-852009-8-iscsi devstack@n-api.service[120740]: DEBUG oslo_concurrency.lockutils [req-c7a73b07-fa35-4bd7-a449-0663a6e7df2c req-6a35594d-abca-49df-ad39-a7e0f27bbe28 service nova] Acquiring lock "1daf4f4c-0e4a-4779-b53a-78c48397ea2f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120740) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 18:04:06.541285 dv-cinder-852009-8-iscsi devstack@n-api.service[120740]: DEBUG oslo_concurrency.lockutils [req-c7a73b07-fa35-4bd7-a449-0663a6e7df2c req-6a35594d-abca-49df-ad39-a7e0f27bbe28 service nova] Lock "1daf4f4c-0e4a-4779-b53a-78c48397ea2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120740) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 18:04:06.541738 dv-cinder-852009-8-iscsi devstack@n-api.service[120740]: DEBUG oslo_concurrency.lockutils [req-c7a73b07-fa35-4bd7-a449-0663a6e7df2c req-6a35594d-abca-49df-ad39-a7e0f27bbe28 service nova] Lock "1daf4f4c-0e4a-4779-b53a-78c48397ea2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120740) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 18:04:06.702807 dv-cinder-852009-8-iscsi devstack@n-api.service[120740]: INFO nova.api.openstack.compute.server_external_events [req-c7a73b07-fa35-4bd7-a449-0663a6e7df2c req-6a35594d-abca-49df-ad39-a7e0f27bbe28 service nova] Creating event network-vif-plugged:ea32c59b-537c-405f-b361-3a6b70e328d4 for instance e8ce7158-6b73-4586-9f78-8e821988e71c on hv-cinder-85200 Sep 13 18:04:06.707735 dv-cinder-852009-8-iscsi devstack@n-api.service[120740]: INFO nova.api.openstack.requestlog [req-c7a73b07-fa35-4bd7-a449-0663a6e7df2c req-6a35594d-abca-49df-ad39-a7e0f27bbe28 service nova] 10.222.0.43 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.180604 Sep 13 18:04:06.708725 dv-cinder-852009-8-iscsi devstack@n-api.service[120740]: [pid: 120740|app: 0|req: 147/285] 10.222.0.43 () {64 vars in 1317 bytes} [Tue Sep 13 18:04:06 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 182 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Sep 13 18:04:06.846826 dv-cinder-852009-8-iscsi devstack@n-api.service[120741]: DEBUG nova.api.openstack.wsgi [None req-c1a18fd1-6c01-4361-8e7e-67c7434ac1dc tempest-AttachVolumeTestJSON-555093534 tempest-AttachVolumeTestJSON-555093534-project] Calling method '>' {{(pid=120741) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 18:04:06.847440 dv-cinder-852009-8-iscsi devstack@n-api.service[120741]: DEBUG nova.compute.api [None req-c1a18fd1-6c01-4361-8e7e-67c7434ac1dc tempest-AttachVolumeTestJSON-555093534 tempest-AttachVolumeTestJSON-555093534-project] [instance: b958d409-df20-44c6-aa0e-58cb0a482edf] Fetching instance by UUID {{(pid=120741) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 18:04:06.854681 dv-cinder-852009-8-iscsi devstack@n-api.service[120741]: DEBUG oslo_concurrency.lockutils [None req-c1a18fd1-6c01-4361-8e7e-67c7434ac1dc tempest-AttachVolumeTestJSON-555093534 tempest-AttachVolumeTestJSON-555093534-project] Acquiring lock "1daf4f4c-0e4a-4779-b53a-78c48397ea2f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120741) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 18:04:06.855465 dv-cinder-852009-8-iscsi devstack@n-api.service[120741]: DEBUG oslo_concurrency.lockutils [None req-c1a18fd1-6c01-4361-8e7e-67c7434ac1dc tempest-AttachVolumeTestJSON-555093534 tempest-AttachVolumeTestJSON-555093534-project] Lock "1daf4f4c-0e4a-4779-b53a-78c48397ea2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120741) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 18:04:06.863305 dv-cinder-852009-8-iscsi devstack@n-api.service[120741]: DEBUG oslo_concurrency.lockutils [None req-c1a18fd1-6c01-4361-8e7e-67c7434ac1dc tempest-AttachVolumeTestJSON-555093534 tempest-AttachVolumeTestJSON-555093534-project] Lock "1daf4f4c-0e4a-4779-b53a-78c48397ea2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120741) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 18:04:06.865494 dv-cinder-852009-8-iscsi devstack@n-api.service[120741]: DEBUG oslo_concurrency.lockutils [None req-c1a18fd1-6c01-4361-8e7e-67c7434ac1dc tempest-AttachVolumeTestJSON-555093534 tempest-AttachVolumeTestJSON-555093534-project] Acquiring lock "1daf4f4c-0e4a-4779-b53a-78c48397ea2f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120741) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 18:04:06.866075 dv-cinder-852009-8-iscsi devstack@n-api.service[120741]: DEBUG oslo_concurrency.lockutils [None req-c1a18fd1-6c01-4361-8e7e-67c7434ac1dc tempest-AttachVolumeTestJSON-555093534 tempest-AttachVolumeTestJSON-555093534-project] Lock "1daf4f4c-0e4a-4779-b53a-78c48397ea2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120741) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 18:04:06.866804 dv-cinder-852009-8-iscsi devstack@n-api.service[120741]: DEBUG oslo_concurrency.lockutils [None req-c1a18fd1-6c01-4361-8e7e-67c7434ac1dc tempest-AttachVolumeTestJSON-555093534 tempest-AttachVolumeTestJSON-555093534-project] Lock "1daf4f4c-0e4a-4779-b53a-78c48397ea2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120741) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 18:04:06.880052 dv-cinder-852009-8-iscsi devstack@n-api.service[120740]: DEBUG nova.api.openstack.wsgi [None req-0b5213aa-09a8-43ad-a37a-25f8b6061c06 tempest-ServerRescueNegativeTestJSON-412251590 tempest-ServerRescueNegativeTestJSON-412251590-project] Calling method '>' {{(pid=120740) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 18:04:06.880797 dv-cinder-852009-8-iscsi devstack@n-api.service[120740]: DEBUG nova.compute.api [None req-0b5213aa-09a8-43ad-a37a-25f8b6061c06 tempest-ServerRescueNegativeTestJSON-412251590 tempest-ServerRescueNegativeTestJSON-412251590-project] [instance: e8ce7158-6b73-4586-9f78-8e821988e71c] Fetching instance by UUID {{(pid=120740) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 18:04:06.900318 dv-cinder-852009-8-iscsi devstack@n-api.service[120740]: DEBUG oslo_concurrency.lockutils [None req-0b5213aa-09a8-43ad-a37a-25f8b6061c06 tempest-ServerRescueNegativeTestJSON-412251590 tempest-ServerRescueNegativeTestJSON-412251590-project] Acquiring lock "1daf4f4c-0e4a-4779-b53a-78c48397ea2f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120740) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 18:04:06.902384 dv-cinder-852009-8-iscsi devstack@n-api.service[120740]: DEBUG oslo_concurrency.lockutils [None req-0b5213aa-09a8-43ad-a37a-25f8b6061c06 tempest-ServerRescueNegativeTestJSON-412251590 tempest-ServerRescueNegativeTestJSON-412251590-project] Lock "1daf4f4c-0e4a-4779-b53a-78c48397ea2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.008s {{(pid=120740) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 18:04:06.903681 dv-cinder-852009-8-iscsi devstack@n-api.service[120740]: DEBUG oslo_concurrency.lockutils [None req-0b5213aa-09a8-43ad-a37a-25f8b6061c06 tempest-ServerRescueNegativeTestJSON-412251590 tempest-ServerRescueNegativeTestJSON-412251590-project] Lock "1daf4f4c-0e4a-4779-b53a-78c48397ea2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120740) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 18:04:06.906450 dv-cinder-852009-8-iscsi devstack@n-api.service[120740]: DEBUG oslo_concurrency.lockutils [None req-0b5213aa-09a8-43ad-a37a-25f8b6061c06 tempest-ServerRescueNegativeTestJSON-412251590 tempest-ServerRescueNegativeTestJSON-412251590-project] Acquiring lock "1daf4f4c-0e4a-4779-b53a-78c48397ea2f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120740) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 18:04:06.907189 dv-cinder-852009-8-iscsi devstack@n-api.service[120740]: DEBUG oslo_concurrency.lockutils [None req-0b5213aa-09a8-43ad-a37a-25f8b6061c06 tempest-ServerRescueNegativeTestJSON-412251590 tempest-ServerRescueNegativeTestJSON-412251590-project] Lock "1daf4f4c-0e4a-4779-b53a-78c48397ea2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120740) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 18:04:06.908658 dv-cinder-852009-8-iscsi devstack@n-api.service[120740]: DEBUG oslo_concurrency.lockutils [None req-0b5213aa-09a8-43ad-a37a-25f8b6061c06 tempest-ServerRescueNegativeTestJSON-412251590 tempest-ServerRescueNegativeTestJSON-412251590-project] Lock "1daf4f4c-0e4a-4779-b53a-78c48397ea2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120740) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 18:04:07.174936 dv-cinder-852009-8-iscsi devstack@n-api.service[120741]: DEBUG nova.policy [None req-c1a18fd1-6c01-4361-8e7e-67c7434ac1dc tempest-AttachVolumeTestJSON-555093534 tempest-AttachVolumeTestJSON-555093534-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0625b3113ce044bbac4f6142eaade11c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a279fcbf274c4704a31a2b95061e1469', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120741) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 18:04:07.185834 dv-cinder-852009-8-iscsi devstack@n-api.service[120741]: INFO nova.api.openstack.requestlog [None req-c1a18fd1-6c01-4361-8e7e-67c7434ac1dc tempest-AttachVolumeTestJSON-555093534 tempest-AttachVolumeTestJSON-555093534-project] 10.222.0.43 "GET /compute/v2.1/servers/b958d409-df20-44c6-aa0e-58cb0a482edf" status: 200 len: 1724 microversion: 2.1 time: 0.345206 Sep 13 18:04:07.187316 dv-cinder-852009-8-iscsi devstack@n-api.service[120741]: [pid: 120741|app: 0|req: 139/286] 10.222.0.43 () {58 vars in 1236 bytes} [Tue Sep 13 18:04:06 2022] GET /compute/v2.1/servers/b958d409-df20-44c6-aa0e-58cb0a482edf => generated 1724 bytes in 354 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 13 18:04:07.243559 dv-cinder-852009-8-iscsi devstack@n-api.service[120740]: DEBUG nova.policy [None req-0b5213aa-09a8-43ad-a37a-25f8b6061c06 tempest-ServerRescueNegativeTestJSON-412251590 tempest-ServerRescueNegativeTestJSON-412251590-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '60800cf2774e409d9c1b6f4992669991', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2eae4acecf6c4961830ead78d71b2ad3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120740) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 18:04:07.251467 dv-cinder-852009-8-iscsi devstack@n-api.service[120741]: DEBUG nova.api.openstack.wsgi [None req-7523eeb9-3a5c-42d9-a7db-be84955fa414 tempest-TestShelveInstance-6258502 tempest-TestShelveInstance-6258502-project] Calling method '>' {{(pid=120741) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 18:04:07.252414 dv-cinder-852009-8-iscsi devstack@n-api.service[120741]: DEBUG nova.compute.api [None req-7523eeb9-3a5c-42d9-a7db-be84955fa414 tempest-TestShelveInstance-6258502 tempest-TestShelveInstance-6258502-project] [instance: 2d60cc6d-a699-417d-aa20-fe3e1bfc351e] Fetching instance by UUID {{(pid=120741) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 18:04:07.260524 dv-cinder-852009-8-iscsi devstack@n-api.service[120740]: INFO nova.api.openstack.requestlog [None req-0b5213aa-09a8-43ad-a37a-25f8b6061c06 tempest-ServerRescueNegativeTestJSON-412251590 tempest-ServerRescueNegativeTestJSON-412251590-project] 10.222.0.43 "GET /compute/v2.1/servers/e8ce7158-6b73-4586-9f78-8e821988e71c" status: 200 len: 1371 microversion: 2.1 time: 0.384818 Sep 13 18:04:07.261979 dv-cinder-852009-8-iscsi devstack@n-api.service[120741]: DEBUG oslo_concurrency.lockutils [None req-7523eeb9-3a5c-42d9-a7db-be84955fa414 tempest-TestShelveInstance-6258502 tempest-TestShelveInstance-6258502-project] Acquiring lock "1daf4f4c-0e4a-4779-b53a-78c48397ea2f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120741) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 18:04:07.265386 dv-cinder-852009-8-iscsi devstack@n-api.service[120741]: DEBUG oslo_concurrency.lockutils [None req-7523eeb9-3a5c-42d9-a7db-be84955fa414 tempest-TestShelveInstance-6258502 tempest-TestShelveInstance-6258502-project] Lock "1daf4f4c-0e4a-4779-b53a-78c48397ea2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120741) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 18:04:07.266117 dv-cinder-852009-8-iscsi devstack@n-api.service[120741]: DEBUG oslo_concurrency.lockutils [None req-7523eeb9-3a5c-42d9-a7db-be84955fa414 tempest-TestShelveInstance-6258502 tempest-TestShelveInstance-6258502-project] Lock "1daf4f4c-0e4a-4779-b53a-78c48397ea2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120741) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 18:04:07.266863 dv-cinder-852009-8-iscsi devstack@n-api.service[120741]: DEBUG oslo_concurrency.lockutils [None req-7523eeb9-3a5c-42d9-a7db-be84955fa414 tempest-TestShelveInstance-6258502 tempest-TestShelveInstance-6258502-project] Acquiring lock "1daf4f4c-0e4a-4779-b53a-78c48397ea2f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120741) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 18:04:07.267320 dv-cinder-852009-8-iscsi devstack@n-api.service[120741]: DEBUG oslo_concurrency.lockutils [None req-7523eeb9-3a5c-42d9-a7db-be84955fa414 tempest-TestShelveInstance-6258502 tempest-TestShelveInstance-6258502-project] Lock "1daf4f4c-0e4a-4779-b53a-78c48397ea2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120741) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 18:04:07.267733 dv-cinder-852009-8-iscsi devstack@n-api.service[120741]: DEBUG oslo_concurrency.lockutils [None req-7523eeb9-3a5c-42d9-a7db-be84955fa414 tempest-TestShelveInstance-6258502 tempest-TestShelveInstance-6258502-project] Lock "1daf4f4c-0e4a-4779-b53a-78c48397ea2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120741) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 18:04:07.268793 dv-cinder-852009-8-iscsi devstack@n-api.service[120740]: [pid: 120740|app: 0|req: 148/287] 10.222.0.43 () {58 vars in 1236 bytes} [Tue Sep 13 18:04:06 2022] GET /compute/v2.1/servers/e8ce7158-6b73-4586-9f78-8e821988e71c => generated 1371 bytes in 394 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 13 18:04:07.351658 dv-cinder-852009-8-iscsi devstack@n-api.service[120741]: DEBUG dbcounter [-] [120741] Writing DB stats nova_cell0:SELECT=2 {{(pid=120741) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 18:04:07.384541 dv-cinder-852009-8-iscsi devstack@n-api.service[120740]: DEBUG nova.api.openstack.wsgi [None req-b6abeedd-53ce-4e18-8ef1-5348921b2fb8 tempest-AttachVolumeShelveTestJSON-385853788 tempest-AttachVolumeShelveTestJSON-385853788-project] Calling method '>' {{(pid=120740) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 18:04:07.385558 dv-cinder-852009-8-iscsi devstack@n-api.service[120740]: DEBUG nova.compute.api [None req-b6abeedd-53ce-4e18-8ef1-5348921b2fb8 tempest-AttachVolumeShelveTestJSON-385853788 tempest-AttachVolumeShelveTestJSON-385853788-project] [instance: 11d2616a-96f9-4a7a-aab8-219219986a8b] Fetching instance by UUID {{(pid=120740) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 18:04:07.392665 dv-cinder-852009-8-iscsi devstack@n-api.service[120740]: DEBUG oslo_concurrency.lockutils [None req-b6abeedd-53ce-4e18-8ef1-5348921b2fb8 tempest-AttachVolumeShelveTestJSON-385853788 tempest-AttachVolumeShelveTestJSON-385853788-project] Acquiring lock "1daf4f4c-0e4a-4779-b53a-78c48397ea2f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120740) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 18:04:07.393543 dv-cinder-852009-8-iscsi devstack@n-api.service[120740]: DEBUG oslo_concurrency.lockutils [None req-b6abeedd-53ce-4e18-8ef1-5348921b2fb8 tempest-AttachVolumeShelveTestJSON-385853788 tempest-AttachVolumeShelveTestJSON-385853788-project] Lock "1daf4f4c-0e4a-4779-b53a-78c48397ea2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120740) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 18:04:07.394206 dv-cinder-852009-8-iscsi devstack@n-api.service[120740]: DEBUG oslo_concurrency.lockutils [None req-b6abeedd-53ce-4e18-8ef1-5348921b2fb8 tempest-AttachVolumeShelveTestJSON-385853788 tempest-AttachVolumeShelveTestJSON-385853788-project] Lock "1daf4f4c-0e4a-4779-b53a-78c48397ea2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120740) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 18:04:07.395139 dv-cinder-852009-8-iscsi devstack@n-api.service[120740]: DEBUG oslo_concurrency.lockutils [None req-b6abeedd-53ce-4e18-8ef1-5348921b2fb8 tempest-AttachVolumeShelveTestJSON-385853788 tempest-AttachVolumeShelveTestJSON-385853788-project] Acquiring lock "1daf4f4c-0e4a-4779-b53a-78c48397ea2f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120740) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 18:04:07.395818 dv-cinder-852009-8-iscsi devstack@n-api.service[120740]: DEBUG oslo_concurrency.lockutils [None req-b6abeedd-53ce-4e18-8ef1-5348921b2fb8 tempest-AttachVolumeShelveTestJSON-385853788 tempest-AttachVolumeShelveTestJSON-385853788-project] Lock "1daf4f4c-0e4a-4779-b53a-78c48397ea2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120740) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 18:04:07.396535 dv-cinder-852009-8-iscsi devstack@n-api.service[120740]: DEBUG oslo_concurrency.lockutils [None req-b6abeedd-53ce-4e18-8ef1-5348921b2fb8 tempest-AttachVolumeShelveTestJSON-385853788 tempest-AttachVolumeShelveTestJSON-385853788-project] Lock "1daf4f4c-0e4a-4779-b53a-78c48397ea2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120740) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 18:04:07.492935 dv-cinder-852009-8-iscsi devstack@n-api.service[120741]: DEBUG nova.policy [None req-7523eeb9-3a5c-42d9-a7db-be84955fa414 tempest-TestShelveInstance-6258502 tempest-TestShelveInstance-6258502-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2ab9930d6ce54cacbb3d4fd6313294d5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5eafd54351bd4049b87ad308a3638f80', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120741) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 18:04:07.505855 dv-cinder-852009-8-iscsi devstack@n-api.service[120741]: INFO nova.api.openstack.requestlog [None req-7523eeb9-3a5c-42d9-a7db-be84955fa414 tempest-TestShelveInstance-6258502 tempest-TestShelveInstance-6258502-project] 10.222.0.43 "GET /compute/v2.1/servers/2d60cc6d-a699-417d-aa20-fe3e1bfc351e" status: 200 len: 1261 microversion: 2.1 time: 0.257088 Sep 13 18:04:07.517322 dv-cinder-852009-8-iscsi devstack@n-api.service[120741]: [pid: 120741|app: 0|req: 140/288] 10.222.0.43 () {58 vars in 1236 bytes} [Tue Sep 13 18:04:07 2022] GET /compute/v2.1/servers/2d60cc6d-a699-417d-aa20-fe3e1bfc351e => generated 1261 bytes in 270 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 13 18:04:07.582544 dv-cinder-852009-8-iscsi devstack@n-api.service[120740]: DEBUG nova.policy [None req-b6abeedd-53ce-4e18-8ef1-5348921b2fb8 tempest-AttachVolumeShelveTestJSON-385853788 tempest-AttachVolumeShelveTestJSON-385853788-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e68ecd9b3ca643539b109f75bb242d6f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '75e14fd88bfb4cd896fa7b070a0fac47', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120740) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 18:04:07.593254 dv-cinder-852009-8-iscsi devstack@n-api.service[120740]: DEBUG nova.policy [None req-b6abeedd-53ce-4e18-8ef1-5348921b2fb8 tempest-AttachVolumeShelveTestJSON-385853788 tempest-AttachVolumeShelveTestJSON-385853788-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'e68ecd9b3ca643539b109f75bb242d6f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '75e14fd88bfb4cd896fa7b070a0fac47', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120740) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 18:04:07.594714 dv-cinder-852009-8-iscsi devstack@n-api.service[120740]: DEBUG nova.policy [None req-b6abeedd-53ce-4e18-8ef1-5348921b2fb8 tempest-AttachVolumeShelveTestJSON-385853788 tempest-AttachVolumeShelveTestJSON-385853788-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'e68ecd9b3ca643539b109f75bb242d6f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '75e14fd88bfb4cd896fa7b070a0fac47', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120740) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 18:04:07.595879 dv-cinder-852009-8-iscsi devstack@n-api.service[120740]: INFO nova.api.openstack.requestlog [None req-b6abeedd-53ce-4e18-8ef1-5348921b2fb8 tempest-AttachVolumeShelveTestJSON-385853788 tempest-AttachVolumeShelveTestJSON-385853788-project] 10.222.0.43 "GET /compute/v2.1/servers/11d2616a-96f9-4a7a-aab8-219219986a8b" status: 200 len: 1738 microversion: 2.20 time: 0.217023 Sep 13 18:04:07.596497 dv-cinder-852009-8-iscsi devstack@n-api.service[120740]: [pid: 120740|app: 0|req: 149/289] 10.222.0.43 () {60 vars in 1277 bytes} [Tue Sep 13 18:04:07 2022] GET /compute/v2.1/servers/11d2616a-96f9-4a7a-aab8-219219986a8b => generated 1738 bytes in 219 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 13 18:04:08.213497 dv-cinder-852009-8-iscsi devstack@n-api.service[120741]: DEBUG nova.api.openstack.wsgi [None req-4b45c5d3-abd7-4b75-b14f-625bb1d1b0fa tempest-AttachVolumeTestJSON-555093534 tempest-AttachVolumeTestJSON-555093534-project] Calling method '>' {{(pid=120741) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 18:04:08.214263 dv-cinder-852009-8-iscsi devstack@n-api.service[120741]: DEBUG nova.compute.api [None req-4b45c5d3-abd7-4b75-b14f-625bb1d1b0fa tempest-AttachVolumeTestJSON-555093534 tempest-AttachVolumeTestJSON-555093534-project] [instance: b958d409-df20-44c6-aa0e-58cb0a482edf] Fetching instance by UUID {{(pid=120741) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 18:04:08.221677 dv-cinder-852009-8-iscsi devstack@n-api.service[120741]: DEBUG oslo_concurrency.lockutils [None req-4b45c5d3-abd7-4b75-b14f-625bb1d1b0fa tempest-AttachVolumeTestJSON-555093534 tempest-AttachVolumeTestJSON-555093534-project] Acquiring lock "1daf4f4c-0e4a-4779-b53a-78c48397ea2f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120741) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 18:04:08.223257 dv-cinder-852009-8-iscsi devstack@n-api.service[120741]: DEBUG oslo_concurrency.lockutils [None req-4b45c5d3-abd7-4b75-b14f-625bb1d1b0fa tempest-AttachVolumeTestJSON-555093534 tempest-AttachVolumeTestJSON-555093534-project] Lock "1daf4f4c-0e4a-4779-b53a-78c48397ea2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120741) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 18:04:08.223978 dv-cinder-852009-8-iscsi devstack@n-api.service[120741]: DEBUG oslo_concurrency.lockutils [None req-4b45c5d3-abd7-4b75-b14f-625bb1d1b0fa tempest-AttachVolumeTestJSON-555093534 tempest-AttachVolumeTestJSON-555093534-project] Lock "1daf4f4c-0e4a-4779-b53a-78c48397ea2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120741) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 18:04:08.225456 dv-cinder-852009-8-iscsi devstack@n-api.service[120741]: DEBUG oslo_concurrency.lockutils [None req-4b45c5d3-abd7-4b75-b14f-625bb1d1b0fa tempest-AttachVolumeTestJSON-555093534 tempest-AttachVolumeTestJSON-555093534-project] Acquiring lock "1daf4f4c-0e4a-4779-b53a-78c48397ea2f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120741) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 18:04:08.226768 dv-cinder-852009-8-iscsi devstack@n-api.service[120741]: DEBUG oslo_concurrency.lockutils [None req-4b45c5d3-abd7-4b75-b14f-625bb1d1b0fa tempest-AttachVolumeTestJSON-555093534 tempest-AttachVolumeTestJSON-555093534-project] Lock "1daf4f4c-0e4a-4779-b53a-78c48397ea2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120741) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 18:04:08.227468 dv-cinder-852009-8-iscsi devstack@n-api.service[120741]: DEBUG oslo_concurrency.lockutils [None req-4b45c5d3-abd7-4b75-b14f-625bb1d1b0fa tempest-AttachVolumeTestJSON-555093534 tempest-AttachVolumeTestJSON-555093534-project] Lock "1daf4f4c-0e4a-4779-b53a-78c48397ea2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120741) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 18:04:08.281308 dv-cinder-852009-8-iscsi devstack@n-api.service[120740]: DEBUG dbcounter [-] [120740] Writing DB stats nova_cell0:SELECT=2 {{(pid=120740) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 18:04:08.283232 dv-cinder-852009-8-iscsi devstack@n-api.service[120740]: DEBUG dbcounter [-] [120740] Writing DB stats nova_cell0:SELECT=6 {{(pid=120740) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 18:04:08.288653 dv-cinder-852009-8-iscsi devstack@n-api.service[120740]: DEBUG nova.api.openstack.wsgi [None req-08c3a82e-8f28-43b9-9531-ee9e55c95d20 tempest-ServerRescueNegativeTestJSON-412251590 tempest-ServerRescueNegativeTestJSON-412251590-project] Calling method '>' {{(pid=120740) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 18:04:08.289656 dv-cinder-852009-8-iscsi devstack@n-api.service[120740]: DEBUG nova.compute.api [None req-08c3a82e-8f28-43b9-9531-ee9e55c95d20 tempest-ServerRescueNegativeTestJSON-412251590 tempest-ServerRescueNegativeTestJSON-412251590-project] [instance: e8ce7158-6b73-4586-9f78-8e821988e71c] Fetching instance by UUID {{(pid=120740) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 18:04:08.297612 dv-cinder-852009-8-iscsi devstack@n-api.service[120740]: DEBUG oslo_concurrency.lockutils [None req-08c3a82e-8f28-43b9-9531-ee9e55c95d20 tempest-ServerRescueNegativeTestJSON-412251590 tempest-ServerRescueNegativeTestJSON-412251590-project] Acquiring lock "1daf4f4c-0e4a-4779-b53a-78c48397ea2f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120740) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 18:04:08.298376 dv-cinder-852009-8-iscsi devstack@n-api.service[120740]: DEBUG oslo_concurrency.lockutils [None req-08c3a82e-8f28-43b9-9531-ee9e55c95d20 tempest-ServerRescueNegativeTestJSON-412251590 tempest-ServerRescueNegativeTestJSON-412251590-project] Lock "1daf4f4c-0e4a-4779-b53a-78c48397ea2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120740) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 18:04:08.299108 dv-cinder-852009-8-iscsi devstack@n-api.service[120740]: DEBUG oslo_concurrency.lockutils [None req-08c3a82e-8f28-43b9-9531-ee9e55c95d20 tempest-ServerRescueNegativeTestJSON-412251590 tempest-ServerRescueNegativeTestJSON-412251590-project] Lock "1daf4f4c-0e4a-4779-b53a-78c48397ea2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120740) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 18:04:08.299889 dv-cinder-852009-8-iscsi devstack@n-api.service[120740]: DEBUG oslo_concurrency.lockutils [None req-08c3a82e-8f28-43b9-9531-ee9e55c95d20 tempest-ServerRescueNegativeTestJSON-412251590 tempest-ServerRescueNegativeTestJSON-412251590-project] Acquiring lock "1daf4f4c-0e4a-4779-b53a-78c48397ea2f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120740) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 18:04:08.301140 dv-cinder-852009-8-iscsi devstack@n-api.service[120740]: DEBUG oslo_concurrency.lockutils [None req-08c3a82e-8f28-43b9-9531-ee9e55c95d20 tempest-ServerRescueNegativeTestJSON-412251590 tempest-ServerRescueNegativeTestJSON-412251590-project] Lock "1daf4f4c-0e4a-4779-b53a-78c48397ea2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120740) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 18:04:08.301140 dv-cinder-852009-8-iscsi devstack@n-api.service[120740]: DEBUG oslo_concurrency.lockutils [None req-08c3a82e-8f28-43b9-9531-ee9e55c95d20 tempest-ServerRescueNegativeTestJSON-412251590 tempest-ServerRescueNegativeTestJSON-412251590-project] Lock "1daf4f4c-0e4a-4779-b53a-78c48397ea2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120740) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 18:04:08.332076 dv-cinder-852009-8-iscsi devstack@n-api.service[120740]: DEBUG dbcounter [-] [120740] Writing DB stats nova_cell1:SELECT=100 {{(pid=120740) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 18:04:08.427803 dv-cinder-852009-8-iscsi devstack@n-api.service[120741]: DEBUG dbcounter [-] [120741] Writing DB stats nova_cell0:SELECT=14 {{(pid=120741) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 18:04:08.480191 dv-cinder-852009-8-iscsi devstack@n-api.service[120741]: DEBUG nova.policy [None req-4b45c5d3-abd7-4b75-b14f-625bb1d1b0fa tempest-AttachVolumeTestJSON-555093534 tempest-AttachVolumeTestJSON-555093534-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0625b3113ce044bbac4f6142eaade11c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a279fcbf274c4704a31a2b95061e1469', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120741) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 18:04:08.484617 dv-cinder-852009-8-iscsi devstack@n-api.service[120741]: INFO nova.api.openstack.requestlog [None req-4b45c5d3-abd7-4b75-b14f-625bb1d1b0fa tempest-AttachVolumeTestJSON-555093534 tempest-AttachVolumeTestJSON-555093534-project] 10.222.0.43 "GET /compute/v2.1/servers/b958d409-df20-44c6-aa0e-58cb0a482edf" status: 200 len: 1724 microversion: 2.1 time: 0.276176 Sep 13 18:04:08.485554 dv-cinder-852009-8-iscsi devstack@n-api.service[120741]: [pid: 120741|app: 0|req: 141/290] 10.222.0.43 () {58 vars in 1236 bytes} [Tue Sep 13 18:04:08 2022] GET /compute/v2.1/servers/b958d409-df20-44c6-aa0e-58cb0a482edf => generated 1724 bytes in 278 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 13 18:04:08.510146 dv-cinder-852009-8-iscsi devstack@n-api.service[120740]: DEBUG nova.policy [None req-08c3a82e-8f28-43b9-9531-ee9e55c95d20 tempest-ServerRescueNegativeTestJSON-412251590 tempest-ServerRescueNegativeTestJSON-412251590-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '60800cf2774e409d9c1b6f4992669991', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2eae4acecf6c4961830ead78d71b2ad3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120740) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 18:04:08.519371 dv-cinder-852009-8-iscsi devstack@n-api.service[120740]: INFO nova.api.openstack.requestlog [None req-08c3a82e-8f28-43b9-9531-ee9e55c95d20 tempest-ServerRescueNegativeTestJSON-412251590 tempest-ServerRescueNegativeTestJSON-412251590-project] 10.222.0.43 "GET /compute/v2.1/servers/e8ce7158-6b73-4586-9f78-8e821988e71c" status: 200 len: 1371 microversion: 2.1 time: 0.239213 Sep 13 18:04:08.520303 dv-cinder-852009-8-iscsi devstack@n-api.service[120740]: [pid: 120740|app: 0|req: 150/291] 10.222.0.43 () {58 vars in 1236 bytes} [Tue Sep 13 18:04:08 2022] GET /compute/v2.1/servers/e8ce7158-6b73-4586-9f78-8e821988e71c => generated 1371 bytes in 241 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 13 18:04:08.533269 dv-cinder-852009-8-iscsi devstack@n-api.service[120741]: DEBUG nova.api.openstack.wsgi [None req-948b714d-d09c-43f0-94d4-ddc057253421 tempest-TestShelveInstance-6258502 tempest-TestShelveInstance-6258502-project] Calling method '>' {{(pid=120741) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 18:04:08.533887 dv-cinder-852009-8-iscsi devstack@n-api.service[120741]: DEBUG nova.compute.api [None req-948b714d-d09c-43f0-94d4-ddc057253421 tempest-TestShelveInstance-6258502 tempest-TestShelveInstance-6258502-project] [instance: 2d60cc6d-a699-417d-aa20-fe3e1bfc351e] Fetching instance by UUID {{(pid=120741) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 18:04:08.540656 dv-cinder-852009-8-iscsi devstack@n-api.service[120741]: DEBUG oslo_concurrency.lockutils [None req-948b714d-d09c-43f0-94d4-ddc057253421 tempest-TestShelveInstance-6258502 tempest-TestShelveInstance-6258502-project] Acquiring lock "1daf4f4c-0e4a-4779-b53a-78c48397ea2f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120741) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 18:04:08.541266 dv-cinder-852009-8-iscsi devstack@n-api.service[120741]: DEBUG oslo_concurrency.lockutils [None req-948b714d-d09c-43f0-94d4-ddc057253421 tempest-TestShelveInstance-6258502 tempest-TestShelveInstance-6258502-project] Lock "1daf4f4c-0e4a-4779-b53a-78c48397ea2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120741) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 18:04:08.541713 dv-cinder-852009-8-iscsi devstack@n-api.service[120741]: DEBUG oslo_concurrency.lockutils [None req-948b714d-d09c-43f0-94d4-ddc057253421 tempest-TestShelveInstance-6258502 tempest-TestShelveInstance-6258502-project] Lock "1daf4f4c-0e4a-4779-b53a-78c48397ea2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120741) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 18:04:08.542611 dv-cinder-852009-8-iscsi devstack@n-api.service[120741]: DEBUG oslo_concurrency.lockutils [None req-948b714d-d09c-43f0-94d4-ddc057253421 tempest-TestShelveInstance-6258502 tempest-TestShelveInstance-6258502-project] Acquiring lock "1daf4f4c-0e4a-4779-b53a-78c48397ea2f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120741) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 18:04:08.543083 dv-cinder-852009-8-iscsi devstack@n-api.service[120741]: DEBUG oslo_concurrency.lockutils [None req-948b714d-d09c-43f0-94d4-ddc057253421 tempest-TestShelveInstance-6258502 tempest-TestShelveInstance-6258502-project] Lock "1daf4f4c-0e4a-4779-b53a-78c48397ea2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120741) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 18:04:08.543507 dv-cinder-852009-8-iscsi devstack@n-api.service[120741]: DEBUG oslo_concurrency.lockutils [None req-948b714d-d09c-43f0-94d4-ddc057253421 tempest-TestShelveInstance-6258502 tempest-TestShelveInstance-6258502-project] Lock "1daf4f4c-0e4a-4779-b53a-78c48397ea2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120741) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 18:04:08.621644 dv-cinder-852009-8-iscsi devstack@n-api.service[120740]: DEBUG nova.api.openstack.wsgi [None req-5017f967-7d8c-4a9e-9177-896cd0b3fef9 tempest-AttachVolumeShelveTestJSON-385853788 tempest-AttachVolumeShelveTestJSON-385853788-project] Calling method '>' {{(pid=120740) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 18:04:08.622692 dv-cinder-852009-8-iscsi devstack@n-api.service[120740]: DEBUG nova.compute.api [None req-5017f967-7d8c-4a9e-9177-896cd0b3fef9 tempest-AttachVolumeShelveTestJSON-385853788 tempest-AttachVolumeShelveTestJSON-385853788-project] [instance: 11d2616a-96f9-4a7a-aab8-219219986a8b] Fetching instance by UUID {{(pid=120740) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 18:04:08.629726 dv-cinder-852009-8-iscsi devstack@n-api.service[120740]: DEBUG oslo_concurrency.lockutils [None req-5017f967-7d8c-4a9e-9177-896cd0b3fef9 tempest-AttachVolumeShelveTestJSON-385853788 tempest-AttachVolumeShelveTestJSON-385853788-project] Acquiring lock "1daf4f4c-0e4a-4779-b53a-78c48397ea2f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120740) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 18:04:08.630205 dv-cinder-852009-8-iscsi devstack@n-api.service[120740]: DEBUG oslo_concurrency.lockutils [None req-5017f967-7d8c-4a9e-9177-896cd0b3fef9 tempest-AttachVolumeShelveTestJSON-385853788 tempest-AttachVolumeShelveTestJSON-385853788-project] Lock "1daf4f4c-0e4a-4779-b53a-78c48397ea2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120740) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 18:04:08.630632 dv-cinder-852009-8-iscsi devstack@n-api.service[120740]: DEBUG oslo_concurrency.lockutils [None req-5017f967-7d8c-4a9e-9177-896cd0b3fef9 tempest-AttachVolumeShelveTestJSON-385853788 tempest-AttachVolumeShelveTestJSON-385853788-project] Lock "1daf4f4c-0e4a-4779-b53a-78c48397ea2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120740) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 18:04:08.631581 dv-cinder-852009-8-iscsi devstack@n-api.service[120740]: DEBUG oslo_concurrency.lockutils [None req-5017f967-7d8c-4a9e-9177-896cd0b3fef9 tempest-AttachVolumeShelveTestJSON-385853788 tempest-AttachVolumeShelveTestJSON-385853788-project] Acquiring lock "1daf4f4c-0e4a-4779-b53a-78c48397ea2f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120740) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 18:04:08.632794 dv-cinder-852009-8-iscsi devstack@n-api.service[120740]: DEBUG oslo_concurrency.lockutils [None req-5017f967-7d8c-4a9e-9177-896cd0b3fef9 tempest-AttachVolumeShelveTestJSON-385853788 tempest-AttachVolumeShelveTestJSON-385853788-project] Lock "1daf4f4c-0e4a-4779-b53a-78c48397ea2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120740) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 18:04:08.633586 dv-cinder-852009-8-iscsi devstack@n-api.service[120740]: DEBUG oslo_concurrency.lockutils [None req-5017f967-7d8c-4a9e-9177-896cd0b3fef9 tempest-AttachVolumeShelveTestJSON-385853788 tempest-AttachVolumeShelveTestJSON-385853788-project] Lock "1daf4f4c-0e4a-4779-b53a-78c48397ea2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120740) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 18:04:08.703086 dv-cinder-852009-8-iscsi devstack@n-api.service[120741]: DEBUG nova.policy [None req-948b714d-d09c-43f0-94d4-ddc057253421 tempest-TestShelveInstance-6258502 tempest-TestShelveInstance-6258502-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2ab9930d6ce54cacbb3d4fd6313294d5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5eafd54351bd4049b87ad308a3638f80', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120741) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 18:04:08.713502 dv-cinder-852009-8-iscsi devstack@n-api.service[120741]: INFO nova.api.openstack.requestlog [None req-948b714d-d09c-43f0-94d4-ddc057253421 tempest-TestShelveInstance-6258502 tempest-TestShelveInstance-6258502-project] 10.222.0.43 "GET /compute/v2.1/servers/2d60cc6d-a699-417d-aa20-fe3e1bfc351e" status: 200 len: 1261 microversion: 2.1 time: 0.184628 Sep 13 18:04:08.714755 dv-cinder-852009-8-iscsi devstack@n-api.service[120741]: [pid: 120741|app: 0|req: 142/292] 10.222.0.43 () {58 vars in 1236 bytes} [Tue Sep 13 18:04:08 2022] GET /compute/v2.1/servers/2d60cc6d-a699-417d-aa20-fe3e1bfc351e => generated 1261 bytes in 186 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 13 18:04:08.810795 dv-cinder-852009-8-iscsi devstack@n-api.service[120740]: DEBUG nova.policy [None req-5017f967-7d8c-4a9e-9177-896cd0b3fef9 tempest-AttachVolumeShelveTestJSON-385853788 tempest-AttachVolumeShelveTestJSON-385853788-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e68ecd9b3ca643539b109f75bb242d6f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '75e14fd88bfb4cd896fa7b070a0fac47', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120740) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 18:04:08.820299 dv-cinder-852009-8-iscsi devstack@n-api.service[120740]: DEBUG nova.policy [None req-5017f967-7d8c-4a9e-9177-896cd0b3fef9 tempest-AttachVolumeShelveTestJSON-385853788 tempest-AttachVolumeShelveTestJSON-385853788-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'e68ecd9b3ca643539b109f75bb242d6f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '75e14fd88bfb4cd896fa7b070a0fac47', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120740) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 18:04:08.822007 dv-cinder-852009-8-iscsi devstack@n-api.service[120740]: DEBUG nova.policy [None req-5017f967-7d8c-4a9e-9177-896cd0b3fef9 tempest-AttachVolumeShelveTestJSON-385853788 tempest-AttachVolumeShelveTestJSON-385853788-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'e68ecd9b3ca643539b109f75bb242d6f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '75e14fd88bfb4cd896fa7b070a0fac47', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120740) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 18:04:08.823211 dv-cinder-852009-8-iscsi devstack@n-api.service[120740]: INFO nova.api.openstack.requestlog [None req-5017f967-7d8c-4a9e-9177-896cd0b3fef9 tempest-AttachVolumeShelveTestJSON-385853788 tempest-AttachVolumeShelveTestJSON-385853788-project] 10.222.0.43 "GET /compute/v2.1/servers/11d2616a-96f9-4a7a-aab8-219219986a8b" status: 200 len: 1738 microversion: 2.20 time: 0.206225 Sep 13 18:04:08.823763 dv-cinder-852009-8-iscsi devstack@n-api.service[120740]: [pid: 120740|app: 0|req: 151/293] 10.222.0.43 () {60 vars in 1277 bytes} [Tue Sep 13 18:04:08 2022] GET /compute/v2.1/servers/11d2616a-96f9-4a7a-aab8-219219986a8b => generated 1738 bytes in 208 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Sep 13 18:04:09.510242 dv-cinder-852009-8-iscsi devstack@n-api.service[120741]: DEBUG nova.api.openstack.wsgi [None req-16dc14fc-4823-4df5-8666-c8895c299dbe tempest-AttachVolumeTestJSON-555093534 tempest-AttachVolumeTestJSON-555093534-project] Calling method '>' {{(pid=120741) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 18:04:09.510872 dv-cinder-852009-8-iscsi devstack@n-api.service[120741]: DEBUG nova.compute.api [None req-16dc14fc-4823-4df5-8666-c8895c299dbe tempest-AttachVolumeTestJSON-555093534 tempest-AttachVolumeTestJSON-555093534-project] [instance: b958d409-df20-44c6-aa0e-58cb0a482edf] Fetching instance by UUID {{(pid=120741) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 18:04:09.518307 dv-cinder-852009-8-iscsi devstack@n-api.service[120741]: DEBUG oslo_concurrency.lockutils [None req-16dc14fc-4823-4df5-8666-c8895c299dbe tempest-AttachVolumeTestJSON-555093534 tempest-AttachVolumeTestJSON-555093534-project] Acquiring lock "1daf4f4c-0e4a-4779-b53a-78c48397ea2f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120741) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 18:04:09.519087 dv-cinder-852009-8-iscsi devstack@n-api.service[120741]: DEBUG oslo_concurrency.lockutils [None req-16dc14fc-4823-4df5-8666-c8895c299dbe tempest-AttachVolumeTestJSON-555093534 tempest-AttachVolumeTestJSON-555093534-project] Lock "1daf4f4c-0e4a-4779-b53a-78c48397ea2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120741) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 18:04:09.519686 dv-cinder-852009-8-iscsi devstack@n-api.service[120741]: DEBUG oslo_concurrency.lockutils [None req-16dc14fc-4823-4df5-8666-c8895c299dbe tempest-AttachVolumeTestJSON-555093534 tempest-AttachVolumeTestJSON-555093534-project] Lock "1daf4f4c-0e4a-4779-b53a-78c48397ea2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120741) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 18:04:09.520660 dv-cinder-852009-8-iscsi devstack@n-api.service[120741]: DEBUG oslo_concurrency.lockutils [None req-16dc14fc-4823-4df5-8666-c8895c299dbe tempest-AttachVolumeTestJSON-555093534 tempest-AttachVolumeTestJSON-555093534-project] Acquiring lock "1daf4f4c-0e4a-4779-b53a-78c48397ea2f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120741) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 18:04:09.521256 dv-cinder-852009-8-iscsi devstack@n-api.service[120741]: DEBUG oslo_concurrency.lockutils [None req-16dc14fc-4823-4df5-8666-c8895c299dbe tempest-AttachVolumeTestJSON-555093534 tempest-AttachVolumeTestJSON-555093534-project] Lock "1daf4f4c-0e4a-4779-b53a-78c48397ea2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120741) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 18:04:09.521935 dv-cinder-852009-8-iscsi devstack@n-api.service[120741]: DEBUG oslo_concurrency.lockutils [None req-16dc14fc-4823-4df5-8666-c8895c299dbe tempest-AttachVolumeTestJSON-555093534 tempest-AttachVolumeTestJSON-555093534-project] Lock "1daf4f4c-0e4a-4779-b53a-78c48397ea2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120741) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 18:04:09.544415 dv-cinder-852009-8-iscsi devstack@n-api.service[120740]: DEBUG nova.api.openstack.wsgi [None req-e88fb9cf-fd82-46a1-9eab-26dd20c17fa9 tempest-ServerRescueNegativeTestJSON-412251590 tempest-ServerRescueNegativeTestJSON-412251590-project] Calling method '>' {{(pid=120740) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 18:04:09.545256 dv-cinder-852009-8-iscsi devstack@n-api.service[120740]: DEBUG nova.compute.api [None req-e88fb9cf-fd82-46a1-9eab-26dd20c17fa9 tempest-ServerRescueNegativeTestJSON-412251590 tempest-ServerRescueNegativeTestJSON-412251590-project] [instance: e8ce7158-6b73-4586-9f78-8e821988e71c] Fetching instance by UUID {{(pid=120740) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 18:04:09.555698 dv-cinder-852009-8-iscsi devstack@n-api.service[120740]: DEBUG oslo_concurrency.lockutils [None req-e88fb9cf-fd82-46a1-9eab-26dd20c17fa9 tempest-ServerRescueNegativeTestJSON-412251590 tempest-ServerRescueNegativeTestJSON-412251590-project] Acquiring lock "1daf4f4c-0e4a-4779-b53a-78c48397ea2f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120740) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 18:04:09.556253 dv-cinder-852009-8-iscsi devstack@n-api.service[120740]: DEBUG oslo_concurrency.lockutils [None req-e88fb9cf-fd82-46a1-9eab-26dd20c17fa9 tempest-ServerRescueNegativeTestJSON-412251590 tempest-ServerRescueNegativeTestJSON-412251590-project] Lock "1daf4f4c-0e4a-4779-b53a-78c48397ea2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120740) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 18:04:09.556711 dv-cinder-852009-8-iscsi devstack@n-api.service[120740]: DEBUG oslo_concurrency.lockutils [None req-e88fb9cf-fd82-46a1-9eab-26dd20c17fa9 tempest-ServerRescueNegativeTestJSON-412251590 tempest-ServerRescueNegativeTestJSON-412251590-project] Lock "1daf4f4c-0e4a-4779-b53a-78c48397ea2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120740) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 18:04:09.557411 dv-cinder-852009-8-iscsi devstack@n-api.service[120740]: DEBUG oslo_concurrency.lockutils [None req-e88fb9cf-fd82-46a1-9eab-26dd20c17fa9 tempest-ServerRescueNegativeTestJSON-412251590 tempest-ServerRescueNegativeTestJSON-412251590-project] Acquiring lock "1daf4f4c-0e4a-4779-b53a-78c48397ea2f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120740) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 18:04:09.557860 dv-cinder-852009-8-iscsi devstack@n-api.service[120740]: DEBUG oslo_concurrency.lockutils [None req-e88fb9cf-fd82-46a1-9eab-26dd20c17fa9 tempest-ServerRescueNegativeTestJSON-412251590 tempest-ServerRescueNegativeTestJSON-412251590-project] Lock "1daf4f4c-0e4a-4779-b53a-78c48397ea2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120740) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 18:04:09.558267 dv-cinder-852009-8-iscsi devstack@n-api.service[120740]: DEBUG oslo_concurrency.lockutils [None req-e88fb9cf-fd82-46a1-9eab-26dd20c17fa9 tempest-ServerRescueNegativeTestJSON-412251590 tempest-ServerRescueNegativeTestJSON-412251590-project] Lock "1daf4f4c-0e4a-4779-b53a-78c48397ea2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120740) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 18:04:09.741842 dv-cinder-852009-8-iscsi devstack@n-api.service[120740]: DEBUG nova.policy [None req-e88fb9cf-fd82-46a1-9eab-26dd20c17fa9 tempest-ServerRescueNegativeTestJSON-412251590 tempest-ServerRescueNegativeTestJSON-412251590-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '60800cf2774e409d9c1b6f4992669991', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2eae4acecf6c4961830ead78d71b2ad3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120740) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 18:04:09.745430 dv-cinder-852009-8-iscsi devstack@n-api.service[120741]: DEBUG nova.policy [None req-16dc14fc-4823-4df5-8666-c8895c299dbe tempest-AttachVolumeTestJSON-555093534 tempest-AttachVolumeTestJSON-555093534-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0625b3113ce044bbac4f6142eaade11c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a279fcbf274c4704a31a2b95061e1469', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120741) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 18:04:09.758297 dv-cinder-852009-8-iscsi devstack@n-api.service[120741]: INFO nova.api.openstack.requestlog [None req-16dc14fc-4823-4df5-8666-c8895c299dbe tempest-AttachVolumeTestJSON-555093534 tempest-AttachVolumeTestJSON-555093534-project] 10.222.0.43 "GET /compute/v2.1/servers/b958d409-df20-44c6-aa0e-58cb0a482edf" status: 200 len: 1724 microversion: 2.1 time: 0.252085 Sep 13 18:04:09.758888 dv-cinder-852009-8-iscsi devstack@n-api.service[120741]: [pid: 120741|app: 0|req: 143/294] 10.222.0.43 () {58 vars in 1236 bytes} [Tue Sep 13 18:04:09 2022] GET /compute/v2.1/servers/b958d409-df20-44c6-aa0e-58cb0a482edf => generated 1724 bytes in 253 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 13 18:04:09.759147 dv-cinder-852009-8-iscsi devstack@n-api.service[120740]: INFO nova.api.openstack.requestlog [None req-e88fb9cf-fd82-46a1-9eab-26dd20c17fa9 tempest-ServerRescueNegativeTestJSON-412251590 tempest-ServerRescueNegativeTestJSON-412251590-project] 10.222.0.43 "GET /compute/v2.1/servers/e8ce7158-6b73-4586-9f78-8e821988e71c" status: 200 len: 1565 microversion: 2.1 time: 0.218665 Sep 13 18:04:09.760174 dv-cinder-852009-8-iscsi devstack@n-api.service[120740]: [pid: 120740|app: 0|req: 152/295] 10.222.0.43 () {58 vars in 1236 bytes} [Tue Sep 13 18:04:09 2022] GET /compute/v2.1/servers/e8ce7158-6b73-4586-9f78-8e821988e71c => generated 1565 bytes in 221 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 13 18:04:09.780092 dv-cinder-852009-8-iscsi devstack@n-api.service[120741]: DEBUG nova.api.openstack.wsgi [None req-c1620570-2802-4091-b2c8-114754af0bac tempest-TestShelveInstance-6258502 tempest-TestShelveInstance-6258502-project] Calling method '>' {{(pid=120741) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 18:04:09.780745 dv-cinder-852009-8-iscsi devstack@n-api.service[120741]: DEBUG nova.compute.api [None req-c1620570-2802-4091-b2c8-114754af0bac tempest-TestShelveInstance-6258502 tempest-TestShelveInstance-6258502-project] [instance: 2d60cc6d-a699-417d-aa20-fe3e1bfc351e] Fetching instance by UUID {{(pid=120741) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 18:04:09.787511 dv-cinder-852009-8-iscsi devstack@n-api.service[120741]: DEBUG oslo_concurrency.lockutils [None req-c1620570-2802-4091-b2c8-114754af0bac tempest-TestShelveInstance-6258502 tempest-TestShelveInstance-6258502-project] Acquiring lock "1daf4f4c-0e4a-4779-b53a-78c48397ea2f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120741) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 18:04:09.787994 dv-cinder-852009-8-iscsi devstack@n-api.service[120741]: DEBUG oslo_concurrency.lockutils [None req-c1620570-2802-4091-b2c8-114754af0bac tempest-TestShelveInstance-6258502 tempest-TestShelveInstance-6258502-project] Lock "1daf4f4c-0e4a-4779-b53a-78c48397ea2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120741) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 18:04:09.788454 dv-cinder-852009-8-iscsi devstack@n-api.service[120741]: DEBUG oslo_concurrency.lockutils [None req-c1620570-2802-4091-b2c8-114754af0bac tempest-TestShelveInstance-6258502 tempest-TestShelveInstance-6258502-project] Lock "1daf4f4c-0e4a-4779-b53a-78c48397ea2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120741) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 18:04:09.789120 dv-cinder-852009-8-iscsi devstack@n-api.service[120740]: DEBUG nova.api.openstack.wsgi [None req-334416b3-4b50-49fa-88ec-3f09bbac6a19 tempest-ServerRescueNegativeTestJSON-412251590 tempest-ServerRescueNegativeTestJSON-412251590-project] Calling method '>' {{(pid=120740) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 18:04:09.789430 dv-cinder-852009-8-iscsi devstack@n-api.service[120741]: DEBUG oslo_concurrency.lockutils [None req-c1620570-2802-4091-b2c8-114754af0bac tempest-TestShelveInstance-6258502 tempest-TestShelveInstance-6258502-project] Acquiring lock "1daf4f4c-0e4a-4779-b53a-78c48397ea2f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120741) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 18:04:09.789794 dv-cinder-852009-8-iscsi devstack@n-api.service[120740]: DEBUG nova.compute.api [None req-334416b3-4b50-49fa-88ec-3f09bbac6a19 tempest-ServerRescueNegativeTestJSON-412251590 tempest-ServerRescueNegativeTestJSON-412251590-project] [instance: e8ce7158-6b73-4586-9f78-8e821988e71c] Fetching instance by UUID {{(pid=120740) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 18:04:09.789915 dv-cinder-852009-8-iscsi devstack@n-api.service[120741]: DEBUG oslo_concurrency.lockutils [None req-c1620570-2802-4091-b2c8-114754af0bac tempest-TestShelveInstance-6258502 tempest-TestShelveInstance-6258502-project] Lock "1daf4f4c-0e4a-4779-b53a-78c48397ea2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120741) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 18:04:09.790280 dv-cinder-852009-8-iscsi devstack@n-api.service[120741]: DEBUG oslo_concurrency.lockutils [None req-c1620570-2802-4091-b2c8-114754af0bac tempest-TestShelveInstance-6258502 tempest-TestShelveInstance-6258502-project] Lock "1daf4f4c-0e4a-4779-b53a-78c48397ea2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120741) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 18:04:09.801921 dv-cinder-852009-8-iscsi devstack@n-api.service[120740]: DEBUG oslo_concurrency.lockutils [None req-334416b3-4b50-49fa-88ec-3f09bbac6a19 tempest-ServerRescueNegativeTestJSON-412251590 tempest-ServerRescueNegativeTestJSON-412251590-project] Acquiring lock "1daf4f4c-0e4a-4779-b53a-78c48397ea2f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120740) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 18:04:09.803148 dv-cinder-852009-8-iscsi devstack@n-api.service[120740]: DEBUG oslo_concurrency.lockutils [None req-334416b3-4b50-49fa-88ec-3f09bbac6a19 tempest-ServerRescueNegativeTestJSON-412251590 tempest-ServerRescueNegativeTestJSON-412251590-project] Lock "1daf4f4c-0e4a-4779-b53a-78c48397ea2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120740) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 18:04:09.805338 dv-cinder-852009-8-iscsi devstack@n-api.service[120740]: DEBUG oslo_concurrency.lockutils [None req-334416b3-4b50-49fa-88ec-3f09bbac6a19 tempest-ServerRescueNegativeTestJSON-412251590 tempest-ServerRescueNegativeTestJSON-412251590-project] Lock "1daf4f4c-0e4a-4779-b53a-78c48397ea2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120740) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 18:04:09.806700 dv-cinder-852009-8-iscsi devstack@n-api.service[120740]: DEBUG oslo_concurrency.lockutils [None req-334416b3-4b50-49fa-88ec-3f09bbac6a19 tempest-ServerRescueNegativeTestJSON-412251590 tempest-ServerRescueNegativeTestJSON-412251590-project] Acquiring lock "1daf4f4c-0e4a-4779-b53a-78c48397ea2f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120740) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 18:04:09.807254 dv-cinder-852009-8-iscsi devstack@n-api.service[120740]: DEBUG oslo_concurrency.lockutils [None req-334416b3-4b50-49fa-88ec-3f09bbac6a19 tempest-ServerRescueNegativeTestJSON-412251590 tempest-ServerRescueNegativeTestJSON-412251590-project] Lock "1daf4f4c-0e4a-4779-b53a-78c48397ea2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120740) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 18:04:09.807769 dv-cinder-852009-8-iscsi devstack@n-api.service[120740]: DEBUG oslo_concurrency.lockutils [None req-334416b3-4b50-49fa-88ec-3f09bbac6a19 tempest-ServerRescueNegativeTestJSON-412251590 tempest-ServerRescueNegativeTestJSON-412251590-project] Lock "1daf4f4c-0e4a-4779-b53a-78c48397ea2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120740) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 18:04:09.929377 dv-cinder-852009-8-iscsi devstack@n-api.service[120740]: INFO nova.api.openstack.requestlog [None req-334416b3-4b50-49fa-88ec-3f09bbac6a19 tempest-ServerRescueNegativeTestJSON-412251590 tempest-ServerRescueNegativeTestJSON-412251590-project] 10.222.0.43 "GET /compute/v2.1/servers/e8ce7158-6b73-4586-9f78-8e821988e71c/os-interface" status: 200 len: 284 microversion: 2.1 time: 0.144938 Sep 13 18:04:09.929985 dv-cinder-852009-8-iscsi devstack@n-api.service[120740]: [pid: 120740|app: 0|req: 153/296] 10.222.0.43 () {58 vars in 1275 bytes} [Tue Sep 13 18:04:09 2022] GET /compute/v2.1/servers/e8ce7158-6b73-4586-9f78-8e821988e71c/os-interface => generated 284 bytes in 147 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Sep 13 18:04:09.934940 dv-cinder-852009-8-iscsi devstack@n-api.service[120740]: DEBUG nova.api.openstack.wsgi [None req-1c98d337-5603-47ef-8ff7-919ec479775d tempest-AttachVolumeShelveTestJSON-385853788 tempest-AttachVolumeShelveTestJSON-385853788-project] Calling method '>' {{(pid=120740) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 18:04:09.935529 dv-cinder-852009-8-iscsi devstack@n-api.service[120740]: DEBUG nova.compute.api [None req-1c98d337-5603-47ef-8ff7-919ec479775d tempest-AttachVolumeShelveTestJSON-385853788 tempest-AttachVolumeShelveTestJSON-385853788-project] [instance: 11d2616a-96f9-4a7a-aab8-219219986a8b] Fetching instance by UUID {{(pid=120740) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 18:04:09.950053 dv-cinder-852009-8-iscsi devstack@n-api.service[120740]: DEBUG oslo_concurrency.lockutils [None req-1c98d337-5603-47ef-8ff7-919ec479775d tempest-AttachVolumeShelveTestJSON-385853788 tempest-AttachVolumeShelveTestJSON-385853788-project] Acquiring lock "1daf4f4c-0e4a-4779-b53a-78c48397ea2f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120740) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 18:04:09.950053 dv-cinder-852009-8-iscsi devstack@n-api.service[120740]: DEBUG oslo_concurrency.lockutils [None req-1c98d337-5603-47ef-8ff7-919ec479775d tempest-AttachVolumeShelveTestJSON-385853788 tempest-AttachVolumeShelveTestJSON-385853788-project] Lock "1daf4f4c-0e4a-4779-b53a-78c48397ea2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120740) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 18:04:09.950400 dv-cinder-852009-8-iscsi devstack@n-api.service[120740]: DEBUG oslo_concurrency.lockutils [None req-1c98d337-5603-47ef-8ff7-919ec479775d tempest-AttachVolumeShelveTestJSON-385853788 tempest-AttachVolumeShelveTestJSON-385853788-project] Lock "1daf4f4c-0e4a-4779-b53a-78c48397ea2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120740) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 18:04:09.951282 dv-cinder-852009-8-iscsi devstack@n-api.service[120740]: DEBUG oslo_concurrency.lockutils [None req-1c98d337-5603-47ef-8ff7-919ec479775d tempest-AttachVolumeShelveTestJSON-385853788 tempest-AttachVolumeShelveTestJSON-385853788-project] Acquiring lock "1daf4f4c-0e4a-4779-b53a-78c48397ea2f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120740) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 18:04:09.951732 dv-cinder-852009-8-iscsi devstack@n-api.service[120740]: DEBUG oslo_concurrency.lockutils [None req-1c98d337-5603-47ef-8ff7-919ec479775d tempest-AttachVolumeShelveTestJSON-385853788 tempest-AttachVolumeShelveTestJSON-385853788-project] Lock "1daf4f4c-0e4a-4779-b53a-78c48397ea2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120740) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 18:04:09.952146 dv-cinder-852009-8-iscsi devstack@n-api.service[120740]: DEBUG oslo_concurrency.lockutils [None req-1c98d337-5603-47ef-8ff7-919ec479775d tempest-AttachVolumeShelveTestJSON-385853788 tempest-AttachVolumeShelveTestJSON-385853788-project] Lock "1daf4f4c-0e4a-4779-b53a-78c48397ea2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120740) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 18:04:10.083308 dv-cinder-852009-8-iscsi devstack@n-api.service[120741]: DEBUG nova.policy [None req-c1620570-2802-4091-b2c8-114754af0bac tempest-TestShelveInstance-6258502 tempest-TestShelveInstance-6258502-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2ab9930d6ce54cacbb3d4fd6313294d5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5eafd54351bd4049b87ad308a3638f80', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120741) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 18:04:10.098722 dv-cinder-852009-8-iscsi devstack@n-api.service[120741]: INFO nova.api.openstack.requestlog [None req-c1620570-2802-4091-b2c8-114754af0bac tempest-TestShelveInstance-6258502 tempest-TestShelveInstance-6258502-project] 10.222.0.43 "GET /compute/v2.1/servers/2d60cc6d-a699-417d-aa20-fe3e1bfc351e" status: 200 len: 1261 microversion: 2.1 time: 0.328896 Sep 13 18:04:10.102218 dv-cinder-852009-8-iscsi devstack@n-api.service[120741]: [pid: 120741|app: 0|req: 144/297] 10.222.0.43 () {58 vars in 1236 bytes} [Tue Sep 13 18:04:09 2022] GET /compute/v2.1/servers/2d60cc6d-a699-417d-aa20-fe3e1bfc351e => generated 1261 bytes in 343 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 13 18:04:10.190815 dv-cinder-852009-8-iscsi devstack@n-api.service[120740]: DEBUG nova.policy [None req-1c98d337-5603-47ef-8ff7-919ec479775d tempest-AttachVolumeShelveTestJSON-385853788 tempest-AttachVolumeShelveTestJSON-385853788-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e68ecd9b3ca643539b109f75bb242d6f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '75e14fd88bfb4cd896fa7b070a0fac47', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120740) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 18:04:10.204180 dv-cinder-852009-8-iscsi devstack@n-api.service[120740]: DEBUG nova.policy [None req-1c98d337-5603-47ef-8ff7-919ec479775d tempest-AttachVolumeShelveTestJSON-385853788 tempest-AttachVolumeShelveTestJSON-385853788-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'e68ecd9b3ca643539b109f75bb242d6f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '75e14fd88bfb4cd896fa7b070a0fac47', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120740) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 18:04:10.206506 dv-cinder-852009-8-iscsi devstack@n-api.service[120740]: DEBUG nova.policy [None req-1c98d337-5603-47ef-8ff7-919ec479775d tempest-AttachVolumeShelveTestJSON-385853788 tempest-AttachVolumeShelveTestJSON-385853788-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'e68ecd9b3ca643539b109f75bb242d6f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '75e14fd88bfb4cd896fa7b070a0fac47', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120740) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 18:04:10.208174 dv-cinder-852009-8-iscsi devstack@n-api.service[120740]: INFO nova.api.openstack.requestlog [None req-1c98d337-5603-47ef-8ff7-919ec479775d tempest-AttachVolumeShelveTestJSON-385853788 tempest-AttachVolumeShelveTestJSON-385853788-project] 10.222.0.43 "GET /compute/v2.1/servers/11d2616a-96f9-4a7a-aab8-219219986a8b" status: 200 len: 1738 microversion: 2.20 time: 0.276436 Sep 13 18:04:10.208174 dv-cinder-852009-8-iscsi devstack@n-api.service[120740]: [pid: 120740|app: 0|req: 154/298] 10.222.0.43 () {60 vars in 1277 bytes} [Tue Sep 13 18:04:09 2022] GET /compute/v2.1/servers/11d2616a-96f9-4a7a-aab8-219219986a8b => generated 1738 bytes in 278 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 13 18:04:10.789417 dv-cinder-852009-8-iscsi devstack@n-api.service[120741]: DEBUG nova.api.openstack.wsgi [None req-2f5af5e4-2fc2-4736-9550-4bf2eb6b5559 tempest-AttachVolumeTestJSON-555093534 tempest-AttachVolumeTestJSON-555093534-project] Calling method '>' {{(pid=120741) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 18:04:10.791043 dv-cinder-852009-8-iscsi devstack@n-api.service[120741]: DEBUG nova.compute.api [None req-2f5af5e4-2fc2-4736-9550-4bf2eb6b5559 tempest-AttachVolumeTestJSON-555093534 tempest-AttachVolumeTestJSON-555093534-project] [instance: b958d409-df20-44c6-aa0e-58cb0a482edf] Fetching instance by UUID {{(pid=120741) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 18:04:10.802267 dv-cinder-852009-8-iscsi devstack@n-api.service[120741]: DEBUG oslo_concurrency.lockutils [None req-2f5af5e4-2fc2-4736-9550-4bf2eb6b5559 tempest-AttachVolumeTestJSON-555093534 tempest-AttachVolumeTestJSON-555093534-project] Acquiring lock "1daf4f4c-0e4a-4779-b53a-78c48397ea2f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120741) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 18:04:10.803056 dv-cinder-852009-8-iscsi devstack@n-api.service[120741]: DEBUG oslo_concurrency.lockutils [None req-2f5af5e4-2fc2-4736-9550-4bf2eb6b5559 tempest-AttachVolumeTestJSON-555093534 tempest-AttachVolumeTestJSON-555093534-project] Lock "1daf4f4c-0e4a-4779-b53a-78c48397ea2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120741) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 18:04:10.803656 dv-cinder-852009-8-iscsi devstack@n-api.service[120741]: DEBUG oslo_concurrency.lockutils [None req-2f5af5e4-2fc2-4736-9550-4bf2eb6b5559 tempest-AttachVolumeTestJSON-555093534 tempest-AttachVolumeTestJSON-555093534-project] Lock "1daf4f4c-0e4a-4779-b53a-78c48397ea2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120741) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 18:04:10.804578 dv-cinder-852009-8-iscsi devstack@n-api.service[120741]: DEBUG oslo_concurrency.lockutils [None req-2f5af5e4-2fc2-4736-9550-4bf2eb6b5559 tempest-AttachVolumeTestJSON-555093534 tempest-AttachVolumeTestJSON-555093534-project] Acquiring lock "1daf4f4c-0e4a-4779-b53a-78c48397ea2f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120741) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 18:04:10.805203 dv-cinder-852009-8-iscsi devstack@n-api.service[120741]: DEBUG oslo_concurrency.lockutils [None req-2f5af5e4-2fc2-4736-9550-4bf2eb6b5559 tempest-AttachVolumeTestJSON-555093534 tempest-AttachVolumeTestJSON-555093534-project] Lock "1daf4f4c-0e4a-4779-b53a-78c48397ea2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120741) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 18:04:10.806423 dv-cinder-852009-8-iscsi devstack@n-api.service[120741]: DEBUG oslo_concurrency.lockutils [None req-2f5af5e4-2fc2-4736-9550-4bf2eb6b5559 tempest-AttachVolumeTestJSON-555093534 tempest-AttachVolumeTestJSON-555093534-project] Lock "1daf4f4c-0e4a-4779-b53a-78c48397ea2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120741) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 18:04:10.987790 dv-cinder-852009-8-iscsi devstack@n-api.service[120741]: DEBUG nova.policy [None req-2f5af5e4-2fc2-4736-9550-4bf2eb6b5559 tempest-AttachVolumeTestJSON-555093534 tempest-AttachVolumeTestJSON-555093534-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0625b3113ce044bbac4f6142eaade11c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a279fcbf274c4704a31a2b95061e1469', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120741) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 18:04:10.997625 dv-cinder-852009-8-iscsi devstack@n-api.service[120741]: INFO nova.api.openstack.requestlog [None req-2f5af5e4-2fc2-4736-9550-4bf2eb6b5559 tempest-AttachVolumeTestJSON-555093534 tempest-AttachVolumeTestJSON-555093534-project] 10.222.0.43 "GET /compute/v2.1/servers/b958d409-df20-44c6-aa0e-58cb0a482edf" status: 200 len: 1724 microversion: 2.1 time: 0.214433 Sep 13 18:04:11.008450 dv-cinder-852009-8-iscsi devstack@n-api.service[120741]: [pid: 120741|app: 0|req: 145/299] 10.222.0.43 () {58 vars in 1236 bytes} [Tue Sep 13 18:04:10 2022] GET /compute/v2.1/servers/b958d409-df20-44c6-aa0e-58cb0a482edf => generated 1724 bytes in 216 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 13 18:04:11.125850 dv-cinder-852009-8-iscsi devstack@n-api.service[120740]: DEBUG nova.api.openstack.wsgi [None req-2ccc2c13-628a-4392-a665-43c199e0f1dd tempest-TestShelveInstance-6258502 tempest-TestShelveInstance-6258502-project] Calling method '>' {{(pid=120740) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 18:04:11.127561 dv-cinder-852009-8-iscsi devstack@n-api.service[120740]: DEBUG nova.compute.api [None req-2ccc2c13-628a-4392-a665-43c199e0f1dd tempest-TestShelveInstance-6258502 tempest-TestShelveInstance-6258502-project] [instance: 2d60cc6d-a699-417d-aa20-fe3e1bfc351e] Fetching instance by UUID {{(pid=120740) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 18:04:11.135216 dv-cinder-852009-8-iscsi devstack@n-api.service[120740]: DEBUG oslo_concurrency.lockutils [None req-2ccc2c13-628a-4392-a665-43c199e0f1dd tempest-TestShelveInstance-6258502 tempest-TestShelveInstance-6258502-project] Acquiring lock "1daf4f4c-0e4a-4779-b53a-78c48397ea2f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120740) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 18:04:11.135991 dv-cinder-852009-8-iscsi devstack@n-api.service[120740]: DEBUG oslo_concurrency.lockutils [None req-2ccc2c13-628a-4392-a665-43c199e0f1dd tempest-TestShelveInstance-6258502 tempest-TestShelveInstance-6258502-project] Lock "1daf4f4c-0e4a-4779-b53a-78c48397ea2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120740) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 18:04:11.136617 dv-cinder-852009-8-iscsi devstack@n-api.service[120740]: DEBUG oslo_concurrency.lockutils [None req-2ccc2c13-628a-4392-a665-43c199e0f1dd tempest-TestShelveInstance-6258502 tempest-TestShelveInstance-6258502-project] Lock "1daf4f4c-0e4a-4779-b53a-78c48397ea2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120740) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 18:04:11.137542 dv-cinder-852009-8-iscsi devstack@n-api.service[120740]: DEBUG oslo_concurrency.lockutils [None req-2ccc2c13-628a-4392-a665-43c199e0f1dd tempest-TestShelveInstance-6258502 tempest-TestShelveInstance-6258502-project] Acquiring lock "1daf4f4c-0e4a-4779-b53a-78c48397ea2f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120740) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 18:04:11.138130 dv-cinder-852009-8-iscsi devstack@n-api.service[120740]: DEBUG oslo_concurrency.lockutils [None req-2ccc2c13-628a-4392-a665-43c199e0f1dd tempest-TestShelveInstance-6258502 tempest-TestShelveInstance-6258502-project] Lock "1daf4f4c-0e4a-4779-b53a-78c48397ea2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120740) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 18:04:11.138959 dv-cinder-852009-8-iscsi devstack@n-api.service[120740]: DEBUG oslo_concurrency.lockutils [None req-2ccc2c13-628a-4392-a665-43c199e0f1dd tempest-TestShelveInstance-6258502 tempest-TestShelveInstance-6258502-project] Lock "1daf4f4c-0e4a-4779-b53a-78c48397ea2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120740) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 18:04:11.243274 dv-cinder-852009-8-iscsi devstack@n-api.service[120741]: DEBUG nova.api.openstack.wsgi [None req-a4a67bf0-62c1-4e60-8691-575c409cc67d tempest-AttachVolumeShelveTestJSON-385853788 tempest-AttachVolumeShelveTestJSON-385853788-project] Calling method '>' {{(pid=120741) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 18:04:11.244152 dv-cinder-852009-8-iscsi devstack@n-api.service[120741]: DEBUG nova.compute.api [None req-a4a67bf0-62c1-4e60-8691-575c409cc67d tempest-AttachVolumeShelveTestJSON-385853788 tempest-AttachVolumeShelveTestJSON-385853788-project] [instance: 11d2616a-96f9-4a7a-aab8-219219986a8b] Fetching instance by UUID {{(pid=120741) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 18:04:11.252889 dv-cinder-852009-8-iscsi devstack@n-api.service[120741]: DEBUG oslo_concurrency.lockutils [None req-a4a67bf0-62c1-4e60-8691-575c409cc67d tempest-AttachVolumeShelveTestJSON-385853788 tempest-AttachVolumeShelveTestJSON-385853788-project] Acquiring lock "1daf4f4c-0e4a-4779-b53a-78c48397ea2f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120741) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 18:04:11.253461 dv-cinder-852009-8-iscsi devstack@n-api.service[120741]: DEBUG oslo_concurrency.lockutils [None req-a4a67bf0-62c1-4e60-8691-575c409cc67d tempest-AttachVolumeShelveTestJSON-385853788 tempest-AttachVolumeShelveTestJSON-385853788-project] Lock "1daf4f4c-0e4a-4779-b53a-78c48397ea2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120741) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 18:04:11.254079 dv-cinder-852009-8-iscsi devstack@n-api.service[120741]: DEBUG oslo_concurrency.lockutils [None req-a4a67bf0-62c1-4e60-8691-575c409cc67d tempest-AttachVolumeShelveTestJSON-385853788 tempest-AttachVolumeShelveTestJSON-385853788-project] Lock "1daf4f4c-0e4a-4779-b53a-78c48397ea2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120741) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 18:04:11.255049 dv-cinder-852009-8-iscsi devstack@n-api.service[120741]: DEBUG oslo_concurrency.lockutils [None req-a4a67bf0-62c1-4e60-8691-575c409cc67d tempest-AttachVolumeShelveTestJSON-385853788 tempest-AttachVolumeShelveTestJSON-385853788-project] Acquiring lock "1daf4f4c-0e4a-4779-b53a-78c48397ea2f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120741) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 18:04:11.255586 dv-cinder-852009-8-iscsi devstack@n-api.service[120741]: DEBUG oslo_concurrency.lockutils [None req-a4a67bf0-62c1-4e60-8691-575c409cc67d tempest-AttachVolumeShelveTestJSON-385853788 tempest-AttachVolumeShelveTestJSON-385853788-project] Lock "1daf4f4c-0e4a-4779-b53a-78c48397ea2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120741) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 18:04:11.256065 dv-cinder-852009-8-iscsi devstack@n-api.service[120741]: DEBUG oslo_concurrency.lockutils [None req-a4a67bf0-62c1-4e60-8691-575c409cc67d tempest-AttachVolumeShelveTestJSON-385853788 tempest-AttachVolumeShelveTestJSON-385853788-project] Lock "1daf4f4c-0e4a-4779-b53a-78c48397ea2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120741) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 18:04:11.386165 dv-cinder-852009-8-iscsi devstack@n-api.service[120740]: DEBUG nova.policy [None req-2ccc2c13-628a-4392-a665-43c199e0f1dd tempest-TestShelveInstance-6258502 tempest-TestShelveInstance-6258502-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2ab9930d6ce54cacbb3d4fd6313294d5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5eafd54351bd4049b87ad308a3638f80', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120740) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 18:04:11.394949 dv-cinder-852009-8-iscsi devstack@n-api.service[120740]: INFO nova.api.openstack.requestlog [None req-2ccc2c13-628a-4392-a665-43c199e0f1dd tempest-TestShelveInstance-6258502 tempest-TestShelveInstance-6258502-project] 10.222.0.43 "GET /compute/v2.1/servers/2d60cc6d-a699-417d-aa20-fe3e1bfc351e" status: 200 len: 1261 microversion: 2.1 time: 0.273380 Sep 13 18:04:11.397061 dv-cinder-852009-8-iscsi devstack@n-api.service[120740]: [pid: 120740|app: 0|req: 155/300] 10.222.0.43 () {58 vars in 1236 bytes} [Tue Sep 13 18:04:11 2022] GET /compute/v2.1/servers/2d60cc6d-a699-417d-aa20-fe3e1bfc351e => generated 1261 bytes in 276 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 13 18:04:11.442551 dv-cinder-852009-8-iscsi devstack@n-api.service[120740]: DEBUG nova.api.openstack.wsgi [req-06d76e19-a548-4b95-bfe2-5f334faafebb req-d9bfe2a7-424f-4e19-a519-54ae57ab363e service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "e8ce7158-6b73-4586-9f78-8e821988e71c", "tag": "ea32c59b-537c-405f-b361-3a6b70e328d4"}]} {{(pid=120740) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 13 18:04:11.452946 dv-cinder-852009-8-iscsi devstack@n-api.service[120740]: DEBUG oslo_concurrency.lockutils [req-06d76e19-a548-4b95-bfe2-5f334faafebb req-d9bfe2a7-424f-4e19-a519-54ae57ab363e service nova] Acquiring lock "1daf4f4c-0e4a-4779-b53a-78c48397ea2f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120740) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 18:04:11.453587 dv-cinder-852009-8-iscsi devstack@n-api.service[120740]: DEBUG oslo_concurrency.lockutils [req-06d76e19-a548-4b95-bfe2-5f334faafebb req-d9bfe2a7-424f-4e19-a519-54ae57ab363e service nova] Lock "1daf4f4c-0e4a-4779-b53a-78c48397ea2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120740) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 18:04:11.454139 dv-cinder-852009-8-iscsi devstack@n-api.service[120740]: DEBUG oslo_concurrency.lockutils [req-06d76e19-a548-4b95-bfe2-5f334faafebb req-d9bfe2a7-424f-4e19-a519-54ae57ab363e service nova] Lock "1daf4f4c-0e4a-4779-b53a-78c48397ea2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120740) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 18:04:11.460064 dv-cinder-852009-8-iscsi devstack@n-api.service[120741]: DEBUG nova.policy [None req-a4a67bf0-62c1-4e60-8691-575c409cc67d tempest-AttachVolumeShelveTestJSON-385853788 tempest-AttachVolumeShelveTestJSON-385853788-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e68ecd9b3ca643539b109f75bb242d6f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '75e14fd88bfb4cd896fa7b070a0fac47', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120741) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 18:04:11.470209 dv-cinder-852009-8-iscsi devstack@n-api.service[120741]: DEBUG nova.policy [None req-a4a67bf0-62c1-4e60-8691-575c409cc67d tempest-AttachVolumeShelveTestJSON-385853788 tempest-AttachVolumeShelveTestJSON-385853788-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'e68ecd9b3ca643539b109f75bb242d6f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '75e14fd88bfb4cd896fa7b070a0fac47', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120741) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 18:04:11.473168 dv-cinder-852009-8-iscsi devstack@n-api.service[120741]: DEBUG nova.policy [None req-a4a67bf0-62c1-4e60-8691-575c409cc67d tempest-AttachVolumeShelveTestJSON-385853788 tempest-AttachVolumeShelveTestJSON-385853788-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'e68ecd9b3ca643539b109f75bb242d6f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '75e14fd88bfb4cd896fa7b070a0fac47', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120741) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 18:04:11.479706 dv-cinder-852009-8-iscsi devstack@n-api.service[120740]: INFO nova.api.openstack.compute.server_external_events [req-06d76e19-a548-4b95-bfe2-5f334faafebb req-d9bfe2a7-424f-4e19-a519-54ae57ab363e service nova] Creating event network-changed:ea32c59b-537c-405f-b361-3a6b70e328d4 for instance e8ce7158-6b73-4586-9f78-8e821988e71c on hv-cinder-85200 Sep 13 18:04:11.481189 dv-cinder-852009-8-iscsi devstack@n-api.service[120741]: INFO nova.api.openstack.requestlog [None req-a4a67bf0-62c1-4e60-8691-575c409cc67d tempest-AttachVolumeShelveTestJSON-385853788 tempest-AttachVolumeShelveTestJSON-385853788-project] 10.222.0.43 "GET /compute/v2.1/servers/11d2616a-96f9-4a7a-aab8-219219986a8b" status: 200 len: 1738 microversion: 2.20 time: 0.249401 Sep 13 18:04:11.484662 dv-cinder-852009-8-iscsi devstack@n-api.service[120741]: [pid: 120741|app: 0|req: 146/301] 10.222.0.43 () {60 vars in 1277 bytes} [Tue Sep 13 18:04:11 2022] GET /compute/v2.1/servers/11d2616a-96f9-4a7a-aab8-219219986a8b => generated 1738 bytes in 251 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 13 18:04:11.487530 dv-cinder-852009-8-iscsi devstack@n-api.service[120740]: INFO nova.api.openstack.requestlog [req-06d76e19-a548-4b95-bfe2-5f334faafebb req-d9bfe2a7-424f-4e19-a519-54ae57ab363e service nova] 10.222.0.43 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.048957 Sep 13 18:04:11.488585 dv-cinder-852009-8-iscsi devstack@n-api.service[120740]: [pid: 120740|app: 0|req: 156/302] 10.222.0.43 () {64 vars in 1317 bytes} [Tue Sep 13 18:04:11 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 51 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Sep 13 18:04:12.026233 dv-cinder-852009-8-iscsi devstack@n-api.service[120741]: DEBUG nova.api.openstack.wsgi [None req-4b542980-09a8-4df9-b6da-bc49b073df82 tempest-AttachVolumeTestJSON-555093534 tempest-AttachVolumeTestJSON-555093534-project] Calling method '>' {{(pid=120741) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 18:04:12.028348 dv-cinder-852009-8-iscsi devstack@n-api.service[120741]: DEBUG nova.compute.api [None req-4b542980-09a8-4df9-b6da-bc49b073df82 tempest-AttachVolumeTestJSON-555093534 tempest-AttachVolumeTestJSON-555093534-project] [instance: b958d409-df20-44c6-aa0e-58cb0a482edf] Fetching instance by UUID {{(pid=120741) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 18:04:12.043516 dv-cinder-852009-8-iscsi devstack@n-api.service[120741]: DEBUG oslo_concurrency.lockutils [None req-4b542980-09a8-4df9-b6da-bc49b073df82 tempest-AttachVolumeTestJSON-555093534 tempest-AttachVolumeTestJSON-555093534-project] Acquiring lock "1daf4f4c-0e4a-4779-b53a-78c48397ea2f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120741) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 18:04:12.045560 dv-cinder-852009-8-iscsi devstack@n-api.service[120741]: DEBUG oslo_concurrency.lockutils [None req-4b542980-09a8-4df9-b6da-bc49b073df82 tempest-AttachVolumeTestJSON-555093534 tempest-AttachVolumeTestJSON-555093534-project] Lock "1daf4f4c-0e4a-4779-b53a-78c48397ea2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120741) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 18:04:12.048499 dv-cinder-852009-8-iscsi devstack@n-api.service[120741]: DEBUG oslo_concurrency.lockutils [None req-4b542980-09a8-4df9-b6da-bc49b073df82 tempest-AttachVolumeTestJSON-555093534 tempest-AttachVolumeTestJSON-555093534-project] Lock "1daf4f4c-0e4a-4779-b53a-78c48397ea2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=120741) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 18:04:12.049478 dv-cinder-852009-8-iscsi devstack@n-api.service[120741]: DEBUG oslo_concurrency.lockutils [None req-4b542980-09a8-4df9-b6da-bc49b073df82 tempest-AttachVolumeTestJSON-555093534 tempest-AttachVolumeTestJSON-555093534-project] Acquiring lock "1daf4f4c-0e4a-4779-b53a-78c48397ea2f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120741) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 18:04:12.053001 dv-cinder-852009-8-iscsi devstack@n-api.service[120741]: DEBUG oslo_concurrency.lockutils [None req-4b542980-09a8-4df9-b6da-bc49b073df82 tempest-AttachVolumeTestJSON-555093534 tempest-AttachVolumeTestJSON-555093534-project] Lock "1daf4f4c-0e4a-4779-b53a-78c48397ea2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120741) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 18:04:12.053667 dv-cinder-852009-8-iscsi devstack@n-api.service[120741]: DEBUG oslo_concurrency.lockutils [None req-4b542980-09a8-4df9-b6da-bc49b073df82 tempest-AttachVolumeTestJSON-555093534 tempest-AttachVolumeTestJSON-555093534-project] Lock "1daf4f4c-0e4a-4779-b53a-78c48397ea2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120741) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 18:04:12.318944 dv-cinder-852009-8-iscsi devstack@n-api.service[120741]: DEBUG nova.policy [None req-4b542980-09a8-4df9-b6da-bc49b073df82 tempest-AttachVolumeTestJSON-555093534 tempest-AttachVolumeTestJSON-555093534-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0625b3113ce044bbac4f6142eaade11c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a279fcbf274c4704a31a2b95061e1469', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120741) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 18:04:12.328177 dv-cinder-852009-8-iscsi devstack@n-api.service[120741]: INFO nova.api.openstack.requestlog [None req-4b542980-09a8-4df9-b6da-bc49b073df82 tempest-AttachVolumeTestJSON-555093534 tempest-AttachVolumeTestJSON-555093534-project] 10.222.0.43 "GET /compute/v2.1/servers/b958d409-df20-44c6-aa0e-58cb0a482edf" status: 200 len: 1724 microversion: 2.1 time: 0.307829 Sep 13 18:04:12.330373 dv-cinder-852009-8-iscsi devstack@n-api.service[120741]: [pid: 120741|app: 0|req: 147/303] 10.222.0.43 () {58 vars in 1236 bytes} [Tue Sep 13 18:04:12 2022] GET /compute/v2.1/servers/b958d409-df20-44c6-aa0e-58cb0a482edf => generated 1724 bytes in 311 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 13 18:04:12.422406 dv-cinder-852009-8-iscsi devstack@n-api.service[120740]: DEBUG nova.api.openstack.wsgi [None req-b3de1841-7bfd-4376-ab73-2a554644b070 tempest-TestShelveInstance-6258502 tempest-TestShelveInstance-6258502-project] Calling method '>' {{(pid=120740) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 18:04:12.424383 dv-cinder-852009-8-iscsi devstack@n-api.service[120740]: DEBUG nova.compute.api [None req-b3de1841-7bfd-4376-ab73-2a554644b070 tempest-TestShelveInstance-6258502 tempest-TestShelveInstance-6258502-project] [instance: 2d60cc6d-a699-417d-aa20-fe3e1bfc351e] Fetching instance by UUID {{(pid=120740) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 18:04:12.437373 dv-cinder-852009-8-iscsi devstack@n-api.service[120740]: DEBUG oslo_concurrency.lockutils [None req-b3de1841-7bfd-4376-ab73-2a554644b070 tempest-TestShelveInstance-6258502 tempest-TestShelveInstance-6258502-project] Acquiring lock "1daf4f4c-0e4a-4779-b53a-78c48397ea2f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120740) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 18:04:12.441081 dv-cinder-852009-8-iscsi devstack@n-api.service[120740]: DEBUG oslo_concurrency.lockutils [None req-b3de1841-7bfd-4376-ab73-2a554644b070 tempest-TestShelveInstance-6258502 tempest-TestShelveInstance-6258502-project] Lock "1daf4f4c-0e4a-4779-b53a-78c48397ea2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=120740) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 18:04:12.441840 dv-cinder-852009-8-iscsi devstack@n-api.service[120740]: DEBUG oslo_concurrency.lockutils [None req-b3de1841-7bfd-4376-ab73-2a554644b070 tempest-TestShelveInstance-6258502 tempest-TestShelveInstance-6258502-project] Lock "1daf4f4c-0e4a-4779-b53a-78c48397ea2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120740) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 18:04:12.443751 dv-cinder-852009-8-iscsi devstack@n-api.service[120740]: DEBUG oslo_concurrency.lockutils [None req-b3de1841-7bfd-4376-ab73-2a554644b070 tempest-TestShelveInstance-6258502 tempest-TestShelveInstance-6258502-project] Acquiring lock "1daf4f4c-0e4a-4779-b53a-78c48397ea2f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120740) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 18:04:12.444768 dv-cinder-852009-8-iscsi devstack@n-api.service[120740]: DEBUG oslo_concurrency.lockutils [None req-b3de1841-7bfd-4376-ab73-2a554644b070 tempest-TestShelveInstance-6258502 tempest-TestShelveInstance-6258502-project] Lock "1daf4f4c-0e4a-4779-b53a-78c48397ea2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120740) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 18:04:12.445665 dv-cinder-852009-8-iscsi devstack@n-api.service[120740]: DEBUG oslo_concurrency.lockutils [None req-b3de1841-7bfd-4376-ab73-2a554644b070 tempest-TestShelveInstance-6258502 tempest-TestShelveInstance-6258502-project] Lock "1daf4f4c-0e4a-4779-b53a-78c48397ea2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120740) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 18:04:12.507448 dv-cinder-852009-8-iscsi devstack@n-api.service[120741]: DEBUG nova.api.openstack.wsgi [None req-a1f18cf3-50ee-4eb7-a47b-165915d418fd tempest-AttachVolumeShelveTestJSON-385853788 tempest-AttachVolumeShelveTestJSON-385853788-project] Calling method '>' {{(pid=120741) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 18:04:12.508271 dv-cinder-852009-8-iscsi devstack@n-api.service[120741]: DEBUG nova.compute.api [None req-a1f18cf3-50ee-4eb7-a47b-165915d418fd tempest-AttachVolumeShelveTestJSON-385853788 tempest-AttachVolumeShelveTestJSON-385853788-project] [instance: 11d2616a-96f9-4a7a-aab8-219219986a8b] Fetching instance by UUID {{(pid=120741) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 18:04:12.514925 dv-cinder-852009-8-iscsi devstack@n-api.service[120741]: DEBUG oslo_concurrency.lockutils [None req-a1f18cf3-50ee-4eb7-a47b-165915d418fd tempest-AttachVolumeShelveTestJSON-385853788 tempest-AttachVolumeShelveTestJSON-385853788-project] Acquiring lock "1daf4f4c-0e4a-4779-b53a-78c48397ea2f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120741) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 18:04:12.515503 dv-cinder-852009-8-iscsi devstack@n-api.service[120741]: DEBUG oslo_concurrency.lockutils [None req-a1f18cf3-50ee-4eb7-a47b-165915d418fd tempest-AttachVolumeShelveTestJSON-385853788 tempest-AttachVolumeShelveTestJSON-385853788-project] Lock "1daf4f4c-0e4a-4779-b53a-78c48397ea2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120741) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 18:04:12.515982 dv-cinder-852009-8-iscsi devstack@n-api.service[120741]: DEBUG oslo_concurrency.lockutils [None req-a1f18cf3-50ee-4eb7-a47b-165915d418fd tempest-AttachVolumeShelveTestJSON-385853788 tempest-AttachVolumeShelveTestJSON-385853788-project] Lock "1daf4f4c-0e4a-4779-b53a-78c48397ea2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120741) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 18:04:12.516954 dv-cinder-852009-8-iscsi devstack@n-api.service[120741]: DEBUG oslo_concurrency.lockutils [None req-a1f18cf3-50ee-4eb7-a47b-165915d418fd tempest-AttachVolumeShelveTestJSON-385853788 tempest-AttachVolumeShelveTestJSON-385853788-project] Acquiring lock "1daf4f4c-0e4a-4779-b53a-78c48397ea2f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120741) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 18:04:12.517563 dv-cinder-852009-8-iscsi devstack@n-api.service[120741]: DEBUG oslo_concurrency.lockutils [None req-a1f18cf3-50ee-4eb7-a47b-165915d418fd tempest-AttachVolumeShelveTestJSON-385853788 tempest-AttachVolumeShelveTestJSON-385853788-project] Lock "1daf4f4c-0e4a-4779-b53a-78c48397ea2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120741) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 18:04:12.518150 dv-cinder-852009-8-iscsi devstack@n-api.service[120741]: DEBUG oslo_concurrency.lockutils [None req-a1f18cf3-50ee-4eb7-a47b-165915d418fd tempest-AttachVolumeShelveTestJSON-385853788 tempest-AttachVolumeShelveTestJSON-385853788-project] Lock "1daf4f4c-0e4a-4779-b53a-78c48397ea2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120741) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 18:04:12.735184 dv-cinder-852009-8-iscsi devstack@n-api.service[120740]: DEBUG nova.policy [None req-b3de1841-7bfd-4376-ab73-2a554644b070 tempest-TestShelveInstance-6258502 tempest-TestShelveInstance-6258502-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2ab9930d6ce54cacbb3d4fd6313294d5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5eafd54351bd4049b87ad308a3638f80', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120740) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 18:04:12.761810 dv-cinder-852009-8-iscsi devstack@n-api.service[120740]: INFO nova.api.openstack.requestlog [None req-b3de1841-7bfd-4376-ab73-2a554644b070 tempest-TestShelveInstance-6258502 tempest-TestShelveInstance-6258502-project] 10.222.0.43 "GET /compute/v2.1/servers/2d60cc6d-a699-417d-aa20-fe3e1bfc351e" status: 200 len: 1261 microversion: 2.1 time: 0.346189 Sep 13 18:04:12.764791 dv-cinder-852009-8-iscsi devstack@n-api.service[120740]: [pid: 120740|app: 0|req: 157/304] 10.222.0.43 () {58 vars in 1236 bytes} [Tue Sep 13 18:04:12 2022] GET /compute/v2.1/servers/2d60cc6d-a699-417d-aa20-fe3e1bfc351e => generated 1261 bytes in 351 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 13 18:04:12.768113 dv-cinder-852009-8-iscsi devstack@n-api.service[120741]: DEBUG nova.policy [None req-a1f18cf3-50ee-4eb7-a47b-165915d418fd tempest-AttachVolumeShelveTestJSON-385853788 tempest-AttachVolumeShelveTestJSON-385853788-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e68ecd9b3ca643539b109f75bb242d6f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '75e14fd88bfb4cd896fa7b070a0fac47', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120741) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 18:04:12.784668 dv-cinder-852009-8-iscsi devstack@n-api.service[120741]: DEBUG nova.policy [None req-a1f18cf3-50ee-4eb7-a47b-165915d418fd tempest-AttachVolumeShelveTestJSON-385853788 tempest-AttachVolumeShelveTestJSON-385853788-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'e68ecd9b3ca643539b109f75bb242d6f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '75e14fd88bfb4cd896fa7b070a0fac47', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120741) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 18:04:12.786292 dv-cinder-852009-8-iscsi devstack@n-api.service[120741]: DEBUG nova.policy [None req-a1f18cf3-50ee-4eb7-a47b-165915d418fd tempest-AttachVolumeShelveTestJSON-385853788 tempest-AttachVolumeShelveTestJSON-385853788-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'e68ecd9b3ca643539b109f75bb242d6f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '75e14fd88bfb4cd896fa7b070a0fac47', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120741) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 18:04:12.787727 dv-cinder-852009-8-iscsi devstack@n-api.service[120741]: INFO nova.api.openstack.requestlog [None req-a1f18cf3-50ee-4eb7-a47b-165915d418fd tempest-AttachVolumeShelveTestJSON-385853788 tempest-AttachVolumeShelveTestJSON-385853788-project] 10.222.0.43 "GET /compute/v2.1/servers/11d2616a-96f9-4a7a-aab8-219219986a8b" status: 200 len: 1738 microversion: 2.20 time: 0.284122 Sep 13 18:04:12.788663 dv-cinder-852009-8-iscsi devstack@n-api.service[120741]: [pid: 120741|app: 0|req: 148/305] 10.222.0.43 () {60 vars in 1277 bytes} [Tue Sep 13 18:04:12 2022] GET /compute/v2.1/servers/11d2616a-96f9-4a7a-aab8-219219986a8b => generated 1738 bytes in 285 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 13 18:04:13.356172 dv-cinder-852009-8-iscsi devstack@n-api.service[120740]: DEBUG nova.api.openstack.wsgi [None req-d0a47b4f-2a0b-4875-80e0-fe3c9ae65b06 tempest-AttachVolumeTestJSON-555093534 tempest-AttachVolumeTestJSON-555093534-project] Calling method '>' {{(pid=120740) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 18:04:13.356967 dv-cinder-852009-8-iscsi devstack@n-api.service[120740]: DEBUG nova.compute.api [None req-d0a47b4f-2a0b-4875-80e0-fe3c9ae65b06 tempest-AttachVolumeTestJSON-555093534 tempest-AttachVolumeTestJSON-555093534-project] [instance: b958d409-df20-44c6-aa0e-58cb0a482edf] Fetching instance by UUID {{(pid=120740) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 18:04:13.365216 dv-cinder-852009-8-iscsi devstack@n-api.service[120740]: DEBUG oslo_concurrency.lockutils [None req-d0a47b4f-2a0b-4875-80e0-fe3c9ae65b06 tempest-AttachVolumeTestJSON-555093534 tempest-AttachVolumeTestJSON-555093534-project] Acquiring lock "1daf4f4c-0e4a-4779-b53a-78c48397ea2f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120740) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 18:04:13.365779 dv-cinder-852009-8-iscsi devstack@n-api.service[120740]: DEBUG oslo_concurrency.lockutils [None req-d0a47b4f-2a0b-4875-80e0-fe3c9ae65b06 tempest-AttachVolumeTestJSON-555093534 tempest-AttachVolumeTestJSON-555093534-project] Lock "1daf4f4c-0e4a-4779-b53a-78c48397ea2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120740) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 18:04:13.366401 dv-cinder-852009-8-iscsi devstack@n-api.service[120740]: DEBUG oslo_concurrency.lockutils [None req-d0a47b4f-2a0b-4875-80e0-fe3c9ae65b06 tempest-AttachVolumeTestJSON-555093534 tempest-AttachVolumeTestJSON-555093534-project] Lock "1daf4f4c-0e4a-4779-b53a-78c48397ea2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120740) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 18:04:13.367374 dv-cinder-852009-8-iscsi devstack@n-api.service[120740]: DEBUG oslo_concurrency.lockutils [None req-d0a47b4f-2a0b-4875-80e0-fe3c9ae65b06 tempest-AttachVolumeTestJSON-555093534 tempest-AttachVolumeTestJSON-555093534-project] Acquiring lock "1daf4f4c-0e4a-4779-b53a-78c48397ea2f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120740) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 18:04:13.367937 dv-cinder-852009-8-iscsi devstack@n-api.service[120740]: DEBUG oslo_concurrency.lockutils [None req-d0a47b4f-2a0b-4875-80e0-fe3c9ae65b06 tempest-AttachVolumeTestJSON-555093534 tempest-AttachVolumeTestJSON-555093534-project] Lock "1daf4f4c-0e4a-4779-b53a-78c48397ea2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120740) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 18:04:13.368662 dv-cinder-852009-8-iscsi devstack@n-api.service[120740]: DEBUG oslo_concurrency.lockutils [None req-d0a47b4f-2a0b-4875-80e0-fe3c9ae65b06 tempest-AttachVolumeTestJSON-555093534 tempest-AttachVolumeTestJSON-555093534-project] Lock "1daf4f4c-0e4a-4779-b53a-78c48397ea2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120740) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 18:04:13.507070 dv-cinder-852009-8-iscsi devstack@n-api.service[120740]: DEBUG nova.policy [None req-d0a47b4f-2a0b-4875-80e0-fe3c9ae65b06 tempest-AttachVolumeTestJSON-555093534 tempest-AttachVolumeTestJSON-555093534-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0625b3113ce044bbac4f6142eaade11c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a279fcbf274c4704a31a2b95061e1469', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120740) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 18:04:13.516460 dv-cinder-852009-8-iscsi devstack@n-api.service[120740]: INFO nova.api.openstack.requestlog [None req-d0a47b4f-2a0b-4875-80e0-fe3c9ae65b06 tempest-AttachVolumeTestJSON-555093534 tempest-AttachVolumeTestJSON-555093534-project] 10.222.0.43 "GET /compute/v2.1/servers/b958d409-df20-44c6-aa0e-58cb0a482edf" status: 200 len: 1724 microversion: 2.1 time: 0.165753 Sep 13 18:04:13.517141 dv-cinder-852009-8-iscsi devstack@n-api.service[120740]: [pid: 120740|app: 0|req: 158/306] 10.222.0.43 () {58 vars in 1236 bytes} [Tue Sep 13 18:04:13 2022] GET /compute/v2.1/servers/b958d409-df20-44c6-aa0e-58cb0a482edf => generated 1724 bytes in 167 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 13 18:04:13.787187 dv-cinder-852009-8-iscsi devstack@n-api.service[120741]: DEBUG nova.api.openstack.wsgi [None req-3e8ca841-64da-4fc3-a3dd-816f6f81fe00 tempest-TestShelveInstance-6258502 tempest-TestShelveInstance-6258502-project] Calling method '>' {{(pid=120741) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 18:04:13.787969 dv-cinder-852009-8-iscsi devstack@n-api.service[120741]: DEBUG nova.compute.api [None req-3e8ca841-64da-4fc3-a3dd-816f6f81fe00 tempest-TestShelveInstance-6258502 tempest-TestShelveInstance-6258502-project] [instance: 2d60cc6d-a699-417d-aa20-fe3e1bfc351e] Fetching instance by UUID {{(pid=120741) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 18:04:13.795360 dv-cinder-852009-8-iscsi devstack@n-api.service[120741]: DEBUG oslo_concurrency.lockutils [None req-3e8ca841-64da-4fc3-a3dd-816f6f81fe00 tempest-TestShelveInstance-6258502 tempest-TestShelveInstance-6258502-project] Acquiring lock "1daf4f4c-0e4a-4779-b53a-78c48397ea2f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120741) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 18:04:13.795962 dv-cinder-852009-8-iscsi devstack@n-api.service[120741]: DEBUG oslo_concurrency.lockutils [None req-3e8ca841-64da-4fc3-a3dd-816f6f81fe00 tempest-TestShelveInstance-6258502 tempest-TestShelveInstance-6258502-project] Lock "1daf4f4c-0e4a-4779-b53a-78c48397ea2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120741) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 18:04:13.796393 dv-cinder-852009-8-iscsi devstack@n-api.service[120741]: DEBUG oslo_concurrency.lockutils [None req-3e8ca841-64da-4fc3-a3dd-816f6f81fe00 tempest-TestShelveInstance-6258502 tempest-TestShelveInstance-6258502-project] Lock "1daf4f4c-0e4a-4779-b53a-78c48397ea2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120741) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 18:04:13.797133 dv-cinder-852009-8-iscsi devstack@n-api.service[120741]: DEBUG oslo_concurrency.lockutils [None req-3e8ca841-64da-4fc3-a3dd-816f6f81fe00 tempest-TestShelveInstance-6258502 tempest-TestShelveInstance-6258502-project] Acquiring lock "1daf4f4c-0e4a-4779-b53a-78c48397ea2f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120741) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 18:04:13.797618 dv-cinder-852009-8-iscsi devstack@n-api.service[120741]: DEBUG oslo_concurrency.lockutils [None req-3e8ca841-64da-4fc3-a3dd-816f6f81fe00 tempest-TestShelveInstance-6258502 tempest-TestShelveInstance-6258502-project] Lock "1daf4f4c-0e4a-4779-b53a-78c48397ea2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120741) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 18:04:13.798036 dv-cinder-852009-8-iscsi devstack@n-api.service[120741]: DEBUG oslo_concurrency.lockutils [None req-3e8ca841-64da-4fc3-a3dd-816f6f81fe00 tempest-TestShelveInstance-6258502 tempest-TestShelveInstance-6258502-project] Lock "1daf4f4c-0e4a-4779-b53a-78c48397ea2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120741) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 18:04:13.814855 dv-cinder-852009-8-iscsi devstack@n-api.service[120740]: DEBUG nova.api.openstack.wsgi [None req-96d8ee49-117d-4779-8d20-af94998f95ec tempest-AttachVolumeShelveTestJSON-385853788 tempest-AttachVolumeShelveTestJSON-385853788-project] Calling method '>' {{(pid=120740) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 18:04:13.815628 dv-cinder-852009-8-iscsi devstack@n-api.service[120740]: DEBUG nova.compute.api [None req-96d8ee49-117d-4779-8d20-af94998f95ec tempest-AttachVolumeShelveTestJSON-385853788 tempest-AttachVolumeShelveTestJSON-385853788-project] [instance: 11d2616a-96f9-4a7a-aab8-219219986a8b] Fetching instance by UUID {{(pid=120740) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 18:04:13.822369 dv-cinder-852009-8-iscsi devstack@n-api.service[120740]: DEBUG oslo_concurrency.lockutils [None req-96d8ee49-117d-4779-8d20-af94998f95ec tempest-AttachVolumeShelveTestJSON-385853788 tempest-AttachVolumeShelveTestJSON-385853788-project] Acquiring lock "1daf4f4c-0e4a-4779-b53a-78c48397ea2f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120740) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 18:04:13.822965 dv-cinder-852009-8-iscsi devstack@n-api.service[120740]: DEBUG oslo_concurrency.lockutils [None req-96d8ee49-117d-4779-8d20-af94998f95ec tempest-AttachVolumeShelveTestJSON-385853788 tempest-AttachVolumeShelveTestJSON-385853788-project] Lock "1daf4f4c-0e4a-4779-b53a-78c48397ea2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120740) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 18:04:13.823498 dv-cinder-852009-8-iscsi devstack@n-api.service[120740]: DEBUG oslo_concurrency.lockutils [None req-96d8ee49-117d-4779-8d20-af94998f95ec tempest-AttachVolumeShelveTestJSON-385853788 tempest-AttachVolumeShelveTestJSON-385853788-project] Lock "1daf4f4c-0e4a-4779-b53a-78c48397ea2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120740) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 18:04:13.824380 dv-cinder-852009-8-iscsi devstack@n-api.service[120740]: DEBUG oslo_concurrency.lockutils [None req-96d8ee49-117d-4779-8d20-af94998f95ec tempest-AttachVolumeShelveTestJSON-385853788 tempest-AttachVolumeShelveTestJSON-385853788-project] Acquiring lock "1daf4f4c-0e4a-4779-b53a-78c48397ea2f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120740) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 18:04:13.824978 dv-cinder-852009-8-iscsi devstack@n-api.service[120740]: DEBUG oslo_concurrency.lockutils [None req-96d8ee49-117d-4779-8d20-af94998f95ec tempest-AttachVolumeShelveTestJSON-385853788 tempest-AttachVolumeShelveTestJSON-385853788-project] Lock "1daf4f4c-0e4a-4779-b53a-78c48397ea2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120740) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 18:04:13.825507 dv-cinder-852009-8-iscsi devstack@n-api.service[120740]: DEBUG oslo_concurrency.lockutils [None req-96d8ee49-117d-4779-8d20-af94998f95ec tempest-AttachVolumeShelveTestJSON-385853788 tempest-AttachVolumeShelveTestJSON-385853788-project] Lock "1daf4f4c-0e4a-4779-b53a-78c48397ea2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120740) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 18:04:14.103144 dv-cinder-852009-8-iscsi devstack@n-api.service[120741]: DEBUG nova.policy [None req-3e8ca841-64da-4fc3-a3dd-816f6f81fe00 tempest-TestShelveInstance-6258502 tempest-TestShelveInstance-6258502-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2ab9930d6ce54cacbb3d4fd6313294d5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5eafd54351bd4049b87ad308a3638f80', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120741) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 18:04:14.111702 dv-cinder-852009-8-iscsi devstack@n-api.service[120740]: DEBUG nova.policy [None req-96d8ee49-117d-4779-8d20-af94998f95ec tempest-AttachVolumeShelveTestJSON-385853788 tempest-AttachVolumeShelveTestJSON-385853788-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e68ecd9b3ca643539b109f75bb242d6f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '75e14fd88bfb4cd896fa7b070a0fac47', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120740) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 18:04:14.111956 dv-cinder-852009-8-iscsi devstack@n-api.service[120741]: INFO nova.api.openstack.requestlog [None req-3e8ca841-64da-4fc3-a3dd-816f6f81fe00 tempest-TestShelveInstance-6258502 tempest-TestShelveInstance-6258502-project] 10.222.0.43 "GET /compute/v2.1/servers/2d60cc6d-a699-417d-aa20-fe3e1bfc351e" status: 200 len: 1261 microversion: 2.1 time: 0.328110 Sep 13 18:04:14.112344 dv-cinder-852009-8-iscsi devstack@n-api.service[120741]: [pid: 120741|app: 0|req: 149/307] 10.222.0.43 () {58 vars in 1236 bytes} [Tue Sep 13 18:04:13 2022] GET /compute/v2.1/servers/2d60cc6d-a699-417d-aa20-fe3e1bfc351e => generated 1261 bytes in 330 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 13 18:04:14.120952 dv-cinder-852009-8-iscsi devstack@n-api.service[120740]: DEBUG nova.policy [None req-96d8ee49-117d-4779-8d20-af94998f95ec tempest-AttachVolumeShelveTestJSON-385853788 tempest-AttachVolumeShelveTestJSON-385853788-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'e68ecd9b3ca643539b109f75bb242d6f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '75e14fd88bfb4cd896fa7b070a0fac47', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120740) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 18:04:14.124130 dv-cinder-852009-8-iscsi devstack@n-api.service[120740]: DEBUG nova.policy [None req-96d8ee49-117d-4779-8d20-af94998f95ec tempest-AttachVolumeShelveTestJSON-385853788 tempest-AttachVolumeShelveTestJSON-385853788-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'e68ecd9b3ca643539b109f75bb242d6f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '75e14fd88bfb4cd896fa7b070a0fac47', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120740) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 18:04:14.124130 dv-cinder-852009-8-iscsi devstack@n-api.service[120740]: INFO nova.api.openstack.requestlog [None req-96d8ee49-117d-4779-8d20-af94998f95ec tempest-AttachVolumeShelveTestJSON-385853788 tempest-AttachVolumeShelveTestJSON-385853788-project] 10.222.0.43 "GET /compute/v2.1/servers/11d2616a-96f9-4a7a-aab8-219219986a8b" status: 200 len: 1720 microversion: 2.20 time: 0.313602 Sep 13 18:04:14.124526 dv-cinder-852009-8-iscsi devstack@n-api.service[120740]: [pid: 120740|app: 0|req: 159/308] 10.222.0.43 () {60 vars in 1277 bytes} [Tue Sep 13 18:04:13 2022] GET /compute/v2.1/servers/11d2616a-96f9-4a7a-aab8-219219986a8b => generated 1720 bytes in 315 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 13 18:04:14.541070 dv-cinder-852009-8-iscsi devstack@n-api.service[120741]: DEBUG nova.api.openstack.wsgi [None req-d9a253aa-c7d5-498b-82cd-2e0ae706be74 tempest-AttachVolumeTestJSON-555093534 tempest-AttachVolumeTestJSON-555093534-project] Calling method '>' {{(pid=120741) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 18:04:14.541868 dv-cinder-852009-8-iscsi devstack@n-api.service[120741]: DEBUG nova.compute.api [None req-d9a253aa-c7d5-498b-82cd-2e0ae706be74 tempest-AttachVolumeTestJSON-555093534 tempest-AttachVolumeTestJSON-555093534-project] [instance: b958d409-df20-44c6-aa0e-58cb0a482edf] Fetching instance by UUID {{(pid=120741) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 18:04:14.548745 dv-cinder-852009-8-iscsi devstack@n-api.service[120741]: DEBUG oslo_concurrency.lockutils [None req-d9a253aa-c7d5-498b-82cd-2e0ae706be74 tempest-AttachVolumeTestJSON-555093534 tempest-AttachVolumeTestJSON-555093534-project] Acquiring lock "1daf4f4c-0e4a-4779-b53a-78c48397ea2f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120741) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 18:04:14.549242 dv-cinder-852009-8-iscsi devstack@n-api.service[120741]: DEBUG oslo_concurrency.lockutils [None req-d9a253aa-c7d5-498b-82cd-2e0ae706be74 tempest-AttachVolumeTestJSON-555093534 tempest-AttachVolumeTestJSON-555093534-project] Lock "1daf4f4c-0e4a-4779-b53a-78c48397ea2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120741) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 18:04:14.549747 dv-cinder-852009-8-iscsi devstack@n-api.service[120741]: DEBUG oslo_concurrency.lockutils [None req-d9a253aa-c7d5-498b-82cd-2e0ae706be74 tempest-AttachVolumeTestJSON-555093534 tempest-AttachVolumeTestJSON-555093534-project] Lock "1daf4f4c-0e4a-4779-b53a-78c48397ea2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120741) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 18:04:14.550454 dv-cinder-852009-8-iscsi devstack@n-api.service[120741]: DEBUG oslo_concurrency.lockutils [None req-d9a253aa-c7d5-498b-82cd-2e0ae706be74 tempest-AttachVolumeTestJSON-555093534 tempest-AttachVolumeTestJSON-555093534-project] Acquiring lock "1daf4f4c-0e4a-4779-b53a-78c48397ea2f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120741) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 18:04:14.551212 dv-cinder-852009-8-iscsi devstack@n-api.service[120741]: DEBUG oslo_concurrency.lockutils [None req-d9a253aa-c7d5-498b-82cd-2e0ae706be74 tempest-AttachVolumeTestJSON-555093534 tempest-AttachVolumeTestJSON-555093534-project] Lock "1daf4f4c-0e4a-4779-b53a-78c48397ea2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120741) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 18:04:14.551848 dv-cinder-852009-8-iscsi devstack@n-api.service[120741]: DEBUG oslo_concurrency.lockutils [None req-d9a253aa-c7d5-498b-82cd-2e0ae706be74 tempest-AttachVolumeTestJSON-555093534 tempest-AttachVolumeTestJSON-555093534-project] Lock "1daf4f4c-0e4a-4779-b53a-78c48397ea2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120741) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 18:04:14.559292 dv-cinder-852009-8-iscsi devstack@n-api.service[120740]: DEBUG nova.api.openstack.wsgi [req-4e6396a9-dac6-4a79-a53f-6defbe681f4c req-b5bfe10a-2b14-49c0-9e3e-30b550abc3b1 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "2d60cc6d-a699-417d-aa20-fe3e1bfc351e", "name": "network-vif-plugged", "status": "completed", "tag": "fa199ada-f924-4f1a-9116-5daf985f618d"}]} {{(pid=120740) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 13 18:04:14.569998 dv-cinder-852009-8-iscsi devstack@n-api.service[120740]: DEBUG oslo_concurrency.lockutils [req-4e6396a9-dac6-4a79-a53f-6defbe681f4c req-b5bfe10a-2b14-49c0-9e3e-30b550abc3b1 service nova] Acquiring lock "1daf4f4c-0e4a-4779-b53a-78c48397ea2f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120740) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 18:04:14.570582 dv-cinder-852009-8-iscsi devstack@n-api.service[120740]: DEBUG oslo_concurrency.lockutils [req-4e6396a9-dac6-4a79-a53f-6defbe681f4c req-b5bfe10a-2b14-49c0-9e3e-30b550abc3b1 service nova] Lock "1daf4f4c-0e4a-4779-b53a-78c48397ea2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120740) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 18:04:14.571047 dv-cinder-852009-8-iscsi devstack@n-api.service[120740]: DEBUG oslo_concurrency.lockutils [req-4e6396a9-dac6-4a79-a53f-6defbe681f4c req-b5bfe10a-2b14-49c0-9e3e-30b550abc3b1 service nova] Lock "1daf4f4c-0e4a-4779-b53a-78c48397ea2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120740) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 18:04:14.585832 dv-cinder-852009-8-iscsi devstack@n-api.service[120740]: INFO nova.api.openstack.compute.server_external_events [req-4e6396a9-dac6-4a79-a53f-6defbe681f4c req-b5bfe10a-2b14-49c0-9e3e-30b550abc3b1 service nova] Creating event network-vif-plugged:fa199ada-f924-4f1a-9116-5daf985f618d for instance 2d60cc6d-a699-417d-aa20-fe3e1bfc351e on hv-cinder-85200 Sep 13 18:04:14.591350 dv-cinder-852009-8-iscsi devstack@n-api.service[120740]: INFO nova.api.openstack.requestlog [req-4e6396a9-dac6-4a79-a53f-6defbe681f4c req-b5bfe10a-2b14-49c0-9e3e-30b550abc3b1 service nova] 10.222.0.43 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.036203 Sep 13 18:04:14.591945 dv-cinder-852009-8-iscsi devstack@n-api.service[120740]: [pid: 120740|app: 0|req: 160/309] 10.222.0.43 () {64 vars in 1317 bytes} [Tue Sep 13 18:04:14 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 38 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 13 18:04:14.687766 dv-cinder-852009-8-iscsi devstack@n-api.service[120741]: DEBUG nova.policy [None req-d9a253aa-c7d5-498b-82cd-2e0ae706be74 tempest-AttachVolumeTestJSON-555093534 tempest-AttachVolumeTestJSON-555093534-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0625b3113ce044bbac4f6142eaade11c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a279fcbf274c4704a31a2b95061e1469', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120741) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 18:04:14.698536 dv-cinder-852009-8-iscsi devstack@n-api.service[120741]: INFO nova.api.openstack.requestlog [None req-d9a253aa-c7d5-498b-82cd-2e0ae706be74 tempest-AttachVolumeTestJSON-555093534 tempest-AttachVolumeTestJSON-555093534-project] 10.222.0.43 "GET /compute/v2.1/servers/b958d409-df20-44c6-aa0e-58cb0a482edf" status: 200 len: 1724 microversion: 2.1 time: 0.161532 Sep 13 18:04:14.699146 dv-cinder-852009-8-iscsi devstack@n-api.service[120741]: [pid: 120741|app: 0|req: 150/310] 10.222.0.43 () {58 vars in 1236 bytes} [Tue Sep 13 18:04:14 2022] GET /compute/v2.1/servers/b958d409-df20-44c6-aa0e-58cb0a482edf => generated 1724 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 13 18:04:15.140155 dv-cinder-852009-8-iscsi devstack@n-api.service[120740]: DEBUG nova.api.openstack.wsgi [None req-714fc0e1-1bcf-43d7-91f3-219631e7fdce tempest-TestShelveInstance-6258502 tempest-TestShelveInstance-6258502-project] Calling method '>' {{(pid=120740) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 18:04:15.140786 dv-cinder-852009-8-iscsi devstack@n-api.service[120740]: DEBUG nova.compute.api [None req-714fc0e1-1bcf-43d7-91f3-219631e7fdce tempest-TestShelveInstance-6258502 tempest-TestShelveInstance-6258502-project] [instance: 2d60cc6d-a699-417d-aa20-fe3e1bfc351e] Fetching instance by UUID {{(pid=120740) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 18:04:15.147937 dv-cinder-852009-8-iscsi devstack@n-api.service[120740]: DEBUG oslo_concurrency.lockutils [None req-714fc0e1-1bcf-43d7-91f3-219631e7fdce tempest-TestShelveInstance-6258502 tempest-TestShelveInstance-6258502-project] Acquiring lock "1daf4f4c-0e4a-4779-b53a-78c48397ea2f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120740) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 18:04:15.148410 dv-cinder-852009-8-iscsi devstack@n-api.service[120740]: DEBUG oslo_concurrency.lockutils [None req-714fc0e1-1bcf-43d7-91f3-219631e7fdce tempest-TestShelveInstance-6258502 tempest-TestShelveInstance-6258502-project] Lock "1daf4f4c-0e4a-4779-b53a-78c48397ea2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120740) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 18:04:15.148863 dv-cinder-852009-8-iscsi devstack@n-api.service[120740]: DEBUG oslo_concurrency.lockutils [None req-714fc0e1-1bcf-43d7-91f3-219631e7fdce tempest-TestShelveInstance-6258502 tempest-TestShelveInstance-6258502-project] Lock "1daf4f4c-0e4a-4779-b53a-78c48397ea2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120740) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 18:04:15.149576 dv-cinder-852009-8-iscsi devstack@n-api.service[120740]: DEBUG oslo_concurrency.lockutils [None req-714fc0e1-1bcf-43d7-91f3-219631e7fdce tempest-TestShelveInstance-6258502 tempest-TestShelveInstance-6258502-project] Acquiring lock "1daf4f4c-0e4a-4779-b53a-78c48397ea2f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120740) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 18:04:15.150030 dv-cinder-852009-8-iscsi devstack@n-api.service[120740]: DEBUG oslo_concurrency.lockutils [None req-714fc0e1-1bcf-43d7-91f3-219631e7fdce tempest-TestShelveInstance-6258502 tempest-TestShelveInstance-6258502-project] Lock "1daf4f4c-0e4a-4779-b53a-78c48397ea2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120740) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 18:04:15.150482 dv-cinder-852009-8-iscsi devstack@n-api.service[120740]: DEBUG oslo_concurrency.lockutils [None req-714fc0e1-1bcf-43d7-91f3-219631e7fdce tempest-TestShelveInstance-6258502 tempest-TestShelveInstance-6258502-project] Lock "1daf4f4c-0e4a-4779-b53a-78c48397ea2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120740) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 18:04:15.151017 dv-cinder-852009-8-iscsi devstack@n-api.service[120741]: DEBUG nova.api.openstack.wsgi [None req-10aeb913-8d8d-46e8-b0e4-831a13dcf583 tempest-AttachVolumeShelveTestJSON-385853788 tempest-AttachVolumeShelveTestJSON-385853788-project] Calling method '>' {{(pid=120741) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 18:04:15.151873 dv-cinder-852009-8-iscsi devstack@n-api.service[120741]: DEBUG nova.compute.api [None req-10aeb913-8d8d-46e8-b0e4-831a13dcf583 tempest-AttachVolumeShelveTestJSON-385853788 tempest-AttachVolumeShelveTestJSON-385853788-project] [instance: 11d2616a-96f9-4a7a-aab8-219219986a8b] Fetching instance by UUID {{(pid=120741) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 18:04:15.154313 dv-cinder-852009-8-iscsi devstack@n-api.service[120741]: DEBUG dbcounter [-] [120741] Writing DB stats nova_api:SELECT=96,nova_api:INSERT=4 {{(pid=120741) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 18:04:15.159764 dv-cinder-852009-8-iscsi devstack@n-api.service[120741]: DEBUG oslo_concurrency.lockutils [None req-10aeb913-8d8d-46e8-b0e4-831a13dcf583 tempest-AttachVolumeShelveTestJSON-385853788 tempest-AttachVolumeShelveTestJSON-385853788-project] Acquiring lock "1daf4f4c-0e4a-4779-b53a-78c48397ea2f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120741) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 18:04:15.160253 dv-cinder-852009-8-iscsi devstack@n-api.service[120741]: DEBUG oslo_concurrency.lockutils [None req-10aeb913-8d8d-46e8-b0e4-831a13dcf583 tempest-AttachVolumeShelveTestJSON-385853788 tempest-AttachVolumeShelveTestJSON-385853788-project] Lock "1daf4f4c-0e4a-4779-b53a-78c48397ea2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120741) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 18:04:15.160702 dv-cinder-852009-8-iscsi devstack@n-api.service[120741]: DEBUG oslo_concurrency.lockutils [None req-10aeb913-8d8d-46e8-b0e4-831a13dcf583 tempest-AttachVolumeShelveTestJSON-385853788 tempest-AttachVolumeShelveTestJSON-385853788-project] Lock "1daf4f4c-0e4a-4779-b53a-78c48397ea2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120741) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 18:04:15.161407 dv-cinder-852009-8-iscsi devstack@n-api.service[120741]: DEBUG oslo_concurrency.lockutils [None req-10aeb913-8d8d-46e8-b0e4-831a13dcf583 tempest-AttachVolumeShelveTestJSON-385853788 tempest-AttachVolumeShelveTestJSON-385853788-project] Acquiring lock "1daf4f4c-0e4a-4779-b53a-78c48397ea2f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120741) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 18:04:15.161854 dv-cinder-852009-8-iscsi devstack@n-api.service[120741]: DEBUG oslo_concurrency.lockutils [None req-10aeb913-8d8d-46e8-b0e4-831a13dcf583 tempest-AttachVolumeShelveTestJSON-385853788 tempest-AttachVolumeShelveTestJSON-385853788-project] Lock "1daf4f4c-0e4a-4779-b53a-78c48397ea2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120741) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 18:04:15.162267 dv-cinder-852009-8-iscsi devstack@n-api.service[120741]: DEBUG oslo_concurrency.lockutils [None req-10aeb913-8d8d-46e8-b0e4-831a13dcf583 tempest-AttachVolumeShelveTestJSON-385853788 tempest-AttachVolumeShelveTestJSON-385853788-project] Lock "1daf4f4c-0e4a-4779-b53a-78c48397ea2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120741) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 18:04:15.582157 dv-cinder-852009-8-iscsi devstack@n-api.service[120740]: DEBUG nova.policy [None req-714fc0e1-1bcf-43d7-91f3-219631e7fdce tempest-TestShelveInstance-6258502 tempest-TestShelveInstance-6258502-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2ab9930d6ce54cacbb3d4fd6313294d5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5eafd54351bd4049b87ad308a3638f80', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120740) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 18:04:15.585894 dv-cinder-852009-8-iscsi devstack@n-api.service[120741]: DEBUG nova.policy [None req-10aeb913-8d8d-46e8-b0e4-831a13dcf583 tempest-AttachVolumeShelveTestJSON-385853788 tempest-AttachVolumeShelveTestJSON-385853788-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e68ecd9b3ca643539b109f75bb242d6f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '75e14fd88bfb4cd896fa7b070a0fac47', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120741) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 18:04:15.590621 dv-cinder-852009-8-iscsi devstack@n-api.service[120740]: INFO nova.api.openstack.requestlog [None req-714fc0e1-1bcf-43d7-91f3-219631e7fdce tempest-TestShelveInstance-6258502 tempest-TestShelveInstance-6258502-project] 10.222.0.43 "GET /compute/v2.1/servers/2d60cc6d-a699-417d-aa20-fe3e1bfc351e" status: 200 len: 1261 microversion: 2.1 time: 0.455460 Sep 13 18:04:15.591366 dv-cinder-852009-8-iscsi devstack@n-api.service[120740]: [pid: 120740|app: 0|req: 161/311] 10.222.0.43 () {58 vars in 1236 bytes} [Tue Sep 13 18:04:15 2022] GET /compute/v2.1/servers/2d60cc6d-a699-417d-aa20-fe3e1bfc351e => generated 1261 bytes in 457 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 13 18:04:15.594563 dv-cinder-852009-8-iscsi devstack@n-api.service[120741]: DEBUG nova.policy [None req-10aeb913-8d8d-46e8-b0e4-831a13dcf583 tempest-AttachVolumeShelveTestJSON-385853788 tempest-AttachVolumeShelveTestJSON-385853788-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'e68ecd9b3ca643539b109f75bb242d6f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '75e14fd88bfb4cd896fa7b070a0fac47', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120741) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 18:04:15.596460 dv-cinder-852009-8-iscsi devstack@n-api.service[120741]: DEBUG nova.policy [None req-10aeb913-8d8d-46e8-b0e4-831a13dcf583 tempest-AttachVolumeShelveTestJSON-385853788 tempest-AttachVolumeShelveTestJSON-385853788-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'e68ecd9b3ca643539b109f75bb242d6f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '75e14fd88bfb4cd896fa7b070a0fac47', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120741) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 18:04:15.597729 dv-cinder-852009-8-iscsi devstack@n-api.service[120741]: INFO nova.api.openstack.requestlog [None req-10aeb913-8d8d-46e8-b0e4-831a13dcf583 tempest-AttachVolumeShelveTestJSON-385853788 tempest-AttachVolumeShelveTestJSON-385853788-project] 10.222.0.43 "GET /compute/v2.1/servers/11d2616a-96f9-4a7a-aab8-219219986a8b" status: 200 len: 1720 microversion: 2.20 time: 0.451404 Sep 13 18:04:15.598374 dv-cinder-852009-8-iscsi devstack@n-api.service[120741]: [pid: 120741|app: 0|req: 151/312] 10.222.0.43 () {60 vars in 1277 bytes} [Tue Sep 13 18:04:15 2022] GET /compute/v2.1/servers/11d2616a-96f9-4a7a-aab8-219219986a8b => generated 1720 bytes in 453 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Sep 13 18:04:15.726982 dv-cinder-852009-8-iscsi devstack@n-api.service[120740]: DEBUG nova.api.openstack.wsgi [None req-105cfe49-50b4-4c2a-be62-323603fa1db2 tempest-AttachVolumeTestJSON-555093534 tempest-AttachVolumeTestJSON-555093534-project] Calling method '>' {{(pid=120740) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 18:04:15.727911 dv-cinder-852009-8-iscsi devstack@n-api.service[120740]: DEBUG nova.compute.api [None req-105cfe49-50b4-4c2a-be62-323603fa1db2 tempest-AttachVolumeTestJSON-555093534 tempest-AttachVolumeTestJSON-555093534-project] [instance: b958d409-df20-44c6-aa0e-58cb0a482edf] Fetching instance by UUID {{(pid=120740) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 18:04:15.734684 dv-cinder-852009-8-iscsi devstack@n-api.service[120740]: DEBUG oslo_concurrency.lockutils [None req-105cfe49-50b4-4c2a-be62-323603fa1db2 tempest-AttachVolumeTestJSON-555093534 tempest-AttachVolumeTestJSON-555093534-project] Acquiring lock "1daf4f4c-0e4a-4779-b53a-78c48397ea2f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120740) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 18:04:15.735181 dv-cinder-852009-8-iscsi devstack@n-api.service[120740]: DEBUG oslo_concurrency.lockutils [None req-105cfe49-50b4-4c2a-be62-323603fa1db2 tempest-AttachVolumeTestJSON-555093534 tempest-AttachVolumeTestJSON-555093534-project] Lock "1daf4f4c-0e4a-4779-b53a-78c48397ea2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120740) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 18:04:15.735616 dv-cinder-852009-8-iscsi devstack@n-api.service[120740]: DEBUG oslo_concurrency.lockutils [None req-105cfe49-50b4-4c2a-be62-323603fa1db2 tempest-AttachVolumeTestJSON-555093534 tempest-AttachVolumeTestJSON-555093534-project] Lock "1daf4f4c-0e4a-4779-b53a-78c48397ea2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120740) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 18:04:15.736309 dv-cinder-852009-8-iscsi devstack@n-api.service[120740]: DEBUG oslo_concurrency.lockutils [None req-105cfe49-50b4-4c2a-be62-323603fa1db2 tempest-AttachVolumeTestJSON-555093534 tempest-AttachVolumeTestJSON-555093534-project] Acquiring lock "1daf4f4c-0e4a-4779-b53a-78c48397ea2f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120740) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 18:04:15.737133 dv-cinder-852009-8-iscsi devstack@n-api.service[120740]: DEBUG oslo_concurrency.lockutils [None req-105cfe49-50b4-4c2a-be62-323603fa1db2 tempest-AttachVolumeTestJSON-555093534 tempest-AttachVolumeTestJSON-555093534-project] Lock "1daf4f4c-0e4a-4779-b53a-78c48397ea2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120740) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 18:04:15.737735 dv-cinder-852009-8-iscsi devstack@n-api.service[120740]: DEBUG oslo_concurrency.lockutils [None req-105cfe49-50b4-4c2a-be62-323603fa1db2 tempest-AttachVolumeTestJSON-555093534 tempest-AttachVolumeTestJSON-555093534-project] Lock "1daf4f4c-0e4a-4779-b53a-78c48397ea2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120740) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 18:04:15.880909 dv-cinder-852009-8-iscsi devstack@n-api.service[120740]: DEBUG nova.policy [None req-105cfe49-50b4-4c2a-be62-323603fa1db2 tempest-AttachVolumeTestJSON-555093534 tempest-AttachVolumeTestJSON-555093534-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0625b3113ce044bbac4f6142eaade11c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a279fcbf274c4704a31a2b95061e1469', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120740) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 18:04:15.889709 dv-cinder-852009-8-iscsi devstack@n-api.service[120740]: INFO nova.api.openstack.requestlog [None req-105cfe49-50b4-4c2a-be62-323603fa1db2 tempest-AttachVolumeTestJSON-555093534 tempest-AttachVolumeTestJSON-555093534-project] 10.222.0.43 "GET /compute/v2.1/servers/b958d409-df20-44c6-aa0e-58cb0a482edf" status: 200 len: 1724 microversion: 2.1 time: 0.170218 Sep 13 18:04:15.890274 dv-cinder-852009-8-iscsi devstack@n-api.service[120740]: [pid: 120740|app: 0|req: 162/313] 10.222.0.43 () {58 vars in 1236 bytes} [Tue Sep 13 18:04:15 2022] GET /compute/v2.1/servers/b958d409-df20-44c6-aa0e-58cb0a482edf => generated 1724 bytes in 172 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 13 18:04:16.606885 dv-cinder-852009-8-iscsi devstack@n-api.service[120741]: DEBUG nova.api.openstack.wsgi [req-f01c369c-3068-411c-8efe-0188f1588eea req-df053c69-0488-44a6-8b4e-1746e26bb4c3 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "11d2616a-96f9-4a7a-aab8-219219986a8b", "name": "network-vif-unplugged", "status": "completed", "tag": "85bfb53c-ec3d-49bc-ade7-acdfac253331"}]} {{(pid=120741) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 13 18:04:16.612874 dv-cinder-852009-8-iscsi devstack@n-api.service[120740]: DEBUG nova.api.openstack.wsgi [None req-2e93333e-b4d1-4536-9a09-964a580e0dd8 tempest-TestShelveInstance-6258502 tempest-TestShelveInstance-6258502-project] Calling method '>' {{(pid=120740) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 18:04:16.613474 dv-cinder-852009-8-iscsi devstack@n-api.service[120740]: DEBUG nova.compute.api [None req-2e93333e-b4d1-4536-9a09-964a580e0dd8 tempest-TestShelveInstance-6258502 tempest-TestShelveInstance-6258502-project] [instance: 2d60cc6d-a699-417d-aa20-fe3e1bfc351e] Fetching instance by UUID {{(pid=120740) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 18:04:16.619010 dv-cinder-852009-8-iscsi devstack@n-api.service[120741]: DEBUG oslo_concurrency.lockutils [req-f01c369c-3068-411c-8efe-0188f1588eea req-df053c69-0488-44a6-8b4e-1746e26bb4c3 service nova] Acquiring lock "1daf4f4c-0e4a-4779-b53a-78c48397ea2f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120741) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 18:04:16.619527 dv-cinder-852009-8-iscsi devstack@n-api.service[120741]: DEBUG oslo_concurrency.lockutils [req-f01c369c-3068-411c-8efe-0188f1588eea req-df053c69-0488-44a6-8b4e-1746e26bb4c3 service nova] Lock "1daf4f4c-0e4a-4779-b53a-78c48397ea2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120741) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 18:04:16.619963 dv-cinder-852009-8-iscsi devstack@n-api.service[120741]: DEBUG oslo_concurrency.lockutils [req-f01c369c-3068-411c-8efe-0188f1588eea req-df053c69-0488-44a6-8b4e-1746e26bb4c3 service nova] Lock "1daf4f4c-0e4a-4779-b53a-78c48397ea2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120741) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 18:04:16.620119 dv-cinder-852009-8-iscsi devstack@n-api.service[120740]: DEBUG oslo_concurrency.lockutils [None req-2e93333e-b4d1-4536-9a09-964a580e0dd8 tempest-TestShelveInstance-6258502 tempest-TestShelveInstance-6258502-project] Acquiring lock "1daf4f4c-0e4a-4779-b53a-78c48397ea2f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120740) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 18:04:16.620452 dv-cinder-852009-8-iscsi devstack@n-api.service[120740]: DEBUG oslo_concurrency.lockutils [None req-2e93333e-b4d1-4536-9a09-964a580e0dd8 tempest-TestShelveInstance-6258502 tempest-TestShelveInstance-6258502-project] Lock "1daf4f4c-0e4a-4779-b53a-78c48397ea2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120740) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 18:04:16.620900 dv-cinder-852009-8-iscsi devstack@n-api.service[120740]: DEBUG oslo_concurrency.lockutils [None req-2e93333e-b4d1-4536-9a09-964a580e0dd8 tempest-TestShelveInstance-6258502 tempest-TestShelveInstance-6258502-project] Lock "1daf4f4c-0e4a-4779-b53a-78c48397ea2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120740) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 18:04:16.621625 dv-cinder-852009-8-iscsi devstack@n-api.service[120740]: DEBUG oslo_concurrency.lockutils [None req-2e93333e-b4d1-4536-9a09-964a580e0dd8 tempest-TestShelveInstance-6258502 tempest-TestShelveInstance-6258502-project] Acquiring lock "1daf4f4c-0e4a-4779-b53a-78c48397ea2f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120740) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 18:04:16.622056 dv-cinder-852009-8-iscsi devstack@n-api.service[120740]: DEBUG oslo_concurrency.lockutils [None req-2e93333e-b4d1-4536-9a09-964a580e0dd8 tempest-TestShelveInstance-6258502 tempest-TestShelveInstance-6258502-project] Lock "1daf4f4c-0e4a-4779-b53a-78c48397ea2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120740) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 18:04:16.622482 dv-cinder-852009-8-iscsi devstack@n-api.service[120740]: DEBUG oslo_concurrency.lockutils [None req-2e93333e-b4d1-4536-9a09-964a580e0dd8 tempest-TestShelveInstance-6258502 tempest-TestShelveInstance-6258502-project] Lock "1daf4f4c-0e4a-4779-b53a-78c48397ea2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120740) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 18:04:16.632098 dv-cinder-852009-8-iscsi devstack@n-api.service[120741]: INFO nova.api.openstack.compute.server_external_events [req-f01c369c-3068-411c-8efe-0188f1588eea req-df053c69-0488-44a6-8b4e-1746e26bb4c3 service nova] Creating event network-vif-unplugged:85bfb53c-ec3d-49bc-ade7-acdfac253331 for instance 11d2616a-96f9-4a7a-aab8-219219986a8b on hv-cinder-85200 Sep 13 18:04:16.637416 dv-cinder-852009-8-iscsi devstack@n-api.service[120741]: INFO nova.api.openstack.requestlog [req-f01c369c-3068-411c-8efe-0188f1588eea req-df053c69-0488-44a6-8b4e-1746e26bb4c3 service nova] 10.222.0.43 "POST /compute/v2.1/os-server-external-events" status: 200 len: 185 microversion: 2.1 time: 0.035133 Sep 13 18:04:16.638009 dv-cinder-852009-8-iscsi devstack@n-api.service[120741]: [pid: 120741|app: 0|req: 152/314] 10.222.0.43 () {64 vars in 1317 bytes} [Tue Sep 13 18:04:16 2022] POST /compute/v2.1/os-server-external-events => generated 185 bytes in 37 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 13 18:04:16.643065 dv-cinder-852009-8-iscsi devstack@n-api.service[120741]: DEBUG nova.api.openstack.wsgi [None req-bd9a0410-6fd5-4696-863d-c731217ee13c tempest-AttachVolumeShelveTestJSON-385853788 tempest-AttachVolumeShelveTestJSON-385853788-project] Calling method '>' {{(pid=120741) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 18:04:16.643754 dv-cinder-852009-8-iscsi devstack@n-api.service[120741]: DEBUG nova.compute.api [None req-bd9a0410-6fd5-4696-863d-c731217ee13c tempest-AttachVolumeShelveTestJSON-385853788 tempest-AttachVolumeShelveTestJSON-385853788-project] [instance: 11d2616a-96f9-4a7a-aab8-219219986a8b] Fetching instance by UUID {{(pid=120741) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 18:04:16.649978 dv-cinder-852009-8-iscsi devstack@n-api.service[120741]: DEBUG oslo_concurrency.lockutils [None req-bd9a0410-6fd5-4696-863d-c731217ee13c tempest-AttachVolumeShelveTestJSON-385853788 tempest-AttachVolumeShelveTestJSON-385853788-project] Acquiring lock "1daf4f4c-0e4a-4779-b53a-78c48397ea2f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120741) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 18:04:16.650521 dv-cinder-852009-8-iscsi devstack@n-api.service[120741]: DEBUG oslo_concurrency.lockutils [None req-bd9a0410-6fd5-4696-863d-c731217ee13c tempest-AttachVolumeShelveTestJSON-385853788 tempest-AttachVolumeShelveTestJSON-385853788-project] Lock "1daf4f4c-0e4a-4779-b53a-78c48397ea2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120741) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 18:04:16.650899 dv-cinder-852009-8-iscsi devstack@n-api.service[120741]: DEBUG oslo_concurrency.lockutils [None req-bd9a0410-6fd5-4696-863d-c731217ee13c tempest-AttachVolumeShelveTestJSON-385853788 tempest-AttachVolumeShelveTestJSON-385853788-project] Lock "1daf4f4c-0e4a-4779-b53a-78c48397ea2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120741) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 18:04:16.651637 dv-cinder-852009-8-iscsi devstack@n-api.service[120741]: DEBUG oslo_concurrency.lockutils [None req-bd9a0410-6fd5-4696-863d-c731217ee13c tempest-AttachVolumeShelveTestJSON-385853788 tempest-AttachVolumeShelveTestJSON-385853788-project] Acquiring lock "1daf4f4c-0e4a-4779-b53a-78c48397ea2f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120741) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 18:04:16.652092 dv-cinder-852009-8-iscsi devstack@n-api.service[120741]: DEBUG oslo_concurrency.lockutils [None req-bd9a0410-6fd5-4696-863d-c731217ee13c tempest-AttachVolumeShelveTestJSON-385853788 tempest-AttachVolumeShelveTestJSON-385853788-project] Lock "1daf4f4c-0e4a-4779-b53a-78c48397ea2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120741) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 18:04:16.652546 dv-cinder-852009-8-iscsi devstack@n-api.service[120741]: DEBUG oslo_concurrency.lockutils [None req-bd9a0410-6fd5-4696-863d-c731217ee13c tempest-AttachVolumeShelveTestJSON-385853788 tempest-AttachVolumeShelveTestJSON-385853788-project] Lock "1daf4f4c-0e4a-4779-b53a-78c48397ea2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120741) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 18:04:16.810099 dv-cinder-852009-8-iscsi devstack@n-api.service[120740]: DEBUG nova.policy [None req-2e93333e-b4d1-4536-9a09-964a580e0dd8 tempest-TestShelveInstance-6258502 tempest-TestShelveInstance-6258502-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2ab9930d6ce54cacbb3d4fd6313294d5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5eafd54351bd4049b87ad308a3638f80', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120740) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 18:04:16.818571 dv-cinder-852009-8-iscsi devstack@n-api.service[120740]: INFO nova.api.openstack.requestlog [None req-2e93333e-b4d1-4536-9a09-964a580e0dd8 tempest-TestShelveInstance-6258502 tempest-TestShelveInstance-6258502-project] 10.222.0.43 "GET /compute/v2.1/servers/2d60cc6d-a699-417d-aa20-fe3e1bfc351e" status: 200 len: 1261 microversion: 2.1 time: 0.209365 Sep 13 18:04:16.819111 dv-cinder-852009-8-iscsi devstack@n-api.service[120740]: [pid: 120740|app: 0|req: 163/315] 10.222.0.43 () {58 vars in 1236 bytes} [Tue Sep 13 18:04:16 2022] GET /compute/v2.1/servers/2d60cc6d-a699-417d-aa20-fe3e1bfc351e => generated 1261 bytes in 211 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 13 18:04:16.838547 dv-cinder-852009-8-iscsi devstack@n-api.service[120741]: DEBUG nova.policy [None req-bd9a0410-6fd5-4696-863d-c731217ee13c tempest-AttachVolumeShelveTestJSON-385853788 tempest-AttachVolumeShelveTestJSON-385853788-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e68ecd9b3ca643539b109f75bb242d6f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '75e14fd88bfb4cd896fa7b070a0fac47', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120741) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 18:04:16.847247 dv-cinder-852009-8-iscsi devstack@n-api.service[120741]: DEBUG nova.policy [None req-bd9a0410-6fd5-4696-863d-c731217ee13c tempest-AttachVolumeShelveTestJSON-385853788 tempest-AttachVolumeShelveTestJSON-385853788-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'e68ecd9b3ca643539b109f75bb242d6f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '75e14fd88bfb4cd896fa7b070a0fac47', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120741) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 18:04:16.848846 dv-cinder-852009-8-iscsi devstack@n-api.service[120741]: DEBUG nova.policy [None req-bd9a0410-6fd5-4696-863d-c731217ee13c tempest-AttachVolumeShelveTestJSON-385853788 tempest-AttachVolumeShelveTestJSON-385853788-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'e68ecd9b3ca643539b109f75bb242d6f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '75e14fd88bfb4cd896fa7b070a0fac47', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120741) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 18:04:16.850020 dv-cinder-852009-8-iscsi devstack@n-api.service[120741]: INFO nova.api.openstack.requestlog [None req-bd9a0410-6fd5-4696-863d-c731217ee13c tempest-AttachVolumeShelveTestJSON-385853788 tempest-AttachVolumeShelveTestJSON-385853788-project] 10.222.0.43 "GET /compute/v2.1/servers/11d2616a-96f9-4a7a-aab8-219219986a8b" status: 200 len: 1723 microversion: 2.20 time: 0.210919 Sep 13 18:04:16.850674 dv-cinder-852009-8-iscsi devstack@n-api.service[120741]: [pid: 120741|app: 0|req: 153/316] 10.222.0.43 () {60 vars in 1277 bytes} [Tue Sep 13 18:04:16 2022] GET /compute/v2.1/servers/11d2616a-96f9-4a7a-aab8-219219986a8b => generated 1723 bytes in 212 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 13 18:04:16.876723 dv-cinder-852009-8-iscsi devstack@n-api.service[120740]: DEBUG nova.api.openstack.wsgi [None req-f64d363e-4450-4348-b2ad-a03663916c07 tempest-AttachVolumeShelveTestJSON-385853788 tempest-AttachVolumeShelveTestJSON-385853788-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "966c4c3d-084a-41d9-893a-39e5c5518786"}} {{(pid=120740) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 13 18:04:16.879607 dv-cinder-852009-8-iscsi devstack@n-api.service[120740]: DEBUG nova.compute.api [None req-f64d363e-4450-4348-b2ad-a03663916c07 tempest-AttachVolumeShelveTestJSON-385853788 tempest-AttachVolumeShelveTestJSON-385853788-project] [instance: 11d2616a-96f9-4a7a-aab8-219219986a8b] Fetching instance by UUID {{(pid=120740) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 18:04:16.886553 dv-cinder-852009-8-iscsi devstack@n-api.service[120740]: DEBUG oslo_concurrency.lockutils [None req-f64d363e-4450-4348-b2ad-a03663916c07 tempest-AttachVolumeShelveTestJSON-385853788 tempest-AttachVolumeShelveTestJSON-385853788-project] Acquiring lock "1daf4f4c-0e4a-4779-b53a-78c48397ea2f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120740) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 18:04:16.887169 dv-cinder-852009-8-iscsi devstack@n-api.service[120740]: DEBUG oslo_concurrency.lockutils [None req-f64d363e-4450-4348-b2ad-a03663916c07 tempest-AttachVolumeShelveTestJSON-385853788 tempest-AttachVolumeShelveTestJSON-385853788-project] Lock "1daf4f4c-0e4a-4779-b53a-78c48397ea2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120740) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 18:04:16.887481 dv-cinder-852009-8-iscsi devstack@n-api.service[120740]: DEBUG oslo_concurrency.lockutils [None req-f64d363e-4450-4348-b2ad-a03663916c07 tempest-AttachVolumeShelveTestJSON-385853788 tempest-AttachVolumeShelveTestJSON-385853788-project] Lock "1daf4f4c-0e4a-4779-b53a-78c48397ea2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120740) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 18:04:16.888179 dv-cinder-852009-8-iscsi devstack@n-api.service[120740]: DEBUG oslo_concurrency.lockutils [None req-f64d363e-4450-4348-b2ad-a03663916c07 tempest-AttachVolumeShelveTestJSON-385853788 tempest-AttachVolumeShelveTestJSON-385853788-project] Acquiring lock "1daf4f4c-0e4a-4779-b53a-78c48397ea2f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120740) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 18:04:16.888699 dv-cinder-852009-8-iscsi devstack@n-api.service[120740]: DEBUG oslo_concurrency.lockutils [None req-f64d363e-4450-4348-b2ad-a03663916c07 tempest-AttachVolumeShelveTestJSON-385853788 tempest-AttachVolumeShelveTestJSON-385853788-project] Lock "1daf4f4c-0e4a-4779-b53a-78c48397ea2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120740) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 18:04:16.889055 dv-cinder-852009-8-iscsi devstack@n-api.service[120740]: DEBUG oslo_concurrency.lockutils [None req-f64d363e-4450-4348-b2ad-a03663916c07 tempest-AttachVolumeShelveTestJSON-385853788 tempest-AttachVolumeShelveTestJSON-385853788-project] Lock "1daf4f4c-0e4a-4779-b53a-78c48397ea2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120740) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 18:04:16.914187 dv-cinder-852009-8-iscsi devstack@n-api.service[120741]: DEBUG nova.api.openstack.wsgi [None req-46605c8a-051b-4698-a952-5f44f588128e tempest-AttachVolumeTestJSON-555093534 tempest-AttachVolumeTestJSON-555093534-project] Calling method '>' {{(pid=120741) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 18:04:16.914819 dv-cinder-852009-8-iscsi devstack@n-api.service[120741]: DEBUG nova.compute.api [None req-46605c8a-051b-4698-a952-5f44f588128e tempest-AttachVolumeTestJSON-555093534 tempest-AttachVolumeTestJSON-555093534-project] [instance: b958d409-df20-44c6-aa0e-58cb0a482edf] Fetching instance by UUID {{(pid=120741) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 18:04:16.921337 dv-cinder-852009-8-iscsi devstack@n-api.service[120741]: DEBUG oslo_concurrency.lockutils [None req-46605c8a-051b-4698-a952-5f44f588128e tempest-AttachVolumeTestJSON-555093534 tempest-AttachVolumeTestJSON-555093534-project] Acquiring lock "1daf4f4c-0e4a-4779-b53a-78c48397ea2f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120741) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 18:04:16.921442 dv-cinder-852009-8-iscsi devstack@n-api.service[120741]: DEBUG oslo_concurrency.lockutils [None req-46605c8a-051b-4698-a952-5f44f588128e tempest-AttachVolumeTestJSON-555093534 tempest-AttachVolumeTestJSON-555093534-project] Lock "1daf4f4c-0e4a-4779-b53a-78c48397ea2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120741) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 18:04:16.921863 dv-cinder-852009-8-iscsi devstack@n-api.service[120741]: DEBUG oslo_concurrency.lockutils [None req-46605c8a-051b-4698-a952-5f44f588128e tempest-AttachVolumeTestJSON-555093534 tempest-AttachVolumeTestJSON-555093534-project] Lock "1daf4f4c-0e4a-4779-b53a-78c48397ea2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120741) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 18:04:16.922551 dv-cinder-852009-8-iscsi devstack@n-api.service[120741]: DEBUG oslo_concurrency.lockutils [None req-46605c8a-051b-4698-a952-5f44f588128e tempest-AttachVolumeTestJSON-555093534 tempest-AttachVolumeTestJSON-555093534-project] Acquiring lock "1daf4f4c-0e4a-4779-b53a-78c48397ea2f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120741) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 18:04:16.922997 dv-cinder-852009-8-iscsi devstack@n-api.service[120741]: DEBUG oslo_concurrency.lockutils [None req-46605c8a-051b-4698-a952-5f44f588128e tempest-AttachVolumeTestJSON-555093534 tempest-AttachVolumeTestJSON-555093534-project] Lock "1daf4f4c-0e4a-4779-b53a-78c48397ea2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120741) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 18:04:16.923413 dv-cinder-852009-8-iscsi devstack@n-api.service[120741]: DEBUG oslo_concurrency.lockutils [None req-46605c8a-051b-4698-a952-5f44f588128e tempest-AttachVolumeTestJSON-555093534 tempest-AttachVolumeTestJSON-555093534-project] Lock "1daf4f4c-0e4a-4779-b53a-78c48397ea2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120741) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 18:04:16.927500 dv-cinder-852009-8-iscsi devstack@n-api.service[120741]: DEBUG dbcounter [-] [120741] Writing DB stats nova_cell1:SELECT=100 {{(pid=120741) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 18:04:17.062410 dv-cinder-852009-8-iscsi devstack@n-api.service[120741]: DEBUG nova.policy [None req-46605c8a-051b-4698-a952-5f44f588128e tempest-AttachVolumeTestJSON-555093534 tempest-AttachVolumeTestJSON-555093534-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0625b3113ce044bbac4f6142eaade11c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a279fcbf274c4704a31a2b95061e1469', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120741) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 18:04:17.073057 dv-cinder-852009-8-iscsi devstack@n-api.service[120741]: INFO nova.api.openstack.requestlog [None req-46605c8a-051b-4698-a952-5f44f588128e tempest-AttachVolumeTestJSON-555093534 tempest-AttachVolumeTestJSON-555093534-project] 10.222.0.43 "GET /compute/v2.1/servers/b958d409-df20-44c6-aa0e-58cb0a482edf" status: 200 len: 1724 microversion: 2.1 time: 0.161612 Sep 13 18:04:17.073700 dv-cinder-852009-8-iscsi devstack@n-api.service[120741]: [pid: 120741|app: 0|req: 154/317] 10.222.0.43 () {58 vars in 1236 bytes} [Tue Sep 13 18:04:16 2022] GET /compute/v2.1/servers/b958d409-df20-44c6-aa0e-58cb0a482edf => generated 1724 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 13 18:04:17.215332 dv-cinder-852009-8-iscsi devstack@n-api.service[120740]: INFO nova.api.openstack.requestlog [None req-f64d363e-4450-4348-b2ad-a03663916c07 tempest-AttachVolumeShelveTestJSON-385853788 tempest-AttachVolumeShelveTestJSON-385853788-project] 10.222.0.43 "POST /compute/v2.1/servers/11d2616a-96f9-4a7a-aab8-219219986a8b/os-volume_attachments" status: 200 len: 188 microversion: 2.20 time: 0.342551 Sep 13 18:04:17.215840 dv-cinder-852009-8-iscsi devstack@n-api.service[120740]: [pid: 120740|app: 0|req: 164/318] 10.222.0.43 () {62 vars in 1364 bytes} [Tue Sep 13 18:04:16 2022] POST /compute/v2.1/servers/11d2616a-96f9-4a7a-aab8-219219986a8b/os-volume_attachments => generated 188 bytes in 344 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Sep 13 18:04:17.344337 dv-cinder-852009-8-iscsi devstack@n-api.service[120741]: DEBUG nova.api.openstack.wsgi [None req-31b3ae3a-20b0-48dd-bb23-71b565207c08 tempest-AttachVolumeShelveTestJSON-385853788 tempest-AttachVolumeShelveTestJSON-385853788-project] Action: 'action', calling method: >, body: {"unshelve": null} {{(pid=120741) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 13 18:04:17.344950 dv-cinder-852009-8-iscsi devstack@n-api.service[120741]: DEBUG nova.compute.api [None req-31b3ae3a-20b0-48dd-bb23-71b565207c08 tempest-AttachVolumeShelveTestJSON-385853788 tempest-AttachVolumeShelveTestJSON-385853788-project] [instance: 11d2616a-96f9-4a7a-aab8-219219986a8b] Fetching instance by UUID {{(pid=120741) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 18:04:17.351149 dv-cinder-852009-8-iscsi devstack@n-api.service[120741]: DEBUG oslo_concurrency.lockutils [None req-31b3ae3a-20b0-48dd-bb23-71b565207c08 tempest-AttachVolumeShelveTestJSON-385853788 tempest-AttachVolumeShelveTestJSON-385853788-project] Acquiring lock "1daf4f4c-0e4a-4779-b53a-78c48397ea2f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120741) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 18:04:17.351639 dv-cinder-852009-8-iscsi devstack@n-api.service[120741]: DEBUG oslo_concurrency.lockutils [None req-31b3ae3a-20b0-48dd-bb23-71b565207c08 tempest-AttachVolumeShelveTestJSON-385853788 tempest-AttachVolumeShelveTestJSON-385853788-project] Lock "1daf4f4c-0e4a-4779-b53a-78c48397ea2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120741) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 18:04:17.352163 dv-cinder-852009-8-iscsi devstack@n-api.service[120741]: DEBUG oslo_concurrency.lockutils [None req-31b3ae3a-20b0-48dd-bb23-71b565207c08 tempest-AttachVolumeShelveTestJSON-385853788 tempest-AttachVolumeShelveTestJSON-385853788-project] Lock "1daf4f4c-0e4a-4779-b53a-78c48397ea2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120741) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 18:04:17.352890 dv-cinder-852009-8-iscsi devstack@n-api.service[120741]: DEBUG oslo_concurrency.lockutils [None req-31b3ae3a-20b0-48dd-bb23-71b565207c08 tempest-AttachVolumeShelveTestJSON-385853788 tempest-AttachVolumeShelveTestJSON-385853788-project] Acquiring lock "1daf4f4c-0e4a-4779-b53a-78c48397ea2f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120741) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 18:04:17.353338 dv-cinder-852009-8-iscsi devstack@n-api.service[120741]: DEBUG oslo_concurrency.lockutils [None req-31b3ae3a-20b0-48dd-bb23-71b565207c08 tempest-AttachVolumeShelveTestJSON-385853788 tempest-AttachVolumeShelveTestJSON-385853788-project] Lock "1daf4f4c-0e4a-4779-b53a-78c48397ea2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120741) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 18:04:17.353752 dv-cinder-852009-8-iscsi devstack@n-api.service[120741]: DEBUG oslo_concurrency.lockutils [None req-31b3ae3a-20b0-48dd-bb23-71b565207c08 tempest-AttachVolumeShelveTestJSON-385853788 tempest-AttachVolumeShelveTestJSON-385853788-project] Lock "1daf4f4c-0e4a-4779-b53a-78c48397ea2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120741) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 18:04:17.396752 dv-cinder-852009-8-iscsi devstack@n-api.service[120741]: DEBUG nova.compute.api [None req-31b3ae3a-20b0-48dd-bb23-71b565207c08 tempest-AttachVolumeShelveTestJSON-385853788 tempest-AttachVolumeShelveTestJSON-385853788-project] [instance: 11d2616a-96f9-4a7a-aab8-219219986a8b] Unshelving instance with old availability_zone "None" to new availability_zone "not provided" and host "None". {{(pid=120741) unshelve /opt/stack/nova/nova/compute/api.py:4593}} Sep 13 18:04:17.469995 dv-cinder-852009-8-iscsi devstack@n-api.service[120741]: INFO nova.api.openstack.requestlog [None req-31b3ae3a-20b0-48dd-bb23-71b565207c08 tempest-AttachVolumeShelveTestJSON-385853788 tempest-AttachVolumeShelveTestJSON-385853788-project] 10.222.0.43 "POST /compute/v2.1/servers/11d2616a-96f9-4a7a-aab8-219219986a8b/action" status: 202 len: 0 microversion: 2.20 time: 0.129764 Sep 13 18:04:17.470793 dv-cinder-852009-8-iscsi devstack@n-api.service[120741]: [pid: 120741|app: 0|req: 155/319] 10.222.0.43 () {62 vars in 1319 bytes} [Tue Sep 13 18:04:17 2022] POST /compute/v2.1/servers/11d2616a-96f9-4a7a-aab8-219219986a8b/action => generated 0 bytes in 131 msecs (HTTP/1.1 202) 9 headers in 363 bytes (1 switches on core 0) Sep 13 18:04:17.484619 dv-cinder-852009-8-iscsi devstack@n-api.service[120740]: DEBUG nova.api.openstack.wsgi [None req-d13a9eb7-05ce-4607-ae14-561d2eb53dea tempest-AttachVolumeShelveTestJSON-385853788 tempest-AttachVolumeShelveTestJSON-385853788-project] Calling method '>' {{(pid=120740) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 18:04:17.485536 dv-cinder-852009-8-iscsi devstack@n-api.service[120740]: DEBUG nova.compute.api [None req-d13a9eb7-05ce-4607-ae14-561d2eb53dea tempest-AttachVolumeShelveTestJSON-385853788 tempest-AttachVolumeShelveTestJSON-385853788-project] [instance: 11d2616a-96f9-4a7a-aab8-219219986a8b] Fetching instance by UUID {{(pid=120740) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 18:04:17.492594 dv-cinder-852009-8-iscsi devstack@n-api.service[120740]: DEBUG oslo_concurrency.lockutils [None req-d13a9eb7-05ce-4607-ae14-561d2eb53dea tempest-AttachVolumeShelveTestJSON-385853788 tempest-AttachVolumeShelveTestJSON-385853788-project] Acquiring lock "1daf4f4c-0e4a-4779-b53a-78c48397ea2f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120740) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 18:04:17.493091 dv-cinder-852009-8-iscsi devstack@n-api.service[120740]: DEBUG oslo_concurrency.lockutils [None req-d13a9eb7-05ce-4607-ae14-561d2eb53dea tempest-AttachVolumeShelveTestJSON-385853788 tempest-AttachVolumeShelveTestJSON-385853788-project] Lock "1daf4f4c-0e4a-4779-b53a-78c48397ea2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120740) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 18:04:17.493526 dv-cinder-852009-8-iscsi devstack@n-api.service[120740]: DEBUG oslo_concurrency.lockutils [None req-d13a9eb7-05ce-4607-ae14-561d2eb53dea tempest-AttachVolumeShelveTestJSON-385853788 tempest-AttachVolumeShelveTestJSON-385853788-project] Lock "1daf4f4c-0e4a-4779-b53a-78c48397ea2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120740) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 18:04:17.494769 dv-cinder-852009-8-iscsi devstack@n-api.service[120740]: DEBUG oslo_concurrency.lockutils [None req-d13a9eb7-05ce-4607-ae14-561d2eb53dea tempest-AttachVolumeShelveTestJSON-385853788 tempest-AttachVolumeShelveTestJSON-385853788-project] Acquiring lock "1daf4f4c-0e4a-4779-b53a-78c48397ea2f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120740) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 18:04:17.494769 dv-cinder-852009-8-iscsi devstack@n-api.service[120740]: DEBUG oslo_concurrency.lockutils [None req-d13a9eb7-05ce-4607-ae14-561d2eb53dea tempest-AttachVolumeShelveTestJSON-385853788 tempest-AttachVolumeShelveTestJSON-385853788-project] Lock "1daf4f4c-0e4a-4779-b53a-78c48397ea2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120740) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 18:04:17.495162 dv-cinder-852009-8-iscsi devstack@n-api.service[120740]: DEBUG oslo_concurrency.lockutils [None req-d13a9eb7-05ce-4607-ae14-561d2eb53dea tempest-AttachVolumeShelveTestJSON-385853788 tempest-AttachVolumeShelveTestJSON-385853788-project] Lock "1daf4f4c-0e4a-4779-b53a-78c48397ea2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120740) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 18:04:17.631285 dv-cinder-852009-8-iscsi devstack@n-api.service[120740]: DEBUG nova.policy [None req-d13a9eb7-05ce-4607-ae14-561d2eb53dea tempest-AttachVolumeShelveTestJSON-385853788 tempest-AttachVolumeShelveTestJSON-385853788-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e68ecd9b3ca643539b109f75bb242d6f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '75e14fd88bfb4cd896fa7b070a0fac47', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120740) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 18:04:17.640786 dv-cinder-852009-8-iscsi devstack@n-api.service[120740]: DEBUG nova.policy [None req-d13a9eb7-05ce-4607-ae14-561d2eb53dea tempest-AttachVolumeShelveTestJSON-385853788 tempest-AttachVolumeShelveTestJSON-385853788-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'e68ecd9b3ca643539b109f75bb242d6f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '75e14fd88bfb4cd896fa7b070a0fac47', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120740) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 18:04:17.642293 dv-cinder-852009-8-iscsi devstack@n-api.service[120740]: DEBUG nova.policy [None req-d13a9eb7-05ce-4607-ae14-561d2eb53dea tempest-AttachVolumeShelveTestJSON-385853788 tempest-AttachVolumeShelveTestJSON-385853788-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'e68ecd9b3ca643539b109f75bb242d6f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '75e14fd88bfb4cd896fa7b070a0fac47', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120740) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 18:04:17.643615 dv-cinder-852009-8-iscsi devstack@n-api.service[120740]: INFO nova.api.openstack.requestlog [None req-d13a9eb7-05ce-4607-ae14-561d2eb53dea tempest-AttachVolumeShelveTestJSON-385853788 tempest-AttachVolumeShelveTestJSON-385853788-project] 10.222.0.43 "GET /compute/v2.1/servers/11d2616a-96f9-4a7a-aab8-219219986a8b" status: 200 len: 1809 microversion: 2.20 time: 0.168384 Sep 13 18:04:17.644204 dv-cinder-852009-8-iscsi devstack@n-api.service[120740]: [pid: 120740|app: 0|req: 165/320] 10.222.0.43 () {60 vars in 1277 bytes} [Tue Sep 13 18:04:17 2022] GET /compute/v2.1/servers/11d2616a-96f9-4a7a-aab8-219219986a8b => generated 1809 bytes in 170 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 13 18:04:17.842369 dv-cinder-852009-8-iscsi devstack@n-api.service[120741]: DEBUG nova.api.openstack.wsgi [None req-ee8aac48-4531-4e9c-910c-385b2d76573a tempest-TestShelveInstance-6258502 tempest-TestShelveInstance-6258502-project] Calling method '>' {{(pid=120741) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 18:04:17.843935 dv-cinder-852009-8-iscsi devstack@n-api.service[120741]: DEBUG nova.compute.api [None req-ee8aac48-4531-4e9c-910c-385b2d76573a tempest-TestShelveInstance-6258502 tempest-TestShelveInstance-6258502-project] [instance: 2d60cc6d-a699-417d-aa20-fe3e1bfc351e] Fetching instance by UUID {{(pid=120741) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 18:04:17.850706 dv-cinder-852009-8-iscsi devstack@n-api.service[120741]: DEBUG oslo_concurrency.lockutils [None req-ee8aac48-4531-4e9c-910c-385b2d76573a tempest-TestShelveInstance-6258502 tempest-TestShelveInstance-6258502-project] Acquiring lock "1daf4f4c-0e4a-4779-b53a-78c48397ea2f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120741) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 18:04:17.851382 dv-cinder-852009-8-iscsi devstack@n-api.service[120741]: DEBUG oslo_concurrency.lockutils [None req-ee8aac48-4531-4e9c-910c-385b2d76573a tempest-TestShelveInstance-6258502 tempest-TestShelveInstance-6258502-project] Lock "1daf4f4c-0e4a-4779-b53a-78c48397ea2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120741) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 18:04:17.851815 dv-cinder-852009-8-iscsi devstack@n-api.service[120741]: DEBUG oslo_concurrency.lockutils [None req-ee8aac48-4531-4e9c-910c-385b2d76573a tempest-TestShelveInstance-6258502 tempest-TestShelveInstance-6258502-project] Lock "1daf4f4c-0e4a-4779-b53a-78c48397ea2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120741) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 18:04:17.852847 dv-cinder-852009-8-iscsi devstack@n-api.service[120741]: DEBUG oslo_concurrency.lockutils [None req-ee8aac48-4531-4e9c-910c-385b2d76573a tempest-TestShelveInstance-6258502 tempest-TestShelveInstance-6258502-project] Acquiring lock "1daf4f4c-0e4a-4779-b53a-78c48397ea2f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120741) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 18:04:17.853302 dv-cinder-852009-8-iscsi devstack@n-api.service[120741]: DEBUG oslo_concurrency.lockutils [None req-ee8aac48-4531-4e9c-910c-385b2d76573a tempest-TestShelveInstance-6258502 tempest-TestShelveInstance-6258502-project] Lock "1daf4f4c-0e4a-4779-b53a-78c48397ea2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120741) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 18:04:17.853723 dv-cinder-852009-8-iscsi devstack@n-api.service[120741]: DEBUG oslo_concurrency.lockutils [None req-ee8aac48-4531-4e9c-910c-385b2d76573a tempest-TestShelveInstance-6258502 tempest-TestShelveInstance-6258502-project] Lock "1daf4f4c-0e4a-4779-b53a-78c48397ea2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120741) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 18:04:18.038025 dv-cinder-852009-8-iscsi devstack@n-api.service[120741]: DEBUG nova.policy [None req-ee8aac48-4531-4e9c-910c-385b2d76573a tempest-TestShelveInstance-6258502 tempest-TestShelveInstance-6258502-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2ab9930d6ce54cacbb3d4fd6313294d5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5eafd54351bd4049b87ad308a3638f80', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120741) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 18:04:18.045927 dv-cinder-852009-8-iscsi devstack@n-api.service[120741]: INFO nova.api.openstack.requestlog [None req-ee8aac48-4531-4e9c-910c-385b2d76573a tempest-TestShelveInstance-6258502 tempest-TestShelveInstance-6258502-project] 10.222.0.43 "GET /compute/v2.1/servers/2d60cc6d-a699-417d-aa20-fe3e1bfc351e" status: 200 len: 1261 microversion: 2.1 time: 0.208251 Sep 13 18:04:18.046494 dv-cinder-852009-8-iscsi devstack@n-api.service[120741]: [pid: 120741|app: 0|req: 156/321] 10.222.0.43 () {58 vars in 1236 bytes} [Tue Sep 13 18:04:17 2022] GET /compute/v2.1/servers/2d60cc6d-a699-417d-aa20-fe3e1bfc351e => generated 1261 bytes in 209 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 13 18:04:18.098237 dv-cinder-852009-8-iscsi devstack@n-api.service[120740]: DEBUG nova.api.openstack.wsgi [None req-26f6dbbb-b7fa-4d50-b6f9-69e88c01eb0b tempest-AttachVolumeTestJSON-555093534 tempest-AttachVolumeTestJSON-555093534-project] Calling method '>' {{(pid=120740) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 18:04:18.098839 dv-cinder-852009-8-iscsi devstack@n-api.service[120740]: DEBUG nova.compute.api [None req-26f6dbbb-b7fa-4d50-b6f9-69e88c01eb0b tempest-AttachVolumeTestJSON-555093534 tempest-AttachVolumeTestJSON-555093534-project] [instance: b958d409-df20-44c6-aa0e-58cb0a482edf] Fetching instance by UUID {{(pid=120740) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 18:04:18.104852 dv-cinder-852009-8-iscsi devstack@n-api.service[120740]: DEBUG oslo_concurrency.lockutils [None req-26f6dbbb-b7fa-4d50-b6f9-69e88c01eb0b tempest-AttachVolumeTestJSON-555093534 tempest-AttachVolumeTestJSON-555093534-project] Acquiring lock "1daf4f4c-0e4a-4779-b53a-78c48397ea2f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120740) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 18:04:18.105322 dv-cinder-852009-8-iscsi devstack@n-api.service[120740]: DEBUG oslo_concurrency.lockutils [None req-26f6dbbb-b7fa-4d50-b6f9-69e88c01eb0b tempest-AttachVolumeTestJSON-555093534 tempest-AttachVolumeTestJSON-555093534-project] Lock "1daf4f4c-0e4a-4779-b53a-78c48397ea2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120740) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 18:04:18.105754 dv-cinder-852009-8-iscsi devstack@n-api.service[120740]: DEBUG oslo_concurrency.lockutils [None req-26f6dbbb-b7fa-4d50-b6f9-69e88c01eb0b tempest-AttachVolumeTestJSON-555093534 tempest-AttachVolumeTestJSON-555093534-project] Lock "1daf4f4c-0e4a-4779-b53a-78c48397ea2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120740) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 18:04:18.106441 dv-cinder-852009-8-iscsi devstack@n-api.service[120740]: DEBUG oslo_concurrency.lockutils [None req-26f6dbbb-b7fa-4d50-b6f9-69e88c01eb0b tempest-AttachVolumeTestJSON-555093534 tempest-AttachVolumeTestJSON-555093534-project] Acquiring lock "1daf4f4c-0e4a-4779-b53a-78c48397ea2f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120740) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 18:04:18.106867 dv-cinder-852009-8-iscsi devstack@n-api.service[120740]: DEBUG oslo_concurrency.lockutils [None req-26f6dbbb-b7fa-4d50-b6f9-69e88c01eb0b tempest-AttachVolumeTestJSON-555093534 tempest-AttachVolumeTestJSON-555093534-project] Lock "1daf4f4c-0e4a-4779-b53a-78c48397ea2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120740) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 18:04:18.107287 dv-cinder-852009-8-iscsi devstack@n-api.service[120740]: DEBUG oslo_concurrency.lockutils [None req-26f6dbbb-b7fa-4d50-b6f9-69e88c01eb0b tempest-AttachVolumeTestJSON-555093534 tempest-AttachVolumeTestJSON-555093534-project] Lock "1daf4f4c-0e4a-4779-b53a-78c48397ea2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120740) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 18:04:18.111775 dv-cinder-852009-8-iscsi devstack@n-api.service[120740]: DEBUG dbcounter [-] [120740] Writing DB stats nova_cell1:SELECT=93,nova_cell1:INSERT=3,nova_cell1:UPDATE=4 {{(pid=120740) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 18:04:18.245379 dv-cinder-852009-8-iscsi devstack@n-api.service[120740]: DEBUG nova.policy [None req-26f6dbbb-b7fa-4d50-b6f9-69e88c01eb0b tempest-AttachVolumeTestJSON-555093534 tempest-AttachVolumeTestJSON-555093534-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0625b3113ce044bbac4f6142eaade11c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a279fcbf274c4704a31a2b95061e1469', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120740) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 18:04:18.253923 dv-cinder-852009-8-iscsi devstack@n-api.service[120740]: INFO nova.api.openstack.requestlog [None req-26f6dbbb-b7fa-4d50-b6f9-69e88c01eb0b tempest-AttachVolumeTestJSON-555093534 tempest-AttachVolumeTestJSON-555093534-project] 10.222.0.43 "GET /compute/v2.1/servers/b958d409-df20-44c6-aa0e-58cb0a482edf" status: 200 len: 1724 microversion: 2.1 time: 0.159560 Sep 13 18:04:18.254497 dv-cinder-852009-8-iscsi devstack@n-api.service[120740]: [pid: 120740|app: 0|req: 166/322] 10.222.0.43 () {58 vars in 1236 bytes} [Tue Sep 13 18:04:18 2022] GET /compute/v2.1/servers/b958d409-df20-44c6-aa0e-58cb0a482edf => generated 1724 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 13 18:04:18.670322 dv-cinder-852009-8-iscsi devstack@n-api.service[120741]: DEBUG nova.api.openstack.wsgi [None req-63ab7e71-bcff-4213-a94f-d7284bde2f87 tempest-AttachVolumeShelveTestJSON-385853788 tempest-AttachVolumeShelveTestJSON-385853788-project] Calling method '>' {{(pid=120741) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 18:04:18.670916 dv-cinder-852009-8-iscsi devstack@n-api.service[120741]: DEBUG nova.compute.api [None req-63ab7e71-bcff-4213-a94f-d7284bde2f87 tempest-AttachVolumeShelveTestJSON-385853788 tempest-AttachVolumeShelveTestJSON-385853788-project] [instance: 11d2616a-96f9-4a7a-aab8-219219986a8b] Fetching instance by UUID {{(pid=120741) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 18:04:18.677758 dv-cinder-852009-8-iscsi devstack@n-api.service[120741]: DEBUG oslo_concurrency.lockutils [None req-63ab7e71-bcff-4213-a94f-d7284bde2f87 tempest-AttachVolumeShelveTestJSON-385853788 tempest-AttachVolumeShelveTestJSON-385853788-project] Acquiring lock "1daf4f4c-0e4a-4779-b53a-78c48397ea2f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120741) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 18:04:18.678454 dv-cinder-852009-8-iscsi devstack@n-api.service[120741]: DEBUG oslo_concurrency.lockutils [None req-63ab7e71-bcff-4213-a94f-d7284bde2f87 tempest-AttachVolumeShelveTestJSON-385853788 tempest-AttachVolumeShelveTestJSON-385853788-project] Lock "1daf4f4c-0e4a-4779-b53a-78c48397ea2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120741) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 18:04:18.678886 dv-cinder-852009-8-iscsi devstack@n-api.service[120741]: DEBUG oslo_concurrency.lockutils [None req-63ab7e71-bcff-4213-a94f-d7284bde2f87 tempest-AttachVolumeShelveTestJSON-385853788 tempest-AttachVolumeShelveTestJSON-385853788-project] Lock "1daf4f4c-0e4a-4779-b53a-78c48397ea2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120741) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 18:04:18.679730 dv-cinder-852009-8-iscsi devstack@n-api.service[120741]: DEBUG oslo_concurrency.lockutils [None req-63ab7e71-bcff-4213-a94f-d7284bde2f87 tempest-AttachVolumeShelveTestJSON-385853788 tempest-AttachVolumeShelveTestJSON-385853788-project] Acquiring lock "1daf4f4c-0e4a-4779-b53a-78c48397ea2f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120741) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 18:04:18.680200 dv-cinder-852009-8-iscsi devstack@n-api.service[120741]: DEBUG oslo_concurrency.lockutils [None req-63ab7e71-bcff-4213-a94f-d7284bde2f87 tempest-AttachVolumeShelveTestJSON-385853788 tempest-AttachVolumeShelveTestJSON-385853788-project] Lock "1daf4f4c-0e4a-4779-b53a-78c48397ea2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120741) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 18:04:18.680665 dv-cinder-852009-8-iscsi devstack@n-api.service[120741]: DEBUG oslo_concurrency.lockutils [None req-63ab7e71-bcff-4213-a94f-d7284bde2f87 tempest-AttachVolumeShelveTestJSON-385853788 tempest-AttachVolumeShelveTestJSON-385853788-project] Lock "1daf4f4c-0e4a-4779-b53a-78c48397ea2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120741) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 18:04:18.814544 dv-cinder-852009-8-iscsi devstack@n-api.service[120741]: DEBUG nova.policy [None req-63ab7e71-bcff-4213-a94f-d7284bde2f87 tempest-AttachVolumeShelveTestJSON-385853788 tempest-AttachVolumeShelveTestJSON-385853788-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e68ecd9b3ca643539b109f75bb242d6f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '75e14fd88bfb4cd896fa7b070a0fac47', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120741) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 18:04:18.823342 dv-cinder-852009-8-iscsi devstack@n-api.service[120741]: DEBUG nova.policy [None req-63ab7e71-bcff-4213-a94f-d7284bde2f87 tempest-AttachVolumeShelveTestJSON-385853788 tempest-AttachVolumeShelveTestJSON-385853788-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'e68ecd9b3ca643539b109f75bb242d6f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '75e14fd88bfb4cd896fa7b070a0fac47', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120741) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 18:04:18.824808 dv-cinder-852009-8-iscsi devstack@n-api.service[120741]: DEBUG nova.policy [None req-63ab7e71-bcff-4213-a94f-d7284bde2f87 tempest-AttachVolumeShelveTestJSON-385853788 tempest-AttachVolumeShelveTestJSON-385853788-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'e68ecd9b3ca643539b109f75bb242d6f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '75e14fd88bfb4cd896fa7b070a0fac47', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120741) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 18:04:18.825961 dv-cinder-852009-8-iscsi devstack@n-api.service[120741]: INFO nova.api.openstack.requestlog [None req-63ab7e71-bcff-4213-a94f-d7284bde2f87 tempest-AttachVolumeShelveTestJSON-385853788 tempest-AttachVolumeShelveTestJSON-385853788-project] 10.222.0.43 "GET /compute/v2.1/servers/11d2616a-96f9-4a7a-aab8-219219986a8b" status: 200 len: 1751 microversion: 2.20 time: 0.159648 Sep 13 18:04:18.826507 dv-cinder-852009-8-iscsi devstack@n-api.service[120741]: [pid: 120741|app: 0|req: 157/323] 10.222.0.43 () {60 vars in 1277 bytes} [Tue Sep 13 18:04:18 2022] GET /compute/v2.1/servers/11d2616a-96f9-4a7a-aab8-219219986a8b => generated 1751 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 13 18:04:19.069507 dv-cinder-852009-8-iscsi devstack@n-api.service[120740]: DEBUG nova.api.openstack.wsgi [None req-802c8b81-ebd2-4118-9c5f-92f31ef4af28 tempest-TestShelveInstance-6258502 tempest-TestShelveInstance-6258502-project] Calling method '>' {{(pid=120740) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 18:04:19.070101 dv-cinder-852009-8-iscsi devstack@n-api.service[120740]: DEBUG nova.compute.api [None req-802c8b81-ebd2-4118-9c5f-92f31ef4af28 tempest-TestShelveInstance-6258502 tempest-TestShelveInstance-6258502-project] [instance: 2d60cc6d-a699-417d-aa20-fe3e1bfc351e] Fetching instance by UUID {{(pid=120740) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 18:04:19.077412 dv-cinder-852009-8-iscsi devstack@n-api.service[120740]: DEBUG oslo_concurrency.lockutils [None req-802c8b81-ebd2-4118-9c5f-92f31ef4af28 tempest-TestShelveInstance-6258502 tempest-TestShelveInstance-6258502-project] Acquiring lock "1daf4f4c-0e4a-4779-b53a-78c48397ea2f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120740) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 18:04:19.077935 dv-cinder-852009-8-iscsi devstack@n-api.service[120740]: DEBUG oslo_concurrency.lockutils [None req-802c8b81-ebd2-4118-9c5f-92f31ef4af28 tempest-TestShelveInstance-6258502 tempest-TestShelveInstance-6258502-project] Lock "1daf4f4c-0e4a-4779-b53a-78c48397ea2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120740) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 18:04:19.078411 dv-cinder-852009-8-iscsi devstack@n-api.service[120740]: DEBUG oslo_concurrency.lockutils [None req-802c8b81-ebd2-4118-9c5f-92f31ef4af28 tempest-TestShelveInstance-6258502 tempest-TestShelveInstance-6258502-project] Lock "1daf4f4c-0e4a-4779-b53a-78c48397ea2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120740) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 18:04:19.079131 dv-cinder-852009-8-iscsi devstack@n-api.service[120740]: DEBUG oslo_concurrency.lockutils [None req-802c8b81-ebd2-4118-9c5f-92f31ef4af28 tempest-TestShelveInstance-6258502 tempest-TestShelveInstance-6258502-project] Acquiring lock "1daf4f4c-0e4a-4779-b53a-78c48397ea2f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120740) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 18:04:19.079580 dv-cinder-852009-8-iscsi devstack@n-api.service[120740]: DEBUG oslo_concurrency.lockutils [None req-802c8b81-ebd2-4118-9c5f-92f31ef4af28 tempest-TestShelveInstance-6258502 tempest-TestShelveInstance-6258502-project] Lock "1daf4f4c-0e4a-4779-b53a-78c48397ea2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120740) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 18:04:19.080019 dv-cinder-852009-8-iscsi devstack@n-api.service[120740]: DEBUG oslo_concurrency.lockutils [None req-802c8b81-ebd2-4118-9c5f-92f31ef4af28 tempest-TestShelveInstance-6258502 tempest-TestShelveInstance-6258502-project] Lock "1daf4f4c-0e4a-4779-b53a-78c48397ea2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120740) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 18:04:19.225267 dv-cinder-852009-8-iscsi devstack@n-api.service[120740]: DEBUG nova.policy [None req-802c8b81-ebd2-4118-9c5f-92f31ef4af28 tempest-TestShelveInstance-6258502 tempest-TestShelveInstance-6258502-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2ab9930d6ce54cacbb3d4fd6313294d5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5eafd54351bd4049b87ad308a3638f80', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120740) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 18:04:19.233544 dv-cinder-852009-8-iscsi devstack@n-api.service[120740]: INFO nova.api.openstack.requestlog [None req-802c8b81-ebd2-4118-9c5f-92f31ef4af28 tempest-TestShelveInstance-6258502 tempest-TestShelveInstance-6258502-project] 10.222.0.43 "GET /compute/v2.1/servers/2d60cc6d-a699-417d-aa20-fe3e1bfc351e" status: 200 len: 1445 microversion: 2.1 time: 0.168000 Sep 13 18:04:19.234253 dv-cinder-852009-8-iscsi devstack@n-api.service[120740]: [pid: 120740|app: 0|req: 167/324] 10.222.0.43 () {58 vars in 1236 bytes} [Tue Sep 13 18:04:19 2022] GET /compute/v2.1/servers/2d60cc6d-a699-417d-aa20-fe3e1bfc351e => generated 1445 bytes in 170 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 13 18:04:19.258032 dv-cinder-852009-8-iscsi devstack@n-api.service[120741]: DEBUG nova.api.openstack.wsgi [None req-2120455e-afd2-4ce6-a31a-aeda8ab08ac0 tempest-TestShelveInstance-6258502 tempest-TestShelveInstance-6258502-project] Calling method '>' {{(pid=120741) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 18:04:19.260142 dv-cinder-852009-8-iscsi devstack@n-api.service[120741]: DEBUG nova.compute.api [None req-2120455e-afd2-4ce6-a31a-aeda8ab08ac0 tempest-TestShelveInstance-6258502 tempest-TestShelveInstance-6258502-project] [instance: 2d60cc6d-a699-417d-aa20-fe3e1bfc351e] Fetching instance by UUID {{(pid=120741) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 18:04:19.267969 dv-cinder-852009-8-iscsi devstack@n-api.service[120741]: DEBUG oslo_concurrency.lockutils [None req-2120455e-afd2-4ce6-a31a-aeda8ab08ac0 tempest-TestShelveInstance-6258502 tempest-TestShelveInstance-6258502-project] Acquiring lock "1daf4f4c-0e4a-4779-b53a-78c48397ea2f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120741) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 18:04:19.268512 dv-cinder-852009-8-iscsi devstack@n-api.service[120741]: DEBUG oslo_concurrency.lockutils [None req-2120455e-afd2-4ce6-a31a-aeda8ab08ac0 tempest-TestShelveInstance-6258502 tempest-TestShelveInstance-6258502-project] Lock "1daf4f4c-0e4a-4779-b53a-78c48397ea2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120741) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 18:04:19.269150 dv-cinder-852009-8-iscsi devstack@n-api.service[120741]: DEBUG oslo_concurrency.lockutils [None req-2120455e-afd2-4ce6-a31a-aeda8ab08ac0 tempest-TestShelveInstance-6258502 tempest-TestShelveInstance-6258502-project] Lock "1daf4f4c-0e4a-4779-b53a-78c48397ea2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120741) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 18:04:19.270044 dv-cinder-852009-8-iscsi devstack@n-api.service[120741]: DEBUG oslo_concurrency.lockutils [None req-2120455e-afd2-4ce6-a31a-aeda8ab08ac0 tempest-TestShelveInstance-6258502 tempest-TestShelveInstance-6258502-project] Acquiring lock "1daf4f4c-0e4a-4779-b53a-78c48397ea2f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120741) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 18:04:19.270522 dv-cinder-852009-8-iscsi devstack@n-api.service[120741]: DEBUG oslo_concurrency.lockutils [None req-2120455e-afd2-4ce6-a31a-aeda8ab08ac0 tempest-TestShelveInstance-6258502 tempest-TestShelveInstance-6258502-project] Lock "1daf4f4c-0e4a-4779-b53a-78c48397ea2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120741) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 18:04:19.271027 dv-cinder-852009-8-iscsi devstack@n-api.service[120741]: DEBUG oslo_concurrency.lockutils [None req-2120455e-afd2-4ce6-a31a-aeda8ab08ac0 tempest-TestShelveInstance-6258502 tempest-TestShelveInstance-6258502-project] Lock "1daf4f4c-0e4a-4779-b53a-78c48397ea2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120741) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 18:04:19.285179 dv-cinder-852009-8-iscsi devstack@n-api.service[120740]: DEBUG nova.api.openstack.wsgi [None req-07e8f82e-4687-406f-ba8e-041d0ec1c3f4 tempest-AttachVolumeTestJSON-555093534 tempest-AttachVolumeTestJSON-555093534-project] Calling method '>' {{(pid=120740) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 18:04:19.285780 dv-cinder-852009-8-iscsi devstack@n-api.service[120740]: DEBUG nova.compute.api [None req-07e8f82e-4687-406f-ba8e-041d0ec1c3f4 tempest-AttachVolumeTestJSON-555093534 tempest-AttachVolumeTestJSON-555093534-project] [instance: b958d409-df20-44c6-aa0e-58cb0a482edf] Fetching instance by UUID {{(pid=120740) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 18:04:19.292134 dv-cinder-852009-8-iscsi devstack@n-api.service[120740]: DEBUG oslo_concurrency.lockutils [None req-07e8f82e-4687-406f-ba8e-041d0ec1c3f4 tempest-AttachVolumeTestJSON-555093534 tempest-AttachVolumeTestJSON-555093534-project] Acquiring lock "1daf4f4c-0e4a-4779-b53a-78c48397ea2f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120740) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 18:04:19.293635 dv-cinder-852009-8-iscsi devstack@n-api.service[120740]: DEBUG oslo_concurrency.lockutils [None req-07e8f82e-4687-406f-ba8e-041d0ec1c3f4 tempest-AttachVolumeTestJSON-555093534 tempest-AttachVolumeTestJSON-555093534-project] Lock "1daf4f4c-0e4a-4779-b53a-78c48397ea2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120740) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 18:04:19.293635 dv-cinder-852009-8-iscsi devstack@n-api.service[120740]: DEBUG oslo_concurrency.lockutils [None req-07e8f82e-4687-406f-ba8e-041d0ec1c3f4 tempest-AttachVolumeTestJSON-555093534 tempest-AttachVolumeTestJSON-555093534-project] Lock "1daf4f4c-0e4a-4779-b53a-78c48397ea2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120740) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 18:04:19.294164 dv-cinder-852009-8-iscsi devstack@n-api.service[120740]: DEBUG oslo_concurrency.lockutils [None req-07e8f82e-4687-406f-ba8e-041d0ec1c3f4 tempest-AttachVolumeTestJSON-555093534 tempest-AttachVolumeTestJSON-555093534-project] Acquiring lock "1daf4f4c-0e4a-4779-b53a-78c48397ea2f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120740) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 18:04:19.294623 dv-cinder-852009-8-iscsi devstack@n-api.service[120740]: DEBUG oslo_concurrency.lockutils [None req-07e8f82e-4687-406f-ba8e-041d0ec1c3f4 tempest-AttachVolumeTestJSON-555093534 tempest-AttachVolumeTestJSON-555093534-project] Lock "1daf4f4c-0e4a-4779-b53a-78c48397ea2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120740) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 18:04:19.295122 dv-cinder-852009-8-iscsi devstack@n-api.service[120740]: DEBUG oslo_concurrency.lockutils [None req-07e8f82e-4687-406f-ba8e-041d0ec1c3f4 tempest-AttachVolumeTestJSON-555093534 tempest-AttachVolumeTestJSON-555093534-project] Lock "1daf4f4c-0e4a-4779-b53a-78c48397ea2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120740) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 18:04:19.505394 dv-cinder-852009-8-iscsi devstack@n-api.service[120741]: DEBUG nova.policy [None req-2120455e-afd2-4ce6-a31a-aeda8ab08ac0 tempest-TestShelveInstance-6258502 tempest-TestShelveInstance-6258502-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2ab9930d6ce54cacbb3d4fd6313294d5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5eafd54351bd4049b87ad308a3638f80', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120741) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 18:04:19.518850 dv-cinder-852009-8-iscsi devstack@n-api.service[120740]: DEBUG nova.policy [None req-07e8f82e-4687-406f-ba8e-041d0ec1c3f4 tempest-AttachVolumeTestJSON-555093534 tempest-AttachVolumeTestJSON-555093534-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0625b3113ce044bbac4f6142eaade11c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a279fcbf274c4704a31a2b95061e1469', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120740) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 18:04:19.522585 dv-cinder-852009-8-iscsi devstack@n-api.service[120741]: INFO nova.api.openstack.requestlog [None req-2120455e-afd2-4ce6-a31a-aeda8ab08ac0 tempest-TestShelveInstance-6258502 tempest-TestShelveInstance-6258502-project] 10.222.0.43 "GET /compute/v2.1/servers/2d60cc6d-a699-417d-aa20-fe3e1bfc351e" status: 200 len: 1445 microversion: 2.1 time: 0.261757 Sep 13 18:04:19.523238 dv-cinder-852009-8-iscsi devstack@n-api.service[120741]: [pid: 120741|app: 0|req: 158/325] 10.222.0.43 () {58 vars in 1236 bytes} [Tue Sep 13 18:04:19 2022] GET /compute/v2.1/servers/2d60cc6d-a699-417d-aa20-fe3e1bfc351e => generated 1445 bytes in 270 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 13 18:04:19.532942 dv-cinder-852009-8-iscsi devstack@n-api.service[120740]: INFO nova.api.openstack.requestlog [None req-07e8f82e-4687-406f-ba8e-041d0ec1c3f4 tempest-AttachVolumeTestJSON-555093534 tempest-AttachVolumeTestJSON-555093534-project] 10.222.0.43 "GET /compute/v2.1/servers/b958d409-df20-44c6-aa0e-58cb0a482edf" status: 200 len: 1701 microversion: 2.1 time: 0.254818 Sep 13 18:04:19.533534 dv-cinder-852009-8-iscsi devstack@n-api.service[120740]: [pid: 120740|app: 0|req: 168/326] 10.222.0.43 () {58 vars in 1236 bytes} [Tue Sep 13 18:04:19 2022] GET /compute/v2.1/servers/b958d409-df20-44c6-aa0e-58cb0a482edf => generated 1701 bytes in 256 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 13 18:04:19.557249 dv-cinder-852009-8-iscsi devstack@n-api.service[120741]: DEBUG nova.api.openstack.wsgi [None req-b0f28136-d9c1-482b-9a1d-0753fa905008 tempest-AttachVolumeTestJSON-555093534 tempest-AttachVolumeTestJSON-555093534-project] Action: 'action', calling method: >, body: {"os-start": {}} {{(pid=120741) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 13 18:04:19.564126 dv-cinder-852009-8-iscsi devstack@n-api.service[120741]: DEBUG oslo_concurrency.lockutils [None req-b0f28136-d9c1-482b-9a1d-0753fa905008 tempest-AttachVolumeTestJSON-555093534 tempest-AttachVolumeTestJSON-555093534-project] Acquiring lock "1daf4f4c-0e4a-4779-b53a-78c48397ea2f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120741) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 18:04:19.564875 dv-cinder-852009-8-iscsi devstack@n-api.service[120741]: DEBUG oslo_concurrency.lockutils [None req-b0f28136-d9c1-482b-9a1d-0753fa905008 tempest-AttachVolumeTestJSON-555093534 tempest-AttachVolumeTestJSON-555093534-project] Lock "1daf4f4c-0e4a-4779-b53a-78c48397ea2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120741) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 18:04:19.565305 dv-cinder-852009-8-iscsi devstack@n-api.service[120741]: DEBUG oslo_concurrency.lockutils [None req-b0f28136-d9c1-482b-9a1d-0753fa905008 tempest-AttachVolumeTestJSON-555093534 tempest-AttachVolumeTestJSON-555093534-project] Lock "1daf4f4c-0e4a-4779-b53a-78c48397ea2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120741) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 18:04:19.590975 dv-cinder-852009-8-iscsi devstack@n-api.service[120741]: DEBUG nova.compute.api [None req-b0f28136-d9c1-482b-9a1d-0753fa905008 tempest-AttachVolumeTestJSON-555093534 tempest-AttachVolumeTestJSON-555093534-project] [instance: b958d409-df20-44c6-aa0e-58cb0a482edf] Going to try to start instance {{(pid=120741) start /opt/stack/nova/nova/compute/api.py:2785}} Sep 13 18:04:19.654877 dv-cinder-852009-8-iscsi devstack@n-api.service[120741]: INFO nova.api.openstack.requestlog [None req-b0f28136-d9c1-482b-9a1d-0753fa905008 tempest-AttachVolumeTestJSON-555093534 tempest-AttachVolumeTestJSON-555093534-project] 10.222.0.43 "POST /compute/v2.1/servers/b958d409-df20-44c6-aa0e-58cb0a482edf/action" status: 202 len: 0 microversion: 2.1 time: 0.101969 Sep 13 18:04:19.656452 dv-cinder-852009-8-iscsi devstack@n-api.service[120741]: [pid: 120741|app: 0|req: 159/327] 10.222.0.43 () {60 vars in 1278 bytes} [Tue Sep 13 18:04:19 2022] POST /compute/v2.1/servers/b958d409-df20-44c6-aa0e-58cb0a482edf/action => generated 0 bytes in 104 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Sep 13 18:04:19.665519 dv-cinder-852009-8-iscsi devstack@n-api.service[120740]: DEBUG nova.api.openstack.wsgi [None req-e78d02f4-3d64-490e-b45b-8e750d349ac1 tempest-AttachVolumeTestJSON-555093534 tempest-AttachVolumeTestJSON-555093534-project] Calling method '>' {{(pid=120740) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 18:04:19.666246 dv-cinder-852009-8-iscsi devstack@n-api.service[120740]: DEBUG nova.compute.api [None req-e78d02f4-3d64-490e-b45b-8e750d349ac1 tempest-AttachVolumeTestJSON-555093534 tempest-AttachVolumeTestJSON-555093534-project] [instance: b958d409-df20-44c6-aa0e-58cb0a482edf] Fetching instance by UUID {{(pid=120740) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 18:04:19.673251 dv-cinder-852009-8-iscsi devstack@n-api.service[120740]: DEBUG oslo_concurrency.lockutils [None req-e78d02f4-3d64-490e-b45b-8e750d349ac1 tempest-AttachVolumeTestJSON-555093534 tempest-AttachVolumeTestJSON-555093534-project] Acquiring lock "1daf4f4c-0e4a-4779-b53a-78c48397ea2f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120740) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 18:04:19.675063 dv-cinder-852009-8-iscsi devstack@n-api.service[120740]: DEBUG oslo_concurrency.lockutils [None req-e78d02f4-3d64-490e-b45b-8e750d349ac1 tempest-AttachVolumeTestJSON-555093534 tempest-AttachVolumeTestJSON-555093534-project] Lock "1daf4f4c-0e4a-4779-b53a-78c48397ea2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120740) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 18:04:19.675543 dv-cinder-852009-8-iscsi devstack@n-api.service[120740]: DEBUG oslo_concurrency.lockutils [None req-e78d02f4-3d64-490e-b45b-8e750d349ac1 tempest-AttachVolumeTestJSON-555093534 tempest-AttachVolumeTestJSON-555093534-project] Lock "1daf4f4c-0e4a-4779-b53a-78c48397ea2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120740) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 18:04:19.676505 dv-cinder-852009-8-iscsi devstack@n-api.service[120740]: DEBUG oslo_concurrency.lockutils [None req-e78d02f4-3d64-490e-b45b-8e750d349ac1 tempest-AttachVolumeTestJSON-555093534 tempest-AttachVolumeTestJSON-555093534-project] Acquiring lock "1daf4f4c-0e4a-4779-b53a-78c48397ea2f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120740) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 18:04:19.676986 dv-cinder-852009-8-iscsi devstack@n-api.service[120740]: DEBUG oslo_concurrency.lockutils [None req-e78d02f4-3d64-490e-b45b-8e750d349ac1 tempest-AttachVolumeTestJSON-555093534 tempest-AttachVolumeTestJSON-555093534-project] Lock "1daf4f4c-0e4a-4779-b53a-78c48397ea2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120740) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 18:04:19.677587 dv-cinder-852009-8-iscsi devstack@n-api.service[120740]: DEBUG oslo_concurrency.lockutils [None req-e78d02f4-3d64-490e-b45b-8e750d349ac1 tempest-AttachVolumeTestJSON-555093534 tempest-AttachVolumeTestJSON-555093534-project] Lock "1daf4f4c-0e4a-4779-b53a-78c48397ea2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120740) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 18:04:19.838569 dv-cinder-852009-8-iscsi devstack@n-api.service[120740]: DEBUG nova.policy [None req-e78d02f4-3d64-490e-b45b-8e750d349ac1 tempest-AttachVolumeTestJSON-555093534 tempest-AttachVolumeTestJSON-555093534-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0625b3113ce044bbac4f6142eaade11c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a279fcbf274c4704a31a2b95061e1469', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120740) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 18:04:19.848072 dv-cinder-852009-8-iscsi devstack@n-api.service[120740]: INFO nova.api.openstack.requestlog [None req-e78d02f4-3d64-490e-b45b-8e750d349ac1 tempest-AttachVolumeTestJSON-555093534 tempest-AttachVolumeTestJSON-555093534-project] 10.222.0.43 "GET /compute/v2.1/servers/b958d409-df20-44c6-aa0e-58cb0a482edf" status: 200 len: 1710 microversion: 2.1 time: 0.186990 Sep 13 18:04:19.848916 dv-cinder-852009-8-iscsi devstack@n-api.service[120740]: [pid: 120740|app: 0|req: 169/328] 10.222.0.43 () {58 vars in 1236 bytes} [Tue Sep 13 18:04:19 2022] GET /compute/v2.1/servers/b958d409-df20-44c6-aa0e-58cb0a482edf => generated 1710 bytes in 189 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 13 18:04:19.852074 dv-cinder-852009-8-iscsi devstack@n-api.service[120741]: DEBUG nova.api.openstack.wsgi [None req-9c4219fc-6a5e-4f77-acd1-1225438bcddb tempest-AttachVolumeShelveTestJSON-385853788 tempest-AttachVolumeShelveTestJSON-385853788-project] Calling method '>' {{(pid=120741) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 18:04:19.852578 dv-cinder-852009-8-iscsi devstack@n-api.service[120741]: DEBUG nova.compute.api [None req-9c4219fc-6a5e-4f77-acd1-1225438bcddb tempest-AttachVolumeShelveTestJSON-385853788 tempest-AttachVolumeShelveTestJSON-385853788-project] [instance: 11d2616a-96f9-4a7a-aab8-219219986a8b] Fetching instance by UUID {{(pid=120741) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 18:04:19.859239 dv-cinder-852009-8-iscsi devstack@n-api.service[120741]: DEBUG oslo_concurrency.lockutils [None req-9c4219fc-6a5e-4f77-acd1-1225438bcddb tempest-AttachVolumeShelveTestJSON-385853788 tempest-AttachVolumeShelveTestJSON-385853788-project] Acquiring lock "1daf4f4c-0e4a-4779-b53a-78c48397ea2f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120741) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 18:04:19.859732 dv-cinder-852009-8-iscsi devstack@n-api.service[120741]: DEBUG oslo_concurrency.lockutils [None req-9c4219fc-6a5e-4f77-acd1-1225438bcddb tempest-AttachVolumeShelveTestJSON-385853788 tempest-AttachVolumeShelveTestJSON-385853788-project] Lock "1daf4f4c-0e4a-4779-b53a-78c48397ea2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120741) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 18:04:19.860199 dv-cinder-852009-8-iscsi devstack@n-api.service[120741]: DEBUG oslo_concurrency.lockutils [None req-9c4219fc-6a5e-4f77-acd1-1225438bcddb tempest-AttachVolumeShelveTestJSON-385853788 tempest-AttachVolumeShelveTestJSON-385853788-project] Lock "1daf4f4c-0e4a-4779-b53a-78c48397ea2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120741) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 18:04:19.861030 dv-cinder-852009-8-iscsi devstack@n-api.service[120741]: DEBUG oslo_concurrency.lockutils [None req-9c4219fc-6a5e-4f77-acd1-1225438bcddb tempest-AttachVolumeShelveTestJSON-385853788 tempest-AttachVolumeShelveTestJSON-385853788-project] Acquiring lock "1daf4f4c-0e4a-4779-b53a-78c48397ea2f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120741) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 18:04:19.861491 dv-cinder-852009-8-iscsi devstack@n-api.service[120741]: DEBUG oslo_concurrency.lockutils [None req-9c4219fc-6a5e-4f77-acd1-1225438bcddb tempest-AttachVolumeShelveTestJSON-385853788 tempest-AttachVolumeShelveTestJSON-385853788-project] Lock "1daf4f4c-0e4a-4779-b53a-78c48397ea2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120741) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 18:04:19.861916 dv-cinder-852009-8-iscsi devstack@n-api.service[120741]: DEBUG oslo_concurrency.lockutils [None req-9c4219fc-6a5e-4f77-acd1-1225438bcddb tempest-AttachVolumeShelveTestJSON-385853788 tempest-AttachVolumeShelveTestJSON-385853788-project] Lock "1daf4f4c-0e4a-4779-b53a-78c48397ea2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120741) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 18:04:19.999443 dv-cinder-852009-8-iscsi devstack@n-api.service[120741]: DEBUG nova.policy [None req-9c4219fc-6a5e-4f77-acd1-1225438bcddb tempest-AttachVolumeShelveTestJSON-385853788 tempest-AttachVolumeShelveTestJSON-385853788-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e68ecd9b3ca643539b109f75bb242d6f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '75e14fd88bfb4cd896fa7b070a0fac47', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120741) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 18:04:20.008913 dv-cinder-852009-8-iscsi devstack@n-api.service[120741]: DEBUG nova.policy [None req-9c4219fc-6a5e-4f77-acd1-1225438bcddb tempest-AttachVolumeShelveTestJSON-385853788 tempest-AttachVolumeShelveTestJSON-385853788-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'e68ecd9b3ca643539b109f75bb242d6f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '75e14fd88bfb4cd896fa7b070a0fac47', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120741) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 18:04:20.010370 dv-cinder-852009-8-iscsi devstack@n-api.service[120741]: DEBUG nova.policy [None req-9c4219fc-6a5e-4f77-acd1-1225438bcddb tempest-AttachVolumeShelveTestJSON-385853788 tempest-AttachVolumeShelveTestJSON-385853788-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'e68ecd9b3ca643539b109f75bb242d6f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '75e14fd88bfb4cd896fa7b070a0fac47', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120741) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 18:04:20.011603 dv-cinder-852009-8-iscsi devstack@n-api.service[120741]: INFO nova.api.openstack.requestlog [None req-9c4219fc-6a5e-4f77-acd1-1225438bcddb tempest-AttachVolumeShelveTestJSON-385853788 tempest-AttachVolumeShelveTestJSON-385853788-project] 10.222.0.43 "GET /compute/v2.1/servers/11d2616a-96f9-4a7a-aab8-219219986a8b" status: 200 len: 1807 microversion: 2.20 time: 0.164104 Sep 13 18:04:20.024816 dv-cinder-852009-8-iscsi devstack@n-api.service[120741]: [pid: 120741|app: 0|req: 160/329] 10.222.0.43 () {60 vars in 1277 bytes} [Tue Sep 13 18:04:19 2022] GET /compute/v2.1/servers/11d2616a-96f9-4a7a-aab8-219219986a8b => generated 1807 bytes in 178 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Sep 13 18:04:20.873309 dv-cinder-852009-8-iscsi devstack@n-api.service[120740]: DEBUG nova.api.openstack.wsgi [None req-b6c04cdb-bd08-451f-85bd-cf36b58c0cb9 tempest-AttachVolumeTestJSON-555093534 tempest-AttachVolumeTestJSON-555093534-project] Calling method '>' {{(pid=120740) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 18:04:20.873903 dv-cinder-852009-8-iscsi devstack@n-api.service[120740]: DEBUG nova.compute.api [None req-b6c04cdb-bd08-451f-85bd-cf36b58c0cb9 tempest-AttachVolumeTestJSON-555093534 tempest-AttachVolumeTestJSON-555093534-project] [instance: b958d409-df20-44c6-aa0e-58cb0a482edf] Fetching instance by UUID {{(pid=120740) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 18:04:20.881065 dv-cinder-852009-8-iscsi devstack@n-api.service[120740]: DEBUG oslo_concurrency.lockutils [None req-b6c04cdb-bd08-451f-85bd-cf36b58c0cb9 tempest-AttachVolumeTestJSON-555093534 tempest-AttachVolumeTestJSON-555093534-project] Acquiring lock "1daf4f4c-0e4a-4779-b53a-78c48397ea2f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120740) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 18:04:20.881562 dv-cinder-852009-8-iscsi devstack@n-api.service[120740]: DEBUG oslo_concurrency.lockutils [None req-b6c04cdb-bd08-451f-85bd-cf36b58c0cb9 tempest-AttachVolumeTestJSON-555093534 tempest-AttachVolumeTestJSON-555093534-project] Lock "1daf4f4c-0e4a-4779-b53a-78c48397ea2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120740) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 18:04:20.882863 dv-cinder-852009-8-iscsi devstack@n-api.service[120740]: DEBUG oslo_concurrency.lockutils [None req-b6c04cdb-bd08-451f-85bd-cf36b58c0cb9 tempest-AttachVolumeTestJSON-555093534 tempest-AttachVolumeTestJSON-555093534-project] Lock "1daf4f4c-0e4a-4779-b53a-78c48397ea2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120740) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 18:04:20.883585 dv-cinder-852009-8-iscsi devstack@n-api.service[120740]: DEBUG oslo_concurrency.lockutils [None req-b6c04cdb-bd08-451f-85bd-cf36b58c0cb9 tempest-AttachVolumeTestJSON-555093534 tempest-AttachVolumeTestJSON-555093534-project] Acquiring lock "1daf4f4c-0e4a-4779-b53a-78c48397ea2f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120740) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 18:04:20.884228 dv-cinder-852009-8-iscsi devstack@n-api.service[120740]: DEBUG oslo_concurrency.lockutils [None req-b6c04cdb-bd08-451f-85bd-cf36b58c0cb9 tempest-AttachVolumeTestJSON-555093534 tempest-AttachVolumeTestJSON-555093534-project] Lock "1daf4f4c-0e4a-4779-b53a-78c48397ea2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120740) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 18:04:20.884687 dv-cinder-852009-8-iscsi devstack@n-api.service[120740]: DEBUG oslo_concurrency.lockutils [None req-b6c04cdb-bd08-451f-85bd-cf36b58c0cb9 tempest-AttachVolumeTestJSON-555093534 tempest-AttachVolumeTestJSON-555093534-project] Lock "1daf4f4c-0e4a-4779-b53a-78c48397ea2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120740) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 18:04:21.020812 dv-cinder-852009-8-iscsi devstack@n-api.service[120740]: DEBUG nova.policy [None req-b6c04cdb-bd08-451f-85bd-cf36b58c0cb9 tempest-AttachVolumeTestJSON-555093534 tempest-AttachVolumeTestJSON-555093534-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0625b3113ce044bbac4f6142eaade11c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a279fcbf274c4704a31a2b95061e1469', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120740) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 18:04:21.029229 dv-cinder-852009-8-iscsi devstack@n-api.service[120740]: INFO nova.api.openstack.requestlog [None req-b6c04cdb-bd08-451f-85bd-cf36b58c0cb9 tempest-AttachVolumeTestJSON-555093534 tempest-AttachVolumeTestJSON-555093534-project] 10.222.0.43 "GET /compute/v2.1/servers/b958d409-df20-44c6-aa0e-58cb0a482edf" status: 200 len: 1710 microversion: 2.1 time: 0.159986 Sep 13 18:04:21.029800 dv-cinder-852009-8-iscsi devstack@n-api.service[120740]: [pid: 120740|app: 0|req: 170/330] 10.222.0.43 () {58 vars in 1236 bytes} [Tue Sep 13 18:04:20 2022] GET /compute/v2.1/servers/b958d409-df20-44c6-aa0e-58cb0a482edf => generated 1710 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 13 18:04:21.037478 dv-cinder-852009-8-iscsi devstack@n-api.service[120741]: DEBUG nova.api.openstack.wsgi [None req-3f50beda-f2bf-4809-af1a-c22991c32a0a tempest-AttachVolumeShelveTestJSON-385853788 tempest-AttachVolumeShelveTestJSON-385853788-project] Calling method '>' {{(pid=120741) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 18:04:21.038669 dv-cinder-852009-8-iscsi devstack@n-api.service[120741]: DEBUG nova.compute.api [None req-3f50beda-f2bf-4809-af1a-c22991c32a0a tempest-AttachVolumeShelveTestJSON-385853788 tempest-AttachVolumeShelveTestJSON-385853788-project] [instance: 11d2616a-96f9-4a7a-aab8-219219986a8b] Fetching instance by UUID {{(pid=120741) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 18:04:21.045179 dv-cinder-852009-8-iscsi devstack@n-api.service[120741]: DEBUG oslo_concurrency.lockutils [None req-3f50beda-f2bf-4809-af1a-c22991c32a0a tempest-AttachVolumeShelveTestJSON-385853788 tempest-AttachVolumeShelveTestJSON-385853788-project] Acquiring lock "1daf4f4c-0e4a-4779-b53a-78c48397ea2f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120741) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 18:04:21.045659 dv-cinder-852009-8-iscsi devstack@n-api.service[120741]: DEBUG oslo_concurrency.lockutils [None req-3f50beda-f2bf-4809-af1a-c22991c32a0a tempest-AttachVolumeShelveTestJSON-385853788 tempest-AttachVolumeShelveTestJSON-385853788-project] Lock "1daf4f4c-0e4a-4779-b53a-78c48397ea2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120741) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 18:04:21.046086 dv-cinder-852009-8-iscsi devstack@n-api.service[120741]: DEBUG oslo_concurrency.lockutils [None req-3f50beda-f2bf-4809-af1a-c22991c32a0a tempest-AttachVolumeShelveTestJSON-385853788 tempest-AttachVolumeShelveTestJSON-385853788-project] Lock "1daf4f4c-0e4a-4779-b53a-78c48397ea2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120741) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 18:04:21.046796 dv-cinder-852009-8-iscsi devstack@n-api.service[120741]: DEBUG oslo_concurrency.lockutils [None req-3f50beda-f2bf-4809-af1a-c22991c32a0a tempest-AttachVolumeShelveTestJSON-385853788 tempest-AttachVolumeShelveTestJSON-385853788-project] Acquiring lock "1daf4f4c-0e4a-4779-b53a-78c48397ea2f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120741) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 18:04:21.047243 dv-cinder-852009-8-iscsi devstack@n-api.service[120741]: DEBUG oslo_concurrency.lockutils [None req-3f50beda-f2bf-4809-af1a-c22991c32a0a tempest-AttachVolumeShelveTestJSON-385853788 tempest-AttachVolumeShelveTestJSON-385853788-project] Lock "1daf4f4c-0e4a-4779-b53a-78c48397ea2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120741) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 18:04:21.047658 dv-cinder-852009-8-iscsi devstack@n-api.service[120741]: DEBUG oslo_concurrency.lockutils [None req-3f50beda-f2bf-4809-af1a-c22991c32a0a tempest-AttachVolumeShelveTestJSON-385853788 tempest-AttachVolumeShelveTestJSON-385853788-project] Lock "1daf4f4c-0e4a-4779-b53a-78c48397ea2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120741) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 18:04:21.183146 dv-cinder-852009-8-iscsi devstack@n-api.service[120741]: DEBUG nova.policy [None req-3f50beda-f2bf-4809-af1a-c22991c32a0a tempest-AttachVolumeShelveTestJSON-385853788 tempest-AttachVolumeShelveTestJSON-385853788-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e68ecd9b3ca643539b109f75bb242d6f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '75e14fd88bfb4cd896fa7b070a0fac47', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120741) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 18:04:21.196341 dv-cinder-852009-8-iscsi devstack@n-api.service[120741]: DEBUG nova.policy [None req-3f50beda-f2bf-4809-af1a-c22991c32a0a tempest-AttachVolumeShelveTestJSON-385853788 tempest-AttachVolumeShelveTestJSON-385853788-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'e68ecd9b3ca643539b109f75bb242d6f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '75e14fd88bfb4cd896fa7b070a0fac47', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120741) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 18:04:21.198298 dv-cinder-852009-8-iscsi devstack@n-api.service[120741]: DEBUG nova.policy [None req-3f50beda-f2bf-4809-af1a-c22991c32a0a tempest-AttachVolumeShelveTestJSON-385853788 tempest-AttachVolumeShelveTestJSON-385853788-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'e68ecd9b3ca643539b109f75bb242d6f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '75e14fd88bfb4cd896fa7b070a0fac47', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120741) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 18:04:21.200023 dv-cinder-852009-8-iscsi devstack@n-api.service[120741]: INFO nova.api.openstack.requestlog [None req-3f50beda-f2bf-4809-af1a-c22991c32a0a tempest-AttachVolumeShelveTestJSON-385853788 tempest-AttachVolumeShelveTestJSON-385853788-project] 10.222.0.43 "GET /compute/v2.1/servers/11d2616a-96f9-4a7a-aab8-219219986a8b" status: 200 len: 1807 microversion: 2.20 time: 0.166297 Sep 13 18:04:21.200897 dv-cinder-852009-8-iscsi devstack@n-api.service[120741]: [pid: 120741|app: 0|req: 161/331] 10.222.0.43 () {60 vars in 1277 bytes} [Tue Sep 13 18:04:21 2022] GET /compute/v2.1/servers/11d2616a-96f9-4a7a-aab8-219219986a8b => generated 1807 bytes in 168 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Sep 13 18:04:21.753717 dv-cinder-852009-8-iscsi devstack@n-api.service[120740]: DEBUG nova.api.openstack.wsgi [req-ef5ff78f-dc14-4bcf-b549-0328a1f73790 req-5a1c659c-cb00-4056-b669-297f6466f167 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "2d60cc6d-a699-417d-aa20-fe3e1bfc351e", "tag": "fa199ada-f924-4f1a-9116-5daf985f618d"}]} {{(pid=120740) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 13 18:04:21.758659 dv-cinder-852009-8-iscsi devstack@n-api.service[120740]: DEBUG dbcounter [-] [120740] Writing DB stats nova_api:SELECT=97,nova_api:INSERT=3 {{(pid=120740) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 18:04:21.764029 dv-cinder-852009-8-iscsi devstack@n-api.service[120740]: DEBUG oslo_concurrency.lockutils [req-ef5ff78f-dc14-4bcf-b549-0328a1f73790 req-5a1c659c-cb00-4056-b669-297f6466f167 service nova] Acquiring lock "1daf4f4c-0e4a-4779-b53a-78c48397ea2f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120740) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 18:04:21.764539 dv-cinder-852009-8-iscsi devstack@n-api.service[120740]: DEBUG oslo_concurrency.lockutils [req-ef5ff78f-dc14-4bcf-b549-0328a1f73790 req-5a1c659c-cb00-4056-b669-297f6466f167 service nova] Lock "1daf4f4c-0e4a-4779-b53a-78c48397ea2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120740) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 18:04:21.764967 dv-cinder-852009-8-iscsi devstack@n-api.service[120740]: DEBUG oslo_concurrency.lockutils [req-ef5ff78f-dc14-4bcf-b549-0328a1f73790 req-5a1c659c-cb00-4056-b669-297f6466f167 service nova] Lock "1daf4f4c-0e4a-4779-b53a-78c48397ea2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120740) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 18:04:21.777457 dv-cinder-852009-8-iscsi devstack@n-api.service[120740]: INFO nova.api.openstack.compute.server_external_events [req-ef5ff78f-dc14-4bcf-b549-0328a1f73790 req-5a1c659c-cb00-4056-b669-297f6466f167 service nova] Creating event network-changed:fa199ada-f924-4f1a-9116-5daf985f618d for instance 2d60cc6d-a699-417d-aa20-fe3e1bfc351e on hv-cinder-85200 Sep 13 18:04:21.794845 dv-cinder-852009-8-iscsi devstack@n-api.service[120740]: INFO nova.api.openstack.requestlog [req-ef5ff78f-dc14-4bcf-b549-0328a1f73790 req-5a1c659c-cb00-4056-b669-297f6466f167 service nova] 10.222.0.43 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.045152 Sep 13 18:04:21.795696 dv-cinder-852009-8-iscsi devstack@n-api.service[120740]: [pid: 120740|app: 0|req: 171/332] 10.222.0.43 () {64 vars in 1317 bytes} [Tue Sep 13 18:04:21 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 47 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Sep 13 18:04:22.053990 dv-cinder-852009-8-iscsi devstack@n-api.service[120741]: DEBUG nova.api.openstack.wsgi [None req-27031394-dd97-487b-b300-3f92f4346a13 tempest-AttachVolumeTestJSON-555093534 tempest-AttachVolumeTestJSON-555093534-project] Calling method '>' {{(pid=120741) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 18:04:22.054482 dv-cinder-852009-8-iscsi devstack@n-api.service[120741]: DEBUG nova.compute.api [None req-27031394-dd97-487b-b300-3f92f4346a13 tempest-AttachVolumeTestJSON-555093534 tempest-AttachVolumeTestJSON-555093534-project] [instance: b958d409-df20-44c6-aa0e-58cb0a482edf] Fetching instance by UUID {{(pid=120741) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 18:04:22.063909 dv-cinder-852009-8-iscsi devstack@n-api.service[120741]: DEBUG oslo_concurrency.lockutils [None req-27031394-dd97-487b-b300-3f92f4346a13 tempest-AttachVolumeTestJSON-555093534 tempest-AttachVolumeTestJSON-555093534-project] Acquiring lock "1daf4f4c-0e4a-4779-b53a-78c48397ea2f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120741) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 18:04:22.064283 dv-cinder-852009-8-iscsi devstack@n-api.service[120741]: DEBUG oslo_concurrency.lockutils [None req-27031394-dd97-487b-b300-3f92f4346a13 tempest-AttachVolumeTestJSON-555093534 tempest-AttachVolumeTestJSON-555093534-project] Lock "1daf4f4c-0e4a-4779-b53a-78c48397ea2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120741) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 18:04:22.064751 dv-cinder-852009-8-iscsi devstack@n-api.service[120741]: DEBUG oslo_concurrency.lockutils [None req-27031394-dd97-487b-b300-3f92f4346a13 tempest-AttachVolumeTestJSON-555093534 tempest-AttachVolumeTestJSON-555093534-project] Lock "1daf4f4c-0e4a-4779-b53a-78c48397ea2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120741) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 18:04:22.065468 dv-cinder-852009-8-iscsi devstack@n-api.service[120741]: DEBUG oslo_concurrency.lockutils [None req-27031394-dd97-487b-b300-3f92f4346a13 tempest-AttachVolumeTestJSON-555093534 tempest-AttachVolumeTestJSON-555093534-project] Acquiring lock "1daf4f4c-0e4a-4779-b53a-78c48397ea2f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120741) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 18:04:22.065923 dv-cinder-852009-8-iscsi devstack@n-api.service[120741]: DEBUG oslo_concurrency.lockutils [None req-27031394-dd97-487b-b300-3f92f4346a13 tempest-AttachVolumeTestJSON-555093534 tempest-AttachVolumeTestJSON-555093534-project] Lock "1daf4f4c-0e4a-4779-b53a-78c48397ea2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120741) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 18:04:22.066347 dv-cinder-852009-8-iscsi devstack@n-api.service[120741]: DEBUG oslo_concurrency.lockutils [None req-27031394-dd97-487b-b300-3f92f4346a13 tempest-AttachVolumeTestJSON-555093534 tempest-AttachVolumeTestJSON-555093534-project] Lock "1daf4f4c-0e4a-4779-b53a-78c48397ea2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120741) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 18:04:22.232914 dv-cinder-852009-8-iscsi devstack@n-api.service[120740]: DEBUG nova.api.openstack.wsgi [None req-69a69a1c-51ce-4e59-b1e6-65e52cffd399 tempest-AttachVolumeShelveTestJSON-385853788 tempest-AttachVolumeShelveTestJSON-385853788-project] Calling method '>' {{(pid=120740) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 18:04:22.232914 dv-cinder-852009-8-iscsi devstack@n-api.service[120740]: DEBUG nova.compute.api [None req-69a69a1c-51ce-4e59-b1e6-65e52cffd399 tempest-AttachVolumeShelveTestJSON-385853788 tempest-AttachVolumeShelveTestJSON-385853788-project] [instance: 11d2616a-96f9-4a7a-aab8-219219986a8b] Fetching instance by UUID {{(pid=120740) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 18:04:22.239150 dv-cinder-852009-8-iscsi devstack@n-api.service[120740]: DEBUG oslo_concurrency.lockutils [None req-69a69a1c-51ce-4e59-b1e6-65e52cffd399 tempest-AttachVolumeShelveTestJSON-385853788 tempest-AttachVolumeShelveTestJSON-385853788-project] Acquiring lock "1daf4f4c-0e4a-4779-b53a-78c48397ea2f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120740) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 18:04:22.240602 dv-cinder-852009-8-iscsi devstack@n-api.service[120740]: DEBUG oslo_concurrency.lockutils [None req-69a69a1c-51ce-4e59-b1e6-65e52cffd399 tempest-AttachVolumeShelveTestJSON-385853788 tempest-AttachVolumeShelveTestJSON-385853788-project] Lock "1daf4f4c-0e4a-4779-b53a-78c48397ea2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120740) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 18:04:22.241213 dv-cinder-852009-8-iscsi devstack@n-api.service[120740]: DEBUG oslo_concurrency.lockutils [None req-69a69a1c-51ce-4e59-b1e6-65e52cffd399 tempest-AttachVolumeShelveTestJSON-385853788 tempest-AttachVolumeShelveTestJSON-385853788-project] Lock "1daf4f4c-0e4a-4779-b53a-78c48397ea2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120740) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 18:04:22.242364 dv-cinder-852009-8-iscsi devstack@n-api.service[120740]: DEBUG oslo_concurrency.lockutils [None req-69a69a1c-51ce-4e59-b1e6-65e52cffd399 tempest-AttachVolumeShelveTestJSON-385853788 tempest-AttachVolumeShelveTestJSON-385853788-project] Acquiring lock "1daf4f4c-0e4a-4779-b53a-78c48397ea2f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120740) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 18:04:22.243773 dv-cinder-852009-8-iscsi devstack@n-api.service[120740]: DEBUG oslo_concurrency.lockutils [None req-69a69a1c-51ce-4e59-b1e6-65e52cffd399 tempest-AttachVolumeShelveTestJSON-385853788 tempest-AttachVolumeShelveTestJSON-385853788-project] Lock "1daf4f4c-0e4a-4779-b53a-78c48397ea2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120740) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 18:04:22.245175 dv-cinder-852009-8-iscsi devstack@n-api.service[120740]: DEBUG oslo_concurrency.lockutils [None req-69a69a1c-51ce-4e59-b1e6-65e52cffd399 tempest-AttachVolumeShelveTestJSON-385853788 tempest-AttachVolumeShelveTestJSON-385853788-project] Lock "1daf4f4c-0e4a-4779-b53a-78c48397ea2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120740) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 18:04:22.322266 dv-cinder-852009-8-iscsi devstack@n-api.service[120741]: DEBUG nova.policy [None req-27031394-dd97-487b-b300-3f92f4346a13 tempest-AttachVolumeTestJSON-555093534 tempest-AttachVolumeTestJSON-555093534-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0625b3113ce044bbac4f6142eaade11c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a279fcbf274c4704a31a2b95061e1469', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120741) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 18:04:22.342537 dv-cinder-852009-8-iscsi devstack@n-api.service[120741]: INFO nova.api.openstack.requestlog [None req-27031394-dd97-487b-b300-3f92f4346a13 tempest-AttachVolumeTestJSON-555093534 tempest-AttachVolumeTestJSON-555093534-project] 10.222.0.43 "GET /compute/v2.1/servers/b958d409-df20-44c6-aa0e-58cb0a482edf" status: 200 len: 1714 microversion: 2.1 time: 0.292963 Sep 13 18:04:22.343214 dv-cinder-852009-8-iscsi devstack@n-api.service[120741]: [pid: 120741|app: 0|req: 162/333] 10.222.0.43 () {58 vars in 1236 bytes} [Tue Sep 13 18:04:22 2022] GET /compute/v2.1/servers/b958d409-df20-44c6-aa0e-58cb0a482edf => generated 1714 bytes in 294 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 13 18:04:22.484285 dv-cinder-852009-8-iscsi devstack@n-api.service[120740]: DEBUG nova.policy [None req-69a69a1c-51ce-4e59-b1e6-65e52cffd399 tempest-AttachVolumeShelveTestJSON-385853788 tempest-AttachVolumeShelveTestJSON-385853788-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e68ecd9b3ca643539b109f75bb242d6f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '75e14fd88bfb4cd896fa7b070a0fac47', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120740) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 18:04:22.495383 dv-cinder-852009-8-iscsi devstack@n-api.service[120740]: DEBUG nova.policy [None req-69a69a1c-51ce-4e59-b1e6-65e52cffd399 tempest-AttachVolumeShelveTestJSON-385853788 tempest-AttachVolumeShelveTestJSON-385853788-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'e68ecd9b3ca643539b109f75bb242d6f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '75e14fd88bfb4cd896fa7b070a0fac47', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120740) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 18:04:22.498130 dv-cinder-852009-8-iscsi devstack@n-api.service[120740]: DEBUG nova.policy [None req-69a69a1c-51ce-4e59-b1e6-65e52cffd399 tempest-AttachVolumeShelveTestJSON-385853788 tempest-AttachVolumeShelveTestJSON-385853788-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'e68ecd9b3ca643539b109f75bb242d6f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '75e14fd88bfb4cd896fa7b070a0fac47', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120740) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 18:04:22.499761 dv-cinder-852009-8-iscsi devstack@n-api.service[120740]: INFO nova.api.openstack.requestlog [None req-69a69a1c-51ce-4e59-b1e6-65e52cffd399 tempest-AttachVolumeShelveTestJSON-385853788 tempest-AttachVolumeShelveTestJSON-385853788-project] 10.222.0.43 "GET /compute/v2.1/servers/11d2616a-96f9-4a7a-aab8-219219986a8b" status: 200 len: 1807 microversion: 2.20 time: 0.272660 Sep 13 18:04:22.500844 dv-cinder-852009-8-iscsi devstack@n-api.service[120740]: [pid: 120740|app: 0|req: 172/334] 10.222.0.43 () {60 vars in 1277 bytes} [Tue Sep 13 18:04:22 2022] GET /compute/v2.1/servers/11d2616a-96f9-4a7a-aab8-219219986a8b => generated 1807 bytes in 274 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 13 18:04:23.527875 dv-cinder-852009-8-iscsi devstack@n-api.service[120741]: DEBUG nova.api.openstack.wsgi [None req-25e8c560-9b51-4a77-9aca-0fd9dbbc0db6 tempest-AttachVolumeShelveTestJSON-385853788 tempest-AttachVolumeShelveTestJSON-385853788-project] Calling method '>' {{(pid=120741) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 18:04:23.530121 dv-cinder-852009-8-iscsi devstack@n-api.service[120741]: DEBUG nova.compute.api [None req-25e8c560-9b51-4a77-9aca-0fd9dbbc0db6 tempest-AttachVolumeShelveTestJSON-385853788 tempest-AttachVolumeShelveTestJSON-385853788-project] [instance: 11d2616a-96f9-4a7a-aab8-219219986a8b] Fetching instance by UUID {{(pid=120741) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 18:04:23.536831 dv-cinder-852009-8-iscsi devstack@n-api.service[120741]: DEBUG oslo_concurrency.lockutils [None req-25e8c560-9b51-4a77-9aca-0fd9dbbc0db6 tempest-AttachVolumeShelveTestJSON-385853788 tempest-AttachVolumeShelveTestJSON-385853788-project] Acquiring lock "1daf4f4c-0e4a-4779-b53a-78c48397ea2f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120741) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 18:04:23.537316 dv-cinder-852009-8-iscsi devstack@n-api.service[120741]: DEBUG oslo_concurrency.lockutils [None req-25e8c560-9b51-4a77-9aca-0fd9dbbc0db6 tempest-AttachVolumeShelveTestJSON-385853788 tempest-AttachVolumeShelveTestJSON-385853788-project] Lock "1daf4f4c-0e4a-4779-b53a-78c48397ea2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120741) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 18:04:23.537744 dv-cinder-852009-8-iscsi devstack@n-api.service[120741]: DEBUG oslo_concurrency.lockutils [None req-25e8c560-9b51-4a77-9aca-0fd9dbbc0db6 tempest-AttachVolumeShelveTestJSON-385853788 tempest-AttachVolumeShelveTestJSON-385853788-project] Lock "1daf4f4c-0e4a-4779-b53a-78c48397ea2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120741) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 18:04:23.538449 dv-cinder-852009-8-iscsi devstack@n-api.service[120741]: DEBUG oslo_concurrency.lockutils [None req-25e8c560-9b51-4a77-9aca-0fd9dbbc0db6 tempest-AttachVolumeShelveTestJSON-385853788 tempest-AttachVolumeShelveTestJSON-385853788-project] Acquiring lock "1daf4f4c-0e4a-4779-b53a-78c48397ea2f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120741) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 18:04:23.538932 dv-cinder-852009-8-iscsi devstack@n-api.service[120741]: DEBUG oslo_concurrency.lockutils [None req-25e8c560-9b51-4a77-9aca-0fd9dbbc0db6 tempest-AttachVolumeShelveTestJSON-385853788 tempest-AttachVolumeShelveTestJSON-385853788-project] Lock "1daf4f4c-0e4a-4779-b53a-78c48397ea2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120741) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 18:04:23.539357 dv-cinder-852009-8-iscsi devstack@n-api.service[120741]: DEBUG oslo_concurrency.lockutils [None req-25e8c560-9b51-4a77-9aca-0fd9dbbc0db6 tempest-AttachVolumeShelveTestJSON-385853788 tempest-AttachVolumeShelveTestJSON-385853788-project] Lock "1daf4f4c-0e4a-4779-b53a-78c48397ea2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120741) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 18:04:23.686355 dv-cinder-852009-8-iscsi devstack@n-api.service[120741]: DEBUG nova.policy [None req-25e8c560-9b51-4a77-9aca-0fd9dbbc0db6 tempest-AttachVolumeShelveTestJSON-385853788 tempest-AttachVolumeShelveTestJSON-385853788-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e68ecd9b3ca643539b109f75bb242d6f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '75e14fd88bfb4cd896fa7b070a0fac47', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120741) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 18:04:23.695376 dv-cinder-852009-8-iscsi devstack@n-api.service[120741]: DEBUG nova.policy [None req-25e8c560-9b51-4a77-9aca-0fd9dbbc0db6 tempest-AttachVolumeShelveTestJSON-385853788 tempest-AttachVolumeShelveTestJSON-385853788-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'e68ecd9b3ca643539b109f75bb242d6f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '75e14fd88bfb4cd896fa7b070a0fac47', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120741) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 18:04:23.696975 dv-cinder-852009-8-iscsi devstack@n-api.service[120741]: DEBUG nova.policy [None req-25e8c560-9b51-4a77-9aca-0fd9dbbc0db6 tempest-AttachVolumeShelveTestJSON-385853788 tempest-AttachVolumeShelveTestJSON-385853788-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'e68ecd9b3ca643539b109f75bb242d6f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '75e14fd88bfb4cd896fa7b070a0fac47', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120741) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 18:04:23.698184 dv-cinder-852009-8-iscsi devstack@n-api.service[120741]: INFO nova.api.openstack.requestlog [None req-25e8c560-9b51-4a77-9aca-0fd9dbbc0db6 tempest-AttachVolumeShelveTestJSON-385853788 tempest-AttachVolumeShelveTestJSON-385853788-project] 10.222.0.43 "GET /compute/v2.1/servers/11d2616a-96f9-4a7a-aab8-219219986a8b" status: 200 len: 1807 microversion: 2.20 time: 0.174330 Sep 13 18:04:23.698747 dv-cinder-852009-8-iscsi devstack@n-api.service[120741]: [pid: 120741|app: 0|req: 163/335] 10.222.0.43 () {60 vars in 1277 bytes} [Tue Sep 13 18:04:23 2022] GET /compute/v2.1/servers/11d2616a-96f9-4a7a-aab8-219219986a8b => generated 1807 bytes in 176 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 13 18:04:24.724577 dv-cinder-852009-8-iscsi devstack@n-api.service[120740]: DEBUG nova.api.openstack.wsgi [None req-446cd8af-df55-4330-bef8-13dce27207fa tempest-AttachVolumeShelveTestJSON-385853788 tempest-AttachVolumeShelveTestJSON-385853788-project] Calling method '>' {{(pid=120740) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 18:04:24.725251 dv-cinder-852009-8-iscsi devstack@n-api.service[120740]: DEBUG nova.compute.api [None req-446cd8af-df55-4330-bef8-13dce27207fa tempest-AttachVolumeShelveTestJSON-385853788 tempest-AttachVolumeShelveTestJSON-385853788-project] [instance: 11d2616a-96f9-4a7a-aab8-219219986a8b] Fetching instance by UUID {{(pid=120740) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 18:04:24.731705 dv-cinder-852009-8-iscsi devstack@n-api.service[120740]: DEBUG oslo_concurrency.lockutils [None req-446cd8af-df55-4330-bef8-13dce27207fa tempest-AttachVolumeShelveTestJSON-385853788 tempest-AttachVolumeShelveTestJSON-385853788-project] Acquiring lock "1daf4f4c-0e4a-4779-b53a-78c48397ea2f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120740) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 18:04:24.732188 dv-cinder-852009-8-iscsi devstack@n-api.service[120740]: DEBUG oslo_concurrency.lockutils [None req-446cd8af-df55-4330-bef8-13dce27207fa tempest-AttachVolumeShelveTestJSON-385853788 tempest-AttachVolumeShelveTestJSON-385853788-project] Lock "1daf4f4c-0e4a-4779-b53a-78c48397ea2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120740) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 18:04:24.732657 dv-cinder-852009-8-iscsi devstack@n-api.service[120740]: DEBUG oslo_concurrency.lockutils [None req-446cd8af-df55-4330-bef8-13dce27207fa tempest-AttachVolumeShelveTestJSON-385853788 tempest-AttachVolumeShelveTestJSON-385853788-project] Lock "1daf4f4c-0e4a-4779-b53a-78c48397ea2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120740) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 18:04:24.733350 dv-cinder-852009-8-iscsi devstack@n-api.service[120740]: DEBUG oslo_concurrency.lockutils [None req-446cd8af-df55-4330-bef8-13dce27207fa tempest-AttachVolumeShelveTestJSON-385853788 tempest-AttachVolumeShelveTestJSON-385853788-project] Acquiring lock "1daf4f4c-0e4a-4779-b53a-78c48397ea2f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120740) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 18:04:24.733800 dv-cinder-852009-8-iscsi devstack@n-api.service[120740]: DEBUG oslo_concurrency.lockutils [None req-446cd8af-df55-4330-bef8-13dce27207fa tempest-AttachVolumeShelveTestJSON-385853788 tempest-AttachVolumeShelveTestJSON-385853788-project] Lock "1daf4f4c-0e4a-4779-b53a-78c48397ea2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120740) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 18:04:24.734214 dv-cinder-852009-8-iscsi devstack@n-api.service[120740]: DEBUG oslo_concurrency.lockutils [None req-446cd8af-df55-4330-bef8-13dce27207fa tempest-AttachVolumeShelveTestJSON-385853788 tempest-AttachVolumeShelveTestJSON-385853788-project] Lock "1daf4f4c-0e4a-4779-b53a-78c48397ea2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120740) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 18:04:24.888231 dv-cinder-852009-8-iscsi devstack@n-api.service[120740]: DEBUG nova.policy [None req-446cd8af-df55-4330-bef8-13dce27207fa tempest-AttachVolumeShelveTestJSON-385853788 tempest-AttachVolumeShelveTestJSON-385853788-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e68ecd9b3ca643539b109f75bb242d6f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '75e14fd88bfb4cd896fa7b070a0fac47', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120740) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 18:04:24.897511 dv-cinder-852009-8-iscsi devstack@n-api.service[120740]: DEBUG nova.policy [None req-446cd8af-df55-4330-bef8-13dce27207fa tempest-AttachVolumeShelveTestJSON-385853788 tempest-AttachVolumeShelveTestJSON-385853788-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'e68ecd9b3ca643539b109f75bb242d6f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '75e14fd88bfb4cd896fa7b070a0fac47', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120740) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 18:04:24.899068 dv-cinder-852009-8-iscsi devstack@n-api.service[120740]: DEBUG nova.policy [None req-446cd8af-df55-4330-bef8-13dce27207fa tempest-AttachVolumeShelveTestJSON-385853788 tempest-AttachVolumeShelveTestJSON-385853788-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'e68ecd9b3ca643539b109f75bb242d6f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '75e14fd88bfb4cd896fa7b070a0fac47', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120740) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 18:04:24.900323 dv-cinder-852009-8-iscsi devstack@n-api.service[120740]: INFO nova.api.openstack.requestlog [None req-446cd8af-df55-4330-bef8-13dce27207fa tempest-AttachVolumeShelveTestJSON-385853788 tempest-AttachVolumeShelveTestJSON-385853788-project] 10.222.0.43 "GET /compute/v2.1/servers/11d2616a-96f9-4a7a-aab8-219219986a8b" status: 200 len: 1807 microversion: 2.20 time: 0.180043 Sep 13 18:04:24.916455 dv-cinder-852009-8-iscsi devstack@n-api.service[120740]: [pid: 120740|app: 0|req: 173/336] 10.222.0.43 () {60 vars in 1277 bytes} [Tue Sep 13 18:04:24 2022] GET /compute/v2.1/servers/11d2616a-96f9-4a7a-aab8-219219986a8b => generated 1807 bytes in 181 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 13 18:04:25.927492 dv-cinder-852009-8-iscsi devstack@n-api.service[120741]: DEBUG nova.api.openstack.wsgi [None req-d37f9a57-b245-4a93-9ef5-eac4b1504441 tempest-AttachVolumeShelveTestJSON-385853788 tempest-AttachVolumeShelveTestJSON-385853788-project] Calling method '>' {{(pid=120741) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 18:04:25.928135 dv-cinder-852009-8-iscsi devstack@n-api.service[120741]: DEBUG nova.compute.api [None req-d37f9a57-b245-4a93-9ef5-eac4b1504441 tempest-AttachVolumeShelveTestJSON-385853788 tempest-AttachVolumeShelveTestJSON-385853788-project] [instance: 11d2616a-96f9-4a7a-aab8-219219986a8b] Fetching instance by UUID {{(pid=120741) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 18:04:25.935657 dv-cinder-852009-8-iscsi devstack@n-api.service[120741]: DEBUG oslo_concurrency.lockutils [None req-d37f9a57-b245-4a93-9ef5-eac4b1504441 tempest-AttachVolumeShelveTestJSON-385853788 tempest-AttachVolumeShelveTestJSON-385853788-project] Acquiring lock "1daf4f4c-0e4a-4779-b53a-78c48397ea2f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120741) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 18:04:25.936455 dv-cinder-852009-8-iscsi devstack@n-api.service[120741]: DEBUG oslo_concurrency.lockutils [None req-d37f9a57-b245-4a93-9ef5-eac4b1504441 tempest-AttachVolumeShelveTestJSON-385853788 tempest-AttachVolumeShelveTestJSON-385853788-project] Lock "1daf4f4c-0e4a-4779-b53a-78c48397ea2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120741) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 18:04:25.937101 dv-cinder-852009-8-iscsi devstack@n-api.service[120741]: DEBUG oslo_concurrency.lockutils [None req-d37f9a57-b245-4a93-9ef5-eac4b1504441 tempest-AttachVolumeShelveTestJSON-385853788 tempest-AttachVolumeShelveTestJSON-385853788-project] Lock "1daf4f4c-0e4a-4779-b53a-78c48397ea2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120741) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 18:04:25.938081 dv-cinder-852009-8-iscsi devstack@n-api.service[120741]: DEBUG oslo_concurrency.lockutils [None req-d37f9a57-b245-4a93-9ef5-eac4b1504441 tempest-AttachVolumeShelveTestJSON-385853788 tempest-AttachVolumeShelveTestJSON-385853788-project] Acquiring lock "1daf4f4c-0e4a-4779-b53a-78c48397ea2f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120741) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 18:04:25.938859 dv-cinder-852009-8-iscsi devstack@n-api.service[120741]: DEBUG oslo_concurrency.lockutils [None req-d37f9a57-b245-4a93-9ef5-eac4b1504441 tempest-AttachVolumeShelveTestJSON-385853788 tempest-AttachVolumeShelveTestJSON-385853788-project] Lock "1daf4f4c-0e4a-4779-b53a-78c48397ea2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120741) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 18:04:25.939473 dv-cinder-852009-8-iscsi devstack@n-api.service[120741]: DEBUG oslo_concurrency.lockutils [None req-d37f9a57-b245-4a93-9ef5-eac4b1504441 tempest-AttachVolumeShelveTestJSON-385853788 tempest-AttachVolumeShelveTestJSON-385853788-project] Lock "1daf4f4c-0e4a-4779-b53a-78c48397ea2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120741) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 18:04:26.075543 dv-cinder-852009-8-iscsi devstack@n-api.service[120741]: DEBUG nova.policy [None req-d37f9a57-b245-4a93-9ef5-eac4b1504441 tempest-AttachVolumeShelveTestJSON-385853788 tempest-AttachVolumeShelveTestJSON-385853788-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e68ecd9b3ca643539b109f75bb242d6f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '75e14fd88bfb4cd896fa7b070a0fac47', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120741) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 18:04:26.084438 dv-cinder-852009-8-iscsi devstack@n-api.service[120741]: DEBUG nova.policy [None req-d37f9a57-b245-4a93-9ef5-eac4b1504441 tempest-AttachVolumeShelveTestJSON-385853788 tempest-AttachVolumeShelveTestJSON-385853788-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'e68ecd9b3ca643539b109f75bb242d6f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '75e14fd88bfb4cd896fa7b070a0fac47', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120741) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 18:04:26.085879 dv-cinder-852009-8-iscsi devstack@n-api.service[120741]: DEBUG nova.policy [None req-d37f9a57-b245-4a93-9ef5-eac4b1504441 tempest-AttachVolumeShelveTestJSON-385853788 tempest-AttachVolumeShelveTestJSON-385853788-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'e68ecd9b3ca643539b109f75bb242d6f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '75e14fd88bfb4cd896fa7b070a0fac47', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120741) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 18:04:26.087045 dv-cinder-852009-8-iscsi devstack@n-api.service[120741]: INFO nova.api.openstack.requestlog [None req-d37f9a57-b245-4a93-9ef5-eac4b1504441 tempest-AttachVolumeShelveTestJSON-385853788 tempest-AttachVolumeShelveTestJSON-385853788-project] 10.222.0.43 "GET /compute/v2.1/servers/11d2616a-96f9-4a7a-aab8-219219986a8b" status: 200 len: 1807 microversion: 2.20 time: 0.163633 Sep 13 18:04:26.087613 dv-cinder-852009-8-iscsi devstack@n-api.service[120741]: [pid: 120741|app: 0|req: 164/337] 10.222.0.43 () {60 vars in 1277 bytes} [Tue Sep 13 18:04:25 2022] GET /compute/v2.1/servers/11d2616a-96f9-4a7a-aab8-219219986a8b => generated 1807 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 13 18:04:27.112930 dv-cinder-852009-8-iscsi devstack@n-api.service[120740]: DEBUG nova.api.openstack.wsgi [None req-032b0793-0ad2-4969-a0e2-032321a405e4 tempest-AttachVolumeShelveTestJSON-385853788 tempest-AttachVolumeShelveTestJSON-385853788-project] Calling method '>' {{(pid=120740) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 18:04:27.113916 dv-cinder-852009-8-iscsi devstack@n-api.service[120740]: DEBUG nova.compute.api [None req-032b0793-0ad2-4969-a0e2-032321a405e4 tempest-AttachVolumeShelveTestJSON-385853788 tempest-AttachVolumeShelveTestJSON-385853788-project] [instance: 11d2616a-96f9-4a7a-aab8-219219986a8b] Fetching instance by UUID {{(pid=120740) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 18:04:27.121735 dv-cinder-852009-8-iscsi devstack@n-api.service[120740]: DEBUG oslo_concurrency.lockutils [None req-032b0793-0ad2-4969-a0e2-032321a405e4 tempest-AttachVolumeShelveTestJSON-385853788 tempest-AttachVolumeShelveTestJSON-385853788-project] Acquiring lock "1daf4f4c-0e4a-4779-b53a-78c48397ea2f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120740) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 18:04:27.122258 dv-cinder-852009-8-iscsi devstack@n-api.service[120740]: DEBUG oslo_concurrency.lockutils [None req-032b0793-0ad2-4969-a0e2-032321a405e4 tempest-AttachVolumeShelveTestJSON-385853788 tempest-AttachVolumeShelveTestJSON-385853788-project] Lock "1daf4f4c-0e4a-4779-b53a-78c48397ea2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120740) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 18:04:27.122684 dv-cinder-852009-8-iscsi devstack@n-api.service[120740]: DEBUG oslo_concurrency.lockutils [None req-032b0793-0ad2-4969-a0e2-032321a405e4 tempest-AttachVolumeShelveTestJSON-385853788 tempest-AttachVolumeShelveTestJSON-385853788-project] Lock "1daf4f4c-0e4a-4779-b53a-78c48397ea2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120740) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 18:04:27.123385 dv-cinder-852009-8-iscsi devstack@n-api.service[120740]: DEBUG oslo_concurrency.lockutils [None req-032b0793-0ad2-4969-a0e2-032321a405e4 tempest-AttachVolumeShelveTestJSON-385853788 tempest-AttachVolumeShelveTestJSON-385853788-project] Acquiring lock "1daf4f4c-0e4a-4779-b53a-78c48397ea2f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120740) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 18:04:27.123835 dv-cinder-852009-8-iscsi devstack@n-api.service[120740]: DEBUG oslo_concurrency.lockutils [None req-032b0793-0ad2-4969-a0e2-032321a405e4 tempest-AttachVolumeShelveTestJSON-385853788 tempest-AttachVolumeShelveTestJSON-385853788-project] Lock "1daf4f4c-0e4a-4779-b53a-78c48397ea2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120740) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 18:04:27.124253 dv-cinder-852009-8-iscsi devstack@n-api.service[120740]: DEBUG oslo_concurrency.lockutils [None req-032b0793-0ad2-4969-a0e2-032321a405e4 tempest-AttachVolumeShelveTestJSON-385853788 tempest-AttachVolumeShelveTestJSON-385853788-project] Lock "1daf4f4c-0e4a-4779-b53a-78c48397ea2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120740) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 18:04:27.281218 dv-cinder-852009-8-iscsi devstack@n-api.service[120740]: DEBUG nova.policy [None req-032b0793-0ad2-4969-a0e2-032321a405e4 tempest-AttachVolumeShelveTestJSON-385853788 tempest-AttachVolumeShelveTestJSON-385853788-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e68ecd9b3ca643539b109f75bb242d6f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '75e14fd88bfb4cd896fa7b070a0fac47', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120740) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 18:04:27.291104 dv-cinder-852009-8-iscsi devstack@n-api.service[120740]: DEBUG nova.policy [None req-032b0793-0ad2-4969-a0e2-032321a405e4 tempest-AttachVolumeShelveTestJSON-385853788 tempest-AttachVolumeShelveTestJSON-385853788-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'e68ecd9b3ca643539b109f75bb242d6f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '75e14fd88bfb4cd896fa7b070a0fac47', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120740) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 18:04:27.292726 dv-cinder-852009-8-iscsi devstack@n-api.service[120740]: DEBUG nova.policy [None req-032b0793-0ad2-4969-a0e2-032321a405e4 tempest-AttachVolumeShelveTestJSON-385853788 tempest-AttachVolumeShelveTestJSON-385853788-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'e68ecd9b3ca643539b109f75bb242d6f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '75e14fd88bfb4cd896fa7b070a0fac47', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120740) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 18:04:27.294002 dv-cinder-852009-8-iscsi devstack@n-api.service[120740]: INFO nova.api.openstack.requestlog [None req-032b0793-0ad2-4969-a0e2-032321a405e4 tempest-AttachVolumeShelveTestJSON-385853788 tempest-AttachVolumeShelveTestJSON-385853788-project] 10.222.0.43 "GET /compute/v2.1/servers/11d2616a-96f9-4a7a-aab8-219219986a8b" status: 200 len: 1807 microversion: 2.20 time: 0.185332 Sep 13 18:04:27.294811 dv-cinder-852009-8-iscsi devstack@n-api.service[120740]: [pid: 120740|app: 0|req: 174/338] 10.222.0.43 () {60 vars in 1277 bytes} [Tue Sep 13 18:04:27 2022] GET /compute/v2.1/servers/11d2616a-96f9-4a7a-aab8-219219986a8b => generated 1807 bytes in 186 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 13 18:04:28.319230 dv-cinder-852009-8-iscsi devstack@n-api.service[120741]: DEBUG nova.api.openstack.wsgi [None req-6a1b5ea8-89f1-48d3-ade6-45765cd21669 tempest-AttachVolumeShelveTestJSON-385853788 tempest-AttachVolumeShelveTestJSON-385853788-project] Calling method '>' {{(pid=120741) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 18:04:28.319870 dv-cinder-852009-8-iscsi devstack@n-api.service[120741]: DEBUG nova.compute.api [None req-6a1b5ea8-89f1-48d3-ade6-45765cd21669 tempest-AttachVolumeShelveTestJSON-385853788 tempest-AttachVolumeShelveTestJSON-385853788-project] [instance: 11d2616a-96f9-4a7a-aab8-219219986a8b] Fetching instance by UUID {{(pid=120741) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 18:04:28.326708 dv-cinder-852009-8-iscsi devstack@n-api.service[120741]: DEBUG oslo_concurrency.lockutils [None req-6a1b5ea8-89f1-48d3-ade6-45765cd21669 tempest-AttachVolumeShelveTestJSON-385853788 tempest-AttachVolumeShelveTestJSON-385853788-project] Acquiring lock "1daf4f4c-0e4a-4779-b53a-78c48397ea2f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120741) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 18:04:28.327189 dv-cinder-852009-8-iscsi devstack@n-api.service[120741]: DEBUG oslo_concurrency.lockutils [None req-6a1b5ea8-89f1-48d3-ade6-45765cd21669 tempest-AttachVolumeShelveTestJSON-385853788 tempest-AttachVolumeShelveTestJSON-385853788-project] Lock "1daf4f4c-0e4a-4779-b53a-78c48397ea2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120741) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 18:04:28.327617 dv-cinder-852009-8-iscsi devstack@n-api.service[120741]: DEBUG oslo_concurrency.lockutils [None req-6a1b5ea8-89f1-48d3-ade6-45765cd21669 tempest-AttachVolumeShelveTestJSON-385853788 tempest-AttachVolumeShelveTestJSON-385853788-project] Lock "1daf4f4c-0e4a-4779-b53a-78c48397ea2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120741) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 18:04:28.328305 dv-cinder-852009-8-iscsi devstack@n-api.service[120741]: DEBUG oslo_concurrency.lockutils [None req-6a1b5ea8-89f1-48d3-ade6-45765cd21669 tempest-AttachVolumeShelveTestJSON-385853788 tempest-AttachVolumeShelveTestJSON-385853788-project] Acquiring lock "1daf4f4c-0e4a-4779-b53a-78c48397ea2f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120741) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 18:04:28.328782 dv-cinder-852009-8-iscsi devstack@n-api.service[120741]: DEBUG oslo_concurrency.lockutils [None req-6a1b5ea8-89f1-48d3-ade6-45765cd21669 tempest-AttachVolumeShelveTestJSON-385853788 tempest-AttachVolumeShelveTestJSON-385853788-project] Lock "1daf4f4c-0e4a-4779-b53a-78c48397ea2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120741) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 18:04:28.329199 dv-cinder-852009-8-iscsi devstack@n-api.service[120741]: DEBUG oslo_concurrency.lockutils [None req-6a1b5ea8-89f1-48d3-ade6-45765cd21669 tempest-AttachVolumeShelveTestJSON-385853788 tempest-AttachVolumeShelveTestJSON-385853788-project] Lock "1daf4f4c-0e4a-4779-b53a-78c48397ea2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120741) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 18:04:28.485252 dv-cinder-852009-8-iscsi devstack@n-api.service[120741]: DEBUG nova.policy [None req-6a1b5ea8-89f1-48d3-ade6-45765cd21669 tempest-AttachVolumeShelveTestJSON-385853788 tempest-AttachVolumeShelveTestJSON-385853788-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e68ecd9b3ca643539b109f75bb242d6f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '75e14fd88bfb4cd896fa7b070a0fac47', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120741) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 18:04:28.494655 dv-cinder-852009-8-iscsi devstack@n-api.service[120741]: DEBUG nova.policy [None req-6a1b5ea8-89f1-48d3-ade6-45765cd21669 tempest-AttachVolumeShelveTestJSON-385853788 tempest-AttachVolumeShelveTestJSON-385853788-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'e68ecd9b3ca643539b109f75bb242d6f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '75e14fd88bfb4cd896fa7b070a0fac47', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120741) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 18:04:28.496164 dv-cinder-852009-8-iscsi devstack@n-api.service[120741]: DEBUG nova.policy [None req-6a1b5ea8-89f1-48d3-ade6-45765cd21669 tempest-AttachVolumeShelveTestJSON-385853788 tempest-AttachVolumeShelveTestJSON-385853788-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'e68ecd9b3ca643539b109f75bb242d6f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '75e14fd88bfb4cd896fa7b070a0fac47', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120741) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 18:04:28.497721 dv-cinder-852009-8-iscsi devstack@n-api.service[120741]: INFO nova.api.openstack.requestlog [None req-6a1b5ea8-89f1-48d3-ade6-45765cd21669 tempest-AttachVolumeShelveTestJSON-385853788 tempest-AttachVolumeShelveTestJSON-385853788-project] 10.222.0.43 "GET /compute/v2.1/servers/11d2616a-96f9-4a7a-aab8-219219986a8b" status: 200 len: 1807 microversion: 2.20 time: 0.182397 Sep 13 18:04:28.498563 dv-cinder-852009-8-iscsi devstack@n-api.service[120741]: [pid: 120741|app: 0|req: 165/339] 10.222.0.43 () {60 vars in 1277 bytes} [Tue Sep 13 18:04:28 2022] GET /compute/v2.1/servers/11d2616a-96f9-4a7a-aab8-219219986a8b => generated 1807 bytes in 184 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 13 18:04:29.528105 dv-cinder-852009-8-iscsi devstack@n-api.service[120740]: DEBUG nova.api.openstack.wsgi [None req-18c760cb-2970-4c11-98de-5174b7d33a3b tempest-AttachVolumeShelveTestJSON-385853788 tempest-AttachVolumeShelveTestJSON-385853788-project] Calling method '>' {{(pid=120740) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 18:04:29.528824 dv-cinder-852009-8-iscsi devstack@n-api.service[120740]: DEBUG nova.compute.api [None req-18c760cb-2970-4c11-98de-5174b7d33a3b tempest-AttachVolumeShelveTestJSON-385853788 tempest-AttachVolumeShelveTestJSON-385853788-project] [instance: 11d2616a-96f9-4a7a-aab8-219219986a8b] Fetching instance by UUID {{(pid=120740) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 18:04:29.536710 dv-cinder-852009-8-iscsi devstack@n-api.service[120740]: DEBUG oslo_concurrency.lockutils [None req-18c760cb-2970-4c11-98de-5174b7d33a3b tempest-AttachVolumeShelveTestJSON-385853788 tempest-AttachVolumeShelveTestJSON-385853788-project] Acquiring lock "1daf4f4c-0e4a-4779-b53a-78c48397ea2f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120740) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 18:04:29.537259 dv-cinder-852009-8-iscsi devstack@n-api.service[120740]: DEBUG oslo_concurrency.lockutils [None req-18c760cb-2970-4c11-98de-5174b7d33a3b tempest-AttachVolumeShelveTestJSON-385853788 tempest-AttachVolumeShelveTestJSON-385853788-project] Lock "1daf4f4c-0e4a-4779-b53a-78c48397ea2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120740) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 18:04:29.537772 dv-cinder-852009-8-iscsi devstack@n-api.service[120740]: DEBUG oslo_concurrency.lockutils [None req-18c760cb-2970-4c11-98de-5174b7d33a3b tempest-AttachVolumeShelveTestJSON-385853788 tempest-AttachVolumeShelveTestJSON-385853788-project] Lock "1daf4f4c-0e4a-4779-b53a-78c48397ea2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120740) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 18:04:29.538541 dv-cinder-852009-8-iscsi devstack@n-api.service[120740]: DEBUG oslo_concurrency.lockutils [None req-18c760cb-2970-4c11-98de-5174b7d33a3b tempest-AttachVolumeShelveTestJSON-385853788 tempest-AttachVolumeShelveTestJSON-385853788-project] Acquiring lock "1daf4f4c-0e4a-4779-b53a-78c48397ea2f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120740) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 18:04:29.539042 dv-cinder-852009-8-iscsi devstack@n-api.service[120740]: DEBUG oslo_concurrency.lockutils [None req-18c760cb-2970-4c11-98de-5174b7d33a3b tempest-AttachVolumeShelveTestJSON-385853788 tempest-AttachVolumeShelveTestJSON-385853788-project] Lock "1daf4f4c-0e4a-4779-b53a-78c48397ea2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120740) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 18:04:29.539510 dv-cinder-852009-8-iscsi devstack@n-api.service[120740]: DEBUG oslo_concurrency.lockutils [None req-18c760cb-2970-4c11-98de-5174b7d33a3b tempest-AttachVolumeShelveTestJSON-385853788 tempest-AttachVolumeShelveTestJSON-385853788-project] Lock "1daf4f4c-0e4a-4779-b53a-78c48397ea2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120740) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 18:04:29.679027 dv-cinder-852009-8-iscsi devstack@n-api.service[120740]: DEBUG nova.policy [None req-18c760cb-2970-4c11-98de-5174b7d33a3b tempest-AttachVolumeShelveTestJSON-385853788 tempest-AttachVolumeShelveTestJSON-385853788-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e68ecd9b3ca643539b109f75bb242d6f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '75e14fd88bfb4cd896fa7b070a0fac47', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120740) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 18:04:29.688814 dv-cinder-852009-8-iscsi devstack@n-api.service[120740]: DEBUG nova.policy [None req-18c760cb-2970-4c11-98de-5174b7d33a3b tempest-AttachVolumeShelveTestJSON-385853788 tempest-AttachVolumeShelveTestJSON-385853788-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'e68ecd9b3ca643539b109f75bb242d6f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '75e14fd88bfb4cd896fa7b070a0fac47', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120740) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 18:04:29.690320 dv-cinder-852009-8-iscsi devstack@n-api.service[120740]: DEBUG nova.policy [None req-18c760cb-2970-4c11-98de-5174b7d33a3b tempest-AttachVolumeShelveTestJSON-385853788 tempest-AttachVolumeShelveTestJSON-385853788-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'e68ecd9b3ca643539b109f75bb242d6f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '75e14fd88bfb4cd896fa7b070a0fac47', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120740) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 18:04:29.691494 dv-cinder-852009-8-iscsi devstack@n-api.service[120740]: INFO nova.api.openstack.requestlog [None req-18c760cb-2970-4c11-98de-5174b7d33a3b tempest-AttachVolumeShelveTestJSON-385853788 tempest-AttachVolumeShelveTestJSON-385853788-project] 10.222.0.43 "GET /compute/v2.1/servers/11d2616a-96f9-4a7a-aab8-219219986a8b" status: 200 len: 1807 microversion: 2.20 time: 0.168049 Sep 13 18:04:29.692055 dv-cinder-852009-8-iscsi devstack@n-api.service[120740]: [pid: 120740|app: 0|req: 175/340] 10.222.0.43 () {60 vars in 1277 bytes} [Tue Sep 13 18:04:29 2022] GET /compute/v2.1/servers/11d2616a-96f9-4a7a-aab8-219219986a8b => generated 1807 bytes in 169 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 13 18:04:30.718742 dv-cinder-852009-8-iscsi devstack@n-api.service[120741]: DEBUG nova.api.openstack.wsgi [None req-93783b66-97cb-4757-b5e9-5cc674595be0 tempest-AttachVolumeShelveTestJSON-385853788 tempest-AttachVolumeShelveTestJSON-385853788-project] Calling method '>' {{(pid=120741) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 18:04:30.719310 dv-cinder-852009-8-iscsi devstack@n-api.service[120741]: DEBUG nova.compute.api [None req-93783b66-97cb-4757-b5e9-5cc674595be0 tempest-AttachVolumeShelveTestJSON-385853788 tempest-AttachVolumeShelveTestJSON-385853788-project] [instance: 11d2616a-96f9-4a7a-aab8-219219986a8b] Fetching instance by UUID {{(pid=120741) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 18:04:30.726570 dv-cinder-852009-8-iscsi devstack@n-api.service[120741]: DEBUG oslo_concurrency.lockutils [None req-93783b66-97cb-4757-b5e9-5cc674595be0 tempest-AttachVolumeShelveTestJSON-385853788 tempest-AttachVolumeShelveTestJSON-385853788-project] Acquiring lock "1daf4f4c-0e4a-4779-b53a-78c48397ea2f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120741) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 18:04:30.727053 dv-cinder-852009-8-iscsi devstack@n-api.service[120741]: DEBUG oslo_concurrency.lockutils [None req-93783b66-97cb-4757-b5e9-5cc674595be0 tempest-AttachVolumeShelveTestJSON-385853788 tempest-AttachVolumeShelveTestJSON-385853788-project] Lock "1daf4f4c-0e4a-4779-b53a-78c48397ea2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120741) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 18:04:30.727479 dv-cinder-852009-8-iscsi devstack@n-api.service[120741]: DEBUG oslo_concurrency.lockutils [None req-93783b66-97cb-4757-b5e9-5cc674595be0 tempest-AttachVolumeShelveTestJSON-385853788 tempest-AttachVolumeShelveTestJSON-385853788-project] Lock "1daf4f4c-0e4a-4779-b53a-78c48397ea2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120741) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 18:04:30.728168 dv-cinder-852009-8-iscsi devstack@n-api.service[120741]: DEBUG oslo_concurrency.lockutils [None req-93783b66-97cb-4757-b5e9-5cc674595be0 tempest-AttachVolumeShelveTestJSON-385853788 tempest-AttachVolumeShelveTestJSON-385853788-project] Acquiring lock "1daf4f4c-0e4a-4779-b53a-78c48397ea2f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120741) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 18:04:30.728674 dv-cinder-852009-8-iscsi devstack@n-api.service[120741]: DEBUG oslo_concurrency.lockutils [None req-93783b66-97cb-4757-b5e9-5cc674595be0 tempest-AttachVolumeShelveTestJSON-385853788 tempest-AttachVolumeShelveTestJSON-385853788-project] Lock "1daf4f4c-0e4a-4779-b53a-78c48397ea2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120741) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 18:04:30.729091 dv-cinder-852009-8-iscsi devstack@n-api.service[120741]: DEBUG oslo_concurrency.lockutils [None req-93783b66-97cb-4757-b5e9-5cc674595be0 tempest-AttachVolumeShelveTestJSON-385853788 tempest-AttachVolumeShelveTestJSON-385853788-project] Lock "1daf4f4c-0e4a-4779-b53a-78c48397ea2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120741) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 18:04:30.871960 dv-cinder-852009-8-iscsi devstack@n-api.service[120741]: DEBUG nova.policy [None req-93783b66-97cb-4757-b5e9-5cc674595be0 tempest-AttachVolumeShelveTestJSON-385853788 tempest-AttachVolumeShelveTestJSON-385853788-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e68ecd9b3ca643539b109f75bb242d6f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '75e14fd88bfb4cd896fa7b070a0fac47', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120741) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 18:04:30.885560 dv-cinder-852009-8-iscsi devstack@n-api.service[120741]: DEBUG nova.policy [None req-93783b66-97cb-4757-b5e9-5cc674595be0 tempest-AttachVolumeShelveTestJSON-385853788 tempest-AttachVolumeShelveTestJSON-385853788-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'e68ecd9b3ca643539b109f75bb242d6f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '75e14fd88bfb4cd896fa7b070a0fac47', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120741) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 18:04:30.887335 dv-cinder-852009-8-iscsi devstack@n-api.service[120741]: DEBUG nova.policy [None req-93783b66-97cb-4757-b5e9-5cc674595be0 tempest-AttachVolumeShelveTestJSON-385853788 tempest-AttachVolumeShelveTestJSON-385853788-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'e68ecd9b3ca643539b109f75bb242d6f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '75e14fd88bfb4cd896fa7b070a0fac47', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120741) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 18:04:30.889470 dv-cinder-852009-8-iscsi devstack@n-api.service[120741]: INFO nova.api.openstack.requestlog [None req-93783b66-97cb-4757-b5e9-5cc674595be0 tempest-AttachVolumeShelveTestJSON-385853788 tempest-AttachVolumeShelveTestJSON-385853788-project] 10.222.0.43 "GET /compute/v2.1/servers/11d2616a-96f9-4a7a-aab8-219219986a8b" status: 200 len: 1807 microversion: 2.20 time: 0.174022 Sep 13 18:04:30.889470 dv-cinder-852009-8-iscsi devstack@n-api.service[120741]: [pid: 120741|app: 0|req: 166/341] 10.222.0.43 () {60 vars in 1277 bytes} [Tue Sep 13 18:04:30 2022] GET /compute/v2.1/servers/11d2616a-96f9-4a7a-aab8-219219986a8b => generated 1807 bytes in 175 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 13 18:04:31.919295 dv-cinder-852009-8-iscsi devstack@n-api.service[120740]: DEBUG nova.api.openstack.wsgi [None req-2ffae800-9c42-4e5f-b311-1da65d24ce7d tempest-AttachVolumeShelveTestJSON-385853788 tempest-AttachVolumeShelveTestJSON-385853788-project] Calling method '>' {{(pid=120740) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 18:04:31.920464 dv-cinder-852009-8-iscsi devstack@n-api.service[120740]: DEBUG nova.compute.api [None req-2ffae800-9c42-4e5f-b311-1da65d24ce7d tempest-AttachVolumeShelveTestJSON-385853788 tempest-AttachVolumeShelveTestJSON-385853788-project] [instance: 11d2616a-96f9-4a7a-aab8-219219986a8b] Fetching instance by UUID {{(pid=120740) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 18:04:31.927355 dv-cinder-852009-8-iscsi devstack@n-api.service[120740]: DEBUG oslo_concurrency.lockutils [None req-2ffae800-9c42-4e5f-b311-1da65d24ce7d tempest-AttachVolumeShelveTestJSON-385853788 tempest-AttachVolumeShelveTestJSON-385853788-project] Acquiring lock "1daf4f4c-0e4a-4779-b53a-78c48397ea2f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120740) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 18:04:31.927845 dv-cinder-852009-8-iscsi devstack@n-api.service[120740]: DEBUG oslo_concurrency.lockutils [None req-2ffae800-9c42-4e5f-b311-1da65d24ce7d tempest-AttachVolumeShelveTestJSON-385853788 tempest-AttachVolumeShelveTestJSON-385853788-project] Lock "1daf4f4c-0e4a-4779-b53a-78c48397ea2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120740) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 18:04:31.928283 dv-cinder-852009-8-iscsi devstack@n-api.service[120740]: DEBUG oslo_concurrency.lockutils [None req-2ffae800-9c42-4e5f-b311-1da65d24ce7d tempest-AttachVolumeShelveTestJSON-385853788 tempest-AttachVolumeShelveTestJSON-385853788-project] Lock "1daf4f4c-0e4a-4779-b53a-78c48397ea2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120740) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 18:04:31.929013 dv-cinder-852009-8-iscsi devstack@n-api.service[120740]: DEBUG oslo_concurrency.lockutils [None req-2ffae800-9c42-4e5f-b311-1da65d24ce7d tempest-AttachVolumeShelveTestJSON-385853788 tempest-AttachVolumeShelveTestJSON-385853788-project] Acquiring lock "1daf4f4c-0e4a-4779-b53a-78c48397ea2f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120740) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 18:04:31.929464 dv-cinder-852009-8-iscsi devstack@n-api.service[120740]: DEBUG oslo_concurrency.lockutils [None req-2ffae800-9c42-4e5f-b311-1da65d24ce7d tempest-AttachVolumeShelveTestJSON-385853788 tempest-AttachVolumeShelveTestJSON-385853788-project] Lock "1daf4f4c-0e4a-4779-b53a-78c48397ea2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120740) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 18:04:31.929887 dv-cinder-852009-8-iscsi devstack@n-api.service[120740]: DEBUG oslo_concurrency.lockutils [None req-2ffae800-9c42-4e5f-b311-1da65d24ce7d tempest-AttachVolumeShelveTestJSON-385853788 tempest-AttachVolumeShelveTestJSON-385853788-project] Lock "1daf4f4c-0e4a-4779-b53a-78c48397ea2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120740) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 18:04:32.061727 dv-cinder-852009-8-iscsi devstack@n-api.service[120740]: DEBUG nova.policy [None req-2ffae800-9c42-4e5f-b311-1da65d24ce7d tempest-AttachVolumeShelveTestJSON-385853788 tempest-AttachVolumeShelveTestJSON-385853788-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e68ecd9b3ca643539b109f75bb242d6f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '75e14fd88bfb4cd896fa7b070a0fac47', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120740) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 18:04:32.070802 dv-cinder-852009-8-iscsi devstack@n-api.service[120740]: DEBUG nova.policy [None req-2ffae800-9c42-4e5f-b311-1da65d24ce7d tempest-AttachVolumeShelveTestJSON-385853788 tempest-AttachVolumeShelveTestJSON-385853788-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'e68ecd9b3ca643539b109f75bb242d6f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '75e14fd88bfb4cd896fa7b070a0fac47', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120740) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 18:04:32.072236 dv-cinder-852009-8-iscsi devstack@n-api.service[120740]: DEBUG nova.policy [None req-2ffae800-9c42-4e5f-b311-1da65d24ce7d tempest-AttachVolumeShelveTestJSON-385853788 tempest-AttachVolumeShelveTestJSON-385853788-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'e68ecd9b3ca643539b109f75bb242d6f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '75e14fd88bfb4cd896fa7b070a0fac47', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120740) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 18:04:32.073438 dv-cinder-852009-8-iscsi devstack@n-api.service[120740]: INFO nova.api.openstack.requestlog [None req-2ffae800-9c42-4e5f-b311-1da65d24ce7d tempest-AttachVolumeShelveTestJSON-385853788 tempest-AttachVolumeShelveTestJSON-385853788-project] 10.222.0.43 "GET /compute/v2.1/servers/11d2616a-96f9-4a7a-aab8-219219986a8b" status: 200 len: 1807 microversion: 2.20 time: 0.160723 Sep 13 18:04:32.074014 dv-cinder-852009-8-iscsi devstack@n-api.service[120740]: [pid: 120740|app: 0|req: 176/342] 10.222.0.43 () {60 vars in 1277 bytes} [Tue Sep 13 18:04:31 2022] GET /compute/v2.1/servers/11d2616a-96f9-4a7a-aab8-219219986a8b => generated 1807 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 13 18:04:33.099458 dv-cinder-852009-8-iscsi devstack@n-api.service[120741]: DEBUG nova.api.openstack.wsgi [None req-232b96eb-e451-4186-92c8-b04f1dde078c tempest-AttachVolumeShelveTestJSON-385853788 tempest-AttachVolumeShelveTestJSON-385853788-project] Calling method '>' {{(pid=120741) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 18:04:33.100157 dv-cinder-852009-8-iscsi devstack@n-api.service[120741]: DEBUG nova.compute.api [None req-232b96eb-e451-4186-92c8-b04f1dde078c tempest-AttachVolumeShelveTestJSON-385853788 tempest-AttachVolumeShelveTestJSON-385853788-project] [instance: 11d2616a-96f9-4a7a-aab8-219219986a8b] Fetching instance by UUID {{(pid=120741) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 18:04:33.108784 dv-cinder-852009-8-iscsi devstack@n-api.service[120741]: DEBUG oslo_concurrency.lockutils [None req-232b96eb-e451-4186-92c8-b04f1dde078c tempest-AttachVolumeShelveTestJSON-385853788 tempest-AttachVolumeShelveTestJSON-385853788-project] Acquiring lock "1daf4f4c-0e4a-4779-b53a-78c48397ea2f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120741) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 18:04:33.109336 dv-cinder-852009-8-iscsi devstack@n-api.service[120741]: DEBUG oslo_concurrency.lockutils [None req-232b96eb-e451-4186-92c8-b04f1dde078c tempest-AttachVolumeShelveTestJSON-385853788 tempest-AttachVolumeShelveTestJSON-385853788-project] Lock "1daf4f4c-0e4a-4779-b53a-78c48397ea2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120741) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 18:04:33.109850 dv-cinder-852009-8-iscsi devstack@n-api.service[120741]: DEBUG oslo_concurrency.lockutils [None req-232b96eb-e451-4186-92c8-b04f1dde078c tempest-AttachVolumeShelveTestJSON-385853788 tempest-AttachVolumeShelveTestJSON-385853788-project] Lock "1daf4f4c-0e4a-4779-b53a-78c48397ea2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120741) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 18:04:33.110602 dv-cinder-852009-8-iscsi devstack@n-api.service[120741]: DEBUG oslo_concurrency.lockutils [None req-232b96eb-e451-4186-92c8-b04f1dde078c tempest-AttachVolumeShelveTestJSON-385853788 tempest-AttachVolumeShelveTestJSON-385853788-project] Acquiring lock "1daf4f4c-0e4a-4779-b53a-78c48397ea2f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120741) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 18:04:33.111129 dv-cinder-852009-8-iscsi devstack@n-api.service[120741]: DEBUG oslo_concurrency.lockutils [None req-232b96eb-e451-4186-92c8-b04f1dde078c tempest-AttachVolumeShelveTestJSON-385853788 tempest-AttachVolumeShelveTestJSON-385853788-project] Lock "1daf4f4c-0e4a-4779-b53a-78c48397ea2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120741) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 18:04:33.111589 dv-cinder-852009-8-iscsi devstack@n-api.service[120741]: DEBUG oslo_concurrency.lockutils [None req-232b96eb-e451-4186-92c8-b04f1dde078c tempest-AttachVolumeShelveTestJSON-385853788 tempest-AttachVolumeShelveTestJSON-385853788-project] Lock "1daf4f4c-0e4a-4779-b53a-78c48397ea2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120741) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 18:04:33.262895 dv-cinder-852009-8-iscsi devstack@n-api.service[120741]: DEBUG nova.policy [None req-232b96eb-e451-4186-92c8-b04f1dde078c tempest-AttachVolumeShelveTestJSON-385853788 tempest-AttachVolumeShelveTestJSON-385853788-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e68ecd9b3ca643539b109f75bb242d6f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '75e14fd88bfb4cd896fa7b070a0fac47', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120741) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 18:04:33.272964 dv-cinder-852009-8-iscsi devstack@n-api.service[120741]: DEBUG nova.policy [None req-232b96eb-e451-4186-92c8-b04f1dde078c tempest-AttachVolumeShelveTestJSON-385853788 tempest-AttachVolumeShelveTestJSON-385853788-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'e68ecd9b3ca643539b109f75bb242d6f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '75e14fd88bfb4cd896fa7b070a0fac47', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120741) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 18:04:33.274465 dv-cinder-852009-8-iscsi devstack@n-api.service[120741]: DEBUG nova.policy [None req-232b96eb-e451-4186-92c8-b04f1dde078c tempest-AttachVolumeShelveTestJSON-385853788 tempest-AttachVolumeShelveTestJSON-385853788-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'e68ecd9b3ca643539b109f75bb242d6f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '75e14fd88bfb4cd896fa7b070a0fac47', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120741) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 18:04:33.275692 dv-cinder-852009-8-iscsi devstack@n-api.service[120741]: INFO nova.api.openstack.requestlog [None req-232b96eb-e451-4186-92c8-b04f1dde078c tempest-AttachVolumeShelveTestJSON-385853788 tempest-AttachVolumeShelveTestJSON-385853788-project] 10.222.0.43 "GET /compute/v2.1/servers/11d2616a-96f9-4a7a-aab8-219219986a8b" status: 200 len: 1807 microversion: 2.20 time: 0.180340 Sep 13 18:04:33.276463 dv-cinder-852009-8-iscsi devstack@n-api.service[120741]: [pid: 120741|app: 0|req: 167/343] 10.222.0.43 () {60 vars in 1277 bytes} [Tue Sep 13 18:04:33 2022] GET /compute/v2.1/servers/11d2616a-96f9-4a7a-aab8-219219986a8b => generated 1807 bytes in 182 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 13 18:04:34.302183 dv-cinder-852009-8-iscsi devstack@n-api.service[120740]: DEBUG nova.api.openstack.wsgi [None req-105cbdd7-c6f7-42a6-91d9-6c8d6f1a6bb4 tempest-AttachVolumeShelveTestJSON-385853788 tempest-AttachVolumeShelveTestJSON-385853788-project] Calling method '>' {{(pid=120740) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 18:04:34.302783 dv-cinder-852009-8-iscsi devstack@n-api.service[120740]: DEBUG nova.compute.api [None req-105cbdd7-c6f7-42a6-91d9-6c8d6f1a6bb4 tempest-AttachVolumeShelveTestJSON-385853788 tempest-AttachVolumeShelveTestJSON-385853788-project] [instance: 11d2616a-96f9-4a7a-aab8-219219986a8b] Fetching instance by UUID {{(pid=120740) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 18:04:34.309561 dv-cinder-852009-8-iscsi devstack@n-api.service[120740]: DEBUG oslo_concurrency.lockutils [None req-105cbdd7-c6f7-42a6-91d9-6c8d6f1a6bb4 tempest-AttachVolumeShelveTestJSON-385853788 tempest-AttachVolumeShelveTestJSON-385853788-project] Acquiring lock "1daf4f4c-0e4a-4779-b53a-78c48397ea2f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120740) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 18:04:34.310040 dv-cinder-852009-8-iscsi devstack@n-api.service[120740]: DEBUG oslo_concurrency.lockutils [None req-105cbdd7-c6f7-42a6-91d9-6c8d6f1a6bb4 tempest-AttachVolumeShelveTestJSON-385853788 tempest-AttachVolumeShelveTestJSON-385853788-project] Lock "1daf4f4c-0e4a-4779-b53a-78c48397ea2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120740) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 18:04:34.310468 dv-cinder-852009-8-iscsi devstack@n-api.service[120740]: DEBUG oslo_concurrency.lockutils [None req-105cbdd7-c6f7-42a6-91d9-6c8d6f1a6bb4 tempest-AttachVolumeShelveTestJSON-385853788 tempest-AttachVolumeShelveTestJSON-385853788-project] Lock "1daf4f4c-0e4a-4779-b53a-78c48397ea2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120740) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 18:04:34.311187 dv-cinder-852009-8-iscsi devstack@n-api.service[120740]: DEBUG oslo_concurrency.lockutils [None req-105cbdd7-c6f7-42a6-91d9-6c8d6f1a6bb4 tempest-AttachVolumeShelveTestJSON-385853788 tempest-AttachVolumeShelveTestJSON-385853788-project] Acquiring lock "1daf4f4c-0e4a-4779-b53a-78c48397ea2f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120740) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 18:04:34.311631 dv-cinder-852009-8-iscsi devstack@n-api.service[120740]: DEBUG oslo_concurrency.lockutils [None req-105cbdd7-c6f7-42a6-91d9-6c8d6f1a6bb4 tempest-AttachVolumeShelveTestJSON-385853788 tempest-AttachVolumeShelveTestJSON-385853788-project] Lock "1daf4f4c-0e4a-4779-b53a-78c48397ea2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120740) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 18:04:34.312048 dv-cinder-852009-8-iscsi devstack@n-api.service[120740]: DEBUG oslo_concurrency.lockutils [None req-105cbdd7-c6f7-42a6-91d9-6c8d6f1a6bb4 tempest-AttachVolumeShelveTestJSON-385853788 tempest-AttachVolumeShelveTestJSON-385853788-project] Lock "1daf4f4c-0e4a-4779-b53a-78c48397ea2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120740) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 18:04:34.448446 dv-cinder-852009-8-iscsi devstack@n-api.service[120740]: DEBUG nova.policy [None req-105cbdd7-c6f7-42a6-91d9-6c8d6f1a6bb4 tempest-AttachVolumeShelveTestJSON-385853788 tempest-AttachVolumeShelveTestJSON-385853788-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e68ecd9b3ca643539b109f75bb242d6f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '75e14fd88bfb4cd896fa7b070a0fac47', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120740) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 18:04:34.458361 dv-cinder-852009-8-iscsi devstack@n-api.service[120740]: DEBUG nova.policy [None req-105cbdd7-c6f7-42a6-91d9-6c8d6f1a6bb4 tempest-AttachVolumeShelveTestJSON-385853788 tempest-AttachVolumeShelveTestJSON-385853788-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'e68ecd9b3ca643539b109f75bb242d6f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '75e14fd88bfb4cd896fa7b070a0fac47', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120740) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 18:04:34.459957 dv-cinder-852009-8-iscsi devstack@n-api.service[120740]: DEBUG nova.policy [None req-105cbdd7-c6f7-42a6-91d9-6c8d6f1a6bb4 tempest-AttachVolumeShelveTestJSON-385853788 tempest-AttachVolumeShelveTestJSON-385853788-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'e68ecd9b3ca643539b109f75bb242d6f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '75e14fd88bfb4cd896fa7b070a0fac47', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120740) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 18:04:34.461250 dv-cinder-852009-8-iscsi devstack@n-api.service[120740]: INFO nova.api.openstack.requestlog [None req-105cbdd7-c6f7-42a6-91d9-6c8d6f1a6bb4 tempest-AttachVolumeShelveTestJSON-385853788 tempest-AttachVolumeShelveTestJSON-385853788-project] 10.222.0.43 "GET /compute/v2.1/servers/11d2616a-96f9-4a7a-aab8-219219986a8b" status: 200 len: 1807 microversion: 2.20 time: 0.163207 Sep 13 18:04:34.461894 dv-cinder-852009-8-iscsi devstack@n-api.service[120740]: [pid: 120740|app: 0|req: 177/344] 10.222.0.43 () {60 vars in 1277 bytes} [Tue Sep 13 18:04:34 2022] GET /compute/v2.1/servers/11d2616a-96f9-4a7a-aab8-219219986a8b => generated 1807 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 13 18:04:35.491559 dv-cinder-852009-8-iscsi devstack@n-api.service[120741]: DEBUG nova.api.openstack.wsgi [None req-55f4a13c-d473-49db-a85f-1443fe9f17ab tempest-AttachVolumeShelveTestJSON-385853788 tempest-AttachVolumeShelveTestJSON-385853788-project] Calling method '>' {{(pid=120741) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 18:04:35.492520 dv-cinder-852009-8-iscsi devstack@n-api.service[120741]: DEBUG nova.compute.api [None req-55f4a13c-d473-49db-a85f-1443fe9f17ab tempest-AttachVolumeShelveTestJSON-385853788 tempest-AttachVolumeShelveTestJSON-385853788-project] [instance: 11d2616a-96f9-4a7a-aab8-219219986a8b] Fetching instance by UUID {{(pid=120741) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 18:04:35.502684 dv-cinder-852009-8-iscsi devstack@n-api.service[120741]: DEBUG oslo_concurrency.lockutils [None req-55f4a13c-d473-49db-a85f-1443fe9f17ab tempest-AttachVolumeShelveTestJSON-385853788 tempest-AttachVolumeShelveTestJSON-385853788-project] Acquiring lock "1daf4f4c-0e4a-4779-b53a-78c48397ea2f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120741) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 18:04:35.503164 dv-cinder-852009-8-iscsi devstack@n-api.service[120741]: DEBUG oslo_concurrency.lockutils [None req-55f4a13c-d473-49db-a85f-1443fe9f17ab tempest-AttachVolumeShelveTestJSON-385853788 tempest-AttachVolumeShelveTestJSON-385853788-project] Lock "1daf4f4c-0e4a-4779-b53a-78c48397ea2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120741) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 18:04:35.503590 dv-cinder-852009-8-iscsi devstack@n-api.service[120741]: DEBUG oslo_concurrency.lockutils [None req-55f4a13c-d473-49db-a85f-1443fe9f17ab tempest-AttachVolumeShelveTestJSON-385853788 tempest-AttachVolumeShelveTestJSON-385853788-project] Lock "1daf4f4c-0e4a-4779-b53a-78c48397ea2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120741) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 18:04:35.504280 dv-cinder-852009-8-iscsi devstack@n-api.service[120741]: DEBUG oslo_concurrency.lockutils [None req-55f4a13c-d473-49db-a85f-1443fe9f17ab tempest-AttachVolumeShelveTestJSON-385853788 tempest-AttachVolumeShelveTestJSON-385853788-project] Acquiring lock "1daf4f4c-0e4a-4779-b53a-78c48397ea2f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120741) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 18:04:35.504766 dv-cinder-852009-8-iscsi devstack@n-api.service[120741]: DEBUG oslo_concurrency.lockutils [None req-55f4a13c-d473-49db-a85f-1443fe9f17ab tempest-AttachVolumeShelveTestJSON-385853788 tempest-AttachVolumeShelveTestJSON-385853788-project] Lock "1daf4f4c-0e4a-4779-b53a-78c48397ea2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120741) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 18:04:35.505184 dv-cinder-852009-8-iscsi devstack@n-api.service[120741]: DEBUG oslo_concurrency.lockutils [None req-55f4a13c-d473-49db-a85f-1443fe9f17ab tempest-AttachVolumeShelveTestJSON-385853788 tempest-AttachVolumeShelveTestJSON-385853788-project] Lock "1daf4f4c-0e4a-4779-b53a-78c48397ea2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120741) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 18:04:35.636782 dv-cinder-852009-8-iscsi devstack@n-api.service[120741]: DEBUG nova.policy [None req-55f4a13c-d473-49db-a85f-1443fe9f17ab tempest-AttachVolumeShelveTestJSON-385853788 tempest-AttachVolumeShelveTestJSON-385853788-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e68ecd9b3ca643539b109f75bb242d6f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '75e14fd88bfb4cd896fa7b070a0fac47', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120741) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 18:04:35.641848 dv-cinder-852009-8-iscsi devstack@n-api.service[120741]: DEBUG dbcounter [-] [120741] Writing DB stats nova_cell1:SELECT=96,nova_cell1:UPDATE=2,nova_cell1:INSERT=2 {{(pid=120741) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 18:04:35.648632 dv-cinder-852009-8-iscsi devstack@n-api.service[120741]: DEBUG nova.policy [None req-55f4a13c-d473-49db-a85f-1443fe9f17ab tempest-AttachVolumeShelveTestJSON-385853788 tempest-AttachVolumeShelveTestJSON-385853788-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'e68ecd9b3ca643539b109f75bb242d6f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '75e14fd88bfb4cd896fa7b070a0fac47', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120741) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 18:04:35.650055 dv-cinder-852009-8-iscsi devstack@n-api.service[120741]: DEBUG nova.policy [None req-55f4a13c-d473-49db-a85f-1443fe9f17ab tempest-AttachVolumeShelveTestJSON-385853788 tempest-AttachVolumeShelveTestJSON-385853788-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'e68ecd9b3ca643539b109f75bb242d6f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '75e14fd88bfb4cd896fa7b070a0fac47', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120741) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 18:04:35.651213 dv-cinder-852009-8-iscsi devstack@n-api.service[120741]: INFO nova.api.openstack.requestlog [None req-55f4a13c-d473-49db-a85f-1443fe9f17ab tempest-AttachVolumeShelveTestJSON-385853788 tempest-AttachVolumeShelveTestJSON-385853788-project] 10.222.0.43 "GET /compute/v2.1/servers/11d2616a-96f9-4a7a-aab8-219219986a8b" status: 200 len: 1807 microversion: 2.20 time: 0.166766 Sep 13 18:04:35.651815 dv-cinder-852009-8-iscsi devstack@n-api.service[120741]: [pid: 120741|app: 0|req: 168/345] 10.222.0.43 () {60 vars in 1277 bytes} [Tue Sep 13 18:04:35 2022] GET /compute/v2.1/servers/11d2616a-96f9-4a7a-aab8-219219986a8b => generated 1807 bytes in 168 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 13 18:04:36.680903 dv-cinder-852009-8-iscsi devstack@n-api.service[120740]: DEBUG nova.api.openstack.wsgi [None req-bdc7caeb-f9ea-4a04-a693-99cb096a4ab5 tempest-AttachVolumeShelveTestJSON-385853788 tempest-AttachVolumeShelveTestJSON-385853788-project] Calling method '>' {{(pid=120740) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 18:04:36.681806 dv-cinder-852009-8-iscsi devstack@n-api.service[120740]: DEBUG nova.compute.api [None req-bdc7caeb-f9ea-4a04-a693-99cb096a4ab5 tempest-AttachVolumeShelveTestJSON-385853788 tempest-AttachVolumeShelveTestJSON-385853788-project] [instance: 11d2616a-96f9-4a7a-aab8-219219986a8b] Fetching instance by UUID {{(pid=120740) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 18:04:36.692934 dv-cinder-852009-8-iscsi devstack@n-api.service[120740]: DEBUG oslo_concurrency.lockutils [None req-bdc7caeb-f9ea-4a04-a693-99cb096a4ab5 tempest-AttachVolumeShelveTestJSON-385853788 tempest-AttachVolumeShelveTestJSON-385853788-project] Acquiring lock "1daf4f4c-0e4a-4779-b53a-78c48397ea2f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120740) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 18:04:36.693796 dv-cinder-852009-8-iscsi devstack@n-api.service[120740]: DEBUG oslo_concurrency.lockutils [None req-bdc7caeb-f9ea-4a04-a693-99cb096a4ab5 tempest-AttachVolumeShelveTestJSON-385853788 tempest-AttachVolumeShelveTestJSON-385853788-project] Lock "1daf4f4c-0e4a-4779-b53a-78c48397ea2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120740) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 18:04:36.694468 dv-cinder-852009-8-iscsi devstack@n-api.service[120740]: DEBUG oslo_concurrency.lockutils [None req-bdc7caeb-f9ea-4a04-a693-99cb096a4ab5 tempest-AttachVolumeShelveTestJSON-385853788 tempest-AttachVolumeShelveTestJSON-385853788-project] Lock "1daf4f4c-0e4a-4779-b53a-78c48397ea2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120740) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 18:04:36.695664 dv-cinder-852009-8-iscsi devstack@n-api.service[120740]: DEBUG oslo_concurrency.lockutils [None req-bdc7caeb-f9ea-4a04-a693-99cb096a4ab5 tempest-AttachVolumeShelveTestJSON-385853788 tempest-AttachVolumeShelveTestJSON-385853788-project] Acquiring lock "1daf4f4c-0e4a-4779-b53a-78c48397ea2f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120740) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 18:04:36.696415 dv-cinder-852009-8-iscsi devstack@n-api.service[120740]: DEBUG oslo_concurrency.lockutils [None req-bdc7caeb-f9ea-4a04-a693-99cb096a4ab5 tempest-AttachVolumeShelveTestJSON-385853788 tempest-AttachVolumeShelveTestJSON-385853788-project] Lock "1daf4f4c-0e4a-4779-b53a-78c48397ea2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120740) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 18:04:36.697168 dv-cinder-852009-8-iscsi devstack@n-api.service[120740]: DEBUG oslo_concurrency.lockutils [None req-bdc7caeb-f9ea-4a04-a693-99cb096a4ab5 tempest-AttachVolumeShelveTestJSON-385853788 tempest-AttachVolumeShelveTestJSON-385853788-project] Lock "1daf4f4c-0e4a-4779-b53a-78c48397ea2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120740) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 18:04:36.836266 dv-cinder-852009-8-iscsi devstack@n-api.service[120740]: DEBUG nova.policy [None req-bdc7caeb-f9ea-4a04-a693-99cb096a4ab5 tempest-AttachVolumeShelveTestJSON-385853788 tempest-AttachVolumeShelveTestJSON-385853788-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e68ecd9b3ca643539b109f75bb242d6f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '75e14fd88bfb4cd896fa7b070a0fac47', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120740) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 18:04:36.845454 dv-cinder-852009-8-iscsi devstack@n-api.service[120740]: DEBUG nova.policy [None req-bdc7caeb-f9ea-4a04-a693-99cb096a4ab5 tempest-AttachVolumeShelveTestJSON-385853788 tempest-AttachVolumeShelveTestJSON-385853788-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'e68ecd9b3ca643539b109f75bb242d6f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '75e14fd88bfb4cd896fa7b070a0fac47', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120740) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 18:04:36.846895 dv-cinder-852009-8-iscsi devstack@n-api.service[120740]: DEBUG nova.policy [None req-bdc7caeb-f9ea-4a04-a693-99cb096a4ab5 tempest-AttachVolumeShelveTestJSON-385853788 tempest-AttachVolumeShelveTestJSON-385853788-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'e68ecd9b3ca643539b109f75bb242d6f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '75e14fd88bfb4cd896fa7b070a0fac47', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120740) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 18:04:36.848064 dv-cinder-852009-8-iscsi devstack@n-api.service[120740]: INFO nova.api.openstack.requestlog [None req-bdc7caeb-f9ea-4a04-a693-99cb096a4ab5 tempest-AttachVolumeShelveTestJSON-385853788 tempest-AttachVolumeShelveTestJSON-385853788-project] 10.222.0.43 "GET /compute/v2.1/servers/11d2616a-96f9-4a7a-aab8-219219986a8b" status: 200 len: 1807 microversion: 2.20 time: 0.173901 Sep 13 18:04:36.848654 dv-cinder-852009-8-iscsi devstack@n-api.service[120740]: [pid: 120740|app: 0|req: 178/346] 10.222.0.43 () {60 vars in 1277 bytes} [Tue Sep 13 18:04:36 2022] GET /compute/v2.1/servers/11d2616a-96f9-4a7a-aab8-219219986a8b => generated 1807 bytes in 175 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 13 18:04:37.878373 dv-cinder-852009-8-iscsi devstack@n-api.service[120741]: DEBUG nova.api.openstack.wsgi [None req-e50934b2-054c-4c08-8dac-6a79dcb16d01 tempest-AttachVolumeShelveTestJSON-385853788 tempest-AttachVolumeShelveTestJSON-385853788-project] Calling method '>' {{(pid=120741) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 18:04:37.879346 dv-cinder-852009-8-iscsi devstack@n-api.service[120741]: DEBUG nova.compute.api [None req-e50934b2-054c-4c08-8dac-6a79dcb16d01 tempest-AttachVolumeShelveTestJSON-385853788 tempest-AttachVolumeShelveTestJSON-385853788-project] [instance: 11d2616a-96f9-4a7a-aab8-219219986a8b] Fetching instance by UUID {{(pid=120741) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 18:04:37.891389 dv-cinder-852009-8-iscsi devstack@n-api.service[120741]: DEBUG oslo_concurrency.lockutils [None req-e50934b2-054c-4c08-8dac-6a79dcb16d01 tempest-AttachVolumeShelveTestJSON-385853788 tempest-AttachVolumeShelveTestJSON-385853788-project] Acquiring lock "1daf4f4c-0e4a-4779-b53a-78c48397ea2f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120741) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 18:04:37.892252 dv-cinder-852009-8-iscsi devstack@n-api.service[120741]: DEBUG oslo_concurrency.lockutils [None req-e50934b2-054c-4c08-8dac-6a79dcb16d01 tempest-AttachVolumeShelveTestJSON-385853788 tempest-AttachVolumeShelveTestJSON-385853788-project] Lock "1daf4f4c-0e4a-4779-b53a-78c48397ea2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120741) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 18:04:37.892869 dv-cinder-852009-8-iscsi devstack@n-api.service[120741]: DEBUG oslo_concurrency.lockutils [None req-e50934b2-054c-4c08-8dac-6a79dcb16d01 tempest-AttachVolumeShelveTestJSON-385853788 tempest-AttachVolumeShelveTestJSON-385853788-project] Lock "1daf4f4c-0e4a-4779-b53a-78c48397ea2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120741) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 18:04:37.893556 dv-cinder-852009-8-iscsi devstack@n-api.service[120741]: DEBUG oslo_concurrency.lockutils [None req-e50934b2-054c-4c08-8dac-6a79dcb16d01 tempest-AttachVolumeShelveTestJSON-385853788 tempest-AttachVolumeShelveTestJSON-385853788-project] Acquiring lock "1daf4f4c-0e4a-4779-b53a-78c48397ea2f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120741) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 18:04:37.893996 dv-cinder-852009-8-iscsi devstack@n-api.service[120741]: DEBUG oslo_concurrency.lockutils [None req-e50934b2-054c-4c08-8dac-6a79dcb16d01 tempest-AttachVolumeShelveTestJSON-385853788 tempest-AttachVolumeShelveTestJSON-385853788-project] Lock "1daf4f4c-0e4a-4779-b53a-78c48397ea2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120741) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 18:04:37.894418 dv-cinder-852009-8-iscsi devstack@n-api.service[120741]: DEBUG oslo_concurrency.lockutils [None req-e50934b2-054c-4c08-8dac-6a79dcb16d01 tempest-AttachVolumeShelveTestJSON-385853788 tempest-AttachVolumeShelveTestJSON-385853788-project] Lock "1daf4f4c-0e4a-4779-b53a-78c48397ea2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120741) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 18:04:38.034686 dv-cinder-852009-8-iscsi devstack@n-api.service[120741]: DEBUG nova.policy [None req-e50934b2-054c-4c08-8dac-6a79dcb16d01 tempest-AttachVolumeShelveTestJSON-385853788 tempest-AttachVolumeShelveTestJSON-385853788-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e68ecd9b3ca643539b109f75bb242d6f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '75e14fd88bfb4cd896fa7b070a0fac47', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120741) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 18:04:38.043289 dv-cinder-852009-8-iscsi devstack@n-api.service[120741]: DEBUG nova.policy [None req-e50934b2-054c-4c08-8dac-6a79dcb16d01 tempest-AttachVolumeShelveTestJSON-385853788 tempest-AttachVolumeShelveTestJSON-385853788-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'e68ecd9b3ca643539b109f75bb242d6f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '75e14fd88bfb4cd896fa7b070a0fac47', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120741) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 18:04:38.044802 dv-cinder-852009-8-iscsi devstack@n-api.service[120741]: DEBUG nova.policy [None req-e50934b2-054c-4c08-8dac-6a79dcb16d01 tempest-AttachVolumeShelveTestJSON-385853788 tempest-AttachVolumeShelveTestJSON-385853788-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'e68ecd9b3ca643539b109f75bb242d6f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '75e14fd88bfb4cd896fa7b070a0fac47', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120741) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 18:04:38.045950 dv-cinder-852009-8-iscsi devstack@n-api.service[120741]: INFO nova.api.openstack.requestlog [None req-e50934b2-054c-4c08-8dac-6a79dcb16d01 tempest-AttachVolumeShelveTestJSON-385853788 tempest-AttachVolumeShelveTestJSON-385853788-project] 10.222.0.43 "GET /compute/v2.1/servers/11d2616a-96f9-4a7a-aab8-219219986a8b" status: 200 len: 1807 microversion: 2.20 time: 0.174564 Sep 13 18:04:38.046510 dv-cinder-852009-8-iscsi devstack@n-api.service[120741]: [pid: 120741|app: 0|req: 169/347] 10.222.0.43 () {60 vars in 1277 bytes} [Tue Sep 13 18:04:37 2022] GET /compute/v2.1/servers/11d2616a-96f9-4a7a-aab8-219219986a8b => generated 1807 bytes in 176 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 13 18:04:39.071578 dv-cinder-852009-8-iscsi devstack@n-api.service[120740]: DEBUG nova.api.openstack.wsgi [None req-39d0a6bb-faa5-4966-b3c1-f48fcfc3256e tempest-AttachVolumeShelveTestJSON-385853788 tempest-AttachVolumeShelveTestJSON-385853788-project] Calling method '>' {{(pid=120740) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 18:04:39.072355 dv-cinder-852009-8-iscsi devstack@n-api.service[120740]: DEBUG nova.compute.api [None req-39d0a6bb-faa5-4966-b3c1-f48fcfc3256e tempest-AttachVolumeShelveTestJSON-385853788 tempest-AttachVolumeShelveTestJSON-385853788-project] [instance: 11d2616a-96f9-4a7a-aab8-219219986a8b] Fetching instance by UUID {{(pid=120740) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 18:04:39.079222 dv-cinder-852009-8-iscsi devstack@n-api.service[120740]: DEBUG oslo_concurrency.lockutils [None req-39d0a6bb-faa5-4966-b3c1-f48fcfc3256e tempest-AttachVolumeShelveTestJSON-385853788 tempest-AttachVolumeShelveTestJSON-385853788-project] Acquiring lock "1daf4f4c-0e4a-4779-b53a-78c48397ea2f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120740) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 18:04:39.079749 dv-cinder-852009-8-iscsi devstack@n-api.service[120740]: DEBUG oslo_concurrency.lockutils [None req-39d0a6bb-faa5-4966-b3c1-f48fcfc3256e tempest-AttachVolumeShelveTestJSON-385853788 tempest-AttachVolumeShelveTestJSON-385853788-project] Lock "1daf4f4c-0e4a-4779-b53a-78c48397ea2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120740) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 18:04:39.080182 dv-cinder-852009-8-iscsi devstack@n-api.service[120740]: DEBUG oslo_concurrency.lockutils [None req-39d0a6bb-faa5-4966-b3c1-f48fcfc3256e tempest-AttachVolumeShelveTestJSON-385853788 tempest-AttachVolumeShelveTestJSON-385853788-project] Lock "1daf4f4c-0e4a-4779-b53a-78c48397ea2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120740) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 18:04:39.080914 dv-cinder-852009-8-iscsi devstack@n-api.service[120740]: DEBUG oslo_concurrency.lockutils [None req-39d0a6bb-faa5-4966-b3c1-f48fcfc3256e tempest-AttachVolumeShelveTestJSON-385853788 tempest-AttachVolumeShelveTestJSON-385853788-project] Acquiring lock "1daf4f4c-0e4a-4779-b53a-78c48397ea2f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120740) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 18:04:39.081351 dv-cinder-852009-8-iscsi devstack@n-api.service[120740]: DEBUG oslo_concurrency.lockutils [None req-39d0a6bb-faa5-4966-b3c1-f48fcfc3256e tempest-AttachVolumeShelveTestJSON-385853788 tempest-AttachVolumeShelveTestJSON-385853788-project] Lock "1daf4f4c-0e4a-4779-b53a-78c48397ea2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120740) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 18:04:39.081780 dv-cinder-852009-8-iscsi devstack@n-api.service[120740]: DEBUG oslo_concurrency.lockutils [None req-39d0a6bb-faa5-4966-b3c1-f48fcfc3256e tempest-AttachVolumeShelveTestJSON-385853788 tempest-AttachVolumeShelveTestJSON-385853788-project] Lock "1daf4f4c-0e4a-4779-b53a-78c48397ea2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120740) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 18:04:39.218231 dv-cinder-852009-8-iscsi devstack@n-api.service[120740]: DEBUG nova.policy [None req-39d0a6bb-faa5-4966-b3c1-f48fcfc3256e tempest-AttachVolumeShelveTestJSON-385853788 tempest-AttachVolumeShelveTestJSON-385853788-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e68ecd9b3ca643539b109f75bb242d6f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '75e14fd88bfb4cd896fa7b070a0fac47', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120740) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 18:04:39.227207 dv-cinder-852009-8-iscsi devstack@n-api.service[120740]: DEBUG nova.policy [None req-39d0a6bb-faa5-4966-b3c1-f48fcfc3256e tempest-AttachVolumeShelveTestJSON-385853788 tempest-AttachVolumeShelveTestJSON-385853788-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'e68ecd9b3ca643539b109f75bb242d6f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '75e14fd88bfb4cd896fa7b070a0fac47', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120740) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 18:04:39.228704 dv-cinder-852009-8-iscsi devstack@n-api.service[120740]: DEBUG nova.policy [None req-39d0a6bb-faa5-4966-b3c1-f48fcfc3256e tempest-AttachVolumeShelveTestJSON-385853788 tempest-AttachVolumeShelveTestJSON-385853788-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'e68ecd9b3ca643539b109f75bb242d6f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '75e14fd88bfb4cd896fa7b070a0fac47', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120740) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 18:04:39.229867 dv-cinder-852009-8-iscsi devstack@n-api.service[120740]: INFO nova.api.openstack.requestlog [None req-39d0a6bb-faa5-4966-b3c1-f48fcfc3256e tempest-AttachVolumeShelveTestJSON-385853788 tempest-AttachVolumeShelveTestJSON-385853788-project] 10.222.0.43 "GET /compute/v2.1/servers/11d2616a-96f9-4a7a-aab8-219219986a8b" status: 200 len: 1807 microversion: 2.20 time: 0.162451 Sep 13 18:04:39.230442 dv-cinder-852009-8-iscsi devstack@n-api.service[120740]: [pid: 120740|app: 0|req: 179/348] 10.222.0.43 () {60 vars in 1277 bytes} [Tue Sep 13 18:04:39 2022] GET /compute/v2.1/servers/11d2616a-96f9-4a7a-aab8-219219986a8b => generated 1807 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 13 18:04:40.255411 dv-cinder-852009-8-iscsi devstack@n-api.service[120741]: DEBUG nova.api.openstack.wsgi [None req-f24b1923-25b0-4472-8ffc-09773873ba6f tempest-AttachVolumeShelveTestJSON-385853788 tempest-AttachVolumeShelveTestJSON-385853788-project] Calling method '>' {{(pid=120741) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 18:04:40.256158 dv-cinder-852009-8-iscsi devstack@n-api.service[120741]: DEBUG nova.compute.api [None req-f24b1923-25b0-4472-8ffc-09773873ba6f tempest-AttachVolumeShelveTestJSON-385853788 tempest-AttachVolumeShelveTestJSON-385853788-project] [instance: 11d2616a-96f9-4a7a-aab8-219219986a8b] Fetching instance by UUID {{(pid=120741) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 18:04:40.263364 dv-cinder-852009-8-iscsi devstack@n-api.service[120741]: DEBUG oslo_concurrency.lockutils [None req-f24b1923-25b0-4472-8ffc-09773873ba6f tempest-AttachVolumeShelveTestJSON-385853788 tempest-AttachVolumeShelveTestJSON-385853788-project] Acquiring lock "1daf4f4c-0e4a-4779-b53a-78c48397ea2f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120741) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 18:04:40.263844 dv-cinder-852009-8-iscsi devstack@n-api.service[120741]: DEBUG oslo_concurrency.lockutils [None req-f24b1923-25b0-4472-8ffc-09773873ba6f tempest-AttachVolumeShelveTestJSON-385853788 tempest-AttachVolumeShelveTestJSON-385853788-project] Lock "1daf4f4c-0e4a-4779-b53a-78c48397ea2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120741) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 18:04:40.264269 dv-cinder-852009-8-iscsi devstack@n-api.service[120741]: DEBUG oslo_concurrency.lockutils [None req-f24b1923-25b0-4472-8ffc-09773873ba6f tempest-AttachVolumeShelveTestJSON-385853788 tempest-AttachVolumeShelveTestJSON-385853788-project] Lock "1daf4f4c-0e4a-4779-b53a-78c48397ea2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120741) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 18:04:40.265133 dv-cinder-852009-8-iscsi devstack@n-api.service[120741]: DEBUG oslo_concurrency.lockutils [None req-f24b1923-25b0-4472-8ffc-09773873ba6f tempest-AttachVolumeShelveTestJSON-385853788 tempest-AttachVolumeShelveTestJSON-385853788-project] Acquiring lock "1daf4f4c-0e4a-4779-b53a-78c48397ea2f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120741) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 18:04:40.265594 dv-cinder-852009-8-iscsi devstack@n-api.service[120741]: DEBUG oslo_concurrency.lockutils [None req-f24b1923-25b0-4472-8ffc-09773873ba6f tempest-AttachVolumeShelveTestJSON-385853788 tempest-AttachVolumeShelveTestJSON-385853788-project] Lock "1daf4f4c-0e4a-4779-b53a-78c48397ea2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120741) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 18:04:40.266291 dv-cinder-852009-8-iscsi devstack@n-api.service[120741]: DEBUG oslo_concurrency.lockutils [None req-f24b1923-25b0-4472-8ffc-09773873ba6f tempest-AttachVolumeShelveTestJSON-385853788 tempest-AttachVolumeShelveTestJSON-385853788-project] Lock "1daf4f4c-0e4a-4779-b53a-78c48397ea2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120741) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 18:04:40.396832 dv-cinder-852009-8-iscsi devstack@n-api.service[120741]: DEBUG nova.policy [None req-f24b1923-25b0-4472-8ffc-09773873ba6f tempest-AttachVolumeShelveTestJSON-385853788 tempest-AttachVolumeShelveTestJSON-385853788-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e68ecd9b3ca643539b109f75bb242d6f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '75e14fd88bfb4cd896fa7b070a0fac47', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120741) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 18:04:40.406138 dv-cinder-852009-8-iscsi devstack@n-api.service[120741]: DEBUG nova.policy [None req-f24b1923-25b0-4472-8ffc-09773873ba6f tempest-AttachVolumeShelveTestJSON-385853788 tempest-AttachVolumeShelveTestJSON-385853788-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'e68ecd9b3ca643539b109f75bb242d6f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '75e14fd88bfb4cd896fa7b070a0fac47', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120741) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 18:04:40.407578 dv-cinder-852009-8-iscsi devstack@n-api.service[120741]: DEBUG nova.policy [None req-f24b1923-25b0-4472-8ffc-09773873ba6f tempest-AttachVolumeShelveTestJSON-385853788 tempest-AttachVolumeShelveTestJSON-385853788-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'e68ecd9b3ca643539b109f75bb242d6f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '75e14fd88bfb4cd896fa7b070a0fac47', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120741) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 18:04:40.408818 dv-cinder-852009-8-iscsi devstack@n-api.service[120741]: INFO nova.api.openstack.requestlog [None req-f24b1923-25b0-4472-8ffc-09773873ba6f tempest-AttachVolumeShelveTestJSON-385853788 tempest-AttachVolumeShelveTestJSON-385853788-project] 10.222.0.43 "GET /compute/v2.1/servers/11d2616a-96f9-4a7a-aab8-219219986a8b" status: 200 len: 1807 microversion: 2.20 time: 0.157544 Sep 13 18:04:40.409335 dv-cinder-852009-8-iscsi devstack@n-api.service[120741]: [pid: 120741|app: 0|req: 170/349] 10.222.0.43 () {60 vars in 1277 bytes} [Tue Sep 13 18:04:40 2022] GET /compute/v2.1/servers/11d2616a-96f9-4a7a-aab8-219219986a8b => generated 1807 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 13 18:04:41.436111 dv-cinder-852009-8-iscsi devstack@n-api.service[120740]: DEBUG nova.api.openstack.wsgi [None req-9f3c6c96-e766-47ea-9c91-d3afda2eef50 tempest-AttachVolumeShelveTestJSON-385853788 tempest-AttachVolumeShelveTestJSON-385853788-project] Calling method '>' {{(pid=120740) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 18:04:41.436844 dv-cinder-852009-8-iscsi devstack@n-api.service[120740]: DEBUG nova.compute.api [None req-9f3c6c96-e766-47ea-9c91-d3afda2eef50 tempest-AttachVolumeShelveTestJSON-385853788 tempest-AttachVolumeShelveTestJSON-385853788-project] [instance: 11d2616a-96f9-4a7a-aab8-219219986a8b] Fetching instance by UUID {{(pid=120740) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 18:04:41.444260 dv-cinder-852009-8-iscsi devstack@n-api.service[120740]: DEBUG oslo_concurrency.lockutils [None req-9f3c6c96-e766-47ea-9c91-d3afda2eef50 tempest-AttachVolumeShelveTestJSON-385853788 tempest-AttachVolumeShelveTestJSON-385853788-project] Acquiring lock "1daf4f4c-0e4a-4779-b53a-78c48397ea2f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120740) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 18:04:41.444774 dv-cinder-852009-8-iscsi devstack@n-api.service[120740]: DEBUG oslo_concurrency.lockutils [None req-9f3c6c96-e766-47ea-9c91-d3afda2eef50 tempest-AttachVolumeShelveTestJSON-385853788 tempest-AttachVolumeShelveTestJSON-385853788-project] Lock "1daf4f4c-0e4a-4779-b53a-78c48397ea2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120740) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 18:04:41.445203 dv-cinder-852009-8-iscsi devstack@n-api.service[120740]: DEBUG oslo_concurrency.lockutils [None req-9f3c6c96-e766-47ea-9c91-d3afda2eef50 tempest-AttachVolumeShelveTestJSON-385853788 tempest-AttachVolumeShelveTestJSON-385853788-project] Lock "1daf4f4c-0e4a-4779-b53a-78c48397ea2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120740) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 18:04:41.445907 dv-cinder-852009-8-iscsi devstack@n-api.service[120740]: DEBUG oslo_concurrency.lockutils [None req-9f3c6c96-e766-47ea-9c91-d3afda2eef50 tempest-AttachVolumeShelveTestJSON-385853788 tempest-AttachVolumeShelveTestJSON-385853788-project] Acquiring lock "1daf4f4c-0e4a-4779-b53a-78c48397ea2f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120740) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 18:04:41.446353 dv-cinder-852009-8-iscsi devstack@n-api.service[120740]: DEBUG oslo_concurrency.lockutils [None req-9f3c6c96-e766-47ea-9c91-d3afda2eef50 tempest-AttachVolumeShelveTestJSON-385853788 tempest-AttachVolumeShelveTestJSON-385853788-project] Lock "1daf4f4c-0e4a-4779-b53a-78c48397ea2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120740) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 18:04:41.446797 dv-cinder-852009-8-iscsi devstack@n-api.service[120740]: DEBUG oslo_concurrency.lockutils [None req-9f3c6c96-e766-47ea-9c91-d3afda2eef50 tempest-AttachVolumeShelveTestJSON-385853788 tempest-AttachVolumeShelveTestJSON-385853788-project] Lock "1daf4f4c-0e4a-4779-b53a-78c48397ea2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120740) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 18:04:41.579930 dv-cinder-852009-8-iscsi devstack@n-api.service[120740]: DEBUG nova.policy [None req-9f3c6c96-e766-47ea-9c91-d3afda2eef50 tempest-AttachVolumeShelveTestJSON-385853788 tempest-AttachVolumeShelveTestJSON-385853788-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e68ecd9b3ca643539b109f75bb242d6f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '75e14fd88bfb4cd896fa7b070a0fac47', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120740) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 18:04:41.589989 dv-cinder-852009-8-iscsi devstack@n-api.service[120740]: DEBUG nova.policy [None req-9f3c6c96-e766-47ea-9c91-d3afda2eef50 tempest-AttachVolumeShelveTestJSON-385853788 tempest-AttachVolumeShelveTestJSON-385853788-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'e68ecd9b3ca643539b109f75bb242d6f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '75e14fd88bfb4cd896fa7b070a0fac47', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120740) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 18:04:41.591427 dv-cinder-852009-8-iscsi devstack@n-api.service[120740]: DEBUG nova.policy [None req-9f3c6c96-e766-47ea-9c91-d3afda2eef50 tempest-AttachVolumeShelveTestJSON-385853788 tempest-AttachVolumeShelveTestJSON-385853788-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'e68ecd9b3ca643539b109f75bb242d6f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '75e14fd88bfb4cd896fa7b070a0fac47', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120740) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 18:04:41.592631 dv-cinder-852009-8-iscsi devstack@n-api.service[120740]: INFO nova.api.openstack.requestlog [None req-9f3c6c96-e766-47ea-9c91-d3afda2eef50 tempest-AttachVolumeShelveTestJSON-385853788 tempest-AttachVolumeShelveTestJSON-385853788-project] 10.222.0.43 "GET /compute/v2.1/servers/11d2616a-96f9-4a7a-aab8-219219986a8b" status: 200 len: 1807 microversion: 2.20 time: 0.161417 Sep 13 18:04:41.593193 dv-cinder-852009-8-iscsi devstack@n-api.service[120740]: [pid: 120740|app: 0|req: 180/350] 10.222.0.43 () {60 vars in 1277 bytes} [Tue Sep 13 18:04:41 2022] GET /compute/v2.1/servers/11d2616a-96f9-4a7a-aab8-219219986a8b => generated 1807 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 13 18:04:42.623643 dv-cinder-852009-8-iscsi devstack@n-api.service[120741]: DEBUG nova.api.openstack.wsgi [None req-3a55611a-27c8-4aab-b996-b4569a31bad3 tempest-AttachVolumeShelveTestJSON-385853788 tempest-AttachVolumeShelveTestJSON-385853788-project] Calling method '>' {{(pid=120741) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 18:04:42.624269 dv-cinder-852009-8-iscsi devstack@n-api.service[120741]: DEBUG nova.compute.api [None req-3a55611a-27c8-4aab-b996-b4569a31bad3 tempest-AttachVolumeShelveTestJSON-385853788 tempest-AttachVolumeShelveTestJSON-385853788-project] [instance: 11d2616a-96f9-4a7a-aab8-219219986a8b] Fetching instance by UUID {{(pid=120741) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 18:04:42.631733 dv-cinder-852009-8-iscsi devstack@n-api.service[120741]: DEBUG oslo_concurrency.lockutils [None req-3a55611a-27c8-4aab-b996-b4569a31bad3 tempest-AttachVolumeShelveTestJSON-385853788 tempest-AttachVolumeShelveTestJSON-385853788-project] Acquiring lock "1daf4f4c-0e4a-4779-b53a-78c48397ea2f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120741) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 18:04:42.632218 dv-cinder-852009-8-iscsi devstack@n-api.service[120741]: DEBUG oslo_concurrency.lockutils [None req-3a55611a-27c8-4aab-b996-b4569a31bad3 tempest-AttachVolumeShelveTestJSON-385853788 tempest-AttachVolumeShelveTestJSON-385853788-project] Lock "1daf4f4c-0e4a-4779-b53a-78c48397ea2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120741) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 18:04:42.632691 dv-cinder-852009-8-iscsi devstack@n-api.service[120741]: DEBUG oslo_concurrency.lockutils [None req-3a55611a-27c8-4aab-b996-b4569a31bad3 tempest-AttachVolumeShelveTestJSON-385853788 tempest-AttachVolumeShelveTestJSON-385853788-project] Lock "1daf4f4c-0e4a-4779-b53a-78c48397ea2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120741) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 18:04:42.633382 dv-cinder-852009-8-iscsi devstack@n-api.service[120741]: DEBUG oslo_concurrency.lockutils [None req-3a55611a-27c8-4aab-b996-b4569a31bad3 tempest-AttachVolumeShelveTestJSON-385853788 tempest-AttachVolumeShelveTestJSON-385853788-project] Acquiring lock "1daf4f4c-0e4a-4779-b53a-78c48397ea2f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120741) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 18:04:42.633829 dv-cinder-852009-8-iscsi devstack@n-api.service[120741]: DEBUG oslo_concurrency.lockutils [None req-3a55611a-27c8-4aab-b996-b4569a31bad3 tempest-AttachVolumeShelveTestJSON-385853788 tempest-AttachVolumeShelveTestJSON-385853788-project] Lock "1daf4f4c-0e4a-4779-b53a-78c48397ea2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120741) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 18:04:42.634244 dv-cinder-852009-8-iscsi devstack@n-api.service[120741]: DEBUG oslo_concurrency.lockutils [None req-3a55611a-27c8-4aab-b996-b4569a31bad3 tempest-AttachVolumeShelveTestJSON-385853788 tempest-AttachVolumeShelveTestJSON-385853788-project] Lock "1daf4f4c-0e4a-4779-b53a-78c48397ea2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120741) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 18:04:42.780382 dv-cinder-852009-8-iscsi devstack@n-api.service[120741]: DEBUG nova.policy [None req-3a55611a-27c8-4aab-b996-b4569a31bad3 tempest-AttachVolumeShelveTestJSON-385853788 tempest-AttachVolumeShelveTestJSON-385853788-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e68ecd9b3ca643539b109f75bb242d6f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '75e14fd88bfb4cd896fa7b070a0fac47', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120741) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 18:04:42.789543 dv-cinder-852009-8-iscsi devstack@n-api.service[120741]: DEBUG nova.policy [None req-3a55611a-27c8-4aab-b996-b4569a31bad3 tempest-AttachVolumeShelveTestJSON-385853788 tempest-AttachVolumeShelveTestJSON-385853788-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'e68ecd9b3ca643539b109f75bb242d6f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '75e14fd88bfb4cd896fa7b070a0fac47', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120741) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 18:04:42.792373 dv-cinder-852009-8-iscsi devstack@n-api.service[120741]: DEBUG nova.policy [None req-3a55611a-27c8-4aab-b996-b4569a31bad3 tempest-AttachVolumeShelveTestJSON-385853788 tempest-AttachVolumeShelveTestJSON-385853788-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'e68ecd9b3ca643539b109f75bb242d6f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '75e14fd88bfb4cd896fa7b070a0fac47', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120741) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 18:04:42.794373 dv-cinder-852009-8-iscsi devstack@n-api.service[120741]: INFO nova.api.openstack.requestlog [None req-3a55611a-27c8-4aab-b996-b4569a31bad3 tempest-AttachVolumeShelveTestJSON-385853788 tempest-AttachVolumeShelveTestJSON-385853788-project] 10.222.0.43 "GET /compute/v2.1/servers/11d2616a-96f9-4a7a-aab8-219219986a8b" status: 200 len: 1807 microversion: 2.20 time: 0.174310 Sep 13 18:04:42.795295 dv-cinder-852009-8-iscsi devstack@n-api.service[120741]: [pid: 120741|app: 0|req: 171/351] 10.222.0.43 () {60 vars in 1277 bytes} [Tue Sep 13 18:04:42 2022] GET /compute/v2.1/servers/11d2616a-96f9-4a7a-aab8-219219986a8b => generated 1807 bytes in 176 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 13 18:04:43.824280 dv-cinder-852009-8-iscsi devstack@n-api.service[120740]: DEBUG nova.api.openstack.wsgi [None req-1e6c93ce-2476-446c-98dd-589146c65e06 tempest-AttachVolumeShelveTestJSON-385853788 tempest-AttachVolumeShelveTestJSON-385853788-project] Calling method '>' {{(pid=120740) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 18:04:43.825168 dv-cinder-852009-8-iscsi devstack@n-api.service[120740]: DEBUG nova.compute.api [None req-1e6c93ce-2476-446c-98dd-589146c65e06 tempest-AttachVolumeShelveTestJSON-385853788 tempest-AttachVolumeShelveTestJSON-385853788-project] [instance: 11d2616a-96f9-4a7a-aab8-219219986a8b] Fetching instance by UUID {{(pid=120740) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 18:04:43.834491 dv-cinder-852009-8-iscsi devstack@n-api.service[120740]: DEBUG oslo_concurrency.lockutils [None req-1e6c93ce-2476-446c-98dd-589146c65e06 tempest-AttachVolumeShelveTestJSON-385853788 tempest-AttachVolumeShelveTestJSON-385853788-project] Acquiring lock "1daf4f4c-0e4a-4779-b53a-78c48397ea2f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120740) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 18:04:43.835188 dv-cinder-852009-8-iscsi devstack@n-api.service[120740]: DEBUG oslo_concurrency.lockutils [None req-1e6c93ce-2476-446c-98dd-589146c65e06 tempest-AttachVolumeShelveTestJSON-385853788 tempest-AttachVolumeShelveTestJSON-385853788-project] Lock "1daf4f4c-0e4a-4779-b53a-78c48397ea2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120740) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 18:04:43.835861 dv-cinder-852009-8-iscsi devstack@n-api.service[120740]: DEBUG oslo_concurrency.lockutils [None req-1e6c93ce-2476-446c-98dd-589146c65e06 tempest-AttachVolumeShelveTestJSON-385853788 tempest-AttachVolumeShelveTestJSON-385853788-project] Lock "1daf4f4c-0e4a-4779-b53a-78c48397ea2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120740) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 18:04:43.836598 dv-cinder-852009-8-iscsi devstack@n-api.service[120740]: DEBUG oslo_concurrency.lockutils [None req-1e6c93ce-2476-446c-98dd-589146c65e06 tempest-AttachVolumeShelveTestJSON-385853788 tempest-AttachVolumeShelveTestJSON-385853788-project] Acquiring lock "1daf4f4c-0e4a-4779-b53a-78c48397ea2f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120740) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 18:04:43.837055 dv-cinder-852009-8-iscsi devstack@n-api.service[120740]: DEBUG oslo_concurrency.lockutils [None req-1e6c93ce-2476-446c-98dd-589146c65e06 tempest-AttachVolumeShelveTestJSON-385853788 tempest-AttachVolumeShelveTestJSON-385853788-project] Lock "1daf4f4c-0e4a-4779-b53a-78c48397ea2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120740) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 18:04:43.837474 dv-cinder-852009-8-iscsi devstack@n-api.service[120740]: DEBUG oslo_concurrency.lockutils [None req-1e6c93ce-2476-446c-98dd-589146c65e06 tempest-AttachVolumeShelveTestJSON-385853788 tempest-AttachVolumeShelveTestJSON-385853788-project] Lock "1daf4f4c-0e4a-4779-b53a-78c48397ea2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120740) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 18:04:43.968668 dv-cinder-852009-8-iscsi devstack@n-api.service[120740]: DEBUG nova.policy [None req-1e6c93ce-2476-446c-98dd-589146c65e06 tempest-AttachVolumeShelveTestJSON-385853788 tempest-AttachVolumeShelveTestJSON-385853788-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e68ecd9b3ca643539b109f75bb242d6f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '75e14fd88bfb4cd896fa7b070a0fac47', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120740) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 18:04:43.977684 dv-cinder-852009-8-iscsi devstack@n-api.service[120740]: DEBUG nova.policy [None req-1e6c93ce-2476-446c-98dd-589146c65e06 tempest-AttachVolumeShelveTestJSON-385853788 tempest-AttachVolumeShelveTestJSON-385853788-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'e68ecd9b3ca643539b109f75bb242d6f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '75e14fd88bfb4cd896fa7b070a0fac47', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120740) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 18:04:43.979132 dv-cinder-852009-8-iscsi devstack@n-api.service[120740]: DEBUG nova.policy [None req-1e6c93ce-2476-446c-98dd-589146c65e06 tempest-AttachVolumeShelveTestJSON-385853788 tempest-AttachVolumeShelveTestJSON-385853788-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'e68ecd9b3ca643539b109f75bb242d6f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '75e14fd88bfb4cd896fa7b070a0fac47', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120740) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 18:04:43.980292 dv-cinder-852009-8-iscsi devstack@n-api.service[120740]: INFO nova.api.openstack.requestlog [None req-1e6c93ce-2476-446c-98dd-589146c65e06 tempest-AttachVolumeShelveTestJSON-385853788 tempest-AttachVolumeShelveTestJSON-385853788-project] 10.222.0.43 "GET /compute/v2.1/servers/11d2616a-96f9-4a7a-aab8-219219986a8b" status: 200 len: 1807 microversion: 2.20 time: 0.161875 Sep 13 18:04:43.980892 dv-cinder-852009-8-iscsi devstack@n-api.service[120740]: [pid: 120740|app: 0|req: 181/352] 10.222.0.43 () {60 vars in 1277 bytes} [Tue Sep 13 18:04:43 2022] GET /compute/v2.1/servers/11d2616a-96f9-4a7a-aab8-219219986a8b => generated 1807 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 13 18:04:44.750173 dv-cinder-852009-8-iscsi devstack@n-api.service[120741]: DEBUG nova.api.openstack.wsgi [req-55c2f68e-7372-4070-94e6-bcd06881a3cd req-833fed25-4c18-4ca2-8083-5fce30358180 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "11d2616a-96f9-4a7a-aab8-219219986a8b", "name": "network-vif-plugged", "status": "completed", "tag": "85bfb53c-ec3d-49bc-ade7-acdfac253331"}]} {{(pid=120741) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 13 18:04:44.760959 dv-cinder-852009-8-iscsi devstack@n-api.service[120741]: DEBUG oslo_concurrency.lockutils [req-55c2f68e-7372-4070-94e6-bcd06881a3cd req-833fed25-4c18-4ca2-8083-5fce30358180 service nova] Acquiring lock "1daf4f4c-0e4a-4779-b53a-78c48397ea2f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120741) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 18:04:44.761463 dv-cinder-852009-8-iscsi devstack@n-api.service[120741]: DEBUG oslo_concurrency.lockutils [req-55c2f68e-7372-4070-94e6-bcd06881a3cd req-833fed25-4c18-4ca2-8083-5fce30358180 service nova] Lock "1daf4f4c-0e4a-4779-b53a-78c48397ea2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120741) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 18:04:44.761880 dv-cinder-852009-8-iscsi devstack@n-api.service[120741]: DEBUG oslo_concurrency.lockutils [req-55c2f68e-7372-4070-94e6-bcd06881a3cd req-833fed25-4c18-4ca2-8083-5fce30358180 service nova] Lock "1daf4f4c-0e4a-4779-b53a-78c48397ea2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120741) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 18:04:44.772988 dv-cinder-852009-8-iscsi devstack@n-api.service[120741]: INFO nova.api.openstack.compute.server_external_events [req-55c2f68e-7372-4070-94e6-bcd06881a3cd req-833fed25-4c18-4ca2-8083-5fce30358180 service nova] Creating event network-vif-plugged:85bfb53c-ec3d-49bc-ade7-acdfac253331 for instance 11d2616a-96f9-4a7a-aab8-219219986a8b on hv-cinder-85200 Sep 13 18:04:44.778035 dv-cinder-852009-8-iscsi devstack@n-api.service[120741]: INFO nova.api.openstack.requestlog [req-55c2f68e-7372-4070-94e6-bcd06881a3cd req-833fed25-4c18-4ca2-8083-5fce30358180 service nova] 10.222.0.43 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.031615 Sep 13 18:04:44.778808 dv-cinder-852009-8-iscsi devstack@n-api.service[120741]: [pid: 120741|app: 0|req: 172/353] 10.222.0.43 () {64 vars in 1317 bytes} [Tue Sep 13 18:04:44 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 33 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Sep 13 18:04:45.006457 dv-cinder-852009-8-iscsi devstack@n-api.service[120740]: DEBUG nova.api.openstack.wsgi [None req-fa3914a6-aa00-40df-9bdd-7559ad9a4a2f tempest-AttachVolumeShelveTestJSON-385853788 tempest-AttachVolumeShelveTestJSON-385853788-project] Calling method '>' {{(pid=120740) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 18:04:45.007007 dv-cinder-852009-8-iscsi devstack@n-api.service[120740]: DEBUG nova.compute.api [None req-fa3914a6-aa00-40df-9bdd-7559ad9a4a2f tempest-AttachVolumeShelveTestJSON-385853788 tempest-AttachVolumeShelveTestJSON-385853788-project] [instance: 11d2616a-96f9-4a7a-aab8-219219986a8b] Fetching instance by UUID {{(pid=120740) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 18:04:45.014083 dv-cinder-852009-8-iscsi devstack@n-api.service[120740]: DEBUG oslo_concurrency.lockutils [None req-fa3914a6-aa00-40df-9bdd-7559ad9a4a2f tempest-AttachVolumeShelveTestJSON-385853788 tempest-AttachVolumeShelveTestJSON-385853788-project] Acquiring lock "1daf4f4c-0e4a-4779-b53a-78c48397ea2f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120740) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 18:04:45.014572 dv-cinder-852009-8-iscsi devstack@n-api.service[120740]: DEBUG oslo_concurrency.lockutils [None req-fa3914a6-aa00-40df-9bdd-7559ad9a4a2f tempest-AttachVolumeShelveTestJSON-385853788 tempest-AttachVolumeShelveTestJSON-385853788-project] Lock "1daf4f4c-0e4a-4779-b53a-78c48397ea2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120740) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 18:04:45.014997 dv-cinder-852009-8-iscsi devstack@n-api.service[120740]: DEBUG oslo_concurrency.lockutils [None req-fa3914a6-aa00-40df-9bdd-7559ad9a4a2f tempest-AttachVolumeShelveTestJSON-385853788 tempest-AttachVolumeShelveTestJSON-385853788-project] Lock "1daf4f4c-0e4a-4779-b53a-78c48397ea2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120740) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 18:04:45.015688 dv-cinder-852009-8-iscsi devstack@n-api.service[120740]: DEBUG oslo_concurrency.lockutils [None req-fa3914a6-aa00-40df-9bdd-7559ad9a4a2f tempest-AttachVolumeShelveTestJSON-385853788 tempest-AttachVolumeShelveTestJSON-385853788-project] Acquiring lock "1daf4f4c-0e4a-4779-b53a-78c48397ea2f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120740) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 18:04:45.016132 dv-cinder-852009-8-iscsi devstack@n-api.service[120740]: DEBUG oslo_concurrency.lockutils [None req-fa3914a6-aa00-40df-9bdd-7559ad9a4a2f tempest-AttachVolumeShelveTestJSON-385853788 tempest-AttachVolumeShelveTestJSON-385853788-project] Lock "1daf4f4c-0e4a-4779-b53a-78c48397ea2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120740) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 18:04:45.016590 dv-cinder-852009-8-iscsi devstack@n-api.service[120740]: DEBUG oslo_concurrency.lockutils [None req-fa3914a6-aa00-40df-9bdd-7559ad9a4a2f tempest-AttachVolumeShelveTestJSON-385853788 tempest-AttachVolumeShelveTestJSON-385853788-project] Lock "1daf4f4c-0e4a-4779-b53a-78c48397ea2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120740) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 18:04:45.154642 dv-cinder-852009-8-iscsi devstack@n-api.service[120740]: DEBUG nova.policy [None req-fa3914a6-aa00-40df-9bdd-7559ad9a4a2f tempest-AttachVolumeShelveTestJSON-385853788 tempest-AttachVolumeShelveTestJSON-385853788-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e68ecd9b3ca643539b109f75bb242d6f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '75e14fd88bfb4cd896fa7b070a0fac47', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120740) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 18:04:45.164375 dv-cinder-852009-8-iscsi devstack@n-api.service[120740]: DEBUG nova.policy [None req-fa3914a6-aa00-40df-9bdd-7559ad9a4a2f tempest-AttachVolumeShelveTestJSON-385853788 tempest-AttachVolumeShelveTestJSON-385853788-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'e68ecd9b3ca643539b109f75bb242d6f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '75e14fd88bfb4cd896fa7b070a0fac47', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120740) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 18:04:45.165898 dv-cinder-852009-8-iscsi devstack@n-api.service[120740]: DEBUG nova.policy [None req-fa3914a6-aa00-40df-9bdd-7559ad9a4a2f tempest-AttachVolumeShelveTestJSON-385853788 tempest-AttachVolumeShelveTestJSON-385853788-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'e68ecd9b3ca643539b109f75bb242d6f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '75e14fd88bfb4cd896fa7b070a0fac47', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120740) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 18:04:45.167073 dv-cinder-852009-8-iscsi devstack@n-api.service[120740]: INFO nova.api.openstack.requestlog [None req-fa3914a6-aa00-40df-9bdd-7559ad9a4a2f tempest-AttachVolumeShelveTestJSON-385853788 tempest-AttachVolumeShelveTestJSON-385853788-project] 10.222.0.43 "GET /compute/v2.1/servers/11d2616a-96f9-4a7a-aab8-219219986a8b" status: 200 len: 1807 microversion: 2.20 time: 0.165062 Sep 13 18:04:45.167632 dv-cinder-852009-8-iscsi devstack@n-api.service[120740]: [pid: 120740|app: 0|req: 182/354] 10.222.0.43 () {60 vars in 1277 bytes} [Tue Sep 13 18:04:45 2022] GET /compute/v2.1/servers/11d2616a-96f9-4a7a-aab8-219219986a8b => generated 1807 bytes in 166 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 13 18:04:46.201720 dv-cinder-852009-8-iscsi devstack@n-api.service[120741]: DEBUG nova.api.openstack.wsgi [None req-51f23525-c5be-40cd-a2ae-187cdd897654 tempest-AttachVolumeShelveTestJSON-385853788 tempest-AttachVolumeShelveTestJSON-385853788-project] Calling method '>' {{(pid=120741) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 18:04:46.202813 dv-cinder-852009-8-iscsi devstack@n-api.service[120741]: DEBUG nova.compute.api [None req-51f23525-c5be-40cd-a2ae-187cdd897654 tempest-AttachVolumeShelveTestJSON-385853788 tempest-AttachVolumeShelveTestJSON-385853788-project] [instance: 11d2616a-96f9-4a7a-aab8-219219986a8b] Fetching instance by UUID {{(pid=120741) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 18:04:46.206067 dv-cinder-852009-8-iscsi devstack@n-api.service[120741]: DEBUG dbcounter [-] [120741] Writing DB stats nova_api:SELECT=48,nova_api:UPDATE=1 {{(pid=120741) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 18:04:46.214926 dv-cinder-852009-8-iscsi devstack@n-api.service[120741]: DEBUG oslo_concurrency.lockutils [None req-51f23525-c5be-40cd-a2ae-187cdd897654 tempest-AttachVolumeShelveTestJSON-385853788 tempest-AttachVolumeShelveTestJSON-385853788-project] Acquiring lock "1daf4f4c-0e4a-4779-b53a-78c48397ea2f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120741) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 18:04:46.215423 dv-cinder-852009-8-iscsi devstack@n-api.service[120741]: DEBUG oslo_concurrency.lockutils [None req-51f23525-c5be-40cd-a2ae-187cdd897654 tempest-AttachVolumeShelveTestJSON-385853788 tempest-AttachVolumeShelveTestJSON-385853788-project] Lock "1daf4f4c-0e4a-4779-b53a-78c48397ea2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120741) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 18:04:46.215846 dv-cinder-852009-8-iscsi devstack@n-api.service[120741]: DEBUG oslo_concurrency.lockutils [None req-51f23525-c5be-40cd-a2ae-187cdd897654 tempest-AttachVolumeShelveTestJSON-385853788 tempest-AttachVolumeShelveTestJSON-385853788-project] Lock "1daf4f4c-0e4a-4779-b53a-78c48397ea2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120741) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 18:04:46.216588 dv-cinder-852009-8-iscsi devstack@n-api.service[120741]: DEBUG oslo_concurrency.lockutils [None req-51f23525-c5be-40cd-a2ae-187cdd897654 tempest-AttachVolumeShelveTestJSON-385853788 tempest-AttachVolumeShelveTestJSON-385853788-project] Acquiring lock "1daf4f4c-0e4a-4779-b53a-78c48397ea2f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120741) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 18:04:46.217030 dv-cinder-852009-8-iscsi devstack@n-api.service[120741]: DEBUG oslo_concurrency.lockutils [None req-51f23525-c5be-40cd-a2ae-187cdd897654 tempest-AttachVolumeShelveTestJSON-385853788 tempest-AttachVolumeShelveTestJSON-385853788-project] Lock "1daf4f4c-0e4a-4779-b53a-78c48397ea2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120741) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 18:04:46.217461 dv-cinder-852009-8-iscsi devstack@n-api.service[120741]: DEBUG oslo_concurrency.lockutils [None req-51f23525-c5be-40cd-a2ae-187cdd897654 tempest-AttachVolumeShelveTestJSON-385853788 tempest-AttachVolumeShelveTestJSON-385853788-project] Lock "1daf4f4c-0e4a-4779-b53a-78c48397ea2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120741) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 18:04:46.353953 dv-cinder-852009-8-iscsi devstack@n-api.service[120741]: DEBUG nova.policy [None req-51f23525-c5be-40cd-a2ae-187cdd897654 tempest-AttachVolumeShelveTestJSON-385853788 tempest-AttachVolumeShelveTestJSON-385853788-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e68ecd9b3ca643539b109f75bb242d6f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '75e14fd88bfb4cd896fa7b070a0fac47', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120741) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 18:04:46.362943 dv-cinder-852009-8-iscsi devstack@n-api.service[120741]: DEBUG nova.policy [None req-51f23525-c5be-40cd-a2ae-187cdd897654 tempest-AttachVolumeShelveTestJSON-385853788 tempest-AttachVolumeShelveTestJSON-385853788-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'e68ecd9b3ca643539b109f75bb242d6f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '75e14fd88bfb4cd896fa7b070a0fac47', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120741) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 18:04:46.364322 dv-cinder-852009-8-iscsi devstack@n-api.service[120741]: DEBUG nova.policy [None req-51f23525-c5be-40cd-a2ae-187cdd897654 tempest-AttachVolumeShelveTestJSON-385853788 tempest-AttachVolumeShelveTestJSON-385853788-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'e68ecd9b3ca643539b109f75bb242d6f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '75e14fd88bfb4cd896fa7b070a0fac47', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120741) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 18:04:46.365706 dv-cinder-852009-8-iscsi devstack@n-api.service[120741]: INFO nova.api.openstack.requestlog [None req-51f23525-c5be-40cd-a2ae-187cdd897654 tempest-AttachVolumeShelveTestJSON-385853788 tempest-AttachVolumeShelveTestJSON-385853788-project] 10.222.0.43 "GET /compute/v2.1/servers/11d2616a-96f9-4a7a-aab8-219219986a8b" status: 200 len: 1807 microversion: 2.20 time: 0.172129 Sep 13 18:04:46.366275 dv-cinder-852009-8-iscsi devstack@n-api.service[120741]: [pid: 120741|app: 0|req: 173/355] 10.222.0.43 () {60 vars in 1277 bytes} [Tue Sep 13 18:04:46 2022] GET /compute/v2.1/servers/11d2616a-96f9-4a7a-aab8-219219986a8b => generated 1807 bytes in 174 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 13 18:04:47.396361 dv-cinder-852009-8-iscsi devstack@n-api.service[120740]: DEBUG nova.api.openstack.wsgi [None req-aa49c567-2797-4148-b39d-0faf0afd3f1c tempest-AttachVolumeShelveTestJSON-385853788 tempest-AttachVolumeShelveTestJSON-385853788-project] Calling method '>' {{(pid=120740) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 18:04:47.397973 dv-cinder-852009-8-iscsi devstack@n-api.service[120740]: DEBUG nova.compute.api [None req-aa49c567-2797-4148-b39d-0faf0afd3f1c tempest-AttachVolumeShelveTestJSON-385853788 tempest-AttachVolumeShelveTestJSON-385853788-project] [instance: 11d2616a-96f9-4a7a-aab8-219219986a8b] Fetching instance by UUID {{(pid=120740) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 18:04:47.405560 dv-cinder-852009-8-iscsi devstack@n-api.service[120740]: DEBUG oslo_concurrency.lockutils [None req-aa49c567-2797-4148-b39d-0faf0afd3f1c tempest-AttachVolumeShelveTestJSON-385853788 tempest-AttachVolumeShelveTestJSON-385853788-project] Acquiring lock "1daf4f4c-0e4a-4779-b53a-78c48397ea2f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120740) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 18:04:47.406405 dv-cinder-852009-8-iscsi devstack@n-api.service[120740]: DEBUG oslo_concurrency.lockutils [None req-aa49c567-2797-4148-b39d-0faf0afd3f1c tempest-AttachVolumeShelveTestJSON-385853788 tempest-AttachVolumeShelveTestJSON-385853788-project] Lock "1daf4f4c-0e4a-4779-b53a-78c48397ea2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120740) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 18:04:47.407324 dv-cinder-852009-8-iscsi devstack@n-api.service[120740]: DEBUG oslo_concurrency.lockutils [None req-aa49c567-2797-4148-b39d-0faf0afd3f1c tempest-AttachVolumeShelveTestJSON-385853788 tempest-AttachVolumeShelveTestJSON-385853788-project] Lock "1daf4f4c-0e4a-4779-b53a-78c48397ea2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120740) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 18:04:47.408521 dv-cinder-852009-8-iscsi devstack@n-api.service[120740]: DEBUG oslo_concurrency.lockutils [None req-aa49c567-2797-4148-b39d-0faf0afd3f1c tempest-AttachVolumeShelveTestJSON-385853788 tempest-AttachVolumeShelveTestJSON-385853788-project] Acquiring lock "1daf4f4c-0e4a-4779-b53a-78c48397ea2f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120740) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 18:04:47.409370 dv-cinder-852009-8-iscsi devstack@n-api.service[120740]: DEBUG oslo_concurrency.lockutils [None req-aa49c567-2797-4148-b39d-0faf0afd3f1c tempest-AttachVolumeShelveTestJSON-385853788 tempest-AttachVolumeShelveTestJSON-385853788-project] Lock "1daf4f4c-0e4a-4779-b53a-78c48397ea2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120740) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 18:04:47.409793 dv-cinder-852009-8-iscsi devstack@n-api.service[120740]: DEBUG oslo_concurrency.lockutils [None req-aa49c567-2797-4148-b39d-0faf0afd3f1c tempest-AttachVolumeShelveTestJSON-385853788 tempest-AttachVolumeShelveTestJSON-385853788-project] Lock "1daf4f4c-0e4a-4779-b53a-78c48397ea2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120740) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 18:04:47.431598 dv-cinder-852009-8-iscsi devstack@n-api.service[120740]: DEBUG dbcounter [-] [120740] Writing DB stats nova_cell1:SELECT=100 {{(pid=120740) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 18:04:47.546854 dv-cinder-852009-8-iscsi devstack@n-api.service[120740]: DEBUG nova.policy [None req-aa49c567-2797-4148-b39d-0faf0afd3f1c tempest-AttachVolumeShelveTestJSON-385853788 tempest-AttachVolumeShelveTestJSON-385853788-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e68ecd9b3ca643539b109f75bb242d6f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '75e14fd88bfb4cd896fa7b070a0fac47', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120740) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 18:04:47.556128 dv-cinder-852009-8-iscsi devstack@n-api.service[120740]: DEBUG nova.policy [None req-aa49c567-2797-4148-b39d-0faf0afd3f1c tempest-AttachVolumeShelveTestJSON-385853788 tempest-AttachVolumeShelveTestJSON-385853788-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'e68ecd9b3ca643539b109f75bb242d6f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '75e14fd88bfb4cd896fa7b070a0fac47', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120740) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 18:04:47.557702 dv-cinder-852009-8-iscsi devstack@n-api.service[120740]: DEBUG nova.policy [None req-aa49c567-2797-4148-b39d-0faf0afd3f1c tempest-AttachVolumeShelveTestJSON-385853788 tempest-AttachVolumeShelveTestJSON-385853788-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'e68ecd9b3ca643539b109f75bb242d6f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '75e14fd88bfb4cd896fa7b070a0fac47', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120740) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 18:04:47.558875 dv-cinder-852009-8-iscsi devstack@n-api.service[120740]: INFO nova.api.openstack.requestlog [None req-aa49c567-2797-4148-b39d-0faf0afd3f1c tempest-AttachVolumeShelveTestJSON-385853788 tempest-AttachVolumeShelveTestJSON-385853788-project] 10.222.0.43 "GET /compute/v2.1/servers/11d2616a-96f9-4a7a-aab8-219219986a8b" status: 200 len: 1807 microversion: 2.20 time: 0.169411 Sep 13 18:04:47.559428 dv-cinder-852009-8-iscsi devstack@n-api.service[120740]: [pid: 120740|app: 0|req: 183/356] 10.222.0.43 () {60 vars in 1277 bytes} [Tue Sep 13 18:04:47 2022] GET /compute/v2.1/servers/11d2616a-96f9-4a7a-aab8-219219986a8b => generated 1807 bytes in 171 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 13 18:04:48.584232 dv-cinder-852009-8-iscsi devstack@n-api.service[120741]: DEBUG nova.api.openstack.wsgi [None req-ccd369e3-15ed-4d4d-aa93-9ec318f18c02 tempest-AttachVolumeShelveTestJSON-385853788 tempest-AttachVolumeShelveTestJSON-385853788-project] Calling method '>' {{(pid=120741) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 18:04:48.584876 dv-cinder-852009-8-iscsi devstack@n-api.service[120741]: DEBUG nova.compute.api [None req-ccd369e3-15ed-4d4d-aa93-9ec318f18c02 tempest-AttachVolumeShelveTestJSON-385853788 tempest-AttachVolumeShelveTestJSON-385853788-project] [instance: 11d2616a-96f9-4a7a-aab8-219219986a8b] Fetching instance by UUID {{(pid=120741) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 18:04:48.591827 dv-cinder-852009-8-iscsi devstack@n-api.service[120741]: DEBUG oslo_concurrency.lockutils [None req-ccd369e3-15ed-4d4d-aa93-9ec318f18c02 tempest-AttachVolumeShelveTestJSON-385853788 tempest-AttachVolumeShelveTestJSON-385853788-project] Acquiring lock "1daf4f4c-0e4a-4779-b53a-78c48397ea2f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120741) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 18:04:48.592294 dv-cinder-852009-8-iscsi devstack@n-api.service[120741]: DEBUG oslo_concurrency.lockutils [None req-ccd369e3-15ed-4d4d-aa93-9ec318f18c02 tempest-AttachVolumeShelveTestJSON-385853788 tempest-AttachVolumeShelveTestJSON-385853788-project] Lock "1daf4f4c-0e4a-4779-b53a-78c48397ea2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120741) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 18:04:48.592752 dv-cinder-852009-8-iscsi devstack@n-api.service[120741]: DEBUG oslo_concurrency.lockutils [None req-ccd369e3-15ed-4d4d-aa93-9ec318f18c02 tempest-AttachVolumeShelveTestJSON-385853788 tempest-AttachVolumeShelveTestJSON-385853788-project] Lock "1daf4f4c-0e4a-4779-b53a-78c48397ea2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120741) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 18:04:48.593429 dv-cinder-852009-8-iscsi devstack@n-api.service[120741]: DEBUG oslo_concurrency.lockutils [None req-ccd369e3-15ed-4d4d-aa93-9ec318f18c02 tempest-AttachVolumeShelveTestJSON-385853788 tempest-AttachVolumeShelveTestJSON-385853788-project] Acquiring lock "1daf4f4c-0e4a-4779-b53a-78c48397ea2f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120741) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 18:04:48.593870 dv-cinder-852009-8-iscsi devstack@n-api.service[120741]: DEBUG oslo_concurrency.lockutils [None req-ccd369e3-15ed-4d4d-aa93-9ec318f18c02 tempest-AttachVolumeShelveTestJSON-385853788 tempest-AttachVolumeShelveTestJSON-385853788-project] Lock "1daf4f4c-0e4a-4779-b53a-78c48397ea2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120741) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 18:04:48.594281 dv-cinder-852009-8-iscsi devstack@n-api.service[120741]: DEBUG oslo_concurrency.lockutils [None req-ccd369e3-15ed-4d4d-aa93-9ec318f18c02 tempest-AttachVolumeShelveTestJSON-385853788 tempest-AttachVolumeShelveTestJSON-385853788-project] Lock "1daf4f4c-0e4a-4779-b53a-78c48397ea2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120741) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 18:04:48.735978 dv-cinder-852009-8-iscsi devstack@n-api.service[120741]: DEBUG nova.policy [None req-ccd369e3-15ed-4d4d-aa93-9ec318f18c02 tempest-AttachVolumeShelveTestJSON-385853788 tempest-AttachVolumeShelveTestJSON-385853788-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e68ecd9b3ca643539b109f75bb242d6f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '75e14fd88bfb4cd896fa7b070a0fac47', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120741) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 18:04:48.744862 dv-cinder-852009-8-iscsi devstack@n-api.service[120741]: DEBUG nova.policy [None req-ccd369e3-15ed-4d4d-aa93-9ec318f18c02 tempest-AttachVolumeShelveTestJSON-385853788 tempest-AttachVolumeShelveTestJSON-385853788-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'e68ecd9b3ca643539b109f75bb242d6f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '75e14fd88bfb4cd896fa7b070a0fac47', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120741) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 18:04:48.746323 dv-cinder-852009-8-iscsi devstack@n-api.service[120741]: DEBUG nova.policy [None req-ccd369e3-15ed-4d4d-aa93-9ec318f18c02 tempest-AttachVolumeShelveTestJSON-385853788 tempest-AttachVolumeShelveTestJSON-385853788-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'e68ecd9b3ca643539b109f75bb242d6f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '75e14fd88bfb4cd896fa7b070a0fac47', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120741) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 18:04:48.747489 dv-cinder-852009-8-iscsi devstack@n-api.service[120741]: INFO nova.api.openstack.requestlog [None req-ccd369e3-15ed-4d4d-aa93-9ec318f18c02 tempest-AttachVolumeShelveTestJSON-385853788 tempest-AttachVolumeShelveTestJSON-385853788-project] 10.222.0.43 "GET /compute/v2.1/servers/11d2616a-96f9-4a7a-aab8-219219986a8b" status: 200 len: 1794 microversion: 2.20 time: 0.167561 Sep 13 18:04:48.748038 dv-cinder-852009-8-iscsi devstack@n-api.service[120741]: [pid: 120741|app: 0|req: 174/357] 10.222.0.43 () {60 vars in 1277 bytes} [Tue Sep 13 18:04:48 2022] GET /compute/v2.1/servers/11d2616a-96f9-4a7a-aab8-219219986a8b => generated 1794 bytes in 169 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 13 18:05:07.178538 dv-cinder-852009-8-iscsi devstack@n-api.service[120740]: DEBUG nova.api.openstack.wsgi [None req-c232c7e6-34c8-4211-9c4c-fdcdaad6d45b tempest-ServerRescueNegativeTestJSON-412251590 tempest-ServerRescueNegativeTestJSON-412251590-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "ed90df9f-4d34-4ffc-8a94-069e3f8558c1"}} {{(pid=120740) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 13 18:05:07.181850 dv-cinder-852009-8-iscsi devstack@n-api.service[120740]: DEBUG nova.compute.api [None req-c232c7e6-34c8-4211-9c4c-fdcdaad6d45b tempest-ServerRescueNegativeTestJSON-412251590 tempest-ServerRescueNegativeTestJSON-412251590-project] [instance: e8ce7158-6b73-4586-9f78-8e821988e71c] Fetching instance by UUID {{(pid=120740) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 18:05:07.184491 dv-cinder-852009-8-iscsi devstack@n-api.service[120740]: DEBUG dbcounter [-] [120740] Writing DB stats nova_api:SELECT=25 {{(pid=120740) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 18:05:07.185393 dv-cinder-852009-8-iscsi devstack@n-api.service[120740]: DEBUG dbcounter [-] [120740] Writing DB stats nova_cell1:SELECT=2 {{(pid=120740) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 18:05:07.193379 dv-cinder-852009-8-iscsi devstack@n-api.service[120740]: DEBUG oslo_concurrency.lockutils [None req-c232c7e6-34c8-4211-9c4c-fdcdaad6d45b tempest-ServerRescueNegativeTestJSON-412251590 tempest-ServerRescueNegativeTestJSON-412251590-project] Acquiring lock "1daf4f4c-0e4a-4779-b53a-78c48397ea2f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120740) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 18:05:07.194064 dv-cinder-852009-8-iscsi devstack@n-api.service[120740]: DEBUG oslo_concurrency.lockutils [None req-c232c7e6-34c8-4211-9c4c-fdcdaad6d45b tempest-ServerRescueNegativeTestJSON-412251590 tempest-ServerRescueNegativeTestJSON-412251590-project] Lock "1daf4f4c-0e4a-4779-b53a-78c48397ea2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120740) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 18:05:07.194646 dv-cinder-852009-8-iscsi devstack@n-api.service[120740]: DEBUG oslo_concurrency.lockutils [None req-c232c7e6-34c8-4211-9c4c-fdcdaad6d45b tempest-ServerRescueNegativeTestJSON-412251590 tempest-ServerRescueNegativeTestJSON-412251590-project] Lock "1daf4f4c-0e4a-4779-b53a-78c48397ea2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120740) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 18:05:07.195593 dv-cinder-852009-8-iscsi devstack@n-api.service[120740]: DEBUG oslo_concurrency.lockutils [None req-c232c7e6-34c8-4211-9c4c-fdcdaad6d45b tempest-ServerRescueNegativeTestJSON-412251590 tempest-ServerRescueNegativeTestJSON-412251590-project] Acquiring lock "1daf4f4c-0e4a-4779-b53a-78c48397ea2f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120740) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 18:05:07.196207 dv-cinder-852009-8-iscsi devstack@n-api.service[120740]: DEBUG oslo_concurrency.lockutils [None req-c232c7e6-34c8-4211-9c4c-fdcdaad6d45b tempest-ServerRescueNegativeTestJSON-412251590 tempest-ServerRescueNegativeTestJSON-412251590-project] Lock "1daf4f4c-0e4a-4779-b53a-78c48397ea2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120740) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 18:05:07.196845 dv-cinder-852009-8-iscsi devstack@n-api.service[120740]: DEBUG oslo_concurrency.lockutils [None req-c232c7e6-34c8-4211-9c4c-fdcdaad6d45b tempest-ServerRescueNegativeTestJSON-412251590 tempest-ServerRescueNegativeTestJSON-412251590-project] Lock "1daf4f4c-0e4a-4779-b53a-78c48397ea2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120740) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 18:05:07.473462 dv-cinder-852009-8-iscsi devstack@n-api.service[120740]: INFO nova.api.openstack.requestlog [None req-c232c7e6-34c8-4211-9c4c-fdcdaad6d45b tempest-ServerRescueNegativeTestJSON-412251590 tempest-ServerRescueNegativeTestJSON-412251590-project] 10.222.0.43 "POST /compute/v2.1/servers/e8ce7158-6b73-4586-9f78-8e821988e71c/os-volume_attachments" status: 200 len: 194 microversion: 2.1 time: 0.300513 Sep 13 18:05:07.474074 dv-cinder-852009-8-iscsi devstack@n-api.service[120740]: [pid: 120740|app: 0|req: 184/358] 10.222.0.43 () {60 vars in 1323 bytes} [Tue Sep 13 18:05:07 2022] POST /compute/v2.1/servers/e8ce7158-6b73-4586-9f78-8e821988e71c/os-volume_attachments => generated 194 bytes in 302 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 13 18:05:12.142487 dv-cinder-852009-8-iscsi devstack@n-api.service[120741]: DEBUG nova.api.openstack.wsgi [None req-9a293711-36d3-446d-a56d-7e06b3ceff6a tempest-AttachVolumeTestJSON-555093534 tempest-AttachVolumeTestJSON-555093534-project] Calling method '>' {{(pid=120741) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 18:05:12.142986 dv-cinder-852009-8-iscsi devstack@n-api.service[120741]: DEBUG nova.compute.api [None req-9a293711-36d3-446d-a56d-7e06b3ceff6a tempest-AttachVolumeTestJSON-555093534 tempest-AttachVolumeTestJSON-555093534-project] [instance: b958d409-df20-44c6-aa0e-58cb0a482edf] Fetching instance by UUID {{(pid=120741) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 18:05:12.145340 dv-cinder-852009-8-iscsi devstack@n-api.service[120741]: DEBUG dbcounter [-] [120741] Writing DB stats nova_api:SELECT=3 {{(pid=120741) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 18:05:12.145988 dv-cinder-852009-8-iscsi devstack@n-api.service[120741]: DEBUG dbcounter [-] [120741] Writing DB stats nova_cell1:SELECT=32 {{(pid=120741) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 18:05:12.153810 dv-cinder-852009-8-iscsi devstack@n-api.service[120741]: DEBUG oslo_concurrency.lockutils [None req-9a293711-36d3-446d-a56d-7e06b3ceff6a tempest-AttachVolumeTestJSON-555093534 tempest-AttachVolumeTestJSON-555093534-project] Acquiring lock "1daf4f4c-0e4a-4779-b53a-78c48397ea2f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120741) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 18:05:12.154549 dv-cinder-852009-8-iscsi devstack@n-api.service[120741]: DEBUG oslo_concurrency.lockutils [None req-9a293711-36d3-446d-a56d-7e06b3ceff6a tempest-AttachVolumeTestJSON-555093534 tempest-AttachVolumeTestJSON-555093534-project] Lock "1daf4f4c-0e4a-4779-b53a-78c48397ea2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120741) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 18:05:12.155278 dv-cinder-852009-8-iscsi devstack@n-api.service[120741]: DEBUG oslo_concurrency.lockutils [None req-9a293711-36d3-446d-a56d-7e06b3ceff6a tempest-AttachVolumeTestJSON-555093534 tempest-AttachVolumeTestJSON-555093534-project] Lock "1daf4f4c-0e4a-4779-b53a-78c48397ea2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120741) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 18:05:12.156164 dv-cinder-852009-8-iscsi devstack@n-api.service[120741]: DEBUG oslo_concurrency.lockutils [None req-9a293711-36d3-446d-a56d-7e06b3ceff6a tempest-AttachVolumeTestJSON-555093534 tempest-AttachVolumeTestJSON-555093534-project] Acquiring lock "1daf4f4c-0e4a-4779-b53a-78c48397ea2f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120741) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 18:05:12.156851 dv-cinder-852009-8-iscsi devstack@n-api.service[120741]: DEBUG oslo_concurrency.lockutils [None req-9a293711-36d3-446d-a56d-7e06b3ceff6a tempest-AttachVolumeTestJSON-555093534 tempest-AttachVolumeTestJSON-555093534-project] Lock "1daf4f4c-0e4a-4779-b53a-78c48397ea2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120741) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 18:05:12.157399 dv-cinder-852009-8-iscsi devstack@n-api.service[120741]: DEBUG oslo_concurrency.lockutils [None req-9a293711-36d3-446d-a56d-7e06b3ceff6a tempest-AttachVolumeTestJSON-555093534 tempest-AttachVolumeTestJSON-555093534-project] Lock "1daf4f4c-0e4a-4779-b53a-78c48397ea2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120741) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 18:05:12.319693 dv-cinder-852009-8-iscsi devstack@n-api.service[120741]: DEBUG nova.objects.instance [None req-9a293711-36d3-446d-a56d-7e06b3ceff6a tempest-AttachVolumeTestJSON-555093534 tempest-AttachVolumeTestJSON-555093534-project] Lazy-loading 'services' on Instance uuid b958d409-df20-44c6-aa0e-58cb0a482edf {{(pid=120741) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Sep 13 18:05:12.460064 dv-cinder-852009-8-iscsi devstack@n-api.service[120741]: INFO nova.api.openstack.requestlog [None req-9a293711-36d3-446d-a56d-7e06b3ceff6a tempest-AttachVolumeTestJSON-555093534 tempest-AttachVolumeTestJSON-555093534-project] 10.222.0.43 "DELETE /compute/v2.1/servers/b958d409-df20-44c6-aa0e-58cb0a482edf/os-volume_attachments/b2ed4383-e3fc-44cc-916c-b102e81a7295" status: 202 len: 0 microversion: 2.1 time: 0.322041 Sep 13 18:05:12.467000 dv-cinder-852009-8-iscsi devstack@n-api.service[120741]: [pid: 120741|app: 0|req: 175/359] 10.222.0.43 () {58 vars in 1416 bytes} [Tue Sep 13 18:05:12 2022] DELETE /compute/v2.1/servers/b958d409-df20-44c6-aa0e-58cb0a482edf/os-volume_attachments/b2ed4383-e3fc-44cc-916c-b102e81a7295 => generated 0 bytes in 327 msecs (HTTP/1.1 202) 9 headers in 361 bytes (2 switches on core 0) Sep 13 18:05:19.515960 dv-cinder-852009-8-iscsi devstack@n-api.service[120740]: DEBUG dbcounter [-] [120740] Writing DB stats nova_api:SELECT=2 {{(pid=120740) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 18:05:19.518135 dv-cinder-852009-8-iscsi devstack@n-api.service[120740]: DEBUG dbcounter [-] [120740] Writing DB stats nova_cell1:SELECT=11,nova_cell1:UPDATE=2,nova_cell1:INSERT=1 {{(pid=120740) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 18:05:19.523445 dv-cinder-852009-8-iscsi devstack@n-api.service[120740]: DEBUG nova.api.openstack.wsgi [None req-17e2331e-75e2-481e-9d96-44bb76213aab tempest-ServerRescueNegativeTestJSON-412251590 tempest-ServerRescueNegativeTestJSON-412251590-project] Action: 'action', calling method: >, body: {"rescue": {"adminPass": "***"}} {{(pid=120740) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 13 18:05:19.525973 dv-cinder-852009-8-iscsi devstack@n-api.service[120740]: DEBUG nova.compute.api [None req-17e2331e-75e2-481e-9d96-44bb76213aab tempest-ServerRescueNegativeTestJSON-412251590 tempest-ServerRescueNegativeTestJSON-412251590-project] [instance: e8ce7158-6b73-4586-9f78-8e821988e71c] Fetching instance by UUID {{(pid=120740) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 18:05:19.533188 dv-cinder-852009-8-iscsi devstack@n-api.service[120740]: DEBUG oslo_concurrency.lockutils [None req-17e2331e-75e2-481e-9d96-44bb76213aab tempest-ServerRescueNegativeTestJSON-412251590 tempest-ServerRescueNegativeTestJSON-412251590-project] Acquiring lock "1daf4f4c-0e4a-4779-b53a-78c48397ea2f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120740) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 18:05:19.533875 dv-cinder-852009-8-iscsi devstack@n-api.service[120740]: DEBUG oslo_concurrency.lockutils [None req-17e2331e-75e2-481e-9d96-44bb76213aab tempest-ServerRescueNegativeTestJSON-412251590 tempest-ServerRescueNegativeTestJSON-412251590-project] Lock "1daf4f4c-0e4a-4779-b53a-78c48397ea2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120740) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 18:05:19.534489 dv-cinder-852009-8-iscsi devstack@n-api.service[120740]: DEBUG oslo_concurrency.lockutils [None req-17e2331e-75e2-481e-9d96-44bb76213aab tempest-ServerRescueNegativeTestJSON-412251590 tempest-ServerRescueNegativeTestJSON-412251590-project] Lock "1daf4f4c-0e4a-4779-b53a-78c48397ea2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120740) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 18:05:19.535371 dv-cinder-852009-8-iscsi devstack@n-api.service[120740]: DEBUG oslo_concurrency.lockutils [None req-17e2331e-75e2-481e-9d96-44bb76213aab tempest-ServerRescueNegativeTestJSON-412251590 tempest-ServerRescueNegativeTestJSON-412251590-project] Acquiring lock "1daf4f4c-0e4a-4779-b53a-78c48397ea2f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120740) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 18:05:19.535960 dv-cinder-852009-8-iscsi devstack@n-api.service[120740]: DEBUG oslo_concurrency.lockutils [None req-17e2331e-75e2-481e-9d96-44bb76213aab tempest-ServerRescueNegativeTestJSON-412251590 tempest-ServerRescueNegativeTestJSON-412251590-project] Lock "1daf4f4c-0e4a-4779-b53a-78c48397ea2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120740) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 18:05:19.536557 dv-cinder-852009-8-iscsi devstack@n-api.service[120740]: DEBUG oslo_concurrency.lockutils [None req-17e2331e-75e2-481e-9d96-44bb76213aab tempest-ServerRescueNegativeTestJSON-412251590 tempest-ServerRescueNegativeTestJSON-412251590-project] Lock "1daf4f4c-0e4a-4779-b53a-78c48397ea2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120740) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 18:05:19.585655 dv-cinder-852009-8-iscsi devstack@n-api.service[120740]: DEBUG nova.objects.instance [None req-17e2331e-75e2-481e-9d96-44bb76213aab tempest-ServerRescueNegativeTestJSON-412251590 tempest-ServerRescueNegativeTestJSON-412251590-project] Lazy-loading 'flavor' on Instance uuid e8ce7158-6b73-4586-9f78-8e821988e71c {{(pid=120740) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Sep 13 18:05:19.785652 dv-cinder-852009-8-iscsi devstack@n-api.service[120740]: INFO nova.api.openstack.requestlog [None req-17e2331e-75e2-481e-9d96-44bb76213aab tempest-ServerRescueNegativeTestJSON-412251590 tempest-ServerRescueNegativeTestJSON-412251590-project] 10.222.0.43 "POST /compute/v2.1/servers/e8ce7158-6b73-4586-9f78-8e821988e71c/action" status: 200 len: 32 microversion: 2.1 time: 0.273185 Sep 13 18:05:19.787200 dv-cinder-852009-8-iscsi devstack@n-api.service[120740]: [pid: 120740|app: 0|req: 185/360] 10.222.0.43 () {60 vars in 1278 bytes} [Tue Sep 13 18:05:19 2022] POST /compute/v2.1/servers/e8ce7158-6b73-4586-9f78-8e821988e71c/action => generated 32 bytes in 276 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Sep 13 18:05:19.796989 dv-cinder-852009-8-iscsi devstack@n-api.service[120741]: DEBUG nova.api.openstack.wsgi [None req-22c8dd52-10fc-4d37-a592-b0251c1d5f39 tempest-ServerRescueNegativeTestJSON-412251590 tempest-ServerRescueNegativeTestJSON-412251590-project] Calling method '>' {{(pid=120741) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 18:05:19.798292 dv-cinder-852009-8-iscsi devstack@n-api.service[120741]: DEBUG nova.compute.api [None req-22c8dd52-10fc-4d37-a592-b0251c1d5f39 tempest-ServerRescueNegativeTestJSON-412251590 tempest-ServerRescueNegativeTestJSON-412251590-project] [instance: e8ce7158-6b73-4586-9f78-8e821988e71c] Fetching instance by UUID {{(pid=120741) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 18:05:19.812726 dv-cinder-852009-8-iscsi devstack@n-api.service[120741]: DEBUG oslo_concurrency.lockutils [None req-22c8dd52-10fc-4d37-a592-b0251c1d5f39 tempest-ServerRescueNegativeTestJSON-412251590 tempest-ServerRescueNegativeTestJSON-412251590-project] Acquiring lock "1daf4f4c-0e4a-4779-b53a-78c48397ea2f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120741) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 18:05:19.813728 dv-cinder-852009-8-iscsi devstack@n-api.service[120741]: DEBUG oslo_concurrency.lockutils [None req-22c8dd52-10fc-4d37-a592-b0251c1d5f39 tempest-ServerRescueNegativeTestJSON-412251590 tempest-ServerRescueNegativeTestJSON-412251590-project] Lock "1daf4f4c-0e4a-4779-b53a-78c48397ea2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120741) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 18:05:19.820756 dv-cinder-852009-8-iscsi devstack@n-api.service[120741]: DEBUG oslo_concurrency.lockutils [None req-22c8dd52-10fc-4d37-a592-b0251c1d5f39 tempest-ServerRescueNegativeTestJSON-412251590 tempest-ServerRescueNegativeTestJSON-412251590-project] Lock "1daf4f4c-0e4a-4779-b53a-78c48397ea2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120741) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 18:05:19.821611 dv-cinder-852009-8-iscsi devstack@n-api.service[120741]: DEBUG oslo_concurrency.lockutils [None req-22c8dd52-10fc-4d37-a592-b0251c1d5f39 tempest-ServerRescueNegativeTestJSON-412251590 tempest-ServerRescueNegativeTestJSON-412251590-project] Acquiring lock "1daf4f4c-0e4a-4779-b53a-78c48397ea2f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120741) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 18:05:19.822100 dv-cinder-852009-8-iscsi devstack@n-api.service[120741]: DEBUG oslo_concurrency.lockutils [None req-22c8dd52-10fc-4d37-a592-b0251c1d5f39 tempest-ServerRescueNegativeTestJSON-412251590 tempest-ServerRescueNegativeTestJSON-412251590-project] Lock "1daf4f4c-0e4a-4779-b53a-78c48397ea2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120741) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 18:05:19.822580 dv-cinder-852009-8-iscsi devstack@n-api.service[120741]: DEBUG oslo_concurrency.lockutils [None req-22c8dd52-10fc-4d37-a592-b0251c1d5f39 tempest-ServerRescueNegativeTestJSON-412251590 tempest-ServerRescueNegativeTestJSON-412251590-project] Lock "1daf4f4c-0e4a-4779-b53a-78c48397ea2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120741) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 18:05:20.007363 dv-cinder-852009-8-iscsi devstack@n-api.service[120741]: DEBUG nova.policy [None req-22c8dd52-10fc-4d37-a592-b0251c1d5f39 tempest-ServerRescueNegativeTestJSON-412251590 tempest-ServerRescueNegativeTestJSON-412251590-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '60800cf2774e409d9c1b6f4992669991', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2eae4acecf6c4961830ead78d71b2ad3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120741) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 18:05:20.016112 dv-cinder-852009-8-iscsi devstack@n-api.service[120741]: INFO nova.api.openstack.requestlog [None req-22c8dd52-10fc-4d37-a592-b0251c1d5f39 tempest-ServerRescueNegativeTestJSON-412251590 tempest-ServerRescueNegativeTestJSON-412251590-project] 10.222.0.43 "GET /compute/v2.1/servers/e8ce7158-6b73-4586-9f78-8e821988e71c" status: 200 len: 1736 microversion: 2.1 time: 0.223447 Sep 13 18:05:20.017082 dv-cinder-852009-8-iscsi devstack@n-api.service[120741]: [pid: 120741|app: 0|req: 176/361] 10.222.0.43 () {58 vars in 1236 bytes} [Tue Sep 13 18:05:19 2022] GET /compute/v2.1/servers/e8ce7158-6b73-4586-9f78-8e821988e71c => generated 1736 bytes in 225 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 13 18:05:20.115323 dv-cinder-852009-8-iscsi devstack@n-api.service[120740]: DEBUG nova.api.openstack.wsgi [None req-3770fd97-08fb-46b6-9b76-eec3997a0b48 tempest-AttachVolumeTestJSON-555093534 tempest-AttachVolumeTestJSON-555093534-project] Action: 'action', calling method: >, body: {"os-stop": {}} {{(pid=120740) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 13 18:05:20.121751 dv-cinder-852009-8-iscsi devstack@n-api.service[120740]: DEBUG oslo_concurrency.lockutils [None req-3770fd97-08fb-46b6-9b76-eec3997a0b48 tempest-AttachVolumeTestJSON-555093534 tempest-AttachVolumeTestJSON-555093534-project] Acquiring lock "1daf4f4c-0e4a-4779-b53a-78c48397ea2f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120740) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 18:05:20.122245 dv-cinder-852009-8-iscsi devstack@n-api.service[120740]: DEBUG oslo_concurrency.lockutils [None req-3770fd97-08fb-46b6-9b76-eec3997a0b48 tempest-AttachVolumeTestJSON-555093534 tempest-AttachVolumeTestJSON-555093534-project] Lock "1daf4f4c-0e4a-4779-b53a-78c48397ea2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120740) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 18:05:20.122687 dv-cinder-852009-8-iscsi devstack@n-api.service[120740]: DEBUG oslo_concurrency.lockutils [None req-3770fd97-08fb-46b6-9b76-eec3997a0b48 tempest-AttachVolumeTestJSON-555093534 tempest-AttachVolumeTestJSON-555093534-project] Lock "1daf4f4c-0e4a-4779-b53a-78c48397ea2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120740) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 18:05:20.212284 dv-cinder-852009-8-iscsi devstack@n-api.service[120740]: DEBUG nova.compute.api [None req-3770fd97-08fb-46b6-9b76-eec3997a0b48 tempest-AttachVolumeTestJSON-555093534 tempest-AttachVolumeTestJSON-555093534-project] [instance: b958d409-df20-44c6-aa0e-58cb0a482edf] Going to try to stop instance {{(pid=120740) force_stop /opt/stack/nova/nova/compute/api.py:2762}} Sep 13 18:05:20.296738 dv-cinder-852009-8-iscsi devstack@n-api.service[120740]: INFO nova.api.openstack.requestlog [None req-3770fd97-08fb-46b6-9b76-eec3997a0b48 tempest-AttachVolumeTestJSON-555093534 tempest-AttachVolumeTestJSON-555093534-project] 10.222.0.43 "POST /compute/v2.1/servers/b958d409-df20-44c6-aa0e-58cb0a482edf/action" status: 202 len: 0 microversion: 2.1 time: 0.186501 Sep 13 18:05:20.306459 dv-cinder-852009-8-iscsi devstack@n-api.service[120741]: DEBUG nova.api.openstack.wsgi [None req-8786f4ab-8774-4373-8597-12620ad71a73 tempest-AttachVolumeTestJSON-555093534 tempest-AttachVolumeTestJSON-555093534-project] Calling method '>' {{(pid=120741) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 18:05:20.307393 dv-cinder-852009-8-iscsi devstack@n-api.service[120741]: DEBUG nova.compute.api [None req-8786f4ab-8774-4373-8597-12620ad71a73 tempest-AttachVolumeTestJSON-555093534 tempest-AttachVolumeTestJSON-555093534-project] [instance: b958d409-df20-44c6-aa0e-58cb0a482edf] Fetching instance by UUID {{(pid=120741) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 18:05:20.311225 dv-cinder-852009-8-iscsi devstack@n-api.service[120740]: [pid: 120740|app: 0|req: 186/362] 10.222.0.43 () {60 vars in 1278 bytes} [Tue Sep 13 18:05:20 2022] POST /compute/v2.1/servers/b958d409-df20-44c6-aa0e-58cb0a482edf/action => generated 0 bytes in 199 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Sep 13 18:05:20.320836 dv-cinder-852009-8-iscsi devstack@n-api.service[120741]: DEBUG oslo_concurrency.lockutils [None req-8786f4ab-8774-4373-8597-12620ad71a73 tempest-AttachVolumeTestJSON-555093534 tempest-AttachVolumeTestJSON-555093534-project] Acquiring lock "1daf4f4c-0e4a-4779-b53a-78c48397ea2f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120741) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 18:05:20.321650 dv-cinder-852009-8-iscsi devstack@n-api.service[120741]: DEBUG oslo_concurrency.lockutils [None req-8786f4ab-8774-4373-8597-12620ad71a73 tempest-AttachVolumeTestJSON-555093534 tempest-AttachVolumeTestJSON-555093534-project] Lock "1daf4f4c-0e4a-4779-b53a-78c48397ea2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120741) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 18:05:20.322294 dv-cinder-852009-8-iscsi devstack@n-api.service[120741]: DEBUG oslo_concurrency.lockutils [None req-8786f4ab-8774-4373-8597-12620ad71a73 tempest-AttachVolumeTestJSON-555093534 tempest-AttachVolumeTestJSON-555093534-project] Lock "1daf4f4c-0e4a-4779-b53a-78c48397ea2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120741) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 18:05:20.323316 dv-cinder-852009-8-iscsi devstack@n-api.service[120741]: DEBUG oslo_concurrency.lockutils [None req-8786f4ab-8774-4373-8597-12620ad71a73 tempest-AttachVolumeTestJSON-555093534 tempest-AttachVolumeTestJSON-555093534-project] Acquiring lock "1daf4f4c-0e4a-4779-b53a-78c48397ea2f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120741) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 18:05:20.323927 dv-cinder-852009-8-iscsi devstack@n-api.service[120741]: DEBUG oslo_concurrency.lockutils [None req-8786f4ab-8774-4373-8597-12620ad71a73 tempest-AttachVolumeTestJSON-555093534 tempest-AttachVolumeTestJSON-555093534-project] Lock "1daf4f4c-0e4a-4779-b53a-78c48397ea2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120741) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 18:05:20.324379 dv-cinder-852009-8-iscsi devstack@n-api.service[120741]: DEBUG oslo_concurrency.lockutils [None req-8786f4ab-8774-4373-8597-12620ad71a73 tempest-AttachVolumeTestJSON-555093534 tempest-AttachVolumeTestJSON-555093534-project] Lock "1daf4f4c-0e4a-4779-b53a-78c48397ea2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120741) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 18:05:20.549494 dv-cinder-852009-8-iscsi devstack@n-api.service[120741]: DEBUG nova.policy [None req-8786f4ab-8774-4373-8597-12620ad71a73 tempest-AttachVolumeTestJSON-555093534 tempest-AttachVolumeTestJSON-555093534-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0625b3113ce044bbac4f6142eaade11c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a279fcbf274c4704a31a2b95061e1469', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120741) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 18:05:20.559028 dv-cinder-852009-8-iscsi devstack@n-api.service[120741]: INFO nova.api.openstack.requestlog [None req-8786f4ab-8774-4373-8597-12620ad71a73 tempest-AttachVolumeTestJSON-555093534 tempest-AttachVolumeTestJSON-555093534-project] 10.222.0.43 "GET /compute/v2.1/servers/b958d409-df20-44c6-aa0e-58cb0a482edf" status: 200 len: 1678 microversion: 2.1 time: 0.255868 Sep 13 18:05:20.560306 dv-cinder-852009-8-iscsi devstack@n-api.service[120741]: [pid: 120741|app: 0|req: 177/363] 10.222.0.43 () {58 vars in 1236 bytes} [Tue Sep 13 18:05:20 2022] GET /compute/v2.1/servers/b958d409-df20-44c6-aa0e-58cb0a482edf => generated 1678 bytes in 258 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 13 18:05:21.041601 dv-cinder-852009-8-iscsi devstack@n-api.service[120740]: DEBUG nova.api.openstack.wsgi [None req-19c25fb5-0a5c-4dfc-aaee-e84bf7a37ad7 tempest-ServerRescueNegativeTestJSON-412251590 tempest-ServerRescueNegativeTestJSON-412251590-project] Calling method '>' {{(pid=120740) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 18:05:21.042352 dv-cinder-852009-8-iscsi devstack@n-api.service[120740]: DEBUG nova.compute.api [None req-19c25fb5-0a5c-4dfc-aaee-e84bf7a37ad7 tempest-ServerRescueNegativeTestJSON-412251590 tempest-ServerRescueNegativeTestJSON-412251590-project] [instance: e8ce7158-6b73-4586-9f78-8e821988e71c] Fetching instance by UUID {{(pid=120740) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 18:05:21.051860 dv-cinder-852009-8-iscsi devstack@n-api.service[120740]: DEBUG oslo_concurrency.lockutils [None req-19c25fb5-0a5c-4dfc-aaee-e84bf7a37ad7 tempest-ServerRescueNegativeTestJSON-412251590 tempest-ServerRescueNegativeTestJSON-412251590-project] Acquiring lock "1daf4f4c-0e4a-4779-b53a-78c48397ea2f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120740) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 18:05:21.052359 dv-cinder-852009-8-iscsi devstack@n-api.service[120740]: DEBUG oslo_concurrency.lockutils [None req-19c25fb5-0a5c-4dfc-aaee-e84bf7a37ad7 tempest-ServerRescueNegativeTestJSON-412251590 tempest-ServerRescueNegativeTestJSON-412251590-project] Lock "1daf4f4c-0e4a-4779-b53a-78c48397ea2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120740) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 18:05:21.052844 dv-cinder-852009-8-iscsi devstack@n-api.service[120740]: DEBUG oslo_concurrency.lockutils [None req-19c25fb5-0a5c-4dfc-aaee-e84bf7a37ad7 tempest-ServerRescueNegativeTestJSON-412251590 tempest-ServerRescueNegativeTestJSON-412251590-project] Lock "1daf4f4c-0e4a-4779-b53a-78c48397ea2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120740) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 18:05:21.053534 dv-cinder-852009-8-iscsi devstack@n-api.service[120740]: DEBUG oslo_concurrency.lockutils [None req-19c25fb5-0a5c-4dfc-aaee-e84bf7a37ad7 tempest-ServerRescueNegativeTestJSON-412251590 tempest-ServerRescueNegativeTestJSON-412251590-project] Acquiring lock "1daf4f4c-0e4a-4779-b53a-78c48397ea2f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120740) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 18:05:21.053977 dv-cinder-852009-8-iscsi devstack@n-api.service[120740]: DEBUG oslo_concurrency.lockutils [None req-19c25fb5-0a5c-4dfc-aaee-e84bf7a37ad7 tempest-ServerRescueNegativeTestJSON-412251590 tempest-ServerRescueNegativeTestJSON-412251590-project] Lock "1daf4f4c-0e4a-4779-b53a-78c48397ea2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120740) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 18:05:21.054600 dv-cinder-852009-8-iscsi devstack@n-api.service[120740]: DEBUG oslo_concurrency.lockutils [None req-19c25fb5-0a5c-4dfc-aaee-e84bf7a37ad7 tempest-ServerRescueNegativeTestJSON-412251590 tempest-ServerRescueNegativeTestJSON-412251590-project] Lock "1daf4f4c-0e4a-4779-b53a-78c48397ea2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120740) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 18:05:21.196577 dv-cinder-852009-8-iscsi devstack@n-api.service[120740]: DEBUG nova.policy [None req-19c25fb5-0a5c-4dfc-aaee-e84bf7a37ad7 tempest-ServerRescueNegativeTestJSON-412251590 tempest-ServerRescueNegativeTestJSON-412251590-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '60800cf2774e409d9c1b6f4992669991', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2eae4acecf6c4961830ead78d71b2ad3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120740) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 18:05:21.206925 dv-cinder-852009-8-iscsi devstack@n-api.service[120740]: INFO nova.api.openstack.requestlog [None req-19c25fb5-0a5c-4dfc-aaee-e84bf7a37ad7 tempest-ServerRescueNegativeTestJSON-412251590 tempest-ServerRescueNegativeTestJSON-412251590-project] 10.222.0.43 "GET /compute/v2.1/servers/e8ce7158-6b73-4586-9f78-8e821988e71c" status: 200 len: 1736 microversion: 2.1 time: 0.169252 Sep 13 18:05:21.207956 dv-cinder-852009-8-iscsi devstack@n-api.service[120740]: [pid: 120740|app: 0|req: 187/364] 10.222.0.43 () {58 vars in 1236 bytes} [Tue Sep 13 18:05:21 2022] GET /compute/v2.1/servers/e8ce7158-6b73-4586-9f78-8e821988e71c => generated 1736 bytes in 172 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 13 18:05:21.584861 dv-cinder-852009-8-iscsi devstack@n-api.service[120741]: DEBUG nova.api.openstack.wsgi [None req-ec2b16e3-fdc2-4406-9419-d532116decd9 tempest-AttachVolumeTestJSON-555093534 tempest-AttachVolumeTestJSON-555093534-project] Calling method '>' {{(pid=120741) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 18:05:21.586010 dv-cinder-852009-8-iscsi devstack@n-api.service[120741]: DEBUG nova.compute.api [None req-ec2b16e3-fdc2-4406-9419-d532116decd9 tempest-AttachVolumeTestJSON-555093534 tempest-AttachVolumeTestJSON-555093534-project] [instance: b958d409-df20-44c6-aa0e-58cb0a482edf] Fetching instance by UUID {{(pid=120741) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 18:05:21.593132 dv-cinder-852009-8-iscsi devstack@n-api.service[120741]: DEBUG oslo_concurrency.lockutils [None req-ec2b16e3-fdc2-4406-9419-d532116decd9 tempest-AttachVolumeTestJSON-555093534 tempest-AttachVolumeTestJSON-555093534-project] Acquiring lock "1daf4f4c-0e4a-4779-b53a-78c48397ea2f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120741) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 18:05:21.593736 dv-cinder-852009-8-iscsi devstack@n-api.service[120741]: DEBUG oslo_concurrency.lockutils [None req-ec2b16e3-fdc2-4406-9419-d532116decd9 tempest-AttachVolumeTestJSON-555093534 tempest-AttachVolumeTestJSON-555093534-project] Lock "1daf4f4c-0e4a-4779-b53a-78c48397ea2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120741) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 18:05:21.594427 dv-cinder-852009-8-iscsi devstack@n-api.service[120741]: DEBUG oslo_concurrency.lockutils [None req-ec2b16e3-fdc2-4406-9419-d532116decd9 tempest-AttachVolumeTestJSON-555093534 tempest-AttachVolumeTestJSON-555093534-project] Lock "1daf4f4c-0e4a-4779-b53a-78c48397ea2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120741) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 18:05:21.595553 dv-cinder-852009-8-iscsi devstack@n-api.service[120741]: DEBUG oslo_concurrency.lockutils [None req-ec2b16e3-fdc2-4406-9419-d532116decd9 tempest-AttachVolumeTestJSON-555093534 tempest-AttachVolumeTestJSON-555093534-project] Acquiring lock "1daf4f4c-0e4a-4779-b53a-78c48397ea2f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120741) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 18:05:21.596217 dv-cinder-852009-8-iscsi devstack@n-api.service[120741]: DEBUG oslo_concurrency.lockutils [None req-ec2b16e3-fdc2-4406-9419-d532116decd9 tempest-AttachVolumeTestJSON-555093534 tempest-AttachVolumeTestJSON-555093534-project] Lock "1daf4f4c-0e4a-4779-b53a-78c48397ea2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120741) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 18:05:21.596809 dv-cinder-852009-8-iscsi devstack@n-api.service[120741]: DEBUG oslo_concurrency.lockutils [None req-ec2b16e3-fdc2-4406-9419-d532116decd9 tempest-AttachVolumeTestJSON-555093534 tempest-AttachVolumeTestJSON-555093534-project] Lock "1daf4f4c-0e4a-4779-b53a-78c48397ea2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120741) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 18:05:21.745809 dv-cinder-852009-8-iscsi devstack@n-api.service[120741]: DEBUG nova.policy [None req-ec2b16e3-fdc2-4406-9419-d532116decd9 tempest-AttachVolumeTestJSON-555093534 tempest-AttachVolumeTestJSON-555093534-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0625b3113ce044bbac4f6142eaade11c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a279fcbf274c4704a31a2b95061e1469', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120741) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 18:05:21.754684 dv-cinder-852009-8-iscsi devstack@n-api.service[120741]: INFO nova.api.openstack.requestlog [None req-ec2b16e3-fdc2-4406-9419-d532116decd9 tempest-AttachVolumeTestJSON-555093534 tempest-AttachVolumeTestJSON-555093534-project] 10.222.0.43 "GET /compute/v2.1/servers/b958d409-df20-44c6-aa0e-58cb0a482edf" status: 200 len: 1678 microversion: 2.1 time: 0.174799 Sep 13 18:05:21.755805 dv-cinder-852009-8-iscsi devstack@n-api.service[120741]: [pid: 120741|app: 0|req: 178/365] 10.222.0.43 () {58 vars in 1236 bytes} [Tue Sep 13 18:05:21 2022] GET /compute/v2.1/servers/b958d409-df20-44c6-aa0e-58cb0a482edf => generated 1678 bytes in 177 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 13 18:05:22.239233 dv-cinder-852009-8-iscsi devstack@n-api.service[120740]: DEBUG nova.api.openstack.wsgi [None req-f3594573-f8e9-4cb4-b910-fd6b48f1a19d tempest-ServerRescueNegativeTestJSON-412251590 tempest-ServerRescueNegativeTestJSON-412251590-project] Calling method '>' {{(pid=120740) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 18:05:22.240477 dv-cinder-852009-8-iscsi devstack@n-api.service[120740]: DEBUG nova.compute.api [None req-f3594573-f8e9-4cb4-b910-fd6b48f1a19d tempest-ServerRescueNegativeTestJSON-412251590 tempest-ServerRescueNegativeTestJSON-412251590-project] [instance: e8ce7158-6b73-4586-9f78-8e821988e71c] Fetching instance by UUID {{(pid=120740) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 18:05:22.253087 dv-cinder-852009-8-iscsi devstack@n-api.service[120740]: DEBUG oslo_concurrency.lockutils [None req-f3594573-f8e9-4cb4-b910-fd6b48f1a19d tempest-ServerRescueNegativeTestJSON-412251590 tempest-ServerRescueNegativeTestJSON-412251590-project] Acquiring lock "1daf4f4c-0e4a-4779-b53a-78c48397ea2f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120740) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 18:05:22.253582 dv-cinder-852009-8-iscsi devstack@n-api.service[120740]: DEBUG oslo_concurrency.lockutils [None req-f3594573-f8e9-4cb4-b910-fd6b48f1a19d tempest-ServerRescueNegativeTestJSON-412251590 tempest-ServerRescueNegativeTestJSON-412251590-project] Lock "1daf4f4c-0e4a-4779-b53a-78c48397ea2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120740) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 18:05:22.254045 dv-cinder-852009-8-iscsi devstack@n-api.service[120740]: DEBUG oslo_concurrency.lockutils [None req-f3594573-f8e9-4cb4-b910-fd6b48f1a19d tempest-ServerRescueNegativeTestJSON-412251590 tempest-ServerRescueNegativeTestJSON-412251590-project] Lock "1daf4f4c-0e4a-4779-b53a-78c48397ea2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120740) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 18:05:22.258479 dv-cinder-852009-8-iscsi devstack@n-api.service[120740]: DEBUG oslo_concurrency.lockutils [None req-f3594573-f8e9-4cb4-b910-fd6b48f1a19d tempest-ServerRescueNegativeTestJSON-412251590 tempest-ServerRescueNegativeTestJSON-412251590-project] Acquiring lock "1daf4f4c-0e4a-4779-b53a-78c48397ea2f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120740) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 18:05:22.259005 dv-cinder-852009-8-iscsi devstack@n-api.service[120740]: DEBUG oslo_concurrency.lockutils [None req-f3594573-f8e9-4cb4-b910-fd6b48f1a19d tempest-ServerRescueNegativeTestJSON-412251590 tempest-ServerRescueNegativeTestJSON-412251590-project] Lock "1daf4f4c-0e4a-4779-b53a-78c48397ea2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120740) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 18:05:22.259563 dv-cinder-852009-8-iscsi devstack@n-api.service[120740]: DEBUG oslo_concurrency.lockutils [None req-f3594573-f8e9-4cb4-b910-fd6b48f1a19d tempest-ServerRescueNegativeTestJSON-412251590 tempest-ServerRescueNegativeTestJSON-412251590-project] Lock "1daf4f4c-0e4a-4779-b53a-78c48397ea2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120740) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 18:05:22.434171 dv-cinder-852009-8-iscsi devstack@n-api.service[120740]: DEBUG nova.policy [None req-f3594573-f8e9-4cb4-b910-fd6b48f1a19d tempest-ServerRescueNegativeTestJSON-412251590 tempest-ServerRescueNegativeTestJSON-412251590-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '60800cf2774e409d9c1b6f4992669991', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2eae4acecf6c4961830ead78d71b2ad3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120740) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 18:05:22.442956 dv-cinder-852009-8-iscsi devstack@n-api.service[120740]: INFO nova.api.openstack.requestlog [None req-f3594573-f8e9-4cb4-b910-fd6b48f1a19d tempest-ServerRescueNegativeTestJSON-412251590 tempest-ServerRescueNegativeTestJSON-412251590-project] 10.222.0.43 "GET /compute/v2.1/servers/e8ce7158-6b73-4586-9f78-8e821988e71c" status: 200 len: 1736 microversion: 2.1 time: 0.212679 Sep 13 18:05:22.445324 dv-cinder-852009-8-iscsi devstack@n-api.service[120740]: [pid: 120740|app: 0|req: 188/366] 10.222.0.43 () {58 vars in 1236 bytes} [Tue Sep 13 18:05:22 2022] GET /compute/v2.1/servers/e8ce7158-6b73-4586-9f78-8e821988e71c => generated 1736 bytes in 216 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 13 18:05:22.785087 dv-cinder-852009-8-iscsi devstack@n-api.service[120741]: DEBUG nova.api.openstack.wsgi [None req-6c8e77b4-f669-4624-a47e-766d03844439 tempest-AttachVolumeTestJSON-555093534 tempest-AttachVolumeTestJSON-555093534-project] Calling method '>' {{(pid=120741) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 18:05:22.786629 dv-cinder-852009-8-iscsi devstack@n-api.service[120741]: DEBUG nova.compute.api [None req-6c8e77b4-f669-4624-a47e-766d03844439 tempest-AttachVolumeTestJSON-555093534 tempest-AttachVolumeTestJSON-555093534-project] [instance: b958d409-df20-44c6-aa0e-58cb0a482edf] Fetching instance by UUID {{(pid=120741) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 18:05:22.795866 dv-cinder-852009-8-iscsi devstack@n-api.service[120741]: DEBUG oslo_concurrency.lockutils [None req-6c8e77b4-f669-4624-a47e-766d03844439 tempest-AttachVolumeTestJSON-555093534 tempest-AttachVolumeTestJSON-555093534-project] Acquiring lock "1daf4f4c-0e4a-4779-b53a-78c48397ea2f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120741) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 18:05:22.805600 dv-cinder-852009-8-iscsi devstack@n-api.service[120741]: DEBUG oslo_concurrency.lockutils [None req-6c8e77b4-f669-4624-a47e-766d03844439 tempest-AttachVolumeTestJSON-555093534 tempest-AttachVolumeTestJSON-555093534-project] Lock "1daf4f4c-0e4a-4779-b53a-78c48397ea2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.008s {{(pid=120741) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 18:05:22.806309 dv-cinder-852009-8-iscsi devstack@n-api.service[120741]: DEBUG oslo_concurrency.lockutils [None req-6c8e77b4-f669-4624-a47e-766d03844439 tempest-AttachVolumeTestJSON-555093534 tempest-AttachVolumeTestJSON-555093534-project] Lock "1daf4f4c-0e4a-4779-b53a-78c48397ea2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=120741) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 18:05:22.807525 dv-cinder-852009-8-iscsi devstack@n-api.service[120741]: DEBUG oslo_concurrency.lockutils [None req-6c8e77b4-f669-4624-a47e-766d03844439 tempest-AttachVolumeTestJSON-555093534 tempest-AttachVolumeTestJSON-555093534-project] Acquiring lock "1daf4f4c-0e4a-4779-b53a-78c48397ea2f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120741) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 18:05:22.807995 dv-cinder-852009-8-iscsi devstack@n-api.service[120741]: DEBUG oslo_concurrency.lockutils [None req-6c8e77b4-f669-4624-a47e-766d03844439 tempest-AttachVolumeTestJSON-555093534 tempest-AttachVolumeTestJSON-555093534-project] Lock "1daf4f4c-0e4a-4779-b53a-78c48397ea2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120741) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 18:05:22.808418 dv-cinder-852009-8-iscsi devstack@n-api.service[120741]: DEBUG oslo_concurrency.lockutils [None req-6c8e77b4-f669-4624-a47e-766d03844439 tempest-AttachVolumeTestJSON-555093534 tempest-AttachVolumeTestJSON-555093534-project] Lock "1daf4f4c-0e4a-4779-b53a-78c48397ea2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120741) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 18:05:22.975542 dv-cinder-852009-8-iscsi devstack@n-api.service[120741]: DEBUG nova.policy [None req-6c8e77b4-f669-4624-a47e-766d03844439 tempest-AttachVolumeTestJSON-555093534 tempest-AttachVolumeTestJSON-555093534-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0625b3113ce044bbac4f6142eaade11c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a279fcbf274c4704a31a2b95061e1469', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120741) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 18:05:22.985606 dv-cinder-852009-8-iscsi devstack@n-api.service[120741]: INFO nova.api.openstack.requestlog [None req-6c8e77b4-f669-4624-a47e-766d03844439 tempest-AttachVolumeTestJSON-555093534 tempest-AttachVolumeTestJSON-555093534-project] 10.222.0.43 "GET /compute/v2.1/servers/b958d409-df20-44c6-aa0e-58cb0a482edf" status: 200 len: 1678 microversion: 2.1 time: 0.205786 Sep 13 18:05:23.008498 dv-cinder-852009-8-iscsi devstack@n-api.service[120741]: [pid: 120741|app: 0|req: 179/367] 10.222.0.43 () {58 vars in 1236 bytes} [Tue Sep 13 18:05:22 2022] GET /compute/v2.1/servers/b958d409-df20-44c6-aa0e-58cb0a482edf => generated 1678 bytes in 229 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 13 18:05:23.476564 dv-cinder-852009-8-iscsi devstack@n-api.service[120740]: DEBUG nova.api.openstack.wsgi [None req-9f5067d5-d2ba-46fe-ad43-3090532edebd tempest-ServerRescueNegativeTestJSON-412251590 tempest-ServerRescueNegativeTestJSON-412251590-project] Calling method '>' {{(pid=120740) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 18:05:23.477175 dv-cinder-852009-8-iscsi devstack@n-api.service[120740]: DEBUG nova.compute.api [None req-9f5067d5-d2ba-46fe-ad43-3090532edebd tempest-ServerRescueNegativeTestJSON-412251590 tempest-ServerRescueNegativeTestJSON-412251590-project] [instance: e8ce7158-6b73-4586-9f78-8e821988e71c] Fetching instance by UUID {{(pid=120740) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 18:05:23.486340 dv-cinder-852009-8-iscsi devstack@n-api.service[120740]: DEBUG oslo_concurrency.lockutils [None req-9f5067d5-d2ba-46fe-ad43-3090532edebd tempest-ServerRescueNegativeTestJSON-412251590 tempest-ServerRescueNegativeTestJSON-412251590-project] Acquiring lock "1daf4f4c-0e4a-4779-b53a-78c48397ea2f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120740) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 18:05:23.486871 dv-cinder-852009-8-iscsi devstack@n-api.service[120740]: DEBUG oslo_concurrency.lockutils [None req-9f5067d5-d2ba-46fe-ad43-3090532edebd tempest-ServerRescueNegativeTestJSON-412251590 tempest-ServerRescueNegativeTestJSON-412251590-project] Lock "1daf4f4c-0e4a-4779-b53a-78c48397ea2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120740) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 18:05:23.487301 dv-cinder-852009-8-iscsi devstack@n-api.service[120740]: DEBUG oslo_concurrency.lockutils [None req-9f5067d5-d2ba-46fe-ad43-3090532edebd tempest-ServerRescueNegativeTestJSON-412251590 tempest-ServerRescueNegativeTestJSON-412251590-project] Lock "1daf4f4c-0e4a-4779-b53a-78c48397ea2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120740) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 18:05:23.488019 dv-cinder-852009-8-iscsi devstack@n-api.service[120740]: DEBUG oslo_concurrency.lockutils [None req-9f5067d5-d2ba-46fe-ad43-3090532edebd tempest-ServerRescueNegativeTestJSON-412251590 tempest-ServerRescueNegativeTestJSON-412251590-project] Acquiring lock "1daf4f4c-0e4a-4779-b53a-78c48397ea2f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120740) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 18:05:23.488559 dv-cinder-852009-8-iscsi devstack@n-api.service[120740]: DEBUG oslo_concurrency.lockutils [None req-9f5067d5-d2ba-46fe-ad43-3090532edebd tempest-ServerRescueNegativeTestJSON-412251590 tempest-ServerRescueNegativeTestJSON-412251590-project] Lock "1daf4f4c-0e4a-4779-b53a-78c48397ea2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120740) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 18:05:23.488985 dv-cinder-852009-8-iscsi devstack@n-api.service[120740]: DEBUG oslo_concurrency.lockutils [None req-9f5067d5-d2ba-46fe-ad43-3090532edebd tempest-ServerRescueNegativeTestJSON-412251590 tempest-ServerRescueNegativeTestJSON-412251590-project] Lock "1daf4f4c-0e4a-4779-b53a-78c48397ea2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120740) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 18:05:23.670880 dv-cinder-852009-8-iscsi devstack@n-api.service[120740]: DEBUG nova.policy [None req-9f5067d5-d2ba-46fe-ad43-3090532edebd tempest-ServerRescueNegativeTestJSON-412251590 tempest-ServerRescueNegativeTestJSON-412251590-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '60800cf2774e409d9c1b6f4992669991', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2eae4acecf6c4961830ead78d71b2ad3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120740) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 18:05:23.680732 dv-cinder-852009-8-iscsi devstack@n-api.service[120740]: INFO nova.api.openstack.requestlog [None req-9f5067d5-d2ba-46fe-ad43-3090532edebd tempest-ServerRescueNegativeTestJSON-412251590 tempest-ServerRescueNegativeTestJSON-412251590-project] 10.222.0.43 "GET /compute/v2.1/servers/e8ce7158-6b73-4586-9f78-8e821988e71c" status: 200 len: 1736 microversion: 2.1 time: 0.213178 Sep 13 18:05:23.698143 dv-cinder-852009-8-iscsi devstack@n-api.service[120740]: [pid: 120740|app: 0|req: 189/368] 10.222.0.43 () {58 vars in 1236 bytes} [Tue Sep 13 18:05:23 2022] GET /compute/v2.1/servers/e8ce7158-6b73-4586-9f78-8e821988e71c => generated 1736 bytes in 231 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 13 18:05:24.016549 dv-cinder-852009-8-iscsi devstack@n-api.service[120741]: DEBUG nova.api.openstack.wsgi [None req-16e39623-7c96-4944-9db5-94d7ccc36878 tempest-AttachVolumeTestJSON-555093534 tempest-AttachVolumeTestJSON-555093534-project] Calling method '>' {{(pid=120741) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 18:05:24.017801 dv-cinder-852009-8-iscsi devstack@n-api.service[120741]: DEBUG nova.compute.api [None req-16e39623-7c96-4944-9db5-94d7ccc36878 tempest-AttachVolumeTestJSON-555093534 tempest-AttachVolumeTestJSON-555093534-project] [instance: b958d409-df20-44c6-aa0e-58cb0a482edf] Fetching instance by UUID {{(pid=120741) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 18:05:24.038014 dv-cinder-852009-8-iscsi devstack@n-api.service[120741]: DEBUG oslo_concurrency.lockutils [None req-16e39623-7c96-4944-9db5-94d7ccc36878 tempest-AttachVolumeTestJSON-555093534 tempest-AttachVolumeTestJSON-555093534-project] Acquiring lock "1daf4f4c-0e4a-4779-b53a-78c48397ea2f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120741) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 18:05:24.038572 dv-cinder-852009-8-iscsi devstack@n-api.service[120741]: DEBUG oslo_concurrency.lockutils [None req-16e39623-7c96-4944-9db5-94d7ccc36878 tempest-AttachVolumeTestJSON-555093534 tempest-AttachVolumeTestJSON-555093534-project] Lock "1daf4f4c-0e4a-4779-b53a-78c48397ea2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120741) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 18:05:24.040529 dv-cinder-852009-8-iscsi devstack@n-api.service[120741]: DEBUG oslo_concurrency.lockutils [None req-16e39623-7c96-4944-9db5-94d7ccc36878 tempest-AttachVolumeTestJSON-555093534 tempest-AttachVolumeTestJSON-555093534-project] Lock "1daf4f4c-0e4a-4779-b53a-78c48397ea2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120741) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 18:05:24.041238 dv-cinder-852009-8-iscsi devstack@n-api.service[120741]: DEBUG oslo_concurrency.lockutils [None req-16e39623-7c96-4944-9db5-94d7ccc36878 tempest-AttachVolumeTestJSON-555093534 tempest-AttachVolumeTestJSON-555093534-project] Acquiring lock "1daf4f4c-0e4a-4779-b53a-78c48397ea2f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120741) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 18:05:24.041691 dv-cinder-852009-8-iscsi devstack@n-api.service[120741]: DEBUG oslo_concurrency.lockutils [None req-16e39623-7c96-4944-9db5-94d7ccc36878 tempest-AttachVolumeTestJSON-555093534 tempest-AttachVolumeTestJSON-555093534-project] Lock "1daf4f4c-0e4a-4779-b53a-78c48397ea2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120741) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 18:05:24.042142 dv-cinder-852009-8-iscsi devstack@n-api.service[120741]: DEBUG oslo_concurrency.lockutils [None req-16e39623-7c96-4944-9db5-94d7ccc36878 tempest-AttachVolumeTestJSON-555093534 tempest-AttachVolumeTestJSON-555093534-project] Lock "1daf4f4c-0e4a-4779-b53a-78c48397ea2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120741) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 18:05:24.235759 dv-cinder-852009-8-iscsi devstack@n-api.service[120741]: DEBUG nova.policy [None req-16e39623-7c96-4944-9db5-94d7ccc36878 tempest-AttachVolumeTestJSON-555093534 tempest-AttachVolumeTestJSON-555093534-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0625b3113ce044bbac4f6142eaade11c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a279fcbf274c4704a31a2b95061e1469', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120741) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 18:05:24.244687 dv-cinder-852009-8-iscsi devstack@n-api.service[120741]: INFO nova.api.openstack.requestlog [None req-16e39623-7c96-4944-9db5-94d7ccc36878 tempest-AttachVolumeTestJSON-555093534 tempest-AttachVolumeTestJSON-555093534-project] 10.222.0.43 "GET /compute/v2.1/servers/b958d409-df20-44c6-aa0e-58cb0a482edf" status: 200 len: 1678 microversion: 2.1 time: 0.232649 Sep 13 18:05:24.245546 dv-cinder-852009-8-iscsi devstack@n-api.service[120741]: [pid: 120741|app: 0|req: 180/369] 10.222.0.43 () {58 vars in 1236 bytes} [Tue Sep 13 18:05:24 2022] GET /compute/v2.1/servers/b958d409-df20-44c6-aa0e-58cb0a482edf => generated 1678 bytes in 234 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 13 18:05:24.704363 dv-cinder-852009-8-iscsi devstack@n-api.service[120740]: DEBUG nova.api.openstack.wsgi [None req-f6981f73-b454-4944-a42e-dedaeceeda3a tempest-ServerRescueNegativeTestJSON-412251590 tempest-ServerRescueNegativeTestJSON-412251590-project] Calling method '>' {{(pid=120740) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 18:05:24.704936 dv-cinder-852009-8-iscsi devstack@n-api.service[120740]: DEBUG nova.compute.api [None req-f6981f73-b454-4944-a42e-dedaeceeda3a tempest-ServerRescueNegativeTestJSON-412251590 tempest-ServerRescueNegativeTestJSON-412251590-project] [instance: e8ce7158-6b73-4586-9f78-8e821988e71c] Fetching instance by UUID {{(pid=120740) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 18:05:24.712067 dv-cinder-852009-8-iscsi devstack@n-api.service[120740]: DEBUG oslo_concurrency.lockutils [None req-f6981f73-b454-4944-a42e-dedaeceeda3a tempest-ServerRescueNegativeTestJSON-412251590 tempest-ServerRescueNegativeTestJSON-412251590-project] Acquiring lock "1daf4f4c-0e4a-4779-b53a-78c48397ea2f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120740) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 18:05:24.712627 dv-cinder-852009-8-iscsi devstack@n-api.service[120740]: DEBUG oslo_concurrency.lockutils [None req-f6981f73-b454-4944-a42e-dedaeceeda3a tempest-ServerRescueNegativeTestJSON-412251590 tempest-ServerRescueNegativeTestJSON-412251590-project] Lock "1daf4f4c-0e4a-4779-b53a-78c48397ea2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120740) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 18:05:24.713249 dv-cinder-852009-8-iscsi devstack@n-api.service[120740]: DEBUG oslo_concurrency.lockutils [None req-f6981f73-b454-4944-a42e-dedaeceeda3a tempest-ServerRescueNegativeTestJSON-412251590 tempest-ServerRescueNegativeTestJSON-412251590-project] Lock "1daf4f4c-0e4a-4779-b53a-78c48397ea2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120740) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 18:05:24.714452 dv-cinder-852009-8-iscsi devstack@n-api.service[120740]: DEBUG oslo_concurrency.lockutils [None req-f6981f73-b454-4944-a42e-dedaeceeda3a tempest-ServerRescueNegativeTestJSON-412251590 tempest-ServerRescueNegativeTestJSON-412251590-project] Acquiring lock "1daf4f4c-0e4a-4779-b53a-78c48397ea2f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120740) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 18:05:24.715063 dv-cinder-852009-8-iscsi devstack@n-api.service[120740]: DEBUG oslo_concurrency.lockutils [None req-f6981f73-b454-4944-a42e-dedaeceeda3a tempest-ServerRescueNegativeTestJSON-412251590 tempest-ServerRescueNegativeTestJSON-412251590-project] Lock "1daf4f4c-0e4a-4779-b53a-78c48397ea2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120740) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 18:05:24.715643 dv-cinder-852009-8-iscsi devstack@n-api.service[120740]: DEBUG oslo_concurrency.lockutils [None req-f6981f73-b454-4944-a42e-dedaeceeda3a tempest-ServerRescueNegativeTestJSON-412251590 tempest-ServerRescueNegativeTestJSON-412251590-project] Lock "1daf4f4c-0e4a-4779-b53a-78c48397ea2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120740) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 18:05:24.870734 dv-cinder-852009-8-iscsi devstack@n-api.service[120740]: DEBUG nova.policy [None req-f6981f73-b454-4944-a42e-dedaeceeda3a tempest-ServerRescueNegativeTestJSON-412251590 tempest-ServerRescueNegativeTestJSON-412251590-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '60800cf2774e409d9c1b6f4992669991', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2eae4acecf6c4961830ead78d71b2ad3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120740) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 18:05:24.883593 dv-cinder-852009-8-iscsi devstack@n-api.service[120740]: INFO nova.api.openstack.requestlog [None req-f6981f73-b454-4944-a42e-dedaeceeda3a tempest-ServerRescueNegativeTestJSON-412251590 tempest-ServerRescueNegativeTestJSON-412251590-project] 10.222.0.43 "GET /compute/v2.1/servers/e8ce7158-6b73-4586-9f78-8e821988e71c" status: 200 len: 1736 microversion: 2.1 time: 0.184057 Sep 13 18:05:24.884818 dv-cinder-852009-8-iscsi devstack@n-api.service[120740]: [pid: 120740|app: 0|req: 190/370] 10.222.0.43 () {58 vars in 1236 bytes} [Tue Sep 13 18:05:24 2022] GET /compute/v2.1/servers/e8ce7158-6b73-4586-9f78-8e821988e71c => generated 1736 bytes in 186 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 13 18:05:25.270622 dv-cinder-852009-8-iscsi devstack@n-api.service[120741]: DEBUG nova.api.openstack.wsgi [None req-e6e7eabd-3406-4810-8646-313fa838237b tempest-AttachVolumeTestJSON-555093534 tempest-AttachVolumeTestJSON-555093534-project] Calling method '>' {{(pid=120741) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 18:05:25.277340 dv-cinder-852009-8-iscsi devstack@n-api.service[120741]: DEBUG nova.compute.api [None req-e6e7eabd-3406-4810-8646-313fa838237b tempest-AttachVolumeTestJSON-555093534 tempest-AttachVolumeTestJSON-555093534-project] [instance: b958d409-df20-44c6-aa0e-58cb0a482edf] Fetching instance by UUID {{(pid=120741) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 18:05:25.284694 dv-cinder-852009-8-iscsi devstack@n-api.service[120741]: DEBUG oslo_concurrency.lockutils [None req-e6e7eabd-3406-4810-8646-313fa838237b tempest-AttachVolumeTestJSON-555093534 tempest-AttachVolumeTestJSON-555093534-project] Acquiring lock "1daf4f4c-0e4a-4779-b53a-78c48397ea2f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120741) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 18:05:25.285463 dv-cinder-852009-8-iscsi devstack@n-api.service[120741]: DEBUG oslo_concurrency.lockutils [None req-e6e7eabd-3406-4810-8646-313fa838237b tempest-AttachVolumeTestJSON-555093534 tempest-AttachVolumeTestJSON-555093534-project] Lock "1daf4f4c-0e4a-4779-b53a-78c48397ea2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120741) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 18:05:25.286050 dv-cinder-852009-8-iscsi devstack@n-api.service[120741]: DEBUG oslo_concurrency.lockutils [None req-e6e7eabd-3406-4810-8646-313fa838237b tempest-AttachVolumeTestJSON-555093534 tempest-AttachVolumeTestJSON-555093534-project] Lock "1daf4f4c-0e4a-4779-b53a-78c48397ea2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120741) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 18:05:25.286912 dv-cinder-852009-8-iscsi devstack@n-api.service[120741]: DEBUG oslo_concurrency.lockutils [None req-e6e7eabd-3406-4810-8646-313fa838237b tempest-AttachVolumeTestJSON-555093534 tempest-AttachVolumeTestJSON-555093534-project] Acquiring lock "1daf4f4c-0e4a-4779-b53a-78c48397ea2f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120741) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 18:05:25.287516 dv-cinder-852009-8-iscsi devstack@n-api.service[120741]: DEBUG oslo_concurrency.lockutils [None req-e6e7eabd-3406-4810-8646-313fa838237b tempest-AttachVolumeTestJSON-555093534 tempest-AttachVolumeTestJSON-555093534-project] Lock "1daf4f4c-0e4a-4779-b53a-78c48397ea2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120741) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 18:05:25.288088 dv-cinder-852009-8-iscsi devstack@n-api.service[120741]: DEBUG oslo_concurrency.lockutils [None req-e6e7eabd-3406-4810-8646-313fa838237b tempest-AttachVolumeTestJSON-555093534 tempest-AttachVolumeTestJSON-555093534-project] Lock "1daf4f4c-0e4a-4779-b53a-78c48397ea2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120741) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 18:05:25.449506 dv-cinder-852009-8-iscsi devstack@n-api.service[120741]: DEBUG nova.policy [None req-e6e7eabd-3406-4810-8646-313fa838237b tempest-AttachVolumeTestJSON-555093534 tempest-AttachVolumeTestJSON-555093534-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0625b3113ce044bbac4f6142eaade11c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a279fcbf274c4704a31a2b95061e1469', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120741) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 18:05:25.458644 dv-cinder-852009-8-iscsi devstack@n-api.service[120741]: INFO nova.api.openstack.requestlog [None req-e6e7eabd-3406-4810-8646-313fa838237b tempest-AttachVolumeTestJSON-555093534 tempest-AttachVolumeTestJSON-555093534-project] 10.222.0.43 "GET /compute/v2.1/servers/b958d409-df20-44c6-aa0e-58cb0a482edf" status: 200 len: 1678 microversion: 2.1 time: 0.192060 Sep 13 18:05:25.459247 dv-cinder-852009-8-iscsi devstack@n-api.service[120741]: [pid: 120741|app: 0|req: 181/371] 10.222.0.43 () {58 vars in 1236 bytes} [Tue Sep 13 18:05:25 2022] GET /compute/v2.1/servers/b958d409-df20-44c6-aa0e-58cb0a482edf => generated 1678 bytes in 194 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 13 18:05:25.909208 dv-cinder-852009-8-iscsi devstack@n-api.service[120740]: DEBUG nova.api.openstack.wsgi [None req-656d8dd7-5cf5-4628-a645-f0fb3f532364 tempest-ServerRescueNegativeTestJSON-412251590 tempest-ServerRescueNegativeTestJSON-412251590-project] Calling method '>' {{(pid=120740) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 18:05:25.910838 dv-cinder-852009-8-iscsi devstack@n-api.service[120740]: DEBUG nova.compute.api [None req-656d8dd7-5cf5-4628-a645-f0fb3f532364 tempest-ServerRescueNegativeTestJSON-412251590 tempest-ServerRescueNegativeTestJSON-412251590-project] [instance: e8ce7158-6b73-4586-9f78-8e821988e71c] Fetching instance by UUID {{(pid=120740) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 18:05:25.917673 dv-cinder-852009-8-iscsi devstack@n-api.service[120740]: DEBUG oslo_concurrency.lockutils [None req-656d8dd7-5cf5-4628-a645-f0fb3f532364 tempest-ServerRescueNegativeTestJSON-412251590 tempest-ServerRescueNegativeTestJSON-412251590-project] Acquiring lock "1daf4f4c-0e4a-4779-b53a-78c48397ea2f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120740) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 18:05:25.918237 dv-cinder-852009-8-iscsi devstack@n-api.service[120740]: DEBUG oslo_concurrency.lockutils [None req-656d8dd7-5cf5-4628-a645-f0fb3f532364 tempest-ServerRescueNegativeTestJSON-412251590 tempest-ServerRescueNegativeTestJSON-412251590-project] Lock "1daf4f4c-0e4a-4779-b53a-78c48397ea2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120740) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 18:05:25.918668 dv-cinder-852009-8-iscsi devstack@n-api.service[120740]: DEBUG oslo_concurrency.lockutils [None req-656d8dd7-5cf5-4628-a645-f0fb3f532364 tempest-ServerRescueNegativeTestJSON-412251590 tempest-ServerRescueNegativeTestJSON-412251590-project] Lock "1daf4f4c-0e4a-4779-b53a-78c48397ea2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120740) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 18:05:25.919349 dv-cinder-852009-8-iscsi devstack@n-api.service[120740]: DEBUG oslo_concurrency.lockutils [None req-656d8dd7-5cf5-4628-a645-f0fb3f532364 tempest-ServerRescueNegativeTestJSON-412251590 tempest-ServerRescueNegativeTestJSON-412251590-project] Acquiring lock "1daf4f4c-0e4a-4779-b53a-78c48397ea2f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120740) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 18:05:25.919797 dv-cinder-852009-8-iscsi devstack@n-api.service[120740]: DEBUG oslo_concurrency.lockutils [None req-656d8dd7-5cf5-4628-a645-f0fb3f532364 tempest-ServerRescueNegativeTestJSON-412251590 tempest-ServerRescueNegativeTestJSON-412251590-project] Lock "1daf4f4c-0e4a-4779-b53a-78c48397ea2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120740) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 18:05:25.922866 dv-cinder-852009-8-iscsi devstack@n-api.service[120740]: DEBUG oslo_concurrency.lockutils [None req-656d8dd7-5cf5-4628-a645-f0fb3f532364 tempest-ServerRescueNegativeTestJSON-412251590 tempest-ServerRescueNegativeTestJSON-412251590-project] Lock "1daf4f4c-0e4a-4779-b53a-78c48397ea2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120740) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 18:05:26.066079 dv-cinder-852009-8-iscsi devstack@n-api.service[120740]: DEBUG nova.policy [None req-656d8dd7-5cf5-4628-a645-f0fb3f532364 tempest-ServerRescueNegativeTestJSON-412251590 tempest-ServerRescueNegativeTestJSON-412251590-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '60800cf2774e409d9c1b6f4992669991', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2eae4acecf6c4961830ead78d71b2ad3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120740) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 18:05:26.077815 dv-cinder-852009-8-iscsi devstack@n-api.service[120740]: INFO nova.api.openstack.requestlog [None req-656d8dd7-5cf5-4628-a645-f0fb3f532364 tempest-ServerRescueNegativeTestJSON-412251590 tempest-ServerRescueNegativeTestJSON-412251590-project] 10.222.0.43 "GET /compute/v2.1/servers/e8ce7158-6b73-4586-9f78-8e821988e71c" status: 200 len: 1736 microversion: 2.1 time: 0.172383 Sep 13 18:05:26.078403 dv-cinder-852009-8-iscsi devstack@n-api.service[120740]: [pid: 120740|app: 0|req: 191/372] 10.222.0.43 () {58 vars in 1236 bytes} [Tue Sep 13 18:05:25 2022] GET /compute/v2.1/servers/e8ce7158-6b73-4586-9f78-8e821988e71c => generated 1736 bytes in 174 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 13 18:05:26.484091 dv-cinder-852009-8-iscsi devstack@n-api.service[120741]: DEBUG nova.api.openstack.wsgi [None req-61a54899-e600-4e6b-b667-2c916149f86e tempest-AttachVolumeTestJSON-555093534 tempest-AttachVolumeTestJSON-555093534-project] Calling method '>' {{(pid=120741) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 18:05:26.485465 dv-cinder-852009-8-iscsi devstack@n-api.service[120741]: DEBUG nova.compute.api [None req-61a54899-e600-4e6b-b667-2c916149f86e tempest-AttachVolumeTestJSON-555093534 tempest-AttachVolumeTestJSON-555093534-project] [instance: b958d409-df20-44c6-aa0e-58cb0a482edf] Fetching instance by UUID {{(pid=120741) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 18:05:26.493727 dv-cinder-852009-8-iscsi devstack@n-api.service[120741]: DEBUG oslo_concurrency.lockutils [None req-61a54899-e600-4e6b-b667-2c916149f86e tempest-AttachVolumeTestJSON-555093534 tempest-AttachVolumeTestJSON-555093534-project] Acquiring lock "1daf4f4c-0e4a-4779-b53a-78c48397ea2f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120741) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 18:05:26.494488 dv-cinder-852009-8-iscsi devstack@n-api.service[120741]: DEBUG oslo_concurrency.lockutils [None req-61a54899-e600-4e6b-b667-2c916149f86e tempest-AttachVolumeTestJSON-555093534 tempest-AttachVolumeTestJSON-555093534-project] Lock "1daf4f4c-0e4a-4779-b53a-78c48397ea2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120741) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 18:05:26.494923 dv-cinder-852009-8-iscsi devstack@n-api.service[120741]: DEBUG oslo_concurrency.lockutils [None req-61a54899-e600-4e6b-b667-2c916149f86e tempest-AttachVolumeTestJSON-555093534 tempest-AttachVolumeTestJSON-555093534-project] Lock "1daf4f4c-0e4a-4779-b53a-78c48397ea2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120741) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 18:05:26.495798 dv-cinder-852009-8-iscsi devstack@n-api.service[120741]: DEBUG oslo_concurrency.lockutils [None req-61a54899-e600-4e6b-b667-2c916149f86e tempest-AttachVolumeTestJSON-555093534 tempest-AttachVolumeTestJSON-555093534-project] Acquiring lock "1daf4f4c-0e4a-4779-b53a-78c48397ea2f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120741) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 18:05:26.496764 dv-cinder-852009-8-iscsi devstack@n-api.service[120741]: DEBUG oslo_concurrency.lockutils [None req-61a54899-e600-4e6b-b667-2c916149f86e tempest-AttachVolumeTestJSON-555093534 tempest-AttachVolumeTestJSON-555093534-project] Lock "1daf4f4c-0e4a-4779-b53a-78c48397ea2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120741) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 18:05:26.496896 dv-cinder-852009-8-iscsi devstack@n-api.service[120741]: DEBUG oslo_concurrency.lockutils [None req-61a54899-e600-4e6b-b667-2c916149f86e tempest-AttachVolumeTestJSON-555093534 tempest-AttachVolumeTestJSON-555093534-project] Lock "1daf4f4c-0e4a-4779-b53a-78c48397ea2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120741) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 18:05:26.631481 dv-cinder-852009-8-iscsi devstack@n-api.service[120741]: DEBUG nova.policy [None req-61a54899-e600-4e6b-b667-2c916149f86e tempest-AttachVolumeTestJSON-555093534 tempest-AttachVolumeTestJSON-555093534-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0625b3113ce044bbac4f6142eaade11c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a279fcbf274c4704a31a2b95061e1469', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120741) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 18:05:26.640079 dv-cinder-852009-8-iscsi devstack@n-api.service[120741]: INFO nova.api.openstack.requestlog [None req-61a54899-e600-4e6b-b667-2c916149f86e tempest-AttachVolumeTestJSON-555093534 tempest-AttachVolumeTestJSON-555093534-project] 10.222.0.43 "GET /compute/v2.1/servers/b958d409-df20-44c6-aa0e-58cb0a482edf" status: 200 len: 1678 microversion: 2.1 time: 0.160616 Sep 13 18:05:26.640939 dv-cinder-852009-8-iscsi devstack@n-api.service[120741]: [pid: 120741|app: 0|req: 182/373] 10.222.0.43 () {58 vars in 1236 bytes} [Tue Sep 13 18:05:26 2022] GET /compute/v2.1/servers/b958d409-df20-44c6-aa0e-58cb0a482edf => generated 1678 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 13 18:05:27.100996 dv-cinder-852009-8-iscsi devstack@n-api.service[120740]: DEBUG nova.api.openstack.wsgi [None req-c1b5bbd0-f01f-4fc1-a036-0b2866665188 tempest-ServerRescueNegativeTestJSON-412251590 tempest-ServerRescueNegativeTestJSON-412251590-project] Calling method '>' {{(pid=120740) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 18:05:27.101645 dv-cinder-852009-8-iscsi devstack@n-api.service[120740]: DEBUG nova.compute.api [None req-c1b5bbd0-f01f-4fc1-a036-0b2866665188 tempest-ServerRescueNegativeTestJSON-412251590 tempest-ServerRescueNegativeTestJSON-412251590-project] [instance: e8ce7158-6b73-4586-9f78-8e821988e71c] Fetching instance by UUID {{(pid=120740) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 18:05:27.108685 dv-cinder-852009-8-iscsi devstack@n-api.service[120740]: DEBUG oslo_concurrency.lockutils [None req-c1b5bbd0-f01f-4fc1-a036-0b2866665188 tempest-ServerRescueNegativeTestJSON-412251590 tempest-ServerRescueNegativeTestJSON-412251590-project] Acquiring lock "1daf4f4c-0e4a-4779-b53a-78c48397ea2f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120740) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 18:05:27.109576 dv-cinder-852009-8-iscsi devstack@n-api.service[120740]: DEBUG oslo_concurrency.lockutils [None req-c1b5bbd0-f01f-4fc1-a036-0b2866665188 tempest-ServerRescueNegativeTestJSON-412251590 tempest-ServerRescueNegativeTestJSON-412251590-project] Lock "1daf4f4c-0e4a-4779-b53a-78c48397ea2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120740) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 18:05:27.110243 dv-cinder-852009-8-iscsi devstack@n-api.service[120740]: DEBUG oslo_concurrency.lockutils [None req-c1b5bbd0-f01f-4fc1-a036-0b2866665188 tempest-ServerRescueNegativeTestJSON-412251590 tempest-ServerRescueNegativeTestJSON-412251590-project] Lock "1daf4f4c-0e4a-4779-b53a-78c48397ea2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120740) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 18:05:27.111648 dv-cinder-852009-8-iscsi devstack@n-api.service[120740]: DEBUG oslo_concurrency.lockutils [None req-c1b5bbd0-f01f-4fc1-a036-0b2866665188 tempest-ServerRescueNegativeTestJSON-412251590 tempest-ServerRescueNegativeTestJSON-412251590-project] Acquiring lock "1daf4f4c-0e4a-4779-b53a-78c48397ea2f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120740) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 18:05:27.112349 dv-cinder-852009-8-iscsi devstack@n-api.service[120740]: DEBUG oslo_concurrency.lockutils [None req-c1b5bbd0-f01f-4fc1-a036-0b2866665188 tempest-ServerRescueNegativeTestJSON-412251590 tempest-ServerRescueNegativeTestJSON-412251590-project] Lock "1daf4f4c-0e4a-4779-b53a-78c48397ea2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120740) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 18:05:27.113178 dv-cinder-852009-8-iscsi devstack@n-api.service[120740]: DEBUG oslo_concurrency.lockutils [None req-c1b5bbd0-f01f-4fc1-a036-0b2866665188 tempest-ServerRescueNegativeTestJSON-412251590 tempest-ServerRescueNegativeTestJSON-412251590-project] Lock "1daf4f4c-0e4a-4779-b53a-78c48397ea2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120740) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 18:05:27.260970 dv-cinder-852009-8-iscsi devstack@n-api.service[120740]: DEBUG nova.policy [None req-c1b5bbd0-f01f-4fc1-a036-0b2866665188 tempest-ServerRescueNegativeTestJSON-412251590 tempest-ServerRescueNegativeTestJSON-412251590-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '60800cf2774e409d9c1b6f4992669991', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2eae4acecf6c4961830ead78d71b2ad3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120740) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 18:05:27.269893 dv-cinder-852009-8-iscsi devstack@n-api.service[120740]: INFO nova.api.openstack.requestlog [None req-c1b5bbd0-f01f-4fc1-a036-0b2866665188 tempest-ServerRescueNegativeTestJSON-412251590 tempest-ServerRescueNegativeTestJSON-412251590-project] 10.222.0.43 "GET /compute/v2.1/servers/e8ce7158-6b73-4586-9f78-8e821988e71c" status: 200 len: 1736 microversion: 2.1 time: 0.172848 Sep 13 18:05:27.270780 dv-cinder-852009-8-iscsi devstack@n-api.service[120740]: [pid: 120740|app: 0|req: 192/374] 10.222.0.43 () {58 vars in 1236 bytes} [Tue Sep 13 18:05:27 2022] GET /compute/v2.1/servers/e8ce7158-6b73-4586-9f78-8e821988e71c => generated 1736 bytes in 174 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 13 18:05:27.663153 dv-cinder-852009-8-iscsi devstack@n-api.service[120741]: DEBUG nova.api.openstack.wsgi [None req-3cba5c62-2204-43f9-be2c-0988daefdc81 tempest-AttachVolumeTestJSON-555093534 tempest-AttachVolumeTestJSON-555093534-project] Calling method '>' {{(pid=120741) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 18:05:27.664521 dv-cinder-852009-8-iscsi devstack@n-api.service[120741]: DEBUG nova.compute.api [None req-3cba5c62-2204-43f9-be2c-0988daefdc81 tempest-AttachVolumeTestJSON-555093534 tempest-AttachVolumeTestJSON-555093534-project] [instance: b958d409-df20-44c6-aa0e-58cb0a482edf] Fetching instance by UUID {{(pid=120741) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 18:05:27.673717 dv-cinder-852009-8-iscsi devstack@n-api.service[120741]: DEBUG oslo_concurrency.lockutils [None req-3cba5c62-2204-43f9-be2c-0988daefdc81 tempest-AttachVolumeTestJSON-555093534 tempest-AttachVolumeTestJSON-555093534-project] Acquiring lock "1daf4f4c-0e4a-4779-b53a-78c48397ea2f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120741) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 18:05:27.674227 dv-cinder-852009-8-iscsi devstack@n-api.service[120741]: DEBUG oslo_concurrency.lockutils [None req-3cba5c62-2204-43f9-be2c-0988daefdc81 tempest-AttachVolumeTestJSON-555093534 tempest-AttachVolumeTestJSON-555093534-project] Lock "1daf4f4c-0e4a-4779-b53a-78c48397ea2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120741) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 18:05:27.674660 dv-cinder-852009-8-iscsi devstack@n-api.service[120741]: DEBUG oslo_concurrency.lockutils [None req-3cba5c62-2204-43f9-be2c-0988daefdc81 tempest-AttachVolumeTestJSON-555093534 tempest-AttachVolumeTestJSON-555093534-project] Lock "1daf4f4c-0e4a-4779-b53a-78c48397ea2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120741) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 18:05:27.675372 dv-cinder-852009-8-iscsi devstack@n-api.service[120741]: DEBUG oslo_concurrency.lockutils [None req-3cba5c62-2204-43f9-be2c-0988daefdc81 tempest-AttachVolumeTestJSON-555093534 tempest-AttachVolumeTestJSON-555093534-project] Acquiring lock "1daf4f4c-0e4a-4779-b53a-78c48397ea2f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120741) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 18:05:27.675978 dv-cinder-852009-8-iscsi devstack@n-api.service[120741]: DEBUG oslo_concurrency.lockutils [None req-3cba5c62-2204-43f9-be2c-0988daefdc81 tempest-AttachVolumeTestJSON-555093534 tempest-AttachVolumeTestJSON-555093534-project] Lock "1daf4f4c-0e4a-4779-b53a-78c48397ea2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120741) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 18:05:27.676403 dv-cinder-852009-8-iscsi devstack@n-api.service[120741]: DEBUG oslo_concurrency.lockutils [None req-3cba5c62-2204-43f9-be2c-0988daefdc81 tempest-AttachVolumeTestJSON-555093534 tempest-AttachVolumeTestJSON-555093534-project] Lock "1daf4f4c-0e4a-4779-b53a-78c48397ea2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120741) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 18:05:27.829360 dv-cinder-852009-8-iscsi devstack@n-api.service[120741]: DEBUG nova.policy [None req-3cba5c62-2204-43f9-be2c-0988daefdc81 tempest-AttachVolumeTestJSON-555093534 tempest-AttachVolumeTestJSON-555093534-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0625b3113ce044bbac4f6142eaade11c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a279fcbf274c4704a31a2b95061e1469', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120741) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 18:05:27.838208 dv-cinder-852009-8-iscsi devstack@n-api.service[120741]: INFO nova.api.openstack.requestlog [None req-3cba5c62-2204-43f9-be2c-0988daefdc81 tempest-AttachVolumeTestJSON-555093534 tempest-AttachVolumeTestJSON-555093534-project] 10.222.0.43 "GET /compute/v2.1/servers/b958d409-df20-44c6-aa0e-58cb0a482edf" status: 200 len: 1678 microversion: 2.1 time: 0.178607 Sep 13 18:05:27.839481 dv-cinder-852009-8-iscsi devstack@n-api.service[120741]: [pid: 120741|app: 0|req: 183/375] 10.222.0.43 () {58 vars in 1236 bytes} [Tue Sep 13 18:05:27 2022] GET /compute/v2.1/servers/b958d409-df20-44c6-aa0e-58cb0a482edf => generated 1678 bytes in 181 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 13 18:05:28.293562 dv-cinder-852009-8-iscsi devstack@n-api.service[120740]: DEBUG nova.api.openstack.wsgi [None req-dd85aba5-0249-47e2-8f48-03381507bb4d tempest-ServerRescueNegativeTestJSON-412251590 tempest-ServerRescueNegativeTestJSON-412251590-project] Calling method '>' {{(pid=120740) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 18:05:28.294160 dv-cinder-852009-8-iscsi devstack@n-api.service[120740]: DEBUG nova.compute.api [None req-dd85aba5-0249-47e2-8f48-03381507bb4d tempest-ServerRescueNegativeTestJSON-412251590 tempest-ServerRescueNegativeTestJSON-412251590-project] [instance: e8ce7158-6b73-4586-9f78-8e821988e71c] Fetching instance by UUID {{(pid=120740) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 18:05:28.300779 dv-cinder-852009-8-iscsi devstack@n-api.service[120740]: DEBUG oslo_concurrency.lockutils [None req-dd85aba5-0249-47e2-8f48-03381507bb4d tempest-ServerRescueNegativeTestJSON-412251590 tempest-ServerRescueNegativeTestJSON-412251590-project] Acquiring lock "1daf4f4c-0e4a-4779-b53a-78c48397ea2f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120740) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 18:05:28.301567 dv-cinder-852009-8-iscsi devstack@n-api.service[120740]: DEBUG oslo_concurrency.lockutils [None req-dd85aba5-0249-47e2-8f48-03381507bb4d tempest-ServerRescueNegativeTestJSON-412251590 tempest-ServerRescueNegativeTestJSON-412251590-project] Lock "1daf4f4c-0e4a-4779-b53a-78c48397ea2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120740) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 18:05:28.301992 dv-cinder-852009-8-iscsi devstack@n-api.service[120740]: DEBUG oslo_concurrency.lockutils [None req-dd85aba5-0249-47e2-8f48-03381507bb4d tempest-ServerRescueNegativeTestJSON-412251590 tempest-ServerRescueNegativeTestJSON-412251590-project] Lock "1daf4f4c-0e4a-4779-b53a-78c48397ea2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120740) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 18:05:28.303231 dv-cinder-852009-8-iscsi devstack@n-api.service[120740]: DEBUG oslo_concurrency.lockutils [None req-dd85aba5-0249-47e2-8f48-03381507bb4d tempest-ServerRescueNegativeTestJSON-412251590 tempest-ServerRescueNegativeTestJSON-412251590-project] Acquiring lock "1daf4f4c-0e4a-4779-b53a-78c48397ea2f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120740) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 18:05:28.303898 dv-cinder-852009-8-iscsi devstack@n-api.service[120740]: DEBUG oslo_concurrency.lockutils [None req-dd85aba5-0249-47e2-8f48-03381507bb4d tempest-ServerRescueNegativeTestJSON-412251590 tempest-ServerRescueNegativeTestJSON-412251590-project] Lock "1daf4f4c-0e4a-4779-b53a-78c48397ea2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120740) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 18:05:28.304383 dv-cinder-852009-8-iscsi devstack@n-api.service[120740]: DEBUG oslo_concurrency.lockutils [None req-dd85aba5-0249-47e2-8f48-03381507bb4d tempest-ServerRescueNegativeTestJSON-412251590 tempest-ServerRescueNegativeTestJSON-412251590-project] Lock "1daf4f4c-0e4a-4779-b53a-78c48397ea2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120740) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 18:05:28.460734 dv-cinder-852009-8-iscsi devstack@n-api.service[120740]: DEBUG nova.policy [None req-dd85aba5-0249-47e2-8f48-03381507bb4d tempest-ServerRescueNegativeTestJSON-412251590 tempest-ServerRescueNegativeTestJSON-412251590-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '60800cf2774e409d9c1b6f4992669991', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2eae4acecf6c4961830ead78d71b2ad3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120740) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 18:05:28.470052 dv-cinder-852009-8-iscsi devstack@n-api.service[120740]: INFO nova.api.openstack.requestlog [None req-dd85aba5-0249-47e2-8f48-03381507bb4d tempest-ServerRescueNegativeTestJSON-412251590 tempest-ServerRescueNegativeTestJSON-412251590-project] 10.222.0.43 "GET /compute/v2.1/servers/e8ce7158-6b73-4586-9f78-8e821988e71c" status: 200 len: 1736 microversion: 2.1 time: 0.180605 Sep 13 18:05:28.470964 dv-cinder-852009-8-iscsi devstack@n-api.service[120740]: [pid: 120740|app: 0|req: 193/376] 10.222.0.43 () {58 vars in 1236 bytes} [Tue Sep 13 18:05:28 2022] GET /compute/v2.1/servers/e8ce7158-6b73-4586-9f78-8e821988e71c => generated 1736 bytes in 182 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 13 18:05:28.862763 dv-cinder-852009-8-iscsi devstack@n-api.service[120741]: DEBUG nova.api.openstack.wsgi [None req-88280b83-132e-4117-98ce-9fcfb4bb9940 tempest-AttachVolumeTestJSON-555093534 tempest-AttachVolumeTestJSON-555093534-project] Calling method '>' {{(pid=120741) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 18:05:28.863442 dv-cinder-852009-8-iscsi devstack@n-api.service[120741]: DEBUG nova.compute.api [None req-88280b83-132e-4117-98ce-9fcfb4bb9940 tempest-AttachVolumeTestJSON-555093534 tempest-AttachVolumeTestJSON-555093534-project] [instance: b958d409-df20-44c6-aa0e-58cb0a482edf] Fetching instance by UUID {{(pid=120741) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 18:05:28.870873 dv-cinder-852009-8-iscsi devstack@n-api.service[120741]: DEBUG oslo_concurrency.lockutils [None req-88280b83-132e-4117-98ce-9fcfb4bb9940 tempest-AttachVolumeTestJSON-555093534 tempest-AttachVolumeTestJSON-555093534-project] Acquiring lock "1daf4f4c-0e4a-4779-b53a-78c48397ea2f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120741) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 18:05:28.871445 dv-cinder-852009-8-iscsi devstack@n-api.service[120741]: DEBUG oslo_concurrency.lockutils [None req-88280b83-132e-4117-98ce-9fcfb4bb9940 tempest-AttachVolumeTestJSON-555093534 tempest-AttachVolumeTestJSON-555093534-project] Lock "1daf4f4c-0e4a-4779-b53a-78c48397ea2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120741) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 18:05:28.871885 dv-cinder-852009-8-iscsi devstack@n-api.service[120741]: DEBUG oslo_concurrency.lockutils [None req-88280b83-132e-4117-98ce-9fcfb4bb9940 tempest-AttachVolumeTestJSON-555093534 tempest-AttachVolumeTestJSON-555093534-project] Lock "1daf4f4c-0e4a-4779-b53a-78c48397ea2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120741) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 18:05:28.872678 dv-cinder-852009-8-iscsi devstack@n-api.service[120741]: DEBUG oslo_concurrency.lockutils [None req-88280b83-132e-4117-98ce-9fcfb4bb9940 tempest-AttachVolumeTestJSON-555093534 tempest-AttachVolumeTestJSON-555093534-project] Acquiring lock "1daf4f4c-0e4a-4779-b53a-78c48397ea2f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120741) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 18:05:28.873137 dv-cinder-852009-8-iscsi devstack@n-api.service[120741]: DEBUG oslo_concurrency.lockutils [None req-88280b83-132e-4117-98ce-9fcfb4bb9940 tempest-AttachVolumeTestJSON-555093534 tempest-AttachVolumeTestJSON-555093534-project] Lock "1daf4f4c-0e4a-4779-b53a-78c48397ea2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120741) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 18:05:28.873559 dv-cinder-852009-8-iscsi devstack@n-api.service[120741]: DEBUG oslo_concurrency.lockutils [None req-88280b83-132e-4117-98ce-9fcfb4bb9940 tempest-AttachVolumeTestJSON-555093534 tempest-AttachVolumeTestJSON-555093534-project] Lock "1daf4f4c-0e4a-4779-b53a-78c48397ea2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120741) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 18:05:29.030979 dv-cinder-852009-8-iscsi devstack@n-api.service[120741]: DEBUG nova.policy [None req-88280b83-132e-4117-98ce-9fcfb4bb9940 tempest-AttachVolumeTestJSON-555093534 tempest-AttachVolumeTestJSON-555093534-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0625b3113ce044bbac4f6142eaade11c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a279fcbf274c4704a31a2b95061e1469', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120741) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 18:05:29.038794 dv-cinder-852009-8-iscsi devstack@n-api.service[120741]: INFO nova.api.openstack.requestlog [None req-88280b83-132e-4117-98ce-9fcfb4bb9940 tempest-AttachVolumeTestJSON-555093534 tempest-AttachVolumeTestJSON-555093534-project] 10.222.0.43 "GET /compute/v2.1/servers/b958d409-df20-44c6-aa0e-58cb0a482edf" status: 200 len: 1678 microversion: 2.1 time: 0.180093 Sep 13 18:05:29.039356 dv-cinder-852009-8-iscsi devstack@n-api.service[120741]: [pid: 120741|app: 0|req: 184/377] 10.222.0.43 () {58 vars in 1236 bytes} [Tue Sep 13 18:05:28 2022] GET /compute/v2.1/servers/b958d409-df20-44c6-aa0e-58cb0a482edf => generated 1678 bytes in 181 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 13 18:05:29.493182 dv-cinder-852009-8-iscsi devstack@n-api.service[120740]: DEBUG nova.api.openstack.wsgi [None req-0086fbab-4d1c-426f-b3b8-2d2bdd689051 tempest-ServerRescueNegativeTestJSON-412251590 tempest-ServerRescueNegativeTestJSON-412251590-project] Calling method '>' {{(pid=120740) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 18:05:29.493804 dv-cinder-852009-8-iscsi devstack@n-api.service[120740]: DEBUG nova.compute.api [None req-0086fbab-4d1c-426f-b3b8-2d2bdd689051 tempest-ServerRescueNegativeTestJSON-412251590 tempest-ServerRescueNegativeTestJSON-412251590-project] [instance: e8ce7158-6b73-4586-9f78-8e821988e71c] Fetching instance by UUID {{(pid=120740) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 18:05:29.500700 dv-cinder-852009-8-iscsi devstack@n-api.service[120740]: DEBUG oslo_concurrency.lockutils [None req-0086fbab-4d1c-426f-b3b8-2d2bdd689051 tempest-ServerRescueNegativeTestJSON-412251590 tempest-ServerRescueNegativeTestJSON-412251590-project] Acquiring lock "1daf4f4c-0e4a-4779-b53a-78c48397ea2f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120740) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 18:05:29.501239 dv-cinder-852009-8-iscsi devstack@n-api.service[120740]: DEBUG oslo_concurrency.lockutils [None req-0086fbab-4d1c-426f-b3b8-2d2bdd689051 tempest-ServerRescueNegativeTestJSON-412251590 tempest-ServerRescueNegativeTestJSON-412251590-project] Lock "1daf4f4c-0e4a-4779-b53a-78c48397ea2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120740) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 18:05:29.501716 dv-cinder-852009-8-iscsi devstack@n-api.service[120740]: DEBUG oslo_concurrency.lockutils [None req-0086fbab-4d1c-426f-b3b8-2d2bdd689051 tempest-ServerRescueNegativeTestJSON-412251590 tempest-ServerRescueNegativeTestJSON-412251590-project] Lock "1daf4f4c-0e4a-4779-b53a-78c48397ea2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120740) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 18:05:29.502793 dv-cinder-852009-8-iscsi devstack@n-api.service[120740]: DEBUG oslo_concurrency.lockutils [None req-0086fbab-4d1c-426f-b3b8-2d2bdd689051 tempest-ServerRescueNegativeTestJSON-412251590 tempest-ServerRescueNegativeTestJSON-412251590-project] Acquiring lock "1daf4f4c-0e4a-4779-b53a-78c48397ea2f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120740) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 18:05:29.503426 dv-cinder-852009-8-iscsi devstack@n-api.service[120740]: DEBUG oslo_concurrency.lockutils [None req-0086fbab-4d1c-426f-b3b8-2d2bdd689051 tempest-ServerRescueNegativeTestJSON-412251590 tempest-ServerRescueNegativeTestJSON-412251590-project] Lock "1daf4f4c-0e4a-4779-b53a-78c48397ea2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120740) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 18:05:29.503840 dv-cinder-852009-8-iscsi devstack@n-api.service[120740]: DEBUG oslo_concurrency.lockutils [None req-0086fbab-4d1c-426f-b3b8-2d2bdd689051 tempest-ServerRescueNegativeTestJSON-412251590 tempest-ServerRescueNegativeTestJSON-412251590-project] Lock "1daf4f4c-0e4a-4779-b53a-78c48397ea2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120740) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 18:05:29.544735 dv-cinder-852009-8-iscsi devstack@n-api.service[120741]: DEBUG nova.api.openstack.wsgi [None req-082b42fe-de36-4287-b38b-b2c291648521 tempest-TestMinimumBasicScenario-820002800 tempest-TestMinimumBasicScenario-820002800-project] Action: 'create', calling method: .version_select at 0x7fa626bf41f0>, body: {"keypair": {"name": "tempest-TestMinimumBasicScenario-1481895359", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBBOD2OVw7xiiF+FtzWxJaoxdyxIQoEfVV661SKjim+WTiSaH0w7IRa/tV1Vn9qE2g1DFi41BPPV7n2EhTltX+TJ9/vMSpCSZatRZ202w6KbPgLkR16eqfCIEQfKrq2wsCA=="}} {{(pid=120741) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 13 18:05:29.572034 dv-cinder-852009-8-iscsi devstack@n-api.service[120741]: DEBUG nova.quota [None req-082b42fe-de36-4287-b38b-b2c291648521 tempest-TestMinimumBasicScenario-820002800 tempest-TestMinimumBasicScenario-820002800-project] Getting quotas for project 2f6832936c824066a4370cc45c5b0282. Resources: {'key_pairs'} {{(pid=120741) _get_quotas /opt/stack/nova/nova/quota.py:393}} Sep 13 18:05:29.576714 dv-cinder-852009-8-iscsi devstack@n-api.service[120741]: DEBUG nova.quota [None req-082b42fe-de36-4287-b38b-b2c291648521 tempest-TestMinimumBasicScenario-820002800 tempest-TestMinimumBasicScenario-820002800-project] Getting quotas for user 7880064ff0aa448d9c367c89eba145ff and project 2f6832936c824066a4370cc45c5b0282. Resources: {'key_pairs'} {{(pid=120741) _get_quotas /opt/stack/nova/nova/quota.py:383}} Sep 13 18:05:29.603597 dv-cinder-852009-8-iscsi devstack@n-api.service[120741]: INFO nova.api.openstack.requestlog [None req-082b42fe-de36-4287-b38b-b2c291648521 tempest-TestMinimumBasicScenario-820002800 tempest-TestMinimumBasicScenario-820002800-project] 10.222.0.43 "POST /compute/v2.1/os-keypairs" status: 200 len: 403 microversion: 2.1 time: 0.063041 Sep 13 18:05:29.604206 dv-cinder-852009-8-iscsi devstack@n-api.service[120741]: [pid: 120741|app: 0|req: 185/378] 10.222.0.43 () {60 vars in 1159 bytes} [Tue Sep 13 18:05:29 2022] POST /compute/v2.1/os-keypairs => generated 403 bytes in 64 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 13 18:05:29.646770 dv-cinder-852009-8-iscsi devstack@n-api.service[120740]: DEBUG nova.policy [None req-0086fbab-4d1c-426f-b3b8-2d2bdd689051 tempest-ServerRescueNegativeTestJSON-412251590 tempest-ServerRescueNegativeTestJSON-412251590-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '60800cf2774e409d9c1b6f4992669991', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2eae4acecf6c4961830ead78d71b2ad3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120740) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 18:05:29.656250 dv-cinder-852009-8-iscsi devstack@n-api.service[120740]: INFO nova.api.openstack.requestlog [None req-0086fbab-4d1c-426f-b3b8-2d2bdd689051 tempest-ServerRescueNegativeTestJSON-412251590 tempest-ServerRescueNegativeTestJSON-412251590-project] 10.222.0.43 "GET /compute/v2.1/servers/e8ce7158-6b73-4586-9f78-8e821988e71c" status: 200 len: 1736 microversion: 2.1 time: 0.166868 Sep 13 18:05:29.656932 dv-cinder-852009-8-iscsi devstack@n-api.service[120740]: [pid: 120740|app: 0|req: 194/379] 10.222.0.43 () {58 vars in 1236 bytes} [Tue Sep 13 18:05:29 2022] GET /compute/v2.1/servers/e8ce7158-6b73-4586-9f78-8e821988e71c => generated 1736 bytes in 168 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 13 18:05:29.717699 dv-cinder-852009-8-iscsi devstack@n-api.service[120741]: DEBUG nova.api.openstack.wsgi [None req-95cfa623-ae74-4aad-b4c4-fdaa58e8df61 tempest-TestMinimumBasicScenario-820002800 tempest-TestMinimumBasicScenario-820002800-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-TestMinimumBasicScenario-server-1667831439", "imageRef": "04b97943-2177-468b-b487-55f2ebec05cc", "flavorRef": "452", "key_name": "tempest-TestMinimumBasicScenario-1481895359", "networks": [{"uuid": "6058b955-d55c-46af-b6d3-c1c382da7454"}]}} {{(pid=120741) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 13 18:05:29.771596 dv-cinder-852009-8-iscsi devstack@n-api.service[120741]: DEBUG nova.network.neutron [None req-95cfa623-ae74-4aad-b4c4-fdaa58e8df61 tempest-TestMinimumBasicScenario-820002800 tempest-TestMinimumBasicScenario-820002800-project] validate_networks() for [('6058b955-d55c-46af-b6d3-c1c382da7454', None, None, None, None, None)] {{(pid=120741) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Sep 13 18:05:30.062889 dv-cinder-852009-8-iscsi devstack@n-api.service[120740]: DEBUG nova.api.openstack.wsgi [None req-bdfce671-ed0f-4a7c-840e-8206ddfbc698 tempest-AttachVolumeTestJSON-555093534 tempest-AttachVolumeTestJSON-555093534-project] Calling method '>' {{(pid=120740) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 18:05:30.063610 dv-cinder-852009-8-iscsi devstack@n-api.service[120740]: DEBUG nova.compute.api [None req-bdfce671-ed0f-4a7c-840e-8206ddfbc698 tempest-AttachVolumeTestJSON-555093534 tempest-AttachVolumeTestJSON-555093534-project] [instance: b958d409-df20-44c6-aa0e-58cb0a482edf] Fetching instance by UUID {{(pid=120740) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 18:05:30.070071 dv-cinder-852009-8-iscsi devstack@n-api.service[120740]: DEBUG oslo_concurrency.lockutils [None req-bdfce671-ed0f-4a7c-840e-8206ddfbc698 tempest-AttachVolumeTestJSON-555093534 tempest-AttachVolumeTestJSON-555093534-project] Acquiring lock "1daf4f4c-0e4a-4779-b53a-78c48397ea2f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120740) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 18:05:30.070609 dv-cinder-852009-8-iscsi devstack@n-api.service[120740]: DEBUG oslo_concurrency.lockutils [None req-bdfce671-ed0f-4a7c-840e-8206ddfbc698 tempest-AttachVolumeTestJSON-555093534 tempest-AttachVolumeTestJSON-555093534-project] Lock "1daf4f4c-0e4a-4779-b53a-78c48397ea2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120740) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 18:05:30.071039 dv-cinder-852009-8-iscsi devstack@n-api.service[120740]: DEBUG oslo_concurrency.lockutils [None req-bdfce671-ed0f-4a7c-840e-8206ddfbc698 tempest-AttachVolumeTestJSON-555093534 tempest-AttachVolumeTestJSON-555093534-project] Lock "1daf4f4c-0e4a-4779-b53a-78c48397ea2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120740) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 18:05:30.071743 dv-cinder-852009-8-iscsi devstack@n-api.service[120740]: DEBUG oslo_concurrency.lockutils [None req-bdfce671-ed0f-4a7c-840e-8206ddfbc698 tempest-AttachVolumeTestJSON-555093534 tempest-AttachVolumeTestJSON-555093534-project] Acquiring lock "1daf4f4c-0e4a-4779-b53a-78c48397ea2f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120740) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 18:05:30.072188 dv-cinder-852009-8-iscsi devstack@n-api.service[120740]: DEBUG oslo_concurrency.lockutils [None req-bdfce671-ed0f-4a7c-840e-8206ddfbc698 tempest-AttachVolumeTestJSON-555093534 tempest-AttachVolumeTestJSON-555093534-project] Lock "1daf4f4c-0e4a-4779-b53a-78c48397ea2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120740) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 18:05:30.072642 dv-cinder-852009-8-iscsi devstack@n-api.service[120740]: DEBUG oslo_concurrency.lockutils [None req-bdfce671-ed0f-4a7c-840e-8206ddfbc698 tempest-AttachVolumeTestJSON-555093534 tempest-AttachVolumeTestJSON-555093534-project] Lock "1daf4f4c-0e4a-4779-b53a-78c48397ea2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120740) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 18:05:30.205482 dv-cinder-852009-8-iscsi devstack@n-api.service[120741]: DEBUG nova.virt.hardware [None req-95cfa623-ae74-4aad-b4c4-fdaa58e8df61 tempest-TestMinimumBasicScenario-820002800 tempest-TestMinimumBasicScenario-820002800-project] Flavor limits 0:0:0 {{(pid=120741) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Sep 13 18:05:30.206002 dv-cinder-852009-8-iscsi devstack@n-api.service[120741]: DEBUG nova.virt.hardware [None req-95cfa623-ae74-4aad-b4c4-fdaa58e8df61 tempest-TestMinimumBasicScenario-820002800 tempest-TestMinimumBasicScenario-820002800-project] Image limits 0:0:0 {{(pid=120741) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Sep 13 18:05:30.206497 dv-cinder-852009-8-iscsi devstack@n-api.service[120741]: DEBUG nova.virt.hardware [None req-95cfa623-ae74-4aad-b4c4-fdaa58e8df61 tempest-TestMinimumBasicScenario-820002800 tempest-TestMinimumBasicScenario-820002800-project] Flavor pref 0:0:0 {{(pid=120741) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Sep 13 18:05:30.206994 dv-cinder-852009-8-iscsi devstack@n-api.service[120741]: DEBUG nova.virt.hardware [None req-95cfa623-ae74-4aad-b4c4-fdaa58e8df61 tempest-TestMinimumBasicScenario-820002800 tempest-TestMinimumBasicScenario-820002800-project] Image pref 0:0:0 {{(pid=120741) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Sep 13 18:05:30.207315 dv-cinder-852009-8-iscsi devstack@n-api.service[120741]: DEBUG nova.virt.hardware [None req-95cfa623-ae74-4aad-b4c4-fdaa58e8df61 tempest-TestMinimumBasicScenario-820002800 tempest-TestMinimumBasicScenario-820002800-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=120741) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Sep 13 18:05:30.218084 dv-cinder-852009-8-iscsi devstack@n-api.service[120741]: DEBUG oslo_concurrency.lockutils [None req-95cfa623-ae74-4aad-b4c4-fdaa58e8df61 tempest-TestMinimumBasicScenario-820002800 tempest-TestMinimumBasicScenario-820002800-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120741) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 18:05:30.218630 dv-cinder-852009-8-iscsi devstack@n-api.service[120741]: DEBUG oslo_concurrency.lockutils [None req-95cfa623-ae74-4aad-b4c4-fdaa58e8df61 tempest-TestMinimumBasicScenario-820002800 tempest-TestMinimumBasicScenario-820002800-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120741) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 18:05:30.219066 dv-cinder-852009-8-iscsi devstack@n-api.service[120741]: DEBUG oslo_concurrency.lockutils [None req-95cfa623-ae74-4aad-b4c4-fdaa58e8df61 tempest-TestMinimumBasicScenario-820002800 tempest-TestMinimumBasicScenario-820002800-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120741) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 18:05:30.219784 dv-cinder-852009-8-iscsi devstack@n-api.service[120741]: DEBUG oslo_concurrency.lockutils [None req-95cfa623-ae74-4aad-b4c4-fdaa58e8df61 tempest-TestMinimumBasicScenario-820002800 tempest-TestMinimumBasicScenario-820002800-project] Acquiring lock "1daf4f4c-0e4a-4779-b53a-78c48397ea2f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120741) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 18:05:30.220230 dv-cinder-852009-8-iscsi devstack@n-api.service[120741]: DEBUG oslo_concurrency.lockutils [None req-95cfa623-ae74-4aad-b4c4-fdaa58e8df61 tempest-TestMinimumBasicScenario-820002800 tempest-TestMinimumBasicScenario-820002800-project] Lock "1daf4f4c-0e4a-4779-b53a-78c48397ea2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120741) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 18:05:30.220694 dv-cinder-852009-8-iscsi devstack@n-api.service[120741]: DEBUG oslo_concurrency.lockutils [None req-95cfa623-ae74-4aad-b4c4-fdaa58e8df61 tempest-TestMinimumBasicScenario-820002800 tempest-TestMinimumBasicScenario-820002800-project] Lock "1daf4f4c-0e4a-4779-b53a-78c48397ea2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120741) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 18:05:30.236975 dv-cinder-852009-8-iscsi devstack@n-api.service[120740]: DEBUG nova.policy [None req-bdfce671-ed0f-4a7c-840e-8206ddfbc698 tempest-AttachVolumeTestJSON-555093534 tempest-AttachVolumeTestJSON-555093534-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0625b3113ce044bbac4f6142eaade11c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a279fcbf274c4704a31a2b95061e1469', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120740) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 18:05:30.238725 dv-cinder-852009-8-iscsi devstack@n-api.service[120741]: DEBUG nova.quota [None req-95cfa623-ae74-4aad-b4c4-fdaa58e8df61 tempest-TestMinimumBasicScenario-820002800 tempest-TestMinimumBasicScenario-820002800-project] Getting quotas for project 2f6832936c824066a4370cc45c5b0282. Resources: {'cores', 'ram', 'instances'} {{(pid=120741) _get_quotas /opt/stack/nova/nova/quota.py:393}} Sep 13 18:05:30.242850 dv-cinder-852009-8-iscsi devstack@n-api.service[120741]: DEBUG nova.quota [None req-95cfa623-ae74-4aad-b4c4-fdaa58e8df61 tempest-TestMinimumBasicScenario-820002800 tempest-TestMinimumBasicScenario-820002800-project] Getting quotas for user 7880064ff0aa448d9c367c89eba145ff and project 2f6832936c824066a4370cc45c5b0282. Resources: {'cores', 'ram', 'instances'} {{(pid=120741) _get_quotas /opt/stack/nova/nova/quota.py:383}} Sep 13 18:05:30.245162 dv-cinder-852009-8-iscsi devstack@n-api.service[120740]: INFO nova.api.openstack.requestlog [None req-bdfce671-ed0f-4a7c-840e-8206ddfbc698 tempest-AttachVolumeTestJSON-555093534 tempest-AttachVolumeTestJSON-555093534-project] 10.222.0.43 "GET /compute/v2.1/servers/b958d409-df20-44c6-aa0e-58cb0a482edf" status: 200 len: 1678 microversion: 2.1 time: 0.186192 Sep 13 18:05:30.245994 dv-cinder-852009-8-iscsi devstack@n-api.service[120740]: [pid: 120740|app: 0|req: 195/380] 10.222.0.43 () {58 vars in 1236 bytes} [Tue Sep 13 18:05:30 2022] GET /compute/v2.1/servers/b958d409-df20-44c6-aa0e-58cb0a482edf => generated 1678 bytes in 188 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 13 18:05:30.254336 dv-cinder-852009-8-iscsi devstack@n-api.service[120741]: DEBUG nova.compute.api [None req-95cfa623-ae74-4aad-b4c4-fdaa58e8df61 tempest-TestMinimumBasicScenario-820002800 tempest-TestMinimumBasicScenario-820002800-project] Going to run 1 instances... {{(pid=120741) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Sep 13 18:05:30.256708 dv-cinder-852009-8-iscsi devstack@n-api.service[120741]: DEBUG nova.compute.api [None req-95cfa623-ae74-4aad-b4c4-fdaa58e8df61 tempest-TestMinimumBasicScenario-820002800 tempest-TestMinimumBasicScenario-820002800-project] [instance: f8247a13-94cd-45b2-acc8-8717e1260f37] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='04b97943-2177-468b-b487-55f2ebec05cc',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=120741) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Sep 13 18:05:30.302981 dv-cinder-852009-8-iscsi devstack@n-api.service[120741]: INFO nova.api.openstack.requestlog [None req-95cfa623-ae74-4aad-b4c4-fdaa58e8df61 tempest-TestMinimumBasicScenario-820002800 tempest-TestMinimumBasicScenario-820002800-project] 10.222.0.43 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 0.589310 Sep 13 18:05:30.303631 dv-cinder-852009-8-iscsi devstack@n-api.service[120741]: [pid: 120741|app: 0|req: 186/381] 10.222.0.43 () {60 vars in 1147 bytes} [Tue Sep 13 18:05:29 2022] POST /compute/v2.1/servers => generated 380 bytes in 591 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Sep 13 18:05:30.315317 dv-cinder-852009-8-iscsi devstack@n-api.service[120740]: DEBUG nova.api.openstack.wsgi [None req-a9f5032c-3a2a-495c-8b98-ed97e23162c7 tempest-TestMinimumBasicScenario-820002800 tempest-TestMinimumBasicScenario-820002800-project] Calling method '>' {{(pid=120740) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 18:05:30.315920 dv-cinder-852009-8-iscsi devstack@n-api.service[120740]: DEBUG nova.compute.api [None req-a9f5032c-3a2a-495c-8b98-ed97e23162c7 tempest-TestMinimumBasicScenario-820002800 tempest-TestMinimumBasicScenario-820002800-project] [instance: f8247a13-94cd-45b2-acc8-8717e1260f37] Fetching instance by UUID {{(pid=120740) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 18:05:30.369910 dv-cinder-852009-8-iscsi devstack@n-api.service[120740]: DEBUG nova.policy [None req-a9f5032c-3a2a-495c-8b98-ed97e23162c7 tempest-TestMinimumBasicScenario-820002800 tempest-TestMinimumBasicScenario-820002800-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7880064ff0aa448d9c367c89eba145ff', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2f6832936c824066a4370cc45c5b0282', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120740) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 18:05:30.377565 dv-cinder-852009-8-iscsi devstack@n-api.service[120740]: INFO nova.api.openstack.requestlog [None req-a9f5032c-3a2a-495c-8b98-ed97e23162c7 tempest-TestMinimumBasicScenario-820002800 tempest-TestMinimumBasicScenario-820002800-project] 10.222.0.43 "GET /compute/v2.1/servers/f8247a13-94cd-45b2-acc8-8717e1260f37" status: 200 len: 1259 microversion: 2.1 time: 0.065879 Sep 13 18:05:30.378138 dv-cinder-852009-8-iscsi devstack@n-api.service[120740]: [pid: 120740|app: 0|req: 196/382] 10.222.0.43 () {58 vars in 1236 bytes} [Tue Sep 13 18:05:30 2022] GET /compute/v2.1/servers/f8247a13-94cd-45b2-acc8-8717e1260f37 => generated 1259 bytes in 67 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 13 18:05:30.548127 dv-cinder-852009-8-iscsi devstack@n-api.service[120741]: DEBUG nova.api.openstack.wsgi [None req-3adb083b-80f5-4727-9e68-ef45c4d6cd83 tempest-AttachVolumeShelveTestJSON-385853788 tempest-AttachVolumeShelveTestJSON-385853788-project] Calling method '>' {{(pid=120741) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 18:05:30.548680 dv-cinder-852009-8-iscsi devstack@n-api.service[120741]: DEBUG nova.compute.api [None req-3adb083b-80f5-4727-9e68-ef45c4d6cd83 tempest-AttachVolumeShelveTestJSON-385853788 tempest-AttachVolumeShelveTestJSON-385853788-project] [instance: 11d2616a-96f9-4a7a-aab8-219219986a8b] Fetching instance by UUID {{(pid=120741) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 18:05:30.554956 dv-cinder-852009-8-iscsi devstack@n-api.service[120741]: DEBUG oslo_concurrency.lockutils [None req-3adb083b-80f5-4727-9e68-ef45c4d6cd83 tempest-AttachVolumeShelveTestJSON-385853788 tempest-AttachVolumeShelveTestJSON-385853788-project] Acquiring lock "1daf4f4c-0e4a-4779-b53a-78c48397ea2f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120741) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 18:05:30.555443 dv-cinder-852009-8-iscsi devstack@n-api.service[120741]: DEBUG oslo_concurrency.lockutils [None req-3adb083b-80f5-4727-9e68-ef45c4d6cd83 tempest-AttachVolumeShelveTestJSON-385853788 tempest-AttachVolumeShelveTestJSON-385853788-project] Lock "1daf4f4c-0e4a-4779-b53a-78c48397ea2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120741) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 18:05:30.555875 dv-cinder-852009-8-iscsi devstack@n-api.service[120741]: DEBUG oslo_concurrency.lockutils [None req-3adb083b-80f5-4727-9e68-ef45c4d6cd83 tempest-AttachVolumeShelveTestJSON-385853788 tempest-AttachVolumeShelveTestJSON-385853788-project] Lock "1daf4f4c-0e4a-4779-b53a-78c48397ea2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120741) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 18:05:30.556606 dv-cinder-852009-8-iscsi devstack@n-api.service[120741]: DEBUG oslo_concurrency.lockutils [None req-3adb083b-80f5-4727-9e68-ef45c4d6cd83 tempest-AttachVolumeShelveTestJSON-385853788 tempest-AttachVolumeShelveTestJSON-385853788-project] Acquiring lock "1daf4f4c-0e4a-4779-b53a-78c48397ea2f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120741) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 18:05:30.557067 dv-cinder-852009-8-iscsi devstack@n-api.service[120741]: DEBUG oslo_concurrency.lockutils [None req-3adb083b-80f5-4727-9e68-ef45c4d6cd83 tempest-AttachVolumeShelveTestJSON-385853788 tempest-AttachVolumeShelveTestJSON-385853788-project] Lock "1daf4f4c-0e4a-4779-b53a-78c48397ea2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120741) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 18:05:30.557588 dv-cinder-852009-8-iscsi devstack@n-api.service[120741]: DEBUG oslo_concurrency.lockutils [None req-3adb083b-80f5-4727-9e68-ef45c4d6cd83 tempest-AttachVolumeShelveTestJSON-385853788 tempest-AttachVolumeShelveTestJSON-385853788-project] Lock "1daf4f4c-0e4a-4779-b53a-78c48397ea2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120741) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 18:05:30.593808 dv-cinder-852009-8-iscsi devstack@n-api.service[120741]: INFO nova.api.openstack.requestlog [None req-3adb083b-80f5-4727-9e68-ef45c4d6cd83 tempest-AttachVolumeShelveTestJSON-385853788 tempest-AttachVolumeShelveTestJSON-385853788-project] 10.222.0.43 "GET /compute/v2.1/servers/11d2616a-96f9-4a7a-aab8-219219986a8b/os-volume_attachments/966c4c3d-084a-41d9-893a-39e5c5518786" status: 200 len: 194 microversion: 2.20 time: 0.049806 Sep 13 18:05:30.594753 dv-cinder-852009-8-iscsi devstack@n-api.service[120741]: [pid: 120741|app: 0|req: 187/383] 10.222.0.43 () {60 vars in 1454 bytes} [Tue Sep 13 18:05:30 2022] GET /compute/v2.1/servers/11d2616a-96f9-4a7a-aab8-219219986a8b/os-volume_attachments/966c4c3d-084a-41d9-893a-39e5c5518786 => generated 194 bytes in 52 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Sep 13 18:05:30.670882 dv-cinder-852009-8-iscsi devstack@n-api.service[120740]: DEBUG nova.api.openstack.wsgi [None req-b2233eea-014f-41ef-bb7b-1f048e6fb771 tempest-AttachVolumeShelveTestJSON-385853788 tempest-AttachVolumeShelveTestJSON-385853788-project] Calling method '>' {{(pid=120740) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 18:05:30.671412 dv-cinder-852009-8-iscsi devstack@n-api.service[120740]: DEBUG nova.compute.api [None req-b2233eea-014f-41ef-bb7b-1f048e6fb771 tempest-AttachVolumeShelveTestJSON-385853788 tempest-AttachVolumeShelveTestJSON-385853788-project] [instance: 11d2616a-96f9-4a7a-aab8-219219986a8b] Fetching instance by UUID {{(pid=120740) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 18:05:30.679179 dv-cinder-852009-8-iscsi devstack@n-api.service[120740]: DEBUG oslo_concurrency.lockutils [None req-b2233eea-014f-41ef-bb7b-1f048e6fb771 tempest-AttachVolumeShelveTestJSON-385853788 tempest-AttachVolumeShelveTestJSON-385853788-project] Acquiring lock "1daf4f4c-0e4a-4779-b53a-78c48397ea2f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120740) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 18:05:30.679897 dv-cinder-852009-8-iscsi devstack@n-api.service[120740]: DEBUG oslo_concurrency.lockutils [None req-b2233eea-014f-41ef-bb7b-1f048e6fb771 tempest-AttachVolumeShelveTestJSON-385853788 tempest-AttachVolumeShelveTestJSON-385853788-project] Lock "1daf4f4c-0e4a-4779-b53a-78c48397ea2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120740) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 18:05:30.680326 dv-cinder-852009-8-iscsi devstack@n-api.service[120740]: DEBUG oslo_concurrency.lockutils [None req-b2233eea-014f-41ef-bb7b-1f048e6fb771 tempest-AttachVolumeShelveTestJSON-385853788 tempest-AttachVolumeShelveTestJSON-385853788-project] Lock "1daf4f4c-0e4a-4779-b53a-78c48397ea2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120740) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 18:05:30.681081 dv-cinder-852009-8-iscsi devstack@n-api.service[120741]: DEBUG nova.api.openstack.wsgi [None req-5b65b50b-aacc-4e6a-9d78-eb7ceb48c57a tempest-ServerRescueNegativeTestJSON-412251590 tempest-ServerRescueNegativeTestJSON-412251590-project] Calling method '>' {{(pid=120741) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 18:05:30.681545 dv-cinder-852009-8-iscsi devstack@n-api.service[120740]: DEBUG oslo_concurrency.lockutils [None req-b2233eea-014f-41ef-bb7b-1f048e6fb771 tempest-AttachVolumeShelveTestJSON-385853788 tempest-AttachVolumeShelveTestJSON-385853788-project] Acquiring lock "1daf4f4c-0e4a-4779-b53a-78c48397ea2f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120740) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 18:05:30.681896 dv-cinder-852009-8-iscsi devstack@n-api.service[120741]: DEBUG nova.compute.api [None req-5b65b50b-aacc-4e6a-9d78-eb7ceb48c57a tempest-ServerRescueNegativeTestJSON-412251590 tempest-ServerRescueNegativeTestJSON-412251590-project] [instance: e8ce7158-6b73-4586-9f78-8e821988e71c] Fetching instance by UUID {{(pid=120741) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 18:05:30.682312 dv-cinder-852009-8-iscsi devstack@n-api.service[120740]: DEBUG oslo_concurrency.lockutils [None req-b2233eea-014f-41ef-bb7b-1f048e6fb771 tempest-AttachVolumeShelveTestJSON-385853788 tempest-AttachVolumeShelveTestJSON-385853788-project] Lock "1daf4f4c-0e4a-4779-b53a-78c48397ea2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120740) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 18:05:30.682948 dv-cinder-852009-8-iscsi devstack@n-api.service[120740]: DEBUG oslo_concurrency.lockutils [None req-b2233eea-014f-41ef-bb7b-1f048e6fb771 tempest-AttachVolumeShelveTestJSON-385853788 tempest-AttachVolumeShelveTestJSON-385853788-project] Lock "1daf4f4c-0e4a-4779-b53a-78c48397ea2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120740) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 18:05:30.693108 dv-cinder-852009-8-iscsi devstack@n-api.service[120741]: DEBUG oslo_concurrency.lockutils [None req-5b65b50b-aacc-4e6a-9d78-eb7ceb48c57a tempest-ServerRescueNegativeTestJSON-412251590 tempest-ServerRescueNegativeTestJSON-412251590-project] Acquiring lock "1daf4f4c-0e4a-4779-b53a-78c48397ea2f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120741) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 18:05:30.693643 dv-cinder-852009-8-iscsi devstack@n-api.service[120741]: DEBUG oslo_concurrency.lockutils [None req-5b65b50b-aacc-4e6a-9d78-eb7ceb48c57a tempest-ServerRescueNegativeTestJSON-412251590 tempest-ServerRescueNegativeTestJSON-412251590-project] Lock "1daf4f4c-0e4a-4779-b53a-78c48397ea2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120741) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 18:05:30.694060 dv-cinder-852009-8-iscsi devstack@n-api.service[120741]: DEBUG oslo_concurrency.lockutils [None req-5b65b50b-aacc-4e6a-9d78-eb7ceb48c57a tempest-ServerRescueNegativeTestJSON-412251590 tempest-ServerRescueNegativeTestJSON-412251590-project] Lock "1daf4f4c-0e4a-4779-b53a-78c48397ea2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120741) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 18:05:30.694802 dv-cinder-852009-8-iscsi devstack@n-api.service[120741]: DEBUG oslo_concurrency.lockutils [None req-5b65b50b-aacc-4e6a-9d78-eb7ceb48c57a tempest-ServerRescueNegativeTestJSON-412251590 tempest-ServerRescueNegativeTestJSON-412251590-project] Acquiring lock "1daf4f4c-0e4a-4779-b53a-78c48397ea2f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120741) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 18:05:30.695323 dv-cinder-852009-8-iscsi devstack@n-api.service[120741]: DEBUG oslo_concurrency.lockutils [None req-5b65b50b-aacc-4e6a-9d78-eb7ceb48c57a tempest-ServerRescueNegativeTestJSON-412251590 tempest-ServerRescueNegativeTestJSON-412251590-project] Lock "1daf4f4c-0e4a-4779-b53a-78c48397ea2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120741) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 18:05:30.695744 dv-cinder-852009-8-iscsi devstack@n-api.service[120741]: DEBUG oslo_concurrency.lockutils [None req-5b65b50b-aacc-4e6a-9d78-eb7ceb48c57a tempest-ServerRescueNegativeTestJSON-412251590 tempest-ServerRescueNegativeTestJSON-412251590-project] Lock "1daf4f4c-0e4a-4779-b53a-78c48397ea2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120741) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 18:05:30.841235 dv-cinder-852009-8-iscsi devstack@n-api.service[120740]: DEBUG nova.objects.instance [None req-b2233eea-014f-41ef-bb7b-1f048e6fb771 tempest-AttachVolumeShelveTestJSON-385853788 tempest-AttachVolumeShelveTestJSON-385853788-project] Lazy-loading 'services' on Instance uuid 11d2616a-96f9-4a7a-aab8-219219986a8b {{(pid=120740) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Sep 13 18:05:30.841512 dv-cinder-852009-8-iscsi devstack@n-api.service[120741]: DEBUG nova.policy [None req-5b65b50b-aacc-4e6a-9d78-eb7ceb48c57a tempest-ServerRescueNegativeTestJSON-412251590 tempest-ServerRescueNegativeTestJSON-412251590-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '60800cf2774e409d9c1b6f4992669991', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2eae4acecf6c4961830ead78d71b2ad3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120741) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 18:05:30.850515 dv-cinder-852009-8-iscsi devstack@n-api.service[120741]: INFO nova.api.openstack.requestlog [None req-5b65b50b-aacc-4e6a-9d78-eb7ceb48c57a tempest-ServerRescueNegativeTestJSON-412251590 tempest-ServerRescueNegativeTestJSON-412251590-project] 10.222.0.43 "GET /compute/v2.1/servers/e8ce7158-6b73-4586-9f78-8e821988e71c" status: 200 len: 1736 microversion: 2.1 time: 0.174539 Sep 13 18:05:30.851117 dv-cinder-852009-8-iscsi devstack@n-api.service[120741]: [pid: 120741|app: 0|req: 188/384] 10.222.0.43 () {58 vars in 1236 bytes} [Tue Sep 13 18:05:30 2022] GET /compute/v2.1/servers/e8ce7158-6b73-4586-9f78-8e821988e71c => generated 1736 bytes in 176 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 13 18:05:30.966440 dv-cinder-852009-8-iscsi devstack@n-api.service[120740]: INFO nova.api.openstack.requestlog [None req-b2233eea-014f-41ef-bb7b-1f048e6fb771 tempest-AttachVolumeShelveTestJSON-385853788 tempest-AttachVolumeShelveTestJSON-385853788-project] 10.222.0.43 "DELETE /compute/v2.1/servers/11d2616a-96f9-4a7a-aab8-219219986a8b/os-volume_attachments/966c4c3d-084a-41d9-893a-39e5c5518786" status: 202 len: 0 microversion: 2.20 time: 0.299803 Sep 13 18:05:30.967055 dv-cinder-852009-8-iscsi devstack@n-api.service[120740]: [pid: 120740|app: 0|req: 197/385] 10.222.0.43 () {60 vars in 1457 bytes} [Tue Sep 13 18:05:30 2022] DELETE /compute/v2.1/servers/11d2616a-96f9-4a7a-aab8-219219986a8b/os-volume_attachments/966c4c3d-084a-41d9-893a-39e5c5518786 => generated 0 bytes in 302 msecs (HTTP/1.1 202) 9 headers in 363 bytes (1 switches on core 0) Sep 13 18:05:30.975716 dv-cinder-852009-8-iscsi devstack@n-api.service[120741]: DEBUG nova.api.openstack.wsgi [None req-109155ef-4115-457e-8368-e7de2f5f0f03 tempest-AttachVolumeShelveTestJSON-385853788 tempest-AttachVolumeShelveTestJSON-385853788-project] Calling method '>' {{(pid=120741) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 18:05:30.978200 dv-cinder-852009-8-iscsi devstack@n-api.service[120741]: DEBUG nova.compute.api [None req-109155ef-4115-457e-8368-e7de2f5f0f03 tempest-AttachVolumeShelveTestJSON-385853788 tempest-AttachVolumeShelveTestJSON-385853788-project] [instance: 11d2616a-96f9-4a7a-aab8-219219986a8b] Fetching instance by UUID {{(pid=120741) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 18:05:30.985609 dv-cinder-852009-8-iscsi devstack@n-api.service[120741]: DEBUG oslo_concurrency.lockutils [None req-109155ef-4115-457e-8368-e7de2f5f0f03 tempest-AttachVolumeShelveTestJSON-385853788 tempest-AttachVolumeShelveTestJSON-385853788-project] Acquiring lock "1daf4f4c-0e4a-4779-b53a-78c48397ea2f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120741) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 18:05:30.986305 dv-cinder-852009-8-iscsi devstack@n-api.service[120741]: DEBUG oslo_concurrency.lockutils [None req-109155ef-4115-457e-8368-e7de2f5f0f03 tempest-AttachVolumeShelveTestJSON-385853788 tempest-AttachVolumeShelveTestJSON-385853788-project] Lock "1daf4f4c-0e4a-4779-b53a-78c48397ea2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120741) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 18:05:30.987019 dv-cinder-852009-8-iscsi devstack@n-api.service[120741]: DEBUG oslo_concurrency.lockutils [None req-109155ef-4115-457e-8368-e7de2f5f0f03 tempest-AttachVolumeShelveTestJSON-385853788 tempest-AttachVolumeShelveTestJSON-385853788-project] Lock "1daf4f4c-0e4a-4779-b53a-78c48397ea2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120741) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 18:05:30.987613 dv-cinder-852009-8-iscsi devstack@n-api.service[120741]: DEBUG oslo_concurrency.lockutils [None req-109155ef-4115-457e-8368-e7de2f5f0f03 tempest-AttachVolumeShelveTestJSON-385853788 tempest-AttachVolumeShelveTestJSON-385853788-project] Acquiring lock "1daf4f4c-0e4a-4779-b53a-78c48397ea2f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120741) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 18:05:30.987904 dv-cinder-852009-8-iscsi devstack@n-api.service[120741]: DEBUG oslo_concurrency.lockutils [None req-109155ef-4115-457e-8368-e7de2f5f0f03 tempest-AttachVolumeShelveTestJSON-385853788 tempest-AttachVolumeShelveTestJSON-385853788-project] Lock "1daf4f4c-0e4a-4779-b53a-78c48397ea2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120741) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 18:05:30.988301 dv-cinder-852009-8-iscsi devstack@n-api.service[120741]: DEBUG oslo_concurrency.lockutils [None req-109155ef-4115-457e-8368-e7de2f5f0f03 tempest-AttachVolumeShelveTestJSON-385853788 tempest-AttachVolumeShelveTestJSON-385853788-project] Lock "1daf4f4c-0e4a-4779-b53a-78c48397ea2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120741) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 18:05:31.020223 dv-cinder-852009-8-iscsi devstack@n-api.service[120741]: INFO nova.api.openstack.requestlog [None req-109155ef-4115-457e-8368-e7de2f5f0f03 tempest-AttachVolumeShelveTestJSON-385853788 tempest-AttachVolumeShelveTestJSON-385853788-project] 10.222.0.43 "GET /compute/v2.1/servers/11d2616a-96f9-4a7a-aab8-219219986a8b/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.048410 Sep 13 18:05:31.020928 dv-cinder-852009-8-iscsi devstack@n-api.service[120741]: [pid: 120741|app: 0|req: 189/386] 10.222.0.43 () {60 vars in 1343 bytes} [Tue Sep 13 18:05:30 2022] GET /compute/v2.1/servers/11d2616a-96f9-4a7a-aab8-219219986a8b/os-volume_attachments => generated 197 bytes in 50 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Sep 13 18:05:31.278211 dv-cinder-852009-8-iscsi devstack@n-api.service[120740]: DEBUG nova.api.openstack.wsgi [None req-a03da891-9bae-4172-a4a9-feb98460bdaf tempest-AttachVolumeTestJSON-555093534 tempest-AttachVolumeTestJSON-555093534-project] Calling method '>' {{(pid=120740) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 18:05:31.279081 dv-cinder-852009-8-iscsi devstack@n-api.service[120740]: DEBUG nova.compute.api [None req-a03da891-9bae-4172-a4a9-feb98460bdaf tempest-AttachVolumeTestJSON-555093534 tempest-AttachVolumeTestJSON-555093534-project] [instance: b958d409-df20-44c6-aa0e-58cb0a482edf] Fetching instance by UUID {{(pid=120740) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 18:05:31.287217 dv-cinder-852009-8-iscsi devstack@n-api.service[120740]: DEBUG oslo_concurrency.lockutils [None req-a03da891-9bae-4172-a4a9-feb98460bdaf tempest-AttachVolumeTestJSON-555093534 tempest-AttachVolumeTestJSON-555093534-project] Acquiring lock "1daf4f4c-0e4a-4779-b53a-78c48397ea2f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120740) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 18:05:31.287831 dv-cinder-852009-8-iscsi devstack@n-api.service[120740]: DEBUG oslo_concurrency.lockutils [None req-a03da891-9bae-4172-a4a9-feb98460bdaf tempest-AttachVolumeTestJSON-555093534 tempest-AttachVolumeTestJSON-555093534-project] Lock "1daf4f4c-0e4a-4779-b53a-78c48397ea2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120740) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 18:05:31.288357 dv-cinder-852009-8-iscsi devstack@n-api.service[120740]: DEBUG oslo_concurrency.lockutils [None req-a03da891-9bae-4172-a4a9-feb98460bdaf tempest-AttachVolumeTestJSON-555093534 tempest-AttachVolumeTestJSON-555093534-project] Lock "1daf4f4c-0e4a-4779-b53a-78c48397ea2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120740) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 18:05:31.289271 dv-cinder-852009-8-iscsi devstack@n-api.service[120740]: DEBUG oslo_concurrency.lockutils [None req-a03da891-9bae-4172-a4a9-feb98460bdaf tempest-AttachVolumeTestJSON-555093534 tempest-AttachVolumeTestJSON-555093534-project] Acquiring lock "1daf4f4c-0e4a-4779-b53a-78c48397ea2f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120740) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 18:05:31.289730 dv-cinder-852009-8-iscsi devstack@n-api.service[120740]: DEBUG oslo_concurrency.lockutils [None req-a03da891-9bae-4172-a4a9-feb98460bdaf tempest-AttachVolumeTestJSON-555093534 tempest-AttachVolumeTestJSON-555093534-project] Lock "1daf4f4c-0e4a-4779-b53a-78c48397ea2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120740) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 18:05:31.290353 dv-cinder-852009-8-iscsi devstack@n-api.service[120740]: DEBUG oslo_concurrency.lockutils [None req-a03da891-9bae-4172-a4a9-feb98460bdaf tempest-AttachVolumeTestJSON-555093534 tempest-AttachVolumeTestJSON-555093534-project] Lock "1daf4f4c-0e4a-4779-b53a-78c48397ea2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120740) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 18:05:31.399848 dv-cinder-852009-8-iscsi devstack@n-api.service[120741]: DEBUG nova.api.openstack.wsgi [None req-f70a50fa-7ab1-4a1d-a85a-4e68c774756c tempest-TestMinimumBasicScenario-820002800 tempest-TestMinimumBasicScenario-820002800-project] Calling method '>' {{(pid=120741) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 18:05:31.400476 dv-cinder-852009-8-iscsi devstack@n-api.service[120741]: DEBUG nova.compute.api [None req-f70a50fa-7ab1-4a1d-a85a-4e68c774756c tempest-TestMinimumBasicScenario-820002800 tempest-TestMinimumBasicScenario-820002800-project] [instance: f8247a13-94cd-45b2-acc8-8717e1260f37] Fetching instance by UUID {{(pid=120741) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 18:05:31.408505 dv-cinder-852009-8-iscsi devstack@n-api.service[120741]: DEBUG oslo_concurrency.lockutils [None req-f70a50fa-7ab1-4a1d-a85a-4e68c774756c tempest-TestMinimumBasicScenario-820002800 tempest-TestMinimumBasicScenario-820002800-project] Acquiring lock "1daf4f4c-0e4a-4779-b53a-78c48397ea2f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120741) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 18:05:31.409303 dv-cinder-852009-8-iscsi devstack@n-api.service[120741]: DEBUG oslo_concurrency.lockutils [None req-f70a50fa-7ab1-4a1d-a85a-4e68c774756c tempest-TestMinimumBasicScenario-820002800 tempest-TestMinimumBasicScenario-820002800-project] Lock "1daf4f4c-0e4a-4779-b53a-78c48397ea2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120741) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 18:05:31.410045 dv-cinder-852009-8-iscsi devstack@n-api.service[120741]: DEBUG oslo_concurrency.lockutils [None req-f70a50fa-7ab1-4a1d-a85a-4e68c774756c tempest-TestMinimumBasicScenario-820002800 tempest-TestMinimumBasicScenario-820002800-project] Lock "1daf4f4c-0e4a-4779-b53a-78c48397ea2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120741) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 18:05:31.411228 dv-cinder-852009-8-iscsi devstack@n-api.service[120741]: DEBUG oslo_concurrency.lockutils [None req-f70a50fa-7ab1-4a1d-a85a-4e68c774756c tempest-TestMinimumBasicScenario-820002800 tempest-TestMinimumBasicScenario-820002800-project] Acquiring lock "1daf4f4c-0e4a-4779-b53a-78c48397ea2f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120741) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 18:05:31.412500 dv-cinder-852009-8-iscsi devstack@n-api.service[120741]: DEBUG oslo_concurrency.lockutils [None req-f70a50fa-7ab1-4a1d-a85a-4e68c774756c tempest-TestMinimumBasicScenario-820002800 tempest-TestMinimumBasicScenario-820002800-project] Lock "1daf4f4c-0e4a-4779-b53a-78c48397ea2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120741) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 18:05:31.413191 dv-cinder-852009-8-iscsi devstack@n-api.service[120741]: DEBUG oslo_concurrency.lockutils [None req-f70a50fa-7ab1-4a1d-a85a-4e68c774756c tempest-TestMinimumBasicScenario-820002800 tempest-TestMinimumBasicScenario-820002800-project] Lock "1daf4f4c-0e4a-4779-b53a-78c48397ea2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120741) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 18:05:31.431768 dv-cinder-852009-8-iscsi devstack@n-api.service[120740]: DEBUG nova.policy [None req-a03da891-9bae-4172-a4a9-feb98460bdaf tempest-AttachVolumeTestJSON-555093534 tempest-AttachVolumeTestJSON-555093534-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0625b3113ce044bbac4f6142eaade11c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a279fcbf274c4704a31a2b95061e1469', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120740) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 18:05:31.435767 dv-cinder-852009-8-iscsi devstack@n-api.service[120740]: DEBUG dbcounter [-] [120740] Writing DB stats nova_cell1:SELECT=94,nova_cell1:UPDATE=3,nova_cell1:INSERT=3 {{(pid=120740) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 18:05:31.441916 dv-cinder-852009-8-iscsi devstack@n-api.service[120740]: INFO nova.api.openstack.requestlog [None req-a03da891-9bae-4172-a4a9-feb98460bdaf tempest-AttachVolumeTestJSON-555093534 tempest-AttachVolumeTestJSON-555093534-project] 10.222.0.43 "GET /compute/v2.1/servers/b958d409-df20-44c6-aa0e-58cb0a482edf" status: 200 len: 1655 microversion: 2.1 time: 0.170314 Sep 13 18:05:31.443041 dv-cinder-852009-8-iscsi devstack@n-api.service[120740]: [pid: 120740|app: 0|req: 198/387] 10.222.0.43 () {58 vars in 1236 bytes} [Tue Sep 13 18:05:31 2022] GET /compute/v2.1/servers/b958d409-df20-44c6-aa0e-58cb0a482edf => generated 1655 bytes in 173 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 13 18:05:31.464950 dv-cinder-852009-8-iscsi devstack@n-api.service[120740]: DEBUG nova.api.openstack.wsgi [None req-8cc17db8-79aa-423d-aa1d-4c1983ceac91 tempest-AttachVolumeTestJSON-555093534 tempest-AttachVolumeTestJSON-555093534-project] Action: 'action', calling method: >, body: {"os-start": {}} {{(pid=120740) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 13 18:05:31.471919 dv-cinder-852009-8-iscsi devstack@n-api.service[120740]: DEBUG oslo_concurrency.lockutils [None req-8cc17db8-79aa-423d-aa1d-4c1983ceac91 tempest-AttachVolumeTestJSON-555093534 tempest-AttachVolumeTestJSON-555093534-project] Acquiring lock "1daf4f4c-0e4a-4779-b53a-78c48397ea2f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120740) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 18:05:31.472403 dv-cinder-852009-8-iscsi devstack@n-api.service[120740]: DEBUG oslo_concurrency.lockutils [None req-8cc17db8-79aa-423d-aa1d-4c1983ceac91 tempest-AttachVolumeTestJSON-555093534 tempest-AttachVolumeTestJSON-555093534-project] Lock "1daf4f4c-0e4a-4779-b53a-78c48397ea2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120740) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 18:05:31.472876 dv-cinder-852009-8-iscsi devstack@n-api.service[120740]: DEBUG oslo_concurrency.lockutils [None req-8cc17db8-79aa-423d-aa1d-4c1983ceac91 tempest-AttachVolumeTestJSON-555093534 tempest-AttachVolumeTestJSON-555093534-project] Lock "1daf4f4c-0e4a-4779-b53a-78c48397ea2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120740) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 18:05:31.494502 dv-cinder-852009-8-iscsi devstack@n-api.service[120741]: DEBUG nova.policy [None req-f70a50fa-7ab1-4a1d-a85a-4e68c774756c tempest-TestMinimumBasicScenario-820002800 tempest-TestMinimumBasicScenario-820002800-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7880064ff0aa448d9c367c89eba145ff', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2f6832936c824066a4370cc45c5b0282', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120741) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 18:05:31.496583 dv-cinder-852009-8-iscsi devstack@n-api.service[120740]: DEBUG nova.compute.api [None req-8cc17db8-79aa-423d-aa1d-4c1983ceac91 tempest-AttachVolumeTestJSON-555093534 tempest-AttachVolumeTestJSON-555093534-project] [instance: b958d409-df20-44c6-aa0e-58cb0a482edf] Going to try to start instance {{(pid=120740) start /opt/stack/nova/nova/compute/api.py:2785}} Sep 13 18:05:31.504845 dv-cinder-852009-8-iscsi devstack@n-api.service[120741]: INFO nova.api.openstack.requestlog [None req-f70a50fa-7ab1-4a1d-a85a-4e68c774756c tempest-TestMinimumBasicScenario-820002800 tempest-TestMinimumBasicScenario-820002800-project] 10.222.0.43 "GET /compute/v2.1/servers/f8247a13-94cd-45b2-acc8-8717e1260f37" status: 200 len: 1311 microversion: 2.1 time: 0.108771 Sep 13 18:05:31.507111 dv-cinder-852009-8-iscsi devstack@n-api.service[120741]: [pid: 120741|app: 0|req: 190/388] 10.222.0.43 () {58 vars in 1236 bytes} [Tue Sep 13 18:05:31 2022] GET /compute/v2.1/servers/f8247a13-94cd-45b2-acc8-8717e1260f37 => generated 1311 bytes in 111 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 13 18:05:31.546843 dv-cinder-852009-8-iscsi devstack@n-api.service[120740]: INFO nova.api.openstack.requestlog [None req-8cc17db8-79aa-423d-aa1d-4c1983ceac91 tempest-AttachVolumeTestJSON-555093534 tempest-AttachVolumeTestJSON-555093534-project] 10.222.0.43 "POST /compute/v2.1/servers/b958d409-df20-44c6-aa0e-58cb0a482edf/action" status: 202 len: 0 microversion: 2.1 time: 0.085889 Sep 13 18:05:31.550922 dv-cinder-852009-8-iscsi devstack@n-api.service[120740]: [pid: 120740|app: 0|req: 199/389] 10.222.0.43 () {60 vars in 1278 bytes} [Tue Sep 13 18:05:31 2022] POST /compute/v2.1/servers/b958d409-df20-44c6-aa0e-58cb0a482edf/action => generated 0 bytes in 88 msecs (HTTP/1.1 202) 9 headers in 361 bytes (2 switches on core 0) Sep 13 18:05:31.555993 dv-cinder-852009-8-iscsi devstack@n-api.service[120741]: DEBUG nova.api.openstack.wsgi [None req-21f7ea08-854a-4a87-900f-f9d342d3fd8d tempest-AttachVolumeTestJSON-555093534 tempest-AttachVolumeTestJSON-555093534-project] Calling method '>' {{(pid=120741) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 18:05:31.556816 dv-cinder-852009-8-iscsi devstack@n-api.service[120741]: DEBUG nova.compute.api [None req-21f7ea08-854a-4a87-900f-f9d342d3fd8d tempest-AttachVolumeTestJSON-555093534 tempest-AttachVolumeTestJSON-555093534-project] [instance: b958d409-df20-44c6-aa0e-58cb0a482edf] Fetching instance by UUID {{(pid=120741) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 18:05:31.563347 dv-cinder-852009-8-iscsi devstack@n-api.service[120741]: DEBUG oslo_concurrency.lockutils [None req-21f7ea08-854a-4a87-900f-f9d342d3fd8d tempest-AttachVolumeTestJSON-555093534 tempest-AttachVolumeTestJSON-555093534-project] Acquiring lock "1daf4f4c-0e4a-4779-b53a-78c48397ea2f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120741) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 18:05:31.563852 dv-cinder-852009-8-iscsi devstack@n-api.service[120741]: DEBUG oslo_concurrency.lockutils [None req-21f7ea08-854a-4a87-900f-f9d342d3fd8d tempest-AttachVolumeTestJSON-555093534 tempest-AttachVolumeTestJSON-555093534-project] Lock "1daf4f4c-0e4a-4779-b53a-78c48397ea2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120741) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 18:05:31.564374 dv-cinder-852009-8-iscsi devstack@n-api.service[120741]: DEBUG oslo_concurrency.lockutils [None req-21f7ea08-854a-4a87-900f-f9d342d3fd8d tempest-AttachVolumeTestJSON-555093534 tempest-AttachVolumeTestJSON-555093534-project] Lock "1daf4f4c-0e4a-4779-b53a-78c48397ea2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120741) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 18:05:31.565182 dv-cinder-852009-8-iscsi devstack@n-api.service[120741]: DEBUG oslo_concurrency.lockutils [None req-21f7ea08-854a-4a87-900f-f9d342d3fd8d tempest-AttachVolumeTestJSON-555093534 tempest-AttachVolumeTestJSON-555093534-project] Acquiring lock "1daf4f4c-0e4a-4779-b53a-78c48397ea2f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120741) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 18:05:31.565558 dv-cinder-852009-8-iscsi devstack@n-api.service[120741]: DEBUG oslo_concurrency.lockutils [None req-21f7ea08-854a-4a87-900f-f9d342d3fd8d tempest-AttachVolumeTestJSON-555093534 tempest-AttachVolumeTestJSON-555093534-project] Lock "1daf4f4c-0e4a-4779-b53a-78c48397ea2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120741) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 18:05:31.565997 dv-cinder-852009-8-iscsi devstack@n-api.service[120741]: DEBUG oslo_concurrency.lockutils [None req-21f7ea08-854a-4a87-900f-f9d342d3fd8d tempest-AttachVolumeTestJSON-555093534 tempest-AttachVolumeTestJSON-555093534-project] Lock "1daf4f4c-0e4a-4779-b53a-78c48397ea2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120741) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 18:05:31.724718 dv-cinder-852009-8-iscsi devstack@n-api.service[120741]: DEBUG nova.policy [None req-21f7ea08-854a-4a87-900f-f9d342d3fd8d tempest-AttachVolumeTestJSON-555093534 tempest-AttachVolumeTestJSON-555093534-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0625b3113ce044bbac4f6142eaade11c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a279fcbf274c4704a31a2b95061e1469', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120741) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 18:05:31.736719 dv-cinder-852009-8-iscsi devstack@n-api.service[120741]: INFO nova.api.openstack.requestlog [None req-21f7ea08-854a-4a87-900f-f9d342d3fd8d tempest-AttachVolumeTestJSON-555093534 tempest-AttachVolumeTestJSON-555093534-project] 10.222.0.43 "GET /compute/v2.1/servers/b958d409-df20-44c6-aa0e-58cb0a482edf" status: 200 len: 1664 microversion: 2.1 time: 0.184427 Sep 13 18:05:31.737304 dv-cinder-852009-8-iscsi devstack@n-api.service[120741]: [pid: 120741|app: 0|req: 191/390] 10.222.0.43 () {58 vars in 1236 bytes} [Tue Sep 13 18:05:31 2022] GET /compute/v2.1/servers/b958d409-df20-44c6-aa0e-58cb0a482edf => generated 1664 bytes in 186 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 13 18:05:31.879127 dv-cinder-852009-8-iscsi devstack@n-api.service[120740]: DEBUG nova.api.openstack.wsgi [None req-90b2b1d5-d2b3-4074-97ea-a553aa0bb981 tempest-ServerRescueNegativeTestJSON-412251590 tempest-ServerRescueNegativeTestJSON-412251590-project] Calling method '>' {{(pid=120740) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 18:05:31.880265 dv-cinder-852009-8-iscsi devstack@n-api.service[120740]: DEBUG nova.compute.api [None req-90b2b1d5-d2b3-4074-97ea-a553aa0bb981 tempest-ServerRescueNegativeTestJSON-412251590 tempest-ServerRescueNegativeTestJSON-412251590-project] [instance: e8ce7158-6b73-4586-9f78-8e821988e71c] Fetching instance by UUID {{(pid=120740) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 18:05:31.889317 dv-cinder-852009-8-iscsi devstack@n-api.service[120740]: DEBUG oslo_concurrency.lockutils [None req-90b2b1d5-d2b3-4074-97ea-a553aa0bb981 tempest-ServerRescueNegativeTestJSON-412251590 tempest-ServerRescueNegativeTestJSON-412251590-project] Acquiring lock "1daf4f4c-0e4a-4779-b53a-78c48397ea2f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120740) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 18:05:31.889810 dv-cinder-852009-8-iscsi devstack@n-api.service[120740]: DEBUG oslo_concurrency.lockutils [None req-90b2b1d5-d2b3-4074-97ea-a553aa0bb981 tempest-ServerRescueNegativeTestJSON-412251590 tempest-ServerRescueNegativeTestJSON-412251590-project] Lock "1daf4f4c-0e4a-4779-b53a-78c48397ea2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120740) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 18:05:31.890245 dv-cinder-852009-8-iscsi devstack@n-api.service[120740]: DEBUG oslo_concurrency.lockutils [None req-90b2b1d5-d2b3-4074-97ea-a553aa0bb981 tempest-ServerRescueNegativeTestJSON-412251590 tempest-ServerRescueNegativeTestJSON-412251590-project] Lock "1daf4f4c-0e4a-4779-b53a-78c48397ea2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120740) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 18:05:31.890942 dv-cinder-852009-8-iscsi devstack@n-api.service[120740]: DEBUG oslo_concurrency.lockutils [None req-90b2b1d5-d2b3-4074-97ea-a553aa0bb981 tempest-ServerRescueNegativeTestJSON-412251590 tempest-ServerRescueNegativeTestJSON-412251590-project] Acquiring lock "1daf4f4c-0e4a-4779-b53a-78c48397ea2f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120740) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 18:05:31.891367 dv-cinder-852009-8-iscsi devstack@n-api.service[120740]: DEBUG oslo_concurrency.lockutils [None req-90b2b1d5-d2b3-4074-97ea-a553aa0bb981 tempest-ServerRescueNegativeTestJSON-412251590 tempest-ServerRescueNegativeTestJSON-412251590-project] Lock "1daf4f4c-0e4a-4779-b53a-78c48397ea2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120740) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 18:05:31.891819 dv-cinder-852009-8-iscsi devstack@n-api.service[120740]: DEBUG oslo_concurrency.lockutils [None req-90b2b1d5-d2b3-4074-97ea-a553aa0bb981 tempest-ServerRescueNegativeTestJSON-412251590 tempest-ServerRescueNegativeTestJSON-412251590-project] Lock "1daf4f4c-0e4a-4779-b53a-78c48397ea2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120740) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 18:05:32.032693 dv-cinder-852009-8-iscsi devstack@n-api.service[120740]: DEBUG nova.policy [None req-90b2b1d5-d2b3-4074-97ea-a553aa0bb981 tempest-ServerRescueNegativeTestJSON-412251590 tempest-ServerRescueNegativeTestJSON-412251590-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '60800cf2774e409d9c1b6f4992669991', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2eae4acecf6c4961830ead78d71b2ad3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120740) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 18:05:32.035495 dv-cinder-852009-8-iscsi devstack@n-api.service[120741]: DEBUG nova.api.openstack.wsgi [None req-b53c0415-e220-4985-ae9f-838818e6ff97 tempest-AttachVolumeShelveTestJSON-385853788 tempest-AttachVolumeShelveTestJSON-385853788-project] Calling method '>' {{(pid=120741) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 18:05:32.038794 dv-cinder-852009-8-iscsi devstack@n-api.service[120741]: DEBUG nova.compute.api [None req-b53c0415-e220-4985-ae9f-838818e6ff97 tempest-AttachVolumeShelveTestJSON-385853788 tempest-AttachVolumeShelveTestJSON-385853788-project] [instance: 11d2616a-96f9-4a7a-aab8-219219986a8b] Fetching instance by UUID {{(pid=120741) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 18:05:32.044442 dv-cinder-852009-8-iscsi devstack@n-api.service[120740]: INFO nova.api.openstack.requestlog [None req-90b2b1d5-d2b3-4074-97ea-a553aa0bb981 tempest-ServerRescueNegativeTestJSON-412251590 tempest-ServerRescueNegativeTestJSON-412251590-project] 10.222.0.43 "GET /compute/v2.1/servers/e8ce7158-6b73-4586-9f78-8e821988e71c" status: 200 len: 1736 microversion: 2.1 time: 0.172604 Sep 13 18:05:32.046360 dv-cinder-852009-8-iscsi devstack@n-api.service[120741]: DEBUG oslo_concurrency.lockutils [None req-b53c0415-e220-4985-ae9f-838818e6ff97 tempest-AttachVolumeShelveTestJSON-385853788 tempest-AttachVolumeShelveTestJSON-385853788-project] Acquiring lock "1daf4f4c-0e4a-4779-b53a-78c48397ea2f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120741) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 18:05:32.046843 dv-cinder-852009-8-iscsi devstack@n-api.service[120741]: DEBUG oslo_concurrency.lockutils [None req-b53c0415-e220-4985-ae9f-838818e6ff97 tempest-AttachVolumeShelveTestJSON-385853788 tempest-AttachVolumeShelveTestJSON-385853788-project] Lock "1daf4f4c-0e4a-4779-b53a-78c48397ea2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120741) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 18:05:32.047464 dv-cinder-852009-8-iscsi devstack@n-api.service[120741]: DEBUG oslo_concurrency.lockutils [None req-b53c0415-e220-4985-ae9f-838818e6ff97 tempest-AttachVolumeShelveTestJSON-385853788 tempest-AttachVolumeShelveTestJSON-385853788-project] Lock "1daf4f4c-0e4a-4779-b53a-78c48397ea2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120741) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 18:05:32.048169 dv-cinder-852009-8-iscsi devstack@n-api.service[120741]: DEBUG oslo_concurrency.lockutils [None req-b53c0415-e220-4985-ae9f-838818e6ff97 tempest-AttachVolumeShelveTestJSON-385853788 tempest-AttachVolumeShelveTestJSON-385853788-project] Acquiring lock "1daf4f4c-0e4a-4779-b53a-78c48397ea2f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120741) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 18:05:32.048819 dv-cinder-852009-8-iscsi devstack@n-api.service[120741]: DEBUG oslo_concurrency.lockutils [None req-b53c0415-e220-4985-ae9f-838818e6ff97 tempest-AttachVolumeShelveTestJSON-385853788 tempest-AttachVolumeShelveTestJSON-385853788-project] Lock "1daf4f4c-0e4a-4779-b53a-78c48397ea2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120741) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 18:05:32.049239 dv-cinder-852009-8-iscsi devstack@n-api.service[120741]: DEBUG oslo_concurrency.lockutils [None req-b53c0415-e220-4985-ae9f-838818e6ff97 tempest-AttachVolumeShelveTestJSON-385853788 tempest-AttachVolumeShelveTestJSON-385853788-project] Lock "1daf4f4c-0e4a-4779-b53a-78c48397ea2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120741) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 18:05:32.061279 dv-cinder-852009-8-iscsi devstack@n-api.service[120740]: [pid: 120740|app: 0|req: 200/391] 10.222.0.43 () {58 vars in 1236 bytes} [Tue Sep 13 18:05:31 2022] GET /compute/v2.1/servers/e8ce7158-6b73-4586-9f78-8e821988e71c => generated 1736 bytes in 190 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 13 18:05:32.067890 dv-cinder-852009-8-iscsi devstack@n-api.service[120741]: DEBUG dbcounter [-] [120741] Writing DB stats nova_cell1:SELECT=99,nova_cell1:INSERT=1 {{(pid=120741) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 18:05:32.084349 dv-cinder-852009-8-iscsi devstack@n-api.service[120741]: INFO nova.api.openstack.requestlog [None req-b53c0415-e220-4985-ae9f-838818e6ff97 tempest-AttachVolumeShelveTestJSON-385853788 tempest-AttachVolumeShelveTestJSON-385853788-project] 10.222.0.43 "GET /compute/v2.1/servers/11d2616a-96f9-4a7a-aab8-219219986a8b/os-volume_attachments" status: 200 len: 25 microversion: 2.20 time: 0.054582 Sep 13 18:05:32.084349 dv-cinder-852009-8-iscsi devstack@n-api.service[120741]: [pid: 120741|app: 0|req: 192/392] 10.222.0.43 () {60 vars in 1343 bytes} [Tue Sep 13 18:05:32 2022] GET /compute/v2.1/servers/11d2616a-96f9-4a7a-aab8-219219986a8b/os-volume_attachments => generated 25 bytes in 56 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 13 18:05:32.152675 dv-cinder-852009-8-iscsi devstack@n-api.service[120740]: DEBUG nova.api.openstack.wsgi [None req-a00aef21-6e97-449d-990d-c4e0d51724f7 tempest-AttachVolumeShelveTestJSON-385853788 tempest-AttachVolumeShelveTestJSON-385853788-project] Calling method '>' {{(pid=120740) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 18:05:32.153269 dv-cinder-852009-8-iscsi devstack@n-api.service[120740]: DEBUG nova.compute.api [None req-a00aef21-6e97-449d-990d-c4e0d51724f7 tempest-AttachVolumeShelveTestJSON-385853788 tempest-AttachVolumeShelveTestJSON-385853788-project] [instance: 11d2616a-96f9-4a7a-aab8-219219986a8b] Fetching instance by UUID {{(pid=120740) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 18:05:32.159722 dv-cinder-852009-8-iscsi devstack@n-api.service[120740]: DEBUG oslo_concurrency.lockutils [None req-a00aef21-6e97-449d-990d-c4e0d51724f7 tempest-AttachVolumeShelveTestJSON-385853788 tempest-AttachVolumeShelveTestJSON-385853788-project] Acquiring lock "1daf4f4c-0e4a-4779-b53a-78c48397ea2f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120740) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 18:05:32.160535 dv-cinder-852009-8-iscsi devstack@n-api.service[120740]: DEBUG oslo_concurrency.lockutils [None req-a00aef21-6e97-449d-990d-c4e0d51724f7 tempest-AttachVolumeShelveTestJSON-385853788 tempest-AttachVolumeShelveTestJSON-385853788-project] Lock "1daf4f4c-0e4a-4779-b53a-78c48397ea2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120740) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 18:05:32.161320 dv-cinder-852009-8-iscsi devstack@n-api.service[120740]: DEBUG oslo_concurrency.lockutils [None req-a00aef21-6e97-449d-990d-c4e0d51724f7 tempest-AttachVolumeShelveTestJSON-385853788 tempest-AttachVolumeShelveTestJSON-385853788-project] Lock "1daf4f4c-0e4a-4779-b53a-78c48397ea2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120740) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 18:05:32.163571 dv-cinder-852009-8-iscsi devstack@n-api.service[120740]: DEBUG oslo_concurrency.lockutils [None req-a00aef21-6e97-449d-990d-c4e0d51724f7 tempest-AttachVolumeShelveTestJSON-385853788 tempest-AttachVolumeShelveTestJSON-385853788-project] Acquiring lock "1daf4f4c-0e4a-4779-b53a-78c48397ea2f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120740) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 18:05:32.164260 dv-cinder-852009-8-iscsi devstack@n-api.service[120740]: DEBUG oslo_concurrency.lockutils [None req-a00aef21-6e97-449d-990d-c4e0d51724f7 tempest-AttachVolumeShelveTestJSON-385853788 tempest-AttachVolumeShelveTestJSON-385853788-project] Lock "1daf4f4c-0e4a-4779-b53a-78c48397ea2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120740) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 18:05:32.164923 dv-cinder-852009-8-iscsi devstack@n-api.service[120740]: DEBUG oslo_concurrency.lockutils [None req-a00aef21-6e97-449d-990d-c4e0d51724f7 tempest-AttachVolumeShelveTestJSON-385853788 tempest-AttachVolumeShelveTestJSON-385853788-project] Lock "1daf4f4c-0e4a-4779-b53a-78c48397ea2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120740) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 18:05:32.194461 dv-cinder-852009-8-iscsi devstack@n-api.service[120740]: DEBUG nova.compute.api [None req-a00aef21-6e97-449d-990d-c4e0d51724f7 tempest-AttachVolumeShelveTestJSON-385853788 tempest-AttachVolumeShelveTestJSON-385853788-project] [instance: 11d2616a-96f9-4a7a-aab8-219219986a8b] Going to try to terminate instance {{(pid=120740) delete /opt/stack/nova/nova/compute/api.py:2719}} Sep 13 18:05:32.301102 dv-cinder-852009-8-iscsi devstack@n-api.service[120740]: INFO nova.api.openstack.requestlog [None req-a00aef21-6e97-449d-990d-c4e0d51724f7 tempest-AttachVolumeShelveTestJSON-385853788 tempest-AttachVolumeShelveTestJSON-385853788-project] 10.222.0.43 "DELETE /compute/v2.1/servers/11d2616a-96f9-4a7a-aab8-219219986a8b" status: 204 len: 0 microversion: 2.20 time: 0.152998 Sep 13 18:05:32.301707 dv-cinder-852009-8-iscsi devstack@n-api.service[120740]: [pid: 120740|app: 0|req: 201/393] 10.222.0.43 () {60 vars in 1280 bytes} [Tue Sep 13 18:05:32 2022] DELETE /compute/v2.1/servers/11d2616a-96f9-4a7a-aab8-219219986a8b => generated 0 bytes in 155 msecs (HTTP/1.1 204) 9 headers in 365 bytes (1 switches on core 0) Sep 13 18:05:32.310737 dv-cinder-852009-8-iscsi devstack@n-api.service[120741]: DEBUG nova.api.openstack.wsgi [None req-ff501fa4-9889-402a-989c-ee07fa6484cf tempest-AttachVolumeShelveTestJSON-385853788 tempest-AttachVolumeShelveTestJSON-385853788-project] Calling method '>' {{(pid=120741) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 18:05:32.311559 dv-cinder-852009-8-iscsi devstack@n-api.service[120741]: DEBUG nova.compute.api [None req-ff501fa4-9889-402a-989c-ee07fa6484cf tempest-AttachVolumeShelveTestJSON-385853788 tempest-AttachVolumeShelveTestJSON-385853788-project] [instance: 11d2616a-96f9-4a7a-aab8-219219986a8b] Fetching instance by UUID {{(pid=120741) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 18:05:32.319098 dv-cinder-852009-8-iscsi devstack@n-api.service[120741]: DEBUG oslo_concurrency.lockutils [None req-ff501fa4-9889-402a-989c-ee07fa6484cf tempest-AttachVolumeShelveTestJSON-385853788 tempest-AttachVolumeShelveTestJSON-385853788-project] Acquiring lock "1daf4f4c-0e4a-4779-b53a-78c48397ea2f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120741) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 18:05:32.319619 dv-cinder-852009-8-iscsi devstack@n-api.service[120741]: DEBUG oslo_concurrency.lockutils [None req-ff501fa4-9889-402a-989c-ee07fa6484cf tempest-AttachVolumeShelveTestJSON-385853788 tempest-AttachVolumeShelveTestJSON-385853788-project] Lock "1daf4f4c-0e4a-4779-b53a-78c48397ea2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120741) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 18:05:32.320051 dv-cinder-852009-8-iscsi devstack@n-api.service[120741]: DEBUG oslo_concurrency.lockutils [None req-ff501fa4-9889-402a-989c-ee07fa6484cf tempest-AttachVolumeShelveTestJSON-385853788 tempest-AttachVolumeShelveTestJSON-385853788-project] Lock "1daf4f4c-0e4a-4779-b53a-78c48397ea2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120741) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 18:05:32.321229 dv-cinder-852009-8-iscsi devstack@n-api.service[120741]: DEBUG oslo_concurrency.lockutils [None req-ff501fa4-9889-402a-989c-ee07fa6484cf tempest-AttachVolumeShelveTestJSON-385853788 tempest-AttachVolumeShelveTestJSON-385853788-project] Acquiring lock "1daf4f4c-0e4a-4779-b53a-78c48397ea2f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120741) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 18:05:32.321693 dv-cinder-852009-8-iscsi devstack@n-api.service[120741]: DEBUG oslo_concurrency.lockutils [None req-ff501fa4-9889-402a-989c-ee07fa6484cf tempest-AttachVolumeShelveTestJSON-385853788 tempest-AttachVolumeShelveTestJSON-385853788-project] Lock "1daf4f4c-0e4a-4779-b53a-78c48397ea2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120741) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 18:05:32.322546 dv-cinder-852009-8-iscsi devstack@n-api.service[120741]: DEBUG oslo_concurrency.lockutils [None req-ff501fa4-9889-402a-989c-ee07fa6484cf tempest-AttachVolumeShelveTestJSON-385853788 tempest-AttachVolumeShelveTestJSON-385853788-project] Lock "1daf4f4c-0e4a-4779-b53a-78c48397ea2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120741) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 18:05:32.530030 dv-cinder-852009-8-iscsi devstack@n-api.service[120740]: DEBUG nova.api.openstack.wsgi [None req-e304c7c8-af4b-4939-8be0-1e0813100af5 tempest-TestMinimumBasicScenario-820002800 tempest-TestMinimumBasicScenario-820002800-project] Calling method '>' {{(pid=120740) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 18:05:32.530734 dv-cinder-852009-8-iscsi devstack@n-api.service[120740]: DEBUG nova.compute.api [None req-e304c7c8-af4b-4939-8be0-1e0813100af5 tempest-TestMinimumBasicScenario-820002800 tempest-TestMinimumBasicScenario-820002800-project] [instance: f8247a13-94cd-45b2-acc8-8717e1260f37] Fetching instance by UUID {{(pid=120740) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 18:05:32.536796 dv-cinder-852009-8-iscsi devstack@n-api.service[120740]: DEBUG oslo_concurrency.lockutils [None req-e304c7c8-af4b-4939-8be0-1e0813100af5 tempest-TestMinimumBasicScenario-820002800 tempest-TestMinimumBasicScenario-820002800-project] Acquiring lock "1daf4f4c-0e4a-4779-b53a-78c48397ea2f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120740) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 18:05:32.537285 dv-cinder-852009-8-iscsi devstack@n-api.service[120740]: DEBUG oslo_concurrency.lockutils [None req-e304c7c8-af4b-4939-8be0-1e0813100af5 tempest-TestMinimumBasicScenario-820002800 tempest-TestMinimumBasicScenario-820002800-project] Lock "1daf4f4c-0e4a-4779-b53a-78c48397ea2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120740) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 18:05:32.537715 dv-cinder-852009-8-iscsi devstack@n-api.service[120740]: DEBUG oslo_concurrency.lockutils [None req-e304c7c8-af4b-4939-8be0-1e0813100af5 tempest-TestMinimumBasicScenario-820002800 tempest-TestMinimumBasicScenario-820002800-project] Lock "1daf4f4c-0e4a-4779-b53a-78c48397ea2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120740) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 18:05:32.538410 dv-cinder-852009-8-iscsi devstack@n-api.service[120740]: DEBUG oslo_concurrency.lockutils [None req-e304c7c8-af4b-4939-8be0-1e0813100af5 tempest-TestMinimumBasicScenario-820002800 tempest-TestMinimumBasicScenario-820002800-project] Acquiring lock "1daf4f4c-0e4a-4779-b53a-78c48397ea2f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120740) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 18:05:32.538853 dv-cinder-852009-8-iscsi devstack@n-api.service[120740]: DEBUG oslo_concurrency.lockutils [None req-e304c7c8-af4b-4939-8be0-1e0813100af5 tempest-TestMinimumBasicScenario-820002800 tempest-TestMinimumBasicScenario-820002800-project] Lock "1daf4f4c-0e4a-4779-b53a-78c48397ea2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120740) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 18:05:32.539273 dv-cinder-852009-8-iscsi devstack@n-api.service[120740]: DEBUG oslo_concurrency.lockutils [None req-e304c7c8-af4b-4939-8be0-1e0813100af5 tempest-TestMinimumBasicScenario-820002800 tempest-TestMinimumBasicScenario-820002800-project] Lock "1daf4f4c-0e4a-4779-b53a-78c48397ea2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120740) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 18:05:32.624341 dv-cinder-852009-8-iscsi devstack@n-api.service[120740]: DEBUG nova.policy [None req-e304c7c8-af4b-4939-8be0-1e0813100af5 tempest-TestMinimumBasicScenario-820002800 tempest-TestMinimumBasicScenario-820002800-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7880064ff0aa448d9c367c89eba145ff', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2f6832936c824066a4370cc45c5b0282', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120740) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 18:05:32.632989 dv-cinder-852009-8-iscsi devstack@n-api.service[120740]: INFO nova.api.openstack.requestlog [None req-e304c7c8-af4b-4939-8be0-1e0813100af5 tempest-TestMinimumBasicScenario-820002800 tempest-TestMinimumBasicScenario-820002800-project] 10.222.0.43 "GET /compute/v2.1/servers/f8247a13-94cd-45b2-acc8-8717e1260f37" status: 200 len: 1317 microversion: 2.1 time: 0.107240 Sep 13 18:05:32.633785 dv-cinder-852009-8-iscsi devstack@n-api.service[120740]: [pid: 120740|app: 0|req: 202/394] 10.222.0.43 () {58 vars in 1236 bytes} [Tue Sep 13 18:05:32 2022] GET /compute/v2.1/servers/f8247a13-94cd-45b2-acc8-8717e1260f37 => generated 1317 bytes in 109 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 13 18:05:32.707424 dv-cinder-852009-8-iscsi devstack@n-api.service[120741]: DEBUG nova.policy [None req-ff501fa4-9889-402a-989c-ee07fa6484cf tempest-AttachVolumeShelveTestJSON-385853788 tempest-AttachVolumeShelveTestJSON-385853788-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e68ecd9b3ca643539b109f75bb242d6f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '75e14fd88bfb4cd896fa7b070a0fac47', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120741) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 18:05:32.715948 dv-cinder-852009-8-iscsi devstack@n-api.service[120741]: DEBUG nova.policy [None req-ff501fa4-9889-402a-989c-ee07fa6484cf tempest-AttachVolumeShelveTestJSON-385853788 tempest-AttachVolumeShelveTestJSON-385853788-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'e68ecd9b3ca643539b109f75bb242d6f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '75e14fd88bfb4cd896fa7b070a0fac47', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120741) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 18:05:32.717414 dv-cinder-852009-8-iscsi devstack@n-api.service[120741]: DEBUG nova.policy [None req-ff501fa4-9889-402a-989c-ee07fa6484cf tempest-AttachVolumeShelveTestJSON-385853788 tempest-AttachVolumeShelveTestJSON-385853788-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'e68ecd9b3ca643539b109f75bb242d6f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '75e14fd88bfb4cd896fa7b070a0fac47', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120741) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 18:05:32.718583 dv-cinder-852009-8-iscsi devstack@n-api.service[120741]: INFO nova.api.openstack.requestlog [None req-ff501fa4-9889-402a-989c-ee07fa6484cf tempest-AttachVolumeShelveTestJSON-385853788 tempest-AttachVolumeShelveTestJSON-385853788-project] 10.222.0.43 "GET /compute/v2.1/servers/11d2616a-96f9-4a7a-aab8-219219986a8b" status: 200 len: 1722 microversion: 2.20 time: 0.412008 Sep 13 18:05:32.719152 dv-cinder-852009-8-iscsi devstack@n-api.service[120741]: [pid: 120741|app: 0|req: 193/395] 10.222.0.43 () {60 vars in 1277 bytes} [Tue Sep 13 18:05:32 2022] GET /compute/v2.1/servers/11d2616a-96f9-4a7a-aab8-219219986a8b => generated 1722 bytes in 413 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 13 18:05:32.760846 dv-cinder-852009-8-iscsi devstack@n-api.service[120740]: DEBUG nova.api.openstack.wsgi [None req-3d23b35c-80ed-4b64-bcc8-4e3d2a9fb76e tempest-AttachVolumeTestJSON-555093534 tempest-AttachVolumeTestJSON-555093534-project] Calling method '>' {{(pid=120740) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 18:05:32.761551 dv-cinder-852009-8-iscsi devstack@n-api.service[120740]: DEBUG nova.compute.api [None req-3d23b35c-80ed-4b64-bcc8-4e3d2a9fb76e tempest-AttachVolumeTestJSON-555093534 tempest-AttachVolumeTestJSON-555093534-project] [instance: b958d409-df20-44c6-aa0e-58cb0a482edf] Fetching instance by UUID {{(pid=120740) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 18:05:32.767436 dv-cinder-852009-8-iscsi devstack@n-api.service[120740]: DEBUG oslo_concurrency.lockutils [None req-3d23b35c-80ed-4b64-bcc8-4e3d2a9fb76e tempest-AttachVolumeTestJSON-555093534 tempest-AttachVolumeTestJSON-555093534-project] Acquiring lock "1daf4f4c-0e4a-4779-b53a-78c48397ea2f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120740) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 18:05:32.768097 dv-cinder-852009-8-iscsi devstack@n-api.service[120740]: DEBUG oslo_concurrency.lockutils [None req-3d23b35c-80ed-4b64-bcc8-4e3d2a9fb76e tempest-AttachVolumeTestJSON-555093534 tempest-AttachVolumeTestJSON-555093534-project] Lock "1daf4f4c-0e4a-4779-b53a-78c48397ea2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120740) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 18:05:32.768634 dv-cinder-852009-8-iscsi devstack@n-api.service[120740]: DEBUG oslo_concurrency.lockutils [None req-3d23b35c-80ed-4b64-bcc8-4e3d2a9fb76e tempest-AttachVolumeTestJSON-555093534 tempest-AttachVolumeTestJSON-555093534-project] Lock "1daf4f4c-0e4a-4779-b53a-78c48397ea2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120740) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 18:05:32.769397 dv-cinder-852009-8-iscsi devstack@n-api.service[120740]: DEBUG oslo_concurrency.lockutils [None req-3d23b35c-80ed-4b64-bcc8-4e3d2a9fb76e tempest-AttachVolumeTestJSON-555093534 tempest-AttachVolumeTestJSON-555093534-project] Acquiring lock "1daf4f4c-0e4a-4779-b53a-78c48397ea2f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120740) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 18:05:32.769917 dv-cinder-852009-8-iscsi devstack@n-api.service[120740]: DEBUG oslo_concurrency.lockutils [None req-3d23b35c-80ed-4b64-bcc8-4e3d2a9fb76e tempest-AttachVolumeTestJSON-555093534 tempest-AttachVolumeTestJSON-555093534-project] Lock "1daf4f4c-0e4a-4779-b53a-78c48397ea2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120740) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 18:05:32.770423 dv-cinder-852009-8-iscsi devstack@n-api.service[120740]: DEBUG oslo_concurrency.lockutils [None req-3d23b35c-80ed-4b64-bcc8-4e3d2a9fb76e tempest-AttachVolumeTestJSON-555093534 tempest-AttachVolumeTestJSON-555093534-project] Lock "1daf4f4c-0e4a-4779-b53a-78c48397ea2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120740) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 18:05:32.958381 dv-cinder-852009-8-iscsi devstack@n-api.service[120740]: DEBUG nova.policy [None req-3d23b35c-80ed-4b64-bcc8-4e3d2a9fb76e tempest-AttachVolumeTestJSON-555093534 tempest-AttachVolumeTestJSON-555093534-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0625b3113ce044bbac4f6142eaade11c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a279fcbf274c4704a31a2b95061e1469', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120740) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 18:05:32.966686 dv-cinder-852009-8-iscsi devstack@n-api.service[120740]: INFO nova.api.openstack.requestlog [None req-3d23b35c-80ed-4b64-bcc8-4e3d2a9fb76e tempest-AttachVolumeTestJSON-555093534 tempest-AttachVolumeTestJSON-555093534-project] 10.222.0.43 "GET /compute/v2.1/servers/b958d409-df20-44c6-aa0e-58cb0a482edf" status: 200 len: 1664 microversion: 2.1 time: 0.209892 Sep 13 18:05:32.967228 dv-cinder-852009-8-iscsi devstack@n-api.service[120740]: [pid: 120740|app: 0|req: 203/396] 10.222.0.43 () {58 vars in 1236 bytes} [Tue Sep 13 18:05:32 2022] GET /compute/v2.1/servers/b958d409-df20-44c6-aa0e-58cb0a482edf => generated 1664 bytes in 211 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 13 18:05:33.068388 dv-cinder-852009-8-iscsi devstack@n-api.service[120741]: DEBUG nova.api.openstack.wsgi [None req-184075e1-7fc9-495f-9d86-ae9b2ff91315 tempest-ServerRescueNegativeTestJSON-412251590 tempest-ServerRescueNegativeTestJSON-412251590-project] Calling method '>' {{(pid=120741) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 18:05:33.069025 dv-cinder-852009-8-iscsi devstack@n-api.service[120741]: DEBUG nova.compute.api [None req-184075e1-7fc9-495f-9d86-ae9b2ff91315 tempest-ServerRescueNegativeTestJSON-412251590 tempest-ServerRescueNegativeTestJSON-412251590-project] [instance: e8ce7158-6b73-4586-9f78-8e821988e71c] Fetching instance by UUID {{(pid=120741) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 18:05:33.075870 dv-cinder-852009-8-iscsi devstack@n-api.service[120741]: DEBUG oslo_concurrency.lockutils [None req-184075e1-7fc9-495f-9d86-ae9b2ff91315 tempest-ServerRescueNegativeTestJSON-412251590 tempest-ServerRescueNegativeTestJSON-412251590-project] Acquiring lock "1daf4f4c-0e4a-4779-b53a-78c48397ea2f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120741) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 18:05:33.076349 dv-cinder-852009-8-iscsi devstack@n-api.service[120741]: DEBUG oslo_concurrency.lockutils [None req-184075e1-7fc9-495f-9d86-ae9b2ff91315 tempest-ServerRescueNegativeTestJSON-412251590 tempest-ServerRescueNegativeTestJSON-412251590-project] Lock "1daf4f4c-0e4a-4779-b53a-78c48397ea2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120741) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 18:05:33.076810 dv-cinder-852009-8-iscsi devstack@n-api.service[120741]: DEBUG oslo_concurrency.lockutils [None req-184075e1-7fc9-495f-9d86-ae9b2ff91315 tempest-ServerRescueNegativeTestJSON-412251590 tempest-ServerRescueNegativeTestJSON-412251590-project] Lock "1daf4f4c-0e4a-4779-b53a-78c48397ea2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120741) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 18:05:33.077590 dv-cinder-852009-8-iscsi devstack@n-api.service[120741]: DEBUG oslo_concurrency.lockutils [None req-184075e1-7fc9-495f-9d86-ae9b2ff91315 tempest-ServerRescueNegativeTestJSON-412251590 tempest-ServerRescueNegativeTestJSON-412251590-project] Acquiring lock "1daf4f4c-0e4a-4779-b53a-78c48397ea2f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120741) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 18:05:33.078036 dv-cinder-852009-8-iscsi devstack@n-api.service[120741]: DEBUG oslo_concurrency.lockutils [None req-184075e1-7fc9-495f-9d86-ae9b2ff91315 tempest-ServerRescueNegativeTestJSON-412251590 tempest-ServerRescueNegativeTestJSON-412251590-project] Lock "1daf4f4c-0e4a-4779-b53a-78c48397ea2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120741) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 18:05:33.078442 dv-cinder-852009-8-iscsi devstack@n-api.service[120741]: DEBUG oslo_concurrency.lockutils [None req-184075e1-7fc9-495f-9d86-ae9b2ff91315 tempest-ServerRescueNegativeTestJSON-412251590 tempest-ServerRescueNegativeTestJSON-412251590-project] Lock "1daf4f4c-0e4a-4779-b53a-78c48397ea2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120741) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 18:05:33.301038 dv-cinder-852009-8-iscsi devstack@n-api.service[120741]: DEBUG nova.policy [None req-184075e1-7fc9-495f-9d86-ae9b2ff91315 tempest-ServerRescueNegativeTestJSON-412251590 tempest-ServerRescueNegativeTestJSON-412251590-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '60800cf2774e409d9c1b6f4992669991', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2eae4acecf6c4961830ead78d71b2ad3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120741) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 18:05:33.309531 dv-cinder-852009-8-iscsi devstack@n-api.service[120741]: INFO nova.api.openstack.requestlog [None req-184075e1-7fc9-495f-9d86-ae9b2ff91315 tempest-ServerRescueNegativeTestJSON-412251590 tempest-ServerRescueNegativeTestJSON-412251590-project] 10.222.0.43 "GET /compute/v2.1/servers/e8ce7158-6b73-4586-9f78-8e821988e71c" status: 200 len: 1736 microversion: 2.1 time: 0.245016 Sep 13 18:05:33.310236 dv-cinder-852009-8-iscsi devstack@n-api.service[120741]: [pid: 120741|app: 0|req: 194/397] 10.222.0.43 () {58 vars in 1236 bytes} [Tue Sep 13 18:05:33 2022] GET /compute/v2.1/servers/e8ce7158-6b73-4586-9f78-8e821988e71c => generated 1736 bytes in 246 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 13 18:05:33.656466 dv-cinder-852009-8-iscsi devstack@n-api.service[120740]: DEBUG nova.api.openstack.wsgi [None req-dee20499-8ddd-4943-99e6-216ebb4fa42b tempest-TestMinimumBasicScenario-820002800 tempest-TestMinimumBasicScenario-820002800-project] Calling method '>' {{(pid=120740) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 18:05:33.657070 dv-cinder-852009-8-iscsi devstack@n-api.service[120740]: DEBUG nova.compute.api [None req-dee20499-8ddd-4943-99e6-216ebb4fa42b tempest-TestMinimumBasicScenario-820002800 tempest-TestMinimumBasicScenario-820002800-project] [instance: f8247a13-94cd-45b2-acc8-8717e1260f37] Fetching instance by UUID {{(pid=120740) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 18:05:33.663148 dv-cinder-852009-8-iscsi devstack@n-api.service[120740]: DEBUG oslo_concurrency.lockutils [None req-dee20499-8ddd-4943-99e6-216ebb4fa42b tempest-TestMinimumBasicScenario-820002800 tempest-TestMinimumBasicScenario-820002800-project] Acquiring lock "1daf4f4c-0e4a-4779-b53a-78c48397ea2f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120740) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 18:05:33.663632 dv-cinder-852009-8-iscsi devstack@n-api.service[120740]: DEBUG oslo_concurrency.lockutils [None req-dee20499-8ddd-4943-99e6-216ebb4fa42b tempest-TestMinimumBasicScenario-820002800 tempest-TestMinimumBasicScenario-820002800-project] Lock "1daf4f4c-0e4a-4779-b53a-78c48397ea2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120740) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 18:05:33.664062 dv-cinder-852009-8-iscsi devstack@n-api.service[120740]: DEBUG oslo_concurrency.lockutils [None req-dee20499-8ddd-4943-99e6-216ebb4fa42b tempest-TestMinimumBasicScenario-820002800 tempest-TestMinimumBasicScenario-820002800-project] Lock "1daf4f4c-0e4a-4779-b53a-78c48397ea2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120740) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 18:05:33.664777 dv-cinder-852009-8-iscsi devstack@n-api.service[120740]: DEBUG oslo_concurrency.lockutils [None req-dee20499-8ddd-4943-99e6-216ebb4fa42b tempest-TestMinimumBasicScenario-820002800 tempest-TestMinimumBasicScenario-820002800-project] Acquiring lock "1daf4f4c-0e4a-4779-b53a-78c48397ea2f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120740) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 18:05:33.665224 dv-cinder-852009-8-iscsi devstack@n-api.service[120740]: DEBUG oslo_concurrency.lockutils [None req-dee20499-8ddd-4943-99e6-216ebb4fa42b tempest-TestMinimumBasicScenario-820002800 tempest-TestMinimumBasicScenario-820002800-project] Lock "1daf4f4c-0e4a-4779-b53a-78c48397ea2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120740) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 18:05:33.665638 dv-cinder-852009-8-iscsi devstack@n-api.service[120740]: DEBUG oslo_concurrency.lockutils [None req-dee20499-8ddd-4943-99e6-216ebb4fa42b tempest-TestMinimumBasicScenario-820002800 tempest-TestMinimumBasicScenario-820002800-project] Lock "1daf4f4c-0e4a-4779-b53a-78c48397ea2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120740) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 18:05:33.750252 dv-cinder-852009-8-iscsi devstack@n-api.service[120741]: DEBUG nova.api.openstack.wsgi [None req-ea3142e5-17f4-4257-9a2e-028f10db7377 tempest-AttachVolumeShelveTestJSON-385853788 tempest-AttachVolumeShelveTestJSON-385853788-project] Calling method '>' {{(pid=120741) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 18:05:33.750859 dv-cinder-852009-8-iscsi devstack@n-api.service[120741]: DEBUG nova.compute.api [None req-ea3142e5-17f4-4257-9a2e-028f10db7377 tempest-AttachVolumeShelveTestJSON-385853788 tempest-AttachVolumeShelveTestJSON-385853788-project] [instance: 11d2616a-96f9-4a7a-aab8-219219986a8b] Fetching instance by UUID {{(pid=120741) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 18:05:33.757425 dv-cinder-852009-8-iscsi devstack@n-api.service[120741]: DEBUG oslo_concurrency.lockutils [None req-ea3142e5-17f4-4257-9a2e-028f10db7377 tempest-AttachVolumeShelveTestJSON-385853788 tempest-AttachVolumeShelveTestJSON-385853788-project] Acquiring lock "1daf4f4c-0e4a-4779-b53a-78c48397ea2f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120741) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 18:05:33.757899 dv-cinder-852009-8-iscsi devstack@n-api.service[120741]: DEBUG oslo_concurrency.lockutils [None req-ea3142e5-17f4-4257-9a2e-028f10db7377 tempest-AttachVolumeShelveTestJSON-385853788 tempest-AttachVolumeShelveTestJSON-385853788-project] Lock "1daf4f4c-0e4a-4779-b53a-78c48397ea2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120741) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 18:05:33.758324 dv-cinder-852009-8-iscsi devstack@n-api.service[120741]: DEBUG oslo_concurrency.lockutils [None req-ea3142e5-17f4-4257-9a2e-028f10db7377 tempest-AttachVolumeShelveTestJSON-385853788 tempest-AttachVolumeShelveTestJSON-385853788-project] Lock "1daf4f4c-0e4a-4779-b53a-78c48397ea2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120741) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 18:05:33.759008 dv-cinder-852009-8-iscsi devstack@n-api.service[120741]: DEBUG oslo_concurrency.lockutils [None req-ea3142e5-17f4-4257-9a2e-028f10db7377 tempest-AttachVolumeShelveTestJSON-385853788 tempest-AttachVolumeShelveTestJSON-385853788-project] Acquiring lock "1daf4f4c-0e4a-4779-b53a-78c48397ea2f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120741) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 18:05:33.759450 dv-cinder-852009-8-iscsi devstack@n-api.service[120741]: DEBUG oslo_concurrency.lockutils [None req-ea3142e5-17f4-4257-9a2e-028f10db7377 tempest-AttachVolumeShelveTestJSON-385853788 tempest-AttachVolumeShelveTestJSON-385853788-project] Lock "1daf4f4c-0e4a-4779-b53a-78c48397ea2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120741) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 18:05:33.759849 dv-cinder-852009-8-iscsi devstack@n-api.service[120741]: DEBUG oslo_concurrency.lockutils [None req-ea3142e5-17f4-4257-9a2e-028f10db7377 tempest-AttachVolumeShelveTestJSON-385853788 tempest-AttachVolumeShelveTestJSON-385853788-project] Lock "1daf4f4c-0e4a-4779-b53a-78c48397ea2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120741) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 18:05:33.971093 dv-cinder-852009-8-iscsi devstack@n-api.service[120740]: DEBUG nova.policy [None req-dee20499-8ddd-4943-99e6-216ebb4fa42b tempest-TestMinimumBasicScenario-820002800 tempest-TestMinimumBasicScenario-820002800-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7880064ff0aa448d9c367c89eba145ff', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2f6832936c824066a4370cc45c5b0282', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120740) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 18:05:33.988305 dv-cinder-852009-8-iscsi devstack@n-api.service[120740]: INFO nova.api.openstack.requestlog [None req-dee20499-8ddd-4943-99e6-216ebb4fa42b tempest-TestMinimumBasicScenario-820002800 tempest-TestMinimumBasicScenario-820002800-project] 10.222.0.43 "GET /compute/v2.1/servers/f8247a13-94cd-45b2-acc8-8717e1260f37" status: 200 len: 1359 microversion: 2.1 time: 0.335779 Sep 13 18:05:33.991138 dv-cinder-852009-8-iscsi devstack@n-api.service[120740]: [pid: 120740|app: 0|req: 204/398] 10.222.0.43 () {58 vars in 1236 bytes} [Tue Sep 13 18:05:33 2022] GET /compute/v2.1/servers/f8247a13-94cd-45b2-acc8-8717e1260f37 => generated 1359 bytes in 339 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 13 18:05:33.997975 dv-cinder-852009-8-iscsi devstack@n-api.service[120740]: DEBUG nova.api.openstack.wsgi [None req-bcb3c41e-9029-4a5b-9185-f48b2fe08512 tempest-AttachVolumeTestJSON-555093534 tempest-AttachVolumeTestJSON-555093534-project] Calling method '>' {{(pid=120740) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 18:05:33.999218 dv-cinder-852009-8-iscsi devstack@n-api.service[120740]: DEBUG nova.compute.api [None req-bcb3c41e-9029-4a5b-9185-f48b2fe08512 tempest-AttachVolumeTestJSON-555093534 tempest-AttachVolumeTestJSON-555093534-project] [instance: b958d409-df20-44c6-aa0e-58cb0a482edf] Fetching instance by UUID {{(pid=120740) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 18:05:34.007199 dv-cinder-852009-8-iscsi devstack@n-api.service[120740]: DEBUG oslo_concurrency.lockutils [None req-bcb3c41e-9029-4a5b-9185-f48b2fe08512 tempest-AttachVolumeTestJSON-555093534 tempest-AttachVolumeTestJSON-555093534-project] Acquiring lock "1daf4f4c-0e4a-4779-b53a-78c48397ea2f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120740) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 18:05:34.007535 dv-cinder-852009-8-iscsi devstack@n-api.service[120741]: DEBUG nova.policy [None req-ea3142e5-17f4-4257-9a2e-028f10db7377 tempest-AttachVolumeShelveTestJSON-385853788 tempest-AttachVolumeShelveTestJSON-385853788-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e68ecd9b3ca643539b109f75bb242d6f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '75e14fd88bfb4cd896fa7b070a0fac47', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120741) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 18:05:34.008886 dv-cinder-852009-8-iscsi devstack@n-api.service[120740]: DEBUG oslo_concurrency.lockutils [None req-bcb3c41e-9029-4a5b-9185-f48b2fe08512 tempest-AttachVolumeTestJSON-555093534 tempest-AttachVolumeTestJSON-555093534-project] Lock "1daf4f4c-0e4a-4779-b53a-78c48397ea2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120740) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 18:05:34.010151 dv-cinder-852009-8-iscsi devstack@n-api.service[120740]: DEBUG oslo_concurrency.lockutils [None req-bcb3c41e-9029-4a5b-9185-f48b2fe08512 tempest-AttachVolumeTestJSON-555093534 tempest-AttachVolumeTestJSON-555093534-project] Lock "1daf4f4c-0e4a-4779-b53a-78c48397ea2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120740) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 18:05:34.011602 dv-cinder-852009-8-iscsi devstack@n-api.service[120740]: DEBUG oslo_concurrency.lockutils [None req-bcb3c41e-9029-4a5b-9185-f48b2fe08512 tempest-AttachVolumeTestJSON-555093534 tempest-AttachVolumeTestJSON-555093534-project] Acquiring lock "1daf4f4c-0e4a-4779-b53a-78c48397ea2f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120740) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 18:05:34.012056 dv-cinder-852009-8-iscsi devstack@n-api.service[120740]: DEBUG oslo_concurrency.lockutils [None req-bcb3c41e-9029-4a5b-9185-f48b2fe08512 tempest-AttachVolumeTestJSON-555093534 tempest-AttachVolumeTestJSON-555093534-project] Lock "1daf4f4c-0e4a-4779-b53a-78c48397ea2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120740) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 18:05:34.012734 dv-cinder-852009-8-iscsi devstack@n-api.service[120740]: DEBUG oslo_concurrency.lockutils [None req-bcb3c41e-9029-4a5b-9185-f48b2fe08512 tempest-AttachVolumeTestJSON-555093534 tempest-AttachVolumeTestJSON-555093534-project] Lock "1daf4f4c-0e4a-4779-b53a-78c48397ea2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120740) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 18:05:34.031236 dv-cinder-852009-8-iscsi devstack@n-api.service[120741]: DEBUG nova.policy [None req-ea3142e5-17f4-4257-9a2e-028f10db7377 tempest-AttachVolumeShelveTestJSON-385853788 tempest-AttachVolumeShelveTestJSON-385853788-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'e68ecd9b3ca643539b109f75bb242d6f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '75e14fd88bfb4cd896fa7b070a0fac47', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120741) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 18:05:34.036204 dv-cinder-852009-8-iscsi devstack@n-api.service[120741]: DEBUG nova.policy [None req-ea3142e5-17f4-4257-9a2e-028f10db7377 tempest-AttachVolumeShelveTestJSON-385853788 tempest-AttachVolumeShelveTestJSON-385853788-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'e68ecd9b3ca643539b109f75bb242d6f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '75e14fd88bfb4cd896fa7b070a0fac47', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120741) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 18:05:34.037465 dv-cinder-852009-8-iscsi devstack@n-api.service[120741]: INFO nova.api.openstack.requestlog [None req-ea3142e5-17f4-4257-9a2e-028f10db7377 tempest-AttachVolumeShelveTestJSON-385853788 tempest-AttachVolumeShelveTestJSON-385853788-project] 10.222.0.43 "GET /compute/v2.1/servers/11d2616a-96f9-4a7a-aab8-219219986a8b" status: 200 len: 1722 microversion: 2.20 time: 0.291250 Sep 13 18:05:34.040497 dv-cinder-852009-8-iscsi devstack@n-api.service[120741]: [pid: 120741|app: 0|req: 195/399] 10.222.0.43 () {60 vars in 1277 bytes} [Tue Sep 13 18:05:33 2022] GET /compute/v2.1/servers/11d2616a-96f9-4a7a-aab8-219219986a8b => generated 1722 bytes in 295 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Sep 13 18:05:34.291254 dv-cinder-852009-8-iscsi devstack@n-api.service[120740]: DEBUG nova.policy [None req-bcb3c41e-9029-4a5b-9185-f48b2fe08512 tempest-AttachVolumeTestJSON-555093534 tempest-AttachVolumeTestJSON-555093534-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0625b3113ce044bbac4f6142eaade11c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a279fcbf274c4704a31a2b95061e1469', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120740) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 18:05:34.303266 dv-cinder-852009-8-iscsi devstack@n-api.service[120740]: INFO nova.api.openstack.requestlog [None req-bcb3c41e-9029-4a5b-9185-f48b2fe08512 tempest-AttachVolumeTestJSON-555093534 tempest-AttachVolumeTestJSON-555093534-project] 10.222.0.43 "GET /compute/v2.1/servers/b958d409-df20-44c6-aa0e-58cb0a482edf" status: 200 len: 1664 microversion: 2.1 time: 0.310792 Sep 13 18:05:34.309372 dv-cinder-852009-8-iscsi devstack@n-api.service[120740]: [pid: 120740|app: 0|req: 205/400] 10.222.0.43 () {58 vars in 1236 bytes} [Tue Sep 13 18:05:33 2022] GET /compute/v2.1/servers/b958d409-df20-44c6-aa0e-58cb0a482edf => generated 1664 bytes in 317 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 13 18:05:34.332988 dv-cinder-852009-8-iscsi devstack@n-api.service[120741]: DEBUG nova.api.openstack.wsgi [None req-645f233a-3db2-43e4-9569-acef930dead1 tempest-ServerRescueNegativeTestJSON-412251590 tempest-ServerRescueNegativeTestJSON-412251590-project] Calling method '>' {{(pid=120741) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 18:05:34.333695 dv-cinder-852009-8-iscsi devstack@n-api.service[120741]: DEBUG nova.compute.api [None req-645f233a-3db2-43e4-9569-acef930dead1 tempest-ServerRescueNegativeTestJSON-412251590 tempest-ServerRescueNegativeTestJSON-412251590-project] [instance: e8ce7158-6b73-4586-9f78-8e821988e71c] Fetching instance by UUID {{(pid=120741) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 18:05:34.340392 dv-cinder-852009-8-iscsi devstack@n-api.service[120741]: DEBUG oslo_concurrency.lockutils [None req-645f233a-3db2-43e4-9569-acef930dead1 tempest-ServerRescueNegativeTestJSON-412251590 tempest-ServerRescueNegativeTestJSON-412251590-project] Acquiring lock "1daf4f4c-0e4a-4779-b53a-78c48397ea2f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120741) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 18:05:34.341036 dv-cinder-852009-8-iscsi devstack@n-api.service[120741]: DEBUG oslo_concurrency.lockutils [None req-645f233a-3db2-43e4-9569-acef930dead1 tempest-ServerRescueNegativeTestJSON-412251590 tempest-ServerRescueNegativeTestJSON-412251590-project] Lock "1daf4f4c-0e4a-4779-b53a-78c48397ea2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120741) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 18:05:34.341529 dv-cinder-852009-8-iscsi devstack@n-api.service[120741]: DEBUG oslo_concurrency.lockutils [None req-645f233a-3db2-43e4-9569-acef930dead1 tempest-ServerRescueNegativeTestJSON-412251590 tempest-ServerRescueNegativeTestJSON-412251590-project] Lock "1daf4f4c-0e4a-4779-b53a-78c48397ea2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120741) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 18:05:34.342225 dv-cinder-852009-8-iscsi devstack@n-api.service[120741]: DEBUG oslo_concurrency.lockutils [None req-645f233a-3db2-43e4-9569-acef930dead1 tempest-ServerRescueNegativeTestJSON-412251590 tempest-ServerRescueNegativeTestJSON-412251590-project] Acquiring lock "1daf4f4c-0e4a-4779-b53a-78c48397ea2f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120741) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 18:05:34.342670 dv-cinder-852009-8-iscsi devstack@n-api.service[120741]: DEBUG oslo_concurrency.lockutils [None req-645f233a-3db2-43e4-9569-acef930dead1 tempest-ServerRescueNegativeTestJSON-412251590 tempest-ServerRescueNegativeTestJSON-412251590-project] Lock "1daf4f4c-0e4a-4779-b53a-78c48397ea2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120741) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 18:05:34.343086 dv-cinder-852009-8-iscsi devstack@n-api.service[120741]: DEBUG oslo_concurrency.lockutils [None req-645f233a-3db2-43e4-9569-acef930dead1 tempest-ServerRescueNegativeTestJSON-412251590 tempest-ServerRescueNegativeTestJSON-412251590-project] Lock "1daf4f4c-0e4a-4779-b53a-78c48397ea2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120741) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 18:05:34.584723 dv-cinder-852009-8-iscsi devstack@n-api.service[120741]: DEBUG nova.policy [None req-645f233a-3db2-43e4-9569-acef930dead1 tempest-ServerRescueNegativeTestJSON-412251590 tempest-ServerRescueNegativeTestJSON-412251590-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '60800cf2774e409d9c1b6f4992669991', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2eae4acecf6c4961830ead78d71b2ad3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120741) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 18:05:34.601088 dv-cinder-852009-8-iscsi devstack@n-api.service[120741]: INFO nova.api.openstack.requestlog [None req-645f233a-3db2-43e4-9569-acef930dead1 tempest-ServerRescueNegativeTestJSON-412251590 tempest-ServerRescueNegativeTestJSON-412251590-project] 10.222.0.43 "GET /compute/v2.1/servers/e8ce7158-6b73-4586-9f78-8e821988e71c" status: 200 len: 1736 microversion: 2.1 time: 0.269661 Sep 13 18:05:34.601773 dv-cinder-852009-8-iscsi devstack@n-api.service[120741]: [pid: 120741|app: 0|req: 196/401] 10.222.0.43 () {58 vars in 1236 bytes} [Tue Sep 13 18:05:34 2022] GET /compute/v2.1/servers/e8ce7158-6b73-4586-9f78-8e821988e71c => generated 1736 bytes in 274 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 13 18:05:34.629523 dv-cinder-852009-8-iscsi devstack@n-api.service[120740]: DEBUG nova.api.openstack.wsgi [req-b8768e1c-df13-4e31-9505-e6fa21a354ce req-689461f7-cbbd-49f4-ab0a-c6343e38e595 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "f8247a13-94cd-45b2-acc8-8717e1260f37", "tag": "9f86cf72-e29e-4f23-8c9d-afea192c2916"}]} {{(pid=120740) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 13 18:05:34.644600 dv-cinder-852009-8-iscsi devstack@n-api.service[120740]: DEBUG oslo_concurrency.lockutils [req-b8768e1c-df13-4e31-9505-e6fa21a354ce req-689461f7-cbbd-49f4-ab0a-c6343e38e595 service nova] Acquiring lock "1daf4f4c-0e4a-4779-b53a-78c48397ea2f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120740) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 18:05:34.645361 dv-cinder-852009-8-iscsi devstack@n-api.service[120740]: DEBUG oslo_concurrency.lockutils [req-b8768e1c-df13-4e31-9505-e6fa21a354ce req-689461f7-cbbd-49f4-ab0a-c6343e38e595 service nova] Lock "1daf4f4c-0e4a-4779-b53a-78c48397ea2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120740) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 18:05:34.646029 dv-cinder-852009-8-iscsi devstack@n-api.service[120740]: DEBUG oslo_concurrency.lockutils [req-b8768e1c-df13-4e31-9505-e6fa21a354ce req-689461f7-cbbd-49f4-ab0a-c6343e38e595 service nova] Lock "1daf4f4c-0e4a-4779-b53a-78c48397ea2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120740) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 18:05:34.659825 dv-cinder-852009-8-iscsi devstack@n-api.service[120740]: INFO nova.api.openstack.compute.server_external_events [req-b8768e1c-df13-4e31-9505-e6fa21a354ce req-689461f7-cbbd-49f4-ab0a-c6343e38e595 service nova] Creating event network-changed:9f86cf72-e29e-4f23-8c9d-afea192c2916 for instance f8247a13-94cd-45b2-acc8-8717e1260f37 on hv-cinder-85200 Sep 13 18:05:34.665143 dv-cinder-852009-8-iscsi devstack@n-api.service[120740]: INFO nova.api.openstack.requestlog [req-b8768e1c-df13-4e31-9505-e6fa21a354ce req-689461f7-cbbd-49f4-ab0a-c6343e38e595 service nova] 10.222.0.43 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.039659 Sep 13 18:05:34.665995 dv-cinder-852009-8-iscsi devstack@n-api.service[120740]: [pid: 120740|app: 0|req: 206/402] 10.222.0.43 () {64 vars in 1317 bytes} [Tue Sep 13 18:05:34 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 41 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Sep 13 18:05:35.017477 dv-cinder-852009-8-iscsi devstack@n-api.service[120741]: DEBUG nova.api.openstack.wsgi [None req-ca43c9ed-c418-4d22-b39a-2a36458d8829 tempest-TestMinimumBasicScenario-820002800 tempest-TestMinimumBasicScenario-820002800-project] Calling method '>' {{(pid=120741) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 18:05:35.018049 dv-cinder-852009-8-iscsi devstack@n-api.service[120741]: DEBUG nova.compute.api [None req-ca43c9ed-c418-4d22-b39a-2a36458d8829 tempest-TestMinimumBasicScenario-820002800 tempest-TestMinimumBasicScenario-820002800-project] [instance: f8247a13-94cd-45b2-acc8-8717e1260f37] Fetching instance by UUID {{(pid=120741) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 18:05:35.025949 dv-cinder-852009-8-iscsi devstack@n-api.service[120741]: DEBUG oslo_concurrency.lockutils [None req-ca43c9ed-c418-4d22-b39a-2a36458d8829 tempest-TestMinimumBasicScenario-820002800 tempest-TestMinimumBasicScenario-820002800-project] Acquiring lock "1daf4f4c-0e4a-4779-b53a-78c48397ea2f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120741) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 18:05:35.026702 dv-cinder-852009-8-iscsi devstack@n-api.service[120741]: DEBUG oslo_concurrency.lockutils [None req-ca43c9ed-c418-4d22-b39a-2a36458d8829 tempest-TestMinimumBasicScenario-820002800 tempest-TestMinimumBasicScenario-820002800-project] Lock "1daf4f4c-0e4a-4779-b53a-78c48397ea2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120741) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 18:05:35.027211 dv-cinder-852009-8-iscsi devstack@n-api.service[120741]: DEBUG oslo_concurrency.lockutils [None req-ca43c9ed-c418-4d22-b39a-2a36458d8829 tempest-TestMinimumBasicScenario-820002800 tempest-TestMinimumBasicScenario-820002800-project] Lock "1daf4f4c-0e4a-4779-b53a-78c48397ea2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120741) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 18:05:35.027931 dv-cinder-852009-8-iscsi devstack@n-api.service[120741]: DEBUG oslo_concurrency.lockutils [None req-ca43c9ed-c418-4d22-b39a-2a36458d8829 tempest-TestMinimumBasicScenario-820002800 tempest-TestMinimumBasicScenario-820002800-project] Acquiring lock "1daf4f4c-0e4a-4779-b53a-78c48397ea2f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120741) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 18:05:35.028412 dv-cinder-852009-8-iscsi devstack@n-api.service[120741]: DEBUG oslo_concurrency.lockutils [None req-ca43c9ed-c418-4d22-b39a-2a36458d8829 tempest-TestMinimumBasicScenario-820002800 tempest-TestMinimumBasicScenario-820002800-project] Lock "1daf4f4c-0e4a-4779-b53a-78c48397ea2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120741) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 18:05:35.028885 dv-cinder-852009-8-iscsi devstack@n-api.service[120741]: DEBUG oslo_concurrency.lockutils [None req-ca43c9ed-c418-4d22-b39a-2a36458d8829 tempest-TestMinimumBasicScenario-820002800 tempest-TestMinimumBasicScenario-820002800-project] Lock "1daf4f4c-0e4a-4779-b53a-78c48397ea2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120741) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 18:05:35.067250 dv-cinder-852009-8-iscsi devstack@n-api.service[120740]: DEBUG nova.api.openstack.wsgi [None req-eb1ffef0-6a70-4105-ae01-1fd6861f13be tempest-AttachVolumeShelveTestJSON-385853788 tempest-AttachVolumeShelveTestJSON-385853788-project] Calling method '>' {{(pid=120740) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 18:05:35.068635 dv-cinder-852009-8-iscsi devstack@n-api.service[120740]: DEBUG nova.compute.api [None req-eb1ffef0-6a70-4105-ae01-1fd6861f13be tempest-AttachVolumeShelveTestJSON-385853788 tempest-AttachVolumeShelveTestJSON-385853788-project] [instance: 11d2616a-96f9-4a7a-aab8-219219986a8b] Fetching instance by UUID {{(pid=120740) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 18:05:35.075423 dv-cinder-852009-8-iscsi devstack@n-api.service[120740]: DEBUG oslo_concurrency.lockutils [None req-eb1ffef0-6a70-4105-ae01-1fd6861f13be tempest-AttachVolumeShelveTestJSON-385853788 tempest-AttachVolumeShelveTestJSON-385853788-project] Acquiring lock "1daf4f4c-0e4a-4779-b53a-78c48397ea2f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120740) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 18:05:35.075906 dv-cinder-852009-8-iscsi devstack@n-api.service[120740]: DEBUG oslo_concurrency.lockutils [None req-eb1ffef0-6a70-4105-ae01-1fd6861f13be tempest-AttachVolumeShelveTestJSON-385853788 tempest-AttachVolumeShelveTestJSON-385853788-project] Lock "1daf4f4c-0e4a-4779-b53a-78c48397ea2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120740) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 18:05:35.076329 dv-cinder-852009-8-iscsi devstack@n-api.service[120740]: DEBUG oslo_concurrency.lockutils [None req-eb1ffef0-6a70-4105-ae01-1fd6861f13be tempest-AttachVolumeShelveTestJSON-385853788 tempest-AttachVolumeShelveTestJSON-385853788-project] Lock "1daf4f4c-0e4a-4779-b53a-78c48397ea2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120740) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 18:05:35.077058 dv-cinder-852009-8-iscsi devstack@n-api.service[120740]: DEBUG oslo_concurrency.lockutils [None req-eb1ffef0-6a70-4105-ae01-1fd6861f13be tempest-AttachVolumeShelveTestJSON-385853788 tempest-AttachVolumeShelveTestJSON-385853788-project] Acquiring lock "1daf4f4c-0e4a-4779-b53a-78c48397ea2f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120740) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 18:05:35.077568 dv-cinder-852009-8-iscsi devstack@n-api.service[120740]: DEBUG oslo_concurrency.lockutils [None req-eb1ffef0-6a70-4105-ae01-1fd6861f13be tempest-AttachVolumeShelveTestJSON-385853788 tempest-AttachVolumeShelveTestJSON-385853788-project] Lock "1daf4f4c-0e4a-4779-b53a-78c48397ea2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120740) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 18:05:35.077979 dv-cinder-852009-8-iscsi devstack@n-api.service[120740]: DEBUG oslo_concurrency.lockutils [None req-eb1ffef0-6a70-4105-ae01-1fd6861f13be tempest-AttachVolumeShelveTestJSON-385853788 tempest-AttachVolumeShelveTestJSON-385853788-project] Lock "1daf4f4c-0e4a-4779-b53a-78c48397ea2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120740) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 18:05:35.235583 dv-cinder-852009-8-iscsi devstack@n-api.service[120741]: DEBUG nova.policy [None req-ca43c9ed-c418-4d22-b39a-2a36458d8829 tempest-TestMinimumBasicScenario-820002800 tempest-TestMinimumBasicScenario-820002800-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7880064ff0aa448d9c367c89eba145ff', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2f6832936c824066a4370cc45c5b0282', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120741) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 18:05:35.244201 dv-cinder-852009-8-iscsi devstack@n-api.service[120741]: INFO nova.api.openstack.requestlog [None req-ca43c9ed-c418-4d22-b39a-2a36458d8829 tempest-TestMinimumBasicScenario-820002800 tempest-TestMinimumBasicScenario-820002800-project] 10.222.0.43 "GET /compute/v2.1/servers/f8247a13-94cd-45b2-acc8-8717e1260f37" status: 200 len: 1359 microversion: 2.1 time: 0.233825 Sep 13 18:05:35.250280 dv-cinder-852009-8-iscsi devstack@n-api.service[120741]: [pid: 120741|app: 0|req: 197/403] 10.222.0.43 () {58 vars in 1236 bytes} [Tue Sep 13 18:05:35 2022] GET /compute/v2.1/servers/f8247a13-94cd-45b2-acc8-8717e1260f37 => generated 1359 bytes in 241 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 13 18:05:35.265003 dv-cinder-852009-8-iscsi devstack@n-api.service[120740]: DEBUG nova.policy [None req-eb1ffef0-6a70-4105-ae01-1fd6861f13be tempest-AttachVolumeShelveTestJSON-385853788 tempest-AttachVolumeShelveTestJSON-385853788-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e68ecd9b3ca643539b109f75bb242d6f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '75e14fd88bfb4cd896fa7b070a0fac47', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120740) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 18:05:35.274722 dv-cinder-852009-8-iscsi devstack@n-api.service[120740]: DEBUG nova.policy [None req-eb1ffef0-6a70-4105-ae01-1fd6861f13be tempest-AttachVolumeShelveTestJSON-385853788 tempest-AttachVolumeShelveTestJSON-385853788-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'e68ecd9b3ca643539b109f75bb242d6f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '75e14fd88bfb4cd896fa7b070a0fac47', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120740) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 18:05:35.276944 dv-cinder-852009-8-iscsi devstack@n-api.service[120740]: DEBUG nova.policy [None req-eb1ffef0-6a70-4105-ae01-1fd6861f13be tempest-AttachVolumeShelveTestJSON-385853788 tempest-AttachVolumeShelveTestJSON-385853788-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'e68ecd9b3ca643539b109f75bb242d6f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '75e14fd88bfb4cd896fa7b070a0fac47', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120740) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 18:05:35.278266 dv-cinder-852009-8-iscsi devstack@n-api.service[120740]: INFO nova.api.openstack.requestlog [None req-eb1ffef0-6a70-4105-ae01-1fd6861f13be tempest-AttachVolumeShelveTestJSON-385853788 tempest-AttachVolumeShelveTestJSON-385853788-project] 10.222.0.43 "GET /compute/v2.1/servers/11d2616a-96f9-4a7a-aab8-219219986a8b" status: 200 len: 1722 microversion: 2.20 time: 0.215272 Sep 13 18:05:35.278943 dv-cinder-852009-8-iscsi devstack@n-api.service[120740]: [pid: 120740|app: 0|req: 207/404] 10.222.0.43 () {60 vars in 1277 bytes} [Tue Sep 13 18:05:35 2022] GET /compute/v2.1/servers/11d2616a-96f9-4a7a-aab8-219219986a8b => generated 1722 bytes in 217 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Sep 13 18:05:35.327735 dv-cinder-852009-8-iscsi devstack@n-api.service[120741]: DEBUG nova.api.openstack.wsgi [None req-c8e2dc9e-7c1e-4883-9d37-1472b4a09910 tempest-AttachVolumeTestJSON-555093534 tempest-AttachVolumeTestJSON-555093534-project] Calling method '>' {{(pid=120741) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 18:05:35.328366 dv-cinder-852009-8-iscsi devstack@n-api.service[120741]: DEBUG nova.compute.api [None req-c8e2dc9e-7c1e-4883-9d37-1472b4a09910 tempest-AttachVolumeTestJSON-555093534 tempest-AttachVolumeTestJSON-555093534-project] [instance: b958d409-df20-44c6-aa0e-58cb0a482edf] Fetching instance by UUID {{(pid=120741) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 18:05:35.334812 dv-cinder-852009-8-iscsi devstack@n-api.service[120741]: DEBUG oslo_concurrency.lockutils [None req-c8e2dc9e-7c1e-4883-9d37-1472b4a09910 tempest-AttachVolumeTestJSON-555093534 tempest-AttachVolumeTestJSON-555093534-project] Acquiring lock "1daf4f4c-0e4a-4779-b53a-78c48397ea2f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120741) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 18:05:35.335365 dv-cinder-852009-8-iscsi devstack@n-api.service[120741]: DEBUG oslo_concurrency.lockutils [None req-c8e2dc9e-7c1e-4883-9d37-1472b4a09910 tempest-AttachVolumeTestJSON-555093534 tempest-AttachVolumeTestJSON-555093534-project] Lock "1daf4f4c-0e4a-4779-b53a-78c48397ea2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120741) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 18:05:35.335796 dv-cinder-852009-8-iscsi devstack@n-api.service[120741]: DEBUG oslo_concurrency.lockutils [None req-c8e2dc9e-7c1e-4883-9d37-1472b4a09910 tempest-AttachVolumeTestJSON-555093534 tempest-AttachVolumeTestJSON-555093534-project] Lock "1daf4f4c-0e4a-4779-b53a-78c48397ea2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120741) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 18:05:35.336513 dv-cinder-852009-8-iscsi devstack@n-api.service[120741]: DEBUG oslo_concurrency.lockutils [None req-c8e2dc9e-7c1e-4883-9d37-1472b4a09910 tempest-AttachVolumeTestJSON-555093534 tempest-AttachVolumeTestJSON-555093534-project] Acquiring lock "1daf4f4c-0e4a-4779-b53a-78c48397ea2f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120741) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 18:05:35.336962 dv-cinder-852009-8-iscsi devstack@n-api.service[120741]: DEBUG oslo_concurrency.lockutils [None req-c8e2dc9e-7c1e-4883-9d37-1472b4a09910 tempest-AttachVolumeTestJSON-555093534 tempest-AttachVolumeTestJSON-555093534-project] Lock "1daf4f4c-0e4a-4779-b53a-78c48397ea2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120741) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 18:05:35.337380 dv-cinder-852009-8-iscsi devstack@n-api.service[120741]: DEBUG oslo_concurrency.lockutils [None req-c8e2dc9e-7c1e-4883-9d37-1472b4a09910 tempest-AttachVolumeTestJSON-555093534 tempest-AttachVolumeTestJSON-555093534-project] Lock "1daf4f4c-0e4a-4779-b53a-78c48397ea2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120741) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 18:05:35.479624 dv-cinder-852009-8-iscsi devstack@n-api.service[120741]: DEBUG nova.policy [None req-c8e2dc9e-7c1e-4883-9d37-1472b4a09910 tempest-AttachVolumeTestJSON-555093534 tempest-AttachVolumeTestJSON-555093534-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0625b3113ce044bbac4f6142eaade11c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a279fcbf274c4704a31a2b95061e1469', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120741) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 18:05:35.487729 dv-cinder-852009-8-iscsi devstack@n-api.service[120741]: INFO nova.api.openstack.requestlog [None req-c8e2dc9e-7c1e-4883-9d37-1472b4a09910 tempest-AttachVolumeTestJSON-555093534 tempest-AttachVolumeTestJSON-555093534-project] 10.222.0.43 "GET /compute/v2.1/servers/b958d409-df20-44c6-aa0e-58cb0a482edf" status: 200 len: 1668 microversion: 2.1 time: 0.164200 Sep 13 18:05:35.488418 dv-cinder-852009-8-iscsi devstack@n-api.service[120741]: [pid: 120741|app: 0|req: 198/405] 10.222.0.43 () {58 vars in 1236 bytes} [Tue Sep 13 18:05:35 2022] GET /compute/v2.1/servers/b958d409-df20-44c6-aa0e-58cb0a482edf => generated 1668 bytes in 166 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 13 18:05:35.625911 dv-cinder-852009-8-iscsi devstack@n-api.service[120740]: DEBUG nova.api.openstack.wsgi [None req-1e3bf845-2ed8-418d-8bd6-b5092188dbad tempest-ServerRescueNegativeTestJSON-412251590 tempest-ServerRescueNegativeTestJSON-412251590-project] Calling method '>' {{(pid=120740) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 18:05:35.626432 dv-cinder-852009-8-iscsi devstack@n-api.service[120740]: DEBUG nova.compute.api [None req-1e3bf845-2ed8-418d-8bd6-b5092188dbad tempest-ServerRescueNegativeTestJSON-412251590 tempest-ServerRescueNegativeTestJSON-412251590-project] [instance: e8ce7158-6b73-4586-9f78-8e821988e71c] Fetching instance by UUID {{(pid=120740) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 18:05:35.639327 dv-cinder-852009-8-iscsi devstack@n-api.service[120740]: DEBUG oslo_concurrency.lockutils [None req-1e3bf845-2ed8-418d-8bd6-b5092188dbad tempest-ServerRescueNegativeTestJSON-412251590 tempest-ServerRescueNegativeTestJSON-412251590-project] Acquiring lock "1daf4f4c-0e4a-4779-b53a-78c48397ea2f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120740) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 18:05:35.639827 dv-cinder-852009-8-iscsi devstack@n-api.service[120740]: DEBUG oslo_concurrency.lockutils [None req-1e3bf845-2ed8-418d-8bd6-b5092188dbad tempest-ServerRescueNegativeTestJSON-412251590 tempest-ServerRescueNegativeTestJSON-412251590-project] Lock "1daf4f4c-0e4a-4779-b53a-78c48397ea2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120740) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 18:05:35.640259 dv-cinder-852009-8-iscsi devstack@n-api.service[120740]: DEBUG oslo_concurrency.lockutils [None req-1e3bf845-2ed8-418d-8bd6-b5092188dbad tempest-ServerRescueNegativeTestJSON-412251590 tempest-ServerRescueNegativeTestJSON-412251590-project] Lock "1daf4f4c-0e4a-4779-b53a-78c48397ea2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120740) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 18:05:35.641001 dv-cinder-852009-8-iscsi devstack@n-api.service[120740]: DEBUG oslo_concurrency.lockutils [None req-1e3bf845-2ed8-418d-8bd6-b5092188dbad tempest-ServerRescueNegativeTestJSON-412251590 tempest-ServerRescueNegativeTestJSON-412251590-project] Acquiring lock "1daf4f4c-0e4a-4779-b53a-78c48397ea2f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120740) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 18:05:35.641449 dv-cinder-852009-8-iscsi devstack@n-api.service[120740]: DEBUG oslo_concurrency.lockutils [None req-1e3bf845-2ed8-418d-8bd6-b5092188dbad tempest-ServerRescueNegativeTestJSON-412251590 tempest-ServerRescueNegativeTestJSON-412251590-project] Lock "1daf4f4c-0e4a-4779-b53a-78c48397ea2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120740) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 18:05:35.641901 dv-cinder-852009-8-iscsi devstack@n-api.service[120740]: DEBUG oslo_concurrency.lockutils [None req-1e3bf845-2ed8-418d-8bd6-b5092188dbad tempest-ServerRescueNegativeTestJSON-412251590 tempest-ServerRescueNegativeTestJSON-412251590-project] Lock "1daf4f4c-0e4a-4779-b53a-78c48397ea2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120740) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 18:05:35.788754 dv-cinder-852009-8-iscsi devstack@n-api.service[120740]: DEBUG nova.policy [None req-1e3bf845-2ed8-418d-8bd6-b5092188dbad tempest-ServerRescueNegativeTestJSON-412251590 tempest-ServerRescueNegativeTestJSON-412251590-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '60800cf2774e409d9c1b6f4992669991', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2eae4acecf6c4961830ead78d71b2ad3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120740) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 18:05:35.797336 dv-cinder-852009-8-iscsi devstack@n-api.service[120740]: INFO nova.api.openstack.requestlog [None req-1e3bf845-2ed8-418d-8bd6-b5092188dbad tempest-ServerRescueNegativeTestJSON-412251590 tempest-ServerRescueNegativeTestJSON-412251590-project] 10.222.0.43 "GET /compute/v2.1/servers/e8ce7158-6b73-4586-9f78-8e821988e71c" status: 200 len: 1736 microversion: 2.1 time: 0.175421 Sep 13 18:05:35.798160 dv-cinder-852009-8-iscsi devstack@n-api.service[120740]: [pid: 120740|app: 0|req: 208/406] 10.222.0.43 () {58 vars in 1236 bytes} [Tue Sep 13 18:05:35 2022] GET /compute/v2.1/servers/e8ce7158-6b73-4586-9f78-8e821988e71c => generated 1736 bytes in 177 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 13 18:05:36.270445 dv-cinder-852009-8-iscsi devstack@n-api.service[120741]: DEBUG nova.api.openstack.wsgi [None req-e5510b42-841a-48d9-9678-b89f6b0030b7 tempest-TestMinimumBasicScenario-820002800 tempest-TestMinimumBasicScenario-820002800-project] Calling method '>' {{(pid=120741) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 18:05:36.271017 dv-cinder-852009-8-iscsi devstack@n-api.service[120741]: DEBUG nova.compute.api [None req-e5510b42-841a-48d9-9678-b89f6b0030b7 tempest-TestMinimumBasicScenario-820002800 tempest-TestMinimumBasicScenario-820002800-project] [instance: f8247a13-94cd-45b2-acc8-8717e1260f37] Fetching instance by UUID {{(pid=120741) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 18:05:36.278313 dv-cinder-852009-8-iscsi devstack@n-api.service[120741]: DEBUG oslo_concurrency.lockutils [None req-e5510b42-841a-48d9-9678-b89f6b0030b7 tempest-TestMinimumBasicScenario-820002800 tempest-TestMinimumBasicScenario-820002800-project] Acquiring lock "1daf4f4c-0e4a-4779-b53a-78c48397ea2f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120741) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 18:05:36.278713 dv-cinder-852009-8-iscsi devstack@n-api.service[120741]: DEBUG oslo_concurrency.lockutils [None req-e5510b42-841a-48d9-9678-b89f6b0030b7 tempest-TestMinimumBasicScenario-820002800 tempest-TestMinimumBasicScenario-820002800-project] Lock "1daf4f4c-0e4a-4779-b53a-78c48397ea2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120741) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 18:05:36.279134 dv-cinder-852009-8-iscsi devstack@n-api.service[120741]: DEBUG oslo_concurrency.lockutils [None req-e5510b42-841a-48d9-9678-b89f6b0030b7 tempest-TestMinimumBasicScenario-820002800 tempest-TestMinimumBasicScenario-820002800-project] Lock "1daf4f4c-0e4a-4779-b53a-78c48397ea2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120741) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 18:05:36.279813 dv-cinder-852009-8-iscsi devstack@n-api.service[120741]: DEBUG oslo_concurrency.lockutils [None req-e5510b42-841a-48d9-9678-b89f6b0030b7 tempest-TestMinimumBasicScenario-820002800 tempest-TestMinimumBasicScenario-820002800-project] Acquiring lock "1daf4f4c-0e4a-4779-b53a-78c48397ea2f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120741) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 18:05:36.280249 dv-cinder-852009-8-iscsi devstack@n-api.service[120741]: DEBUG oslo_concurrency.lockutils [None req-e5510b42-841a-48d9-9678-b89f6b0030b7 tempest-TestMinimumBasicScenario-820002800 tempest-TestMinimumBasicScenario-820002800-project] Lock "1daf4f4c-0e4a-4779-b53a-78c48397ea2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120741) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 18:05:36.280677 dv-cinder-852009-8-iscsi devstack@n-api.service[120741]: DEBUG oslo_concurrency.lockutils [None req-e5510b42-841a-48d9-9678-b89f6b0030b7 tempest-TestMinimumBasicScenario-820002800 tempest-TestMinimumBasicScenario-820002800-project] Lock "1daf4f4c-0e4a-4779-b53a-78c48397ea2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120741) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 18:05:36.303364 dv-cinder-852009-8-iscsi devstack@n-api.service[120740]: DEBUG nova.api.openstack.wsgi [None req-4074406c-c97d-42d7-ba29-4a44b3540b09 tempest-AttachVolumeShelveTestJSON-385853788 tempest-AttachVolumeShelveTestJSON-385853788-project] Calling method '>' {{(pid=120740) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 18:05:36.304629 dv-cinder-852009-8-iscsi devstack@n-api.service[120740]: DEBUG nova.compute.api [None req-4074406c-c97d-42d7-ba29-4a44b3540b09 tempest-AttachVolumeShelveTestJSON-385853788 tempest-AttachVolumeShelveTestJSON-385853788-project] [instance: 11d2616a-96f9-4a7a-aab8-219219986a8b] Fetching instance by UUID {{(pid=120740) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 18:05:36.311930 dv-cinder-852009-8-iscsi devstack@n-api.service[120740]: DEBUG oslo_concurrency.lockutils [None req-4074406c-c97d-42d7-ba29-4a44b3540b09 tempest-AttachVolumeShelveTestJSON-385853788 tempest-AttachVolumeShelveTestJSON-385853788-project] Acquiring lock "1daf4f4c-0e4a-4779-b53a-78c48397ea2f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120740) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 18:05:36.312769 dv-cinder-852009-8-iscsi devstack@n-api.service[120740]: DEBUG oslo_concurrency.lockutils [None req-4074406c-c97d-42d7-ba29-4a44b3540b09 tempest-AttachVolumeShelveTestJSON-385853788 tempest-AttachVolumeShelveTestJSON-385853788-project] Lock "1daf4f4c-0e4a-4779-b53a-78c48397ea2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120740) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 18:05:36.313526 dv-cinder-852009-8-iscsi devstack@n-api.service[120740]: DEBUG oslo_concurrency.lockutils [None req-4074406c-c97d-42d7-ba29-4a44b3540b09 tempest-AttachVolumeShelveTestJSON-385853788 tempest-AttachVolumeShelveTestJSON-385853788-project] Lock "1daf4f4c-0e4a-4779-b53a-78c48397ea2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120740) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 18:05:36.314264 dv-cinder-852009-8-iscsi devstack@n-api.service[120740]: DEBUG oslo_concurrency.lockutils [None req-4074406c-c97d-42d7-ba29-4a44b3540b09 tempest-AttachVolumeShelveTestJSON-385853788 tempest-AttachVolumeShelveTestJSON-385853788-project] Acquiring lock "1daf4f4c-0e4a-4779-b53a-78c48397ea2f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120740) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 18:05:36.318738 dv-cinder-852009-8-iscsi devstack@n-api.service[120740]: DEBUG oslo_concurrency.lockutils [None req-4074406c-c97d-42d7-ba29-4a44b3540b09 tempest-AttachVolumeShelveTestJSON-385853788 tempest-AttachVolumeShelveTestJSON-385853788-project] Lock "1daf4f4c-0e4a-4779-b53a-78c48397ea2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=120740) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 18:05:36.319288 dv-cinder-852009-8-iscsi devstack@n-api.service[120740]: DEBUG oslo_concurrency.lockutils [None req-4074406c-c97d-42d7-ba29-4a44b3540b09 tempest-AttachVolumeShelveTestJSON-385853788 tempest-AttachVolumeShelveTestJSON-385853788-project] Lock "1daf4f4c-0e4a-4779-b53a-78c48397ea2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120740) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 18:05:36.488793 dv-cinder-852009-8-iscsi devstack@n-api.service[120741]: DEBUG nova.policy [None req-e5510b42-841a-48d9-9678-b89f6b0030b7 tempest-TestMinimumBasicScenario-820002800 tempest-TestMinimumBasicScenario-820002800-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7880064ff0aa448d9c367c89eba145ff', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2f6832936c824066a4370cc45c5b0282', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120741) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 18:05:36.498477 dv-cinder-852009-8-iscsi devstack@n-api.service[120741]: INFO nova.api.openstack.requestlog [None req-e5510b42-841a-48d9-9678-b89f6b0030b7 tempest-TestMinimumBasicScenario-820002800 tempest-TestMinimumBasicScenario-820002800-project] 10.222.0.43 "GET /compute/v2.1/servers/f8247a13-94cd-45b2-acc8-8717e1260f37" status: 200 len: 1359 microversion: 2.1 time: 0.231798 Sep 13 18:05:36.499406 dv-cinder-852009-8-iscsi devstack@n-api.service[120741]: [pid: 120741|app: 0|req: 199/407] 10.222.0.43 () {58 vars in 1236 bytes} [Tue Sep 13 18:05:36 2022] GET /compute/v2.1/servers/f8247a13-94cd-45b2-acc8-8717e1260f37 => generated 1359 bytes in 233 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 13 18:05:36.515057 dv-cinder-852009-8-iscsi devstack@n-api.service[120740]: DEBUG nova.policy [None req-4074406c-c97d-42d7-ba29-4a44b3540b09 tempest-AttachVolumeShelveTestJSON-385853788 tempest-AttachVolumeShelveTestJSON-385853788-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e68ecd9b3ca643539b109f75bb242d6f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '75e14fd88bfb4cd896fa7b070a0fac47', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120740) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 18:05:36.523710 dv-cinder-852009-8-iscsi devstack@n-api.service[120740]: DEBUG nova.policy [None req-4074406c-c97d-42d7-ba29-4a44b3540b09 tempest-AttachVolumeShelveTestJSON-385853788 tempest-AttachVolumeShelveTestJSON-385853788-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'e68ecd9b3ca643539b109f75bb242d6f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '75e14fd88bfb4cd896fa7b070a0fac47', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120740) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 18:05:36.525757 dv-cinder-852009-8-iscsi devstack@n-api.service[120740]: DEBUG nova.policy [None req-4074406c-c97d-42d7-ba29-4a44b3540b09 tempest-AttachVolumeShelveTestJSON-385853788 tempest-AttachVolumeShelveTestJSON-385853788-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'e68ecd9b3ca643539b109f75bb242d6f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '75e14fd88bfb4cd896fa7b070a0fac47', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120740) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 18:05:36.527222 dv-cinder-852009-8-iscsi devstack@n-api.service[120740]: INFO nova.api.openstack.requestlog [None req-4074406c-c97d-42d7-ba29-4a44b3540b09 tempest-AttachVolumeShelveTestJSON-385853788 tempest-AttachVolumeShelveTestJSON-385853788-project] 10.222.0.43 "GET /compute/v2.1/servers/11d2616a-96f9-4a7a-aab8-219219986a8b" status: 200 len: 1722 microversion: 2.20 time: 0.227828 Sep 13 18:05:36.527907 dv-cinder-852009-8-iscsi devstack@n-api.service[120740]: [pid: 120740|app: 0|req: 209/408] 10.222.0.43 () {60 vars in 1277 bytes} [Tue Sep 13 18:05:36 2022] GET /compute/v2.1/servers/11d2616a-96f9-4a7a-aab8-219219986a8b => generated 1722 bytes in 229 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Sep 13 18:05:36.820990 dv-cinder-852009-8-iscsi devstack@n-api.service[120741]: DEBUG nova.api.openstack.wsgi [None req-31a4859b-0def-4f9e-ac37-aa0251b6c056 tempest-ServerRescueNegativeTestJSON-412251590 tempest-ServerRescueNegativeTestJSON-412251590-project] Calling method '>' {{(pid=120741) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 18:05:36.821985 dv-cinder-852009-8-iscsi devstack@n-api.service[120741]: DEBUG nova.compute.api [None req-31a4859b-0def-4f9e-ac37-aa0251b6c056 tempest-ServerRescueNegativeTestJSON-412251590 tempest-ServerRescueNegativeTestJSON-412251590-project] [instance: e8ce7158-6b73-4586-9f78-8e821988e71c] Fetching instance by UUID {{(pid=120741) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 18:05:36.828460 dv-cinder-852009-8-iscsi devstack@n-api.service[120741]: DEBUG oslo_concurrency.lockutils [None req-31a4859b-0def-4f9e-ac37-aa0251b6c056 tempest-ServerRescueNegativeTestJSON-412251590 tempest-ServerRescueNegativeTestJSON-412251590-project] Acquiring lock "1daf4f4c-0e4a-4779-b53a-78c48397ea2f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120741) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 18:05:36.829472 dv-cinder-852009-8-iscsi devstack@n-api.service[120741]: DEBUG oslo_concurrency.lockutils [None req-31a4859b-0def-4f9e-ac37-aa0251b6c056 tempest-ServerRescueNegativeTestJSON-412251590 tempest-ServerRescueNegativeTestJSON-412251590-project] Lock "1daf4f4c-0e4a-4779-b53a-78c48397ea2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120741) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 18:05:36.830134 dv-cinder-852009-8-iscsi devstack@n-api.service[120741]: DEBUG oslo_concurrency.lockutils [None req-31a4859b-0def-4f9e-ac37-aa0251b6c056 tempest-ServerRescueNegativeTestJSON-412251590 tempest-ServerRescueNegativeTestJSON-412251590-project] Lock "1daf4f4c-0e4a-4779-b53a-78c48397ea2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120741) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 18:05:36.830984 dv-cinder-852009-8-iscsi devstack@n-api.service[120741]: DEBUG oslo_concurrency.lockutils [None req-31a4859b-0def-4f9e-ac37-aa0251b6c056 tempest-ServerRescueNegativeTestJSON-412251590 tempest-ServerRescueNegativeTestJSON-412251590-project] Acquiring lock "1daf4f4c-0e4a-4779-b53a-78c48397ea2f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120741) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 18:05:36.831428 dv-cinder-852009-8-iscsi devstack@n-api.service[120741]: DEBUG oslo_concurrency.lockutils [None req-31a4859b-0def-4f9e-ac37-aa0251b6c056 tempest-ServerRescueNegativeTestJSON-412251590 tempest-ServerRescueNegativeTestJSON-412251590-project] Lock "1daf4f4c-0e4a-4779-b53a-78c48397ea2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120741) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 18:05:36.831994 dv-cinder-852009-8-iscsi devstack@n-api.service[120741]: DEBUG oslo_concurrency.lockutils [None req-31a4859b-0def-4f9e-ac37-aa0251b6c056 tempest-ServerRescueNegativeTestJSON-412251590 tempest-ServerRescueNegativeTestJSON-412251590-project] Lock "1daf4f4c-0e4a-4779-b53a-78c48397ea2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120741) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 18:05:36.922542 dv-cinder-852009-8-iscsi devstack@n-api.service[120740]: DEBUG nova.api.openstack.wsgi [req-037a27ef-599e-4cb7-be57-d6bdba5f41d1 req-54236452-40f0-4009-bd7c-db3b25ec03fd service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "11d2616a-96f9-4a7a-aab8-219219986a8b", "name": "network-vif-unplugged", "status": "completed", "tag": "85bfb53c-ec3d-49bc-ade7-acdfac253331"}]} {{(pid=120740) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 13 18:05:36.936443 dv-cinder-852009-8-iscsi devstack@n-api.service[120740]: DEBUG oslo_concurrency.lockutils [req-037a27ef-599e-4cb7-be57-d6bdba5f41d1 req-54236452-40f0-4009-bd7c-db3b25ec03fd service nova] Acquiring lock "1daf4f4c-0e4a-4779-b53a-78c48397ea2f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120740) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 18:05:36.937623 dv-cinder-852009-8-iscsi devstack@n-api.service[120740]: DEBUG oslo_concurrency.lockutils [req-037a27ef-599e-4cb7-be57-d6bdba5f41d1 req-54236452-40f0-4009-bd7c-db3b25ec03fd service nova] Lock "1daf4f4c-0e4a-4779-b53a-78c48397ea2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120740) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 18:05:36.940647 dv-cinder-852009-8-iscsi devstack@n-api.service[120740]: DEBUG oslo_concurrency.lockutils [req-037a27ef-599e-4cb7-be57-d6bdba5f41d1 req-54236452-40f0-4009-bd7c-db3b25ec03fd service nova] Lock "1daf4f4c-0e4a-4779-b53a-78c48397ea2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120740) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 18:05:36.961781 dv-cinder-852009-8-iscsi devstack@n-api.service[120740]: INFO nova.api.openstack.compute.server_external_events [req-037a27ef-599e-4cb7-be57-d6bdba5f41d1 req-54236452-40f0-4009-bd7c-db3b25ec03fd service nova] Creating event network-vif-unplugged:85bfb53c-ec3d-49bc-ade7-acdfac253331 for instance 11d2616a-96f9-4a7a-aab8-219219986a8b on hv-cinder-85200 Sep 13 18:05:36.982682 dv-cinder-852009-8-iscsi devstack@n-api.service[120740]: INFO nova.api.openstack.requestlog [req-037a27ef-599e-4cb7-be57-d6bdba5f41d1 req-54236452-40f0-4009-bd7c-db3b25ec03fd service nova] 10.222.0.43 "POST /compute/v2.1/os-server-external-events" status: 200 len: 185 microversion: 2.1 time: 0.063969 Sep 13 18:05:36.984718 dv-cinder-852009-8-iscsi devstack@n-api.service[120740]: [pid: 120740|app: 0|req: 210/409] 10.222.0.43 () {64 vars in 1317 bytes} [Tue Sep 13 18:05:36 2022] POST /compute/v2.1/os-server-external-events => generated 185 bytes in 67 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Sep 13 18:05:36.987477 dv-cinder-852009-8-iscsi devstack@n-api.service[120741]: DEBUG nova.policy [None req-31a4859b-0def-4f9e-ac37-aa0251b6c056 tempest-ServerRescueNegativeTestJSON-412251590 tempest-ServerRescueNegativeTestJSON-412251590-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '60800cf2774e409d9c1b6f4992669991', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2eae4acecf6c4961830ead78d71b2ad3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120741) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 18:05:36.996629 dv-cinder-852009-8-iscsi devstack@n-api.service[120741]: INFO nova.api.openstack.requestlog [None req-31a4859b-0def-4f9e-ac37-aa0251b6c056 tempest-ServerRescueNegativeTestJSON-412251590 tempest-ServerRescueNegativeTestJSON-412251590-project] 10.222.0.43 "GET /compute/v2.1/servers/e8ce7158-6b73-4586-9f78-8e821988e71c" status: 200 len: 1736 microversion: 2.1 time: 0.179840 Sep 13 18:05:36.997207 dv-cinder-852009-8-iscsi devstack@n-api.service[120741]: [pid: 120741|app: 0|req: 200/410] 10.222.0.43 () {58 vars in 1236 bytes} [Tue Sep 13 18:05:36 2022] GET /compute/v2.1/servers/e8ce7158-6b73-4586-9f78-8e821988e71c => generated 1736 bytes in 181 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 13 18:05:37.523848 dv-cinder-852009-8-iscsi devstack@n-api.service[120740]: DEBUG nova.api.openstack.wsgi [None req-8fc00274-57e5-4a26-9999-d0a35488f2b2 tempest-TestMinimumBasicScenario-820002800 tempest-TestMinimumBasicScenario-820002800-project] Calling method '>' {{(pid=120740) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 18:05:37.524583 dv-cinder-852009-8-iscsi devstack@n-api.service[120740]: DEBUG nova.compute.api [None req-8fc00274-57e5-4a26-9999-d0a35488f2b2 tempest-TestMinimumBasicScenario-820002800 tempest-TestMinimumBasicScenario-820002800-project] [instance: f8247a13-94cd-45b2-acc8-8717e1260f37] Fetching instance by UUID {{(pid=120740) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 18:05:37.531032 dv-cinder-852009-8-iscsi devstack@n-api.service[120740]: DEBUG oslo_concurrency.lockutils [None req-8fc00274-57e5-4a26-9999-d0a35488f2b2 tempest-TestMinimumBasicScenario-820002800 tempest-TestMinimumBasicScenario-820002800-project] Acquiring lock "1daf4f4c-0e4a-4779-b53a-78c48397ea2f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120740) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 18:05:37.531590 dv-cinder-852009-8-iscsi devstack@n-api.service[120740]: DEBUG oslo_concurrency.lockutils [None req-8fc00274-57e5-4a26-9999-d0a35488f2b2 tempest-TestMinimumBasicScenario-820002800 tempest-TestMinimumBasicScenario-820002800-project] Lock "1daf4f4c-0e4a-4779-b53a-78c48397ea2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120740) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 18:05:37.532058 dv-cinder-852009-8-iscsi devstack@n-api.service[120740]: DEBUG oslo_concurrency.lockutils [None req-8fc00274-57e5-4a26-9999-d0a35488f2b2 tempest-TestMinimumBasicScenario-820002800 tempest-TestMinimumBasicScenario-820002800-project] Lock "1daf4f4c-0e4a-4779-b53a-78c48397ea2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120740) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 18:05:37.532776 dv-cinder-852009-8-iscsi devstack@n-api.service[120740]: DEBUG oslo_concurrency.lockutils [None req-8fc00274-57e5-4a26-9999-d0a35488f2b2 tempest-TestMinimumBasicScenario-820002800 tempest-TestMinimumBasicScenario-820002800-project] Acquiring lock "1daf4f4c-0e4a-4779-b53a-78c48397ea2f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120740) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 18:05:37.533224 dv-cinder-852009-8-iscsi devstack@n-api.service[120740]: DEBUG oslo_concurrency.lockutils [None req-8fc00274-57e5-4a26-9999-d0a35488f2b2 tempest-TestMinimumBasicScenario-820002800 tempest-TestMinimumBasicScenario-820002800-project] Lock "1daf4f4c-0e4a-4779-b53a-78c48397ea2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120740) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 18:05:37.533649 dv-cinder-852009-8-iscsi devstack@n-api.service[120740]: DEBUG oslo_concurrency.lockutils [None req-8fc00274-57e5-4a26-9999-d0a35488f2b2 tempest-TestMinimumBasicScenario-820002800 tempest-TestMinimumBasicScenario-820002800-project] Lock "1daf4f4c-0e4a-4779-b53a-78c48397ea2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120740) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 18:05:37.555607 dv-cinder-852009-8-iscsi devstack@n-api.service[120741]: DEBUG nova.api.openstack.wsgi [None req-03ef6798-1c6e-4553-bfc4-fd090c00d1d8 tempest-AttachVolumeShelveTestJSON-385853788 tempest-AttachVolumeShelveTestJSON-385853788-project] Calling method '>' {{(pid=120741) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 18:05:37.557545 dv-cinder-852009-8-iscsi devstack@n-api.service[120741]: DEBUG nova.compute.api [None req-03ef6798-1c6e-4553-bfc4-fd090c00d1d8 tempest-AttachVolumeShelveTestJSON-385853788 tempest-AttachVolumeShelveTestJSON-385853788-project] [instance: 11d2616a-96f9-4a7a-aab8-219219986a8b] Fetching instance by UUID {{(pid=120741) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 18:05:37.565019 dv-cinder-852009-8-iscsi devstack@n-api.service[120741]: DEBUG oslo_concurrency.lockutils [None req-03ef6798-1c6e-4553-bfc4-fd090c00d1d8 tempest-AttachVolumeShelveTestJSON-385853788 tempest-AttachVolumeShelveTestJSON-385853788-project] Acquiring lock "1daf4f4c-0e4a-4779-b53a-78c48397ea2f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120741) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 18:05:37.565841 dv-cinder-852009-8-iscsi devstack@n-api.service[120741]: DEBUG oslo_concurrency.lockutils [None req-03ef6798-1c6e-4553-bfc4-fd090c00d1d8 tempest-AttachVolumeShelveTestJSON-385853788 tempest-AttachVolumeShelveTestJSON-385853788-project] Lock "1daf4f4c-0e4a-4779-b53a-78c48397ea2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120741) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 18:05:37.566507 dv-cinder-852009-8-iscsi devstack@n-api.service[120741]: DEBUG oslo_concurrency.lockutils [None req-03ef6798-1c6e-4553-bfc4-fd090c00d1d8 tempest-AttachVolumeShelveTestJSON-385853788 tempest-AttachVolumeShelveTestJSON-385853788-project] Lock "1daf4f4c-0e4a-4779-b53a-78c48397ea2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120741) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 18:05:37.567531 dv-cinder-852009-8-iscsi devstack@n-api.service[120741]: DEBUG oslo_concurrency.lockutils [None req-03ef6798-1c6e-4553-bfc4-fd090c00d1d8 tempest-AttachVolumeShelveTestJSON-385853788 tempest-AttachVolumeShelveTestJSON-385853788-project] Acquiring lock "1daf4f4c-0e4a-4779-b53a-78c48397ea2f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120741) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 18:05:37.568221 dv-cinder-852009-8-iscsi devstack@n-api.service[120741]: DEBUG oslo_concurrency.lockutils [None req-03ef6798-1c6e-4553-bfc4-fd090c00d1d8 tempest-AttachVolumeShelveTestJSON-385853788 tempest-AttachVolumeShelveTestJSON-385853788-project] Lock "1daf4f4c-0e4a-4779-b53a-78c48397ea2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120741) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 18:05:37.568907 dv-cinder-852009-8-iscsi devstack@n-api.service[120741]: DEBUG oslo_concurrency.lockutils [None req-03ef6798-1c6e-4553-bfc4-fd090c00d1d8 tempest-AttachVolumeShelveTestJSON-385853788 tempest-AttachVolumeShelveTestJSON-385853788-project] Lock "1daf4f4c-0e4a-4779-b53a-78c48397ea2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120741) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 18:05:37.758040 dv-cinder-852009-8-iscsi devstack@n-api.service[120740]: DEBUG nova.policy [None req-8fc00274-57e5-4a26-9999-d0a35488f2b2 tempest-TestMinimumBasicScenario-820002800 tempest-TestMinimumBasicScenario-820002800-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7880064ff0aa448d9c367c89eba145ff', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2f6832936c824066a4370cc45c5b0282', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120740) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 18:05:37.764934 dv-cinder-852009-8-iscsi devstack@n-api.service[120741]: DEBUG nova.policy [None req-03ef6798-1c6e-4553-bfc4-fd090c00d1d8 tempest-AttachVolumeShelveTestJSON-385853788 tempest-AttachVolumeShelveTestJSON-385853788-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e68ecd9b3ca643539b109f75bb242d6f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '75e14fd88bfb4cd896fa7b070a0fac47', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120741) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 18:05:37.766674 dv-cinder-852009-8-iscsi devstack@n-api.service[120740]: INFO nova.api.openstack.requestlog [None req-8fc00274-57e5-4a26-9999-d0a35488f2b2 tempest-TestMinimumBasicScenario-820002800 tempest-TestMinimumBasicScenario-820002800-project] 10.222.0.43 "GET /compute/v2.1/servers/f8247a13-94cd-45b2-acc8-8717e1260f37" status: 200 len: 1359 microversion: 2.1 time: 0.247682 Sep 13 18:05:37.767257 dv-cinder-852009-8-iscsi devstack@n-api.service[120740]: [pid: 120740|app: 0|req: 211/411] 10.222.0.43 () {58 vars in 1236 bytes} [Tue Sep 13 18:05:37 2022] GET /compute/v2.1/servers/f8247a13-94cd-45b2-acc8-8717e1260f37 => generated 1359 bytes in 249 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 13 18:05:37.773102 dv-cinder-852009-8-iscsi devstack@n-api.service[120741]: DEBUG nova.policy [None req-03ef6798-1c6e-4553-bfc4-fd090c00d1d8 tempest-AttachVolumeShelveTestJSON-385853788 tempest-AttachVolumeShelveTestJSON-385853788-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'e68ecd9b3ca643539b109f75bb242d6f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '75e14fd88bfb4cd896fa7b070a0fac47', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120741) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 18:05:37.774618 dv-cinder-852009-8-iscsi devstack@n-api.service[120741]: DEBUG nova.policy [None req-03ef6798-1c6e-4553-bfc4-fd090c00d1d8 tempest-AttachVolumeShelveTestJSON-385853788 tempest-AttachVolumeShelveTestJSON-385853788-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'e68ecd9b3ca643539b109f75bb242d6f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '75e14fd88bfb4cd896fa7b070a0fac47', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120741) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 18:05:37.775748 dv-cinder-852009-8-iscsi devstack@n-api.service[120741]: INFO nova.api.openstack.requestlog [None req-03ef6798-1c6e-4553-bfc4-fd090c00d1d8 tempest-AttachVolumeShelveTestJSON-385853788 tempest-AttachVolumeShelveTestJSON-385853788-project] 10.222.0.43 "GET /compute/v2.1/servers/11d2616a-96f9-4a7a-aab8-219219986a8b" status: 200 len: 1722 microversion: 2.20 time: 0.225625 Sep 13 18:05:37.776616 dv-cinder-852009-8-iscsi devstack@n-api.service[120741]: [pid: 120741|app: 0|req: 201/412] 10.222.0.43 () {60 vars in 1277 bytes} [Tue Sep 13 18:05:37 2022] GET /compute/v2.1/servers/11d2616a-96f9-4a7a-aab8-219219986a8b => generated 1722 bytes in 227 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Sep 13 18:05:38.020622 dv-cinder-852009-8-iscsi devstack@n-api.service[120740]: DEBUG nova.api.openstack.wsgi [None req-669ce996-d793-4675-b6fb-a5ccada89208 tempest-ServerRescueNegativeTestJSON-412251590 tempest-ServerRescueNegativeTestJSON-412251590-project] Calling method '>' {{(pid=120740) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 18:05:38.021223 dv-cinder-852009-8-iscsi devstack@n-api.service[120740]: DEBUG nova.compute.api [None req-669ce996-d793-4675-b6fb-a5ccada89208 tempest-ServerRescueNegativeTestJSON-412251590 tempest-ServerRescueNegativeTestJSON-412251590-project] [instance: e8ce7158-6b73-4586-9f78-8e821988e71c] Fetching instance by UUID {{(pid=120740) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 18:05:38.027984 dv-cinder-852009-8-iscsi devstack@n-api.service[120740]: DEBUG oslo_concurrency.lockutils [None req-669ce996-d793-4675-b6fb-a5ccada89208 tempest-ServerRescueNegativeTestJSON-412251590 tempest-ServerRescueNegativeTestJSON-412251590-project] Acquiring lock "1daf4f4c-0e4a-4779-b53a-78c48397ea2f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120740) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 18:05:38.028487 dv-cinder-852009-8-iscsi devstack@n-api.service[120740]: DEBUG oslo_concurrency.lockutils [None req-669ce996-d793-4675-b6fb-a5ccada89208 tempest-ServerRescueNegativeTestJSON-412251590 tempest-ServerRescueNegativeTestJSON-412251590-project] Lock "1daf4f4c-0e4a-4779-b53a-78c48397ea2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120740) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 18:05:38.028915 dv-cinder-852009-8-iscsi devstack@n-api.service[120740]: DEBUG oslo_concurrency.lockutils [None req-669ce996-d793-4675-b6fb-a5ccada89208 tempest-ServerRescueNegativeTestJSON-412251590 tempest-ServerRescueNegativeTestJSON-412251590-project] Lock "1daf4f4c-0e4a-4779-b53a-78c48397ea2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120740) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 18:05:38.031748 dv-cinder-852009-8-iscsi devstack@n-api.service[120740]: DEBUG oslo_concurrency.lockutils [None req-669ce996-d793-4675-b6fb-a5ccada89208 tempest-ServerRescueNegativeTestJSON-412251590 tempest-ServerRescueNegativeTestJSON-412251590-project] Acquiring lock "1daf4f4c-0e4a-4779-b53a-78c48397ea2f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120740) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 18:05:38.031748 dv-cinder-852009-8-iscsi devstack@n-api.service[120740]: DEBUG oslo_concurrency.lockutils [None req-669ce996-d793-4675-b6fb-a5ccada89208 tempest-ServerRescueNegativeTestJSON-412251590 tempest-ServerRescueNegativeTestJSON-412251590-project] Lock "1daf4f4c-0e4a-4779-b53a-78c48397ea2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120740) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 18:05:38.031748 dv-cinder-852009-8-iscsi devstack@n-api.service[120740]: DEBUG oslo_concurrency.lockutils [None req-669ce996-d793-4675-b6fb-a5ccada89208 tempest-ServerRescueNegativeTestJSON-412251590 tempest-ServerRescueNegativeTestJSON-412251590-project] Lock "1daf4f4c-0e4a-4779-b53a-78c48397ea2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120740) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 18:05:38.171652 dv-cinder-852009-8-iscsi devstack@n-api.service[120740]: DEBUG nova.policy [None req-669ce996-d793-4675-b6fb-a5ccada89208 tempest-ServerRescueNegativeTestJSON-412251590 tempest-ServerRescueNegativeTestJSON-412251590-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '60800cf2774e409d9c1b6f4992669991', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2eae4acecf6c4961830ead78d71b2ad3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120740) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 18:05:38.180536 dv-cinder-852009-8-iscsi devstack@n-api.service[120740]: INFO nova.api.openstack.requestlog [None req-669ce996-d793-4675-b6fb-a5ccada89208 tempest-ServerRescueNegativeTestJSON-412251590 tempest-ServerRescueNegativeTestJSON-412251590-project] 10.222.0.43 "GET /compute/v2.1/servers/e8ce7158-6b73-4586-9f78-8e821988e71c" status: 200 len: 1736 microversion: 2.1 time: 0.163719 Sep 13 18:05:38.184610 dv-cinder-852009-8-iscsi devstack@n-api.service[120740]: [pid: 120740|app: 0|req: 212/413] 10.222.0.43 () {58 vars in 1236 bytes} [Tue Sep 13 18:05:38 2022] GET /compute/v2.1/servers/e8ce7158-6b73-4586-9f78-8e821988e71c => generated 1736 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 13 18:05:38.793441 dv-cinder-852009-8-iscsi devstack@n-api.service[120741]: DEBUG nova.api.openstack.wsgi [None req-0327b6d7-414c-44f9-a5ee-74734ca438c1 tempest-TestMinimumBasicScenario-820002800 tempest-TestMinimumBasicScenario-820002800-project] Calling method '>' {{(pid=120741) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 18:05:38.796639 dv-cinder-852009-8-iscsi devstack@n-api.service[120741]: DEBUG nova.compute.api [None req-0327b6d7-414c-44f9-a5ee-74734ca438c1 tempest-TestMinimumBasicScenario-820002800 tempest-TestMinimumBasicScenario-820002800-project] [instance: f8247a13-94cd-45b2-acc8-8717e1260f37] Fetching instance by UUID {{(pid=120741) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 18:05:38.803195 dv-cinder-852009-8-iscsi devstack@n-api.service[120740]: DEBUG nova.api.openstack.wsgi [None req-fed10e69-8453-44d9-bab9-f59ecebad855 tempest-AttachVolumeShelveTestJSON-385853788 tempest-AttachVolumeShelveTestJSON-385853788-project] Calling method '>' {{(pid=120740) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 18:05:38.803884 dv-cinder-852009-8-iscsi devstack@n-api.service[120740]: DEBUG nova.compute.api [None req-fed10e69-8453-44d9-bab9-f59ecebad855 tempest-AttachVolumeShelveTestJSON-385853788 tempest-AttachVolumeShelveTestJSON-385853788-project] [instance: 11d2616a-96f9-4a7a-aab8-219219986a8b] Fetching instance by UUID {{(pid=120740) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 18:05:38.805650 dv-cinder-852009-8-iscsi devstack@n-api.service[120741]: DEBUG oslo_concurrency.lockutils [None req-0327b6d7-414c-44f9-a5ee-74734ca438c1 tempest-TestMinimumBasicScenario-820002800 tempest-TestMinimumBasicScenario-820002800-project] Acquiring lock "1daf4f4c-0e4a-4779-b53a-78c48397ea2f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120741) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 18:05:38.806350 dv-cinder-852009-8-iscsi devstack@n-api.service[120741]: DEBUG oslo_concurrency.lockutils [None req-0327b6d7-414c-44f9-a5ee-74734ca438c1 tempest-TestMinimumBasicScenario-820002800 tempest-TestMinimumBasicScenario-820002800-project] Lock "1daf4f4c-0e4a-4779-b53a-78c48397ea2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120741) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 18:05:38.806782 dv-cinder-852009-8-iscsi devstack@n-api.service[120741]: DEBUG oslo_concurrency.lockutils [None req-0327b6d7-414c-44f9-a5ee-74734ca438c1 tempest-TestMinimumBasicScenario-820002800 tempest-TestMinimumBasicScenario-820002800-project] Lock "1daf4f4c-0e4a-4779-b53a-78c48397ea2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120741) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 18:05:38.807759 dv-cinder-852009-8-iscsi devstack@n-api.service[120741]: DEBUG oslo_concurrency.lockutils [None req-0327b6d7-414c-44f9-a5ee-74734ca438c1 tempest-TestMinimumBasicScenario-820002800 tempest-TestMinimumBasicScenario-820002800-project] Acquiring lock "1daf4f4c-0e4a-4779-b53a-78c48397ea2f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120741) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 18:05:38.808393 dv-cinder-852009-8-iscsi devstack@n-api.service[120741]: DEBUG oslo_concurrency.lockutils [None req-0327b6d7-414c-44f9-a5ee-74734ca438c1 tempest-TestMinimumBasicScenario-820002800 tempest-TestMinimumBasicScenario-820002800-project] Lock "1daf4f4c-0e4a-4779-b53a-78c48397ea2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120741) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 18:05:38.808861 dv-cinder-852009-8-iscsi devstack@n-api.service[120741]: DEBUG oslo_concurrency.lockutils [None req-0327b6d7-414c-44f9-a5ee-74734ca438c1 tempest-TestMinimumBasicScenario-820002800 tempest-TestMinimumBasicScenario-820002800-project] Lock "1daf4f4c-0e4a-4779-b53a-78c48397ea2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120741) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 18:05:38.810864 dv-cinder-852009-8-iscsi devstack@n-api.service[120740]: DEBUG oslo_concurrency.lockutils [None req-fed10e69-8453-44d9-bab9-f59ecebad855 tempest-AttachVolumeShelveTestJSON-385853788 tempest-AttachVolumeShelveTestJSON-385853788-project] Acquiring lock "1daf4f4c-0e4a-4779-b53a-78c48397ea2f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120740) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 18:05:38.811442 dv-cinder-852009-8-iscsi devstack@n-api.service[120740]: DEBUG oslo_concurrency.lockutils [None req-fed10e69-8453-44d9-bab9-f59ecebad855 tempest-AttachVolumeShelveTestJSON-385853788 tempest-AttachVolumeShelveTestJSON-385853788-project] Lock "1daf4f4c-0e4a-4779-b53a-78c48397ea2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120740) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 18:05:38.812110 dv-cinder-852009-8-iscsi devstack@n-api.service[120740]: DEBUG oslo_concurrency.lockutils [None req-fed10e69-8453-44d9-bab9-f59ecebad855 tempest-AttachVolumeShelveTestJSON-385853788 tempest-AttachVolumeShelveTestJSON-385853788-project] Lock "1daf4f4c-0e4a-4779-b53a-78c48397ea2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120740) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 18:05:38.813016 dv-cinder-852009-8-iscsi devstack@n-api.service[120740]: DEBUG oslo_concurrency.lockutils [None req-fed10e69-8453-44d9-bab9-f59ecebad855 tempest-AttachVolumeShelveTestJSON-385853788 tempest-AttachVolumeShelveTestJSON-385853788-project] Acquiring lock "1daf4f4c-0e4a-4779-b53a-78c48397ea2f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120740) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 18:05:38.813472 dv-cinder-852009-8-iscsi devstack@n-api.service[120740]: DEBUG oslo_concurrency.lockutils [None req-fed10e69-8453-44d9-bab9-f59ecebad855 tempest-AttachVolumeShelveTestJSON-385853788 tempest-AttachVolumeShelveTestJSON-385853788-project] Lock "1daf4f4c-0e4a-4779-b53a-78c48397ea2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120740) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 18:05:38.814063 dv-cinder-852009-8-iscsi devstack@n-api.service[120740]: DEBUG oslo_concurrency.lockutils [None req-fed10e69-8453-44d9-bab9-f59ecebad855 tempest-AttachVolumeShelveTestJSON-385853788 tempest-AttachVolumeShelveTestJSON-385853788-project] Lock "1daf4f4c-0e4a-4779-b53a-78c48397ea2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120740) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 18:05:39.024494 dv-cinder-852009-8-iscsi devstack@n-api.service[120741]: DEBUG nova.policy [None req-0327b6d7-414c-44f9-a5ee-74734ca438c1 tempest-TestMinimumBasicScenario-820002800 tempest-TestMinimumBasicScenario-820002800-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7880064ff0aa448d9c367c89eba145ff', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2f6832936c824066a4370cc45c5b0282', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120741) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 18:05:39.027465 dv-cinder-852009-8-iscsi devstack@n-api.service[120740]: DEBUG nova.policy [None req-fed10e69-8453-44d9-bab9-f59ecebad855 tempest-AttachVolumeShelveTestJSON-385853788 tempest-AttachVolumeShelveTestJSON-385853788-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e68ecd9b3ca643539b109f75bb242d6f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '75e14fd88bfb4cd896fa7b070a0fac47', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120740) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 18:05:39.033544 dv-cinder-852009-8-iscsi devstack@n-api.service[120741]: INFO nova.api.openstack.requestlog [None req-0327b6d7-414c-44f9-a5ee-74734ca438c1 tempest-TestMinimumBasicScenario-820002800 tempest-TestMinimumBasicScenario-820002800-project] 10.222.0.43 "GET /compute/v2.1/servers/f8247a13-94cd-45b2-acc8-8717e1260f37" status: 200 len: 1359 microversion: 2.1 time: 0.245392 Sep 13 18:05:39.034619 dv-cinder-852009-8-iscsi devstack@n-api.service[120741]: [pid: 120741|app: 0|req: 202/414] 10.222.0.43 () {58 vars in 1236 bytes} [Tue Sep 13 18:05:38 2022] GET /compute/v2.1/servers/f8247a13-94cd-45b2-acc8-8717e1260f37 => generated 1359 bytes in 247 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 13 18:05:39.042925 dv-cinder-852009-8-iscsi devstack@n-api.service[120740]: DEBUG nova.policy [None req-fed10e69-8453-44d9-bab9-f59ecebad855 tempest-AttachVolumeShelveTestJSON-385853788 tempest-AttachVolumeShelveTestJSON-385853788-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'e68ecd9b3ca643539b109f75bb242d6f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '75e14fd88bfb4cd896fa7b070a0fac47', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120740) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 18:05:39.044414 dv-cinder-852009-8-iscsi devstack@n-api.service[120740]: DEBUG nova.policy [None req-fed10e69-8453-44d9-bab9-f59ecebad855 tempest-AttachVolumeShelveTestJSON-385853788 tempest-AttachVolumeShelveTestJSON-385853788-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'e68ecd9b3ca643539b109f75bb242d6f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '75e14fd88bfb4cd896fa7b070a0fac47', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120740) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 18:05:39.050454 dv-cinder-852009-8-iscsi devstack@n-api.service[120740]: INFO nova.api.openstack.requestlog [None req-fed10e69-8453-44d9-bab9-f59ecebad855 tempest-AttachVolumeShelveTestJSON-385853788 tempest-AttachVolumeShelveTestJSON-385853788-project] 10.222.0.43 "GET /compute/v2.1/servers/11d2616a-96f9-4a7a-aab8-219219986a8b" status: 200 len: 1722 microversion: 2.20 time: 0.252720 Sep 13 18:05:39.051130 dv-cinder-852009-8-iscsi devstack@n-api.service[120740]: [pid: 120740|app: 0|req: 213/415] 10.222.0.43 () {60 vars in 1277 bytes} [Tue Sep 13 18:05:38 2022] GET /compute/v2.1/servers/11d2616a-96f9-4a7a-aab8-219219986a8b => generated 1722 bytes in 254 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Sep 13 18:05:39.203915 dv-cinder-852009-8-iscsi devstack@n-api.service[120741]: DEBUG nova.api.openstack.wsgi [None req-ac3376b2-03f9-40dc-bac7-2c9e3e36c35b tempest-ServerRescueNegativeTestJSON-412251590 tempest-ServerRescueNegativeTestJSON-412251590-project] Calling method '>' {{(pid=120741) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 18:05:39.204538 dv-cinder-852009-8-iscsi devstack@n-api.service[120741]: DEBUG nova.compute.api [None req-ac3376b2-03f9-40dc-bac7-2c9e3e36c35b tempest-ServerRescueNegativeTestJSON-412251590 tempest-ServerRescueNegativeTestJSON-412251590-project] [instance: e8ce7158-6b73-4586-9f78-8e821988e71c] Fetching instance by UUID {{(pid=120741) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 18:05:39.217458 dv-cinder-852009-8-iscsi devstack@n-api.service[120741]: DEBUG oslo_concurrency.lockutils [None req-ac3376b2-03f9-40dc-bac7-2c9e3e36c35b tempest-ServerRescueNegativeTestJSON-412251590 tempest-ServerRescueNegativeTestJSON-412251590-project] Acquiring lock "1daf4f4c-0e4a-4779-b53a-78c48397ea2f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120741) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 18:05:39.217959 dv-cinder-852009-8-iscsi devstack@n-api.service[120741]: DEBUG oslo_concurrency.lockutils [None req-ac3376b2-03f9-40dc-bac7-2c9e3e36c35b tempest-ServerRescueNegativeTestJSON-412251590 tempest-ServerRescueNegativeTestJSON-412251590-project] Lock "1daf4f4c-0e4a-4779-b53a-78c48397ea2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120741) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 18:05:39.218386 dv-cinder-852009-8-iscsi devstack@n-api.service[120741]: DEBUG oslo_concurrency.lockutils [None req-ac3376b2-03f9-40dc-bac7-2c9e3e36c35b tempest-ServerRescueNegativeTestJSON-412251590 tempest-ServerRescueNegativeTestJSON-412251590-project] Lock "1daf4f4c-0e4a-4779-b53a-78c48397ea2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120741) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 18:05:39.219098 dv-cinder-852009-8-iscsi devstack@n-api.service[120741]: DEBUG oslo_concurrency.lockutils [None req-ac3376b2-03f9-40dc-bac7-2c9e3e36c35b tempest-ServerRescueNegativeTestJSON-412251590 tempest-ServerRescueNegativeTestJSON-412251590-project] Acquiring lock "1daf4f4c-0e4a-4779-b53a-78c48397ea2f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120741) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 18:05:39.219984 dv-cinder-852009-8-iscsi devstack@n-api.service[120741]: DEBUG oslo_concurrency.lockutils [None req-ac3376b2-03f9-40dc-bac7-2c9e3e36c35b tempest-ServerRescueNegativeTestJSON-412251590 tempest-ServerRescueNegativeTestJSON-412251590-project] Lock "1daf4f4c-0e4a-4779-b53a-78c48397ea2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120741) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 18:05:39.219984 dv-cinder-852009-8-iscsi devstack@n-api.service[120741]: DEBUG oslo_concurrency.lockutils [None req-ac3376b2-03f9-40dc-bac7-2c9e3e36c35b tempest-ServerRescueNegativeTestJSON-412251590 tempest-ServerRescueNegativeTestJSON-412251590-project] Lock "1daf4f4c-0e4a-4779-b53a-78c48397ea2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120741) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 18:05:39.367513 dv-cinder-852009-8-iscsi devstack@n-api.service[120741]: DEBUG nova.policy [None req-ac3376b2-03f9-40dc-bac7-2c9e3e36c35b tempest-ServerRescueNegativeTestJSON-412251590 tempest-ServerRescueNegativeTestJSON-412251590-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '60800cf2774e409d9c1b6f4992669991', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2eae4acecf6c4961830ead78d71b2ad3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120741) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 18:05:39.377655 dv-cinder-852009-8-iscsi devstack@n-api.service[120741]: INFO nova.api.openstack.requestlog [None req-ac3376b2-03f9-40dc-bac7-2c9e3e36c35b tempest-ServerRescueNegativeTestJSON-412251590 tempest-ServerRescueNegativeTestJSON-412251590-project] 10.222.0.43 "GET /compute/v2.1/servers/e8ce7158-6b73-4586-9f78-8e821988e71c" status: 200 len: 1736 microversion: 2.1 time: 0.177631 Sep 13 18:05:39.384719 dv-cinder-852009-8-iscsi devstack@n-api.service[120741]: [pid: 120741|app: 0|req: 203/416] 10.222.0.43 () {58 vars in 1236 bytes} [Tue Sep 13 18:05:39 2022] GET /compute/v2.1/servers/e8ce7158-6b73-4586-9f78-8e821988e71c => generated 1736 bytes in 186 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 13 18:05:40.056662 dv-cinder-852009-8-iscsi devstack@n-api.service[120740]: DEBUG nova.api.openstack.wsgi [None req-42027894-fdb9-4717-98ae-5df50f3d8e75 tempest-TestMinimumBasicScenario-820002800 tempest-TestMinimumBasicScenario-820002800-project] Calling method '>' {{(pid=120740) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 18:05:40.057289 dv-cinder-852009-8-iscsi devstack@n-api.service[120740]: DEBUG nova.compute.api [None req-42027894-fdb9-4717-98ae-5df50f3d8e75 tempest-TestMinimumBasicScenario-820002800 tempest-TestMinimumBasicScenario-820002800-project] [instance: f8247a13-94cd-45b2-acc8-8717e1260f37] Fetching instance by UUID {{(pid=120740) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 18:05:40.064621 dv-cinder-852009-8-iscsi devstack@n-api.service[120740]: DEBUG oslo_concurrency.lockutils [None req-42027894-fdb9-4717-98ae-5df50f3d8e75 tempest-TestMinimumBasicScenario-820002800 tempest-TestMinimumBasicScenario-820002800-project] Acquiring lock "1daf4f4c-0e4a-4779-b53a-78c48397ea2f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120740) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 18:05:40.065106 dv-cinder-852009-8-iscsi devstack@n-api.service[120740]: DEBUG oslo_concurrency.lockutils [None req-42027894-fdb9-4717-98ae-5df50f3d8e75 tempest-TestMinimumBasicScenario-820002800 tempest-TestMinimumBasicScenario-820002800-project] Lock "1daf4f4c-0e4a-4779-b53a-78c48397ea2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120740) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 18:05:40.065635 dv-cinder-852009-8-iscsi devstack@n-api.service[120740]: DEBUG oslo_concurrency.lockutils [None req-42027894-fdb9-4717-98ae-5df50f3d8e75 tempest-TestMinimumBasicScenario-820002800 tempest-TestMinimumBasicScenario-820002800-project] Lock "1daf4f4c-0e4a-4779-b53a-78c48397ea2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120740) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 18:05:40.066334 dv-cinder-852009-8-iscsi devstack@n-api.service[120740]: DEBUG oslo_concurrency.lockutils [None req-42027894-fdb9-4717-98ae-5df50f3d8e75 tempest-TestMinimumBasicScenario-820002800 tempest-TestMinimumBasicScenario-820002800-project] Acquiring lock "1daf4f4c-0e4a-4779-b53a-78c48397ea2f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120740) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 18:05:40.066919 dv-cinder-852009-8-iscsi devstack@n-api.service[120740]: DEBUG oslo_concurrency.lockutils [None req-42027894-fdb9-4717-98ae-5df50f3d8e75 tempest-TestMinimumBasicScenario-820002800 tempest-TestMinimumBasicScenario-820002800-project] Lock "1daf4f4c-0e4a-4779-b53a-78c48397ea2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120740) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 18:05:40.067335 dv-cinder-852009-8-iscsi devstack@n-api.service[120740]: DEBUG oslo_concurrency.lockutils [None req-42027894-fdb9-4717-98ae-5df50f3d8e75 tempest-TestMinimumBasicScenario-820002800 tempest-TestMinimumBasicScenario-820002800-project] Lock "1daf4f4c-0e4a-4779-b53a-78c48397ea2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120740) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 18:05:40.072226 dv-cinder-852009-8-iscsi devstack@n-api.service[120740]: DEBUG dbcounter [-] [120740] Writing DB stats nova_cell1:SELECT=96,nova_cell1:UPDATE=2,nova_cell1:INSERT=2 {{(pid=120740) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 18:05:40.077836 dv-cinder-852009-8-iscsi devstack@n-api.service[120741]: DEBUG nova.api.openstack.wsgi [None req-2b35ad25-6aef-4e82-8fea-e07750672a58 tempest-AttachVolumeShelveTestJSON-385853788 tempest-AttachVolumeShelveTestJSON-385853788-project] Calling method '>' {{(pid=120741) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 18:05:40.079280 dv-cinder-852009-8-iscsi devstack@n-api.service[120741]: DEBUG nova.compute.api [None req-2b35ad25-6aef-4e82-8fea-e07750672a58 tempest-AttachVolumeShelveTestJSON-385853788 tempest-AttachVolumeShelveTestJSON-385853788-project] [instance: 11d2616a-96f9-4a7a-aab8-219219986a8b] Fetching instance by UUID {{(pid=120741) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 18:05:40.088561 dv-cinder-852009-8-iscsi devstack@n-api.service[120741]: DEBUG oslo_concurrency.lockutils [None req-2b35ad25-6aef-4e82-8fea-e07750672a58 tempest-AttachVolumeShelveTestJSON-385853788 tempest-AttachVolumeShelveTestJSON-385853788-project] Acquiring lock "1daf4f4c-0e4a-4779-b53a-78c48397ea2f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120741) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 18:05:40.089410 dv-cinder-852009-8-iscsi devstack@n-api.service[120741]: DEBUG oslo_concurrency.lockutils [None req-2b35ad25-6aef-4e82-8fea-e07750672a58 tempest-AttachVolumeShelveTestJSON-385853788 tempest-AttachVolumeShelveTestJSON-385853788-project] Lock "1daf4f4c-0e4a-4779-b53a-78c48397ea2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120741) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 18:05:40.090345 dv-cinder-852009-8-iscsi devstack@n-api.service[120741]: DEBUG oslo_concurrency.lockutils [None req-2b35ad25-6aef-4e82-8fea-e07750672a58 tempest-AttachVolumeShelveTestJSON-385853788 tempest-AttachVolumeShelveTestJSON-385853788-project] Lock "1daf4f4c-0e4a-4779-b53a-78c48397ea2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120741) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 18:05:40.091441 dv-cinder-852009-8-iscsi devstack@n-api.service[120741]: DEBUG oslo_concurrency.lockutils [None req-2b35ad25-6aef-4e82-8fea-e07750672a58 tempest-AttachVolumeShelveTestJSON-385853788 tempest-AttachVolumeShelveTestJSON-385853788-project] Acquiring lock "1daf4f4c-0e4a-4779-b53a-78c48397ea2f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120741) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 18:05:40.092108 dv-cinder-852009-8-iscsi devstack@n-api.service[120741]: DEBUG oslo_concurrency.lockutils [None req-2b35ad25-6aef-4e82-8fea-e07750672a58 tempest-AttachVolumeShelveTestJSON-385853788 tempest-AttachVolumeShelveTestJSON-385853788-project] Lock "1daf4f4c-0e4a-4779-b53a-78c48397ea2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120741) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 18:05:40.092781 dv-cinder-852009-8-iscsi devstack@n-api.service[120741]: DEBUG oslo_concurrency.lockutils [None req-2b35ad25-6aef-4e82-8fea-e07750672a58 tempest-AttachVolumeShelveTestJSON-385853788 tempest-AttachVolumeShelveTestJSON-385853788-project] Lock "1daf4f4c-0e4a-4779-b53a-78c48397ea2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120741) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 18:05:40.228992 dv-cinder-852009-8-iscsi devstack@n-api.service[120741]: DEBUG dbcounter [-] [120741] Writing DB stats nova_cell0:SELECT=2 {{(pid=120741) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 18:05:40.249363 dv-cinder-852009-8-iscsi devstack@n-api.service[120741]: DEBUG dbcounter [-] [120741] Writing DB stats nova_cell0:SELECT=10 {{(pid=120741) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 18:05:40.284682 dv-cinder-852009-8-iscsi devstack@n-api.service[120740]: DEBUG nova.policy [None req-42027894-fdb9-4717-98ae-5df50f3d8e75 tempest-TestMinimumBasicScenario-820002800 tempest-TestMinimumBasicScenario-820002800-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7880064ff0aa448d9c367c89eba145ff', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2f6832936c824066a4370cc45c5b0282', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120740) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 18:05:40.294565 dv-cinder-852009-8-iscsi devstack@n-api.service[120740]: INFO nova.api.openstack.requestlog [None req-42027894-fdb9-4717-98ae-5df50f3d8e75 tempest-TestMinimumBasicScenario-820002800 tempest-TestMinimumBasicScenario-820002800-project] 10.222.0.43 "GET /compute/v2.1/servers/f8247a13-94cd-45b2-acc8-8717e1260f37" status: 200 len: 1359 microversion: 2.1 time: 0.241527 Sep 13 18:05:40.296472 dv-cinder-852009-8-iscsi devstack@n-api.service[120740]: [pid: 120740|app: 0|req: 214/417] 10.222.0.43 () {58 vars in 1236 bytes} [Tue Sep 13 18:05:40 2022] GET /compute/v2.1/servers/f8247a13-94cd-45b2-acc8-8717e1260f37 => generated 1359 bytes in 243 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 13 18:05:40.309237 dv-cinder-852009-8-iscsi devstack@n-api.service[120741]: DEBUG nova.policy [None req-2b35ad25-6aef-4e82-8fea-e07750672a58 tempest-AttachVolumeShelveTestJSON-385853788 tempest-AttachVolumeShelveTestJSON-385853788-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e68ecd9b3ca643539b109f75bb242d6f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '75e14fd88bfb4cd896fa7b070a0fac47', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120741) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 18:05:40.318490 dv-cinder-852009-8-iscsi devstack@n-api.service[120741]: DEBUG nova.policy [None req-2b35ad25-6aef-4e82-8fea-e07750672a58 tempest-AttachVolumeShelveTestJSON-385853788 tempest-AttachVolumeShelveTestJSON-385853788-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'e68ecd9b3ca643539b109f75bb242d6f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '75e14fd88bfb4cd896fa7b070a0fac47', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120741) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 18:05:40.320008 dv-cinder-852009-8-iscsi devstack@n-api.service[120741]: DEBUG nova.policy [None req-2b35ad25-6aef-4e82-8fea-e07750672a58 tempest-AttachVolumeShelveTestJSON-385853788 tempest-AttachVolumeShelveTestJSON-385853788-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'e68ecd9b3ca643539b109f75bb242d6f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '75e14fd88bfb4cd896fa7b070a0fac47', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120741) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 18:05:40.321395 dv-cinder-852009-8-iscsi devstack@n-api.service[120741]: INFO nova.api.openstack.requestlog [None req-2b35ad25-6aef-4e82-8fea-e07750672a58 tempest-AttachVolumeShelveTestJSON-385853788 tempest-AttachVolumeShelveTestJSON-385853788-project] 10.222.0.43 "GET /compute/v2.1/servers/11d2616a-96f9-4a7a-aab8-219219986a8b" status: 200 len: 1722 microversion: 2.20 time: 0.248831 Sep 13 18:05:40.322242 dv-cinder-852009-8-iscsi devstack@n-api.service[120741]: [pid: 120741|app: 0|req: 204/418] 10.222.0.43 () {60 vars in 1277 bytes} [Tue Sep 13 18:05:40 2022] GET /compute/v2.1/servers/11d2616a-96f9-4a7a-aab8-219219986a8b => generated 1722 bytes in 250 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 13 18:05:40.400741 dv-cinder-852009-8-iscsi devstack@n-api.service[120740]: DEBUG nova.api.openstack.wsgi [None req-800a397e-0afe-4005-9a03-d2ae7487e5df tempest-ServerRescueNegativeTestJSON-412251590 tempest-ServerRescueNegativeTestJSON-412251590-project] Calling method '>' {{(pid=120740) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 18:05:40.401874 dv-cinder-852009-8-iscsi devstack@n-api.service[120740]: DEBUG nova.compute.api [None req-800a397e-0afe-4005-9a03-d2ae7487e5df tempest-ServerRescueNegativeTestJSON-412251590 tempest-ServerRescueNegativeTestJSON-412251590-project] [instance: e8ce7158-6b73-4586-9f78-8e821988e71c] Fetching instance by UUID {{(pid=120740) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 18:05:40.407579 dv-cinder-852009-8-iscsi devstack@n-api.service[120740]: DEBUG dbcounter [-] [120740] Writing DB stats nova_cell0:SELECT=2 {{(pid=120740) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 18:05:40.409433 dv-cinder-852009-8-iscsi devstack@n-api.service[120740]: DEBUG oslo_concurrency.lockutils [None req-800a397e-0afe-4005-9a03-d2ae7487e5df tempest-ServerRescueNegativeTestJSON-412251590 tempest-ServerRescueNegativeTestJSON-412251590-project] Acquiring lock "1daf4f4c-0e4a-4779-b53a-78c48397ea2f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120740) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 18:05:40.410244 dv-cinder-852009-8-iscsi devstack@n-api.service[120740]: DEBUG oslo_concurrency.lockutils [None req-800a397e-0afe-4005-9a03-d2ae7487e5df tempest-ServerRescueNegativeTestJSON-412251590 tempest-ServerRescueNegativeTestJSON-412251590-project] Lock "1daf4f4c-0e4a-4779-b53a-78c48397ea2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120740) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 18:05:40.410927 dv-cinder-852009-8-iscsi devstack@n-api.service[120740]: DEBUG oslo_concurrency.lockutils [None req-800a397e-0afe-4005-9a03-d2ae7487e5df tempest-ServerRescueNegativeTestJSON-412251590 tempest-ServerRescueNegativeTestJSON-412251590-project] Lock "1daf4f4c-0e4a-4779-b53a-78c48397ea2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120740) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 18:05:40.411986 dv-cinder-852009-8-iscsi devstack@n-api.service[120740]: DEBUG oslo_concurrency.lockutils [None req-800a397e-0afe-4005-9a03-d2ae7487e5df tempest-ServerRescueNegativeTestJSON-412251590 tempest-ServerRescueNegativeTestJSON-412251590-project] Acquiring lock "1daf4f4c-0e4a-4779-b53a-78c48397ea2f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120740) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 18:05:40.412711 dv-cinder-852009-8-iscsi devstack@n-api.service[120740]: DEBUG oslo_concurrency.lockutils [None req-800a397e-0afe-4005-9a03-d2ae7487e5df tempest-ServerRescueNegativeTestJSON-412251590 tempest-ServerRescueNegativeTestJSON-412251590-project] Lock "1daf4f4c-0e4a-4779-b53a-78c48397ea2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120740) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 18:05:40.413446 dv-cinder-852009-8-iscsi devstack@n-api.service[120740]: DEBUG oslo_concurrency.lockutils [None req-800a397e-0afe-4005-9a03-d2ae7487e5df tempest-ServerRescueNegativeTestJSON-412251590 tempest-ServerRescueNegativeTestJSON-412251590-project] Lock "1daf4f4c-0e4a-4779-b53a-78c48397ea2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120740) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 18:05:40.550827 dv-cinder-852009-8-iscsi devstack@n-api.service[120740]: DEBUG nova.policy [None req-800a397e-0afe-4005-9a03-d2ae7487e5df tempest-ServerRescueNegativeTestJSON-412251590 tempest-ServerRescueNegativeTestJSON-412251590-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '60800cf2774e409d9c1b6f4992669991', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2eae4acecf6c4961830ead78d71b2ad3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120740) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 18:05:40.560149 dv-cinder-852009-8-iscsi devstack@n-api.service[120740]: INFO nova.api.openstack.requestlog [None req-800a397e-0afe-4005-9a03-d2ae7487e5df tempest-ServerRescueNegativeTestJSON-412251590 tempest-ServerRescueNegativeTestJSON-412251590-project] 10.222.0.43 "GET /compute/v2.1/servers/e8ce7158-6b73-4586-9f78-8e821988e71c" status: 200 len: 1736 microversion: 2.1 time: 0.163265 Sep 13 18:05:40.560782 dv-cinder-852009-8-iscsi devstack@n-api.service[120740]: [pid: 120740|app: 0|req: 215/419] 10.222.0.43 () {58 vars in 1236 bytes} [Tue Sep 13 18:05:40 2022] GET /compute/v2.1/servers/e8ce7158-6b73-4586-9f78-8e821988e71c => generated 1736 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 13 18:05:41.321537 dv-cinder-852009-8-iscsi devstack@n-api.service[120741]: DEBUG nova.api.openstack.wsgi [None req-9aa96964-81bf-43ce-85d1-adad04eef29b tempest-TestMinimumBasicScenario-820002800 tempest-TestMinimumBasicScenario-820002800-project] Calling method '>' {{(pid=120741) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 18:05:41.322128 dv-cinder-852009-8-iscsi devstack@n-api.service[120741]: DEBUG nova.compute.api [None req-9aa96964-81bf-43ce-85d1-adad04eef29b tempest-TestMinimumBasicScenario-820002800 tempest-TestMinimumBasicScenario-820002800-project] [instance: f8247a13-94cd-45b2-acc8-8717e1260f37] Fetching instance by UUID {{(pid=120741) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 18:05:41.328298 dv-cinder-852009-8-iscsi devstack@n-api.service[120741]: DEBUG oslo_concurrency.lockutils [None req-9aa96964-81bf-43ce-85d1-adad04eef29b tempest-TestMinimumBasicScenario-820002800 tempest-TestMinimumBasicScenario-820002800-project] Acquiring lock "1daf4f4c-0e4a-4779-b53a-78c48397ea2f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120741) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 18:05:41.328788 dv-cinder-852009-8-iscsi devstack@n-api.service[120741]: DEBUG oslo_concurrency.lockutils [None req-9aa96964-81bf-43ce-85d1-adad04eef29b tempest-TestMinimumBasicScenario-820002800 tempest-TestMinimumBasicScenario-820002800-project] Lock "1daf4f4c-0e4a-4779-b53a-78c48397ea2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120741) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 18:05:41.329207 dv-cinder-852009-8-iscsi devstack@n-api.service[120741]: DEBUG oslo_concurrency.lockutils [None req-9aa96964-81bf-43ce-85d1-adad04eef29b tempest-TestMinimumBasicScenario-820002800 tempest-TestMinimumBasicScenario-820002800-project] Lock "1daf4f4c-0e4a-4779-b53a-78c48397ea2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120741) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 18:05:41.329880 dv-cinder-852009-8-iscsi devstack@n-api.service[120741]: DEBUG oslo_concurrency.lockutils [None req-9aa96964-81bf-43ce-85d1-adad04eef29b tempest-TestMinimumBasicScenario-820002800 tempest-TestMinimumBasicScenario-820002800-project] Acquiring lock "1daf4f4c-0e4a-4779-b53a-78c48397ea2f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120741) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 18:05:41.330360 dv-cinder-852009-8-iscsi devstack@n-api.service[120741]: DEBUG oslo_concurrency.lockutils [None req-9aa96964-81bf-43ce-85d1-adad04eef29b tempest-TestMinimumBasicScenario-820002800 tempest-TestMinimumBasicScenario-820002800-project] Lock "1daf4f4c-0e4a-4779-b53a-78c48397ea2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120741) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 18:05:41.330850 dv-cinder-852009-8-iscsi devstack@n-api.service[120741]: DEBUG oslo_concurrency.lockutils [None req-9aa96964-81bf-43ce-85d1-adad04eef29b tempest-TestMinimumBasicScenario-820002800 tempest-TestMinimumBasicScenario-820002800-project] Lock "1daf4f4c-0e4a-4779-b53a-78c48397ea2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120741) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 18:05:41.350873 dv-cinder-852009-8-iscsi devstack@n-api.service[120740]: DEBUG nova.api.openstack.wsgi [None req-d0bf172f-9b8c-4952-8bc1-3375180540f7 tempest-AttachVolumeShelveTestJSON-385853788 tempest-AttachVolumeShelveTestJSON-385853788-project] Calling method '>' {{(pid=120740) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 18:05:41.351644 dv-cinder-852009-8-iscsi devstack@n-api.service[120740]: DEBUG nova.compute.api [None req-d0bf172f-9b8c-4952-8bc1-3375180540f7 tempest-AttachVolumeShelveTestJSON-385853788 tempest-AttachVolumeShelveTestJSON-385853788-project] [instance: 11d2616a-96f9-4a7a-aab8-219219986a8b] Fetching instance by UUID {{(pid=120740) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 18:05:41.360167 dv-cinder-852009-8-iscsi devstack@n-api.service[120740]: DEBUG oslo_concurrency.lockutils [None req-d0bf172f-9b8c-4952-8bc1-3375180540f7 tempest-AttachVolumeShelveTestJSON-385853788 tempest-AttachVolumeShelveTestJSON-385853788-project] Acquiring lock "1daf4f4c-0e4a-4779-b53a-78c48397ea2f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120740) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 18:05:41.361046 dv-cinder-852009-8-iscsi devstack@n-api.service[120740]: DEBUG oslo_concurrency.lockutils [None req-d0bf172f-9b8c-4952-8bc1-3375180540f7 tempest-AttachVolumeShelveTestJSON-385853788 tempest-AttachVolumeShelveTestJSON-385853788-project] Lock "1daf4f4c-0e4a-4779-b53a-78c48397ea2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120740) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 18:05:41.361594 dv-cinder-852009-8-iscsi devstack@n-api.service[120740]: DEBUG oslo_concurrency.lockutils [None req-d0bf172f-9b8c-4952-8bc1-3375180540f7 tempest-AttachVolumeShelveTestJSON-385853788 tempest-AttachVolumeShelveTestJSON-385853788-project] Lock "1daf4f4c-0e4a-4779-b53a-78c48397ea2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120740) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 18:05:41.362555 dv-cinder-852009-8-iscsi devstack@n-api.service[120740]: DEBUG oslo_concurrency.lockutils [None req-d0bf172f-9b8c-4952-8bc1-3375180540f7 tempest-AttachVolumeShelveTestJSON-385853788 tempest-AttachVolumeShelveTestJSON-385853788-project] Acquiring lock "1daf4f4c-0e4a-4779-b53a-78c48397ea2f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120740) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 18:05:41.363112 dv-cinder-852009-8-iscsi devstack@n-api.service[120740]: DEBUG oslo_concurrency.lockutils [None req-d0bf172f-9b8c-4952-8bc1-3375180540f7 tempest-AttachVolumeShelveTestJSON-385853788 tempest-AttachVolumeShelveTestJSON-385853788-project] Lock "1daf4f4c-0e4a-4779-b53a-78c48397ea2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120740) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 18:05:41.363634 dv-cinder-852009-8-iscsi devstack@n-api.service[120740]: DEBUG oslo_concurrency.lockutils [None req-d0bf172f-9b8c-4952-8bc1-3375180540f7 tempest-AttachVolumeShelveTestJSON-385853788 tempest-AttachVolumeShelveTestJSON-385853788-project] Lock "1daf4f4c-0e4a-4779-b53a-78c48397ea2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120740) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 18:05:41.545628 dv-cinder-852009-8-iscsi devstack@n-api.service[120741]: DEBUG nova.policy [None req-9aa96964-81bf-43ce-85d1-adad04eef29b tempest-TestMinimumBasicScenario-820002800 tempest-TestMinimumBasicScenario-820002800-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7880064ff0aa448d9c367c89eba145ff', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2f6832936c824066a4370cc45c5b0282', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120741) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 18:05:41.549684 dv-cinder-852009-8-iscsi devstack@n-api.service[120740]: DEBUG nova.policy [None req-d0bf172f-9b8c-4952-8bc1-3375180540f7 tempest-AttachVolumeShelveTestJSON-385853788 tempest-AttachVolumeShelveTestJSON-385853788-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e68ecd9b3ca643539b109f75bb242d6f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '75e14fd88bfb4cd896fa7b070a0fac47', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120740) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 18:05:41.553833 dv-cinder-852009-8-iscsi devstack@n-api.service[120741]: INFO nova.api.openstack.requestlog [None req-9aa96964-81bf-43ce-85d1-adad04eef29b tempest-TestMinimumBasicScenario-820002800 tempest-TestMinimumBasicScenario-820002800-project] 10.222.0.43 "GET /compute/v2.1/servers/f8247a13-94cd-45b2-acc8-8717e1260f37" status: 200 len: 1359 microversion: 2.1 time: 0.236779 Sep 13 18:05:41.554405 dv-cinder-852009-8-iscsi devstack@n-api.service[120741]: [pid: 120741|app: 0|req: 205/420] 10.222.0.43 () {58 vars in 1236 bytes} [Tue Sep 13 18:05:41 2022] GET /compute/v2.1/servers/f8247a13-94cd-45b2-acc8-8717e1260f37 => generated 1359 bytes in 238 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 13 18:05:41.558262 dv-cinder-852009-8-iscsi devstack@n-api.service[120740]: DEBUG nova.policy [None req-d0bf172f-9b8c-4952-8bc1-3375180540f7 tempest-AttachVolumeShelveTestJSON-385853788 tempest-AttachVolumeShelveTestJSON-385853788-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'e68ecd9b3ca643539b109f75bb242d6f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '75e14fd88bfb4cd896fa7b070a0fac47', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120740) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 18:05:41.559674 dv-cinder-852009-8-iscsi devstack@n-api.service[120740]: DEBUG nova.policy [None req-d0bf172f-9b8c-4952-8bc1-3375180540f7 tempest-AttachVolumeShelveTestJSON-385853788 tempest-AttachVolumeShelveTestJSON-385853788-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'e68ecd9b3ca643539b109f75bb242d6f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '75e14fd88bfb4cd896fa7b070a0fac47', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120740) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 18:05:41.560859 dv-cinder-852009-8-iscsi devstack@n-api.service[120740]: INFO nova.api.openstack.requestlog [None req-d0bf172f-9b8c-4952-8bc1-3375180540f7 tempest-AttachVolumeShelveTestJSON-385853788 tempest-AttachVolumeShelveTestJSON-385853788-project] 10.222.0.43 "GET /compute/v2.1/servers/11d2616a-96f9-4a7a-aab8-219219986a8b" status: 200 len: 1722 microversion: 2.20 time: 0.214288 Sep 13 18:05:41.562332 dv-cinder-852009-8-iscsi devstack@n-api.service[120740]: [pid: 120740|app: 0|req: 216/421] 10.222.0.43 () {60 vars in 1277 bytes} [Tue Sep 13 18:05:41 2022] GET /compute/v2.1/servers/11d2616a-96f9-4a7a-aab8-219219986a8b => generated 1722 bytes in 215 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 13 18:05:41.583408 dv-cinder-852009-8-iscsi devstack@n-api.service[120741]: DEBUG nova.api.openstack.wsgi [None req-b31bf787-946d-4565-9aee-ae4c93a314fc tempest-ServerRescueNegativeTestJSON-412251590 tempest-ServerRescueNegativeTestJSON-412251590-project] Calling method '>' {{(pid=120741) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 18:05:41.583923 dv-cinder-852009-8-iscsi devstack@n-api.service[120741]: DEBUG nova.compute.api [None req-b31bf787-946d-4565-9aee-ae4c93a314fc tempest-ServerRescueNegativeTestJSON-412251590 tempest-ServerRescueNegativeTestJSON-412251590-project] [instance: e8ce7158-6b73-4586-9f78-8e821988e71c] Fetching instance by UUID {{(pid=120741) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 18:05:41.590167 dv-cinder-852009-8-iscsi devstack@n-api.service[120741]: DEBUG oslo_concurrency.lockutils [None req-b31bf787-946d-4565-9aee-ae4c93a314fc tempest-ServerRescueNegativeTestJSON-412251590 tempest-ServerRescueNegativeTestJSON-412251590-project] Acquiring lock "1daf4f4c-0e4a-4779-b53a-78c48397ea2f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120741) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 18:05:41.590652 dv-cinder-852009-8-iscsi devstack@n-api.service[120741]: DEBUG oslo_concurrency.lockutils [None req-b31bf787-946d-4565-9aee-ae4c93a314fc tempest-ServerRescueNegativeTestJSON-412251590 tempest-ServerRescueNegativeTestJSON-412251590-project] Lock "1daf4f4c-0e4a-4779-b53a-78c48397ea2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120741) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 18:05:41.591074 dv-cinder-852009-8-iscsi devstack@n-api.service[120741]: DEBUG oslo_concurrency.lockutils [None req-b31bf787-946d-4565-9aee-ae4c93a314fc tempest-ServerRescueNegativeTestJSON-412251590 tempest-ServerRescueNegativeTestJSON-412251590-project] Lock "1daf4f4c-0e4a-4779-b53a-78c48397ea2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120741) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 18:05:41.591766 dv-cinder-852009-8-iscsi devstack@n-api.service[120741]: DEBUG oslo_concurrency.lockutils [None req-b31bf787-946d-4565-9aee-ae4c93a314fc tempest-ServerRescueNegativeTestJSON-412251590 tempest-ServerRescueNegativeTestJSON-412251590-project] Acquiring lock "1daf4f4c-0e4a-4779-b53a-78c48397ea2f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120741) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 18:05:41.592217 dv-cinder-852009-8-iscsi devstack@n-api.service[120741]: DEBUG oslo_concurrency.lockutils [None req-b31bf787-946d-4565-9aee-ae4c93a314fc tempest-ServerRescueNegativeTestJSON-412251590 tempest-ServerRescueNegativeTestJSON-412251590-project] Lock "1daf4f4c-0e4a-4779-b53a-78c48397ea2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120741) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 18:05:41.592670 dv-cinder-852009-8-iscsi devstack@n-api.service[120741]: DEBUG oslo_concurrency.lockutils [None req-b31bf787-946d-4565-9aee-ae4c93a314fc tempest-ServerRescueNegativeTestJSON-412251590 tempest-ServerRescueNegativeTestJSON-412251590-project] Lock "1daf4f4c-0e4a-4779-b53a-78c48397ea2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120741) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 18:05:41.732171 dv-cinder-852009-8-iscsi devstack@n-api.service[120741]: DEBUG nova.policy [None req-b31bf787-946d-4565-9aee-ae4c93a314fc tempest-ServerRescueNegativeTestJSON-412251590 tempest-ServerRescueNegativeTestJSON-412251590-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '60800cf2774e409d9c1b6f4992669991', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2eae4acecf6c4961830ead78d71b2ad3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120741) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 18:05:41.743121 dv-cinder-852009-8-iscsi devstack@n-api.service[120741]: INFO nova.api.openstack.requestlog [None req-b31bf787-946d-4565-9aee-ae4c93a314fc tempest-ServerRescueNegativeTestJSON-412251590 tempest-ServerRescueNegativeTestJSON-412251590-project] 10.222.0.43 "GET /compute/v2.1/servers/e8ce7158-6b73-4586-9f78-8e821988e71c" status: 200 len: 1736 microversion: 2.1 time: 0.163436 Sep 13 18:05:41.743902 dv-cinder-852009-8-iscsi devstack@n-api.service[120741]: [pid: 120741|app: 0|req: 206/422] 10.222.0.43 () {58 vars in 1236 bytes} [Tue Sep 13 18:05:41 2022] GET /compute/v2.1/servers/e8ce7158-6b73-4586-9f78-8e821988e71c => generated 1736 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 13 18:05:42.576992 dv-cinder-852009-8-iscsi devstack@n-api.service[120740]: DEBUG nova.api.openstack.wsgi [None req-6a814ff7-f2ab-40d5-9cf8-06412856e586 tempest-TestMinimumBasicScenario-820002800 tempest-TestMinimumBasicScenario-820002800-project] Calling method '>' {{(pid=120740) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 18:05:42.577820 dv-cinder-852009-8-iscsi devstack@n-api.service[120740]: DEBUG nova.compute.api [None req-6a814ff7-f2ab-40d5-9cf8-06412856e586 tempest-TestMinimumBasicScenario-820002800 tempest-TestMinimumBasicScenario-820002800-project] [instance: f8247a13-94cd-45b2-acc8-8717e1260f37] Fetching instance by UUID {{(pid=120740) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 18:05:42.585755 dv-cinder-852009-8-iscsi devstack@n-api.service[120740]: DEBUG oslo_concurrency.lockutils [None req-6a814ff7-f2ab-40d5-9cf8-06412856e586 tempest-TestMinimumBasicScenario-820002800 tempest-TestMinimumBasicScenario-820002800-project] Acquiring lock "1daf4f4c-0e4a-4779-b53a-78c48397ea2f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120740) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 18:05:42.586249 dv-cinder-852009-8-iscsi devstack@n-api.service[120740]: DEBUG oslo_concurrency.lockutils [None req-6a814ff7-f2ab-40d5-9cf8-06412856e586 tempest-TestMinimumBasicScenario-820002800 tempest-TestMinimumBasicScenario-820002800-project] Lock "1daf4f4c-0e4a-4779-b53a-78c48397ea2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120740) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 18:05:42.586690 dv-cinder-852009-8-iscsi devstack@n-api.service[120740]: DEBUG oslo_concurrency.lockutils [None req-6a814ff7-f2ab-40d5-9cf8-06412856e586 tempest-TestMinimumBasicScenario-820002800 tempest-TestMinimumBasicScenario-820002800-project] Lock "1daf4f4c-0e4a-4779-b53a-78c48397ea2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120740) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 18:05:42.587397 dv-cinder-852009-8-iscsi devstack@n-api.service[120740]: DEBUG oslo_concurrency.lockutils [None req-6a814ff7-f2ab-40d5-9cf8-06412856e586 tempest-TestMinimumBasicScenario-820002800 tempest-TestMinimumBasicScenario-820002800-project] Acquiring lock "1daf4f4c-0e4a-4779-b53a-78c48397ea2f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120740) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 18:05:42.587846 dv-cinder-852009-8-iscsi devstack@n-api.service[120740]: DEBUG oslo_concurrency.lockutils [None req-6a814ff7-f2ab-40d5-9cf8-06412856e586 tempest-TestMinimumBasicScenario-820002800 tempest-TestMinimumBasicScenario-820002800-project] Lock "1daf4f4c-0e4a-4779-b53a-78c48397ea2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120740) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 18:05:42.588483 dv-cinder-852009-8-iscsi devstack@n-api.service[120740]: DEBUG oslo_concurrency.lockutils [None req-6a814ff7-f2ab-40d5-9cf8-06412856e586 tempest-TestMinimumBasicScenario-820002800 tempest-TestMinimumBasicScenario-820002800-project] Lock "1daf4f4c-0e4a-4779-b53a-78c48397ea2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120740) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 18:05:42.593264 dv-cinder-852009-8-iscsi devstack@n-api.service[120741]: DEBUG nova.api.openstack.wsgi [None req-f238a4c4-da97-4064-9208-45244d224201 tempest-AttachVolumeShelveTestJSON-385853788 tempest-AttachVolumeShelveTestJSON-385853788-project] Calling method '>' {{(pid=120741) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 18:05:42.593865 dv-cinder-852009-8-iscsi devstack@n-api.service[120741]: DEBUG nova.compute.api [None req-f238a4c4-da97-4064-9208-45244d224201 tempest-AttachVolumeShelveTestJSON-385853788 tempest-AttachVolumeShelveTestJSON-385853788-project] [instance: 11d2616a-96f9-4a7a-aab8-219219986a8b] Fetching instance by UUID {{(pid=120741) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 18:05:42.597468 dv-cinder-852009-8-iscsi devstack@n-api.service[120741]: DEBUG dbcounter [-] [120741] Writing DB stats nova_api:SELECT=87,nova_api:INSERT=4 {{(pid=120741) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 18:05:42.601373 dv-cinder-852009-8-iscsi devstack@n-api.service[120741]: DEBUG oslo_concurrency.lockutils [None req-f238a4c4-da97-4064-9208-45244d224201 tempest-AttachVolumeShelveTestJSON-385853788 tempest-AttachVolumeShelveTestJSON-385853788-project] Acquiring lock "1daf4f4c-0e4a-4779-b53a-78c48397ea2f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120741) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 18:05:42.602175 dv-cinder-852009-8-iscsi devstack@n-api.service[120741]: DEBUG oslo_concurrency.lockutils [None req-f238a4c4-da97-4064-9208-45244d224201 tempest-AttachVolumeShelveTestJSON-385853788 tempest-AttachVolumeShelveTestJSON-385853788-project] Lock "1daf4f4c-0e4a-4779-b53a-78c48397ea2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120741) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 18:05:42.602851 dv-cinder-852009-8-iscsi devstack@n-api.service[120741]: DEBUG oslo_concurrency.lockutils [None req-f238a4c4-da97-4064-9208-45244d224201 tempest-AttachVolumeShelveTestJSON-385853788 tempest-AttachVolumeShelveTestJSON-385853788-project] Lock "1daf4f4c-0e4a-4779-b53a-78c48397ea2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120741) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 18:05:42.603810 dv-cinder-852009-8-iscsi devstack@n-api.service[120741]: DEBUG oslo_concurrency.lockutils [None req-f238a4c4-da97-4064-9208-45244d224201 tempest-AttachVolumeShelveTestJSON-385853788 tempest-AttachVolumeShelveTestJSON-385853788-project] Acquiring lock "1daf4f4c-0e4a-4779-b53a-78c48397ea2f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120741) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 18:05:42.604660 dv-cinder-852009-8-iscsi devstack@n-api.service[120741]: DEBUG oslo_concurrency.lockutils [None req-f238a4c4-da97-4064-9208-45244d224201 tempest-AttachVolumeShelveTestJSON-385853788 tempest-AttachVolumeShelveTestJSON-385853788-project] Lock "1daf4f4c-0e4a-4779-b53a-78c48397ea2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120741) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 18:05:42.605241 dv-cinder-852009-8-iscsi devstack@n-api.service[120741]: DEBUG oslo_concurrency.lockutils [None req-f238a4c4-da97-4064-9208-45244d224201 tempest-AttachVolumeShelveTestJSON-385853788 tempest-AttachVolumeShelveTestJSON-385853788-project] Lock "1daf4f4c-0e4a-4779-b53a-78c48397ea2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120741) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 18:05:42.692376 dv-cinder-852009-8-iscsi devstack@n-api.service[120741]: DEBUG nova.policy [None req-f238a4c4-da97-4064-9208-45244d224201 tempest-AttachVolumeShelveTestJSON-385853788 tempest-AttachVolumeShelveTestJSON-385853788-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e68ecd9b3ca643539b109f75bb242d6f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '75e14fd88bfb4cd896fa7b070a0fac47', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120741) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 18:05:42.700866 dv-cinder-852009-8-iscsi devstack@n-api.service[120741]: DEBUG nova.policy [None req-f238a4c4-da97-4064-9208-45244d224201 tempest-AttachVolumeShelveTestJSON-385853788 tempest-AttachVolumeShelveTestJSON-385853788-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'e68ecd9b3ca643539b109f75bb242d6f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '75e14fd88bfb4cd896fa7b070a0fac47', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120741) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 18:05:42.702305 dv-cinder-852009-8-iscsi devstack@n-api.service[120741]: DEBUG nova.policy [None req-f238a4c4-da97-4064-9208-45244d224201 tempest-AttachVolumeShelveTestJSON-385853788 tempest-AttachVolumeShelveTestJSON-385853788-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'e68ecd9b3ca643539b109f75bb242d6f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '75e14fd88bfb4cd896fa7b070a0fac47', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120741) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 18:05:42.703465 dv-cinder-852009-8-iscsi devstack@n-api.service[120741]: INFO nova.api.openstack.requestlog [None req-f238a4c4-da97-4064-9208-45244d224201 tempest-AttachVolumeShelveTestJSON-385853788 tempest-AttachVolumeShelveTestJSON-385853788-project] 10.222.0.43 "GET /compute/v2.1/servers/11d2616a-96f9-4a7a-aab8-219219986a8b" status: 200 len: 1655 microversion: 2.20 time: 0.121382 Sep 13 18:05:42.704346 dv-cinder-852009-8-iscsi devstack@n-api.service[120741]: [pid: 120741|app: 0|req: 207/423] 10.222.0.43 () {60 vars in 1277 bytes} [Tue Sep 13 18:05:42 2022] GET /compute/v2.1/servers/11d2616a-96f9-4a7a-aab8-219219986a8b => generated 1655 bytes in 123 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 13 18:05:42.764101 dv-cinder-852009-8-iscsi devstack@n-api.service[120740]: DEBUG nova.policy [None req-6a814ff7-f2ab-40d5-9cf8-06412856e586 tempest-TestMinimumBasicScenario-820002800 tempest-TestMinimumBasicScenario-820002800-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7880064ff0aa448d9c367c89eba145ff', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2f6832936c824066a4370cc45c5b0282', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120740) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 18:05:42.766620 dv-cinder-852009-8-iscsi devstack@n-api.service[120741]: DEBUG nova.api.openstack.wsgi [None req-2f68cd5a-44a9-4607-b7c9-7e89301e9a78 tempest-ServerRescueNegativeTestJSON-412251590 tempest-ServerRescueNegativeTestJSON-412251590-project] Calling method '>' {{(pid=120741) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 18:05:42.767235 dv-cinder-852009-8-iscsi devstack@n-api.service[120741]: DEBUG nova.compute.api [None req-2f68cd5a-44a9-4607-b7c9-7e89301e9a78 tempest-ServerRescueNegativeTestJSON-412251590 tempest-ServerRescueNegativeTestJSON-412251590-project] [instance: e8ce7158-6b73-4586-9f78-8e821988e71c] Fetching instance by UUID {{(pid=120741) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 18:05:42.772959 dv-cinder-852009-8-iscsi devstack@n-api.service[120740]: INFO nova.api.openstack.requestlog [None req-6a814ff7-f2ab-40d5-9cf8-06412856e586 tempest-TestMinimumBasicScenario-820002800 tempest-TestMinimumBasicScenario-820002800-project] 10.222.0.43 "GET /compute/v2.1/servers/f8247a13-94cd-45b2-acc8-8717e1260f37" status: 200 len: 1359 microversion: 2.1 time: 0.199386 Sep 13 18:05:42.773088 dv-cinder-852009-8-iscsi devstack@n-api.service[120740]: [pid: 120740|app: 0|req: 217/424] 10.222.0.43 () {58 vars in 1236 bytes} [Tue Sep 13 18:05:42 2022] GET /compute/v2.1/servers/f8247a13-94cd-45b2-acc8-8717e1260f37 => generated 1359 bytes in 201 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 13 18:05:42.774643 dv-cinder-852009-8-iscsi devstack@n-api.service[120741]: DEBUG oslo_concurrency.lockutils [None req-2f68cd5a-44a9-4607-b7c9-7e89301e9a78 tempest-ServerRescueNegativeTestJSON-412251590 tempest-ServerRescueNegativeTestJSON-412251590-project] Acquiring lock "1daf4f4c-0e4a-4779-b53a-78c48397ea2f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120741) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 18:05:42.775203 dv-cinder-852009-8-iscsi devstack@n-api.service[120741]: DEBUG oslo_concurrency.lockutils [None req-2f68cd5a-44a9-4607-b7c9-7e89301e9a78 tempest-ServerRescueNegativeTestJSON-412251590 tempest-ServerRescueNegativeTestJSON-412251590-project] Lock "1daf4f4c-0e4a-4779-b53a-78c48397ea2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120741) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 18:05:42.775715 dv-cinder-852009-8-iscsi devstack@n-api.service[120741]: DEBUG oslo_concurrency.lockutils [None req-2f68cd5a-44a9-4607-b7c9-7e89301e9a78 tempest-ServerRescueNegativeTestJSON-412251590 tempest-ServerRescueNegativeTestJSON-412251590-project] Lock "1daf4f4c-0e4a-4779-b53a-78c48397ea2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120741) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 18:05:42.776529 dv-cinder-852009-8-iscsi devstack@n-api.service[120741]: DEBUG oslo_concurrency.lockutils [None req-2f68cd5a-44a9-4607-b7c9-7e89301e9a78 tempest-ServerRescueNegativeTestJSON-412251590 tempest-ServerRescueNegativeTestJSON-412251590-project] Acquiring lock "1daf4f4c-0e4a-4779-b53a-78c48397ea2f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120741) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 18:05:42.777455 dv-cinder-852009-8-iscsi devstack@n-api.service[120741]: DEBUG oslo_concurrency.lockutils [None req-2f68cd5a-44a9-4607-b7c9-7e89301e9a78 tempest-ServerRescueNegativeTestJSON-412251590 tempest-ServerRescueNegativeTestJSON-412251590-project] Lock "1daf4f4c-0e4a-4779-b53a-78c48397ea2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120741) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 18:05:42.777952 dv-cinder-852009-8-iscsi devstack@n-api.service[120741]: DEBUG oslo_concurrency.lockutils [None req-2f68cd5a-44a9-4607-b7c9-7e89301e9a78 tempest-ServerRescueNegativeTestJSON-412251590 tempest-ServerRescueNegativeTestJSON-412251590-project] Lock "1daf4f4c-0e4a-4779-b53a-78c48397ea2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120741) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 18:05:42.879302 dv-cinder-852009-8-iscsi devstack@n-api.service[120740]: DEBUG nova.api.openstack.wsgi [req-e8f8e73f-92fa-4607-bbe0-ed5c1b4e1fb2 req-9dc323d6-0b95-4e7d-adb8-37db6f3717f5 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "11d2616a-96f9-4a7a-aab8-219219986a8b", "name": "network-vif-deleted", "tag": "85bfb53c-ec3d-49bc-ade7-acdfac253331"}]} {{(pid=120740) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 13 18:05:42.889911 dv-cinder-852009-8-iscsi devstack@n-api.service[120740]: DEBUG oslo_concurrency.lockutils [req-e8f8e73f-92fa-4607-bbe0-ed5c1b4e1fb2 req-9dc323d6-0b95-4e7d-adb8-37db6f3717f5 service nova] Acquiring lock "1daf4f4c-0e4a-4779-b53a-78c48397ea2f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120740) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 18:05:42.890398 dv-cinder-852009-8-iscsi devstack@n-api.service[120740]: DEBUG oslo_concurrency.lockutils [req-e8f8e73f-92fa-4607-bbe0-ed5c1b4e1fb2 req-9dc323d6-0b95-4e7d-adb8-37db6f3717f5 service nova] Lock "1daf4f4c-0e4a-4779-b53a-78c48397ea2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120740) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 18:05:42.891006 dv-cinder-852009-8-iscsi devstack@n-api.service[120740]: DEBUG oslo_concurrency.lockutils [req-e8f8e73f-92fa-4607-bbe0-ed5c1b4e1fb2 req-9dc323d6-0b95-4e7d-adb8-37db6f3717f5 service nova] Lock "1daf4f4c-0e4a-4779-b53a-78c48397ea2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120740) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 18:05:42.904758 dv-cinder-852009-8-iscsi devstack@n-api.service[120740]: INFO nova.api.openstack.compute.server_external_events [req-e8f8e73f-92fa-4607-bbe0-ed5c1b4e1fb2 req-9dc323d6-0b95-4e7d-adb8-37db6f3717f5 service nova] Creating event network-vif-deleted:85bfb53c-ec3d-49bc-ade7-acdfac253331 for instance 11d2616a-96f9-4a7a-aab8-219219986a8b on hv-cinder-85200 Sep 13 18:05:42.913247 dv-cinder-852009-8-iscsi devstack@n-api.service[120740]: INFO nova.api.openstack.requestlog [req-e8f8e73f-92fa-4607-bbe0-ed5c1b4e1fb2 req-9dc323d6-0b95-4e7d-adb8-37db6f3717f5 service nova] 10.222.0.43 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.035979 Sep 13 18:05:42.915205 dv-cinder-852009-8-iscsi devstack@n-api.service[120740]: [pid: 120740|app: 0|req: 218/425] 10.222.0.43 () {64 vars in 1317 bytes} [Tue Sep 13 18:05:42 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 41 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 13 18:05:42.921707 dv-cinder-852009-8-iscsi devstack@n-api.service[120741]: DEBUG nova.policy [None req-2f68cd5a-44a9-4607-b7c9-7e89301e9a78 tempest-ServerRescueNegativeTestJSON-412251590 tempest-ServerRescueNegativeTestJSON-412251590-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '60800cf2774e409d9c1b6f4992669991', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2eae4acecf6c4961830ead78d71b2ad3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120741) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 18:05:42.930281 dv-cinder-852009-8-iscsi devstack@n-api.service[120741]: INFO nova.api.openstack.requestlog [None req-2f68cd5a-44a9-4607-b7c9-7e89301e9a78 tempest-ServerRescueNegativeTestJSON-412251590 tempest-ServerRescueNegativeTestJSON-412251590-project] 10.222.0.43 "GET /compute/v2.1/servers/e8ce7158-6b73-4586-9f78-8e821988e71c" status: 200 len: 1736 microversion: 2.1 time: 0.167379 Sep 13 18:05:42.931000 dv-cinder-852009-8-iscsi devstack@n-api.service[120741]: [pid: 120741|app: 0|req: 208/426] 10.222.0.43 () {58 vars in 1236 bytes} [Tue Sep 13 18:05:42 2022] GET /compute/v2.1/servers/e8ce7158-6b73-4586-9f78-8e821988e71c => generated 1736 bytes in 169 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 13 18:05:43.730689 dv-cinder-852009-8-iscsi devstack@n-api.service[120740]: DEBUG nova.api.openstack.wsgi [None req-ca2a6628-ba28-4890-b058-d4067be698fc tempest-AttachVolumeShelveTestJSON-385853788 tempest-AttachVolumeShelveTestJSON-385853788-project] Calling method '>' {{(pid=120740) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 18:05:43.731483 dv-cinder-852009-8-iscsi devstack@n-api.service[120740]: DEBUG nova.compute.api [None req-ca2a6628-ba28-4890-b058-d4067be698fc tempest-AttachVolumeShelveTestJSON-385853788 tempest-AttachVolumeShelveTestJSON-385853788-project] [instance: 11d2616a-96f9-4a7a-aab8-219219986a8b] Fetching instance by UUID {{(pid=120740) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 18:05:43.738074 dv-cinder-852009-8-iscsi devstack@n-api.service[120740]: DEBUG oslo_concurrency.lockutils [None req-ca2a6628-ba28-4890-b058-d4067be698fc tempest-AttachVolumeShelveTestJSON-385853788 tempest-AttachVolumeShelveTestJSON-385853788-project] Acquiring lock "1daf4f4c-0e4a-4779-b53a-78c48397ea2f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120740) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 18:05:43.738639 dv-cinder-852009-8-iscsi devstack@n-api.service[120740]: DEBUG oslo_concurrency.lockutils [None req-ca2a6628-ba28-4890-b058-d4067be698fc tempest-AttachVolumeShelveTestJSON-385853788 tempest-AttachVolumeShelveTestJSON-385853788-project] Lock "1daf4f4c-0e4a-4779-b53a-78c48397ea2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120740) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 18:05:43.739125 dv-cinder-852009-8-iscsi devstack@n-api.service[120740]: DEBUG oslo_concurrency.lockutils [None req-ca2a6628-ba28-4890-b058-d4067be698fc tempest-AttachVolumeShelveTestJSON-385853788 tempest-AttachVolumeShelveTestJSON-385853788-project] Lock "1daf4f4c-0e4a-4779-b53a-78c48397ea2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120740) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 18:05:43.739889 dv-cinder-852009-8-iscsi devstack@n-api.service[120740]: DEBUG oslo_concurrency.lockutils [None req-ca2a6628-ba28-4890-b058-d4067be698fc tempest-AttachVolumeShelveTestJSON-385853788 tempest-AttachVolumeShelveTestJSON-385853788-project] Acquiring lock "1daf4f4c-0e4a-4779-b53a-78c48397ea2f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120740) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 18:05:43.740402 dv-cinder-852009-8-iscsi devstack@n-api.service[120740]: DEBUG oslo_concurrency.lockutils [None req-ca2a6628-ba28-4890-b058-d4067be698fc tempest-AttachVolumeShelveTestJSON-385853788 tempest-AttachVolumeShelveTestJSON-385853788-project] Lock "1daf4f4c-0e4a-4779-b53a-78c48397ea2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120740) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 18:05:43.740901 dv-cinder-852009-8-iscsi devstack@n-api.service[120740]: DEBUG oslo_concurrency.lockutils [None req-ca2a6628-ba28-4890-b058-d4067be698fc tempest-AttachVolumeShelveTestJSON-385853788 tempest-AttachVolumeShelveTestJSON-385853788-project] Lock "1daf4f4c-0e4a-4779-b53a-78c48397ea2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120740) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 18:05:43.756757 dv-cinder-852009-8-iscsi devstack@n-api.service[120740]: INFO nova.api.openstack.wsgi [None req-ca2a6628-ba28-4890-b058-d4067be698fc tempest-AttachVolumeShelveTestJSON-385853788 tempest-AttachVolumeShelveTestJSON-385853788-project] HTTP exception thrown: Instance 11d2616a-96f9-4a7a-aab8-219219986a8b could not be found. Sep 13 18:05:43.758565 dv-cinder-852009-8-iscsi devstack@n-api.service[120740]: DEBUG nova.api.openstack.wsgi [None req-ca2a6628-ba28-4890-b058-d4067be698fc tempest-AttachVolumeShelveTestJSON-385853788 tempest-AttachVolumeShelveTestJSON-385853788-project] Request method failure captured: Sep 13 18:05:43.758565 dv-cinder-852009-8-iscsi devstack@n-api.service[120740]: request: GET /compute/v2.1/servers/11d2616a-96f9-4a7a-aab8-219219986a8b HTTP/1.1 Sep 13 18:05:43.758565 dv-cinder-852009-8-iscsi devstack@n-api.service[120740]: Accept: application/json Sep 13 18:05:43.758565 dv-cinder-852009-8-iscsi devstack@n-api.service[120740]: Accept-Encoding: identity Sep 13 18:05:43.758565 dv-cinder-852009-8-iscsi devstack@n-api.service[120740]: Connection: close Sep 13 18:05:43.758565 dv-cinder-852009-8-iscsi devstack@n-api.service[120740]: Content-Length: 0 Sep 13 18:05:43.758565 dv-cinder-852009-8-iscsi devstack@n-api.service[120740]: Content-Type: application/json Sep 13 18:05:43.758565 dv-cinder-852009-8-iscsi devstack@n-api.service[120740]: Host: 10.222.0.43 Sep 13 18:05:43.758565 dv-cinder-852009-8-iscsi devstack@n-api.service[120740]: Openstack-System-Scope: None Sep 13 18:05:43.758565 dv-cinder-852009-8-iscsi devstack@n-api.service[120740]: User-Agent: python-urllib3/1.26.12 Sep 13 18:05:43.758565 dv-cinder-852009-8-iscsi devstack@n-api.service[120740]: X-Auth-Token: gAAAAABjIMWMYqPVtf0Rs9jRF4xl1KD9-SjO_FS4g579Cc1gUdbkqCtXPDYdTxBMbLmZqtgmWQubM-SSNfaWwXS4FDzkQIkG_6wttMeObykV4FtQQ2VkVt80Xzr2XOrB1n0hRb-cwFsutvG_3Oz7IRpcKn9EZa84Z-Ec1SHW4W3F55A21YEi9KQ Sep 13 18:05:43.758565 dv-cinder-852009-8-iscsi devstack@n-api.service[120740]: X-Domain-Id: None Sep 13 18:05:43.758565 dv-cinder-852009-8-iscsi devstack@n-api.service[120740]: X-Domain-Name: None Sep 13 18:05:43.758565 dv-cinder-852009-8-iscsi devstack@n-api.service[120740]: X-Identity-Status: Confirmed Sep 13 18:05:43.758565 dv-cinder-852009-8-iscsi devstack@n-api.service[120740]: X-Is-Admin-Project: True Sep 13 18:05:43.758565 dv-cinder-852009-8-iscsi devstack@n-api.service[120740]: X-Openstack-Nova-Api-Version: 2.20 Sep 13 18:05:43.758565 dv-cinder-852009-8-iscsi devstack@n-api.service[120740]: X-Project-Domain-Id: default Sep 13 18:05:43.758565 dv-cinder-852009-8-iscsi devstack@n-api.service[120740]: X-Project-Domain-Name: Default Sep 13 18:05:43.758565 dv-cinder-852009-8-iscsi devstack@n-api.service[120740]: X-Project-Id: 75e14fd88bfb4cd896fa7b070a0fac47 Sep 13 18:05:43.758565 dv-cinder-852009-8-iscsi devstack@n-api.service[120740]: X-Project-Name: tempest-AttachVolumeShelveTestJSON-385853788 Sep 13 18:05:43.758565 dv-cinder-852009-8-iscsi devstack@n-api.service[120740]: X-Role: reader,member Sep 13 18:05:43.758565 dv-cinder-852009-8-iscsi devstack@n-api.service[120740]: X-Roles: reader,member Sep 13 18:05:43.760218 dv-cinder-852009-8-iscsi devstack@n-api.service[120740]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/identity"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/compute/v2/75e14fd88bfb4cd896fa7b070a0fac47"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.43:8080", "publicURL": "http://10.222.0.43:8080/v1/AUTH_75e14fd88bfb4cd896fa7b070a0fac47"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43:9696/networking"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/volume/v3/75e14fd88bfb4cd896fa7b070a0fac47"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/compute/v2.1"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/placement"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/volume/v3/75e14fd88bfb4cd896fa7b070a0fac47"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/image"}]}] Sep 13 18:05:43.760218 dv-cinder-852009-8-iscsi devstack@n-api.service[120740]: X-Tenant: tempest-AttachVolumeShelveTestJSON-385853788 Sep 13 18:05:43.760218 dv-cinder-852009-8-iscsi devstack@n-api.service[120740]: X-Tenant-Id: 75e14fd88bfb4cd896fa7b070a0fac47 Sep 13 18:05:43.760218 dv-cinder-852009-8-iscsi devstack@n-api.service[120740]: X-Tenant-Name: tempest-AttachVolumeShelveTestJSON-385853788 Sep 13 18:05:43.760218 dv-cinder-852009-8-iscsi devstack@n-api.service[120740]: X-User: tempest-AttachVolumeShelveTestJSON-385853788-project Sep 13 18:05:43.760218 dv-cinder-852009-8-iscsi devstack@n-api.service[120740]: X-User-Domain-Id: default Sep 13 18:05:43.760218 dv-cinder-852009-8-iscsi devstack@n-api.service[120740]: X-User-Domain-Name: Default Sep 13 18:05:43.760218 dv-cinder-852009-8-iscsi devstack@n-api.service[120740]: X-User-Id: e68ecd9b3ca643539b109f75bb242d6f Sep 13 18:05:43.760218 dv-cinder-852009-8-iscsi devstack@n-api.service[120740]: X-User-Name: tempest-AttachVolumeShelveTestJSON-385853788-project Sep 13 18:05:43.760218 dv-cinder-852009-8-iscsi devstack@n-api.service[120740]: method: > Sep 13 18:05:43.760218 dv-cinder-852009-8-iscsi devstack@n-api.service[120740]: exception: Instance 11d2616a-96f9-4a7a-aab8-219219986a8b could not be found. Sep 13 18:05:43.760218 dv-cinder-852009-8-iscsi devstack@n-api.service[120740]: action_args: {'id': '11d2616a-96f9-4a7a-aab8-219219986a8b'} Sep 13 18:05:43.761295 dv-cinder-852009-8-iscsi devstack@n-api.service[120740]: {{(pid=120740) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 13 18:05:43.761295 dv-cinder-852009-8-iscsi devstack@n-api.service[120740]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 13 18:05:43.761295 dv-cinder-852009-8-iscsi devstack@n-api.service[120740]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Sep 13 18:05:43.761295 dv-cinder-852009-8-iscsi devstack@n-api.service[120740]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Sep 13 18:05:43.761295 dv-cinder-852009-8-iscsi devstack@n-api.service[120740]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Sep 13 18:05:43.761295 dv-cinder-852009-8-iscsi devstack@n-api.service[120740]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Sep 13 18:05:43.761295 dv-cinder-852009-8-iscsi devstack@n-api.service[120740]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Sep 13 18:05:43.761295 dv-cinder-852009-8-iscsi devstack@n-api.service[120740]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Sep 13 18:05:43.761295 dv-cinder-852009-8-iscsi devstack@n-api.service[120740]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Sep 13 18:05:43.761295 dv-cinder-852009-8-iscsi devstack@n-api.service[120740]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Sep 13 18:05:43.761295 dv-cinder-852009-8-iscsi devstack@n-api.service[120740]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 11d2616a-96f9-4a7a-aab8-219219986a8b could not be found. Sep 13 18:05:43.761295 dv-cinder-852009-8-iscsi devstack@n-api.service[120740]: ERROR nova.api.openstack.wsgi Sep 13 18:05:43.761295 dv-cinder-852009-8-iscsi devstack@n-api.service[120740]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 13 18:05:43.761295 dv-cinder-852009-8-iscsi devstack@n-api.service[120740]: ERROR nova.api.openstack.wsgi Sep 13 18:05:43.761295 dv-cinder-852009-8-iscsi devstack@n-api.service[120740]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 13 18:05:43.761295 dv-cinder-852009-8-iscsi devstack@n-api.service[120740]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 13 18:05:43.761295 dv-cinder-852009-8-iscsi devstack@n-api.service[120740]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 13 18:05:43.761295 dv-cinder-852009-8-iscsi devstack@n-api.service[120740]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 13 18:05:43.761295 dv-cinder-852009-8-iscsi devstack@n-api.service[120740]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 13 18:05:43.761295 dv-cinder-852009-8-iscsi devstack@n-api.service[120740]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 13 18:05:43.762713 dv-cinder-852009-8-iscsi devstack@n-api.service[120740]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 13 18:05:43.762713 dv-cinder-852009-8-iscsi devstack@n-api.service[120740]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Sep 13 18:05:43.762713 dv-cinder-852009-8-iscsi devstack@n-api.service[120740]: ERROR nova.api.openstack.wsgi instance = self._get_server( Sep 13 18:05:43.762713 dv-cinder-852009-8-iscsi devstack@n-api.service[120740]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Sep 13 18:05:43.762713 dv-cinder-852009-8-iscsi devstack@n-api.service[120740]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Sep 13 18:05:43.762713 dv-cinder-852009-8-iscsi devstack@n-api.service[120740]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Sep 13 18:05:43.762713 dv-cinder-852009-8-iscsi devstack@n-api.service[120740]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Sep 13 18:05:43.762713 dv-cinder-852009-8-iscsi devstack@n-api.service[120740]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 11d2616a-96f9-4a7a-aab8-219219986a8b could not be found. Sep 13 18:05:43.762713 dv-cinder-852009-8-iscsi devstack@n-api.service[120740]: ERROR nova.api.openstack.wsgi Sep 13 18:05:43.762713 dv-cinder-852009-8-iscsi devstack@n-api.service[120740]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 13 18:05:43.762713 dv-cinder-852009-8-iscsi devstack@n-api.service[120740]: ERROR nova.api.openstack.wsgi Sep 13 18:05:43.762713 dv-cinder-852009-8-iscsi devstack@n-api.service[120740]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 13 18:05:43.762713 dv-cinder-852009-8-iscsi devstack@n-api.service[120740]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 13 18:05:43.762713 dv-cinder-852009-8-iscsi devstack@n-api.service[120740]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 13 18:05:43.762713 dv-cinder-852009-8-iscsi devstack@n-api.service[120740]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 13 18:05:43.762713 dv-cinder-852009-8-iscsi devstack@n-api.service[120740]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 13 18:05:43.762713 dv-cinder-852009-8-iscsi devstack@n-api.service[120740]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 11d2616a-96f9-4a7a-aab8-219219986a8b could not be found. Sep 13 18:05:43.762713 dv-cinder-852009-8-iscsi devstack@n-api.service[120740]: ERROR nova.api.openstack.wsgi Sep 13 18:05:43.763962 dv-cinder-852009-8-iscsi devstack@n-api.service[120740]: DEBUG nova.api.openstack.wsgi [None req-ca2a6628-ba28-4890-b058-d4067be698fc tempest-AttachVolumeShelveTestJSON-385853788 tempest-AttachVolumeShelveTestJSON-385853788-project] Returning 404 to user: Instance 11d2616a-96f9-4a7a-aab8-219219986a8b could not be found. {{(pid=120740) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 13 18:05:43.763962 dv-cinder-852009-8-iscsi devstack@n-api.service[120740]: INFO nova.api.openstack.requestlog [None req-ca2a6628-ba28-4890-b058-d4067be698fc tempest-AttachVolumeShelveTestJSON-385853788 tempest-AttachVolumeShelveTestJSON-385853788-project] 10.222.0.43 "GET /compute/v2.1/servers/11d2616a-96f9-4a7a-aab8-219219986a8b" status: 404 len: 111 microversion: 2.20 time: 0.035962 Sep 13 18:05:43.763962 dv-cinder-852009-8-iscsi devstack@n-api.service[120740]: [pid: 120740|app: 0|req: 219/427] 10.222.0.43 () {60 vars in 1277 bytes} [Tue Sep 13 18:05:43 2022] GET /compute/v2.1/servers/11d2616a-96f9-4a7a-aab8-219219986a8b => generated 111 bytes in 39 msecs (HTTP/1.1 404) 9 headers in 381 bytes (1 switches on core 0) Sep 13 18:05:43.772018 dv-cinder-852009-8-iscsi devstack@n-api.service[120741]: DEBUG nova.api.openstack.wsgi [None req-19bb1116-adaa-4426-a5d2-6859d24618c5 tempest-AttachVolumeShelveTestJSON-385853788 tempest-AttachVolumeShelveTestJSON-385853788-project] Calling method '.version_select at 0x7fa626b97670>' {{(pid=120741) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 18:05:43.795262 dv-cinder-852009-8-iscsi devstack@n-api.service[120740]: DEBUG nova.api.openstack.wsgi [None req-a843a2b0-39f1-4ff4-8573-603d994032a4 tempest-TestMinimumBasicScenario-820002800 tempest-TestMinimumBasicScenario-820002800-project] Calling method '>' {{(pid=120740) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 18:05:43.796137 dv-cinder-852009-8-iscsi devstack@n-api.service[120740]: DEBUG nova.compute.api [None req-a843a2b0-39f1-4ff4-8573-603d994032a4 tempest-TestMinimumBasicScenario-820002800 tempest-TestMinimumBasicScenario-820002800-project] [instance: f8247a13-94cd-45b2-acc8-8717e1260f37] Fetching instance by UUID {{(pid=120740) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 18:05:43.803766 dv-cinder-852009-8-iscsi devstack@n-api.service[120740]: DEBUG oslo_concurrency.lockutils [None req-a843a2b0-39f1-4ff4-8573-603d994032a4 tempest-TestMinimumBasicScenario-820002800 tempest-TestMinimumBasicScenario-820002800-project] Acquiring lock "1daf4f4c-0e4a-4779-b53a-78c48397ea2f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120740) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 18:05:43.806912 dv-cinder-852009-8-iscsi devstack@n-api.service[120740]: DEBUG oslo_concurrency.lockutils [None req-a843a2b0-39f1-4ff4-8573-603d994032a4 tempest-TestMinimumBasicScenario-820002800 tempest-TestMinimumBasicScenario-820002800-project] Lock "1daf4f4c-0e4a-4779-b53a-78c48397ea2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120740) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 18:05:43.806912 dv-cinder-852009-8-iscsi devstack@n-api.service[120740]: DEBUG oslo_concurrency.lockutils [None req-a843a2b0-39f1-4ff4-8573-603d994032a4 tempest-TestMinimumBasicScenario-820002800 tempest-TestMinimumBasicScenario-820002800-project] Lock "1daf4f4c-0e4a-4779-b53a-78c48397ea2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120740) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 18:05:43.806912 dv-cinder-852009-8-iscsi devstack@n-api.service[120740]: DEBUG oslo_concurrency.lockutils [None req-a843a2b0-39f1-4ff4-8573-603d994032a4 tempest-TestMinimumBasicScenario-820002800 tempest-TestMinimumBasicScenario-820002800-project] Acquiring lock "1daf4f4c-0e4a-4779-b53a-78c48397ea2f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120740) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 18:05:43.809105 dv-cinder-852009-8-iscsi devstack@n-api.service[120741]: INFO nova.api.openstack.requestlog [None req-19bb1116-adaa-4426-a5d2-6859d24618c5 tempest-AttachVolumeShelveTestJSON-385853788 tempest-AttachVolumeShelveTestJSON-385853788-project] 10.222.0.43 "DELETE /compute/v2.1/os-keypairs/tempest-keypair-68191066" status: 204 len: 0 microversion: 2.20 time: 0.040368 Sep 13 18:05:43.809914 dv-cinder-852009-8-iscsi devstack@n-api.service[120741]: [pid: 120741|app: 0|req: 209/428] 10.222.0.43 () {60 vars in 1256 bytes} [Tue Sep 13 18:05:43 2022] DELETE /compute/v2.1/os-keypairs/tempest-keypair-68191066 => generated 0 bytes in 42 msecs (HTTP/1.1 204) 9 headers in 365 bytes (1 switches on core 0) Sep 13 18:05:43.817605 dv-cinder-852009-8-iscsi devstack@n-api.service[120740]: DEBUG oslo_concurrency.lockutils [None req-a843a2b0-39f1-4ff4-8573-603d994032a4 tempest-TestMinimumBasicScenario-820002800 tempest-TestMinimumBasicScenario-820002800-project] Lock "1daf4f4c-0e4a-4779-b53a-78c48397ea2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120740) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 18:05:43.818338 dv-cinder-852009-8-iscsi devstack@n-api.service[120740]: DEBUG oslo_concurrency.lockutils [None req-a843a2b0-39f1-4ff4-8573-603d994032a4 tempest-TestMinimumBasicScenario-820002800 tempest-TestMinimumBasicScenario-820002800-project] Lock "1daf4f4c-0e4a-4779-b53a-78c48397ea2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.011s {{(pid=120740) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 18:05:43.955361 dv-cinder-852009-8-iscsi devstack@n-api.service[120741]: DEBUG nova.api.openstack.wsgi [None req-bbf1dd95-7ab1-41c4-8091-0dfb70a499db tempest-ServerRescueNegativeTestJSON-412251590 tempest-ServerRescueNegativeTestJSON-412251590-project] Calling method '>' {{(pid=120741) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 18:05:43.956082 dv-cinder-852009-8-iscsi devstack@n-api.service[120741]: DEBUG nova.compute.api [None req-bbf1dd95-7ab1-41c4-8091-0dfb70a499db tempest-ServerRescueNegativeTestJSON-412251590 tempest-ServerRescueNegativeTestJSON-412251590-project] [instance: e8ce7158-6b73-4586-9f78-8e821988e71c] Fetching instance by UUID {{(pid=120741) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 18:05:43.968335 dv-cinder-852009-8-iscsi devstack@n-api.service[120741]: DEBUG oslo_concurrency.lockutils [None req-bbf1dd95-7ab1-41c4-8091-0dfb70a499db tempest-ServerRescueNegativeTestJSON-412251590 tempest-ServerRescueNegativeTestJSON-412251590-project] Acquiring lock "1daf4f4c-0e4a-4779-b53a-78c48397ea2f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120741) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 18:05:43.968984 dv-cinder-852009-8-iscsi devstack@n-api.service[120741]: DEBUG oslo_concurrency.lockutils [None req-bbf1dd95-7ab1-41c4-8091-0dfb70a499db tempest-ServerRescueNegativeTestJSON-412251590 tempest-ServerRescueNegativeTestJSON-412251590-project] Lock "1daf4f4c-0e4a-4779-b53a-78c48397ea2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120741) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 18:05:43.971560 dv-cinder-852009-8-iscsi devstack@n-api.service[120741]: DEBUG oslo_concurrency.lockutils [None req-bbf1dd95-7ab1-41c4-8091-0dfb70a499db tempest-ServerRescueNegativeTestJSON-412251590 tempest-ServerRescueNegativeTestJSON-412251590-project] Lock "1daf4f4c-0e4a-4779-b53a-78c48397ea2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120741) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 18:05:43.972949 dv-cinder-852009-8-iscsi devstack@n-api.service[120741]: DEBUG oslo_concurrency.lockutils [None req-bbf1dd95-7ab1-41c4-8091-0dfb70a499db tempest-ServerRescueNegativeTestJSON-412251590 tempest-ServerRescueNegativeTestJSON-412251590-project] Acquiring lock "1daf4f4c-0e4a-4779-b53a-78c48397ea2f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120741) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 18:05:43.973650 dv-cinder-852009-8-iscsi devstack@n-api.service[120741]: DEBUG oslo_concurrency.lockutils [None req-bbf1dd95-7ab1-41c4-8091-0dfb70a499db tempest-ServerRescueNegativeTestJSON-412251590 tempest-ServerRescueNegativeTestJSON-412251590-project] Lock "1daf4f4c-0e4a-4779-b53a-78c48397ea2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120741) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 18:05:43.976032 dv-cinder-852009-8-iscsi devstack@n-api.service[120741]: DEBUG oslo_concurrency.lockutils [None req-bbf1dd95-7ab1-41c4-8091-0dfb70a499db tempest-ServerRescueNegativeTestJSON-412251590 tempest-ServerRescueNegativeTestJSON-412251590-project] Lock "1daf4f4c-0e4a-4779-b53a-78c48397ea2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120741) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 18:05:43.986868 dv-cinder-852009-8-iscsi devstack@n-api.service[120741]: DEBUG dbcounter [-] [120741] Writing DB stats nova_cell1:SELECT=100 {{(pid=120741) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 18:05:44.013704 dv-cinder-852009-8-iscsi devstack@n-api.service[120740]: DEBUG nova.policy [None req-a843a2b0-39f1-4ff4-8573-603d994032a4 tempest-TestMinimumBasicScenario-820002800 tempest-TestMinimumBasicScenario-820002800-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7880064ff0aa448d9c367c89eba145ff', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2f6832936c824066a4370cc45c5b0282', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120740) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 18:05:44.021753 dv-cinder-852009-8-iscsi devstack@n-api.service[120740]: INFO nova.api.openstack.requestlog [None req-a843a2b0-39f1-4ff4-8573-603d994032a4 tempest-TestMinimumBasicScenario-820002800 tempest-TestMinimumBasicScenario-820002800-project] 10.222.0.43 "GET /compute/v2.1/servers/f8247a13-94cd-45b2-acc8-8717e1260f37" status: 200 len: 1359 microversion: 2.1 time: 0.230447 Sep 13 18:05:44.037959 dv-cinder-852009-8-iscsi devstack@n-api.service[120740]: [pid: 120740|app: 0|req: 220/429] 10.222.0.43 () {58 vars in 1236 bytes} [Tue Sep 13 18:05:43 2022] GET /compute/v2.1/servers/f8247a13-94cd-45b2-acc8-8717e1260f37 => generated 1359 bytes in 247 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 13 18:05:44.200657 dv-cinder-852009-8-iscsi devstack@n-api.service[120741]: DEBUG nova.policy [None req-bbf1dd95-7ab1-41c4-8091-0dfb70a499db tempest-ServerRescueNegativeTestJSON-412251590 tempest-ServerRescueNegativeTestJSON-412251590-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '60800cf2774e409d9c1b6f4992669991', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2eae4acecf6c4961830ead78d71b2ad3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120741) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 18:05:44.213344 dv-cinder-852009-8-iscsi devstack@n-api.service[120741]: INFO nova.api.openstack.requestlog [None req-bbf1dd95-7ab1-41c4-8091-0dfb70a499db tempest-ServerRescueNegativeTestJSON-412251590 tempest-ServerRescueNegativeTestJSON-412251590-project] 10.222.0.43 "GET /compute/v2.1/servers/e8ce7158-6b73-4586-9f78-8e821988e71c" status: 200 len: 1736 microversion: 2.1 time: 0.262226 Sep 13 18:05:44.213955 dv-cinder-852009-8-iscsi devstack@n-api.service[120741]: [pid: 120741|app: 0|req: 210/430] 10.222.0.43 () {58 vars in 1236 bytes} [Tue Sep 13 18:05:43 2022] GET /compute/v2.1/servers/e8ce7158-6b73-4586-9f78-8e821988e71c => generated 1736 bytes in 264 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 13 18:05:44.971771 dv-cinder-852009-8-iscsi devstack@n-api.service[120740]: DEBUG nova.api.openstack.wsgi [None req-578bdc2f-3856-41fa-8e77-502189c04fb7 tempest-AttachVolumeShelveTestJSON-385853788 tempest-AttachVolumeShelveTestJSON-385853788-project] Action: 'create', calling method: .version_select at 0x7fa626c6e670>, body: {"keypair": {"name": "tempest-keypair-1669216601", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBEV24SuxiPAPpr1YNEPjY6r9wpoTDqTnu0fc5c9x15AmL6vtQ5w8yaIzDd23mloNbU3rykvxagoCr9ZC1UH7QvVr725SyVnAYxS9GnpEjmfgOka6XFBQ25jX8+8yq9ymcg=="}} {{(pid=120740) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 13 18:05:44.989383 dv-cinder-852009-8-iscsi devstack@n-api.service[120740]: DEBUG nova.quota [None req-578bdc2f-3856-41fa-8e77-502189c04fb7 tempest-AttachVolumeShelveTestJSON-385853788 tempest-AttachVolumeShelveTestJSON-385853788-project] Getting quotas for project 75e14fd88bfb4cd896fa7b070a0fac47. Resources: {'key_pairs'} {{(pid=120740) _get_quotas /opt/stack/nova/nova/quota.py:393}} Sep 13 18:05:44.993652 dv-cinder-852009-8-iscsi devstack@n-api.service[120740]: DEBUG nova.quota [None req-578bdc2f-3856-41fa-8e77-502189c04fb7 tempest-AttachVolumeShelveTestJSON-385853788 tempest-AttachVolumeShelveTestJSON-385853788-project] Getting quotas for user e68ecd9b3ca643539b109f75bb242d6f and project 75e14fd88bfb4cd896fa7b070a0fac47. Resources: {'key_pairs'} {{(pid=120740) _get_quotas /opt/stack/nova/nova/quota.py:383}} Sep 13 18:05:45.018406 dv-cinder-852009-8-iscsi devstack@n-api.service[120740]: INFO nova.api.openstack.requestlog [None req-578bdc2f-3856-41fa-8e77-502189c04fb7 tempest-AttachVolumeShelveTestJSON-385853788 tempest-AttachVolumeShelveTestJSON-385853788-project] 10.222.0.43 "POST /compute/v2.1/os-keypairs" status: 201 len: 401 microversion: 2.20 time: 0.050582 Sep 13 18:05:45.019011 dv-cinder-852009-8-iscsi devstack@n-api.service[120740]: [pid: 120740|app: 0|req: 221/431] 10.222.0.43 () {62 vars in 1200 bytes} [Tue Sep 13 18:05:44 2022] POST /compute/v2.1/os-keypairs => generated 401 bytes in 52 msecs (HTTP/1.1 201) 9 headers in 364 bytes (2 switches on core 0) Sep 13 18:05:45.046506 dv-cinder-852009-8-iscsi devstack@n-api.service[120741]: DEBUG nova.api.openstack.wsgi [None req-97f9be48-e592-4d42-94cc-e3891ed8becb tempest-TestMinimumBasicScenario-820002800 tempest-TestMinimumBasicScenario-820002800-project] Calling method '>' {{(pid=120741) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 18:05:45.047101 dv-cinder-852009-8-iscsi devstack@n-api.service[120741]: DEBUG nova.compute.api [None req-97f9be48-e592-4d42-94cc-e3891ed8becb tempest-TestMinimumBasicScenario-820002800 tempest-TestMinimumBasicScenario-820002800-project] [instance: f8247a13-94cd-45b2-acc8-8717e1260f37] Fetching instance by UUID {{(pid=120741) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 18:05:45.055280 dv-cinder-852009-8-iscsi devstack@n-api.service[120741]: DEBUG oslo_concurrency.lockutils [None req-97f9be48-e592-4d42-94cc-e3891ed8becb tempest-TestMinimumBasicScenario-820002800 tempest-TestMinimumBasicScenario-820002800-project] Acquiring lock "1daf4f4c-0e4a-4779-b53a-78c48397ea2f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120741) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 18:05:45.055854 dv-cinder-852009-8-iscsi devstack@n-api.service[120741]: DEBUG oslo_concurrency.lockutils [None req-97f9be48-e592-4d42-94cc-e3891ed8becb tempest-TestMinimumBasicScenario-820002800 tempest-TestMinimumBasicScenario-820002800-project] Lock "1daf4f4c-0e4a-4779-b53a-78c48397ea2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120741) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 18:05:45.056280 dv-cinder-852009-8-iscsi devstack@n-api.service[120741]: DEBUG oslo_concurrency.lockutils [None req-97f9be48-e592-4d42-94cc-e3891ed8becb tempest-TestMinimumBasicScenario-820002800 tempest-TestMinimumBasicScenario-820002800-project] Lock "1daf4f4c-0e4a-4779-b53a-78c48397ea2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120741) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 18:05:45.058229 dv-cinder-852009-8-iscsi devstack@n-api.service[120741]: DEBUG oslo_concurrency.lockutils [None req-97f9be48-e592-4d42-94cc-e3891ed8becb tempest-TestMinimumBasicScenario-820002800 tempest-TestMinimumBasicScenario-820002800-project] Acquiring lock "1daf4f4c-0e4a-4779-b53a-78c48397ea2f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120741) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 18:05:45.059227 dv-cinder-852009-8-iscsi devstack@n-api.service[120741]: DEBUG oslo_concurrency.lockutils [None req-97f9be48-e592-4d42-94cc-e3891ed8becb tempest-TestMinimumBasicScenario-820002800 tempest-TestMinimumBasicScenario-820002800-project] Lock "1daf4f4c-0e4a-4779-b53a-78c48397ea2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120741) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 18:05:45.060356 dv-cinder-852009-8-iscsi devstack@n-api.service[120741]: DEBUG oslo_concurrency.lockutils [None req-97f9be48-e592-4d42-94cc-e3891ed8becb tempest-TestMinimumBasicScenario-820002800 tempest-TestMinimumBasicScenario-820002800-project] Lock "1daf4f4c-0e4a-4779-b53a-78c48397ea2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120741) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 18:05:45.231585 dv-cinder-852009-8-iscsi devstack@n-api.service[120741]: DEBUG nova.policy [None req-97f9be48-e592-4d42-94cc-e3891ed8becb tempest-TestMinimumBasicScenario-820002800 tempest-TestMinimumBasicScenario-820002800-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7880064ff0aa448d9c367c89eba145ff', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2f6832936c824066a4370cc45c5b0282', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120741) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 18:05:45.237501 dv-cinder-852009-8-iscsi devstack@n-api.service[120740]: DEBUG nova.api.openstack.wsgi [None req-c0c5f9cb-90c0-4381-90d6-f3701dc660f2 tempest-ServerRescueNegativeTestJSON-412251590 tempest-ServerRescueNegativeTestJSON-412251590-project] Calling method '>' {{(pid=120740) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 18:05:45.238112 dv-cinder-852009-8-iscsi devstack@n-api.service[120740]: DEBUG nova.compute.api [None req-c0c5f9cb-90c0-4381-90d6-f3701dc660f2 tempest-ServerRescueNegativeTestJSON-412251590 tempest-ServerRescueNegativeTestJSON-412251590-project] [instance: e8ce7158-6b73-4586-9f78-8e821988e71c] Fetching instance by UUID {{(pid=120740) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 18:05:45.239956 dv-cinder-852009-8-iscsi devstack@n-api.service[120741]: INFO nova.api.openstack.requestlog [None req-97f9be48-e592-4d42-94cc-e3891ed8becb tempest-TestMinimumBasicScenario-820002800 tempest-TestMinimumBasicScenario-820002800-project] 10.222.0.43 "GET /compute/v2.1/servers/f8247a13-94cd-45b2-acc8-8717e1260f37" status: 200 len: 1359 microversion: 2.1 time: 0.197367 Sep 13 18:05:45.246142 dv-cinder-852009-8-iscsi devstack@n-api.service[120741]: [pid: 120741|app: 0|req: 211/432] 10.222.0.43 () {58 vars in 1236 bytes} [Tue Sep 13 18:05:45 2022] GET /compute/v2.1/servers/f8247a13-94cd-45b2-acc8-8717e1260f37 => generated 1359 bytes in 199 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 13 18:05:45.246302 dv-cinder-852009-8-iscsi devstack@n-api.service[120740]: DEBUG oslo_concurrency.lockutils [None req-c0c5f9cb-90c0-4381-90d6-f3701dc660f2 tempest-ServerRescueNegativeTestJSON-412251590 tempest-ServerRescueNegativeTestJSON-412251590-project] Acquiring lock "1daf4f4c-0e4a-4779-b53a-78c48397ea2f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120740) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 18:05:45.246302 dv-cinder-852009-8-iscsi devstack@n-api.service[120740]: DEBUG oslo_concurrency.lockutils [None req-c0c5f9cb-90c0-4381-90d6-f3701dc660f2 tempest-ServerRescueNegativeTestJSON-412251590 tempest-ServerRescueNegativeTestJSON-412251590-project] Lock "1daf4f4c-0e4a-4779-b53a-78c48397ea2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120740) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 18:05:45.246586 dv-cinder-852009-8-iscsi devstack@n-api.service[120740]: DEBUG oslo_concurrency.lockutils [None req-c0c5f9cb-90c0-4381-90d6-f3701dc660f2 tempest-ServerRescueNegativeTestJSON-412251590 tempest-ServerRescueNegativeTestJSON-412251590-project] Lock "1daf4f4c-0e4a-4779-b53a-78c48397ea2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120740) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 18:05:45.248119 dv-cinder-852009-8-iscsi devstack@n-api.service[120740]: DEBUG oslo_concurrency.lockutils [None req-c0c5f9cb-90c0-4381-90d6-f3701dc660f2 tempest-ServerRescueNegativeTestJSON-412251590 tempest-ServerRescueNegativeTestJSON-412251590-project] Acquiring lock "1daf4f4c-0e4a-4779-b53a-78c48397ea2f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120740) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 18:05:45.248753 dv-cinder-852009-8-iscsi devstack@n-api.service[120740]: DEBUG oslo_concurrency.lockutils [None req-c0c5f9cb-90c0-4381-90d6-f3701dc660f2 tempest-ServerRescueNegativeTestJSON-412251590 tempest-ServerRescueNegativeTestJSON-412251590-project] Lock "1daf4f4c-0e4a-4779-b53a-78c48397ea2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120740) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 18:05:45.249321 dv-cinder-852009-8-iscsi devstack@n-api.service[120740]: DEBUG oslo_concurrency.lockutils [None req-c0c5f9cb-90c0-4381-90d6-f3701dc660f2 tempest-ServerRescueNegativeTestJSON-412251590 tempest-ServerRescueNegativeTestJSON-412251590-project] Lock "1daf4f4c-0e4a-4779-b53a-78c48397ea2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120740) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 18:05:45.412024 dv-cinder-852009-8-iscsi devstack@n-api.service[120740]: DEBUG nova.policy [None req-c0c5f9cb-90c0-4381-90d6-f3701dc660f2 tempest-ServerRescueNegativeTestJSON-412251590 tempest-ServerRescueNegativeTestJSON-412251590-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '60800cf2774e409d9c1b6f4992669991', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2eae4acecf6c4961830ead78d71b2ad3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120740) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 18:05:45.420548 dv-cinder-852009-8-iscsi devstack@n-api.service[120740]: INFO nova.api.openstack.requestlog [None req-c0c5f9cb-90c0-4381-90d6-f3701dc660f2 tempest-ServerRescueNegativeTestJSON-412251590 tempest-ServerRescueNegativeTestJSON-412251590-project] 10.222.0.43 "GET /compute/v2.1/servers/e8ce7158-6b73-4586-9f78-8e821988e71c" status: 200 len: 1716 microversion: 2.1 time: 0.187335 Sep 13 18:05:45.421588 dv-cinder-852009-8-iscsi devstack@n-api.service[120740]: [pid: 120740|app: 0|req: 222/433] 10.222.0.43 () {58 vars in 1236 bytes} [Tue Sep 13 18:05:45 2022] GET /compute/v2.1/servers/e8ce7158-6b73-4586-9f78-8e821988e71c => generated 1716 bytes in 189 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 13 18:05:45.536246 dv-cinder-852009-8-iscsi devstack@n-api.service[120741]: DEBUG nova.api.openstack.wsgi [None req-4f28e643-1cc2-4708-920b-06800750c605 tempest-ServerRescueNegativeTestJSON-412251590 tempest-ServerRescueNegativeTestJSON-412251590-project] Calling method '>' {{(pid=120741) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 18:05:45.536793 dv-cinder-852009-8-iscsi devstack@n-api.service[120741]: DEBUG nova.compute.api [None req-4f28e643-1cc2-4708-920b-06800750c605 tempest-ServerRescueNegativeTestJSON-412251590 tempest-ServerRescueNegativeTestJSON-412251590-project] [instance: e8ce7158-6b73-4586-9f78-8e821988e71c] Fetching instance by UUID {{(pid=120741) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 18:05:45.543591 dv-cinder-852009-8-iscsi devstack@n-api.service[120741]: DEBUG oslo_concurrency.lockutils [None req-4f28e643-1cc2-4708-920b-06800750c605 tempest-ServerRescueNegativeTestJSON-412251590 tempest-ServerRescueNegativeTestJSON-412251590-project] Acquiring lock "1daf4f4c-0e4a-4779-b53a-78c48397ea2f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120741) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 18:05:45.544241 dv-cinder-852009-8-iscsi devstack@n-api.service[120741]: DEBUG oslo_concurrency.lockutils [None req-4f28e643-1cc2-4708-920b-06800750c605 tempest-ServerRescueNegativeTestJSON-412251590 tempest-ServerRescueNegativeTestJSON-412251590-project] Lock "1daf4f4c-0e4a-4779-b53a-78c48397ea2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120741) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 18:05:45.544817 dv-cinder-852009-8-iscsi devstack@n-api.service[120741]: DEBUG oslo_concurrency.lockutils [None req-4f28e643-1cc2-4708-920b-06800750c605 tempest-ServerRescueNegativeTestJSON-412251590 tempest-ServerRescueNegativeTestJSON-412251590-project] Lock "1daf4f4c-0e4a-4779-b53a-78c48397ea2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120741) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 18:05:45.545569 dv-cinder-852009-8-iscsi devstack@n-api.service[120741]: DEBUG oslo_concurrency.lockutils [None req-4f28e643-1cc2-4708-920b-06800750c605 tempest-ServerRescueNegativeTestJSON-412251590 tempest-ServerRescueNegativeTestJSON-412251590-project] Acquiring lock "1daf4f4c-0e4a-4779-b53a-78c48397ea2f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120741) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 18:05:45.546162 dv-cinder-852009-8-iscsi devstack@n-api.service[120741]: DEBUG oslo_concurrency.lockutils [None req-4f28e643-1cc2-4708-920b-06800750c605 tempest-ServerRescueNegativeTestJSON-412251590 tempest-ServerRescueNegativeTestJSON-412251590-project] Lock "1daf4f4c-0e4a-4779-b53a-78c48397ea2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120741) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 18:05:45.546847 dv-cinder-852009-8-iscsi devstack@n-api.service[120741]: DEBUG oslo_concurrency.lockutils [None req-4f28e643-1cc2-4708-920b-06800750c605 tempest-ServerRescueNegativeTestJSON-412251590 tempest-ServerRescueNegativeTestJSON-412251590-project] Lock "1daf4f4c-0e4a-4779-b53a-78c48397ea2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120741) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 18:05:45.629350 dv-cinder-852009-8-iscsi devstack@n-api.service[120741]: INFO nova.api.openstack.wsgi [None req-4f28e643-1cc2-4708-920b-06800750c605 tempest-ServerRescueNegativeTestJSON-412251590 tempest-ServerRescueNegativeTestJSON-412251590-project] HTTP exception thrown: Cannot 'detach_volume' instance e8ce7158-6b73-4586-9f78-8e821988e71c while it is in vm_state rescued Sep 13 18:05:45.631073 dv-cinder-852009-8-iscsi devstack@n-api.service[120741]: DEBUG nova.api.openstack.wsgi [None req-4f28e643-1cc2-4708-920b-06800750c605 tempest-ServerRescueNegativeTestJSON-412251590 tempest-ServerRescueNegativeTestJSON-412251590-project] Request method failure captured: Sep 13 18:05:45.631073 dv-cinder-852009-8-iscsi devstack@n-api.service[120741]: request: DELETE /compute/v2.1/servers/e8ce7158-6b73-4586-9f78-8e821988e71c/os-volume_attachments/ed90df9f-4d34-4ffc-8a94-069e3f8558c1 HTTP/1.1 Sep 13 18:05:45.631073 dv-cinder-852009-8-iscsi devstack@n-api.service[120741]: Accept: application/json Sep 13 18:05:45.631073 dv-cinder-852009-8-iscsi devstack@n-api.service[120741]: Accept-Encoding: identity Sep 13 18:05:45.631073 dv-cinder-852009-8-iscsi devstack@n-api.service[120741]: Connection: close Sep 13 18:05:45.631073 dv-cinder-852009-8-iscsi devstack@n-api.service[120741]: Content-Length: 0 Sep 13 18:05:45.631073 dv-cinder-852009-8-iscsi devstack@n-api.service[120741]: Content-Type: application/json Sep 13 18:05:45.631073 dv-cinder-852009-8-iscsi devstack@n-api.service[120741]: Host: 10.222.0.43 Sep 13 18:05:45.631073 dv-cinder-852009-8-iscsi devstack@n-api.service[120741]: Openstack-System-Scope: None Sep 13 18:05:45.631073 dv-cinder-852009-8-iscsi devstack@n-api.service[120741]: User-Agent: python-urllib3/1.26.12 Sep 13 18:05:45.631073 dv-cinder-852009-8-iscsi devstack@n-api.service[120741]: X-Auth-Token: gAAAAABjIMWLGCNoeMW1liDJB1gW9y5zhqmLF-sp8LIXP_r2MtlxdDHDtH71A_-WwD3h6pxNpP_1J3-5dl1onM_1dz3k03VMJo2rjFEdcnLe1SaUhiMh3RVhtixTQiirGhUKXyKFRgOaQ5UOSPmq2sc9F0EVe-crpqJDqeSJGSsHbG1iIfI3v08 Sep 13 18:05:45.631073 dv-cinder-852009-8-iscsi devstack@n-api.service[120741]: X-Domain-Id: None Sep 13 18:05:45.631073 dv-cinder-852009-8-iscsi devstack@n-api.service[120741]: X-Domain-Name: None Sep 13 18:05:45.631073 dv-cinder-852009-8-iscsi devstack@n-api.service[120741]: X-Identity-Status: Confirmed Sep 13 18:05:45.631073 dv-cinder-852009-8-iscsi devstack@n-api.service[120741]: X-Is-Admin-Project: True Sep 13 18:05:45.631073 dv-cinder-852009-8-iscsi devstack@n-api.service[120741]: X-Project-Domain-Id: default Sep 13 18:05:45.631073 dv-cinder-852009-8-iscsi devstack@n-api.service[120741]: X-Project-Domain-Name: Default Sep 13 18:05:45.631073 dv-cinder-852009-8-iscsi devstack@n-api.service[120741]: X-Project-Id: 2eae4acecf6c4961830ead78d71b2ad3 Sep 13 18:05:45.631073 dv-cinder-852009-8-iscsi devstack@n-api.service[120741]: X-Project-Name: tempest-ServerRescueNegativeTestJSON-412251590 Sep 13 18:05:45.631073 dv-cinder-852009-8-iscsi devstack@n-api.service[120741]: X-Role: reader,member Sep 13 18:05:45.631073 dv-cinder-852009-8-iscsi devstack@n-api.service[120741]: X-Roles: reader,member Sep 13 18:05:45.632732 dv-cinder-852009-8-iscsi devstack@n-api.service[120741]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/identity"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/compute/v2/2eae4acecf6c4961830ead78d71b2ad3"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.43:8080", "publicURL": "http://10.222.0.43:8080/v1/AUTH_2eae4acecf6c4961830ead78d71b2ad3"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43:9696/networking"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/volume/v3/2eae4acecf6c4961830ead78d71b2ad3"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/compute/v2.1"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/placement"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/volume/v3/2eae4acecf6c4961830ead78d71b2ad3"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/image"}]}] Sep 13 18:05:45.632732 dv-cinder-852009-8-iscsi devstack@n-api.service[120741]: X-Tenant: tempest-ServerRescueNegativeTestJSON-412251590 Sep 13 18:05:45.632732 dv-cinder-852009-8-iscsi devstack@n-api.service[120741]: X-Tenant-Id: 2eae4acecf6c4961830ead78d71b2ad3 Sep 13 18:05:45.632732 dv-cinder-852009-8-iscsi devstack@n-api.service[120741]: X-Tenant-Name: tempest-ServerRescueNegativeTestJSON-412251590 Sep 13 18:05:45.632732 dv-cinder-852009-8-iscsi devstack@n-api.service[120741]: X-User: tempest-ServerRescueNegativeTestJSON-412251590-project Sep 13 18:05:45.632732 dv-cinder-852009-8-iscsi devstack@n-api.service[120741]: X-User-Domain-Id: default Sep 13 18:05:45.632732 dv-cinder-852009-8-iscsi devstack@n-api.service[120741]: X-User-Domain-Name: Default Sep 13 18:05:45.632732 dv-cinder-852009-8-iscsi devstack@n-api.service[120741]: X-User-Id: 60800cf2774e409d9c1b6f4992669991 Sep 13 18:05:45.632732 dv-cinder-852009-8-iscsi devstack@n-api.service[120741]: X-User-Name: tempest-ServerRescueNegativeTestJSON-412251590-project Sep 13 18:05:45.632732 dv-cinder-852009-8-iscsi devstack@n-api.service[120741]: method: > Sep 13 18:05:45.632732 dv-cinder-852009-8-iscsi devstack@n-api.service[120741]: exception: Cannot 'detach_volume' instance e8ce7158-6b73-4586-9f78-8e821988e71c while it is in vm_state rescued Sep 13 18:05:45.633424 dv-cinder-852009-8-iscsi devstack@n-api.service[120741]: action_args: {'server_id': 'e8ce7158-6b73-4586-9f78-8e821988e71c', 'id': 'ed90df9f-4d34-4ffc-8a94-069e3f8558c1'} Sep 13 18:05:45.633424 dv-cinder-852009-8-iscsi devstack@n-api.service[120741]: {{(pid=120741) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 13 18:05:45.633424 dv-cinder-852009-8-iscsi devstack@n-api.service[120741]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 13 18:05:45.633424 dv-cinder-852009-8-iscsi devstack@n-api.service[120741]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 565, in delete Sep 13 18:05:45.633424 dv-cinder-852009-8-iscsi devstack@n-api.service[120741]: ERROR nova.api.openstack.wsgi self.compute_api.detach_volume(context, instance, volume) Sep 13 18:05:45.633424 dv-cinder-852009-8-iscsi devstack@n-api.service[120741]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 241, in inner Sep 13 18:05:45.633424 dv-cinder-852009-8-iscsi devstack@n-api.service[120741]: ERROR nova.api.openstack.wsgi return function(self, context, instance, *args, **kwargs) Sep 13 18:05:45.633424 dv-cinder-852009-8-iscsi devstack@n-api.service[120741]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 148, in inner Sep 13 18:05:45.633424 dv-cinder-852009-8-iscsi devstack@n-api.service[120741]: ERROR nova.api.openstack.wsgi raise exception.InstanceInvalidState( Sep 13 18:05:45.633424 dv-cinder-852009-8-iscsi devstack@n-api.service[120741]: ERROR nova.api.openstack.wsgi nova.exception.InstanceInvalidState: Instance e8ce7158-6b73-4586-9f78-8e821988e71c in vm_state rescued. Cannot detach_volume while the instance is in this state. Sep 13 18:05:45.633424 dv-cinder-852009-8-iscsi devstack@n-api.service[120741]: ERROR nova.api.openstack.wsgi Sep 13 18:05:45.633424 dv-cinder-852009-8-iscsi devstack@n-api.service[120741]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 13 18:05:45.633424 dv-cinder-852009-8-iscsi devstack@n-api.service[120741]: ERROR nova.api.openstack.wsgi Sep 13 18:05:45.633424 dv-cinder-852009-8-iscsi devstack@n-api.service[120741]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 13 18:05:45.633424 dv-cinder-852009-8-iscsi devstack@n-api.service[120741]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 13 18:05:45.633424 dv-cinder-852009-8-iscsi devstack@n-api.service[120741]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 13 18:05:45.633424 dv-cinder-852009-8-iscsi devstack@n-api.service[120741]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 13 18:05:45.633424 dv-cinder-852009-8-iscsi devstack@n-api.service[120741]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 13 18:05:45.633424 dv-cinder-852009-8-iscsi devstack@n-api.service[120741]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 13 18:05:45.633424 dv-cinder-852009-8-iscsi devstack@n-api.service[120741]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 13 18:05:45.634589 dv-cinder-852009-8-iscsi devstack@n-api.service[120741]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 573, in delete Sep 13 18:05:45.634589 dv-cinder-852009-8-iscsi devstack@n-api.service[120741]: ERROR nova.api.openstack.wsgi common.raise_http_conflict_for_instance_invalid_state(state_error, Sep 13 18:05:45.634589 dv-cinder-852009-8-iscsi devstack@n-api.service[120741]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 347, in raise_http_conflict_for_instance_invalid_state Sep 13 18:05:45.634589 dv-cinder-852009-8-iscsi devstack@n-api.service[120741]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPConflict(explanation=msg) Sep 13 18:05:45.634589 dv-cinder-852009-8-iscsi devstack@n-api.service[120741]: ERROR nova.api.openstack.wsgi webob.exc.HTTPConflict: Cannot 'detach_volume' instance e8ce7158-6b73-4586-9f78-8e821988e71c while it is in vm_state rescued Sep 13 18:05:45.634589 dv-cinder-852009-8-iscsi devstack@n-api.service[120741]: ERROR nova.api.openstack.wsgi Sep 13 18:05:45.634589 dv-cinder-852009-8-iscsi devstack@n-api.service[120741]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 13 18:05:45.634589 dv-cinder-852009-8-iscsi devstack@n-api.service[120741]: ERROR nova.api.openstack.wsgi Sep 13 18:05:45.634589 dv-cinder-852009-8-iscsi devstack@n-api.service[120741]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 13 18:05:45.634589 dv-cinder-852009-8-iscsi devstack@n-api.service[120741]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 13 18:05:45.634589 dv-cinder-852009-8-iscsi devstack@n-api.service[120741]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 13 18:05:45.634589 dv-cinder-852009-8-iscsi devstack@n-api.service[120741]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 13 18:05:45.634589 dv-cinder-852009-8-iscsi devstack@n-api.service[120741]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 13 18:05:45.634589 dv-cinder-852009-8-iscsi devstack@n-api.service[120741]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Cannot 'detach_volume' instance e8ce7158-6b73-4586-9f78-8e821988e71c while it is in vm_state rescued Sep 13 18:05:45.634589 dv-cinder-852009-8-iscsi devstack@n-api.service[120741]: ERROR nova.api.openstack.wsgi Sep 13 18:05:45.634589 dv-cinder-852009-8-iscsi devstack@n-api.service[120741]: DEBUG nova.api.openstack.wsgi [None req-4f28e643-1cc2-4708-920b-06800750c605 tempest-ServerRescueNegativeTestJSON-412251590 tempest-ServerRescueNegativeTestJSON-412251590-project] Returning 409 to user: Cannot 'detach_volume' instance e8ce7158-6b73-4586-9f78-8e821988e71c while it is in vm_state rescued {{(pid=120741) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 13 18:05:45.635583 dv-cinder-852009-8-iscsi devstack@n-api.service[120741]: INFO nova.api.openstack.requestlog [None req-4f28e643-1cc2-4708-920b-06800750c605 tempest-ServerRescueNegativeTestJSON-412251590 tempest-ServerRescueNegativeTestJSON-412251590-project] 10.222.0.43 "DELETE /compute/v2.1/servers/e8ce7158-6b73-4586-9f78-8e821988e71c/os-volume_attachments/ed90df9f-4d34-4ffc-8a94-069e3f8558c1" status: 409 len: 152 microversion: 2.1 time: 0.100540 Sep 13 18:05:45.635583 dv-cinder-852009-8-iscsi devstack@n-api.service[120741]: [pid: 120741|app: 0|req: 212/434] 10.222.0.43 () {58 vars in 1416 bytes} [Tue Sep 13 18:05:45 2022] DELETE /compute/v2.1/servers/e8ce7158-6b73-4586-9f78-8e821988e71c/os-volume_attachments/ed90df9f-4d34-4ffc-8a94-069e3f8558c1 => generated 152 bytes in 102 msecs (HTTP/1.1 409) 9 headers in 378 bytes (1 switches on core 0) Sep 13 18:05:45.641811 dv-cinder-852009-8-iscsi devstack@n-api.service[120740]: DEBUG nova.api.openstack.wsgi [None req-0221bcfb-c6a4-4cbc-8f1d-19b2526436e6 tempest-ServerRescueNegativeTestJSON-412251590 tempest-ServerRescueNegativeTestJSON-412251590-project] Action: 'action', calling method: >, body: {"unrescue": {}} {{(pid=120740) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 13 18:05:45.642558 dv-cinder-852009-8-iscsi devstack@n-api.service[120740]: DEBUG nova.compute.api [None req-0221bcfb-c6a4-4cbc-8f1d-19b2526436e6 tempest-ServerRescueNegativeTestJSON-412251590 tempest-ServerRescueNegativeTestJSON-412251590-project] [instance: e8ce7158-6b73-4586-9f78-8e821988e71c] Fetching instance by UUID {{(pid=120740) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 18:05:45.648778 dv-cinder-852009-8-iscsi devstack@n-api.service[120740]: DEBUG oslo_concurrency.lockutils [None req-0221bcfb-c6a4-4cbc-8f1d-19b2526436e6 tempest-ServerRescueNegativeTestJSON-412251590 tempest-ServerRescueNegativeTestJSON-412251590-project] Acquiring lock "1daf4f4c-0e4a-4779-b53a-78c48397ea2f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120740) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 18:05:45.649351 dv-cinder-852009-8-iscsi devstack@n-api.service[120740]: DEBUG oslo_concurrency.lockutils [None req-0221bcfb-c6a4-4cbc-8f1d-19b2526436e6 tempest-ServerRescueNegativeTestJSON-412251590 tempest-ServerRescueNegativeTestJSON-412251590-project] Lock "1daf4f4c-0e4a-4779-b53a-78c48397ea2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120740) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 18:05:45.649850 dv-cinder-852009-8-iscsi devstack@n-api.service[120740]: DEBUG oslo_concurrency.lockutils [None req-0221bcfb-c6a4-4cbc-8f1d-19b2526436e6 tempest-ServerRescueNegativeTestJSON-412251590 tempest-ServerRescueNegativeTestJSON-412251590-project] Lock "1daf4f4c-0e4a-4779-b53a-78c48397ea2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120740) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 18:05:45.650617 dv-cinder-852009-8-iscsi devstack@n-api.service[120740]: DEBUG oslo_concurrency.lockutils [None req-0221bcfb-c6a4-4cbc-8f1d-19b2526436e6 tempest-ServerRescueNegativeTestJSON-412251590 tempest-ServerRescueNegativeTestJSON-412251590-project] Acquiring lock "1daf4f4c-0e4a-4779-b53a-78c48397ea2f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120740) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 18:05:45.651139 dv-cinder-852009-8-iscsi devstack@n-api.service[120740]: DEBUG oslo_concurrency.lockutils [None req-0221bcfb-c6a4-4cbc-8f1d-19b2526436e6 tempest-ServerRescueNegativeTestJSON-412251590 tempest-ServerRescueNegativeTestJSON-412251590-project] Lock "1daf4f4c-0e4a-4779-b53a-78c48397ea2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120740) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 18:05:45.651667 dv-cinder-852009-8-iscsi devstack@n-api.service[120740]: DEBUG oslo_concurrency.lockutils [None req-0221bcfb-c6a4-4cbc-8f1d-19b2526436e6 tempest-ServerRescueNegativeTestJSON-412251590 tempest-ServerRescueNegativeTestJSON-412251590-project] Lock "1daf4f4c-0e4a-4779-b53a-78c48397ea2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120740) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 18:05:45.727583 dv-cinder-852009-8-iscsi devstack@n-api.service[120740]: INFO nova.api.openstack.requestlog [None req-0221bcfb-c6a4-4cbc-8f1d-19b2526436e6 tempest-ServerRescueNegativeTestJSON-412251590 tempest-ServerRescueNegativeTestJSON-412251590-project] 10.222.0.43 "POST /compute/v2.1/servers/e8ce7158-6b73-4586-9f78-8e821988e71c/action" status: 202 len: 0 microversion: 2.1 time: 0.089535 Sep 13 18:05:45.728250 dv-cinder-852009-8-iscsi devstack@n-api.service[120740]: [pid: 120740|app: 0|req: 223/435] 10.222.0.43 () {60 vars in 1278 bytes} [Tue Sep 13 18:05:45 2022] POST /compute/v2.1/servers/e8ce7158-6b73-4586-9f78-8e821988e71c/action => generated 0 bytes in 91 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Sep 13 18:05:45.740126 dv-cinder-852009-8-iscsi devstack@n-api.service[120741]: DEBUG nova.api.openstack.wsgi [None req-932e9056-4fc1-475f-a02e-4f960f76f42f tempest-ServerRescueNegativeTestJSON-412251590 tempest-ServerRescueNegativeTestJSON-412251590-project] Calling method '>' {{(pid=120741) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 18:05:45.740761 dv-cinder-852009-8-iscsi devstack@n-api.service[120741]: DEBUG nova.compute.api [None req-932e9056-4fc1-475f-a02e-4f960f76f42f tempest-ServerRescueNegativeTestJSON-412251590 tempest-ServerRescueNegativeTestJSON-412251590-project] [instance: e8ce7158-6b73-4586-9f78-8e821988e71c] Fetching instance by UUID {{(pid=120741) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 18:05:45.747613 dv-cinder-852009-8-iscsi devstack@n-api.service[120741]: DEBUG oslo_concurrency.lockutils [None req-932e9056-4fc1-475f-a02e-4f960f76f42f tempest-ServerRescueNegativeTestJSON-412251590 tempest-ServerRescueNegativeTestJSON-412251590-project] Acquiring lock "1daf4f4c-0e4a-4779-b53a-78c48397ea2f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120741) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 18:05:45.748588 dv-cinder-852009-8-iscsi devstack@n-api.service[120741]: DEBUG oslo_concurrency.lockutils [None req-932e9056-4fc1-475f-a02e-4f960f76f42f tempest-ServerRescueNegativeTestJSON-412251590 tempest-ServerRescueNegativeTestJSON-412251590-project] Lock "1daf4f4c-0e4a-4779-b53a-78c48397ea2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120741) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 18:05:45.749166 dv-cinder-852009-8-iscsi devstack@n-api.service[120741]: DEBUG oslo_concurrency.lockutils [None req-932e9056-4fc1-475f-a02e-4f960f76f42f tempest-ServerRescueNegativeTestJSON-412251590 tempest-ServerRescueNegativeTestJSON-412251590-project] Lock "1daf4f4c-0e4a-4779-b53a-78c48397ea2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120741) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 18:05:45.749857 dv-cinder-852009-8-iscsi devstack@n-api.service[120741]: DEBUG oslo_concurrency.lockutils [None req-932e9056-4fc1-475f-a02e-4f960f76f42f tempest-ServerRescueNegativeTestJSON-412251590 tempest-ServerRescueNegativeTestJSON-412251590-project] Acquiring lock "1daf4f4c-0e4a-4779-b53a-78c48397ea2f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120741) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 18:05:45.750679 dv-cinder-852009-8-iscsi devstack@n-api.service[120741]: DEBUG oslo_concurrency.lockutils [None req-932e9056-4fc1-475f-a02e-4f960f76f42f tempest-ServerRescueNegativeTestJSON-412251590 tempest-ServerRescueNegativeTestJSON-412251590-project] Lock "1daf4f4c-0e4a-4779-b53a-78c48397ea2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120741) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 18:05:45.751269 dv-cinder-852009-8-iscsi devstack@n-api.service[120741]: DEBUG oslo_concurrency.lockutils [None req-932e9056-4fc1-475f-a02e-4f960f76f42f tempest-ServerRescueNegativeTestJSON-412251590 tempest-ServerRescueNegativeTestJSON-412251590-project] Lock "1daf4f4c-0e4a-4779-b53a-78c48397ea2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120741) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 18:05:45.887708 dv-cinder-852009-8-iscsi devstack@n-api.service[120741]: DEBUG nova.policy [None req-932e9056-4fc1-475f-a02e-4f960f76f42f tempest-ServerRescueNegativeTestJSON-412251590 tempest-ServerRescueNegativeTestJSON-412251590-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '60800cf2774e409d9c1b6f4992669991', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2eae4acecf6c4961830ead78d71b2ad3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120741) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 18:05:45.897061 dv-cinder-852009-8-iscsi devstack@n-api.service[120741]: INFO nova.api.openstack.requestlog [None req-932e9056-4fc1-475f-a02e-4f960f76f42f tempest-ServerRescueNegativeTestJSON-412251590 tempest-ServerRescueNegativeTestJSON-412251590-project] 10.222.0.43 "GET /compute/v2.1/servers/e8ce7158-6b73-4586-9f78-8e821988e71c" status: 200 len: 1724 microversion: 2.1 time: 0.164395 Sep 13 18:05:45.898316 dv-cinder-852009-8-iscsi devstack@n-api.service[120741]: [pid: 120741|app: 0|req: 213/436] 10.222.0.43 () {58 vars in 1236 bytes} [Tue Sep 13 18:05:45 2022] GET /compute/v2.1/servers/e8ce7158-6b73-4586-9f78-8e821988e71c => generated 1724 bytes in 166 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 13 18:05:46.265054 dv-cinder-852009-8-iscsi devstack@n-api.service[120740]: DEBUG nova.api.openstack.wsgi [None req-1b504d70-4dbe-4a13-abf5-67680df679b5 tempest-TestMinimumBasicScenario-820002800 tempest-TestMinimumBasicScenario-820002800-project] Calling method '>' {{(pid=120740) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 18:05:46.265750 dv-cinder-852009-8-iscsi devstack@n-api.service[120740]: DEBUG nova.compute.api [None req-1b504d70-4dbe-4a13-abf5-67680df679b5 tempest-TestMinimumBasicScenario-820002800 tempest-TestMinimumBasicScenario-820002800-project] [instance: f8247a13-94cd-45b2-acc8-8717e1260f37] Fetching instance by UUID {{(pid=120740) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 18:05:46.272153 dv-cinder-852009-8-iscsi devstack@n-api.service[120740]: DEBUG oslo_concurrency.lockutils [None req-1b504d70-4dbe-4a13-abf5-67680df679b5 tempest-TestMinimumBasicScenario-820002800 tempest-TestMinimumBasicScenario-820002800-project] Acquiring lock "1daf4f4c-0e4a-4779-b53a-78c48397ea2f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120740) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 18:05:46.272680 dv-cinder-852009-8-iscsi devstack@n-api.service[120740]: DEBUG oslo_concurrency.lockutils [None req-1b504d70-4dbe-4a13-abf5-67680df679b5 tempest-TestMinimumBasicScenario-820002800 tempest-TestMinimumBasicScenario-820002800-project] Lock "1daf4f4c-0e4a-4779-b53a-78c48397ea2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120740) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 18:05:46.273104 dv-cinder-852009-8-iscsi devstack@n-api.service[120740]: DEBUG oslo_concurrency.lockutils [None req-1b504d70-4dbe-4a13-abf5-67680df679b5 tempest-TestMinimumBasicScenario-820002800 tempest-TestMinimumBasicScenario-820002800-project] Lock "1daf4f4c-0e4a-4779-b53a-78c48397ea2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120740) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 18:05:46.273806 dv-cinder-852009-8-iscsi devstack@n-api.service[120740]: DEBUG oslo_concurrency.lockutils [None req-1b504d70-4dbe-4a13-abf5-67680df679b5 tempest-TestMinimumBasicScenario-820002800 tempest-TestMinimumBasicScenario-820002800-project] Acquiring lock "1daf4f4c-0e4a-4779-b53a-78c48397ea2f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120740) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 18:05:46.274258 dv-cinder-852009-8-iscsi devstack@n-api.service[120740]: DEBUG oslo_concurrency.lockutils [None req-1b504d70-4dbe-4a13-abf5-67680df679b5 tempest-TestMinimumBasicScenario-820002800 tempest-TestMinimumBasicScenario-820002800-project] Lock "1daf4f4c-0e4a-4779-b53a-78c48397ea2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120740) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 18:05:46.274692 dv-cinder-852009-8-iscsi devstack@n-api.service[120740]: DEBUG oslo_concurrency.lockutils [None req-1b504d70-4dbe-4a13-abf5-67680df679b5 tempest-TestMinimumBasicScenario-820002800 tempest-TestMinimumBasicScenario-820002800-project] Lock "1daf4f4c-0e4a-4779-b53a-78c48397ea2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120740) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 18:05:46.407590 dv-cinder-852009-8-iscsi devstack@n-api.service[120740]: DEBUG nova.policy [None req-1b504d70-4dbe-4a13-abf5-67680df679b5 tempest-TestMinimumBasicScenario-820002800 tempest-TestMinimumBasicScenario-820002800-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7880064ff0aa448d9c367c89eba145ff', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2f6832936c824066a4370cc45c5b0282', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120740) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 18:05:46.415441 dv-cinder-852009-8-iscsi devstack@n-api.service[120740]: INFO nova.api.openstack.requestlog [None req-1b504d70-4dbe-4a13-abf5-67680df679b5 tempest-TestMinimumBasicScenario-820002800 tempest-TestMinimumBasicScenario-820002800-project] 10.222.0.43 "GET /compute/v2.1/servers/f8247a13-94cd-45b2-acc8-8717e1260f37" status: 200 len: 1359 microversion: 2.1 time: 0.155287 Sep 13 18:05:46.415962 dv-cinder-852009-8-iscsi devstack@n-api.service[120740]: [pid: 120740|app: 0|req: 224/437] 10.222.0.43 () {58 vars in 1236 bytes} [Tue Sep 13 18:05:46 2022] GET /compute/v2.1/servers/f8247a13-94cd-45b2-acc8-8717e1260f37 => generated 1359 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 13 18:05:46.714959 dv-cinder-852009-8-iscsi devstack@n-api.service[120741]: DEBUG nova.api.openstack.wsgi [None req-43b7300b-f9dd-476b-8eeb-695646bceec4 tempest-AttachVolumeShelveTestJSON-385853788 tempest-AttachVolumeShelveTestJSON-385853788-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-AttachVolumeShelveTestJSON-server-57418659", "imageRef": "33034e36-e6b2-4847-92a1-ff3188c05a4a", "flavorRef": "452", "adminPass": "***", "networks": [{"uuid": "a840bf21-d395-471c-bfba-b1533e9bad0d"}], "security_groups": [{"name": "tempest-securitygroup--1599517557"}], "key_name": "tempest-keypair-1669216601", "user_data": "}} {{(pid=120741) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 13 18:05:46.820012 dv-cinder-852009-8-iscsi devstack@n-api.service[120741]: DEBUG nova.network.neutron [None req-43b7300b-f9dd-476b-8eeb-695646bceec4 tempest-AttachVolumeShelveTestJSON-385853788 tempest-AttachVolumeShelveTestJSON-385853788-project] validate_networks() for [('a840bf21-d395-471c-bfba-b1533e9bad0d', None, None, None, None, None)] {{(pid=120741) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Sep 13 18:05:46.921845 dv-cinder-852009-8-iscsi devstack@n-api.service[120740]: DEBUG nova.api.openstack.wsgi [None req-daf3ae20-f2df-4dfd-aae9-bf356c4a7ba4 tempest-ServerRescueNegativeTestJSON-412251590 tempest-ServerRescueNegativeTestJSON-412251590-project] Calling method '>' {{(pid=120740) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 18:05:46.922558 dv-cinder-852009-8-iscsi devstack@n-api.service[120740]: DEBUG nova.compute.api [None req-daf3ae20-f2df-4dfd-aae9-bf356c4a7ba4 tempest-ServerRescueNegativeTestJSON-412251590 tempest-ServerRescueNegativeTestJSON-412251590-project] [instance: e8ce7158-6b73-4586-9f78-8e821988e71c] Fetching instance by UUID {{(pid=120740) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 18:05:46.925667 dv-cinder-852009-8-iscsi devstack@n-api.service[120740]: DEBUG dbcounter [-] [120740] Writing DB stats nova_api:SELECT=98,nova_api:UPDATE=1,nova_api:INSERT=1 {{(pid=120740) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 18:05:46.929412 dv-cinder-852009-8-iscsi devstack@n-api.service[120740]: DEBUG oslo_concurrency.lockutils [None req-daf3ae20-f2df-4dfd-aae9-bf356c4a7ba4 tempest-ServerRescueNegativeTestJSON-412251590 tempest-ServerRescueNegativeTestJSON-412251590-project] Acquiring lock "1daf4f4c-0e4a-4779-b53a-78c48397ea2f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120740) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 18:05:46.929975 dv-cinder-852009-8-iscsi devstack@n-api.service[120740]: DEBUG oslo_concurrency.lockutils [None req-daf3ae20-f2df-4dfd-aae9-bf356c4a7ba4 tempest-ServerRescueNegativeTestJSON-412251590 tempest-ServerRescueNegativeTestJSON-412251590-project] Lock "1daf4f4c-0e4a-4779-b53a-78c48397ea2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120740) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 18:05:46.930473 dv-cinder-852009-8-iscsi devstack@n-api.service[120740]: DEBUG oslo_concurrency.lockutils [None req-daf3ae20-f2df-4dfd-aae9-bf356c4a7ba4 tempest-ServerRescueNegativeTestJSON-412251590 tempest-ServerRescueNegativeTestJSON-412251590-project] Lock "1daf4f4c-0e4a-4779-b53a-78c48397ea2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120740) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 18:05:46.931230 dv-cinder-852009-8-iscsi devstack@n-api.service[120740]: DEBUG oslo_concurrency.lockutils [None req-daf3ae20-f2df-4dfd-aae9-bf356c4a7ba4 tempest-ServerRescueNegativeTestJSON-412251590 tempest-ServerRescueNegativeTestJSON-412251590-project] Acquiring lock "1daf4f4c-0e4a-4779-b53a-78c48397ea2f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120740) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 18:05:46.931829 dv-cinder-852009-8-iscsi devstack@n-api.service[120740]: DEBUG oslo_concurrency.lockutils [None req-daf3ae20-f2df-4dfd-aae9-bf356c4a7ba4 tempest-ServerRescueNegativeTestJSON-412251590 tempest-ServerRescueNegativeTestJSON-412251590-project] Lock "1daf4f4c-0e4a-4779-b53a-78c48397ea2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120740) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 18:05:46.932315 dv-cinder-852009-8-iscsi devstack@n-api.service[120740]: DEBUG oslo_concurrency.lockutils [None req-daf3ae20-f2df-4dfd-aae9-bf356c4a7ba4 tempest-ServerRescueNegativeTestJSON-412251590 tempest-ServerRescueNegativeTestJSON-412251590-project] Lock "1daf4f4c-0e4a-4779-b53a-78c48397ea2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120740) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 18:05:47.169031 dv-cinder-852009-8-iscsi devstack@n-api.service[120740]: DEBUG nova.policy [None req-daf3ae20-f2df-4dfd-aae9-bf356c4a7ba4 tempest-ServerRescueNegativeTestJSON-412251590 tempest-ServerRescueNegativeTestJSON-412251590-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '60800cf2774e409d9c1b6f4992669991', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2eae4acecf6c4961830ead78d71b2ad3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120740) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 18:05:47.177907 dv-cinder-852009-8-iscsi devstack@n-api.service[120740]: INFO nova.api.openstack.requestlog [None req-daf3ae20-f2df-4dfd-aae9-bf356c4a7ba4 tempest-ServerRescueNegativeTestJSON-412251590 tempest-ServerRescueNegativeTestJSON-412251590-project] 10.222.0.43 "GET /compute/v2.1/servers/e8ce7158-6b73-4586-9f78-8e821988e71c" status: 200 len: 1724 microversion: 2.1 time: 0.260662 Sep 13 18:05:47.178750 dv-cinder-852009-8-iscsi devstack@n-api.service[120740]: [pid: 120740|app: 0|req: 225/438] 10.222.0.43 () {58 vars in 1236 bytes} [Tue Sep 13 18:05:46 2022] GET /compute/v2.1/servers/e8ce7158-6b73-4586-9f78-8e821988e71c => generated 1724 bytes in 262 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 13 18:05:47.277644 dv-cinder-852009-8-iscsi devstack@n-api.service[120741]: DEBUG nova.virt.hardware [None req-43b7300b-f9dd-476b-8eeb-695646bceec4 tempest-AttachVolumeShelveTestJSON-385853788 tempest-AttachVolumeShelveTestJSON-385853788-project] Flavor limits 0:0:0 {{(pid=120741) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Sep 13 18:05:47.278070 dv-cinder-852009-8-iscsi devstack@n-api.service[120741]: DEBUG nova.virt.hardware [None req-43b7300b-f9dd-476b-8eeb-695646bceec4 tempest-AttachVolumeShelveTestJSON-385853788 tempest-AttachVolumeShelveTestJSON-385853788-project] Image limits 0:0:0 {{(pid=120741) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Sep 13 18:05:47.278524 dv-cinder-852009-8-iscsi devstack@n-api.service[120741]: DEBUG nova.virt.hardware [None req-43b7300b-f9dd-476b-8eeb-695646bceec4 tempest-AttachVolumeShelveTestJSON-385853788 tempest-AttachVolumeShelveTestJSON-385853788-project] Flavor pref 0:0:0 {{(pid=120741) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Sep 13 18:05:47.278928 dv-cinder-852009-8-iscsi devstack@n-api.service[120741]: DEBUG nova.virt.hardware [None req-43b7300b-f9dd-476b-8eeb-695646bceec4 tempest-AttachVolumeShelveTestJSON-385853788 tempest-AttachVolumeShelveTestJSON-385853788-project] Image pref 0:0:0 {{(pid=120741) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Sep 13 18:05:47.279337 dv-cinder-852009-8-iscsi devstack@n-api.service[120741]: DEBUG nova.virt.hardware [None req-43b7300b-f9dd-476b-8eeb-695646bceec4 tempest-AttachVolumeShelveTestJSON-385853788 tempest-AttachVolumeShelveTestJSON-385853788-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=120741) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Sep 13 18:05:47.288476 dv-cinder-852009-8-iscsi devstack@n-api.service[120741]: DEBUG oslo_concurrency.lockutils [None req-43b7300b-f9dd-476b-8eeb-695646bceec4 tempest-AttachVolumeShelveTestJSON-385853788 tempest-AttachVolumeShelveTestJSON-385853788-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120741) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 18:05:47.288975 dv-cinder-852009-8-iscsi devstack@n-api.service[120741]: DEBUG oslo_concurrency.lockutils [None req-43b7300b-f9dd-476b-8eeb-695646bceec4 tempest-AttachVolumeShelveTestJSON-385853788 tempest-AttachVolumeShelveTestJSON-385853788-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120741) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 18:05:47.289401 dv-cinder-852009-8-iscsi devstack@n-api.service[120741]: DEBUG oslo_concurrency.lockutils [None req-43b7300b-f9dd-476b-8eeb-695646bceec4 tempest-AttachVolumeShelveTestJSON-385853788 tempest-AttachVolumeShelveTestJSON-385853788-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120741) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 18:05:47.290132 dv-cinder-852009-8-iscsi devstack@n-api.service[120741]: DEBUG oslo_concurrency.lockutils [None req-43b7300b-f9dd-476b-8eeb-695646bceec4 tempest-AttachVolumeShelveTestJSON-385853788 tempest-AttachVolumeShelveTestJSON-385853788-project] Acquiring lock "1daf4f4c-0e4a-4779-b53a-78c48397ea2f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120741) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 18:05:47.290575 dv-cinder-852009-8-iscsi devstack@n-api.service[120741]: DEBUG oslo_concurrency.lockutils [None req-43b7300b-f9dd-476b-8eeb-695646bceec4 tempest-AttachVolumeShelveTestJSON-385853788 tempest-AttachVolumeShelveTestJSON-385853788-project] Lock "1daf4f4c-0e4a-4779-b53a-78c48397ea2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120741) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 18:05:47.290985 dv-cinder-852009-8-iscsi devstack@n-api.service[120741]: DEBUG oslo_concurrency.lockutils [None req-43b7300b-f9dd-476b-8eeb-695646bceec4 tempest-AttachVolumeShelveTestJSON-385853788 tempest-AttachVolumeShelveTestJSON-385853788-project] Lock "1daf4f4c-0e4a-4779-b53a-78c48397ea2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120741) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 18:05:47.308376 dv-cinder-852009-8-iscsi devstack@n-api.service[120741]: DEBUG nova.quota [None req-43b7300b-f9dd-476b-8eeb-695646bceec4 tempest-AttachVolumeShelveTestJSON-385853788 tempest-AttachVolumeShelveTestJSON-385853788-project] Getting quotas for project 75e14fd88bfb4cd896fa7b070a0fac47. Resources: {'cores', 'ram', 'instances'} {{(pid=120741) _get_quotas /opt/stack/nova/nova/quota.py:393}} Sep 13 18:05:47.312693 dv-cinder-852009-8-iscsi devstack@n-api.service[120741]: DEBUG nova.quota [None req-43b7300b-f9dd-476b-8eeb-695646bceec4 tempest-AttachVolumeShelveTestJSON-385853788 tempest-AttachVolumeShelveTestJSON-385853788-project] Getting quotas for user e68ecd9b3ca643539b109f75bb242d6f and project 75e14fd88bfb4cd896fa7b070a0fac47. Resources: {'cores', 'ram', 'instances'} {{(pid=120741) _get_quotas /opt/stack/nova/nova/quota.py:383}} Sep 13 18:05:47.324312 dv-cinder-852009-8-iscsi devstack@n-api.service[120741]: DEBUG nova.compute.api [None req-43b7300b-f9dd-476b-8eeb-695646bceec4 tempest-AttachVolumeShelveTestJSON-385853788 tempest-AttachVolumeShelveTestJSON-385853788-project] Going to run 1 instances... {{(pid=120741) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Sep 13 18:05:47.326549 dv-cinder-852009-8-iscsi devstack@n-api.service[120741]: DEBUG nova.compute.api [None req-43b7300b-f9dd-476b-8eeb-695646bceec4 tempest-AttachVolumeShelveTestJSON-385853788 tempest-AttachVolumeShelveTestJSON-385853788-project] [instance: 8cecf08e-bea8-4cef-9439-0eaa242bfed1] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='33034e36-e6b2-4847-92a1-ff3188c05a4a',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=120741) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Sep 13 18:05:47.375698 dv-cinder-852009-8-iscsi devstack@n-api.service[120741]: INFO nova.api.openstack.requestlog [None req-43b7300b-f9dd-476b-8eeb-695646bceec4 tempest-AttachVolumeShelveTestJSON-385853788 tempest-AttachVolumeShelveTestJSON-385853788-project] 10.222.0.43 "POST /compute/v2.1/servers" status: 202 len: 402 microversion: 2.20 time: 0.665092 Sep 13 18:05:47.377546 dv-cinder-852009-8-iscsi devstack@n-api.service[120741]: [pid: 120741|app: 0|req: 214/439] 10.222.0.43 () {62 vars in 1188 bytes} [Tue Sep 13 18:05:46 2022] POST /compute/v2.1/servers => generated 402 bytes in 667 msecs (HTTP/1.1 202) 10 headers in 453 bytes (1 switches on core 0) Sep 13 18:05:47.389136 dv-cinder-852009-8-iscsi devstack@n-api.service[120740]: DEBUG nova.api.openstack.wsgi [None req-95dfabbb-4970-441a-a9e5-1f40ea9e99e6 tempest-AttachVolumeShelveTestJSON-385853788 tempest-AttachVolumeShelveTestJSON-385853788-project] Calling method '>' {{(pid=120740) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 18:05:47.389806 dv-cinder-852009-8-iscsi devstack@n-api.service[120740]: DEBUG nova.compute.api [None req-95dfabbb-4970-441a-a9e5-1f40ea9e99e6 tempest-AttachVolumeShelveTestJSON-385853788 tempest-AttachVolumeShelveTestJSON-385853788-project] [instance: 8cecf08e-bea8-4cef-9439-0eaa242bfed1] Fetching instance by UUID {{(pid=120740) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 18:05:47.441414 dv-cinder-852009-8-iscsi devstack@n-api.service[120741]: DEBUG nova.api.openstack.wsgi [None req-09c9637e-92cd-4d75-8e79-55f3409c1b61 tempest-TestMinimumBasicScenario-820002800 tempest-TestMinimumBasicScenario-820002800-project] Calling method '>' {{(pid=120741) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 18:05:47.442139 dv-cinder-852009-8-iscsi devstack@n-api.service[120741]: DEBUG nova.compute.api [None req-09c9637e-92cd-4d75-8e79-55f3409c1b61 tempest-TestMinimumBasicScenario-820002800 tempest-TestMinimumBasicScenario-820002800-project] [instance: f8247a13-94cd-45b2-acc8-8717e1260f37] Fetching instance by UUID {{(pid=120741) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 18:05:47.449557 dv-cinder-852009-8-iscsi devstack@n-api.service[120741]: DEBUG oslo_concurrency.lockutils [None req-09c9637e-92cd-4d75-8e79-55f3409c1b61 tempest-TestMinimumBasicScenario-820002800 tempest-TestMinimumBasicScenario-820002800-project] Acquiring lock "1daf4f4c-0e4a-4779-b53a-78c48397ea2f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120741) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 18:05:47.450432 dv-cinder-852009-8-iscsi devstack@n-api.service[120740]: DEBUG nova.policy [None req-95dfabbb-4970-441a-a9e5-1f40ea9e99e6 tempest-AttachVolumeShelveTestJSON-385853788 tempest-AttachVolumeShelveTestJSON-385853788-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e68ecd9b3ca643539b109f75bb242d6f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '75e14fd88bfb4cd896fa7b070a0fac47', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120740) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 18:05:47.450642 dv-cinder-852009-8-iscsi devstack@n-api.service[120741]: DEBUG oslo_concurrency.lockutils [None req-09c9637e-92cd-4d75-8e79-55f3409c1b61 tempest-TestMinimumBasicScenario-820002800 tempest-TestMinimumBasicScenario-820002800-project] Lock "1daf4f4c-0e4a-4779-b53a-78c48397ea2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120741) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 18:05:47.451368 dv-cinder-852009-8-iscsi devstack@n-api.service[120741]: DEBUG oslo_concurrency.lockutils [None req-09c9637e-92cd-4d75-8e79-55f3409c1b61 tempest-TestMinimumBasicScenario-820002800 tempest-TestMinimumBasicScenario-820002800-project] Lock "1daf4f4c-0e4a-4779-b53a-78c48397ea2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120741) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 18:05:47.452515 dv-cinder-852009-8-iscsi devstack@n-api.service[120741]: DEBUG oslo_concurrency.lockutils [None req-09c9637e-92cd-4d75-8e79-55f3409c1b61 tempest-TestMinimumBasicScenario-820002800 tempest-TestMinimumBasicScenario-820002800-project] Acquiring lock "1daf4f4c-0e4a-4779-b53a-78c48397ea2f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120741) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 18:05:47.452759 dv-cinder-852009-8-iscsi devstack@n-api.service[120741]: DEBUG oslo_concurrency.lockutils [None req-09c9637e-92cd-4d75-8e79-55f3409c1b61 tempest-TestMinimumBasicScenario-820002800 tempest-TestMinimumBasicScenario-820002800-project] Lock "1daf4f4c-0e4a-4779-b53a-78c48397ea2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120741) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 18:05:47.453522 dv-cinder-852009-8-iscsi devstack@n-api.service[120741]: DEBUG oslo_concurrency.lockutils [None req-09c9637e-92cd-4d75-8e79-55f3409c1b61 tempest-TestMinimumBasicScenario-820002800 tempest-TestMinimumBasicScenario-820002800-project] Lock "1daf4f4c-0e4a-4779-b53a-78c48397ea2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120741) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 18:05:47.460807 dv-cinder-852009-8-iscsi devstack@n-api.service[120740]: DEBUG nova.policy [None req-95dfabbb-4970-441a-a9e5-1f40ea9e99e6 tempest-AttachVolumeShelveTestJSON-385853788 tempest-AttachVolumeShelveTestJSON-385853788-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'e68ecd9b3ca643539b109f75bb242d6f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '75e14fd88bfb4cd896fa7b070a0fac47', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120740) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 18:05:47.462554 dv-cinder-852009-8-iscsi devstack@n-api.service[120740]: DEBUG nova.policy [None req-95dfabbb-4970-441a-a9e5-1f40ea9e99e6 tempest-AttachVolumeShelveTestJSON-385853788 tempest-AttachVolumeShelveTestJSON-385853788-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'e68ecd9b3ca643539b109f75bb242d6f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '75e14fd88bfb4cd896fa7b070a0fac47', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120740) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 18:05:47.463748 dv-cinder-852009-8-iscsi devstack@n-api.service[120740]: INFO nova.api.openstack.requestlog [None req-95dfabbb-4970-441a-a9e5-1f40ea9e99e6 tempest-AttachVolumeShelveTestJSON-385853788 tempest-AttachVolumeShelveTestJSON-385853788-project] 10.222.0.43 "GET /compute/v2.1/servers/8cecf08e-bea8-4cef-9439-0eaa242bfed1" status: 200 len: 1280 microversion: 2.20 time: 0.078634 Sep 13 18:05:47.464797 dv-cinder-852009-8-iscsi devstack@n-api.service[120740]: [pid: 120740|app: 0|req: 226/440] 10.222.0.43 () {60 vars in 1277 bytes} [Tue Sep 13 18:05:47 2022] GET /compute/v2.1/servers/8cecf08e-bea8-4cef-9439-0eaa242bfed1 => generated 1280 bytes in 80 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Sep 13 18:05:47.599179 dv-cinder-852009-8-iscsi devstack@n-api.service[120741]: DEBUG nova.policy [None req-09c9637e-92cd-4d75-8e79-55f3409c1b61 tempest-TestMinimumBasicScenario-820002800 tempest-TestMinimumBasicScenario-820002800-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7880064ff0aa448d9c367c89eba145ff', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2f6832936c824066a4370cc45c5b0282', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120741) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 18:05:47.607879 dv-cinder-852009-8-iscsi devstack@n-api.service[120741]: INFO nova.api.openstack.requestlog [None req-09c9637e-92cd-4d75-8e79-55f3409c1b61 tempest-TestMinimumBasicScenario-820002800 tempest-TestMinimumBasicScenario-820002800-project] 10.222.0.43 "GET /compute/v2.1/servers/f8247a13-94cd-45b2-acc8-8717e1260f37" status: 200 len: 1359 microversion: 2.1 time: 0.172246 Sep 13 18:05:47.608570 dv-cinder-852009-8-iscsi devstack@n-api.service[120741]: [pid: 120741|app: 0|req: 215/441] 10.222.0.43 () {58 vars in 1236 bytes} [Tue Sep 13 18:05:47 2022] GET /compute/v2.1/servers/f8247a13-94cd-45b2-acc8-8717e1260f37 => generated 1359 bytes in 175 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 13 18:05:48.201564 dv-cinder-852009-8-iscsi devstack@n-api.service[120740]: DEBUG nova.api.openstack.wsgi [None req-838273b3-72e6-457b-bc8e-c51e2dfae937 tempest-ServerRescueNegativeTestJSON-412251590 tempest-ServerRescueNegativeTestJSON-412251590-project] Calling method '>' {{(pid=120740) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 18:05:48.202315 dv-cinder-852009-8-iscsi devstack@n-api.service[120740]: DEBUG nova.compute.api [None req-838273b3-72e6-457b-bc8e-c51e2dfae937 tempest-ServerRescueNegativeTestJSON-412251590 tempest-ServerRescueNegativeTestJSON-412251590-project] [instance: e8ce7158-6b73-4586-9f78-8e821988e71c] Fetching instance by UUID {{(pid=120740) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 18:05:48.210187 dv-cinder-852009-8-iscsi devstack@n-api.service[120740]: DEBUG oslo_concurrency.lockutils [None req-838273b3-72e6-457b-bc8e-c51e2dfae937 tempest-ServerRescueNegativeTestJSON-412251590 tempest-ServerRescueNegativeTestJSON-412251590-project] Acquiring lock "1daf4f4c-0e4a-4779-b53a-78c48397ea2f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120740) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 18:05:48.210955 dv-cinder-852009-8-iscsi devstack@n-api.service[120740]: DEBUG oslo_concurrency.lockutils [None req-838273b3-72e6-457b-bc8e-c51e2dfae937 tempest-ServerRescueNegativeTestJSON-412251590 tempest-ServerRescueNegativeTestJSON-412251590-project] Lock "1daf4f4c-0e4a-4779-b53a-78c48397ea2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120740) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 18:05:48.211508 dv-cinder-852009-8-iscsi devstack@n-api.service[120740]: DEBUG oslo_concurrency.lockutils [None req-838273b3-72e6-457b-bc8e-c51e2dfae937 tempest-ServerRescueNegativeTestJSON-412251590 tempest-ServerRescueNegativeTestJSON-412251590-project] Lock "1daf4f4c-0e4a-4779-b53a-78c48397ea2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120740) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 18:05:48.212384 dv-cinder-852009-8-iscsi devstack@n-api.service[120740]: DEBUG oslo_concurrency.lockutils [None req-838273b3-72e6-457b-bc8e-c51e2dfae937 tempest-ServerRescueNegativeTestJSON-412251590 tempest-ServerRescueNegativeTestJSON-412251590-project] Acquiring lock "1daf4f4c-0e4a-4779-b53a-78c48397ea2f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120740) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 18:05:48.212913 dv-cinder-852009-8-iscsi devstack@n-api.service[120740]: DEBUG oslo_concurrency.lockutils [None req-838273b3-72e6-457b-bc8e-c51e2dfae937 tempest-ServerRescueNegativeTestJSON-412251590 tempest-ServerRescueNegativeTestJSON-412251590-project] Lock "1daf4f4c-0e4a-4779-b53a-78c48397ea2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120740) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 18:05:48.213453 dv-cinder-852009-8-iscsi devstack@n-api.service[120740]: DEBUG oslo_concurrency.lockutils [None req-838273b3-72e6-457b-bc8e-c51e2dfae937 tempest-ServerRescueNegativeTestJSON-412251590 tempest-ServerRescueNegativeTestJSON-412251590-project] Lock "1daf4f4c-0e4a-4779-b53a-78c48397ea2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120740) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 18:05:48.490961 dv-cinder-852009-8-iscsi devstack@n-api.service[120741]: DEBUG nova.api.openstack.wsgi [None req-0ff82ff2-d6b3-49ec-a31d-fb9ae38b8e2f tempest-AttachVolumeShelveTestJSON-385853788 tempest-AttachVolumeShelveTestJSON-385853788-project] Calling method '>' {{(pid=120741) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 18:05:48.491653 dv-cinder-852009-8-iscsi devstack@n-api.service[120741]: DEBUG nova.compute.api [None req-0ff82ff2-d6b3-49ec-a31d-fb9ae38b8e2f tempest-AttachVolumeShelveTestJSON-385853788 tempest-AttachVolumeShelveTestJSON-385853788-project] [instance: 8cecf08e-bea8-4cef-9439-0eaa242bfed1] Fetching instance by UUID {{(pid=120741) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 18:05:48.500148 dv-cinder-852009-8-iscsi devstack@n-api.service[120741]: DEBUG oslo_concurrency.lockutils [None req-0ff82ff2-d6b3-49ec-a31d-fb9ae38b8e2f tempest-AttachVolumeShelveTestJSON-385853788 tempest-AttachVolumeShelveTestJSON-385853788-project] Acquiring lock "1daf4f4c-0e4a-4779-b53a-78c48397ea2f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120741) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 18:05:48.500754 dv-cinder-852009-8-iscsi devstack@n-api.service[120741]: DEBUG oslo_concurrency.lockutils [None req-0ff82ff2-d6b3-49ec-a31d-fb9ae38b8e2f tempest-AttachVolumeShelveTestJSON-385853788 tempest-AttachVolumeShelveTestJSON-385853788-project] Lock "1daf4f4c-0e4a-4779-b53a-78c48397ea2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120741) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 18:05:48.501250 dv-cinder-852009-8-iscsi devstack@n-api.service[120741]: DEBUG oslo_concurrency.lockutils [None req-0ff82ff2-d6b3-49ec-a31d-fb9ae38b8e2f tempest-AttachVolumeShelveTestJSON-385853788 tempest-AttachVolumeShelveTestJSON-385853788-project] Lock "1daf4f4c-0e4a-4779-b53a-78c48397ea2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120741) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 18:05:48.502390 dv-cinder-852009-8-iscsi devstack@n-api.service[120741]: DEBUG oslo_concurrency.lockutils [None req-0ff82ff2-d6b3-49ec-a31d-fb9ae38b8e2f tempest-AttachVolumeShelveTestJSON-385853788 tempest-AttachVolumeShelveTestJSON-385853788-project] Acquiring lock "1daf4f4c-0e4a-4779-b53a-78c48397ea2f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120741) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 18:05:48.502938 dv-cinder-852009-8-iscsi devstack@n-api.service[120741]: DEBUG oslo_concurrency.lockutils [None req-0ff82ff2-d6b3-49ec-a31d-fb9ae38b8e2f tempest-AttachVolumeShelveTestJSON-385853788 tempest-AttachVolumeShelveTestJSON-385853788-project] Lock "1daf4f4c-0e4a-4779-b53a-78c48397ea2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120741) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 18:05:48.503563 dv-cinder-852009-8-iscsi devstack@n-api.service[120741]: DEBUG oslo_concurrency.lockutils [None req-0ff82ff2-d6b3-49ec-a31d-fb9ae38b8e2f tempest-AttachVolumeShelveTestJSON-385853788 tempest-AttachVolumeShelveTestJSON-385853788-project] Lock "1daf4f4c-0e4a-4779-b53a-78c48397ea2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120741) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 18:05:48.593024 dv-cinder-852009-8-iscsi devstack@n-api.service[120740]: DEBUG nova.policy [None req-838273b3-72e6-457b-bc8e-c51e2dfae937 tempest-ServerRescueNegativeTestJSON-412251590 tempest-ServerRescueNegativeTestJSON-412251590-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '60800cf2774e409d9c1b6f4992669991', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2eae4acecf6c4961830ead78d71b2ad3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120740) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 18:05:48.601775 dv-cinder-852009-8-iscsi devstack@n-api.service[120740]: INFO nova.api.openstack.requestlog [None req-838273b3-72e6-457b-bc8e-c51e2dfae937 tempest-ServerRescueNegativeTestJSON-412251590 tempest-ServerRescueNegativeTestJSON-412251590-project] 10.222.0.43 "GET /compute/v2.1/servers/e8ce7158-6b73-4586-9f78-8e821988e71c" status: 200 len: 1724 microversion: 2.1 time: 0.404344 Sep 13 18:05:48.602341 dv-cinder-852009-8-iscsi devstack@n-api.service[120740]: [pid: 120740|app: 0|req: 227/442] 10.222.0.43 () {58 vars in 1236 bytes} [Tue Sep 13 18:05:48 2022] GET /compute/v2.1/servers/e8ce7158-6b73-4586-9f78-8e821988e71c => generated 1724 bytes in 406 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 13 18:05:48.611540 dv-cinder-852009-8-iscsi devstack@n-api.service[120741]: DEBUG nova.policy [None req-0ff82ff2-d6b3-49ec-a31d-fb9ae38b8e2f tempest-AttachVolumeShelveTestJSON-385853788 tempest-AttachVolumeShelveTestJSON-385853788-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e68ecd9b3ca643539b109f75bb242d6f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '75e14fd88bfb4cd896fa7b070a0fac47', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120741) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 18:05:48.622327 dv-cinder-852009-8-iscsi devstack@n-api.service[120741]: DEBUG nova.policy [None req-0ff82ff2-d6b3-49ec-a31d-fb9ae38b8e2f tempest-AttachVolumeShelveTestJSON-385853788 tempest-AttachVolumeShelveTestJSON-385853788-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'e68ecd9b3ca643539b109f75bb242d6f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '75e14fd88bfb4cd896fa7b070a0fac47', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120741) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 18:05:48.630208 dv-cinder-852009-8-iscsi devstack@n-api.service[120741]: DEBUG nova.policy [None req-0ff82ff2-d6b3-49ec-a31d-fb9ae38b8e2f tempest-AttachVolumeShelveTestJSON-385853788 tempest-AttachVolumeShelveTestJSON-385853788-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'e68ecd9b3ca643539b109f75bb242d6f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '75e14fd88bfb4cd896fa7b070a0fac47', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120741) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 18:05:48.631776 dv-cinder-852009-8-iscsi devstack@n-api.service[120741]: INFO nova.api.openstack.requestlog [None req-0ff82ff2-d6b3-49ec-a31d-fb9ae38b8e2f tempest-AttachVolumeShelveTestJSON-385853788 tempest-AttachVolumeShelveTestJSON-385853788-project] 10.222.0.43 "GET /compute/v2.1/servers/8cecf08e-bea8-4cef-9439-0eaa242bfed1" status: 200 len: 1276 microversion: 2.20 time: 0.145477 Sep 13 18:05:48.636552 dv-cinder-852009-8-iscsi devstack@n-api.service[120740]: DEBUG nova.api.openstack.wsgi [None req-e26647cc-ab26-4cce-8059-3374b33f9dc6 tempest-TestMinimumBasicScenario-820002800 tempest-TestMinimumBasicScenario-820002800-project] Calling method '>' {{(pid=120740) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 18:05:48.637742 dv-cinder-852009-8-iscsi devstack@n-api.service[120740]: DEBUG nova.compute.api [None req-e26647cc-ab26-4cce-8059-3374b33f9dc6 tempest-TestMinimumBasicScenario-820002800 tempest-TestMinimumBasicScenario-820002800-project] [instance: f8247a13-94cd-45b2-acc8-8717e1260f37] Fetching instance by UUID {{(pid=120740) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 18:05:48.641298 dv-cinder-852009-8-iscsi devstack@n-api.service[120741]: [pid: 120741|app: 0|req: 216/443] 10.222.0.43 () {60 vars in 1277 bytes} [Tue Sep 13 18:05:48 2022] GET /compute/v2.1/servers/8cecf08e-bea8-4cef-9439-0eaa242bfed1 => generated 1276 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 13 18:05:48.647924 dv-cinder-852009-8-iscsi devstack@n-api.service[120740]: DEBUG oslo_concurrency.lockutils [None req-e26647cc-ab26-4cce-8059-3374b33f9dc6 tempest-TestMinimumBasicScenario-820002800 tempest-TestMinimumBasicScenario-820002800-project] Acquiring lock "1daf4f4c-0e4a-4779-b53a-78c48397ea2f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120740) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 18:05:48.648619 dv-cinder-852009-8-iscsi devstack@n-api.service[120740]: DEBUG oslo_concurrency.lockutils [None req-e26647cc-ab26-4cce-8059-3374b33f9dc6 tempest-TestMinimumBasicScenario-820002800 tempest-TestMinimumBasicScenario-820002800-project] Lock "1daf4f4c-0e4a-4779-b53a-78c48397ea2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120740) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 18:05:48.649054 dv-cinder-852009-8-iscsi devstack@n-api.service[120740]: DEBUG oslo_concurrency.lockutils [None req-e26647cc-ab26-4cce-8059-3374b33f9dc6 tempest-TestMinimumBasicScenario-820002800 tempest-TestMinimumBasicScenario-820002800-project] Lock "1daf4f4c-0e4a-4779-b53a-78c48397ea2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120740) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 18:05:48.650148 dv-cinder-852009-8-iscsi devstack@n-api.service[120740]: DEBUG oslo_concurrency.lockutils [None req-e26647cc-ab26-4cce-8059-3374b33f9dc6 tempest-TestMinimumBasicScenario-820002800 tempest-TestMinimumBasicScenario-820002800-project] Acquiring lock "1daf4f4c-0e4a-4779-b53a-78c48397ea2f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120740) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 18:05:48.650747 dv-cinder-852009-8-iscsi devstack@n-api.service[120740]: DEBUG oslo_concurrency.lockutils [None req-e26647cc-ab26-4cce-8059-3374b33f9dc6 tempest-TestMinimumBasicScenario-820002800 tempest-TestMinimumBasicScenario-820002800-project] Lock "1daf4f4c-0e4a-4779-b53a-78c48397ea2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120740) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 18:05:48.651175 dv-cinder-852009-8-iscsi devstack@n-api.service[120740]: DEBUG oslo_concurrency.lockutils [None req-e26647cc-ab26-4cce-8059-3374b33f9dc6 tempest-TestMinimumBasicScenario-820002800 tempest-TestMinimumBasicScenario-820002800-project] Lock "1daf4f4c-0e4a-4779-b53a-78c48397ea2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120740) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 18:05:48.781158 dv-cinder-852009-8-iscsi devstack@n-api.service[120740]: DEBUG nova.policy [None req-e26647cc-ab26-4cce-8059-3374b33f9dc6 tempest-TestMinimumBasicScenario-820002800 tempest-TestMinimumBasicScenario-820002800-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7880064ff0aa448d9c367c89eba145ff', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2f6832936c824066a4370cc45c5b0282', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120740) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 18:05:48.789178 dv-cinder-852009-8-iscsi devstack@n-api.service[120740]: INFO nova.api.openstack.requestlog [None req-e26647cc-ab26-4cce-8059-3374b33f9dc6 tempest-TestMinimumBasicScenario-820002800 tempest-TestMinimumBasicScenario-820002800-project] 10.222.0.43 "GET /compute/v2.1/servers/f8247a13-94cd-45b2-acc8-8717e1260f37" status: 200 len: 1359 microversion: 2.1 time: 0.159053 Sep 13 18:05:48.789755 dv-cinder-852009-8-iscsi devstack@n-api.service[120740]: [pid: 120740|app: 0|req: 228/444] 10.222.0.43 () {58 vars in 1236 bytes} [Tue Sep 13 18:05:48 2022] GET /compute/v2.1/servers/f8247a13-94cd-45b2-acc8-8717e1260f37 => generated 1359 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 13 18:05:49.040445 dv-cinder-852009-8-iscsi devstack@n-api.service[120741]: DEBUG nova.api.openstack.wsgi [req-fb8eb48d-4c8e-4bc8-8457-6c2889d20d6a req-564b4b73-8a39-451b-9ac4-4df572ba7b3f service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "f8247a13-94cd-45b2-acc8-8717e1260f37", "name": "network-vif-plugged", "status": "completed", "tag": "9f86cf72-e29e-4f23-8c9d-afea192c2916"}]} {{(pid=120741) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 13 18:05:49.050537 dv-cinder-852009-8-iscsi devstack@n-api.service[120741]: DEBUG oslo_concurrency.lockutils [req-fb8eb48d-4c8e-4bc8-8457-6c2889d20d6a req-564b4b73-8a39-451b-9ac4-4df572ba7b3f service nova] Acquiring lock "1daf4f4c-0e4a-4779-b53a-78c48397ea2f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120741) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 18:05:49.050808 dv-cinder-852009-8-iscsi devstack@n-api.service[120741]: DEBUG oslo_concurrency.lockutils [req-fb8eb48d-4c8e-4bc8-8457-6c2889d20d6a req-564b4b73-8a39-451b-9ac4-4df572ba7b3f service nova] Lock "1daf4f4c-0e4a-4779-b53a-78c48397ea2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120741) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 18:05:49.051770 dv-cinder-852009-8-iscsi devstack@n-api.service[120741]: DEBUG oslo_concurrency.lockutils [req-fb8eb48d-4c8e-4bc8-8457-6c2889d20d6a req-564b4b73-8a39-451b-9ac4-4df572ba7b3f service nova] Lock "1daf4f4c-0e4a-4779-b53a-78c48397ea2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120741) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 18:05:49.063768 dv-cinder-852009-8-iscsi devstack@n-api.service[120741]: INFO nova.api.openstack.compute.server_external_events [req-fb8eb48d-4c8e-4bc8-8457-6c2889d20d6a req-564b4b73-8a39-451b-9ac4-4df572ba7b3f service nova] Creating event network-vif-plugged:9f86cf72-e29e-4f23-8c9d-afea192c2916 for instance f8247a13-94cd-45b2-acc8-8717e1260f37 on hv-cinder-85200 Sep 13 18:05:49.068792 dv-cinder-852009-8-iscsi devstack@n-api.service[120741]: INFO nova.api.openstack.requestlog [req-fb8eb48d-4c8e-4bc8-8457-6c2889d20d6a req-564b4b73-8a39-451b-9ac4-4df572ba7b3f service nova] 10.222.0.43 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.032411 Sep 13 18:05:49.069402 dv-cinder-852009-8-iscsi devstack@n-api.service[120741]: [pid: 120741|app: 0|req: 217/445] 10.222.0.43 () {64 vars in 1317 bytes} [Tue Sep 13 18:05:49 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 34 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 13 18:05:49.634418 dv-cinder-852009-8-iscsi devstack@n-api.service[120740]: DEBUG nova.api.openstack.wsgi [None req-a16887cb-87e8-4c6b-b10d-af4b6874fb07 tempest-ServerRescueNegativeTestJSON-412251590 tempest-ServerRescueNegativeTestJSON-412251590-project] Calling method '>' {{(pid=120740) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 18:05:49.635466 dv-cinder-852009-8-iscsi devstack@n-api.service[120740]: DEBUG nova.compute.api [None req-a16887cb-87e8-4c6b-b10d-af4b6874fb07 tempest-ServerRescueNegativeTestJSON-412251590 tempest-ServerRescueNegativeTestJSON-412251590-project] [instance: e8ce7158-6b73-4586-9f78-8e821988e71c] Fetching instance by UUID {{(pid=120740) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 18:05:49.646328 dv-cinder-852009-8-iscsi devstack@n-api.service[120740]: DEBUG oslo_concurrency.lockutils [None req-a16887cb-87e8-4c6b-b10d-af4b6874fb07 tempest-ServerRescueNegativeTestJSON-412251590 tempest-ServerRescueNegativeTestJSON-412251590-project] Acquiring lock "1daf4f4c-0e4a-4779-b53a-78c48397ea2f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120740) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 18:05:49.647404 dv-cinder-852009-8-iscsi devstack@n-api.service[120740]: DEBUG oslo_concurrency.lockutils [None req-a16887cb-87e8-4c6b-b10d-af4b6874fb07 tempest-ServerRescueNegativeTestJSON-412251590 tempest-ServerRescueNegativeTestJSON-412251590-project] Lock "1daf4f4c-0e4a-4779-b53a-78c48397ea2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120740) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 18:05:49.651040 dv-cinder-852009-8-iscsi devstack@n-api.service[120740]: DEBUG oslo_concurrency.lockutils [None req-a16887cb-87e8-4c6b-b10d-af4b6874fb07 tempest-ServerRescueNegativeTestJSON-412251590 tempest-ServerRescueNegativeTestJSON-412251590-project] Lock "1daf4f4c-0e4a-4779-b53a-78c48397ea2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120740) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 18:05:49.651040 dv-cinder-852009-8-iscsi devstack@n-api.service[120740]: DEBUG oslo_concurrency.lockutils [None req-a16887cb-87e8-4c6b-b10d-af4b6874fb07 tempest-ServerRescueNegativeTestJSON-412251590 tempest-ServerRescueNegativeTestJSON-412251590-project] Acquiring lock "1daf4f4c-0e4a-4779-b53a-78c48397ea2f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120740) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 18:05:49.651040 dv-cinder-852009-8-iscsi devstack@n-api.service[120740]: DEBUG oslo_concurrency.lockutils [None req-a16887cb-87e8-4c6b-b10d-af4b6874fb07 tempest-ServerRescueNegativeTestJSON-412251590 tempest-ServerRescueNegativeTestJSON-412251590-project] Lock "1daf4f4c-0e4a-4779-b53a-78c48397ea2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120740) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 18:05:49.651040 dv-cinder-852009-8-iscsi devstack@n-api.service[120740]: DEBUG oslo_concurrency.lockutils [None req-a16887cb-87e8-4c6b-b10d-af4b6874fb07 tempest-ServerRescueNegativeTestJSON-412251590 tempest-ServerRescueNegativeTestJSON-412251590-project] Lock "1daf4f4c-0e4a-4779-b53a-78c48397ea2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120740) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 18:05:49.659487 dv-cinder-852009-8-iscsi devstack@n-api.service[120741]: DEBUG nova.api.openstack.wsgi [None req-fbbe0bfb-7da8-4718-aa64-60104001e825 tempest-AttachVolumeShelveTestJSON-385853788 tempest-AttachVolumeShelveTestJSON-385853788-project] Calling method '>' {{(pid=120741) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 18:05:49.660186 dv-cinder-852009-8-iscsi devstack@n-api.service[120741]: DEBUG nova.compute.api [None req-fbbe0bfb-7da8-4718-aa64-60104001e825 tempest-AttachVolumeShelveTestJSON-385853788 tempest-AttachVolumeShelveTestJSON-385853788-project] [instance: 8cecf08e-bea8-4cef-9439-0eaa242bfed1] Fetching instance by UUID {{(pid=120741) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 18:05:49.666834 dv-cinder-852009-8-iscsi devstack@n-api.service[120741]: DEBUG oslo_concurrency.lockutils [None req-fbbe0bfb-7da8-4718-aa64-60104001e825 tempest-AttachVolumeShelveTestJSON-385853788 tempest-AttachVolumeShelveTestJSON-385853788-project] Acquiring lock "1daf4f4c-0e4a-4779-b53a-78c48397ea2f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120741) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 18:05:49.667299 dv-cinder-852009-8-iscsi devstack@n-api.service[120741]: DEBUG oslo_concurrency.lockutils [None req-fbbe0bfb-7da8-4718-aa64-60104001e825 tempest-AttachVolumeShelveTestJSON-385853788 tempest-AttachVolumeShelveTestJSON-385853788-project] Lock "1daf4f4c-0e4a-4779-b53a-78c48397ea2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120741) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 18:05:49.667788 dv-cinder-852009-8-iscsi devstack@n-api.service[120741]: DEBUG oslo_concurrency.lockutils [None req-fbbe0bfb-7da8-4718-aa64-60104001e825 tempest-AttachVolumeShelveTestJSON-385853788 tempest-AttachVolumeShelveTestJSON-385853788-project] Lock "1daf4f4c-0e4a-4779-b53a-78c48397ea2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120741) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 18:05:49.668470 dv-cinder-852009-8-iscsi devstack@n-api.service[120741]: DEBUG oslo_concurrency.lockutils [None req-fbbe0bfb-7da8-4718-aa64-60104001e825 tempest-AttachVolumeShelveTestJSON-385853788 tempest-AttachVolumeShelveTestJSON-385853788-project] Acquiring lock "1daf4f4c-0e4a-4779-b53a-78c48397ea2f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120741) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 18:05:49.668940 dv-cinder-852009-8-iscsi devstack@n-api.service[120741]: DEBUG oslo_concurrency.lockutils [None req-fbbe0bfb-7da8-4718-aa64-60104001e825 tempest-AttachVolumeShelveTestJSON-385853788 tempest-AttachVolumeShelveTestJSON-385853788-project] Lock "1daf4f4c-0e4a-4779-b53a-78c48397ea2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120741) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 18:05:49.669357 dv-cinder-852009-8-iscsi devstack@n-api.service[120741]: DEBUG oslo_concurrency.lockutils [None req-fbbe0bfb-7da8-4718-aa64-60104001e825 tempest-AttachVolumeShelveTestJSON-385853788 tempest-AttachVolumeShelveTestJSON-385853788-project] Lock "1daf4f4c-0e4a-4779-b53a-78c48397ea2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120741) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 18:05:49.751702 dv-cinder-852009-8-iscsi devstack@n-api.service[120741]: DEBUG nova.policy [None req-fbbe0bfb-7da8-4718-aa64-60104001e825 tempest-AttachVolumeShelveTestJSON-385853788 tempest-AttachVolumeShelveTestJSON-385853788-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e68ecd9b3ca643539b109f75bb242d6f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '75e14fd88bfb4cd896fa7b070a0fac47', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120741) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 18:05:49.760390 dv-cinder-852009-8-iscsi devstack@n-api.service[120741]: DEBUG nova.policy [None req-fbbe0bfb-7da8-4718-aa64-60104001e825 tempest-AttachVolumeShelveTestJSON-385853788 tempest-AttachVolumeShelveTestJSON-385853788-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'e68ecd9b3ca643539b109f75bb242d6f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '75e14fd88bfb4cd896fa7b070a0fac47', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120741) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 18:05:49.761847 dv-cinder-852009-8-iscsi devstack@n-api.service[120741]: DEBUG nova.policy [None req-fbbe0bfb-7da8-4718-aa64-60104001e825 tempest-AttachVolumeShelveTestJSON-385853788 tempest-AttachVolumeShelveTestJSON-385853788-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'e68ecd9b3ca643539b109f75bb242d6f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '75e14fd88bfb4cd896fa7b070a0fac47', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120741) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 18:05:49.763019 dv-cinder-852009-8-iscsi devstack@n-api.service[120741]: INFO nova.api.openstack.requestlog [None req-fbbe0bfb-7da8-4718-aa64-60104001e825 tempest-AttachVolumeShelveTestJSON-385853788 tempest-AttachVolumeShelveTestJSON-385853788-project] 10.222.0.43 "GET /compute/v2.1/servers/8cecf08e-bea8-4cef-9439-0eaa242bfed1" status: 200 len: 1276 microversion: 2.20 time: 0.108490 Sep 13 18:05:49.763565 dv-cinder-852009-8-iscsi devstack@n-api.service[120741]: [pid: 120741|app: 0|req: 218/446] 10.222.0.43 () {60 vars in 1277 bytes} [Tue Sep 13 18:05:49 2022] GET /compute/v2.1/servers/8cecf08e-bea8-4cef-9439-0eaa242bfed1 => generated 1276 bytes in 110 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 13 18:05:49.808160 dv-cinder-852009-8-iscsi devstack@n-api.service[120740]: DEBUG nova.policy [None req-a16887cb-87e8-4c6b-b10d-af4b6874fb07 tempest-ServerRescueNegativeTestJSON-412251590 tempest-ServerRescueNegativeTestJSON-412251590-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '60800cf2774e409d9c1b6f4992669991', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2eae4acecf6c4961830ead78d71b2ad3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120740) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 18:05:49.811859 dv-cinder-852009-8-iscsi devstack@n-api.service[120741]: DEBUG nova.api.openstack.wsgi [None req-9102599e-5116-4d5b-8ede-3db8a8b57996 tempest-TestMinimumBasicScenario-820002800 tempest-TestMinimumBasicScenario-820002800-project] Calling method '>' {{(pid=120741) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 18:05:49.812454 dv-cinder-852009-8-iscsi devstack@n-api.service[120741]: DEBUG nova.compute.api [None req-9102599e-5116-4d5b-8ede-3db8a8b57996 tempest-TestMinimumBasicScenario-820002800 tempest-TestMinimumBasicScenario-820002800-project] [instance: f8247a13-94cd-45b2-acc8-8717e1260f37] Fetching instance by UUID {{(pid=120741) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 18:05:49.816913 dv-cinder-852009-8-iscsi devstack@n-api.service[120740]: INFO nova.api.openstack.requestlog [None req-a16887cb-87e8-4c6b-b10d-af4b6874fb07 tempest-ServerRescueNegativeTestJSON-412251590 tempest-ServerRescueNegativeTestJSON-412251590-project] 10.222.0.43 "GET /compute/v2.1/servers/e8ce7158-6b73-4586-9f78-8e821988e71c" status: 200 len: 1730 microversion: 2.1 time: 0.188893 Sep 13 18:05:49.817536 dv-cinder-852009-8-iscsi devstack@n-api.service[120740]: [pid: 120740|app: 0|req: 229/447] 10.222.0.43 () {58 vars in 1236 bytes} [Tue Sep 13 18:05:49 2022] GET /compute/v2.1/servers/e8ce7158-6b73-4586-9f78-8e821988e71c => generated 1730 bytes in 191 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 13 18:05:49.818753 dv-cinder-852009-8-iscsi devstack@n-api.service[120741]: DEBUG oslo_concurrency.lockutils [None req-9102599e-5116-4d5b-8ede-3db8a8b57996 tempest-TestMinimumBasicScenario-820002800 tempest-TestMinimumBasicScenario-820002800-project] Acquiring lock "1daf4f4c-0e4a-4779-b53a-78c48397ea2f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120741) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 18:05:49.819228 dv-cinder-852009-8-iscsi devstack@n-api.service[120741]: DEBUG oslo_concurrency.lockutils [None req-9102599e-5116-4d5b-8ede-3db8a8b57996 tempest-TestMinimumBasicScenario-820002800 tempest-TestMinimumBasicScenario-820002800-project] Lock "1daf4f4c-0e4a-4779-b53a-78c48397ea2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120741) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 18:05:49.819650 dv-cinder-852009-8-iscsi devstack@n-api.service[120741]: DEBUG oslo_concurrency.lockutils [None req-9102599e-5116-4d5b-8ede-3db8a8b57996 tempest-TestMinimumBasicScenario-820002800 tempest-TestMinimumBasicScenario-820002800-project] Lock "1daf4f4c-0e4a-4779-b53a-78c48397ea2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120741) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 18:05:49.820339 dv-cinder-852009-8-iscsi devstack@n-api.service[120741]: DEBUG oslo_concurrency.lockutils [None req-9102599e-5116-4d5b-8ede-3db8a8b57996 tempest-TestMinimumBasicScenario-820002800 tempest-TestMinimumBasicScenario-820002800-project] Acquiring lock "1daf4f4c-0e4a-4779-b53a-78c48397ea2f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120741) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 18:05:49.820808 dv-cinder-852009-8-iscsi devstack@n-api.service[120741]: DEBUG oslo_concurrency.lockutils [None req-9102599e-5116-4d5b-8ede-3db8a8b57996 tempest-TestMinimumBasicScenario-820002800 tempest-TestMinimumBasicScenario-820002800-project] Lock "1daf4f4c-0e4a-4779-b53a-78c48397ea2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120741) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 18:05:49.821221 dv-cinder-852009-8-iscsi devstack@n-api.service[120741]: DEBUG oslo_concurrency.lockutils [None req-9102599e-5116-4d5b-8ede-3db8a8b57996 tempest-TestMinimumBasicScenario-820002800 tempest-TestMinimumBasicScenario-820002800-project] Lock "1daf4f4c-0e4a-4779-b53a-78c48397ea2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120741) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 18:05:49.839100 dv-cinder-852009-8-iscsi devstack@n-api.service[120740]: DEBUG nova.api.openstack.wsgi [None req-dd181226-413b-4263-af40-8f96be9b7fc2 tempest-ServerRescueNegativeTestJSON-412251590 tempest-ServerRescueNegativeTestJSON-412251590-project] Calling method '>' {{(pid=120740) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 18:05:49.839839 dv-cinder-852009-8-iscsi devstack@n-api.service[120740]: DEBUG nova.compute.api [None req-dd181226-413b-4263-af40-8f96be9b7fc2 tempest-ServerRescueNegativeTestJSON-412251590 tempest-ServerRescueNegativeTestJSON-412251590-project] [instance: e8ce7158-6b73-4586-9f78-8e821988e71c] Fetching instance by UUID {{(pid=120740) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 18:05:49.845820 dv-cinder-852009-8-iscsi devstack@n-api.service[120740]: DEBUG oslo_concurrency.lockutils [None req-dd181226-413b-4263-af40-8f96be9b7fc2 tempest-ServerRescueNegativeTestJSON-412251590 tempest-ServerRescueNegativeTestJSON-412251590-project] Acquiring lock "1daf4f4c-0e4a-4779-b53a-78c48397ea2f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120740) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 18:05:49.846308 dv-cinder-852009-8-iscsi devstack@n-api.service[120740]: DEBUG oslo_concurrency.lockutils [None req-dd181226-413b-4263-af40-8f96be9b7fc2 tempest-ServerRescueNegativeTestJSON-412251590 tempest-ServerRescueNegativeTestJSON-412251590-project] Lock "1daf4f4c-0e4a-4779-b53a-78c48397ea2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120740) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 18:05:49.846739 dv-cinder-852009-8-iscsi devstack@n-api.service[120740]: DEBUG oslo_concurrency.lockutils [None req-dd181226-413b-4263-af40-8f96be9b7fc2 tempest-ServerRescueNegativeTestJSON-412251590 tempest-ServerRescueNegativeTestJSON-412251590-project] Lock "1daf4f4c-0e4a-4779-b53a-78c48397ea2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120740) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 18:05:49.847422 dv-cinder-852009-8-iscsi devstack@n-api.service[120740]: DEBUG oslo_concurrency.lockutils [None req-dd181226-413b-4263-af40-8f96be9b7fc2 tempest-ServerRescueNegativeTestJSON-412251590 tempest-ServerRescueNegativeTestJSON-412251590-project] Acquiring lock "1daf4f4c-0e4a-4779-b53a-78c48397ea2f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120740) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 18:05:49.847863 dv-cinder-852009-8-iscsi devstack@n-api.service[120740]: DEBUG oslo_concurrency.lockutils [None req-dd181226-413b-4263-af40-8f96be9b7fc2 tempest-ServerRescueNegativeTestJSON-412251590 tempest-ServerRescueNegativeTestJSON-412251590-project] Lock "1daf4f4c-0e4a-4779-b53a-78c48397ea2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120740) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 18:05:49.848281 dv-cinder-852009-8-iscsi devstack@n-api.service[120740]: DEBUG oslo_concurrency.lockutils [None req-dd181226-413b-4263-af40-8f96be9b7fc2 tempest-ServerRescueNegativeTestJSON-412251590 tempest-ServerRescueNegativeTestJSON-412251590-project] Lock "1daf4f4c-0e4a-4779-b53a-78c48397ea2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120740) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 18:05:49.950011 dv-cinder-852009-8-iscsi devstack@n-api.service[120740]: INFO nova.api.openstack.requestlog [None req-dd181226-413b-4263-af40-8f96be9b7fc2 tempest-ServerRescueNegativeTestJSON-412251590 tempest-ServerRescueNegativeTestJSON-412251590-project] 10.222.0.43 "GET /compute/v2.1/servers/e8ce7158-6b73-4586-9f78-8e821988e71c/os-interface" status: 200 len: 284 microversion: 2.1 time: 0.114750 Sep 13 18:05:49.950886 dv-cinder-852009-8-iscsi devstack@n-api.service[120740]: [pid: 120740|app: 0|req: 230/448] 10.222.0.43 () {58 vars in 1275 bytes} [Tue Sep 13 18:05:49 2022] GET /compute/v2.1/servers/e8ce7158-6b73-4586-9f78-8e821988e71c/os-interface => generated 284 bytes in 116 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 13 18:05:49.989267 dv-cinder-852009-8-iscsi devstack@n-api.service[120741]: DEBUG nova.policy [None req-9102599e-5116-4d5b-8ede-3db8a8b57996 tempest-TestMinimumBasicScenario-820002800 tempest-TestMinimumBasicScenario-820002800-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7880064ff0aa448d9c367c89eba145ff', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2f6832936c824066a4370cc45c5b0282', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120741) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 18:05:49.997581 dv-cinder-852009-8-iscsi devstack@n-api.service[120741]: INFO nova.api.openstack.requestlog [None req-9102599e-5116-4d5b-8ede-3db8a8b57996 tempest-TestMinimumBasicScenario-820002800 tempest-TestMinimumBasicScenario-820002800-project] 10.222.0.43 "GET /compute/v2.1/servers/f8247a13-94cd-45b2-acc8-8717e1260f37" status: 200 len: 1359 microversion: 2.1 time: 0.190265 Sep 13 18:05:49.998129 dv-cinder-852009-8-iscsi devstack@n-api.service[120741]: [pid: 120741|app: 0|req: 219/449] 10.222.0.43 () {58 vars in 1236 bytes} [Tue Sep 13 18:05:49 2022] GET /compute/v2.1/servers/f8247a13-94cd-45b2-acc8-8717e1260f37 => generated 1359 bytes in 191 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 13 18:05:50.789453 dv-cinder-852009-8-iscsi devstack@n-api.service[120740]: DEBUG nova.api.openstack.wsgi [None req-94d962cc-669e-4da2-b1de-d8c19d2eda19 tempest-AttachVolumeShelveTestJSON-385853788 tempest-AttachVolumeShelveTestJSON-385853788-project] Calling method '>' {{(pid=120740) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 18:05:50.790017 dv-cinder-852009-8-iscsi devstack@n-api.service[120740]: DEBUG nova.compute.api [None req-94d962cc-669e-4da2-b1de-d8c19d2eda19 tempest-AttachVolumeShelveTestJSON-385853788 tempest-AttachVolumeShelveTestJSON-385853788-project] [instance: 8cecf08e-bea8-4cef-9439-0eaa242bfed1] Fetching instance by UUID {{(pid=120740) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 18:05:50.797306 dv-cinder-852009-8-iscsi devstack@n-api.service[120740]: DEBUG oslo_concurrency.lockutils [None req-94d962cc-669e-4da2-b1de-d8c19d2eda19 tempest-AttachVolumeShelveTestJSON-385853788 tempest-AttachVolumeShelveTestJSON-385853788-project] Acquiring lock "1daf4f4c-0e4a-4779-b53a-78c48397ea2f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120740) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 18:05:50.797807 dv-cinder-852009-8-iscsi devstack@n-api.service[120740]: DEBUG oslo_concurrency.lockutils [None req-94d962cc-669e-4da2-b1de-d8c19d2eda19 tempest-AttachVolumeShelveTestJSON-385853788 tempest-AttachVolumeShelveTestJSON-385853788-project] Lock "1daf4f4c-0e4a-4779-b53a-78c48397ea2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120740) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 18:05:50.798241 dv-cinder-852009-8-iscsi devstack@n-api.service[120740]: DEBUG oslo_concurrency.lockutils [None req-94d962cc-669e-4da2-b1de-d8c19d2eda19 tempest-AttachVolumeShelveTestJSON-385853788 tempest-AttachVolumeShelveTestJSON-385853788-project] Lock "1daf4f4c-0e4a-4779-b53a-78c48397ea2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120740) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 18:05:50.799135 dv-cinder-852009-8-iscsi devstack@n-api.service[120740]: DEBUG oslo_concurrency.lockutils [None req-94d962cc-669e-4da2-b1de-d8c19d2eda19 tempest-AttachVolumeShelveTestJSON-385853788 tempest-AttachVolumeShelveTestJSON-385853788-project] Acquiring lock "1daf4f4c-0e4a-4779-b53a-78c48397ea2f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120740) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 18:05:50.799753 dv-cinder-852009-8-iscsi devstack@n-api.service[120740]: DEBUG oslo_concurrency.lockutils [None req-94d962cc-669e-4da2-b1de-d8c19d2eda19 tempest-AttachVolumeShelveTestJSON-385853788 tempest-AttachVolumeShelveTestJSON-385853788-project] Lock "1daf4f4c-0e4a-4779-b53a-78c48397ea2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120740) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 18:05:50.800173 dv-cinder-852009-8-iscsi devstack@n-api.service[120740]: DEBUG oslo_concurrency.lockutils [None req-94d962cc-669e-4da2-b1de-d8c19d2eda19 tempest-AttachVolumeShelveTestJSON-385853788 tempest-AttachVolumeShelveTestJSON-385853788-project] Lock "1daf4f4c-0e4a-4779-b53a-78c48397ea2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120740) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 18:05:50.839375 dv-cinder-852009-8-iscsi devstack@n-api.service[120741]: DEBUG nova.api.openstack.wsgi [req-4d78f596-bf8b-4cd2-b755-88793a56403d req-505c005f-4bb1-4e13-bde9-72c0e90b9e15 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "e8ce7158-6b73-4586-9f78-8e821988e71c", "tag": "ea32c59b-537c-405f-b361-3a6b70e328d4"}]} {{(pid=120741) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 13 18:05:50.870518 dv-cinder-852009-8-iscsi devstack@n-api.service[120741]: DEBUG oslo_concurrency.lockutils [req-4d78f596-bf8b-4cd2-b755-88793a56403d req-505c005f-4bb1-4e13-bde9-72c0e90b9e15 service nova] Acquiring lock "1daf4f4c-0e4a-4779-b53a-78c48397ea2f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120741) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 18:05:50.871365 dv-cinder-852009-8-iscsi devstack@n-api.service[120741]: DEBUG oslo_concurrency.lockutils [req-4d78f596-bf8b-4cd2-b755-88793a56403d req-505c005f-4bb1-4e13-bde9-72c0e90b9e15 service nova] Lock "1daf4f4c-0e4a-4779-b53a-78c48397ea2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120741) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 18:05:50.871785 dv-cinder-852009-8-iscsi devstack@n-api.service[120741]: DEBUG oslo_concurrency.lockutils [req-4d78f596-bf8b-4cd2-b755-88793a56403d req-505c005f-4bb1-4e13-bde9-72c0e90b9e15 service nova] Lock "1daf4f4c-0e4a-4779-b53a-78c48397ea2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120741) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 18:05:50.884244 dv-cinder-852009-8-iscsi devstack@n-api.service[120741]: INFO nova.api.openstack.compute.server_external_events [req-4d78f596-bf8b-4cd2-b755-88793a56403d req-505c005f-4bb1-4e13-bde9-72c0e90b9e15 service nova] Creating event network-changed:ea32c59b-537c-405f-b361-3a6b70e328d4 for instance e8ce7158-6b73-4586-9f78-8e821988e71c on hv-cinder-85200 Sep 13 18:05:50.885172 dv-cinder-852009-8-iscsi devstack@n-api.service[120740]: DEBUG nova.policy [None req-94d962cc-669e-4da2-b1de-d8c19d2eda19 tempest-AttachVolumeShelveTestJSON-385853788 tempest-AttachVolumeShelveTestJSON-385853788-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e68ecd9b3ca643539b109f75bb242d6f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '75e14fd88bfb4cd896fa7b070a0fac47', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120740) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 18:05:50.889354 dv-cinder-852009-8-iscsi devstack@n-api.service[120741]: INFO nova.api.openstack.requestlog [req-4d78f596-bf8b-4cd2-b755-88793a56403d req-505c005f-4bb1-4e13-bde9-72c0e90b9e15 service nova] 10.222.0.43 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.053602 Sep 13 18:05:50.889954 dv-cinder-852009-8-iscsi devstack@n-api.service[120741]: [pid: 120741|app: 0|req: 220/450] 10.222.0.43 () {64 vars in 1317 bytes} [Tue Sep 13 18:05:50 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 55 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Sep 13 18:05:50.895428 dv-cinder-852009-8-iscsi devstack@n-api.service[120740]: DEBUG nova.policy [None req-94d962cc-669e-4da2-b1de-d8c19d2eda19 tempest-AttachVolumeShelveTestJSON-385853788 tempest-AttachVolumeShelveTestJSON-385853788-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'e68ecd9b3ca643539b109f75bb242d6f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '75e14fd88bfb4cd896fa7b070a0fac47', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120740) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 18:05:50.896889 dv-cinder-852009-8-iscsi devstack@n-api.service[120740]: DEBUG nova.policy [None req-94d962cc-669e-4da2-b1de-d8c19d2eda19 tempest-AttachVolumeShelveTestJSON-385853788 tempest-AttachVolumeShelveTestJSON-385853788-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'e68ecd9b3ca643539b109f75bb242d6f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '75e14fd88bfb4cd896fa7b070a0fac47', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120740) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 18:05:50.898015 dv-cinder-852009-8-iscsi devstack@n-api.service[120740]: INFO nova.api.openstack.requestlog [None req-94d962cc-669e-4da2-b1de-d8c19d2eda19 tempest-AttachVolumeShelveTestJSON-385853788 tempest-AttachVolumeShelveTestJSON-385853788-project] 10.222.0.43 "GET /compute/v2.1/servers/8cecf08e-bea8-4cef-9439-0eaa242bfed1" status: 200 len: 1332 microversion: 2.20 time: 0.113540 Sep 13 18:05:50.898559 dv-cinder-852009-8-iscsi devstack@n-api.service[120740]: [pid: 120740|app: 0|req: 231/451] 10.222.0.43 () {60 vars in 1277 bytes} [Tue Sep 13 18:05:50 2022] GET /compute/v2.1/servers/8cecf08e-bea8-4cef-9439-0eaa242bfed1 => generated 1332 bytes in 115 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 13 18:05:51.022650 dv-cinder-852009-8-iscsi devstack@n-api.service[120741]: DEBUG nova.api.openstack.wsgi [None req-c9aacc31-7c7f-4da5-9f5b-e1d809107696 tempest-TestMinimumBasicScenario-820002800 tempest-TestMinimumBasicScenario-820002800-project] Calling method '>' {{(pid=120741) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 18:05:51.023389 dv-cinder-852009-8-iscsi devstack@n-api.service[120741]: DEBUG nova.compute.api [None req-c9aacc31-7c7f-4da5-9f5b-e1d809107696 tempest-TestMinimumBasicScenario-820002800 tempest-TestMinimumBasicScenario-820002800-project] [instance: f8247a13-94cd-45b2-acc8-8717e1260f37] Fetching instance by UUID {{(pid=120741) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 18:05:51.030056 dv-cinder-852009-8-iscsi devstack@n-api.service[120741]: DEBUG oslo_concurrency.lockutils [None req-c9aacc31-7c7f-4da5-9f5b-e1d809107696 tempest-TestMinimumBasicScenario-820002800 tempest-TestMinimumBasicScenario-820002800-project] Acquiring lock "1daf4f4c-0e4a-4779-b53a-78c48397ea2f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120741) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 18:05:51.030538 dv-cinder-852009-8-iscsi devstack@n-api.service[120741]: DEBUG oslo_concurrency.lockutils [None req-c9aacc31-7c7f-4da5-9f5b-e1d809107696 tempest-TestMinimumBasicScenario-820002800 tempest-TestMinimumBasicScenario-820002800-project] Lock "1daf4f4c-0e4a-4779-b53a-78c48397ea2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120741) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 18:05:51.030966 dv-cinder-852009-8-iscsi devstack@n-api.service[120741]: DEBUG oslo_concurrency.lockutils [None req-c9aacc31-7c7f-4da5-9f5b-e1d809107696 tempest-TestMinimumBasicScenario-820002800 tempest-TestMinimumBasicScenario-820002800-project] Lock "1daf4f4c-0e4a-4779-b53a-78c48397ea2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120741) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 18:05:51.031658 dv-cinder-852009-8-iscsi devstack@n-api.service[120741]: DEBUG oslo_concurrency.lockutils [None req-c9aacc31-7c7f-4da5-9f5b-e1d809107696 tempest-TestMinimumBasicScenario-820002800 tempest-TestMinimumBasicScenario-820002800-project] Acquiring lock "1daf4f4c-0e4a-4779-b53a-78c48397ea2f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120741) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 18:05:51.032113 dv-cinder-852009-8-iscsi devstack@n-api.service[120741]: DEBUG oslo_concurrency.lockutils [None req-c9aacc31-7c7f-4da5-9f5b-e1d809107696 tempest-TestMinimumBasicScenario-820002800 tempest-TestMinimumBasicScenario-820002800-project] Lock "1daf4f4c-0e4a-4779-b53a-78c48397ea2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120741) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 18:05:51.032562 dv-cinder-852009-8-iscsi devstack@n-api.service[120741]: DEBUG oslo_concurrency.lockutils [None req-c9aacc31-7c7f-4da5-9f5b-e1d809107696 tempest-TestMinimumBasicScenario-820002800 tempest-TestMinimumBasicScenario-820002800-project] Lock "1daf4f4c-0e4a-4779-b53a-78c48397ea2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120741) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 18:05:51.178776 dv-cinder-852009-8-iscsi devstack@n-api.service[120741]: DEBUG nova.policy [None req-c9aacc31-7c7f-4da5-9f5b-e1d809107696 tempest-TestMinimumBasicScenario-820002800 tempest-TestMinimumBasicScenario-820002800-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7880064ff0aa448d9c367c89eba145ff', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2f6832936c824066a4370cc45c5b0282', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120741) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 18:05:51.187257 dv-cinder-852009-8-iscsi devstack@n-api.service[120741]: INFO nova.api.openstack.requestlog [None req-c9aacc31-7c7f-4da5-9f5b-e1d809107696 tempest-TestMinimumBasicScenario-820002800 tempest-TestMinimumBasicScenario-820002800-project] 10.222.0.43 "GET /compute/v2.1/servers/f8247a13-94cd-45b2-acc8-8717e1260f37" status: 200 len: 1359 microversion: 2.1 time: 0.168892 Sep 13 18:05:51.187822 dv-cinder-852009-8-iscsi devstack@n-api.service[120741]: [pid: 120741|app: 0|req: 221/452] 10.222.0.43 () {58 vars in 1236 bytes} [Tue Sep 13 18:05:51 2022] GET /compute/v2.1/servers/f8247a13-94cd-45b2-acc8-8717e1260f37 => generated 1359 bytes in 170 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 13 18:05:51.923534 dv-cinder-852009-8-iscsi devstack@n-api.service[120740]: DEBUG nova.api.openstack.wsgi [None req-32933b89-69f3-4acd-af96-352dd8199fa8 tempest-AttachVolumeShelveTestJSON-385853788 tempest-AttachVolumeShelveTestJSON-385853788-project] Calling method '>' {{(pid=120740) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 18:05:51.924860 dv-cinder-852009-8-iscsi devstack@n-api.service[120740]: DEBUG nova.compute.api [None req-32933b89-69f3-4acd-af96-352dd8199fa8 tempest-AttachVolumeShelveTestJSON-385853788 tempest-AttachVolumeShelveTestJSON-385853788-project] [instance: 8cecf08e-bea8-4cef-9439-0eaa242bfed1] Fetching instance by UUID {{(pid=120740) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 18:05:51.931864 dv-cinder-852009-8-iscsi devstack@n-api.service[120740]: DEBUG oslo_concurrency.lockutils [None req-32933b89-69f3-4acd-af96-352dd8199fa8 tempest-AttachVolumeShelveTestJSON-385853788 tempest-AttachVolumeShelveTestJSON-385853788-project] Acquiring lock "1daf4f4c-0e4a-4779-b53a-78c48397ea2f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120740) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 18:05:51.932673 dv-cinder-852009-8-iscsi devstack@n-api.service[120740]: DEBUG oslo_concurrency.lockutils [None req-32933b89-69f3-4acd-af96-352dd8199fa8 tempest-AttachVolumeShelveTestJSON-385853788 tempest-AttachVolumeShelveTestJSON-385853788-project] Lock "1daf4f4c-0e4a-4779-b53a-78c48397ea2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120740) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 18:05:51.933325 dv-cinder-852009-8-iscsi devstack@n-api.service[120740]: DEBUG oslo_concurrency.lockutils [None req-32933b89-69f3-4acd-af96-352dd8199fa8 tempest-AttachVolumeShelveTestJSON-385853788 tempest-AttachVolumeShelveTestJSON-385853788-project] Lock "1daf4f4c-0e4a-4779-b53a-78c48397ea2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120740) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 18:05:51.934159 dv-cinder-852009-8-iscsi devstack@n-api.service[120740]: DEBUG oslo_concurrency.lockutils [None req-32933b89-69f3-4acd-af96-352dd8199fa8 tempest-AttachVolumeShelveTestJSON-385853788 tempest-AttachVolumeShelveTestJSON-385853788-project] Acquiring lock "1daf4f4c-0e4a-4779-b53a-78c48397ea2f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120740) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 18:05:51.934668 dv-cinder-852009-8-iscsi devstack@n-api.service[120740]: DEBUG oslo_concurrency.lockutils [None req-32933b89-69f3-4acd-af96-352dd8199fa8 tempest-AttachVolumeShelveTestJSON-385853788 tempest-AttachVolumeShelveTestJSON-385853788-project] Lock "1daf4f4c-0e4a-4779-b53a-78c48397ea2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120740) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 18:05:51.935207 dv-cinder-852009-8-iscsi devstack@n-api.service[120740]: DEBUG oslo_concurrency.lockutils [None req-32933b89-69f3-4acd-af96-352dd8199fa8 tempest-AttachVolumeShelveTestJSON-385853788 tempest-AttachVolumeShelveTestJSON-385853788-project] Lock "1daf4f4c-0e4a-4779-b53a-78c48397ea2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120740) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 18:05:52.011168 dv-cinder-852009-8-iscsi devstack@n-api.service[120740]: DEBUG nova.policy [None req-32933b89-69f3-4acd-af96-352dd8199fa8 tempest-AttachVolumeShelveTestJSON-385853788 tempest-AttachVolumeShelveTestJSON-385853788-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e68ecd9b3ca643539b109f75bb242d6f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '75e14fd88bfb4cd896fa7b070a0fac47', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120740) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 18:05:52.020153 dv-cinder-852009-8-iscsi devstack@n-api.service[120740]: DEBUG nova.policy [None req-32933b89-69f3-4acd-af96-352dd8199fa8 tempest-AttachVolumeShelveTestJSON-385853788 tempest-AttachVolumeShelveTestJSON-385853788-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'e68ecd9b3ca643539b109f75bb242d6f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '75e14fd88bfb4cd896fa7b070a0fac47', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120740) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 18:05:52.021648 dv-cinder-852009-8-iscsi devstack@n-api.service[120740]: DEBUG nova.policy [None req-32933b89-69f3-4acd-af96-352dd8199fa8 tempest-AttachVolumeShelveTestJSON-385853788 tempest-AttachVolumeShelveTestJSON-385853788-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'e68ecd9b3ca643539b109f75bb242d6f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '75e14fd88bfb4cd896fa7b070a0fac47', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120740) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 18:05:52.022779 dv-cinder-852009-8-iscsi devstack@n-api.service[120740]: INFO nova.api.openstack.requestlog [None req-32933b89-69f3-4acd-af96-352dd8199fa8 tempest-AttachVolumeShelveTestJSON-385853788 tempest-AttachVolumeShelveTestJSON-385853788-project] 10.222.0.43 "GET /compute/v2.1/servers/8cecf08e-bea8-4cef-9439-0eaa242bfed1" status: 200 len: 1338 microversion: 2.20 time: 0.103571 Sep 13 18:05:52.023323 dv-cinder-852009-8-iscsi devstack@n-api.service[120740]: [pid: 120740|app: 0|req: 232/453] 10.222.0.43 () {60 vars in 1277 bytes} [Tue Sep 13 18:05:51 2022] GET /compute/v2.1/servers/8cecf08e-bea8-4cef-9439-0eaa242bfed1 => generated 1338 bytes in 105 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 13 18:05:52.209826 dv-cinder-852009-8-iscsi devstack@n-api.service[120741]: DEBUG nova.api.openstack.wsgi [None req-59db4e8b-a13f-41e3-943d-4e2b8b7264e9 tempest-TestMinimumBasicScenario-820002800 tempest-TestMinimumBasicScenario-820002800-project] Calling method '>' {{(pid=120741) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 18:05:52.211219 dv-cinder-852009-8-iscsi devstack@n-api.service[120741]: DEBUG nova.compute.api [None req-59db4e8b-a13f-41e3-943d-4e2b8b7264e9 tempest-TestMinimumBasicScenario-820002800 tempest-TestMinimumBasicScenario-820002800-project] [instance: f8247a13-94cd-45b2-acc8-8717e1260f37] Fetching instance by UUID {{(pid=120741) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 18:05:52.218723 dv-cinder-852009-8-iscsi devstack@n-api.service[120741]: DEBUG oslo_concurrency.lockutils [None req-59db4e8b-a13f-41e3-943d-4e2b8b7264e9 tempest-TestMinimumBasicScenario-820002800 tempest-TestMinimumBasicScenario-820002800-project] Acquiring lock "1daf4f4c-0e4a-4779-b53a-78c48397ea2f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120741) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 18:05:52.219370 dv-cinder-852009-8-iscsi devstack@n-api.service[120741]: DEBUG oslo_concurrency.lockutils [None req-59db4e8b-a13f-41e3-943d-4e2b8b7264e9 tempest-TestMinimumBasicScenario-820002800 tempest-TestMinimumBasicScenario-820002800-project] Lock "1daf4f4c-0e4a-4779-b53a-78c48397ea2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120741) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 18:05:52.219923 dv-cinder-852009-8-iscsi devstack@n-api.service[120741]: DEBUG oslo_concurrency.lockutils [None req-59db4e8b-a13f-41e3-943d-4e2b8b7264e9 tempest-TestMinimumBasicScenario-820002800 tempest-TestMinimumBasicScenario-820002800-project] Lock "1daf4f4c-0e4a-4779-b53a-78c48397ea2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120741) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 18:05:52.220862 dv-cinder-852009-8-iscsi devstack@n-api.service[120741]: DEBUG oslo_concurrency.lockutils [None req-59db4e8b-a13f-41e3-943d-4e2b8b7264e9 tempest-TestMinimumBasicScenario-820002800 tempest-TestMinimumBasicScenario-820002800-project] Acquiring lock "1daf4f4c-0e4a-4779-b53a-78c48397ea2f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120741) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 18:05:52.221438 dv-cinder-852009-8-iscsi devstack@n-api.service[120741]: DEBUG oslo_concurrency.lockutils [None req-59db4e8b-a13f-41e3-943d-4e2b8b7264e9 tempest-TestMinimumBasicScenario-820002800 tempest-TestMinimumBasicScenario-820002800-project] Lock "1daf4f4c-0e4a-4779-b53a-78c48397ea2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120741) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 18:05:52.221967 dv-cinder-852009-8-iscsi devstack@n-api.service[120741]: DEBUG oslo_concurrency.lockutils [None req-59db4e8b-a13f-41e3-943d-4e2b8b7264e9 tempest-TestMinimumBasicScenario-820002800 tempest-TestMinimumBasicScenario-820002800-project] Lock "1daf4f4c-0e4a-4779-b53a-78c48397ea2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120741) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 18:05:52.369421 dv-cinder-852009-8-iscsi devstack@n-api.service[120741]: DEBUG nova.policy [None req-59db4e8b-a13f-41e3-943d-4e2b8b7264e9 tempest-TestMinimumBasicScenario-820002800 tempest-TestMinimumBasicScenario-820002800-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7880064ff0aa448d9c367c89eba145ff', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2f6832936c824066a4370cc45c5b0282', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120741) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 18:05:52.377861 dv-cinder-852009-8-iscsi devstack@n-api.service[120741]: INFO nova.api.openstack.requestlog [None req-59db4e8b-a13f-41e3-943d-4e2b8b7264e9 tempest-TestMinimumBasicScenario-820002800 tempest-TestMinimumBasicScenario-820002800-project] 10.222.0.43 "GET /compute/v2.1/servers/f8247a13-94cd-45b2-acc8-8717e1260f37" status: 200 len: 1549 microversion: 2.1 time: 0.172158 Sep 13 18:05:52.388583 dv-cinder-852009-8-iscsi devstack@n-api.service[120741]: [pid: 120741|app: 0|req: 222/454] 10.222.0.43 () {58 vars in 1236 bytes} [Tue Sep 13 18:05:52 2022] GET /compute/v2.1/servers/f8247a13-94cd-45b2-acc8-8717e1260f37 => generated 1549 bytes in 184 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 13 18:05:52.400371 dv-cinder-852009-8-iscsi devstack@n-api.service[120740]: DEBUG nova.api.openstack.wsgi [None req-39641e6a-65e2-4af9-be22-c1a2aecd4724 tempest-TestMinimumBasicScenario-820002800 tempest-TestMinimumBasicScenario-820002800-project] Calling method '>' {{(pid=120740) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 18:05:52.401011 dv-cinder-852009-8-iscsi devstack@n-api.service[120740]: DEBUG nova.compute.api [None req-39641e6a-65e2-4af9-be22-c1a2aecd4724 tempest-TestMinimumBasicScenario-820002800 tempest-TestMinimumBasicScenario-820002800-project] [instance: f8247a13-94cd-45b2-acc8-8717e1260f37] Fetching instance by UUID {{(pid=120740) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 18:05:52.407010 dv-cinder-852009-8-iscsi devstack@n-api.service[120740]: DEBUG oslo_concurrency.lockutils [None req-39641e6a-65e2-4af9-be22-c1a2aecd4724 tempest-TestMinimumBasicScenario-820002800 tempest-TestMinimumBasicScenario-820002800-project] Acquiring lock "1daf4f4c-0e4a-4779-b53a-78c48397ea2f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120740) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 18:05:52.407494 dv-cinder-852009-8-iscsi devstack@n-api.service[120740]: DEBUG oslo_concurrency.lockutils [None req-39641e6a-65e2-4af9-be22-c1a2aecd4724 tempest-TestMinimumBasicScenario-820002800 tempest-TestMinimumBasicScenario-820002800-project] Lock "1daf4f4c-0e4a-4779-b53a-78c48397ea2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120740) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 18:05:52.407922 dv-cinder-852009-8-iscsi devstack@n-api.service[120740]: DEBUG oslo_concurrency.lockutils [None req-39641e6a-65e2-4af9-be22-c1a2aecd4724 tempest-TestMinimumBasicScenario-820002800 tempest-TestMinimumBasicScenario-820002800-project] Lock "1daf4f4c-0e4a-4779-b53a-78c48397ea2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120740) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 18:05:52.408647 dv-cinder-852009-8-iscsi devstack@n-api.service[120740]: DEBUG oslo_concurrency.lockutils [None req-39641e6a-65e2-4af9-be22-c1a2aecd4724 tempest-TestMinimumBasicScenario-820002800 tempest-TestMinimumBasicScenario-820002800-project] Acquiring lock "1daf4f4c-0e4a-4779-b53a-78c48397ea2f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120740) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 18:05:52.409094 dv-cinder-852009-8-iscsi devstack@n-api.service[120740]: DEBUG oslo_concurrency.lockutils [None req-39641e6a-65e2-4af9-be22-c1a2aecd4724 tempest-TestMinimumBasicScenario-820002800 tempest-TestMinimumBasicScenario-820002800-project] Lock "1daf4f4c-0e4a-4779-b53a-78c48397ea2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120740) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 18:05:52.409511 dv-cinder-852009-8-iscsi devstack@n-api.service[120740]: DEBUG oslo_concurrency.lockutils [None req-39641e6a-65e2-4af9-be22-c1a2aecd4724 tempest-TestMinimumBasicScenario-820002800 tempest-TestMinimumBasicScenario-820002800-project] Lock "1daf4f4c-0e4a-4779-b53a-78c48397ea2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120740) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 18:05:52.427836 dv-cinder-852009-8-iscsi devstack@n-api.service[120740]: DEBUG dbcounter [-] [120740] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=120740) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 18:05:52.541615 dv-cinder-852009-8-iscsi devstack@n-api.service[120740]: DEBUG nova.policy [None req-39641e6a-65e2-4af9-be22-c1a2aecd4724 tempest-TestMinimumBasicScenario-820002800 tempest-TestMinimumBasicScenario-820002800-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7880064ff0aa448d9c367c89eba145ff', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2f6832936c824066a4370cc45c5b0282', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120740) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 18:05:52.549676 dv-cinder-852009-8-iscsi devstack@n-api.service[120740]: INFO nova.api.openstack.requestlog [None req-39641e6a-65e2-4af9-be22-c1a2aecd4724 tempest-TestMinimumBasicScenario-820002800 tempest-TestMinimumBasicScenario-820002800-project] 10.222.0.43 "GET /compute/v2.1/servers/f8247a13-94cd-45b2-acc8-8717e1260f37" status: 200 len: 1549 microversion: 2.1 time: 0.153211 Sep 13 18:05:52.550256 dv-cinder-852009-8-iscsi devstack@n-api.service[120740]: [pid: 120740|app: 0|req: 233/455] 10.222.0.43 () {58 vars in 1236 bytes} [Tue Sep 13 18:05:52 2022] GET /compute/v2.1/servers/f8247a13-94cd-45b2-acc8-8717e1260f37 => generated 1549 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 13 18:05:52.571638 dv-cinder-852009-8-iscsi devstack@n-api.service[120741]: DEBUG nova.api.openstack.wsgi [None req-f83310a3-89b8-49c0-8be1-68c6890ed100 tempest-TestMinimumBasicScenario-820002800 tempest-TestMinimumBasicScenario-820002800-project] Calling method '>' {{(pid=120741) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 18:05:52.576903 dv-cinder-852009-8-iscsi devstack@n-api.service[120741]: DEBUG nova.policy [None req-f83310a3-89b8-49c0-8be1-68c6890ed100 tempest-TestMinimumBasicScenario-820002800 tempest-TestMinimumBasicScenario-820002800-project] Policy check for os_compute_api:servers:allow_all_filters failed with credentials {'is_admin': False, 'user_id': '7880064ff0aa448d9c367c89eba145ff', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2f6832936c824066a4370cc45c5b0282', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120741) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 18:05:52.577776 dv-cinder-852009-8-iscsi devstack@n-api.service[120741]: DEBUG nova.compute.api [None req-f83310a3-89b8-49c0-8be1-68c6890ed100 tempest-TestMinimumBasicScenario-820002800 tempest-TestMinimumBasicScenario-820002800-project] Searching by: {'deleted': False, 'project_id': '2f6832936c824066a4370cc45c5b0282'} {{(pid=120741) get_all /opt/stack/nova/nova/compute/api.py:3017}} Sep 13 18:05:52.584490 dv-cinder-852009-8-iscsi devstack@n-api.service[120741]: DEBUG oslo_concurrency.lockutils [None req-f83310a3-89b8-49c0-8be1-68c6890ed100 tempest-TestMinimumBasicScenario-820002800 tempest-TestMinimumBasicScenario-820002800-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120741) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 18:05:52.584977 dv-cinder-852009-8-iscsi devstack@n-api.service[120741]: DEBUG oslo_concurrency.lockutils [None req-f83310a3-89b8-49c0-8be1-68c6890ed100 tempest-TestMinimumBasicScenario-820002800 tempest-TestMinimumBasicScenario-820002800-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120741) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 18:05:52.585397 dv-cinder-852009-8-iscsi devstack@n-api.service[120741]: DEBUG oslo_concurrency.lockutils [None req-f83310a3-89b8-49c0-8be1-68c6890ed100 tempest-TestMinimumBasicScenario-820002800 tempest-TestMinimumBasicScenario-820002800-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120741) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 18:05:52.586111 dv-cinder-852009-8-iscsi devstack@n-api.service[120741]: DEBUG oslo_concurrency.lockutils [None req-f83310a3-89b8-49c0-8be1-68c6890ed100 tempest-TestMinimumBasicScenario-820002800 tempest-TestMinimumBasicScenario-820002800-project] Acquiring lock "1daf4f4c-0e4a-4779-b53a-78c48397ea2f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120741) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 18:05:52.586564 dv-cinder-852009-8-iscsi devstack@n-api.service[120741]: DEBUG oslo_concurrency.lockutils [None req-f83310a3-89b8-49c0-8be1-68c6890ed100 tempest-TestMinimumBasicScenario-820002800 tempest-TestMinimumBasicScenario-820002800-project] Lock "1daf4f4c-0e4a-4779-b53a-78c48397ea2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120741) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 18:05:52.586977 dv-cinder-852009-8-iscsi devstack@n-api.service[120741]: DEBUG oslo_concurrency.lockutils [None req-f83310a3-89b8-49c0-8be1-68c6890ed100 tempest-TestMinimumBasicScenario-820002800 tempest-TestMinimumBasicScenario-820002800-project] Lock "1daf4f4c-0e4a-4779-b53a-78c48397ea2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120741) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 18:05:52.676923 dv-cinder-852009-8-iscsi devstack@n-api.service[120741]: DEBUG nova.compute.multi_cell_list [None req-f83310a3-89b8-49c0-8be1-68c6890ed100 tempest-TestMinimumBasicScenario-820002800 tempest-TestMinimumBasicScenario-820002800-project] Listed batch of 1 results from cell out of 1000 limit. Returned 1 total so far. {{(pid=120741) do_query /opt/stack/nova/nova/compute/multi_cell_list.py:373}} Sep 13 18:05:52.774785 dv-cinder-852009-8-iscsi devstack@n-api.service[120741]: INFO nova.api.openstack.requestlog [None req-f83310a3-89b8-49c0-8be1-68c6890ed100 tempest-TestMinimumBasicScenario-820002800 tempest-TestMinimumBasicScenario-820002800-project] 10.222.0.43 "GET /compute/v2.1/servers" status: 200 len: 343 microversion: 2.1 time: 0.206961 Sep 13 18:05:52.775696 dv-cinder-852009-8-iscsi devstack@n-api.service[120741]: [pid: 120741|app: 0|req: 223/456] 10.222.0.43 () {58 vars in 1125 bytes} [Tue Sep 13 18:05:52 2022] GET /compute/v2.1/servers => generated 343 bytes in 208 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 13 18:05:52.787167 dv-cinder-852009-8-iscsi devstack@n-api.service[120740]: DEBUG nova.api.openstack.wsgi [None req-2453c748-9eec-4fab-93a1-8e2ca459a27f tempest-TestMinimumBasicScenario-820002800 tempest-TestMinimumBasicScenario-820002800-project] Calling method '>' {{(pid=120740) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 18:05:52.787687 dv-cinder-852009-8-iscsi devstack@n-api.service[120740]: DEBUG nova.compute.api [None req-2453c748-9eec-4fab-93a1-8e2ca459a27f tempest-TestMinimumBasicScenario-820002800 tempest-TestMinimumBasicScenario-820002800-project] [instance: f8247a13-94cd-45b2-acc8-8717e1260f37] Fetching instance by UUID {{(pid=120740) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 18:05:52.794164 dv-cinder-852009-8-iscsi devstack@n-api.service[120740]: DEBUG oslo_concurrency.lockutils [None req-2453c748-9eec-4fab-93a1-8e2ca459a27f tempest-TestMinimumBasicScenario-820002800 tempest-TestMinimumBasicScenario-820002800-project] Acquiring lock "1daf4f4c-0e4a-4779-b53a-78c48397ea2f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120740) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 18:05:52.794905 dv-cinder-852009-8-iscsi devstack@n-api.service[120740]: DEBUG oslo_concurrency.lockutils [None req-2453c748-9eec-4fab-93a1-8e2ca459a27f tempest-TestMinimumBasicScenario-820002800 tempest-TestMinimumBasicScenario-820002800-project] Lock "1daf4f4c-0e4a-4779-b53a-78c48397ea2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120740) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 18:05:52.795296 dv-cinder-852009-8-iscsi devstack@n-api.service[120740]: DEBUG oslo_concurrency.lockutils [None req-2453c748-9eec-4fab-93a1-8e2ca459a27f tempest-TestMinimumBasicScenario-820002800 tempest-TestMinimumBasicScenario-820002800-project] Lock "1daf4f4c-0e4a-4779-b53a-78c48397ea2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120740) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 18:05:52.795984 dv-cinder-852009-8-iscsi devstack@n-api.service[120740]: DEBUG oslo_concurrency.lockutils [None req-2453c748-9eec-4fab-93a1-8e2ca459a27f tempest-TestMinimumBasicScenario-820002800 tempest-TestMinimumBasicScenario-820002800-project] Acquiring lock "1daf4f4c-0e4a-4779-b53a-78c48397ea2f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120740) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 18:05:52.796455 dv-cinder-852009-8-iscsi devstack@n-api.service[120740]: DEBUG oslo_concurrency.lockutils [None req-2453c748-9eec-4fab-93a1-8e2ca459a27f tempest-TestMinimumBasicScenario-820002800 tempest-TestMinimumBasicScenario-820002800-project] Lock "1daf4f4c-0e4a-4779-b53a-78c48397ea2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120740) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 18:05:52.796871 dv-cinder-852009-8-iscsi devstack@n-api.service[120740]: DEBUG oslo_concurrency.lockutils [None req-2453c748-9eec-4fab-93a1-8e2ca459a27f tempest-TestMinimumBasicScenario-820002800 tempest-TestMinimumBasicScenario-820002800-project] Lock "1daf4f4c-0e4a-4779-b53a-78c48397ea2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120740) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 18:05:52.906898 dv-cinder-852009-8-iscsi devstack@n-api.service[120741]: DEBUG nova.api.openstack.wsgi [req-97660f36-51dd-4908-a2a0-964722e86944 req-41ebdb61-7adc-420a-aeb2-0e61449bbce1 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "e8ce7158-6b73-4586-9f78-8e821988e71c", "tag": "ea32c59b-537c-405f-b361-3a6b70e328d4"}]} {{(pid=120741) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 13 18:05:52.921699 dv-cinder-852009-8-iscsi devstack@n-api.service[120741]: DEBUG oslo_concurrency.lockutils [req-97660f36-51dd-4908-a2a0-964722e86944 req-41ebdb61-7adc-420a-aeb2-0e61449bbce1 service nova] Acquiring lock "1daf4f4c-0e4a-4779-b53a-78c48397ea2f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120741) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 18:05:52.922338 dv-cinder-852009-8-iscsi devstack@n-api.service[120741]: DEBUG oslo_concurrency.lockutils [req-97660f36-51dd-4908-a2a0-964722e86944 req-41ebdb61-7adc-420a-aeb2-0e61449bbce1 service nova] Lock "1daf4f4c-0e4a-4779-b53a-78c48397ea2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120741) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 18:05:52.922932 dv-cinder-852009-8-iscsi devstack@n-api.service[120741]: DEBUG oslo_concurrency.lockutils [req-97660f36-51dd-4908-a2a0-964722e86944 req-41ebdb61-7adc-420a-aeb2-0e61449bbce1 service nova] Lock "1daf4f4c-0e4a-4779-b53a-78c48397ea2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120741) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 18:05:52.941091 dv-cinder-852009-8-iscsi devstack@n-api.service[120740]: DEBUG nova.policy [None req-2453c748-9eec-4fab-93a1-8e2ca459a27f tempest-TestMinimumBasicScenario-820002800 tempest-TestMinimumBasicScenario-820002800-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7880064ff0aa448d9c367c89eba145ff', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2f6832936c824066a4370cc45c5b0282', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120740) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 18:05:52.943131 dv-cinder-852009-8-iscsi devstack@n-api.service[120741]: INFO nova.api.openstack.compute.server_external_events [req-97660f36-51dd-4908-a2a0-964722e86944 req-41ebdb61-7adc-420a-aeb2-0e61449bbce1 service nova] Creating event network-changed:ea32c59b-537c-405f-b361-3a6b70e328d4 for instance e8ce7158-6b73-4586-9f78-8e821988e71c on hv-cinder-85200 Sep 13 18:05:52.949680 dv-cinder-852009-8-iscsi devstack@n-api.service[120740]: INFO nova.api.openstack.requestlog [None req-2453c748-9eec-4fab-93a1-8e2ca459a27f tempest-TestMinimumBasicScenario-820002800 tempest-TestMinimumBasicScenario-820002800-project] 10.222.0.43 "GET /compute/v2.1/servers/f8247a13-94cd-45b2-acc8-8717e1260f37" status: 200 len: 1549 microversion: 2.1 time: 0.166411 Sep 13 18:05:52.950832 dv-cinder-852009-8-iscsi devstack@n-api.service[120740]: [pid: 120740|app: 0|req: 234/457] 10.222.0.43 () {58 vars in 1236 bytes} [Tue Sep 13 18:05:52 2022] GET /compute/v2.1/servers/f8247a13-94cd-45b2-acc8-8717e1260f37 => generated 1549 bytes in 168 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 13 18:05:52.951054 dv-cinder-852009-8-iscsi devstack@n-api.service[120741]: INFO nova.api.openstack.requestlog [req-97660f36-51dd-4908-a2a0-964722e86944 req-41ebdb61-7adc-420a-aeb2-0e61449bbce1 service nova] 10.222.0.43 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.047248 Sep 13 18:05:52.951777 dv-cinder-852009-8-iscsi devstack@n-api.service[120741]: [pid: 120741|app: 0|req: 224/458] 10.222.0.43 () {64 vars in 1317 bytes} [Tue Sep 13 18:05:52 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 50 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Sep 13 18:05:53.055890 dv-cinder-852009-8-iscsi devstack@n-api.service[120740]: DEBUG nova.api.openstack.wsgi [None req-56938d78-0f91-4a3b-9288-376d298dce11 tempest-AttachVolumeShelveTestJSON-385853788 tempest-AttachVolumeShelveTestJSON-385853788-project] Calling method '>' {{(pid=120740) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 18:05:53.056896 dv-cinder-852009-8-iscsi devstack@n-api.service[120740]: DEBUG nova.compute.api [None req-56938d78-0f91-4a3b-9288-376d298dce11 tempest-AttachVolumeShelveTestJSON-385853788 tempest-AttachVolumeShelveTestJSON-385853788-project] [instance: 8cecf08e-bea8-4cef-9439-0eaa242bfed1] Fetching instance by UUID {{(pid=120740) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 18:05:53.069164 dv-cinder-852009-8-iscsi devstack@n-api.service[120740]: DEBUG oslo_concurrency.lockutils [None req-56938d78-0f91-4a3b-9288-376d298dce11 tempest-AttachVolumeShelveTestJSON-385853788 tempest-AttachVolumeShelveTestJSON-385853788-project] Acquiring lock "1daf4f4c-0e4a-4779-b53a-78c48397ea2f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120740) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 18:05:53.069654 dv-cinder-852009-8-iscsi devstack@n-api.service[120740]: DEBUG oslo_concurrency.lockutils [None req-56938d78-0f91-4a3b-9288-376d298dce11 tempest-AttachVolumeShelveTestJSON-385853788 tempest-AttachVolumeShelveTestJSON-385853788-project] Lock "1daf4f4c-0e4a-4779-b53a-78c48397ea2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120740) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 18:05:53.070085 dv-cinder-852009-8-iscsi devstack@n-api.service[120740]: DEBUG oslo_concurrency.lockutils [None req-56938d78-0f91-4a3b-9288-376d298dce11 tempest-AttachVolumeShelveTestJSON-385853788 tempest-AttachVolumeShelveTestJSON-385853788-project] Lock "1daf4f4c-0e4a-4779-b53a-78c48397ea2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120740) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 18:05:53.076412 dv-cinder-852009-8-iscsi devstack@n-api.service[120740]: DEBUG oslo_concurrency.lockutils [None req-56938d78-0f91-4a3b-9288-376d298dce11 tempest-AttachVolumeShelveTestJSON-385853788 tempest-AttachVolumeShelveTestJSON-385853788-project] Acquiring lock "1daf4f4c-0e4a-4779-b53a-78c48397ea2f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120740) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 18:05:53.077119 dv-cinder-852009-8-iscsi devstack@n-api.service[120740]: DEBUG oslo_concurrency.lockutils [None req-56938d78-0f91-4a3b-9288-376d298dce11 tempest-AttachVolumeShelveTestJSON-385853788 tempest-AttachVolumeShelveTestJSON-385853788-project] Lock "1daf4f4c-0e4a-4779-b53a-78c48397ea2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120740) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 18:05:53.085578 dv-cinder-852009-8-iscsi devstack@n-api.service[120740]: DEBUG oslo_concurrency.lockutils [None req-56938d78-0f91-4a3b-9288-376d298dce11 tempest-AttachVolumeShelveTestJSON-385853788 tempest-AttachVolumeShelveTestJSON-385853788-project] Lock "1daf4f4c-0e4a-4779-b53a-78c48397ea2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.008s {{(pid=120740) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 18:05:53.271715 dv-cinder-852009-8-iscsi devstack@n-api.service[120740]: DEBUG nova.policy [None req-56938d78-0f91-4a3b-9288-376d298dce11 tempest-AttachVolumeShelveTestJSON-385853788 tempest-AttachVolumeShelveTestJSON-385853788-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e68ecd9b3ca643539b109f75bb242d6f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '75e14fd88bfb4cd896fa7b070a0fac47', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120740) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 18:05:53.283708 dv-cinder-852009-8-iscsi devstack@n-api.service[120740]: DEBUG nova.policy [None req-56938d78-0f91-4a3b-9288-376d298dce11 tempest-AttachVolumeShelveTestJSON-385853788 tempest-AttachVolumeShelveTestJSON-385853788-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'e68ecd9b3ca643539b109f75bb242d6f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '75e14fd88bfb4cd896fa7b070a0fac47', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120740) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 18:05:53.285348 dv-cinder-852009-8-iscsi devstack@n-api.service[120740]: DEBUG nova.policy [None req-56938d78-0f91-4a3b-9288-376d298dce11 tempest-AttachVolumeShelveTestJSON-385853788 tempest-AttachVolumeShelveTestJSON-385853788-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'e68ecd9b3ca643539b109f75bb242d6f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '75e14fd88bfb4cd896fa7b070a0fac47', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120740) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 18:05:53.287101 dv-cinder-852009-8-iscsi devstack@n-api.service[120740]: INFO nova.api.openstack.requestlog [None req-56938d78-0f91-4a3b-9288-376d298dce11 tempest-AttachVolumeShelveTestJSON-385853788 tempest-AttachVolumeShelveTestJSON-385853788-project] 10.222.0.43 "GET /compute/v2.1/servers/8cecf08e-bea8-4cef-9439-0eaa242bfed1" status: 200 len: 1406 microversion: 2.20 time: 0.241641 Sep 13 18:05:53.306270 dv-cinder-852009-8-iscsi devstack@n-api.service[120740]: [pid: 120740|app: 0|req: 235/459] 10.222.0.43 () {60 vars in 1277 bytes} [Tue Sep 13 18:05:53 2022] GET /compute/v2.1/servers/8cecf08e-bea8-4cef-9439-0eaa242bfed1 => generated 1406 bytes in 260 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 13 18:05:54.313403 dv-cinder-852009-8-iscsi devstack@n-api.service[120741]: DEBUG nova.api.openstack.wsgi [None req-f1892b69-0cb7-4d40-ae09-a812aeadd10e tempest-AttachVolumeShelveTestJSON-385853788 tempest-AttachVolumeShelveTestJSON-385853788-project] Calling method '>' {{(pid=120741) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 18:05:54.314190 dv-cinder-852009-8-iscsi devstack@n-api.service[120741]: DEBUG nova.compute.api [None req-f1892b69-0cb7-4d40-ae09-a812aeadd10e tempest-AttachVolumeShelveTestJSON-385853788 tempest-AttachVolumeShelveTestJSON-385853788-project] [instance: 8cecf08e-bea8-4cef-9439-0eaa242bfed1] Fetching instance by UUID {{(pid=120741) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 18:05:54.321364 dv-cinder-852009-8-iscsi devstack@n-api.service[120741]: DEBUG oslo_concurrency.lockutils [None req-f1892b69-0cb7-4d40-ae09-a812aeadd10e tempest-AttachVolumeShelveTestJSON-385853788 tempest-AttachVolumeShelveTestJSON-385853788-project] Acquiring lock "1daf4f4c-0e4a-4779-b53a-78c48397ea2f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120741) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 18:05:54.321827 dv-cinder-852009-8-iscsi devstack@n-api.service[120741]: DEBUG oslo_concurrency.lockutils [None req-f1892b69-0cb7-4d40-ae09-a812aeadd10e tempest-AttachVolumeShelveTestJSON-385853788 tempest-AttachVolumeShelveTestJSON-385853788-project] Lock "1daf4f4c-0e4a-4779-b53a-78c48397ea2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120741) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 18:05:54.322279 dv-cinder-852009-8-iscsi devstack@n-api.service[120741]: DEBUG oslo_concurrency.lockutils [None req-f1892b69-0cb7-4d40-ae09-a812aeadd10e tempest-AttachVolumeShelveTestJSON-385853788 tempest-AttachVolumeShelveTestJSON-385853788-project] Lock "1daf4f4c-0e4a-4779-b53a-78c48397ea2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120741) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 18:05:54.322964 dv-cinder-852009-8-iscsi devstack@n-api.service[120741]: DEBUG oslo_concurrency.lockutils [None req-f1892b69-0cb7-4d40-ae09-a812aeadd10e tempest-AttachVolumeShelveTestJSON-385853788 tempest-AttachVolumeShelveTestJSON-385853788-project] Acquiring lock "1daf4f4c-0e4a-4779-b53a-78c48397ea2f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120741) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 18:05:54.324064 dv-cinder-852009-8-iscsi devstack@n-api.service[120741]: DEBUG oslo_concurrency.lockutils [None req-f1892b69-0cb7-4d40-ae09-a812aeadd10e tempest-AttachVolumeShelveTestJSON-385853788 tempest-AttachVolumeShelveTestJSON-385853788-project] Lock "1daf4f4c-0e4a-4779-b53a-78c48397ea2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120741) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 18:05:54.324621 dv-cinder-852009-8-iscsi devstack@n-api.service[120741]: DEBUG oslo_concurrency.lockutils [None req-f1892b69-0cb7-4d40-ae09-a812aeadd10e tempest-AttachVolumeShelveTestJSON-385853788 tempest-AttachVolumeShelveTestJSON-385853788-project] Lock "1daf4f4c-0e4a-4779-b53a-78c48397ea2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120741) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 18:05:54.466797 dv-cinder-852009-8-iscsi devstack@n-api.service[120741]: DEBUG nova.policy [None req-f1892b69-0cb7-4d40-ae09-a812aeadd10e tempest-AttachVolumeShelveTestJSON-385853788 tempest-AttachVolumeShelveTestJSON-385853788-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e68ecd9b3ca643539b109f75bb242d6f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '75e14fd88bfb4cd896fa7b070a0fac47', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120741) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 18:05:54.475141 dv-cinder-852009-8-iscsi devstack@n-api.service[120741]: DEBUG nova.policy [None req-f1892b69-0cb7-4d40-ae09-a812aeadd10e tempest-AttachVolumeShelveTestJSON-385853788 tempest-AttachVolumeShelveTestJSON-385853788-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'e68ecd9b3ca643539b109f75bb242d6f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '75e14fd88bfb4cd896fa7b070a0fac47', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120741) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 18:05:54.476449 dv-cinder-852009-8-iscsi devstack@n-api.service[120741]: DEBUG nova.policy [None req-f1892b69-0cb7-4d40-ae09-a812aeadd10e tempest-AttachVolumeShelveTestJSON-385853788 tempest-AttachVolumeShelveTestJSON-385853788-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'e68ecd9b3ca643539b109f75bb242d6f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '75e14fd88bfb4cd896fa7b070a0fac47', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120741) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 18:05:54.477558 dv-cinder-852009-8-iscsi devstack@n-api.service[120741]: INFO nova.api.openstack.requestlog [None req-f1892b69-0cb7-4d40-ae09-a812aeadd10e tempest-AttachVolumeShelveTestJSON-385853788 tempest-AttachVolumeShelveTestJSON-385853788-project] 10.222.0.43 "GET /compute/v2.1/servers/8cecf08e-bea8-4cef-9439-0eaa242bfed1" status: 200 len: 1406 microversion: 2.20 time: 0.168604 Sep 13 18:05:54.478144 dv-cinder-852009-8-iscsi devstack@n-api.service[120741]: [pid: 120741|app: 0|req: 225/460] 10.222.0.43 () {60 vars in 1277 bytes} [Tue Sep 13 18:05:54 2022] GET /compute/v2.1/servers/8cecf08e-bea8-4cef-9439-0eaa242bfed1 => generated 1406 bytes in 170 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 13 18:05:54.593998 dv-cinder-852009-8-iscsi devstack@n-api.service[120740]: DEBUG nova.api.openstack.wsgi [None req-43a2789f-ca91-4c00-9f53-f94f3be867f3 tempest-TestMinimumBasicScenario-820002800 tempest-TestMinimumBasicScenario-820002800-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "27d8cacb-8af0-4c38-83c5-31a4d3abe7c1"}} {{(pid=120740) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 13 18:05:54.596438 dv-cinder-852009-8-iscsi devstack@n-api.service[120740]: DEBUG nova.compute.api [None req-43a2789f-ca91-4c00-9f53-f94f3be867f3 tempest-TestMinimumBasicScenario-820002800 tempest-TestMinimumBasicScenario-820002800-project] [instance: f8247a13-94cd-45b2-acc8-8717e1260f37] Fetching instance by UUID {{(pid=120740) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 18:05:54.602376 dv-cinder-852009-8-iscsi devstack@n-api.service[120740]: DEBUG oslo_concurrency.lockutils [None req-43a2789f-ca91-4c00-9f53-f94f3be867f3 tempest-TestMinimumBasicScenario-820002800 tempest-TestMinimumBasicScenario-820002800-project] Acquiring lock "1daf4f4c-0e4a-4779-b53a-78c48397ea2f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120740) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 18:05:54.602859 dv-cinder-852009-8-iscsi devstack@n-api.service[120740]: DEBUG oslo_concurrency.lockutils [None req-43a2789f-ca91-4c00-9f53-f94f3be867f3 tempest-TestMinimumBasicScenario-820002800 tempest-TestMinimumBasicScenario-820002800-project] Lock "1daf4f4c-0e4a-4779-b53a-78c48397ea2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120740) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 18:05:54.603297 dv-cinder-852009-8-iscsi devstack@n-api.service[120740]: DEBUG oslo_concurrency.lockutils [None req-43a2789f-ca91-4c00-9f53-f94f3be867f3 tempest-TestMinimumBasicScenario-820002800 tempest-TestMinimumBasicScenario-820002800-project] Lock "1daf4f4c-0e4a-4779-b53a-78c48397ea2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120740) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 18:05:54.604006 dv-cinder-852009-8-iscsi devstack@n-api.service[120740]: DEBUG oslo_concurrency.lockutils [None req-43a2789f-ca91-4c00-9f53-f94f3be867f3 tempest-TestMinimumBasicScenario-820002800 tempest-TestMinimumBasicScenario-820002800-project] Acquiring lock "1daf4f4c-0e4a-4779-b53a-78c48397ea2f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120740) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 18:05:54.604465 dv-cinder-852009-8-iscsi devstack@n-api.service[120740]: DEBUG oslo_concurrency.lockutils [None req-43a2789f-ca91-4c00-9f53-f94f3be867f3 tempest-TestMinimumBasicScenario-820002800 tempest-TestMinimumBasicScenario-820002800-project] Lock "1daf4f4c-0e4a-4779-b53a-78c48397ea2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120740) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 18:05:54.604926 dv-cinder-852009-8-iscsi devstack@n-api.service[120740]: DEBUG oslo_concurrency.lockutils [None req-43a2789f-ca91-4c00-9f53-f94f3be867f3 tempest-TestMinimumBasicScenario-820002800 tempest-TestMinimumBasicScenario-820002800-project] Lock "1daf4f4c-0e4a-4779-b53a-78c48397ea2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120740) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 18:05:54.994126 dv-cinder-852009-8-iscsi devstack@n-api.service[120741]: DEBUG nova.api.openstack.wsgi [req-2d121b9e-2983-43ab-9b85-b19886d7a076 req-b428113c-1db2-4f41-9945-37a37ca529f2 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "8cecf08e-bea8-4cef-9439-0eaa242bfed1", "tag": "cf75920d-98e9-4700-bdad-ac46b7b3f022"}]} {{(pid=120741) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 13 18:05:55.005269 dv-cinder-852009-8-iscsi devstack@n-api.service[120741]: DEBUG oslo_concurrency.lockutils [req-2d121b9e-2983-43ab-9b85-b19886d7a076 req-b428113c-1db2-4f41-9945-37a37ca529f2 service nova] Acquiring lock "1daf4f4c-0e4a-4779-b53a-78c48397ea2f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120741) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 18:05:55.005771 dv-cinder-852009-8-iscsi devstack@n-api.service[120741]: DEBUG oslo_concurrency.lockutils [req-2d121b9e-2983-43ab-9b85-b19886d7a076 req-b428113c-1db2-4f41-9945-37a37ca529f2 service nova] Lock "1daf4f4c-0e4a-4779-b53a-78c48397ea2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120741) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 18:05:55.006200 dv-cinder-852009-8-iscsi devstack@n-api.service[120741]: DEBUG oslo_concurrency.lockutils [req-2d121b9e-2983-43ab-9b85-b19886d7a076 req-b428113c-1db2-4f41-9945-37a37ca529f2 service nova] Lock "1daf4f4c-0e4a-4779-b53a-78c48397ea2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120741) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 18:05:55.017656 dv-cinder-852009-8-iscsi devstack@n-api.service[120741]: INFO nova.api.openstack.compute.server_external_events [req-2d121b9e-2983-43ab-9b85-b19886d7a076 req-b428113c-1db2-4f41-9945-37a37ca529f2 service nova] Creating event network-changed:cf75920d-98e9-4700-bdad-ac46b7b3f022 for instance 8cecf08e-bea8-4cef-9439-0eaa242bfed1 on hv-cinder-85200 Sep 13 18:05:55.022536 dv-cinder-852009-8-iscsi devstack@n-api.service[120741]: INFO nova.api.openstack.requestlog [req-2d121b9e-2983-43ab-9b85-b19886d7a076 req-b428113c-1db2-4f41-9945-37a37ca529f2 service nova] 10.222.0.43 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.034795 Sep 13 18:05:55.023102 dv-cinder-852009-8-iscsi devstack@n-api.service[120741]: [pid: 120741|app: 0|req: 226/461] 10.222.0.43 () {64 vars in 1317 bytes} [Tue Sep 13 18:05:54 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 36 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 13 18:05:55.457901 dv-cinder-852009-8-iscsi devstack@n-api.service[120740]: INFO nova.api.openstack.requestlog [None req-43a2789f-ca91-4c00-9f53-f94f3be867f3 tempest-TestMinimumBasicScenario-820002800 tempest-TestMinimumBasicScenario-820002800-project] 10.222.0.43 "POST /compute/v2.1/servers/f8247a13-94cd-45b2-acc8-8717e1260f37/os-volume_attachments" status: 200 len: 194 microversion: 2.1 time: 0.867846 Sep 13 18:05:55.458522 dv-cinder-852009-8-iscsi devstack@n-api.service[120740]: [pid: 120740|app: 0|req: 236/462] 10.222.0.43 () {60 vars in 1323 bytes} [Tue Sep 13 18:05:54 2022] POST /compute/v2.1/servers/f8247a13-94cd-45b2-acc8-8717e1260f37/os-volume_attachments => generated 194 bytes in 869 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 13 18:05:55.505209 dv-cinder-852009-8-iscsi devstack@n-api.service[120741]: DEBUG nova.api.openstack.wsgi [None req-53c1d798-4851-46ea-a5cf-3fff03796032 tempest-AttachVolumeShelveTestJSON-385853788 tempest-AttachVolumeShelveTestJSON-385853788-project] Calling method '>' {{(pid=120741) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 18:05:55.505901 dv-cinder-852009-8-iscsi devstack@n-api.service[120741]: DEBUG nova.compute.api [None req-53c1d798-4851-46ea-a5cf-3fff03796032 tempest-AttachVolumeShelveTestJSON-385853788 tempest-AttachVolumeShelveTestJSON-385853788-project] [instance: 8cecf08e-bea8-4cef-9439-0eaa242bfed1] Fetching instance by UUID {{(pid=120741) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 18:05:55.512386 dv-cinder-852009-8-iscsi devstack@n-api.service[120741]: DEBUG oslo_concurrency.lockutils [None req-53c1d798-4851-46ea-a5cf-3fff03796032 tempest-AttachVolumeShelveTestJSON-385853788 tempest-AttachVolumeShelveTestJSON-385853788-project] Acquiring lock "1daf4f4c-0e4a-4779-b53a-78c48397ea2f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120741) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 18:05:55.514315 dv-cinder-852009-8-iscsi devstack@n-api.service[120741]: DEBUG oslo_concurrency.lockutils [None req-53c1d798-4851-46ea-a5cf-3fff03796032 tempest-AttachVolumeShelveTestJSON-385853788 tempest-AttachVolumeShelveTestJSON-385853788-project] Lock "1daf4f4c-0e4a-4779-b53a-78c48397ea2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120741) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 18:05:55.514973 dv-cinder-852009-8-iscsi devstack@n-api.service[120741]: DEBUG oslo_concurrency.lockutils [None req-53c1d798-4851-46ea-a5cf-3fff03796032 tempest-AttachVolumeShelveTestJSON-385853788 tempest-AttachVolumeShelveTestJSON-385853788-project] Lock "1daf4f4c-0e4a-4779-b53a-78c48397ea2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120741) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 18:05:55.516202 dv-cinder-852009-8-iscsi devstack@n-api.service[120741]: DEBUG oslo_concurrency.lockutils [None req-53c1d798-4851-46ea-a5cf-3fff03796032 tempest-AttachVolumeShelveTestJSON-385853788 tempest-AttachVolumeShelveTestJSON-385853788-project] Acquiring lock "1daf4f4c-0e4a-4779-b53a-78c48397ea2f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120741) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 18:05:55.517014 dv-cinder-852009-8-iscsi devstack@n-api.service[120741]: DEBUG oslo_concurrency.lockutils [None req-53c1d798-4851-46ea-a5cf-3fff03796032 tempest-AttachVolumeShelveTestJSON-385853788 tempest-AttachVolumeShelveTestJSON-385853788-project] Lock "1daf4f4c-0e4a-4779-b53a-78c48397ea2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120741) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 18:05:55.517588 dv-cinder-852009-8-iscsi devstack@n-api.service[120741]: DEBUG oslo_concurrency.lockutils [None req-53c1d798-4851-46ea-a5cf-3fff03796032 tempest-AttachVolumeShelveTestJSON-385853788 tempest-AttachVolumeShelveTestJSON-385853788-project] Lock "1daf4f4c-0e4a-4779-b53a-78c48397ea2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120741) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 18:05:55.659252 dv-cinder-852009-8-iscsi devstack@n-api.service[120741]: DEBUG nova.policy [None req-53c1d798-4851-46ea-a5cf-3fff03796032 tempest-AttachVolumeShelveTestJSON-385853788 tempest-AttachVolumeShelveTestJSON-385853788-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e68ecd9b3ca643539b109f75bb242d6f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '75e14fd88bfb4cd896fa7b070a0fac47', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120741) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 18:05:55.667573 dv-cinder-852009-8-iscsi devstack@n-api.service[120741]: DEBUG nova.policy [None req-53c1d798-4851-46ea-a5cf-3fff03796032 tempest-AttachVolumeShelveTestJSON-385853788 tempest-AttachVolumeShelveTestJSON-385853788-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'e68ecd9b3ca643539b109f75bb242d6f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '75e14fd88bfb4cd896fa7b070a0fac47', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120741) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 18:05:55.669081 dv-cinder-852009-8-iscsi devstack@n-api.service[120741]: DEBUG nova.policy [None req-53c1d798-4851-46ea-a5cf-3fff03796032 tempest-AttachVolumeShelveTestJSON-385853788 tempest-AttachVolumeShelveTestJSON-385853788-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'e68ecd9b3ca643539b109f75bb242d6f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '75e14fd88bfb4cd896fa7b070a0fac47', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120741) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 18:05:55.670180 dv-cinder-852009-8-iscsi devstack@n-api.service[120741]: INFO nova.api.openstack.requestlog [None req-53c1d798-4851-46ea-a5cf-3fff03796032 tempest-AttachVolumeShelveTestJSON-385853788 tempest-AttachVolumeShelveTestJSON-385853788-project] 10.222.0.43 "GET /compute/v2.1/servers/8cecf08e-bea8-4cef-9439-0eaa242bfed1" status: 200 len: 1406 microversion: 2.20 time: 0.170746 Sep 13 18:05:55.670747 dv-cinder-852009-8-iscsi devstack@n-api.service[120741]: [pid: 120741|app: 0|req: 227/463] 10.222.0.43 () {60 vars in 1277 bytes} [Tue Sep 13 18:05:55 2022] GET /compute/v2.1/servers/8cecf08e-bea8-4cef-9439-0eaa242bfed1 => generated 1406 bytes in 173 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 13 18:05:56.699944 dv-cinder-852009-8-iscsi devstack@n-api.service[120740]: DEBUG nova.api.openstack.wsgi [None req-3469f14e-c4b5-4423-a5fe-00bbbbcf934b tempest-AttachVolumeShelveTestJSON-385853788 tempest-AttachVolumeShelveTestJSON-385853788-project] Calling method '>' {{(pid=120740) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 18:05:56.701578 dv-cinder-852009-8-iscsi devstack@n-api.service[120740]: DEBUG nova.compute.api [None req-3469f14e-c4b5-4423-a5fe-00bbbbcf934b tempest-AttachVolumeShelveTestJSON-385853788 tempest-AttachVolumeShelveTestJSON-385853788-project] [instance: 8cecf08e-bea8-4cef-9439-0eaa242bfed1] Fetching instance by UUID {{(pid=120740) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 18:05:56.713019 dv-cinder-852009-8-iscsi devstack@n-api.service[120740]: DEBUG oslo_concurrency.lockutils [None req-3469f14e-c4b5-4423-a5fe-00bbbbcf934b tempest-AttachVolumeShelveTestJSON-385853788 tempest-AttachVolumeShelveTestJSON-385853788-project] Acquiring lock "1daf4f4c-0e4a-4779-b53a-78c48397ea2f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120740) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 18:05:56.713801 dv-cinder-852009-8-iscsi devstack@n-api.service[120740]: DEBUG oslo_concurrency.lockutils [None req-3469f14e-c4b5-4423-a5fe-00bbbbcf934b tempest-AttachVolumeShelveTestJSON-385853788 tempest-AttachVolumeShelveTestJSON-385853788-project] Lock "1daf4f4c-0e4a-4779-b53a-78c48397ea2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120740) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 18:05:56.714502 dv-cinder-852009-8-iscsi devstack@n-api.service[120740]: DEBUG oslo_concurrency.lockutils [None req-3469f14e-c4b5-4423-a5fe-00bbbbcf934b tempest-AttachVolumeShelveTestJSON-385853788 tempest-AttachVolumeShelveTestJSON-385853788-project] Lock "1daf4f4c-0e4a-4779-b53a-78c48397ea2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120740) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 18:05:56.715608 dv-cinder-852009-8-iscsi devstack@n-api.service[120740]: DEBUG oslo_concurrency.lockutils [None req-3469f14e-c4b5-4423-a5fe-00bbbbcf934b tempest-AttachVolumeShelveTestJSON-385853788 tempest-AttachVolumeShelveTestJSON-385853788-project] Acquiring lock "1daf4f4c-0e4a-4779-b53a-78c48397ea2f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120740) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 18:05:56.716027 dv-cinder-852009-8-iscsi devstack@n-api.service[120740]: DEBUG oslo_concurrency.lockutils [None req-3469f14e-c4b5-4423-a5fe-00bbbbcf934b tempest-AttachVolumeShelveTestJSON-385853788 tempest-AttachVolumeShelveTestJSON-385853788-project] Lock "1daf4f4c-0e4a-4779-b53a-78c48397ea2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120740) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 18:05:56.716453 dv-cinder-852009-8-iscsi devstack@n-api.service[120740]: DEBUG oslo_concurrency.lockutils [None req-3469f14e-c4b5-4423-a5fe-00bbbbcf934b tempest-AttachVolumeShelveTestJSON-385853788 tempest-AttachVolumeShelveTestJSON-385853788-project] Lock "1daf4f4c-0e4a-4779-b53a-78c48397ea2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120740) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 18:05:56.849753 dv-cinder-852009-8-iscsi devstack@n-api.service[120740]: DEBUG nova.policy [None req-3469f14e-c4b5-4423-a5fe-00bbbbcf934b tempest-AttachVolumeShelveTestJSON-385853788 tempest-AttachVolumeShelveTestJSON-385853788-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e68ecd9b3ca643539b109f75bb242d6f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '75e14fd88bfb4cd896fa7b070a0fac47', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120740) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 18:05:56.858121 dv-cinder-852009-8-iscsi devstack@n-api.service[120740]: DEBUG nova.policy [None req-3469f14e-c4b5-4423-a5fe-00bbbbcf934b tempest-AttachVolumeShelveTestJSON-385853788 tempest-AttachVolumeShelveTestJSON-385853788-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'e68ecd9b3ca643539b109f75bb242d6f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '75e14fd88bfb4cd896fa7b070a0fac47', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120740) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 18:05:56.859553 dv-cinder-852009-8-iscsi devstack@n-api.service[120740]: DEBUG nova.policy [None req-3469f14e-c4b5-4423-a5fe-00bbbbcf934b tempest-AttachVolumeShelveTestJSON-385853788 tempest-AttachVolumeShelveTestJSON-385853788-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'e68ecd9b3ca643539b109f75bb242d6f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '75e14fd88bfb4cd896fa7b070a0fac47', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120740) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 18:05:56.860694 dv-cinder-852009-8-iscsi devstack@n-api.service[120740]: INFO nova.api.openstack.requestlog [None req-3469f14e-c4b5-4423-a5fe-00bbbbcf934b tempest-AttachVolumeShelveTestJSON-385853788 tempest-AttachVolumeShelveTestJSON-385853788-project] 10.222.0.43 "GET /compute/v2.1/servers/8cecf08e-bea8-4cef-9439-0eaa242bfed1" status: 200 len: 1406 microversion: 2.20 time: 0.168077 Sep 13 18:05:56.861251 dv-cinder-852009-8-iscsi devstack@n-api.service[120740]: [pid: 120740|app: 0|req: 237/464] 10.222.0.43 () {60 vars in 1277 bytes} [Tue Sep 13 18:05:56 2022] GET /compute/v2.1/servers/8cecf08e-bea8-4cef-9439-0eaa242bfed1 => generated 1406 bytes in 170 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 13 18:05:57.890522 dv-cinder-852009-8-iscsi devstack@n-api.service[120741]: DEBUG nova.api.openstack.wsgi [None req-c55c5e3b-4bd6-42cc-901a-eda9be492563 tempest-AttachVolumeShelveTestJSON-385853788 tempest-AttachVolumeShelveTestJSON-385853788-project] Calling method '>' {{(pid=120741) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 18:05:57.891379 dv-cinder-852009-8-iscsi devstack@n-api.service[120741]: DEBUG nova.compute.api [None req-c55c5e3b-4bd6-42cc-901a-eda9be492563 tempest-AttachVolumeShelveTestJSON-385853788 tempest-AttachVolumeShelveTestJSON-385853788-project] [instance: 8cecf08e-bea8-4cef-9439-0eaa242bfed1] Fetching instance by UUID {{(pid=120741) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 18:05:57.895341 dv-cinder-852009-8-iscsi devstack@n-api.service[120741]: DEBUG dbcounter [-] [120741] Writing DB stats nova_cell0:SELECT=6 {{(pid=120741) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 18:05:57.904219 dv-cinder-852009-8-iscsi devstack@n-api.service[120741]: DEBUG oslo_concurrency.lockutils [None req-c55c5e3b-4bd6-42cc-901a-eda9be492563 tempest-AttachVolumeShelveTestJSON-385853788 tempest-AttachVolumeShelveTestJSON-385853788-project] Acquiring lock "1daf4f4c-0e4a-4779-b53a-78c48397ea2f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120741) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 18:05:57.904732 dv-cinder-852009-8-iscsi devstack@n-api.service[120741]: DEBUG oslo_concurrency.lockutils [None req-c55c5e3b-4bd6-42cc-901a-eda9be492563 tempest-AttachVolumeShelveTestJSON-385853788 tempest-AttachVolumeShelveTestJSON-385853788-project] Lock "1daf4f4c-0e4a-4779-b53a-78c48397ea2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120741) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 18:05:57.905160 dv-cinder-852009-8-iscsi devstack@n-api.service[120741]: DEBUG oslo_concurrency.lockutils [None req-c55c5e3b-4bd6-42cc-901a-eda9be492563 tempest-AttachVolumeShelveTestJSON-385853788 tempest-AttachVolumeShelveTestJSON-385853788-project] Lock "1daf4f4c-0e4a-4779-b53a-78c48397ea2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120741) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 18:05:57.905852 dv-cinder-852009-8-iscsi devstack@n-api.service[120741]: DEBUG oslo_concurrency.lockutils [None req-c55c5e3b-4bd6-42cc-901a-eda9be492563 tempest-AttachVolumeShelveTestJSON-385853788 tempest-AttachVolumeShelveTestJSON-385853788-project] Acquiring lock "1daf4f4c-0e4a-4779-b53a-78c48397ea2f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120741) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 18:05:57.906304 dv-cinder-852009-8-iscsi devstack@n-api.service[120741]: DEBUG oslo_concurrency.lockutils [None req-c55c5e3b-4bd6-42cc-901a-eda9be492563 tempest-AttachVolumeShelveTestJSON-385853788 tempest-AttachVolumeShelveTestJSON-385853788-project] Lock "1daf4f4c-0e4a-4779-b53a-78c48397ea2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120741) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 18:05:57.906724 dv-cinder-852009-8-iscsi devstack@n-api.service[120741]: DEBUG oslo_concurrency.lockutils [None req-c55c5e3b-4bd6-42cc-901a-eda9be492563 tempest-AttachVolumeShelveTestJSON-385853788 tempest-AttachVolumeShelveTestJSON-385853788-project] Lock "1daf4f4c-0e4a-4779-b53a-78c48397ea2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120741) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 18:05:58.045863 dv-cinder-852009-8-iscsi devstack@n-api.service[120741]: DEBUG nova.policy [None req-c55c5e3b-4bd6-42cc-901a-eda9be492563 tempest-AttachVolumeShelveTestJSON-385853788 tempest-AttachVolumeShelveTestJSON-385853788-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e68ecd9b3ca643539b109f75bb242d6f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '75e14fd88bfb4cd896fa7b070a0fac47', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120741) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 18:05:58.054584 dv-cinder-852009-8-iscsi devstack@n-api.service[120741]: DEBUG nova.policy [None req-c55c5e3b-4bd6-42cc-901a-eda9be492563 tempest-AttachVolumeShelveTestJSON-385853788 tempest-AttachVolumeShelveTestJSON-385853788-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'e68ecd9b3ca643539b109f75bb242d6f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '75e14fd88bfb4cd896fa7b070a0fac47', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120741) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 18:05:58.056065 dv-cinder-852009-8-iscsi devstack@n-api.service[120741]: DEBUG nova.policy [None req-c55c5e3b-4bd6-42cc-901a-eda9be492563 tempest-AttachVolumeShelveTestJSON-385853788 tempest-AttachVolumeShelveTestJSON-385853788-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'e68ecd9b3ca643539b109f75bb242d6f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '75e14fd88bfb4cd896fa7b070a0fac47', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120741) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 18:05:58.057221 dv-cinder-852009-8-iscsi devstack@n-api.service[120741]: INFO nova.api.openstack.requestlog [None req-c55c5e3b-4bd6-42cc-901a-eda9be492563 tempest-AttachVolumeShelveTestJSON-385853788 tempest-AttachVolumeShelveTestJSON-385853788-project] 10.222.0.43 "GET /compute/v2.1/servers/8cecf08e-bea8-4cef-9439-0eaa242bfed1" status: 200 len: 1406 microversion: 2.20 time: 0.173522 Sep 13 18:05:58.057756 dv-cinder-852009-8-iscsi devstack@n-api.service[120741]: [pid: 120741|app: 0|req: 228/465] 10.222.0.43 () {60 vars in 1277 bytes} [Tue Sep 13 18:05:57 2022] GET /compute/v2.1/servers/8cecf08e-bea8-4cef-9439-0eaa242bfed1 => generated 1406 bytes in 175 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 13 18:05:59.083050 dv-cinder-852009-8-iscsi devstack@n-api.service[120740]: DEBUG nova.api.openstack.wsgi [None req-c8776e02-1b13-4a16-a7ce-88933bb01e99 tempest-AttachVolumeShelveTestJSON-385853788 tempest-AttachVolumeShelveTestJSON-385853788-project] Calling method '>' {{(pid=120740) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 18:05:59.084179 dv-cinder-852009-8-iscsi devstack@n-api.service[120740]: DEBUG nova.compute.api [None req-c8776e02-1b13-4a16-a7ce-88933bb01e99 tempest-AttachVolumeShelveTestJSON-385853788 tempest-AttachVolumeShelveTestJSON-385853788-project] [instance: 8cecf08e-bea8-4cef-9439-0eaa242bfed1] Fetching instance by UUID {{(pid=120740) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 18:05:59.086880 dv-cinder-852009-8-iscsi devstack@n-api.service[120740]: DEBUG dbcounter [-] [120740] Writing DB stats nova_cell0:SELECT=6 {{(pid=120740) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 18:05:59.088338 dv-cinder-852009-8-iscsi devstack@n-api.service[120741]: DEBUG nova.api.openstack.wsgi [req-bd199bce-2280-44c3-b30c-e8cd106668e9 req-6b34c667-911d-4fd4-81aa-cf3c9b23df33 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "8cecf08e-bea8-4cef-9439-0eaa242bfed1", "name": "network-vif-plugged", "status": "completed", "tag": "cf75920d-98e9-4700-bdad-ac46b7b3f022"}]} {{(pid=120741) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 13 18:05:59.092089 dv-cinder-852009-8-iscsi devstack@n-api.service[120740]: DEBUG oslo_concurrency.lockutils [None req-c8776e02-1b13-4a16-a7ce-88933bb01e99 tempest-AttachVolumeShelveTestJSON-385853788 tempest-AttachVolumeShelveTestJSON-385853788-project] Acquiring lock "1daf4f4c-0e4a-4779-b53a-78c48397ea2f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120740) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 18:05:59.092639 dv-cinder-852009-8-iscsi devstack@n-api.service[120740]: DEBUG oslo_concurrency.lockutils [None req-c8776e02-1b13-4a16-a7ce-88933bb01e99 tempest-AttachVolumeShelveTestJSON-385853788 tempest-AttachVolumeShelveTestJSON-385853788-project] Lock "1daf4f4c-0e4a-4779-b53a-78c48397ea2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120740) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 18:05:59.093268 dv-cinder-852009-8-iscsi devstack@n-api.service[120740]: DEBUG oslo_concurrency.lockutils [None req-c8776e02-1b13-4a16-a7ce-88933bb01e99 tempest-AttachVolumeShelveTestJSON-385853788 tempest-AttachVolumeShelveTestJSON-385853788-project] Lock "1daf4f4c-0e4a-4779-b53a-78c48397ea2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120740) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 18:05:59.093924 dv-cinder-852009-8-iscsi devstack@n-api.service[120740]: DEBUG oslo_concurrency.lockutils [None req-c8776e02-1b13-4a16-a7ce-88933bb01e99 tempest-AttachVolumeShelveTestJSON-385853788 tempest-AttachVolumeShelveTestJSON-385853788-project] Acquiring lock "1daf4f4c-0e4a-4779-b53a-78c48397ea2f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120740) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 18:05:59.094437 dv-cinder-852009-8-iscsi devstack@n-api.service[120740]: DEBUG oslo_concurrency.lockutils [None req-c8776e02-1b13-4a16-a7ce-88933bb01e99 tempest-AttachVolumeShelveTestJSON-385853788 tempest-AttachVolumeShelveTestJSON-385853788-project] Lock "1daf4f4c-0e4a-4779-b53a-78c48397ea2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120740) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 18:05:59.094829 dv-cinder-852009-8-iscsi devstack@n-api.service[120740]: DEBUG oslo_concurrency.lockutils [None req-c8776e02-1b13-4a16-a7ce-88933bb01e99 tempest-AttachVolumeShelveTestJSON-385853788 tempest-AttachVolumeShelveTestJSON-385853788-project] Lock "1daf4f4c-0e4a-4779-b53a-78c48397ea2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120740) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 18:05:59.101030 dv-cinder-852009-8-iscsi devstack@n-api.service[120741]: DEBUG oslo_concurrency.lockutils [req-bd199bce-2280-44c3-b30c-e8cd106668e9 req-6b34c667-911d-4fd4-81aa-cf3c9b23df33 service nova] Acquiring lock "1daf4f4c-0e4a-4779-b53a-78c48397ea2f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120741) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 18:05:59.101698 dv-cinder-852009-8-iscsi devstack@n-api.service[120741]: DEBUG oslo_concurrency.lockutils [req-bd199bce-2280-44c3-b30c-e8cd106668e9 req-6b34c667-911d-4fd4-81aa-cf3c9b23df33 service nova] Lock "1daf4f4c-0e4a-4779-b53a-78c48397ea2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120741) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 18:05:59.102268 dv-cinder-852009-8-iscsi devstack@n-api.service[120741]: DEBUG oslo_concurrency.lockutils [req-bd199bce-2280-44c3-b30c-e8cd106668e9 req-6b34c667-911d-4fd4-81aa-cf3c9b23df33 service nova] Lock "1daf4f4c-0e4a-4779-b53a-78c48397ea2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120741) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 18:05:59.113813 dv-cinder-852009-8-iscsi devstack@n-api.service[120741]: INFO nova.api.openstack.compute.server_external_events [req-bd199bce-2280-44c3-b30c-e8cd106668e9 req-6b34c667-911d-4fd4-81aa-cf3c9b23df33 service nova] Creating event network-vif-plugged:cf75920d-98e9-4700-bdad-ac46b7b3f022 for instance 8cecf08e-bea8-4cef-9439-0eaa242bfed1 on hv-cinder-85200 Sep 13 18:05:59.119387 dv-cinder-852009-8-iscsi devstack@n-api.service[120741]: INFO nova.api.openstack.requestlog [req-bd199bce-2280-44c3-b30c-e8cd106668e9 req-6b34c667-911d-4fd4-81aa-cf3c9b23df33 service nova] 10.222.0.43 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.035287 Sep 13 18:05:59.120581 dv-cinder-852009-8-iscsi devstack@n-api.service[120741]: [pid: 120741|app: 0|req: 229/466] 10.222.0.43 () {64 vars in 1317 bytes} [Tue Sep 13 18:05:59 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 37 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 13 18:05:59.236008 dv-cinder-852009-8-iscsi devstack@n-api.service[120740]: DEBUG nova.policy [None req-c8776e02-1b13-4a16-a7ce-88933bb01e99 tempest-AttachVolumeShelveTestJSON-385853788 tempest-AttachVolumeShelveTestJSON-385853788-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e68ecd9b3ca643539b109f75bb242d6f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '75e14fd88bfb4cd896fa7b070a0fac47', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120740) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 18:05:59.244844 dv-cinder-852009-8-iscsi devstack@n-api.service[120740]: DEBUG nova.policy [None req-c8776e02-1b13-4a16-a7ce-88933bb01e99 tempest-AttachVolumeShelveTestJSON-385853788 tempest-AttachVolumeShelveTestJSON-385853788-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'e68ecd9b3ca643539b109f75bb242d6f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '75e14fd88bfb4cd896fa7b070a0fac47', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120740) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 18:05:59.246261 dv-cinder-852009-8-iscsi devstack@n-api.service[120740]: DEBUG nova.policy [None req-c8776e02-1b13-4a16-a7ce-88933bb01e99 tempest-AttachVolumeShelveTestJSON-385853788 tempest-AttachVolumeShelveTestJSON-385853788-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'e68ecd9b3ca643539b109f75bb242d6f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '75e14fd88bfb4cd896fa7b070a0fac47', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120740) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 18:05:59.247420 dv-cinder-852009-8-iscsi devstack@n-api.service[120740]: INFO nova.api.openstack.requestlog [None req-c8776e02-1b13-4a16-a7ce-88933bb01e99 tempest-AttachVolumeShelveTestJSON-385853788 tempest-AttachVolumeShelveTestJSON-385853788-project] 10.222.0.43 "GET /compute/v2.1/servers/8cecf08e-bea8-4cef-9439-0eaa242bfed1" status: 200 len: 1406 microversion: 2.20 time: 0.168302 Sep 13 18:05:59.247941 dv-cinder-852009-8-iscsi devstack@n-api.service[120740]: [pid: 120740|app: 0|req: 238/467] 10.222.0.43 () {60 vars in 1277 bytes} [Tue Sep 13 18:05:59 2022] GET /compute/v2.1/servers/8cecf08e-bea8-4cef-9439-0eaa242bfed1 => generated 1406 bytes in 169 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 13 18:06:00.275944 dv-cinder-852009-8-iscsi devstack@n-api.service[120741]: DEBUG nova.api.openstack.wsgi [None req-5e89eda2-d24d-48a1-a4e1-5ea34e65c19f tempest-AttachVolumeShelveTestJSON-385853788 tempest-AttachVolumeShelveTestJSON-385853788-project] Calling method '>' {{(pid=120741) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 18:06:00.276671 dv-cinder-852009-8-iscsi devstack@n-api.service[120741]: DEBUG nova.compute.api [None req-5e89eda2-d24d-48a1-a4e1-5ea34e65c19f tempest-AttachVolumeShelveTestJSON-385853788 tempest-AttachVolumeShelveTestJSON-385853788-project] [instance: 8cecf08e-bea8-4cef-9439-0eaa242bfed1] Fetching instance by UUID {{(pid=120741) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 18:06:00.283970 dv-cinder-852009-8-iscsi devstack@n-api.service[120741]: DEBUG oslo_concurrency.lockutils [None req-5e89eda2-d24d-48a1-a4e1-5ea34e65c19f tempest-AttachVolumeShelveTestJSON-385853788 tempest-AttachVolumeShelveTestJSON-385853788-project] Acquiring lock "1daf4f4c-0e4a-4779-b53a-78c48397ea2f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120741) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 18:06:00.284515 dv-cinder-852009-8-iscsi devstack@n-api.service[120741]: DEBUG oslo_concurrency.lockutils [None req-5e89eda2-d24d-48a1-a4e1-5ea34e65c19f tempest-AttachVolumeShelveTestJSON-385853788 tempest-AttachVolumeShelveTestJSON-385853788-project] Lock "1daf4f4c-0e4a-4779-b53a-78c48397ea2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120741) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 18:06:00.284911 dv-cinder-852009-8-iscsi devstack@n-api.service[120741]: DEBUG oslo_concurrency.lockutils [None req-5e89eda2-d24d-48a1-a4e1-5ea34e65c19f tempest-AttachVolumeShelveTestJSON-385853788 tempest-AttachVolumeShelveTestJSON-385853788-project] Lock "1daf4f4c-0e4a-4779-b53a-78c48397ea2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120741) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 18:06:00.285606 dv-cinder-852009-8-iscsi devstack@n-api.service[120741]: DEBUG oslo_concurrency.lockutils [None req-5e89eda2-d24d-48a1-a4e1-5ea34e65c19f tempest-AttachVolumeShelveTestJSON-385853788 tempest-AttachVolumeShelveTestJSON-385853788-project] Acquiring lock "1daf4f4c-0e4a-4779-b53a-78c48397ea2f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120741) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 18:06:00.286039 dv-cinder-852009-8-iscsi devstack@n-api.service[120741]: DEBUG oslo_concurrency.lockutils [None req-5e89eda2-d24d-48a1-a4e1-5ea34e65c19f tempest-AttachVolumeShelveTestJSON-385853788 tempest-AttachVolumeShelveTestJSON-385853788-project] Lock "1daf4f4c-0e4a-4779-b53a-78c48397ea2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120741) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 18:06:00.286456 dv-cinder-852009-8-iscsi devstack@n-api.service[120741]: DEBUG oslo_concurrency.lockutils [None req-5e89eda2-d24d-48a1-a4e1-5ea34e65c19f tempest-AttachVolumeShelveTestJSON-385853788 tempest-AttachVolumeShelveTestJSON-385853788-project] Lock "1daf4f4c-0e4a-4779-b53a-78c48397ea2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120741) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 18:06:00.306078 dv-cinder-852009-8-iscsi devstack@n-api.service[120741]: DEBUG dbcounter [-] [120741] Writing DB stats nova_cell1:SELECT=100 {{(pid=120741) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 18:06:00.430009 dv-cinder-852009-8-iscsi devstack@n-api.service[120741]: DEBUG nova.policy [None req-5e89eda2-d24d-48a1-a4e1-5ea34e65c19f tempest-AttachVolumeShelveTestJSON-385853788 tempest-AttachVolumeShelveTestJSON-385853788-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e68ecd9b3ca643539b109f75bb242d6f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '75e14fd88bfb4cd896fa7b070a0fac47', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120741) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 18:06:00.438601 dv-cinder-852009-8-iscsi devstack@n-api.service[120741]: DEBUG nova.policy [None req-5e89eda2-d24d-48a1-a4e1-5ea34e65c19f tempest-AttachVolumeShelveTestJSON-385853788 tempest-AttachVolumeShelveTestJSON-385853788-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'e68ecd9b3ca643539b109f75bb242d6f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '75e14fd88bfb4cd896fa7b070a0fac47', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120741) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 18:06:00.440048 dv-cinder-852009-8-iscsi devstack@n-api.service[120741]: DEBUG nova.policy [None req-5e89eda2-d24d-48a1-a4e1-5ea34e65c19f tempest-AttachVolumeShelveTestJSON-385853788 tempest-AttachVolumeShelveTestJSON-385853788-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'e68ecd9b3ca643539b109f75bb242d6f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '75e14fd88bfb4cd896fa7b070a0fac47', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120741) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 18:06:00.441185 dv-cinder-852009-8-iscsi devstack@n-api.service[120741]: INFO nova.api.openstack.requestlog [None req-5e89eda2-d24d-48a1-a4e1-5ea34e65c19f tempest-AttachVolumeShelveTestJSON-385853788 tempest-AttachVolumeShelveTestJSON-385853788-project] 10.222.0.43 "GET /compute/v2.1/servers/8cecf08e-bea8-4cef-9439-0eaa242bfed1" status: 200 len: 1406 microversion: 2.20 time: 0.171236 Sep 13 18:06:00.441761 dv-cinder-852009-8-iscsi devstack@n-api.service[120741]: [pid: 120741|app: 0|req: 230/468] 10.222.0.43 () {60 vars in 1277 bytes} [Tue Sep 13 18:06:00 2022] GET /compute/v2.1/servers/8cecf08e-bea8-4cef-9439-0eaa242bfed1 => generated 1406 bytes in 173 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 13 18:06:01.470102 dv-cinder-852009-8-iscsi devstack@n-api.service[120740]: DEBUG nova.api.openstack.wsgi [None req-f27c472c-064c-499a-a8ac-bf40abba30ab tempest-AttachVolumeShelveTestJSON-385853788 tempest-AttachVolumeShelveTestJSON-385853788-project] Calling method '>' {{(pid=120740) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 18:06:01.470985 dv-cinder-852009-8-iscsi devstack@n-api.service[120740]: DEBUG nova.compute.api [None req-f27c472c-064c-499a-a8ac-bf40abba30ab tempest-AttachVolumeShelveTestJSON-385853788 tempest-AttachVolumeShelveTestJSON-385853788-project] [instance: 8cecf08e-bea8-4cef-9439-0eaa242bfed1] Fetching instance by UUID {{(pid=120740) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 18:06:01.482077 dv-cinder-852009-8-iscsi devstack@n-api.service[120740]: DEBUG oslo_concurrency.lockutils [None req-f27c472c-064c-499a-a8ac-bf40abba30ab tempest-AttachVolumeShelveTestJSON-385853788 tempest-AttachVolumeShelveTestJSON-385853788-project] Acquiring lock "1daf4f4c-0e4a-4779-b53a-78c48397ea2f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120740) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 18:06:01.482851 dv-cinder-852009-8-iscsi devstack@n-api.service[120740]: DEBUG oslo_concurrency.lockutils [None req-f27c472c-064c-499a-a8ac-bf40abba30ab tempest-AttachVolumeShelveTestJSON-385853788 tempest-AttachVolumeShelveTestJSON-385853788-project] Lock "1daf4f4c-0e4a-4779-b53a-78c48397ea2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120740) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 18:06:01.483285 dv-cinder-852009-8-iscsi devstack@n-api.service[120740]: DEBUG oslo_concurrency.lockutils [None req-f27c472c-064c-499a-a8ac-bf40abba30ab tempest-AttachVolumeShelveTestJSON-385853788 tempest-AttachVolumeShelveTestJSON-385853788-project] Lock "1daf4f4c-0e4a-4779-b53a-78c48397ea2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120740) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 18:06:01.483979 dv-cinder-852009-8-iscsi devstack@n-api.service[120740]: DEBUG oslo_concurrency.lockutils [None req-f27c472c-064c-499a-a8ac-bf40abba30ab tempest-AttachVolumeShelveTestJSON-385853788 tempest-AttachVolumeShelveTestJSON-385853788-project] Acquiring lock "1daf4f4c-0e4a-4779-b53a-78c48397ea2f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120740) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 18:06:01.484457 dv-cinder-852009-8-iscsi devstack@n-api.service[120740]: DEBUG oslo_concurrency.lockutils [None req-f27c472c-064c-499a-a8ac-bf40abba30ab tempest-AttachVolumeShelveTestJSON-385853788 tempest-AttachVolumeShelveTestJSON-385853788-project] Lock "1daf4f4c-0e4a-4779-b53a-78c48397ea2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120740) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 18:06:01.484879 dv-cinder-852009-8-iscsi devstack@n-api.service[120740]: DEBUG oslo_concurrency.lockutils [None req-f27c472c-064c-499a-a8ac-bf40abba30ab tempest-AttachVolumeShelveTestJSON-385853788 tempest-AttachVolumeShelveTestJSON-385853788-project] Lock "1daf4f4c-0e4a-4779-b53a-78c48397ea2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120740) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 18:06:01.634057 dv-cinder-852009-8-iscsi devstack@n-api.service[120740]: DEBUG nova.policy [None req-f27c472c-064c-499a-a8ac-bf40abba30ab tempest-AttachVolumeShelveTestJSON-385853788 tempest-AttachVolumeShelveTestJSON-385853788-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e68ecd9b3ca643539b109f75bb242d6f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '75e14fd88bfb4cd896fa7b070a0fac47', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120740) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 18:06:01.642319 dv-cinder-852009-8-iscsi devstack@n-api.service[120740]: DEBUG nova.policy [None req-f27c472c-064c-499a-a8ac-bf40abba30ab tempest-AttachVolumeShelveTestJSON-385853788 tempest-AttachVolumeShelveTestJSON-385853788-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'e68ecd9b3ca643539b109f75bb242d6f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '75e14fd88bfb4cd896fa7b070a0fac47', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120740) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 18:06:01.643761 dv-cinder-852009-8-iscsi devstack@n-api.service[120740]: DEBUG nova.policy [None req-f27c472c-064c-499a-a8ac-bf40abba30ab tempest-AttachVolumeShelveTestJSON-385853788 tempest-AttachVolumeShelveTestJSON-385853788-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'e68ecd9b3ca643539b109f75bb242d6f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '75e14fd88bfb4cd896fa7b070a0fac47', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120740) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 18:06:01.644944 dv-cinder-852009-8-iscsi devstack@n-api.service[120740]: INFO nova.api.openstack.requestlog [None req-f27c472c-064c-499a-a8ac-bf40abba30ab tempest-AttachVolumeShelveTestJSON-385853788 tempest-AttachVolumeShelveTestJSON-385853788-project] 10.222.0.43 "GET /compute/v2.1/servers/8cecf08e-bea8-4cef-9439-0eaa242bfed1" status: 200 len: 1598 microversion: 2.20 time: 0.181676 Sep 13 18:06:01.645505 dv-cinder-852009-8-iscsi devstack@n-api.service[120740]: [pid: 120740|app: 0|req: 239/469] 10.222.0.43 () {60 vars in 1277 bytes} [Tue Sep 13 18:06:01 2022] GET /compute/v2.1/servers/8cecf08e-bea8-4cef-9439-0eaa242bfed1 => generated 1598 bytes in 183 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 13 18:06:01.673060 dv-cinder-852009-8-iscsi devstack@n-api.service[120741]: DEBUG nova.api.openstack.wsgi [None req-6e1697bd-b5e8-4cd3-9704-63231e7608b8 tempest-AttachVolumeShelveTestJSON-385853788 tempest-AttachVolumeShelveTestJSON-385853788-project] Calling method '>' {{(pid=120741) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 18:06:01.673588 dv-cinder-852009-8-iscsi devstack@n-api.service[120741]: DEBUG nova.compute.api [None req-6e1697bd-b5e8-4cd3-9704-63231e7608b8 tempest-AttachVolumeShelveTestJSON-385853788 tempest-AttachVolumeShelveTestJSON-385853788-project] [instance: 8cecf08e-bea8-4cef-9439-0eaa242bfed1] Fetching instance by UUID {{(pid=120741) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 18:06:01.681342 dv-cinder-852009-8-iscsi devstack@n-api.service[120741]: DEBUG oslo_concurrency.lockutils [None req-6e1697bd-b5e8-4cd3-9704-63231e7608b8 tempest-AttachVolumeShelveTestJSON-385853788 tempest-AttachVolumeShelveTestJSON-385853788-project] Acquiring lock "1daf4f4c-0e4a-4779-b53a-78c48397ea2f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120741) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 18:06:01.681854 dv-cinder-852009-8-iscsi devstack@n-api.service[120741]: DEBUG oslo_concurrency.lockutils [None req-6e1697bd-b5e8-4cd3-9704-63231e7608b8 tempest-AttachVolumeShelveTestJSON-385853788 tempest-AttachVolumeShelveTestJSON-385853788-project] Lock "1daf4f4c-0e4a-4779-b53a-78c48397ea2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120741) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 18:06:01.682287 dv-cinder-852009-8-iscsi devstack@n-api.service[120741]: DEBUG oslo_concurrency.lockutils [None req-6e1697bd-b5e8-4cd3-9704-63231e7608b8 tempest-AttachVolumeShelveTestJSON-385853788 tempest-AttachVolumeShelveTestJSON-385853788-project] Lock "1daf4f4c-0e4a-4779-b53a-78c48397ea2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120741) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 18:06:01.682981 dv-cinder-852009-8-iscsi devstack@n-api.service[120741]: DEBUG oslo_concurrency.lockutils [None req-6e1697bd-b5e8-4cd3-9704-63231e7608b8 tempest-AttachVolumeShelveTestJSON-385853788 tempest-AttachVolumeShelveTestJSON-385853788-project] Acquiring lock "1daf4f4c-0e4a-4779-b53a-78c48397ea2f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120741) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 18:06:01.683429 dv-cinder-852009-8-iscsi devstack@n-api.service[120741]: DEBUG oslo_concurrency.lockutils [None req-6e1697bd-b5e8-4cd3-9704-63231e7608b8 tempest-AttachVolumeShelveTestJSON-385853788 tempest-AttachVolumeShelveTestJSON-385853788-project] Lock "1daf4f4c-0e4a-4779-b53a-78c48397ea2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120741) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 18:06:01.683847 dv-cinder-852009-8-iscsi devstack@n-api.service[120741]: DEBUG oslo_concurrency.lockutils [None req-6e1697bd-b5e8-4cd3-9704-63231e7608b8 tempest-AttachVolumeShelveTestJSON-385853788 tempest-AttachVolumeShelveTestJSON-385853788-project] Lock "1daf4f4c-0e4a-4779-b53a-78c48397ea2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120741) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 18:06:01.762400 dv-cinder-852009-8-iscsi devstack@n-api.service[120741]: INFO nova.api.openstack.requestlog [None req-6e1697bd-b5e8-4cd3-9704-63231e7608b8 tempest-AttachVolumeShelveTestJSON-385853788 tempest-AttachVolumeShelveTestJSON-385853788-project] 10.222.0.43 "GET /compute/v2.1/servers/8cecf08e-bea8-4cef-9439-0eaa242bfed1/os-interface" status: 200 len: 284 microversion: 2.20 time: 0.095772 Sep 13 18:06:01.763010 dv-cinder-852009-8-iscsi devstack@n-api.service[120741]: [pid: 120741|app: 0|req: 231/470] 10.222.0.43 () {60 vars in 1316 bytes} [Tue Sep 13 18:06:01 2022] GET /compute/v2.1/servers/8cecf08e-bea8-4cef-9439-0eaa242bfed1/os-interface => generated 284 bytes in 97 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Sep 13 18:06:02.720972 dv-cinder-852009-8-iscsi devstack@n-api.service[120740]: DEBUG nova.api.openstack.wsgi [req-a471c87e-8f0c-47ad-80f9-9cdf911ab226 req-f67e296e-464a-4676-9cb1-03848616ef84 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "8cecf08e-bea8-4cef-9439-0eaa242bfed1", "tag": "cf75920d-98e9-4700-bdad-ac46b7b3f022"}]} {{(pid=120740) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 13 18:06:02.731090 dv-cinder-852009-8-iscsi devstack@n-api.service[120740]: DEBUG oslo_concurrency.lockutils [req-a471c87e-8f0c-47ad-80f9-9cdf911ab226 req-f67e296e-464a-4676-9cb1-03848616ef84 service nova] Acquiring lock "1daf4f4c-0e4a-4779-b53a-78c48397ea2f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120740) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 18:06:02.731578 dv-cinder-852009-8-iscsi devstack@n-api.service[120740]: DEBUG oslo_concurrency.lockutils [req-a471c87e-8f0c-47ad-80f9-9cdf911ab226 req-f67e296e-464a-4676-9cb1-03848616ef84 service nova] Lock "1daf4f4c-0e4a-4779-b53a-78c48397ea2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120740) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 18:06:02.732005 dv-cinder-852009-8-iscsi devstack@n-api.service[120740]: DEBUG oslo_concurrency.lockutils [req-a471c87e-8f0c-47ad-80f9-9cdf911ab226 req-f67e296e-464a-4676-9cb1-03848616ef84 service nova] Lock "1daf4f4c-0e4a-4779-b53a-78c48397ea2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120740) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 18:06:02.743280 dv-cinder-852009-8-iscsi devstack@n-api.service[120740]: INFO nova.api.openstack.compute.server_external_events [req-a471c87e-8f0c-47ad-80f9-9cdf911ab226 req-f67e296e-464a-4676-9cb1-03848616ef84 service nova] Creating event network-changed:cf75920d-98e9-4700-bdad-ac46b7b3f022 for instance 8cecf08e-bea8-4cef-9439-0eaa242bfed1 on hv-cinder-85200 Sep 13 18:06:02.748500 dv-cinder-852009-8-iscsi devstack@n-api.service[120740]: INFO nova.api.openstack.requestlog [req-a471c87e-8f0c-47ad-80f9-9cdf911ab226 req-f67e296e-464a-4676-9cb1-03848616ef84 service nova] 10.222.0.43 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.030874 Sep 13 18:06:02.749129 dv-cinder-852009-8-iscsi devstack@n-api.service[120740]: [pid: 120740|app: 0|req: 240/471] 10.222.0.43 () {64 vars in 1317 bytes} [Tue Sep 13 18:06:02 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 33 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 13 18:06:03.120212 dv-cinder-852009-8-iscsi devstack@n-api.service[120741]: DEBUG dbcounter [-] [120741] Writing DB stats nova_cell0:SELECT=4 {{(pid=120741) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 18:06:03.125226 dv-cinder-852009-8-iscsi devstack@n-api.service[120741]: DEBUG nova.api.openstack.wsgi [None req-0e8cabb9-196b-4c24-946d-b45842b7f634 tempest-TestMinimumBasicScenario-820002800 tempest-TestMinimumBasicScenario-820002800-project] Calling method '>' {{(pid=120741) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 18:06:03.125840 dv-cinder-852009-8-iscsi devstack@n-api.service[120741]: DEBUG nova.compute.api [None req-0e8cabb9-196b-4c24-946d-b45842b7f634 tempest-TestMinimumBasicScenario-820002800 tempest-TestMinimumBasicScenario-820002800-project] [instance: f8247a13-94cd-45b2-acc8-8717e1260f37] Fetching instance by UUID {{(pid=120741) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 18:06:03.132626 dv-cinder-852009-8-iscsi devstack@n-api.service[120741]: DEBUG oslo_concurrency.lockutils [None req-0e8cabb9-196b-4c24-946d-b45842b7f634 tempest-TestMinimumBasicScenario-820002800 tempest-TestMinimumBasicScenario-820002800-project] Acquiring lock "1daf4f4c-0e4a-4779-b53a-78c48397ea2f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120741) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 18:06:03.133107 dv-cinder-852009-8-iscsi devstack@n-api.service[120741]: DEBUG oslo_concurrency.lockutils [None req-0e8cabb9-196b-4c24-946d-b45842b7f634 tempest-TestMinimumBasicScenario-820002800 tempest-TestMinimumBasicScenario-820002800-project] Lock "1daf4f4c-0e4a-4779-b53a-78c48397ea2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120741) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 18:06:03.133538 dv-cinder-852009-8-iscsi devstack@n-api.service[120741]: DEBUG oslo_concurrency.lockutils [None req-0e8cabb9-196b-4c24-946d-b45842b7f634 tempest-TestMinimumBasicScenario-820002800 tempest-TestMinimumBasicScenario-820002800-project] Lock "1daf4f4c-0e4a-4779-b53a-78c48397ea2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120741) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 18:06:03.134227 dv-cinder-852009-8-iscsi devstack@n-api.service[120741]: DEBUG oslo_concurrency.lockutils [None req-0e8cabb9-196b-4c24-946d-b45842b7f634 tempest-TestMinimumBasicScenario-820002800 tempest-TestMinimumBasicScenario-820002800-project] Acquiring lock "1daf4f4c-0e4a-4779-b53a-78c48397ea2f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120741) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 18:06:03.134678 dv-cinder-852009-8-iscsi devstack@n-api.service[120741]: DEBUG oslo_concurrency.lockutils [None req-0e8cabb9-196b-4c24-946d-b45842b7f634 tempest-TestMinimumBasicScenario-820002800 tempest-TestMinimumBasicScenario-820002800-project] Lock "1daf4f4c-0e4a-4779-b53a-78c48397ea2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120741) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 18:06:03.135095 dv-cinder-852009-8-iscsi devstack@n-api.service[120741]: DEBUG oslo_concurrency.lockutils [None req-0e8cabb9-196b-4c24-946d-b45842b7f634 tempest-TestMinimumBasicScenario-820002800 tempest-TestMinimumBasicScenario-820002800-project] Lock "1daf4f4c-0e4a-4779-b53a-78c48397ea2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120741) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 18:06:03.267577 dv-cinder-852009-8-iscsi devstack@n-api.service[120741]: DEBUG nova.policy [None req-0e8cabb9-196b-4c24-946d-b45842b7f634 tempest-TestMinimumBasicScenario-820002800 tempest-TestMinimumBasicScenario-820002800-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7880064ff0aa448d9c367c89eba145ff', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2f6832936c824066a4370cc45c5b0282', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120741) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 18:06:03.275888 dv-cinder-852009-8-iscsi devstack@n-api.service[120741]: INFO nova.api.openstack.requestlog [None req-0e8cabb9-196b-4c24-946d-b45842b7f634 tempest-TestMinimumBasicScenario-820002800 tempest-TestMinimumBasicScenario-820002800-project] 10.222.0.43 "GET /compute/v2.1/servers/f8247a13-94cd-45b2-acc8-8717e1260f37" status: 200 len: 1595 microversion: 2.1 time: 0.156413 Sep 13 18:06:03.276488 dv-cinder-852009-8-iscsi devstack@n-api.service[120741]: [pid: 120741|app: 0|req: 232/472] 10.222.0.43 () {58 vars in 1236 bytes} [Tue Sep 13 18:06:03 2022] GET /compute/v2.1/servers/f8247a13-94cd-45b2-acc8-8717e1260f37 => generated 1595 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 13 18:06:05.209211 dv-cinder-852009-8-iscsi devstack@n-api.service[120740]: DEBUG nova.api.openstack.wsgi [req-3de04249-0529-4788-88d9-17f5e8f92dd1 req-79b0683d-c861-4a97-bb34-dc806b6f9262 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "f8247a13-94cd-45b2-acc8-8717e1260f37", "tag": "9f86cf72-e29e-4f23-8c9d-afea192c2916"}]} {{(pid=120740) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 13 18:06:05.220451 dv-cinder-852009-8-iscsi devstack@n-api.service[120740]: DEBUG oslo_concurrency.lockutils [req-3de04249-0529-4788-88d9-17f5e8f92dd1 req-79b0683d-c861-4a97-bb34-dc806b6f9262 service nova] Acquiring lock "1daf4f4c-0e4a-4779-b53a-78c48397ea2f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120740) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 18:06:05.221262 dv-cinder-852009-8-iscsi devstack@n-api.service[120740]: DEBUG oslo_concurrency.lockutils [req-3de04249-0529-4788-88d9-17f5e8f92dd1 req-79b0683d-c861-4a97-bb34-dc806b6f9262 service nova] Lock "1daf4f4c-0e4a-4779-b53a-78c48397ea2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120740) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 18:06:05.221831 dv-cinder-852009-8-iscsi devstack@n-api.service[120740]: DEBUG oslo_concurrency.lockutils [req-3de04249-0529-4788-88d9-17f5e8f92dd1 req-79b0683d-c861-4a97-bb34-dc806b6f9262 service nova] Lock "1daf4f4c-0e4a-4779-b53a-78c48397ea2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120740) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 18:06:05.234776 dv-cinder-852009-8-iscsi devstack@n-api.service[120740]: INFO nova.api.openstack.compute.server_external_events [req-3de04249-0529-4788-88d9-17f5e8f92dd1 req-79b0683d-c861-4a97-bb34-dc806b6f9262 service nova] Creating event network-changed:9f86cf72-e29e-4f23-8c9d-afea192c2916 for instance f8247a13-94cd-45b2-acc8-8717e1260f37 on hv-cinder-85200 Sep 13 18:06:05.239761 dv-cinder-852009-8-iscsi devstack@n-api.service[120740]: INFO nova.api.openstack.requestlog [req-3de04249-0529-4788-88d9-17f5e8f92dd1 req-79b0683d-c861-4a97-bb34-dc806b6f9262 service nova] 10.222.0.43 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.035514 Sep 13 18:06:05.240820 dv-cinder-852009-8-iscsi devstack@n-api.service[120740]: [pid: 120740|app: 0|req: 241/473] 10.222.0.43 () {64 vars in 1317 bytes} [Tue Sep 13 18:06:05 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 37 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 13 18:06:06.263981 dv-cinder-852009-8-iscsi devstack@n-api.service[120741]: DEBUG nova.api.openstack.wsgi [None req-a1dd6368-b637-4d95-b310-6b33febf263f tempest-TestMinimumBasicScenario-820002800 tempest-TestMinimumBasicScenario-820002800-project] Action: 'action', calling method: >, body: {"addSecurityGroup": {"name": "tempest-secgroup-smoke-1096237766"}} {{(pid=120741) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 13 18:06:06.264609 dv-cinder-852009-8-iscsi devstack@n-api.service[120741]: DEBUG nova.compute.api [None req-a1dd6368-b637-4d95-b310-6b33febf263f tempest-TestMinimumBasicScenario-820002800 tempest-TestMinimumBasicScenario-820002800-project] [instance: f8247a13-94cd-45b2-acc8-8717e1260f37] Fetching instance by UUID {{(pid=120741) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 18:06:06.271193 dv-cinder-852009-8-iscsi devstack@n-api.service[120741]: DEBUG oslo_concurrency.lockutils [None req-a1dd6368-b637-4d95-b310-6b33febf263f tempest-TestMinimumBasicScenario-820002800 tempest-TestMinimumBasicScenario-820002800-project] Acquiring lock "1daf4f4c-0e4a-4779-b53a-78c48397ea2f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120741) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 18:06:06.271669 dv-cinder-852009-8-iscsi devstack@n-api.service[120741]: DEBUG oslo_concurrency.lockutils [None req-a1dd6368-b637-4d95-b310-6b33febf263f tempest-TestMinimumBasicScenario-820002800 tempest-TestMinimumBasicScenario-820002800-project] Lock "1daf4f4c-0e4a-4779-b53a-78c48397ea2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120741) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 18:06:06.272093 dv-cinder-852009-8-iscsi devstack@n-api.service[120741]: DEBUG oslo_concurrency.lockutils [None req-a1dd6368-b637-4d95-b310-6b33febf263f tempest-TestMinimumBasicScenario-820002800 tempest-TestMinimumBasicScenario-820002800-project] Lock "1daf4f4c-0e4a-4779-b53a-78c48397ea2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120741) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 18:06:06.272809 dv-cinder-852009-8-iscsi devstack@n-api.service[120741]: DEBUG oslo_concurrency.lockutils [None req-a1dd6368-b637-4d95-b310-6b33febf263f tempest-TestMinimumBasicScenario-820002800 tempest-TestMinimumBasicScenario-820002800-project] Acquiring lock "1daf4f4c-0e4a-4779-b53a-78c48397ea2f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120741) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 18:06:06.273255 dv-cinder-852009-8-iscsi devstack@n-api.service[120741]: DEBUG oslo_concurrency.lockutils [None req-a1dd6368-b637-4d95-b310-6b33febf263f tempest-TestMinimumBasicScenario-820002800 tempest-TestMinimumBasicScenario-820002800-project] Lock "1daf4f4c-0e4a-4779-b53a-78c48397ea2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120741) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 18:06:06.273670 dv-cinder-852009-8-iscsi devstack@n-api.service[120741]: DEBUG oslo_concurrency.lockutils [None req-a1dd6368-b637-4d95-b310-6b33febf263f tempest-TestMinimumBasicScenario-820002800 tempest-TestMinimumBasicScenario-820002800-project] Lock "1daf4f4c-0e4a-4779-b53a-78c48397ea2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120741) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 18:06:06.409906 dv-cinder-852009-8-iscsi devstack@n-api.service[120741]: INFO nova.network.security_group_api [None req-a1dd6368-b637-4d95-b310-6b33febf263f tempest-TestMinimumBasicScenario-820002800 tempest-TestMinimumBasicScenario-820002800-project] Adding security group 2de44b30-da7f-4ad5-bd73-1890ce641417 to port 9f86cf72-e29e-4f23-8c9d-afea192c2916 Sep 13 18:06:06.761750 dv-cinder-852009-8-iscsi devstack@n-api.service[120741]: INFO nova.api.openstack.requestlog [None req-a1dd6368-b637-4d95-b310-6b33febf263f tempest-TestMinimumBasicScenario-820002800 tempest-TestMinimumBasicScenario-820002800-project] 10.222.0.43 "POST /compute/v2.1/servers/f8247a13-94cd-45b2-acc8-8717e1260f37/action" status: 202 len: 0 microversion: 2.1 time: 0.501656 Sep 13 18:06:06.762436 dv-cinder-852009-8-iscsi devstack@n-api.service[120741]: [pid: 120741|app: 0|req: 233/474] 10.222.0.43 () {60 vars in 1278 bytes} [Tue Sep 13 18:06:06 2022] POST /compute/v2.1/servers/f8247a13-94cd-45b2-acc8-8717e1260f37/action => generated 0 bytes in 503 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Sep 13 18:06:06.772560 dv-cinder-852009-8-iscsi devstack@n-api.service[120740]: DEBUG nova.api.openstack.wsgi [None req-ecb6c6b3-e0da-4f3f-972f-bc3184a18bd4 tempest-TestMinimumBasicScenario-820002800 tempest-TestMinimumBasicScenario-820002800-project] Calling method '>' {{(pid=120740) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 18:06:06.773262 dv-cinder-852009-8-iscsi devstack@n-api.service[120740]: DEBUG nova.compute.api [None req-ecb6c6b3-e0da-4f3f-972f-bc3184a18bd4 tempest-TestMinimumBasicScenario-820002800 tempest-TestMinimumBasicScenario-820002800-project] [instance: f8247a13-94cd-45b2-acc8-8717e1260f37] Fetching instance by UUID {{(pid=120740) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 18:06:06.779801 dv-cinder-852009-8-iscsi devstack@n-api.service[120740]: DEBUG oslo_concurrency.lockutils [None req-ecb6c6b3-e0da-4f3f-972f-bc3184a18bd4 tempest-TestMinimumBasicScenario-820002800 tempest-TestMinimumBasicScenario-820002800-project] Acquiring lock "1daf4f4c-0e4a-4779-b53a-78c48397ea2f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120740) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 18:06:06.780371 dv-cinder-852009-8-iscsi devstack@n-api.service[120740]: DEBUG oslo_concurrency.lockutils [None req-ecb6c6b3-e0da-4f3f-972f-bc3184a18bd4 tempest-TestMinimumBasicScenario-820002800 tempest-TestMinimumBasicScenario-820002800-project] Lock "1daf4f4c-0e4a-4779-b53a-78c48397ea2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120740) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 18:06:06.780959 dv-cinder-852009-8-iscsi devstack@n-api.service[120740]: DEBUG oslo_concurrency.lockutils [None req-ecb6c6b3-e0da-4f3f-972f-bc3184a18bd4 tempest-TestMinimumBasicScenario-820002800 tempest-TestMinimumBasicScenario-820002800-project] Lock "1daf4f4c-0e4a-4779-b53a-78c48397ea2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120740) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 18:06:06.781715 dv-cinder-852009-8-iscsi devstack@n-api.service[120740]: DEBUG oslo_concurrency.lockutils [None req-ecb6c6b3-e0da-4f3f-972f-bc3184a18bd4 tempest-TestMinimumBasicScenario-820002800 tempest-TestMinimumBasicScenario-820002800-project] Acquiring lock "1daf4f4c-0e4a-4779-b53a-78c48397ea2f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120740) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 18:06:06.782179 dv-cinder-852009-8-iscsi devstack@n-api.service[120740]: DEBUG oslo_concurrency.lockutils [None req-ecb6c6b3-e0da-4f3f-972f-bc3184a18bd4 tempest-TestMinimumBasicScenario-820002800 tempest-TestMinimumBasicScenario-820002800-project] Lock "1daf4f4c-0e4a-4779-b53a-78c48397ea2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120740) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 18:06:06.782599 dv-cinder-852009-8-iscsi devstack@n-api.service[120740]: DEBUG oslo_concurrency.lockutils [None req-ecb6c6b3-e0da-4f3f-972f-bc3184a18bd4 tempest-TestMinimumBasicScenario-820002800 tempest-TestMinimumBasicScenario-820002800-project] Lock "1daf4f4c-0e4a-4779-b53a-78c48397ea2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120740) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 18:06:06.940971 dv-cinder-852009-8-iscsi devstack@n-api.service[120740]: DEBUG nova.policy [None req-ecb6c6b3-e0da-4f3f-972f-bc3184a18bd4 tempest-TestMinimumBasicScenario-820002800 tempest-TestMinimumBasicScenario-820002800-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7880064ff0aa448d9c367c89eba145ff', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2f6832936c824066a4370cc45c5b0282', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120740) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 18:06:06.949882 dv-cinder-852009-8-iscsi devstack@n-api.service[120740]: INFO nova.api.openstack.requestlog [None req-ecb6c6b3-e0da-4f3f-972f-bc3184a18bd4 tempest-TestMinimumBasicScenario-820002800 tempest-TestMinimumBasicScenario-820002800-project] 10.222.0.43 "GET /compute/v2.1/servers/f8247a13-94cd-45b2-acc8-8717e1260f37" status: 200 len: 1761 microversion: 2.1 time: 0.182755 Sep 13 18:06:06.950554 dv-cinder-852009-8-iscsi devstack@n-api.service[120740]: [pid: 120740|app: 0|req: 242/475] 10.222.0.43 () {58 vars in 1236 bytes} [Tue Sep 13 18:06:06 2022] GET /compute/v2.1/servers/f8247a13-94cd-45b2-acc8-8717e1260f37 => generated 1761 bytes in 184 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 13 18:06:07.256465 dv-cinder-852009-8-iscsi devstack@n-api.service[120741]: DEBUG nova.api.openstack.wsgi [req-21a77139-76bc-4954-8b93-b086c1d7f44c req-3318a9be-9c9f-4ac0-8403-ce8f28bfff5a service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "f8247a13-94cd-45b2-acc8-8717e1260f37", "tag": "9f86cf72-e29e-4f23-8c9d-afea192c2916"}]} {{(pid=120741) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 13 18:06:07.266918 dv-cinder-852009-8-iscsi devstack@n-api.service[120741]: DEBUG oslo_concurrency.lockutils [req-21a77139-76bc-4954-8b93-b086c1d7f44c req-3318a9be-9c9f-4ac0-8403-ce8f28bfff5a service nova] Acquiring lock "1daf4f4c-0e4a-4779-b53a-78c48397ea2f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120741) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 18:06:07.267539 dv-cinder-852009-8-iscsi devstack@n-api.service[120741]: DEBUG oslo_concurrency.lockutils [req-21a77139-76bc-4954-8b93-b086c1d7f44c req-3318a9be-9c9f-4ac0-8403-ce8f28bfff5a service nova] Lock "1daf4f4c-0e4a-4779-b53a-78c48397ea2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120741) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 18:06:07.267680 dv-cinder-852009-8-iscsi devstack@n-api.service[120741]: DEBUG oslo_concurrency.lockutils [req-21a77139-76bc-4954-8b93-b086c1d7f44c req-3318a9be-9c9f-4ac0-8403-ce8f28bfff5a service nova] Lock "1daf4f4c-0e4a-4779-b53a-78c48397ea2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120741) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 18:06:07.280104 dv-cinder-852009-8-iscsi devstack@n-api.service[120741]: INFO nova.api.openstack.compute.server_external_events [req-21a77139-76bc-4954-8b93-b086c1d7f44c req-3318a9be-9c9f-4ac0-8403-ce8f28bfff5a service nova] Creating event network-changed:9f86cf72-e29e-4f23-8c9d-afea192c2916 for instance f8247a13-94cd-45b2-acc8-8717e1260f37 on hv-cinder-85200 Sep 13 18:06:07.286028 dv-cinder-852009-8-iscsi devstack@n-api.service[120741]: INFO nova.api.openstack.requestlog [req-21a77139-76bc-4954-8b93-b086c1d7f44c req-3318a9be-9c9f-4ac0-8403-ce8f28bfff5a service nova] 10.222.0.43 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.033243 Sep 13 18:06:07.286742 dv-cinder-852009-8-iscsi devstack@n-api.service[120741]: [pid: 120741|app: 0|req: 234/476] 10.222.0.43 () {64 vars in 1317 bytes} [Tue Sep 13 18:06:07 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 35 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 13 18:06:13.933595 dv-cinder-852009-8-iscsi devstack@n-api.service[120740]: DEBUG nova.api.openstack.wsgi [None req-5f595121-78d8-44da-a730-34b21b9fbd7a tempest-AttachVolumeTestJSON-555093534 tempest-AttachVolumeTestJSON-555093534-project] Calling method '>' {{(pid=120740) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 18:06:13.935751 dv-cinder-852009-8-iscsi devstack@n-api.service[120740]: DEBUG nova.compute.api [None req-5f595121-78d8-44da-a730-34b21b9fbd7a tempest-AttachVolumeTestJSON-555093534 tempest-AttachVolumeTestJSON-555093534-project] [instance: b958d409-df20-44c6-aa0e-58cb0a482edf] Fetching instance by UUID {{(pid=120740) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 18:06:13.942735 dv-cinder-852009-8-iscsi devstack@n-api.service[120740]: DEBUG oslo_concurrency.lockutils [None req-5f595121-78d8-44da-a730-34b21b9fbd7a tempest-AttachVolumeTestJSON-555093534 tempest-AttachVolumeTestJSON-555093534-project] Acquiring lock "1daf4f4c-0e4a-4779-b53a-78c48397ea2f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120740) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 18:06:13.943219 dv-cinder-852009-8-iscsi devstack@n-api.service[120740]: DEBUG oslo_concurrency.lockutils [None req-5f595121-78d8-44da-a730-34b21b9fbd7a tempest-AttachVolumeTestJSON-555093534 tempest-AttachVolumeTestJSON-555093534-project] Lock "1daf4f4c-0e4a-4779-b53a-78c48397ea2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120740) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 18:06:13.943655 dv-cinder-852009-8-iscsi devstack@n-api.service[120740]: DEBUG oslo_concurrency.lockutils [None req-5f595121-78d8-44da-a730-34b21b9fbd7a tempest-AttachVolumeTestJSON-555093534 tempest-AttachVolumeTestJSON-555093534-project] Lock "1daf4f4c-0e4a-4779-b53a-78c48397ea2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120740) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 18:06:13.944345 dv-cinder-852009-8-iscsi devstack@n-api.service[120740]: DEBUG oslo_concurrency.lockutils [None req-5f595121-78d8-44da-a730-34b21b9fbd7a tempest-AttachVolumeTestJSON-555093534 tempest-AttachVolumeTestJSON-555093534-project] Acquiring lock "1daf4f4c-0e4a-4779-b53a-78c48397ea2f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120740) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 18:06:13.944826 dv-cinder-852009-8-iscsi devstack@n-api.service[120740]: DEBUG oslo_concurrency.lockutils [None req-5f595121-78d8-44da-a730-34b21b9fbd7a tempest-AttachVolumeTestJSON-555093534 tempest-AttachVolumeTestJSON-555093534-project] Lock "1daf4f4c-0e4a-4779-b53a-78c48397ea2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120740) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 18:06:13.945241 dv-cinder-852009-8-iscsi devstack@n-api.service[120740]: DEBUG oslo_concurrency.lockutils [None req-5f595121-78d8-44da-a730-34b21b9fbd7a tempest-AttachVolumeTestJSON-555093534 tempest-AttachVolumeTestJSON-555093534-project] Lock "1daf4f4c-0e4a-4779-b53a-78c48397ea2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120740) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 18:06:13.975498 dv-cinder-852009-8-iscsi devstack@n-api.service[120740]: INFO nova.api.openstack.requestlog [None req-5f595121-78d8-44da-a730-34b21b9fbd7a tempest-AttachVolumeTestJSON-555093534 tempest-AttachVolumeTestJSON-555093534-project] 10.222.0.43 "GET /compute/v2.1/servers/b958d409-df20-44c6-aa0e-58cb0a482edf/os-volume_attachments" status: 200 len: 25 microversion: 2.1 time: 0.045902 Sep 13 18:06:13.976055 dv-cinder-852009-8-iscsi devstack@n-api.service[120740]: [pid: 120740|app: 0|req: 243/477] 10.222.0.43 () {58 vars in 1302 bytes} [Tue Sep 13 18:06:13 2022] GET /compute/v2.1/servers/b958d409-df20-44c6-aa0e-58cb0a482edf/os-volume_attachments => generated 25 bytes in 47 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Sep 13 18:06:14.040157 dv-cinder-852009-8-iscsi devstack@n-api.service[120741]: DEBUG nova.api.openstack.wsgi [None req-dd999c4b-4d15-4d1a-aac7-b61a4b3f943f tempest-AttachVolumeTestJSON-555093534 tempest-AttachVolumeTestJSON-555093534-project] Calling method '>' {{(pid=120741) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 18:06:14.040739 dv-cinder-852009-8-iscsi devstack@n-api.service[120741]: DEBUG nova.compute.api [None req-dd999c4b-4d15-4d1a-aac7-b61a4b3f943f tempest-AttachVolumeTestJSON-555093534 tempest-AttachVolumeTestJSON-555093534-project] [instance: b958d409-df20-44c6-aa0e-58cb0a482edf] Fetching instance by UUID {{(pid=120741) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 18:06:14.042718 dv-cinder-852009-8-iscsi devstack@n-api.service[120741]: DEBUG dbcounter [-] [120741] Writing DB stats nova_api:SELECT=70,nova_api:DELETE=1,nova_api:INSERT=3 {{(pid=120741) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 18:06:14.050271 dv-cinder-852009-8-iscsi devstack@n-api.service[120741]: DEBUG oslo_concurrency.lockutils [None req-dd999c4b-4d15-4d1a-aac7-b61a4b3f943f tempest-AttachVolumeTestJSON-555093534 tempest-AttachVolumeTestJSON-555093534-project] Acquiring lock "1daf4f4c-0e4a-4779-b53a-78c48397ea2f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120741) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 18:06:14.051130 dv-cinder-852009-8-iscsi devstack@n-api.service[120741]: DEBUG oslo_concurrency.lockutils [None req-dd999c4b-4d15-4d1a-aac7-b61a4b3f943f tempest-AttachVolumeTestJSON-555093534 tempest-AttachVolumeTestJSON-555093534-project] Lock "1daf4f4c-0e4a-4779-b53a-78c48397ea2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120741) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 18:06:14.051240 dv-cinder-852009-8-iscsi devstack@n-api.service[120741]: DEBUG oslo_concurrency.lockutils [None req-dd999c4b-4d15-4d1a-aac7-b61a4b3f943f tempest-AttachVolumeTestJSON-555093534 tempest-AttachVolumeTestJSON-555093534-project] Lock "1daf4f4c-0e4a-4779-b53a-78c48397ea2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120741) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 18:06:14.051841 dv-cinder-852009-8-iscsi devstack@n-api.service[120741]: DEBUG oslo_concurrency.lockutils [None req-dd999c4b-4d15-4d1a-aac7-b61a4b3f943f tempest-AttachVolumeTestJSON-555093534 tempest-AttachVolumeTestJSON-555093534-project] Acquiring lock "1daf4f4c-0e4a-4779-b53a-78c48397ea2f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120741) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 18:06:14.052280 dv-cinder-852009-8-iscsi devstack@n-api.service[120741]: DEBUG oslo_concurrency.lockutils [None req-dd999c4b-4d15-4d1a-aac7-b61a4b3f943f tempest-AttachVolumeTestJSON-555093534 tempest-AttachVolumeTestJSON-555093534-project] Lock "1daf4f4c-0e4a-4779-b53a-78c48397ea2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120741) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 18:06:14.052718 dv-cinder-852009-8-iscsi devstack@n-api.service[120741]: DEBUG oslo_concurrency.lockutils [None req-dd999c4b-4d15-4d1a-aac7-b61a4b3f943f tempest-AttachVolumeTestJSON-555093534 tempest-AttachVolumeTestJSON-555093534-project] Lock "1daf4f4c-0e4a-4779-b53a-78c48397ea2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120741) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 18:06:14.078499 dv-cinder-852009-8-iscsi devstack@n-api.service[120741]: DEBUG nova.compute.api [None req-dd999c4b-4d15-4d1a-aac7-b61a4b3f943f tempest-AttachVolumeTestJSON-555093534 tempest-AttachVolumeTestJSON-555093534-project] [instance: b958d409-df20-44c6-aa0e-58cb0a482edf] Going to try to terminate instance {{(pid=120741) delete /opt/stack/nova/nova/compute/api.py:2719}} Sep 13 18:06:14.171712 dv-cinder-852009-8-iscsi devstack@n-api.service[120741]: INFO nova.api.openstack.requestlog [None req-dd999c4b-4d15-4d1a-aac7-b61a4b3f943f tempest-AttachVolumeTestJSON-555093534 tempest-AttachVolumeTestJSON-555093534-project] 10.222.0.43 "DELETE /compute/v2.1/servers/b958d409-df20-44c6-aa0e-58cb0a482edf" status: 204 len: 0 microversion: 2.1 time: 0.135577 Sep 13 18:06:14.172596 dv-cinder-852009-8-iscsi devstack@n-api.service[120741]: [pid: 120741|app: 0|req: 235/478] 10.222.0.43 () {58 vars in 1239 bytes} [Tue Sep 13 18:06:14 2022] DELETE /compute/v2.1/servers/b958d409-df20-44c6-aa0e-58cb0a482edf => generated 0 bytes in 138 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Sep 13 18:06:14.183960 dv-cinder-852009-8-iscsi devstack@n-api.service[120740]: DEBUG nova.api.openstack.wsgi [None req-ddbfbf46-7da0-48f7-9988-315a2ed26692 tempest-AttachVolumeTestJSON-555093534 tempest-AttachVolumeTestJSON-555093534-project] Calling method '>' {{(pid=120740) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 18:06:14.184804 dv-cinder-852009-8-iscsi devstack@n-api.service[120740]: DEBUG nova.compute.api [None req-ddbfbf46-7da0-48f7-9988-315a2ed26692 tempest-AttachVolumeTestJSON-555093534 tempest-AttachVolumeTestJSON-555093534-project] [instance: b958d409-df20-44c6-aa0e-58cb0a482edf] Fetching instance by UUID {{(pid=120740) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 18:06:14.192490 dv-cinder-852009-8-iscsi devstack@n-api.service[120740]: DEBUG oslo_concurrency.lockutils [None req-ddbfbf46-7da0-48f7-9988-315a2ed26692 tempest-AttachVolumeTestJSON-555093534 tempest-AttachVolumeTestJSON-555093534-project] Acquiring lock "1daf4f4c-0e4a-4779-b53a-78c48397ea2f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120740) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 18:06:14.193137 dv-cinder-852009-8-iscsi devstack@n-api.service[120740]: DEBUG oslo_concurrency.lockutils [None req-ddbfbf46-7da0-48f7-9988-315a2ed26692 tempest-AttachVolumeTestJSON-555093534 tempest-AttachVolumeTestJSON-555093534-project] Lock "1daf4f4c-0e4a-4779-b53a-78c48397ea2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120740) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 18:06:14.193560 dv-cinder-852009-8-iscsi devstack@n-api.service[120740]: DEBUG oslo_concurrency.lockutils [None req-ddbfbf46-7da0-48f7-9988-315a2ed26692 tempest-AttachVolumeTestJSON-555093534 tempest-AttachVolumeTestJSON-555093534-project] Lock "1daf4f4c-0e4a-4779-b53a-78c48397ea2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120740) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 18:06:14.194247 dv-cinder-852009-8-iscsi devstack@n-api.service[120740]: DEBUG oslo_concurrency.lockutils [None req-ddbfbf46-7da0-48f7-9988-315a2ed26692 tempest-AttachVolumeTestJSON-555093534 tempest-AttachVolumeTestJSON-555093534-project] Acquiring lock "1daf4f4c-0e4a-4779-b53a-78c48397ea2f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120740) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 18:06:14.194725 dv-cinder-852009-8-iscsi devstack@n-api.service[120740]: DEBUG oslo_concurrency.lockutils [None req-ddbfbf46-7da0-48f7-9988-315a2ed26692 tempest-AttachVolumeTestJSON-555093534 tempest-AttachVolumeTestJSON-555093534-project] Lock "1daf4f4c-0e4a-4779-b53a-78c48397ea2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120740) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 18:06:14.195142 dv-cinder-852009-8-iscsi devstack@n-api.service[120740]: DEBUG oslo_concurrency.lockutils [None req-ddbfbf46-7da0-48f7-9988-315a2ed26692 tempest-AttachVolumeTestJSON-555093534 tempest-AttachVolumeTestJSON-555093534-project] Lock "1daf4f4c-0e4a-4779-b53a-78c48397ea2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120740) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 18:06:14.345097 dv-cinder-852009-8-iscsi devstack@n-api.service[120740]: DEBUG nova.policy [None req-ddbfbf46-7da0-48f7-9988-315a2ed26692 tempest-AttachVolumeTestJSON-555093534 tempest-AttachVolumeTestJSON-555093534-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0625b3113ce044bbac4f6142eaade11c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a279fcbf274c4704a31a2b95061e1469', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120740) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 18:06:14.352946 dv-cinder-852009-8-iscsi devstack@n-api.service[120740]: INFO nova.api.openstack.requestlog [None req-ddbfbf46-7da0-48f7-9988-315a2ed26692 tempest-AttachVolumeTestJSON-555093534 tempest-AttachVolumeTestJSON-555093534-project] 10.222.0.43 "GET /compute/v2.1/servers/b958d409-df20-44c6-aa0e-58cb0a482edf" status: 200 len: 1674 microversion: 2.1 time: 0.175414 Sep 13 18:06:14.353529 dv-cinder-852009-8-iscsi devstack@n-api.service[120740]: [pid: 120740|app: 0|req: 244/479] 10.222.0.43 () {58 vars in 1236 bytes} [Tue Sep 13 18:06:14 2022] GET /compute/v2.1/servers/b958d409-df20-44c6-aa0e-58cb0a482edf => generated 1674 bytes in 177 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 13 18:06:15.379651 dv-cinder-852009-8-iscsi devstack@n-api.service[120741]: DEBUG nova.api.openstack.wsgi [None req-bea76765-88c0-4dac-88cc-0f5199983d48 tempest-AttachVolumeTestJSON-555093534 tempest-AttachVolumeTestJSON-555093534-project] Calling method '>' {{(pid=120741) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 18:06:15.380462 dv-cinder-852009-8-iscsi devstack@n-api.service[120741]: DEBUG nova.compute.api [None req-bea76765-88c0-4dac-88cc-0f5199983d48 tempest-AttachVolumeTestJSON-555093534 tempest-AttachVolumeTestJSON-555093534-project] [instance: b958d409-df20-44c6-aa0e-58cb0a482edf] Fetching instance by UUID {{(pid=120741) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 18:06:15.388374 dv-cinder-852009-8-iscsi devstack@n-api.service[120741]: DEBUG oslo_concurrency.lockutils [None req-bea76765-88c0-4dac-88cc-0f5199983d48 tempest-AttachVolumeTestJSON-555093534 tempest-AttachVolumeTestJSON-555093534-project] Acquiring lock "1daf4f4c-0e4a-4779-b53a-78c48397ea2f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120741) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 18:06:15.388979 dv-cinder-852009-8-iscsi devstack@n-api.service[120741]: DEBUG oslo_concurrency.lockutils [None req-bea76765-88c0-4dac-88cc-0f5199983d48 tempest-AttachVolumeTestJSON-555093534 tempest-AttachVolumeTestJSON-555093534-project] Lock "1daf4f4c-0e4a-4779-b53a-78c48397ea2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120741) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 18:06:15.389477 dv-cinder-852009-8-iscsi devstack@n-api.service[120741]: DEBUG oslo_concurrency.lockutils [None req-bea76765-88c0-4dac-88cc-0f5199983d48 tempest-AttachVolumeTestJSON-555093534 tempest-AttachVolumeTestJSON-555093534-project] Lock "1daf4f4c-0e4a-4779-b53a-78c48397ea2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120741) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 18:06:15.390282 dv-cinder-852009-8-iscsi devstack@n-api.service[120741]: DEBUG oslo_concurrency.lockutils [None req-bea76765-88c0-4dac-88cc-0f5199983d48 tempest-AttachVolumeTestJSON-555093534 tempest-AttachVolumeTestJSON-555093534-project] Acquiring lock "1daf4f4c-0e4a-4779-b53a-78c48397ea2f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120741) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 18:06:15.390781 dv-cinder-852009-8-iscsi devstack@n-api.service[120741]: DEBUG oslo_concurrency.lockutils [None req-bea76765-88c0-4dac-88cc-0f5199983d48 tempest-AttachVolumeTestJSON-555093534 tempest-AttachVolumeTestJSON-555093534-project] Lock "1daf4f4c-0e4a-4779-b53a-78c48397ea2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120741) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 18:06:15.391306 dv-cinder-852009-8-iscsi devstack@n-api.service[120741]: DEBUG oslo_concurrency.lockutils [None req-bea76765-88c0-4dac-88cc-0f5199983d48 tempest-AttachVolumeTestJSON-555093534 tempest-AttachVolumeTestJSON-555093534-project] Lock "1daf4f4c-0e4a-4779-b53a-78c48397ea2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120741) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 18:06:15.526070 dv-cinder-852009-8-iscsi devstack@n-api.service[120741]: DEBUG nova.policy [None req-bea76765-88c0-4dac-88cc-0f5199983d48 tempest-AttachVolumeTestJSON-555093534 tempest-AttachVolumeTestJSON-555093534-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0625b3113ce044bbac4f6142eaade11c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a279fcbf274c4704a31a2b95061e1469', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120741) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 18:06:15.537579 dv-cinder-852009-8-iscsi devstack@n-api.service[120741]: INFO nova.api.openstack.requestlog [None req-bea76765-88c0-4dac-88cc-0f5199983d48 tempest-AttachVolumeTestJSON-555093534 tempest-AttachVolumeTestJSON-555093534-project] 10.222.0.43 "GET /compute/v2.1/servers/b958d409-df20-44c6-aa0e-58cb0a482edf" status: 200 len: 1674 microversion: 2.1 time: 0.163388 Sep 13 18:06:15.538379 dv-cinder-852009-8-iscsi devstack@n-api.service[120741]: [pid: 120741|app: 0|req: 236/480] 10.222.0.43 () {58 vars in 1236 bytes} [Tue Sep 13 18:06:15 2022] GET /compute/v2.1/servers/b958d409-df20-44c6-aa0e-58cb0a482edf => generated 1674 bytes in 166 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 13 18:06:16.571520 dv-cinder-852009-8-iscsi devstack@n-api.service[120740]: DEBUG nova.api.openstack.wsgi [None req-41a77d5d-9937-4493-8c77-e11ede629ce1 tempest-AttachVolumeTestJSON-555093534 tempest-AttachVolumeTestJSON-555093534-project] Calling method '>' {{(pid=120740) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 18:06:16.572151 dv-cinder-852009-8-iscsi devstack@n-api.service[120740]: DEBUG nova.compute.api [None req-41a77d5d-9937-4493-8c77-e11ede629ce1 tempest-AttachVolumeTestJSON-555093534 tempest-AttachVolumeTestJSON-555093534-project] [instance: b958d409-df20-44c6-aa0e-58cb0a482edf] Fetching instance by UUID {{(pid=120740) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 18:06:16.578822 dv-cinder-852009-8-iscsi devstack@n-api.service[120740]: DEBUG oslo_concurrency.lockutils [None req-41a77d5d-9937-4493-8c77-e11ede629ce1 tempest-AttachVolumeTestJSON-555093534 tempest-AttachVolumeTestJSON-555093534-project] Acquiring lock "1daf4f4c-0e4a-4779-b53a-78c48397ea2f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120740) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 18:06:16.579295 dv-cinder-852009-8-iscsi devstack@n-api.service[120740]: DEBUG oslo_concurrency.lockutils [None req-41a77d5d-9937-4493-8c77-e11ede629ce1 tempest-AttachVolumeTestJSON-555093534 tempest-AttachVolumeTestJSON-555093534-project] Lock "1daf4f4c-0e4a-4779-b53a-78c48397ea2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120740) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 18:06:16.579719 dv-cinder-852009-8-iscsi devstack@n-api.service[120740]: DEBUG oslo_concurrency.lockutils [None req-41a77d5d-9937-4493-8c77-e11ede629ce1 tempest-AttachVolumeTestJSON-555093534 tempest-AttachVolumeTestJSON-555093534-project] Lock "1daf4f4c-0e4a-4779-b53a-78c48397ea2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120740) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 18:06:16.580400 dv-cinder-852009-8-iscsi devstack@n-api.service[120740]: DEBUG oslo_concurrency.lockutils [None req-41a77d5d-9937-4493-8c77-e11ede629ce1 tempest-AttachVolumeTestJSON-555093534 tempest-AttachVolumeTestJSON-555093534-project] Acquiring lock "1daf4f4c-0e4a-4779-b53a-78c48397ea2f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120740) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 18:06:16.580867 dv-cinder-852009-8-iscsi devstack@n-api.service[120740]: DEBUG oslo_concurrency.lockutils [None req-41a77d5d-9937-4493-8c77-e11ede629ce1 tempest-AttachVolumeTestJSON-555093534 tempest-AttachVolumeTestJSON-555093534-project] Lock "1daf4f4c-0e4a-4779-b53a-78c48397ea2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120740) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 18:06:16.581279 dv-cinder-852009-8-iscsi devstack@n-api.service[120740]: DEBUG oslo_concurrency.lockutils [None req-41a77d5d-9937-4493-8c77-e11ede629ce1 tempest-AttachVolumeTestJSON-555093534 tempest-AttachVolumeTestJSON-555093534-project] Lock "1daf4f4c-0e4a-4779-b53a-78c48397ea2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120740) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 18:06:16.712623 dv-cinder-852009-8-iscsi devstack@n-api.service[120740]: DEBUG nova.policy [None req-41a77d5d-9937-4493-8c77-e11ede629ce1 tempest-AttachVolumeTestJSON-555093534 tempest-AttachVolumeTestJSON-555093534-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0625b3113ce044bbac4f6142eaade11c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a279fcbf274c4704a31a2b95061e1469', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120740) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 18:06:16.721353 dv-cinder-852009-8-iscsi devstack@n-api.service[120740]: INFO nova.api.openstack.requestlog [None req-41a77d5d-9937-4493-8c77-e11ede629ce1 tempest-AttachVolumeTestJSON-555093534 tempest-AttachVolumeTestJSON-555093534-project] 10.222.0.43 "GET /compute/v2.1/servers/b958d409-df20-44c6-aa0e-58cb0a482edf" status: 200 len: 1674 microversion: 2.1 time: 0.153741 Sep 13 18:06:16.721933 dv-cinder-852009-8-iscsi devstack@n-api.service[120740]: [pid: 120740|app: 0|req: 245/481] 10.222.0.43 () {58 vars in 1236 bytes} [Tue Sep 13 18:06:16 2022] GET /compute/v2.1/servers/b958d409-df20-44c6-aa0e-58cb0a482edf => generated 1674 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 13 18:06:17.566528 dv-cinder-852009-8-iscsi devstack@n-api.service[120741]: DEBUG nova.api.openstack.wsgi [req-9b898df0-aabc-4970-9d6d-c69c9f5042fb req-2ca41f44-6288-4a04-97a8-1d4465d19b11 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "b958d409-df20-44c6-aa0e-58cb0a482edf", "name": "network-vif-deleted", "tag": "a5580dcb-2c75-47bc-91ef-409ee6db4bdc"}]} {{(pid=120741) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 13 18:06:17.581088 dv-cinder-852009-8-iscsi devstack@n-api.service[120741]: DEBUG oslo_concurrency.lockutils [req-9b898df0-aabc-4970-9d6d-c69c9f5042fb req-2ca41f44-6288-4a04-97a8-1d4465d19b11 service nova] Acquiring lock "1daf4f4c-0e4a-4779-b53a-78c48397ea2f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120741) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 18:06:17.581583 dv-cinder-852009-8-iscsi devstack@n-api.service[120741]: DEBUG oslo_concurrency.lockutils [req-9b898df0-aabc-4970-9d6d-c69c9f5042fb req-2ca41f44-6288-4a04-97a8-1d4465d19b11 service nova] Lock "1daf4f4c-0e4a-4779-b53a-78c48397ea2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120741) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 18:06:17.582009 dv-cinder-852009-8-iscsi devstack@n-api.service[120741]: DEBUG oslo_concurrency.lockutils [req-9b898df0-aabc-4970-9d6d-c69c9f5042fb req-2ca41f44-6288-4a04-97a8-1d4465d19b11 service nova] Lock "1daf4f4c-0e4a-4779-b53a-78c48397ea2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120741) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 18:06:17.593943 dv-cinder-852009-8-iscsi devstack@n-api.service[120741]: INFO nova.api.openstack.compute.server_external_events [req-9b898df0-aabc-4970-9d6d-c69c9f5042fb req-2ca41f44-6288-4a04-97a8-1d4465d19b11 service nova] Creating event network-vif-deleted:a5580dcb-2c75-47bc-91ef-409ee6db4bdc for instance b958d409-df20-44c6-aa0e-58cb0a482edf on hv-cinder-85200 Sep 13 18:06:17.600729 dv-cinder-852009-8-iscsi devstack@n-api.service[120741]: INFO nova.api.openstack.requestlog [req-9b898df0-aabc-4970-9d6d-c69c9f5042fb req-2ca41f44-6288-4a04-97a8-1d4465d19b11 service nova] 10.222.0.43 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.037944 Sep 13 18:06:17.601466 dv-cinder-852009-8-iscsi devstack@n-api.service[120741]: [pid: 120741|app: 0|req: 237/482] 10.222.0.43 () {64 vars in 1317 bytes} [Tue Sep 13 18:06:17 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 40 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 13 18:06:17.744634 dv-cinder-852009-8-iscsi devstack@n-api.service[120740]: DEBUG nova.api.openstack.wsgi [None req-2cbd3520-25e2-44b9-b9f8-0149b37ccb17 tempest-AttachVolumeTestJSON-555093534 tempest-AttachVolumeTestJSON-555093534-project] Calling method '>' {{(pid=120740) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 18:06:17.745380 dv-cinder-852009-8-iscsi devstack@n-api.service[120740]: DEBUG nova.compute.api [None req-2cbd3520-25e2-44b9-b9f8-0149b37ccb17 tempest-AttachVolumeTestJSON-555093534 tempest-AttachVolumeTestJSON-555093534-project] [instance: b958d409-df20-44c6-aa0e-58cb0a482edf] Fetching instance by UUID {{(pid=120740) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 18:06:17.749176 dv-cinder-852009-8-iscsi devstack@n-api.service[120740]: DEBUG dbcounter [-] [120740] Writing DB stats nova_api:SELECT=43 {{(pid=120740) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 18:06:17.753643 dv-cinder-852009-8-iscsi devstack@n-api.service[120740]: DEBUG oslo_concurrency.lockutils [None req-2cbd3520-25e2-44b9-b9f8-0149b37ccb17 tempest-AttachVolumeTestJSON-555093534 tempest-AttachVolumeTestJSON-555093534-project] Acquiring lock "1daf4f4c-0e4a-4779-b53a-78c48397ea2f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120740) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 18:06:17.754385 dv-cinder-852009-8-iscsi devstack@n-api.service[120740]: DEBUG oslo_concurrency.lockutils [None req-2cbd3520-25e2-44b9-b9f8-0149b37ccb17 tempest-AttachVolumeTestJSON-555093534 tempest-AttachVolumeTestJSON-555093534-project] Lock "1daf4f4c-0e4a-4779-b53a-78c48397ea2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120740) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 18:06:17.754889 dv-cinder-852009-8-iscsi devstack@n-api.service[120740]: DEBUG oslo_concurrency.lockutils [None req-2cbd3520-25e2-44b9-b9f8-0149b37ccb17 tempest-AttachVolumeTestJSON-555093534 tempest-AttachVolumeTestJSON-555093534-project] Lock "1daf4f4c-0e4a-4779-b53a-78c48397ea2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120740) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 18:06:17.755686 dv-cinder-852009-8-iscsi devstack@n-api.service[120740]: DEBUG oslo_concurrency.lockutils [None req-2cbd3520-25e2-44b9-b9f8-0149b37ccb17 tempest-AttachVolumeTestJSON-555093534 tempest-AttachVolumeTestJSON-555093534-project] Acquiring lock "1daf4f4c-0e4a-4779-b53a-78c48397ea2f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120740) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 18:06:17.756205 dv-cinder-852009-8-iscsi devstack@n-api.service[120740]: DEBUG oslo_concurrency.lockutils [None req-2cbd3520-25e2-44b9-b9f8-0149b37ccb17 tempest-AttachVolumeTestJSON-555093534 tempest-AttachVolumeTestJSON-555093534-project] Lock "1daf4f4c-0e4a-4779-b53a-78c48397ea2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120740) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 18:06:17.756723 dv-cinder-852009-8-iscsi devstack@n-api.service[120740]: DEBUG oslo_concurrency.lockutils [None req-2cbd3520-25e2-44b9-b9f8-0149b37ccb17 tempest-AttachVolumeTestJSON-555093534 tempest-AttachVolumeTestJSON-555093534-project] Lock "1daf4f4c-0e4a-4779-b53a-78c48397ea2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120740) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 18:06:17.790999 dv-cinder-852009-8-iscsi devstack@n-api.service[120740]: DEBUG oslo_concurrency.lockutils [None req-2cbd3520-25e2-44b9-b9f8-0149b37ccb17 tempest-AttachVolumeTestJSON-555093534 tempest-AttachVolumeTestJSON-555093534-project] Acquiring lock "1daf4f4c-0e4a-4779-b53a-78c48397ea2f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120740) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 18:06:17.791474 dv-cinder-852009-8-iscsi devstack@n-api.service[120740]: DEBUG oslo_concurrency.lockutils [None req-2cbd3520-25e2-44b9-b9f8-0149b37ccb17 tempest-AttachVolumeTestJSON-555093534 tempest-AttachVolumeTestJSON-555093534-project] Lock "1daf4f4c-0e4a-4779-b53a-78c48397ea2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120740) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 18:06:17.791909 dv-cinder-852009-8-iscsi devstack@n-api.service[120740]: DEBUG oslo_concurrency.lockutils [None req-2cbd3520-25e2-44b9-b9f8-0149b37ccb17 tempest-AttachVolumeTestJSON-555093534 tempest-AttachVolumeTestJSON-555093534-project] Lock "1daf4f4c-0e4a-4779-b53a-78c48397ea2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120740) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 18:06:17.792360 dv-cinder-852009-8-iscsi devstack@n-api.service[120740]: DEBUG nova.objects.instance [None req-2cbd3520-25e2-44b9-b9f8-0149b37ccb17 tempest-AttachVolumeTestJSON-555093534 tempest-AttachVolumeTestJSON-555093534-project] Lazy-loading 'fault' on Instance uuid b958d409-df20-44c6-aa0e-58cb0a482edf {{(pid=120740) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Sep 13 18:06:17.841712 dv-cinder-852009-8-iscsi devstack@n-api.service[120740]: DEBUG nova.policy [None req-2cbd3520-25e2-44b9-b9f8-0149b37ccb17 tempest-AttachVolumeTestJSON-555093534 tempest-AttachVolumeTestJSON-555093534-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0625b3113ce044bbac4f6142eaade11c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a279fcbf274c4704a31a2b95061e1469', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120740) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 18:06:17.850168 dv-cinder-852009-8-iscsi devstack@n-api.service[120740]: INFO nova.api.openstack.requestlog [None req-2cbd3520-25e2-44b9-b9f8-0149b37ccb17 tempest-AttachVolumeTestJSON-555093534 tempest-AttachVolumeTestJSON-555093534-project] 10.222.0.43 "GET /compute/v2.1/servers/b958d409-df20-44c6-aa0e-58cb0a482edf" status: 200 len: 1328 microversion: 2.1 time: 0.109353 Sep 13 18:06:17.852910 dv-cinder-852009-8-iscsi devstack@n-api.service[120740]: [pid: 120740|app: 0|req: 246/483] 10.222.0.43 () {58 vars in 1236 bytes} [Tue Sep 13 18:06:17 2022] GET /compute/v2.1/servers/b958d409-df20-44c6-aa0e-58cb0a482edf => generated 1328 bytes in 113 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 13 18:06:18.880575 dv-cinder-852009-8-iscsi devstack@n-api.service[120741]: DEBUG nova.api.openstack.wsgi [None req-0d3772d5-f0a1-4cb9-b27a-5f1342c71536 tempest-AttachVolumeTestJSON-555093534 tempest-AttachVolumeTestJSON-555093534-project] Calling method '>' {{(pid=120741) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 18:06:18.881707 dv-cinder-852009-8-iscsi devstack@n-api.service[120741]: DEBUG nova.compute.api [None req-0d3772d5-f0a1-4cb9-b27a-5f1342c71536 tempest-AttachVolumeTestJSON-555093534 tempest-AttachVolumeTestJSON-555093534-project] [instance: b958d409-df20-44c6-aa0e-58cb0a482edf] Fetching instance by UUID {{(pid=120741) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 18:06:18.893301 dv-cinder-852009-8-iscsi devstack@n-api.service[120741]: DEBUG oslo_concurrency.lockutils [None req-0d3772d5-f0a1-4cb9-b27a-5f1342c71536 tempest-AttachVolumeTestJSON-555093534 tempest-AttachVolumeTestJSON-555093534-project] Acquiring lock "1daf4f4c-0e4a-4779-b53a-78c48397ea2f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120741) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 18:06:18.894078 dv-cinder-852009-8-iscsi devstack@n-api.service[120741]: DEBUG oslo_concurrency.lockutils [None req-0d3772d5-f0a1-4cb9-b27a-5f1342c71536 tempest-AttachVolumeTestJSON-555093534 tempest-AttachVolumeTestJSON-555093534-project] Lock "1daf4f4c-0e4a-4779-b53a-78c48397ea2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120741) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 18:06:18.894777 dv-cinder-852009-8-iscsi devstack@n-api.service[120741]: DEBUG oslo_concurrency.lockutils [None req-0d3772d5-f0a1-4cb9-b27a-5f1342c71536 tempest-AttachVolumeTestJSON-555093534 tempest-AttachVolumeTestJSON-555093534-project] Lock "1daf4f4c-0e4a-4779-b53a-78c48397ea2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120741) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 18:06:18.895903 dv-cinder-852009-8-iscsi devstack@n-api.service[120741]: DEBUG oslo_concurrency.lockutils [None req-0d3772d5-f0a1-4cb9-b27a-5f1342c71536 tempest-AttachVolumeTestJSON-555093534 tempest-AttachVolumeTestJSON-555093534-project] Acquiring lock "1daf4f4c-0e4a-4779-b53a-78c48397ea2f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120741) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 18:06:18.896683 dv-cinder-852009-8-iscsi devstack@n-api.service[120741]: DEBUG oslo_concurrency.lockutils [None req-0d3772d5-f0a1-4cb9-b27a-5f1342c71536 tempest-AttachVolumeTestJSON-555093534 tempest-AttachVolumeTestJSON-555093534-project] Lock "1daf4f4c-0e4a-4779-b53a-78c48397ea2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120741) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 18:06:18.897367 dv-cinder-852009-8-iscsi devstack@n-api.service[120741]: DEBUG oslo_concurrency.lockutils [None req-0d3772d5-f0a1-4cb9-b27a-5f1342c71536 tempest-AttachVolumeTestJSON-555093534 tempest-AttachVolumeTestJSON-555093534-project] Lock "1daf4f4c-0e4a-4779-b53a-78c48397ea2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120741) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 18:06:18.913888 dv-cinder-852009-8-iscsi devstack@n-api.service[120741]: INFO nova.api.openstack.wsgi [None req-0d3772d5-f0a1-4cb9-b27a-5f1342c71536 tempest-AttachVolumeTestJSON-555093534 tempest-AttachVolumeTestJSON-555093534-project] HTTP exception thrown: Instance b958d409-df20-44c6-aa0e-58cb0a482edf could not be found. Sep 13 18:06:18.915487 dv-cinder-852009-8-iscsi devstack@n-api.service[120741]: DEBUG nova.api.openstack.wsgi [None req-0d3772d5-f0a1-4cb9-b27a-5f1342c71536 tempest-AttachVolumeTestJSON-555093534 tempest-AttachVolumeTestJSON-555093534-project] Request method failure captured: Sep 13 18:06:18.915487 dv-cinder-852009-8-iscsi devstack@n-api.service[120741]: request: GET /compute/v2.1/servers/b958d409-df20-44c6-aa0e-58cb0a482edf HTTP/1.1 Sep 13 18:06:18.915487 dv-cinder-852009-8-iscsi devstack@n-api.service[120741]: Accept: application/json Sep 13 18:06:18.915487 dv-cinder-852009-8-iscsi devstack@n-api.service[120741]: Accept-Encoding: identity Sep 13 18:06:18.915487 dv-cinder-852009-8-iscsi devstack@n-api.service[120741]: Connection: close Sep 13 18:06:18.915487 dv-cinder-852009-8-iscsi devstack@n-api.service[120741]: Content-Length: 0 Sep 13 18:06:18.915487 dv-cinder-852009-8-iscsi devstack@n-api.service[120741]: Content-Type: application/json Sep 13 18:06:18.915487 dv-cinder-852009-8-iscsi devstack@n-api.service[120741]: Host: 10.222.0.43 Sep 13 18:06:18.915487 dv-cinder-852009-8-iscsi devstack@n-api.service[120741]: Openstack-System-Scope: None Sep 13 18:06:18.915487 dv-cinder-852009-8-iscsi devstack@n-api.service[120741]: User-Agent: python-urllib3/1.26.12 Sep 13 18:06:18.915487 dv-cinder-852009-8-iscsi devstack@n-api.service[120741]: X-Auth-Token: gAAAAABjIMWRpvfFxseo-bDVg1fnd5kZdHkOwDthdyuSjyLDBDaGBd0tRNAcWyUQSN99QlQGzPKdIVzTAWNjmk4wTGD41N0QFzkZdw8xrHL4a_XEHs7QZTJgaqv9b_MZ7RjwVfYtFh2UsHqvKyEbteoXm1QxW-OO9FPnECIQbldvbAikLpdkEmw Sep 13 18:06:18.915487 dv-cinder-852009-8-iscsi devstack@n-api.service[120741]: X-Domain-Id: None Sep 13 18:06:18.915487 dv-cinder-852009-8-iscsi devstack@n-api.service[120741]: X-Domain-Name: None Sep 13 18:06:18.915487 dv-cinder-852009-8-iscsi devstack@n-api.service[120741]: X-Identity-Status: Confirmed Sep 13 18:06:18.915487 dv-cinder-852009-8-iscsi devstack@n-api.service[120741]: X-Is-Admin-Project: True Sep 13 18:06:18.915487 dv-cinder-852009-8-iscsi devstack@n-api.service[120741]: X-Project-Domain-Id: default Sep 13 18:06:18.915487 dv-cinder-852009-8-iscsi devstack@n-api.service[120741]: X-Project-Domain-Name: Default Sep 13 18:06:18.915487 dv-cinder-852009-8-iscsi devstack@n-api.service[120741]: X-Project-Id: a279fcbf274c4704a31a2b95061e1469 Sep 13 18:06:18.915487 dv-cinder-852009-8-iscsi devstack@n-api.service[120741]: X-Project-Name: tempest-AttachVolumeTestJSON-555093534 Sep 13 18:06:18.915487 dv-cinder-852009-8-iscsi devstack@n-api.service[120741]: X-Role: reader,member Sep 13 18:06:18.915487 dv-cinder-852009-8-iscsi devstack@n-api.service[120741]: X-Roles: reader,member Sep 13 18:06:18.917072 dv-cinder-852009-8-iscsi devstack@n-api.service[120741]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/identity"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/compute/v2/a279fcbf274c4704a31a2b95061e1469"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.43:8080", "publicURL": "http://10.222.0.43:8080/v1/AUTH_a279fcbf274c4704a31a2b95061e1469"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43:9696/networking"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/volume/v3/a279fcbf274c4704a31a2b95061e1469"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/compute/v2.1"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/placement"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/volume/v3/a279fcbf274c4704a31a2b95061e1469"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/image"}]}] Sep 13 18:06:18.917072 dv-cinder-852009-8-iscsi devstack@n-api.service[120741]: X-Tenant: tempest-AttachVolumeTestJSON-555093534 Sep 13 18:06:18.917072 dv-cinder-852009-8-iscsi devstack@n-api.service[120741]: X-Tenant-Id: a279fcbf274c4704a31a2b95061e1469 Sep 13 18:06:18.917072 dv-cinder-852009-8-iscsi devstack@n-api.service[120741]: X-Tenant-Name: tempest-AttachVolumeTestJSON-555093534 Sep 13 18:06:18.917072 dv-cinder-852009-8-iscsi devstack@n-api.service[120741]: X-User: tempest-AttachVolumeTestJSON-555093534-project Sep 13 18:06:18.917072 dv-cinder-852009-8-iscsi devstack@n-api.service[120741]: X-User-Domain-Id: default Sep 13 18:06:18.917072 dv-cinder-852009-8-iscsi devstack@n-api.service[120741]: X-User-Domain-Name: Default Sep 13 18:06:18.917072 dv-cinder-852009-8-iscsi devstack@n-api.service[120741]: X-User-Id: 0625b3113ce044bbac4f6142eaade11c Sep 13 18:06:18.917072 dv-cinder-852009-8-iscsi devstack@n-api.service[120741]: X-User-Name: tempest-AttachVolumeTestJSON-555093534-project Sep 13 18:06:18.917072 dv-cinder-852009-8-iscsi devstack@n-api.service[120741]: method: > Sep 13 18:06:18.917072 dv-cinder-852009-8-iscsi devstack@n-api.service[120741]: exception: Instance b958d409-df20-44c6-aa0e-58cb0a482edf could not be found. Sep 13 18:06:18.917072 dv-cinder-852009-8-iscsi devstack@n-api.service[120741]: action_args: {'id': 'b958d409-df20-44c6-aa0e-58cb0a482edf'} Sep 13 18:06:18.917988 dv-cinder-852009-8-iscsi devstack@n-api.service[120741]: {{(pid=120741) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 13 18:06:18.917988 dv-cinder-852009-8-iscsi devstack@n-api.service[120741]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 13 18:06:18.917988 dv-cinder-852009-8-iscsi devstack@n-api.service[120741]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Sep 13 18:06:18.917988 dv-cinder-852009-8-iscsi devstack@n-api.service[120741]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Sep 13 18:06:18.917988 dv-cinder-852009-8-iscsi devstack@n-api.service[120741]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Sep 13 18:06:18.917988 dv-cinder-852009-8-iscsi devstack@n-api.service[120741]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Sep 13 18:06:18.917988 dv-cinder-852009-8-iscsi devstack@n-api.service[120741]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Sep 13 18:06:18.917988 dv-cinder-852009-8-iscsi devstack@n-api.service[120741]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Sep 13 18:06:18.917988 dv-cinder-852009-8-iscsi devstack@n-api.service[120741]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Sep 13 18:06:18.917988 dv-cinder-852009-8-iscsi devstack@n-api.service[120741]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Sep 13 18:06:18.917988 dv-cinder-852009-8-iscsi devstack@n-api.service[120741]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance b958d409-df20-44c6-aa0e-58cb0a482edf could not be found. Sep 13 18:06:18.917988 dv-cinder-852009-8-iscsi devstack@n-api.service[120741]: ERROR nova.api.openstack.wsgi Sep 13 18:06:18.917988 dv-cinder-852009-8-iscsi devstack@n-api.service[120741]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 13 18:06:18.917988 dv-cinder-852009-8-iscsi devstack@n-api.service[120741]: ERROR nova.api.openstack.wsgi Sep 13 18:06:18.917988 dv-cinder-852009-8-iscsi devstack@n-api.service[120741]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 13 18:06:18.917988 dv-cinder-852009-8-iscsi devstack@n-api.service[120741]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 13 18:06:18.917988 dv-cinder-852009-8-iscsi devstack@n-api.service[120741]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 13 18:06:18.917988 dv-cinder-852009-8-iscsi devstack@n-api.service[120741]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 13 18:06:18.917988 dv-cinder-852009-8-iscsi devstack@n-api.service[120741]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 13 18:06:18.917988 dv-cinder-852009-8-iscsi devstack@n-api.service[120741]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 13 18:06:18.919569 dv-cinder-852009-8-iscsi devstack@n-api.service[120741]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 13 18:06:18.919569 dv-cinder-852009-8-iscsi devstack@n-api.service[120741]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Sep 13 18:06:18.919569 dv-cinder-852009-8-iscsi devstack@n-api.service[120741]: ERROR nova.api.openstack.wsgi instance = self._get_server( Sep 13 18:06:18.919569 dv-cinder-852009-8-iscsi devstack@n-api.service[120741]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Sep 13 18:06:18.919569 dv-cinder-852009-8-iscsi devstack@n-api.service[120741]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Sep 13 18:06:18.919569 dv-cinder-852009-8-iscsi devstack@n-api.service[120741]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Sep 13 18:06:18.919569 dv-cinder-852009-8-iscsi devstack@n-api.service[120741]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Sep 13 18:06:18.919569 dv-cinder-852009-8-iscsi devstack@n-api.service[120741]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance b958d409-df20-44c6-aa0e-58cb0a482edf could not be found. Sep 13 18:06:18.919569 dv-cinder-852009-8-iscsi devstack@n-api.service[120741]: ERROR nova.api.openstack.wsgi Sep 13 18:06:18.919569 dv-cinder-852009-8-iscsi devstack@n-api.service[120741]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 13 18:06:18.919569 dv-cinder-852009-8-iscsi devstack@n-api.service[120741]: ERROR nova.api.openstack.wsgi Sep 13 18:06:18.919569 dv-cinder-852009-8-iscsi devstack@n-api.service[120741]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 13 18:06:18.919569 dv-cinder-852009-8-iscsi devstack@n-api.service[120741]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 13 18:06:18.919569 dv-cinder-852009-8-iscsi devstack@n-api.service[120741]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 13 18:06:18.919569 dv-cinder-852009-8-iscsi devstack@n-api.service[120741]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 13 18:06:18.919569 dv-cinder-852009-8-iscsi devstack@n-api.service[120741]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 13 18:06:18.919569 dv-cinder-852009-8-iscsi devstack@n-api.service[120741]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance b958d409-df20-44c6-aa0e-58cb0a482edf could not be found. Sep 13 18:06:18.919569 dv-cinder-852009-8-iscsi devstack@n-api.service[120741]: ERROR nova.api.openstack.wsgi Sep 13 18:06:18.921191 dv-cinder-852009-8-iscsi devstack@n-api.service[120741]: DEBUG nova.api.openstack.wsgi [None req-0d3772d5-f0a1-4cb9-b27a-5f1342c71536 tempest-AttachVolumeTestJSON-555093534 tempest-AttachVolumeTestJSON-555093534-project] Returning 404 to user: Instance b958d409-df20-44c6-aa0e-58cb0a482edf could not be found. {{(pid=120741) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 13 18:06:18.921191 dv-cinder-852009-8-iscsi devstack@n-api.service[120741]: INFO nova.api.openstack.requestlog [None req-0d3772d5-f0a1-4cb9-b27a-5f1342c71536 tempest-AttachVolumeTestJSON-555093534 tempest-AttachVolumeTestJSON-555093534-project] 10.222.0.43 "GET /compute/v2.1/servers/b958d409-df20-44c6-aa0e-58cb0a482edf" status: 404 len: 111 microversion: 2.1 time: 0.044513 Sep 13 18:06:18.921191 dv-cinder-852009-8-iscsi devstack@n-api.service[120741]: [pid: 120741|app: 0|req: 238/484] 10.222.0.43 () {58 vars in 1236 bytes} [Tue Sep 13 18:06:18 2022] GET /compute/v2.1/servers/b958d409-df20-44c6-aa0e-58cb0a482edf => generated 111 bytes in 46 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Sep 13 18:06:18.926001 dv-cinder-852009-8-iscsi devstack@n-api.service[120740]: DEBUG nova.api.openstack.wsgi [None req-17c139ee-ccad-4f3d-a886-159d9b82341a tempest-AttachVolumeTestJSON-555093534 tempest-AttachVolumeTestJSON-555093534-project] Calling method '.version_select at 0x7fa626c3fa60>' {{(pid=120740) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 18:06:18.948199 dv-cinder-852009-8-iscsi devstack@n-api.service[120740]: INFO nova.api.openstack.requestlog [None req-17c139ee-ccad-4f3d-a886-159d9b82341a tempest-AttachVolumeTestJSON-555093534 tempest-AttachVolumeTestJSON-555093534-project] 10.222.0.43 "DELETE /compute/v2.1/os-keypairs/tempest-keypair-1286157980" status: 202 len: 0 microversion: 2.1 time: 0.026175 Sep 13 18:06:18.948791 dv-cinder-852009-8-iscsi devstack@n-api.service[120740]: [pid: 120740|app: 0|req: 247/485] 10.222.0.43 () {58 vars in 1221 bytes} [Tue Sep 13 18:06:18 2022] DELETE /compute/v2.1/os-keypairs/tempest-keypair-1286157980 => generated 0 bytes in 27 msecs (HTTP/1.1 202) 9 headers in 361 bytes (2 switches on core 0) Sep 13 18:06:19.579476 dv-cinder-852009-8-iscsi devstack@n-api.service[120741]: DEBUG nova.api.openstack.wsgi [None req-53310471-e464-43f5-8879-d596479bd4a6 tempest-AttachVolumeTestJSON-555093534 tempest-AttachVolumeTestJSON-555093534-project] Action: 'create', calling method: .version_select at 0x7fa626bea790>, body: {"keypair": {"name": "tempest-keypair-1705096806", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBNW4BGD+M0ckEGljfYJYXHjJm4kUEI3K718F9u3gX5dAudsU8SymOZucMFysuJyjsm/3y7wZ/SXkxRQlEifmaUIG54SFUIKG4SV4F0DwXSkoGLifgqxg+Ryhhbgp9bVRYg=="}} {{(pid=120741) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 13 18:06:19.596352 dv-cinder-852009-8-iscsi devstack@n-api.service[120741]: DEBUG nova.quota [None req-53310471-e464-43f5-8879-d596479bd4a6 tempest-AttachVolumeTestJSON-555093534 tempest-AttachVolumeTestJSON-555093534-project] Getting quotas for project a279fcbf274c4704a31a2b95061e1469. Resources: {'key_pairs'} {{(pid=120741) _get_quotas /opt/stack/nova/nova/quota.py:393}} Sep 13 18:06:19.600293 dv-cinder-852009-8-iscsi devstack@n-api.service[120741]: DEBUG nova.quota [None req-53310471-e464-43f5-8879-d596479bd4a6 tempest-AttachVolumeTestJSON-555093534 tempest-AttachVolumeTestJSON-555093534-project] Getting quotas for user 0625b3113ce044bbac4f6142eaade11c and project a279fcbf274c4704a31a2b95061e1469. Resources: {'key_pairs'} {{(pid=120741) _get_quotas /opt/stack/nova/nova/quota.py:383}} Sep 13 18:06:19.625884 dv-cinder-852009-8-iscsi devstack@n-api.service[120741]: INFO nova.api.openstack.requestlog [None req-53310471-e464-43f5-8879-d596479bd4a6 tempest-AttachVolumeTestJSON-555093534 tempest-AttachVolumeTestJSON-555093534-project] 10.222.0.43 "POST /compute/v2.1/os-keypairs" status: 200 len: 386 microversion: 2.1 time: 0.050414 Sep 13 18:06:19.626473 dv-cinder-852009-8-iscsi devstack@n-api.service[120741]: [pid: 120741|app: 0|req: 239/486] 10.222.0.43 () {60 vars in 1159 bytes} [Tue Sep 13 18:06:19 2022] POST /compute/v2.1/os-keypairs => generated 386 bytes in 52 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 13 18:06:20.953365 dv-cinder-852009-8-iscsi devstack@n-api.service[120740]: DEBUG nova.api.openstack.wsgi [None req-2847ba99-a847-4689-989b-2ad6eb5dc790 tempest-AttachVolumeTestJSON-555093534 tempest-AttachVolumeTestJSON-555093534-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-AttachVolumeTestJSON-server-648212125", "imageRef": "33034e36-e6b2-4847-92a1-ff3188c05a4a", "flavorRef": "452", "adminPass": "***", "networks": [{"uuid": "c3ccf009-999c-4527-966f-109321f8fcee"}], "security_groups": [{"name": "tempest-securitygroup--1554078452"}], "key_name": "tempest-keypair-1705096806", "user_data": "}} {{(pid=120740) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 13 18:06:21.059140 dv-cinder-852009-8-iscsi devstack@n-api.service[120740]: DEBUG nova.network.neutron [None req-2847ba99-a847-4689-989b-2ad6eb5dc790 tempest-AttachVolumeTestJSON-555093534 tempest-AttachVolumeTestJSON-555093534-project] validate_networks() for [('c3ccf009-999c-4527-966f-109321f8fcee', None, None, None, None, None)] {{(pid=120740) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Sep 13 18:06:21.428550 dv-cinder-852009-8-iscsi devstack@n-api.service[120740]: DEBUG nova.virt.hardware [None req-2847ba99-a847-4689-989b-2ad6eb5dc790 tempest-AttachVolumeTestJSON-555093534 tempest-AttachVolumeTestJSON-555093534-project] Flavor limits 0:0:0 {{(pid=120740) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Sep 13 18:06:21.429210 dv-cinder-852009-8-iscsi devstack@n-api.service[120740]: DEBUG nova.virt.hardware [None req-2847ba99-a847-4689-989b-2ad6eb5dc790 tempest-AttachVolumeTestJSON-555093534 tempest-AttachVolumeTestJSON-555093534-project] Image limits 0:0:0 {{(pid=120740) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Sep 13 18:06:21.429905 dv-cinder-852009-8-iscsi devstack@n-api.service[120740]: DEBUG nova.virt.hardware [None req-2847ba99-a847-4689-989b-2ad6eb5dc790 tempest-AttachVolumeTestJSON-555093534 tempest-AttachVolumeTestJSON-555093534-project] Flavor pref 0:0:0 {{(pid=120740) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Sep 13 18:06:21.430549 dv-cinder-852009-8-iscsi devstack@n-api.service[120740]: DEBUG nova.virt.hardware [None req-2847ba99-a847-4689-989b-2ad6eb5dc790 tempest-AttachVolumeTestJSON-555093534 tempest-AttachVolumeTestJSON-555093534-project] Image pref 0:0:0 {{(pid=120740) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Sep 13 18:06:21.431199 dv-cinder-852009-8-iscsi devstack@n-api.service[120740]: DEBUG nova.virt.hardware [None req-2847ba99-a847-4689-989b-2ad6eb5dc790 tempest-AttachVolumeTestJSON-555093534 tempest-AttachVolumeTestJSON-555093534-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=120740) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Sep 13 18:06:21.444312 dv-cinder-852009-8-iscsi devstack@n-api.service[120740]: DEBUG oslo_concurrency.lockutils [None req-2847ba99-a847-4689-989b-2ad6eb5dc790 tempest-AttachVolumeTestJSON-555093534 tempest-AttachVolumeTestJSON-555093534-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120740) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 18:06:21.445015 dv-cinder-852009-8-iscsi devstack@n-api.service[120740]: DEBUG oslo_concurrency.lockutils [None req-2847ba99-a847-4689-989b-2ad6eb5dc790 tempest-AttachVolumeTestJSON-555093534 tempest-AttachVolumeTestJSON-555093534-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120740) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 18:06:21.445689 dv-cinder-852009-8-iscsi devstack@n-api.service[120740]: DEBUG oslo_concurrency.lockutils [None req-2847ba99-a847-4689-989b-2ad6eb5dc790 tempest-AttachVolumeTestJSON-555093534 tempest-AttachVolumeTestJSON-555093534-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120740) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 18:06:21.446741 dv-cinder-852009-8-iscsi devstack@n-api.service[120740]: DEBUG oslo_concurrency.lockutils [None req-2847ba99-a847-4689-989b-2ad6eb5dc790 tempest-AttachVolumeTestJSON-555093534 tempest-AttachVolumeTestJSON-555093534-project] Acquiring lock "1daf4f4c-0e4a-4779-b53a-78c48397ea2f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120740) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 18:06:21.447381 dv-cinder-852009-8-iscsi devstack@n-api.service[120740]: DEBUG oslo_concurrency.lockutils [None req-2847ba99-a847-4689-989b-2ad6eb5dc790 tempest-AttachVolumeTestJSON-555093534 tempest-AttachVolumeTestJSON-555093534-project] Lock "1daf4f4c-0e4a-4779-b53a-78c48397ea2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120740) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 18:06:21.448030 dv-cinder-852009-8-iscsi devstack@n-api.service[120740]: DEBUG oslo_concurrency.lockutils [None req-2847ba99-a847-4689-989b-2ad6eb5dc790 tempest-AttachVolumeTestJSON-555093534 tempest-AttachVolumeTestJSON-555093534-project] Lock "1daf4f4c-0e4a-4779-b53a-78c48397ea2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120740) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 18:06:21.466892 dv-cinder-852009-8-iscsi devstack@n-api.service[120740]: DEBUG nova.quota [None req-2847ba99-a847-4689-989b-2ad6eb5dc790 tempest-AttachVolumeTestJSON-555093534 tempest-AttachVolumeTestJSON-555093534-project] Getting quotas for project a279fcbf274c4704a31a2b95061e1469. Resources: {'cores', 'ram', 'instances'} {{(pid=120740) _get_quotas /opt/stack/nova/nova/quota.py:393}} Sep 13 18:06:21.471029 dv-cinder-852009-8-iscsi devstack@n-api.service[120740]: DEBUG nova.quota [None req-2847ba99-a847-4689-989b-2ad6eb5dc790 tempest-AttachVolumeTestJSON-555093534 tempest-AttachVolumeTestJSON-555093534-project] Getting quotas for user 0625b3113ce044bbac4f6142eaade11c and project a279fcbf274c4704a31a2b95061e1469. Resources: {'cores', 'ram', 'instances'} {{(pid=120740) _get_quotas /opt/stack/nova/nova/quota.py:383}} Sep 13 18:06:21.482037 dv-cinder-852009-8-iscsi devstack@n-api.service[120740]: DEBUG nova.compute.api [None req-2847ba99-a847-4689-989b-2ad6eb5dc790 tempest-AttachVolumeTestJSON-555093534 tempest-AttachVolumeTestJSON-555093534-project] Going to run 1 instances... {{(pid=120740) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Sep 13 18:06:21.484366 dv-cinder-852009-8-iscsi devstack@n-api.service[120740]: DEBUG nova.compute.api [None req-2847ba99-a847-4689-989b-2ad6eb5dc790 tempest-AttachVolumeTestJSON-555093534 tempest-AttachVolumeTestJSON-555093534-project] [instance: d0983ec1-bb82-4a7d-9dba-ace1e3eb383a] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='33034e36-e6b2-4847-92a1-ff3188c05a4a',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=120740) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Sep 13 18:06:21.528835 dv-cinder-852009-8-iscsi devstack@n-api.service[120740]: ERROR oslo.messaging._drivers.impl_rabbit [None req-2847ba99-a847-4689-989b-2ad6eb5dc790 tempest-AttachVolumeTestJSON-555093534 tempest-AttachVolumeTestJSON-555093534-project] [67d1759e-0fea-43f0-aa12-11b7c82f6bd2] AMQP server on 10.222.0.43:5672 is unreachable: [Errno 104] Connection reset by peer. Trying again in 1 seconds.: ConnectionResetError: [Errno 104] Connection reset by peer Sep 13 18:06:22.541835 dv-cinder-852009-8-iscsi devstack@n-api.service[120740]: INFO oslo.messaging._drivers.impl_rabbit [None req-2847ba99-a847-4689-989b-2ad6eb5dc790 tempest-AttachVolumeTestJSON-555093534 tempest-AttachVolumeTestJSON-555093534-project] [67d1759e-0fea-43f0-aa12-11b7c82f6bd2] Reconnected to AMQP server on 10.222.0.43:5672 via [amqp] client with port 52492. Sep 13 18:06:22.548955 dv-cinder-852009-8-iscsi devstack@n-api.service[120740]: INFO nova.api.openstack.requestlog [None req-2847ba99-a847-4689-989b-2ad6eb5dc790 tempest-AttachVolumeTestJSON-555093534 tempest-AttachVolumeTestJSON-555093534-project] 10.222.0.43 "POST /compute/v2.1/servers" status: 202 len: 402 microversion: 2.1 time: 1.600155 Sep 13 18:06:22.549989 dv-cinder-852009-8-iscsi devstack@n-api.service[120740]: [pid: 120740|app: 0|req: 248/487] 10.222.0.43 () {60 vars in 1147 bytes} [Tue Sep 13 18:06:20 2022] POST /compute/v2.1/servers => generated 402 bytes in 1602 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Sep 13 18:06:22.566719 dv-cinder-852009-8-iscsi devstack@n-api.service[120741]: DEBUG nova.api.openstack.wsgi [None req-581d7376-4715-4675-b505-54d3b6888bd3 tempest-AttachVolumeTestJSON-555093534 tempest-AttachVolumeTestJSON-555093534-project] Calling method '>' {{(pid=120741) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 18:06:22.567301 dv-cinder-852009-8-iscsi devstack@n-api.service[120741]: DEBUG nova.compute.api [None req-581d7376-4715-4675-b505-54d3b6888bd3 tempest-AttachVolumeTestJSON-555093534 tempest-AttachVolumeTestJSON-555093534-project] [instance: d0983ec1-bb82-4a7d-9dba-ace1e3eb383a] Fetching instance by UUID {{(pid=120741) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 18:06:22.621987 dv-cinder-852009-8-iscsi devstack@n-api.service[120741]: DEBUG nova.policy [None req-581d7376-4715-4675-b505-54d3b6888bd3 tempest-AttachVolumeTestJSON-555093534 tempest-AttachVolumeTestJSON-555093534-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0625b3113ce044bbac4f6142eaade11c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a279fcbf274c4704a31a2b95061e1469', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120741) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 18:06:22.629703 dv-cinder-852009-8-iscsi devstack@n-api.service[120741]: INFO nova.api.openstack.requestlog [None req-581d7376-4715-4675-b505-54d3b6888bd3 tempest-AttachVolumeTestJSON-555093534 tempest-AttachVolumeTestJSON-555093534-project] 10.222.0.43 "GET /compute/v2.1/servers/d0983ec1-bb82-4a7d-9dba-ace1e3eb383a" status: 200 len: 1237 microversion: 2.1 time: 0.068074 Sep 13 18:06:22.630276 dv-cinder-852009-8-iscsi devstack@n-api.service[120741]: [pid: 120741|app: 0|req: 240/488] 10.222.0.43 () {58 vars in 1236 bytes} [Tue Sep 13 18:06:22 2022] GET /compute/v2.1/servers/d0983ec1-bb82-4a7d-9dba-ace1e3eb383a => generated 1237 bytes in 70 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 13 18:06:23.657446 dv-cinder-852009-8-iscsi devstack@n-api.service[120740]: DEBUG nova.api.openstack.wsgi [None req-c10866cc-a6da-492f-8b13-37cda07d002c tempest-AttachVolumeTestJSON-555093534 tempest-AttachVolumeTestJSON-555093534-project] Calling method '>' {{(pid=120740) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 18:06:23.658392 dv-cinder-852009-8-iscsi devstack@n-api.service[120740]: DEBUG nova.compute.api [None req-c10866cc-a6da-492f-8b13-37cda07d002c tempest-AttachVolumeTestJSON-555093534 tempest-AttachVolumeTestJSON-555093534-project] [instance: d0983ec1-bb82-4a7d-9dba-ace1e3eb383a] Fetching instance by UUID {{(pid=120740) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 18:06:23.668983 dv-cinder-852009-8-iscsi devstack@n-api.service[120740]: DEBUG oslo_concurrency.lockutils [None req-c10866cc-a6da-492f-8b13-37cda07d002c tempest-AttachVolumeTestJSON-555093534 tempest-AttachVolumeTestJSON-555093534-project] Acquiring lock "1daf4f4c-0e4a-4779-b53a-78c48397ea2f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120740) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 18:06:23.669802 dv-cinder-852009-8-iscsi devstack@n-api.service[120740]: DEBUG oslo_concurrency.lockutils [None req-c10866cc-a6da-492f-8b13-37cda07d002c tempest-AttachVolumeTestJSON-555093534 tempest-AttachVolumeTestJSON-555093534-project] Lock "1daf4f4c-0e4a-4779-b53a-78c48397ea2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120740) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 18:06:23.670514 dv-cinder-852009-8-iscsi devstack@n-api.service[120740]: DEBUG oslo_concurrency.lockutils [None req-c10866cc-a6da-492f-8b13-37cda07d002c tempest-AttachVolumeTestJSON-555093534 tempest-AttachVolumeTestJSON-555093534-project] Lock "1daf4f4c-0e4a-4779-b53a-78c48397ea2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120740) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 18:06:23.671648 dv-cinder-852009-8-iscsi devstack@n-api.service[120740]: DEBUG oslo_concurrency.lockutils [None req-c10866cc-a6da-492f-8b13-37cda07d002c tempest-AttachVolumeTestJSON-555093534 tempest-AttachVolumeTestJSON-555093534-project] Acquiring lock "1daf4f4c-0e4a-4779-b53a-78c48397ea2f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120740) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 18:06:23.672394 dv-cinder-852009-8-iscsi devstack@n-api.service[120740]: DEBUG oslo_concurrency.lockutils [None req-c10866cc-a6da-492f-8b13-37cda07d002c tempest-AttachVolumeTestJSON-555093534 tempest-AttachVolumeTestJSON-555093534-project] Lock "1daf4f4c-0e4a-4779-b53a-78c48397ea2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120740) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 18:06:23.673150 dv-cinder-852009-8-iscsi devstack@n-api.service[120740]: DEBUG oslo_concurrency.lockutils [None req-c10866cc-a6da-492f-8b13-37cda07d002c tempest-AttachVolumeTestJSON-555093534 tempest-AttachVolumeTestJSON-555093534-project] Lock "1daf4f4c-0e4a-4779-b53a-78c48397ea2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120740) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 18:06:23.676989 dv-cinder-852009-8-iscsi devstack@n-api.service[120740]: DEBUG dbcounter [-] [120740] Writing DB stats nova_cell1:SELECT=82,nova_cell1:UPDATE=2,nova_cell1:INSERT=1 {{(pid=120740) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 18:06:23.746877 dv-cinder-852009-8-iscsi devstack@n-api.service[120740]: DEBUG nova.policy [None req-c10866cc-a6da-492f-8b13-37cda07d002c tempest-AttachVolumeTestJSON-555093534 tempest-AttachVolumeTestJSON-555093534-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0625b3113ce044bbac4f6142eaade11c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a279fcbf274c4704a31a2b95061e1469', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120740) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 18:06:23.754979 dv-cinder-852009-8-iscsi devstack@n-api.service[120740]: INFO nova.api.openstack.requestlog [None req-c10866cc-a6da-492f-8b13-37cda07d002c tempest-AttachVolumeTestJSON-555093534 tempest-AttachVolumeTestJSON-555093534-project] 10.222.0.43 "GET /compute/v2.1/servers/d0983ec1-bb82-4a7d-9dba-ace1e3eb383a" status: 200 len: 1289 microversion: 2.1 time: 0.104794 Sep 13 18:06:23.755564 dv-cinder-852009-8-iscsi devstack@n-api.service[120740]: [pid: 120740|app: 0|req: 249/489] 10.222.0.43 () {58 vars in 1236 bytes} [Tue Sep 13 18:06:23 2022] GET /compute/v2.1/servers/d0983ec1-bb82-4a7d-9dba-ace1e3eb383a => generated 1289 bytes in 106 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 13 18:06:24.777871 dv-cinder-852009-8-iscsi devstack@n-api.service[120741]: DEBUG nova.api.openstack.wsgi [None req-59020140-c8ac-42c4-9682-7a64ee818235 tempest-AttachVolumeTestJSON-555093534 tempest-AttachVolumeTestJSON-555093534-project] Calling method '>' {{(pid=120741) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 18:06:24.779108 dv-cinder-852009-8-iscsi devstack@n-api.service[120741]: DEBUG nova.compute.api [None req-59020140-c8ac-42c4-9682-7a64ee818235 tempest-AttachVolumeTestJSON-555093534 tempest-AttachVolumeTestJSON-555093534-project] [instance: d0983ec1-bb82-4a7d-9dba-ace1e3eb383a] Fetching instance by UUID {{(pid=120741) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 18:06:24.786071 dv-cinder-852009-8-iscsi devstack@n-api.service[120741]: DEBUG oslo_concurrency.lockutils [None req-59020140-c8ac-42c4-9682-7a64ee818235 tempest-AttachVolumeTestJSON-555093534 tempest-AttachVolumeTestJSON-555093534-project] Acquiring lock "1daf4f4c-0e4a-4779-b53a-78c48397ea2f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120741) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 18:06:24.786531 dv-cinder-852009-8-iscsi devstack@n-api.service[120741]: DEBUG oslo_concurrency.lockutils [None req-59020140-c8ac-42c4-9682-7a64ee818235 tempest-AttachVolumeTestJSON-555093534 tempest-AttachVolumeTestJSON-555093534-project] Lock "1daf4f4c-0e4a-4779-b53a-78c48397ea2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120741) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 18:06:24.786953 dv-cinder-852009-8-iscsi devstack@n-api.service[120741]: DEBUG oslo_concurrency.lockutils [None req-59020140-c8ac-42c4-9682-7a64ee818235 tempest-AttachVolumeTestJSON-555093534 tempest-AttachVolumeTestJSON-555093534-project] Lock "1daf4f4c-0e4a-4779-b53a-78c48397ea2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120741) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 18:06:24.787687 dv-cinder-852009-8-iscsi devstack@n-api.service[120741]: DEBUG oslo_concurrency.lockutils [None req-59020140-c8ac-42c4-9682-7a64ee818235 tempest-AttachVolumeTestJSON-555093534 tempest-AttachVolumeTestJSON-555093534-project] Acquiring lock "1daf4f4c-0e4a-4779-b53a-78c48397ea2f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120741) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 18:06:24.788075 dv-cinder-852009-8-iscsi devstack@n-api.service[120741]: DEBUG oslo_concurrency.lockutils [None req-59020140-c8ac-42c4-9682-7a64ee818235 tempest-AttachVolumeTestJSON-555093534 tempest-AttachVolumeTestJSON-555093534-project] Lock "1daf4f4c-0e4a-4779-b53a-78c48397ea2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120741) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 18:06:24.788524 dv-cinder-852009-8-iscsi devstack@n-api.service[120741]: DEBUG oslo_concurrency.lockutils [None req-59020140-c8ac-42c4-9682-7a64ee818235 tempest-AttachVolumeTestJSON-555093534 tempest-AttachVolumeTestJSON-555093534-project] Lock "1daf4f4c-0e4a-4779-b53a-78c48397ea2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120741) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 18:06:24.920176 dv-cinder-852009-8-iscsi devstack@n-api.service[120741]: DEBUG nova.policy [None req-59020140-c8ac-42c4-9682-7a64ee818235 tempest-AttachVolumeTestJSON-555093534 tempest-AttachVolumeTestJSON-555093534-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0625b3113ce044bbac4f6142eaade11c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a279fcbf274c4704a31a2b95061e1469', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120741) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 18:06:24.927909 dv-cinder-852009-8-iscsi devstack@n-api.service[120741]: INFO nova.api.openstack.requestlog [None req-59020140-c8ac-42c4-9682-7a64ee818235 tempest-AttachVolumeTestJSON-555093534 tempest-AttachVolumeTestJSON-555093534-project] 10.222.0.43 "GET /compute/v2.1/servers/d0983ec1-bb82-4a7d-9dba-ace1e3eb383a" status: 200 len: 1363 microversion: 2.1 time: 0.153909 Sep 13 18:06:24.928505 dv-cinder-852009-8-iscsi devstack@n-api.service[120741]: [pid: 120741|app: 0|req: 241/490] 10.222.0.43 () {58 vars in 1236 bytes} [Tue Sep 13 18:06:24 2022] GET /compute/v2.1/servers/d0983ec1-bb82-4a7d-9dba-ace1e3eb383a => generated 1363 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 13 18:06:25.261522 dv-cinder-852009-8-iscsi devstack@n-api.service[120740]: DEBUG nova.api.openstack.wsgi [req-66dc1e61-51cf-4ba3-bbf0-76519d78e14f req-01352943-6b6d-4661-9ae9-e50bfd45be32 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "d0983ec1-bb82-4a7d-9dba-ace1e3eb383a", "tag": "074897ee-2ee0-4645-801c-17076daefc87"}]} {{(pid=120740) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 13 18:06:25.274815 dv-cinder-852009-8-iscsi devstack@n-api.service[120740]: DEBUG oslo_concurrency.lockutils [req-66dc1e61-51cf-4ba3-bbf0-76519d78e14f req-01352943-6b6d-4661-9ae9-e50bfd45be32 service nova] Acquiring lock "1daf4f4c-0e4a-4779-b53a-78c48397ea2f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120740) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 18:06:25.275659 dv-cinder-852009-8-iscsi devstack@n-api.service[120740]: DEBUG oslo_concurrency.lockutils [req-66dc1e61-51cf-4ba3-bbf0-76519d78e14f req-01352943-6b6d-4661-9ae9-e50bfd45be32 service nova] Lock "1daf4f4c-0e4a-4779-b53a-78c48397ea2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120740) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 18:06:25.276307 dv-cinder-852009-8-iscsi devstack@n-api.service[120740]: DEBUG oslo_concurrency.lockutils [req-66dc1e61-51cf-4ba3-bbf0-76519d78e14f req-01352943-6b6d-4661-9ae9-e50bfd45be32 service nova] Lock "1daf4f4c-0e4a-4779-b53a-78c48397ea2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120740) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 18:06:25.290804 dv-cinder-852009-8-iscsi devstack@n-api.service[120740]: INFO nova.api.openstack.compute.server_external_events [req-66dc1e61-51cf-4ba3-bbf0-76519d78e14f req-01352943-6b6d-4661-9ae9-e50bfd45be32 service nova] Creating event network-changed:074897ee-2ee0-4645-801c-17076daefc87 for instance d0983ec1-bb82-4a7d-9dba-ace1e3eb383a on hv-cinder-85200 Sep 13 18:06:25.295845 dv-cinder-852009-8-iscsi devstack@n-api.service[120740]: INFO nova.api.openstack.requestlog [req-66dc1e61-51cf-4ba3-bbf0-76519d78e14f req-01352943-6b6d-4661-9ae9-e50bfd45be32 service nova] 10.222.0.43 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.038230 Sep 13 18:06:25.296658 dv-cinder-852009-8-iscsi devstack@n-api.service[120740]: [pid: 120740|app: 0|req: 250/491] 10.222.0.43 () {64 vars in 1317 bytes} [Tue Sep 13 18:06:25 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 40 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Sep 13 18:06:25.951121 dv-cinder-852009-8-iscsi devstack@n-api.service[120741]: DEBUG nova.api.openstack.wsgi [None req-f62652ff-d5a8-446d-9a31-126b5c529e73 tempest-AttachVolumeTestJSON-555093534 tempest-AttachVolumeTestJSON-555093534-project] Calling method '>' {{(pid=120741) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 18:06:25.951771 dv-cinder-852009-8-iscsi devstack@n-api.service[120741]: DEBUG nova.compute.api [None req-f62652ff-d5a8-446d-9a31-126b5c529e73 tempest-AttachVolumeTestJSON-555093534 tempest-AttachVolumeTestJSON-555093534-project] [instance: d0983ec1-bb82-4a7d-9dba-ace1e3eb383a] Fetching instance by UUID {{(pid=120741) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 18:06:25.959015 dv-cinder-852009-8-iscsi devstack@n-api.service[120741]: DEBUG oslo_concurrency.lockutils [None req-f62652ff-d5a8-446d-9a31-126b5c529e73 tempest-AttachVolumeTestJSON-555093534 tempest-AttachVolumeTestJSON-555093534-project] Acquiring lock "1daf4f4c-0e4a-4779-b53a-78c48397ea2f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120741) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 18:06:25.959432 dv-cinder-852009-8-iscsi devstack@n-api.service[120741]: DEBUG oslo_concurrency.lockutils [None req-f62652ff-d5a8-446d-9a31-126b5c529e73 tempest-AttachVolumeTestJSON-555093534 tempest-AttachVolumeTestJSON-555093534-project] Lock "1daf4f4c-0e4a-4779-b53a-78c48397ea2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120741) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 18:06:25.959861 dv-cinder-852009-8-iscsi devstack@n-api.service[120741]: DEBUG oslo_concurrency.lockutils [None req-f62652ff-d5a8-446d-9a31-126b5c529e73 tempest-AttachVolumeTestJSON-555093534 tempest-AttachVolumeTestJSON-555093534-project] Lock "1daf4f4c-0e4a-4779-b53a-78c48397ea2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120741) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 18:06:25.960646 dv-cinder-852009-8-iscsi devstack@n-api.service[120741]: DEBUG oslo_concurrency.lockutils [None req-f62652ff-d5a8-446d-9a31-126b5c529e73 tempest-AttachVolumeTestJSON-555093534 tempest-AttachVolumeTestJSON-555093534-project] Acquiring lock "1daf4f4c-0e4a-4779-b53a-78c48397ea2f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120741) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 18:06:25.961079 dv-cinder-852009-8-iscsi devstack@n-api.service[120741]: DEBUG oslo_concurrency.lockutils [None req-f62652ff-d5a8-446d-9a31-126b5c529e73 tempest-AttachVolumeTestJSON-555093534 tempest-AttachVolumeTestJSON-555093534-project] Lock "1daf4f4c-0e4a-4779-b53a-78c48397ea2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120741) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 18:06:25.961497 dv-cinder-852009-8-iscsi devstack@n-api.service[120741]: DEBUG oslo_concurrency.lockutils [None req-f62652ff-d5a8-446d-9a31-126b5c529e73 tempest-AttachVolumeTestJSON-555093534 tempest-AttachVolumeTestJSON-555093534-project] Lock "1daf4f4c-0e4a-4779-b53a-78c48397ea2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120741) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 18:06:26.112481 dv-cinder-852009-8-iscsi devstack@n-api.service[120741]: DEBUG nova.policy [None req-f62652ff-d5a8-446d-9a31-126b5c529e73 tempest-AttachVolumeTestJSON-555093534 tempest-AttachVolumeTestJSON-555093534-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0625b3113ce044bbac4f6142eaade11c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a279fcbf274c4704a31a2b95061e1469', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120741) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 18:06:26.120387 dv-cinder-852009-8-iscsi devstack@n-api.service[120741]: INFO nova.api.openstack.requestlog [None req-f62652ff-d5a8-446d-9a31-126b5c529e73 tempest-AttachVolumeTestJSON-555093534 tempest-AttachVolumeTestJSON-555093534-project] 10.222.0.43 "GET /compute/v2.1/servers/d0983ec1-bb82-4a7d-9dba-ace1e3eb383a" status: 200 len: 1363 microversion: 2.1 time: 0.173371 Sep 13 18:06:26.121003 dv-cinder-852009-8-iscsi devstack@n-api.service[120741]: [pid: 120741|app: 0|req: 242/492] 10.222.0.43 () {58 vars in 1236 bytes} [Tue Sep 13 18:06:25 2022] GET /compute/v2.1/servers/d0983ec1-bb82-4a7d-9dba-ace1e3eb383a => generated 1363 bytes in 175 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 13 18:06:27.143806 dv-cinder-852009-8-iscsi devstack@n-api.service[120740]: DEBUG nova.api.openstack.wsgi [None req-3cf1e41b-fe73-4026-892f-1191354b917a tempest-AttachVolumeTestJSON-555093534 tempest-AttachVolumeTestJSON-555093534-project] Calling method '>' {{(pid=120740) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 18:06:27.145205 dv-cinder-852009-8-iscsi devstack@n-api.service[120740]: DEBUG nova.compute.api [None req-3cf1e41b-fe73-4026-892f-1191354b917a tempest-AttachVolumeTestJSON-555093534 tempest-AttachVolumeTestJSON-555093534-project] [instance: d0983ec1-bb82-4a7d-9dba-ace1e3eb383a] Fetching instance by UUID {{(pid=120740) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 18:06:27.151892 dv-cinder-852009-8-iscsi devstack@n-api.service[120740]: DEBUG oslo_concurrency.lockutils [None req-3cf1e41b-fe73-4026-892f-1191354b917a tempest-AttachVolumeTestJSON-555093534 tempest-AttachVolumeTestJSON-555093534-project] Acquiring lock "1daf4f4c-0e4a-4779-b53a-78c48397ea2f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120740) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 18:06:27.152379 dv-cinder-852009-8-iscsi devstack@n-api.service[120740]: DEBUG oslo_concurrency.lockutils [None req-3cf1e41b-fe73-4026-892f-1191354b917a tempest-AttachVolumeTestJSON-555093534 tempest-AttachVolumeTestJSON-555093534-project] Lock "1daf4f4c-0e4a-4779-b53a-78c48397ea2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120740) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 18:06:27.152846 dv-cinder-852009-8-iscsi devstack@n-api.service[120740]: DEBUG oslo_concurrency.lockutils [None req-3cf1e41b-fe73-4026-892f-1191354b917a tempest-AttachVolumeTestJSON-555093534 tempest-AttachVolumeTestJSON-555093534-project] Lock "1daf4f4c-0e4a-4779-b53a-78c48397ea2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120740) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 18:06:27.153528 dv-cinder-852009-8-iscsi devstack@n-api.service[120740]: DEBUG oslo_concurrency.lockutils [None req-3cf1e41b-fe73-4026-892f-1191354b917a tempest-AttachVolumeTestJSON-555093534 tempest-AttachVolumeTestJSON-555093534-project] Acquiring lock "1daf4f4c-0e4a-4779-b53a-78c48397ea2f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120740) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 18:06:27.153959 dv-cinder-852009-8-iscsi devstack@n-api.service[120740]: DEBUG oslo_concurrency.lockutils [None req-3cf1e41b-fe73-4026-892f-1191354b917a tempest-AttachVolumeTestJSON-555093534 tempest-AttachVolumeTestJSON-555093534-project] Lock "1daf4f4c-0e4a-4779-b53a-78c48397ea2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120740) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 18:06:27.154399 dv-cinder-852009-8-iscsi devstack@n-api.service[120740]: DEBUG oslo_concurrency.lockutils [None req-3cf1e41b-fe73-4026-892f-1191354b917a tempest-AttachVolumeTestJSON-555093534 tempest-AttachVolumeTestJSON-555093534-project] Lock "1daf4f4c-0e4a-4779-b53a-78c48397ea2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120740) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 18:06:27.290907 dv-cinder-852009-8-iscsi devstack@n-api.service[120740]: DEBUG nova.policy [None req-3cf1e41b-fe73-4026-892f-1191354b917a tempest-AttachVolumeTestJSON-555093534 tempest-AttachVolumeTestJSON-555093534-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0625b3113ce044bbac4f6142eaade11c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a279fcbf274c4704a31a2b95061e1469', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120740) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 18:06:27.299781 dv-cinder-852009-8-iscsi devstack@n-api.service[120740]: INFO nova.api.openstack.requestlog [None req-3cf1e41b-fe73-4026-892f-1191354b917a tempest-AttachVolumeTestJSON-555093534 tempest-AttachVolumeTestJSON-555093534-project] 10.222.0.43 "GET /compute/v2.1/servers/d0983ec1-bb82-4a7d-9dba-ace1e3eb383a" status: 200 len: 1363 microversion: 2.1 time: 0.160164 Sep 13 18:06:27.300388 dv-cinder-852009-8-iscsi devstack@n-api.service[120740]: [pid: 120740|app: 0|req: 251/493] 10.222.0.43 () {58 vars in 1236 bytes} [Tue Sep 13 18:06:27 2022] GET /compute/v2.1/servers/d0983ec1-bb82-4a7d-9dba-ace1e3eb383a => generated 1363 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 13 18:06:28.326371 dv-cinder-852009-8-iscsi devstack@n-api.service[120741]: DEBUG nova.api.openstack.wsgi [None req-3731fc9a-b5e8-4050-bb06-dee98a50d107 tempest-AttachVolumeTestJSON-555093534 tempest-AttachVolumeTestJSON-555093534-project] Calling method '>' {{(pid=120741) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 18:06:28.327245 dv-cinder-852009-8-iscsi devstack@n-api.service[120741]: DEBUG nova.compute.api [None req-3731fc9a-b5e8-4050-bb06-dee98a50d107 tempest-AttachVolumeTestJSON-555093534 tempest-AttachVolumeTestJSON-555093534-project] [instance: d0983ec1-bb82-4a7d-9dba-ace1e3eb383a] Fetching instance by UUID {{(pid=120741) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 18:06:28.336105 dv-cinder-852009-8-iscsi devstack@n-api.service[120741]: DEBUG oslo_concurrency.lockutils [None req-3731fc9a-b5e8-4050-bb06-dee98a50d107 tempest-AttachVolumeTestJSON-555093534 tempest-AttachVolumeTestJSON-555093534-project] Acquiring lock "1daf4f4c-0e4a-4779-b53a-78c48397ea2f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120741) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 18:06:28.336632 dv-cinder-852009-8-iscsi devstack@n-api.service[120741]: DEBUG oslo_concurrency.lockutils [None req-3731fc9a-b5e8-4050-bb06-dee98a50d107 tempest-AttachVolumeTestJSON-555093534 tempest-AttachVolumeTestJSON-555093534-project] Lock "1daf4f4c-0e4a-4779-b53a-78c48397ea2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120741) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 18:06:28.337062 dv-cinder-852009-8-iscsi devstack@n-api.service[120741]: DEBUG oslo_concurrency.lockutils [None req-3731fc9a-b5e8-4050-bb06-dee98a50d107 tempest-AttachVolumeTestJSON-555093534 tempest-AttachVolumeTestJSON-555093534-project] Lock "1daf4f4c-0e4a-4779-b53a-78c48397ea2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120741) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 18:06:28.337780 dv-cinder-852009-8-iscsi devstack@n-api.service[120741]: DEBUG oslo_concurrency.lockutils [None req-3731fc9a-b5e8-4050-bb06-dee98a50d107 tempest-AttachVolumeTestJSON-555093534 tempest-AttachVolumeTestJSON-555093534-project] Acquiring lock "1daf4f4c-0e4a-4779-b53a-78c48397ea2f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120741) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 18:06:28.338228 dv-cinder-852009-8-iscsi devstack@n-api.service[120741]: DEBUG oslo_concurrency.lockutils [None req-3731fc9a-b5e8-4050-bb06-dee98a50d107 tempest-AttachVolumeTestJSON-555093534 tempest-AttachVolumeTestJSON-555093534-project] Lock "1daf4f4c-0e4a-4779-b53a-78c48397ea2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120741) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 18:06:28.338645 dv-cinder-852009-8-iscsi devstack@n-api.service[120741]: DEBUG oslo_concurrency.lockutils [None req-3731fc9a-b5e8-4050-bb06-dee98a50d107 tempest-AttachVolumeTestJSON-555093534 tempest-AttachVolumeTestJSON-555093534-project] Lock "1daf4f4c-0e4a-4779-b53a-78c48397ea2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120741) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 18:06:28.472615 dv-cinder-852009-8-iscsi devstack@n-api.service[120741]: DEBUG nova.policy [None req-3731fc9a-b5e8-4050-bb06-dee98a50d107 tempest-AttachVolumeTestJSON-555093534 tempest-AttachVolumeTestJSON-555093534-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0625b3113ce044bbac4f6142eaade11c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a279fcbf274c4704a31a2b95061e1469', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120741) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 18:06:28.482994 dv-cinder-852009-8-iscsi devstack@n-api.service[120741]: INFO nova.api.openstack.requestlog [None req-3731fc9a-b5e8-4050-bb06-dee98a50d107 tempest-AttachVolumeTestJSON-555093534 tempest-AttachVolumeTestJSON-555093534-project] 10.222.0.43 "GET /compute/v2.1/servers/d0983ec1-bb82-4a7d-9dba-ace1e3eb383a" status: 200 len: 1363 microversion: 2.1 time: 0.162957 Sep 13 18:06:28.483859 dv-cinder-852009-8-iscsi devstack@n-api.service[120741]: [pid: 120741|app: 0|req: 243/494] 10.222.0.43 () {58 vars in 1236 bytes} [Tue Sep 13 18:06:28 2022] GET /compute/v2.1/servers/d0983ec1-bb82-4a7d-9dba-ace1e3eb383a => generated 1363 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 13 18:06:28.909669 dv-cinder-852009-8-iscsi devstack@n-api.service[120740]: DEBUG nova.api.openstack.wsgi [None req-b9d31485-6920-41b2-a65b-0d7683f59929 tempest-ServerRescueNegativeTestJSON-412251590 tempest-ServerRescueNegativeTestJSON-412251590-project] Calling method '>' {{(pid=120740) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 18:06:28.910213 dv-cinder-852009-8-iscsi devstack@n-api.service[120740]: DEBUG nova.compute.api [None req-b9d31485-6920-41b2-a65b-0d7683f59929 tempest-ServerRescueNegativeTestJSON-412251590 tempest-ServerRescueNegativeTestJSON-412251590-project] [instance: e8ce7158-6b73-4586-9f78-8e821988e71c] Fetching instance by UUID {{(pid=120740) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 18:06:28.917260 dv-cinder-852009-8-iscsi devstack@n-api.service[120740]: DEBUG oslo_concurrency.lockutils [None req-b9d31485-6920-41b2-a65b-0d7683f59929 tempest-ServerRescueNegativeTestJSON-412251590 tempest-ServerRescueNegativeTestJSON-412251590-project] Acquiring lock "1daf4f4c-0e4a-4779-b53a-78c48397ea2f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120740) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 18:06:28.917732 dv-cinder-852009-8-iscsi devstack@n-api.service[120740]: DEBUG oslo_concurrency.lockutils [None req-b9d31485-6920-41b2-a65b-0d7683f59929 tempest-ServerRescueNegativeTestJSON-412251590 tempest-ServerRescueNegativeTestJSON-412251590-project] Lock "1daf4f4c-0e4a-4779-b53a-78c48397ea2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120740) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 18:06:28.918156 dv-cinder-852009-8-iscsi devstack@n-api.service[120740]: DEBUG oslo_concurrency.lockutils [None req-b9d31485-6920-41b2-a65b-0d7683f59929 tempest-ServerRescueNegativeTestJSON-412251590 tempest-ServerRescueNegativeTestJSON-412251590-project] Lock "1daf4f4c-0e4a-4779-b53a-78c48397ea2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120740) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 18:06:28.918838 dv-cinder-852009-8-iscsi devstack@n-api.service[120740]: DEBUG oslo_concurrency.lockutils [None req-b9d31485-6920-41b2-a65b-0d7683f59929 tempest-ServerRescueNegativeTestJSON-412251590 tempest-ServerRescueNegativeTestJSON-412251590-project] Acquiring lock "1daf4f4c-0e4a-4779-b53a-78c48397ea2f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120740) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 18:06:28.919286 dv-cinder-852009-8-iscsi devstack@n-api.service[120740]: DEBUG oslo_concurrency.lockutils [None req-b9d31485-6920-41b2-a65b-0d7683f59929 tempest-ServerRescueNegativeTestJSON-412251590 tempest-ServerRescueNegativeTestJSON-412251590-project] Lock "1daf4f4c-0e4a-4779-b53a-78c48397ea2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120740) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 18:06:28.919701 dv-cinder-852009-8-iscsi devstack@n-api.service[120740]: DEBUG oslo_concurrency.lockutils [None req-b9d31485-6920-41b2-a65b-0d7683f59929 tempest-ServerRescueNegativeTestJSON-412251590 tempest-ServerRescueNegativeTestJSON-412251590-project] Lock "1daf4f4c-0e4a-4779-b53a-78c48397ea2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120740) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 18:06:29.000454 dv-cinder-852009-8-iscsi devstack@n-api.service[120740]: DEBUG nova.objects.instance [None req-b9d31485-6920-41b2-a65b-0d7683f59929 tempest-ServerRescueNegativeTestJSON-412251590 tempest-ServerRescueNegativeTestJSON-412251590-project] Lazy-loading 'services' on Instance uuid e8ce7158-6b73-4586-9f78-8e821988e71c {{(pid=120740) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Sep 13 18:06:29.083107 dv-cinder-852009-8-iscsi devstack@n-api.service[120740]: INFO nova.api.openstack.requestlog [None req-b9d31485-6920-41b2-a65b-0d7683f59929 tempest-ServerRescueNegativeTestJSON-412251590 tempest-ServerRescueNegativeTestJSON-412251590-project] 10.222.0.43 "DELETE /compute/v2.1/servers/e8ce7158-6b73-4586-9f78-8e821988e71c/os-volume_attachments/ed90df9f-4d34-4ffc-8a94-069e3f8558c1" status: 202 len: 0 microversion: 2.1 time: 0.177201 Sep 13 18:06:29.083707 dv-cinder-852009-8-iscsi devstack@n-api.service[120740]: [pid: 120740|app: 0|req: 252/495] 10.222.0.43 () {58 vars in 1416 bytes} [Tue Sep 13 18:06:28 2022] DELETE /compute/v2.1/servers/e8ce7158-6b73-4586-9f78-8e821988e71c/os-volume_attachments/ed90df9f-4d34-4ffc-8a94-069e3f8558c1 => generated 0 bytes in 179 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Sep 13 18:06:29.093889 dv-cinder-852009-8-iscsi devstack@n-api.service[120741]: DEBUG nova.api.openstack.wsgi [None req-5ad58aeb-0e61-41ac-99e0-ebe63cb0c91b tempest-ServerRescueNegativeTestJSON-412251590 tempest-ServerRescueNegativeTestJSON-412251590-project] Calling method '>' {{(pid=120741) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 18:06:29.096943 dv-cinder-852009-8-iscsi devstack@n-api.service[120741]: DEBUG nova.compute.api [None req-5ad58aeb-0e61-41ac-99e0-ebe63cb0c91b tempest-ServerRescueNegativeTestJSON-412251590 tempest-ServerRescueNegativeTestJSON-412251590-project] [instance: e8ce7158-6b73-4586-9f78-8e821988e71c] Fetching instance by UUID {{(pid=120741) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 18:06:29.104097 dv-cinder-852009-8-iscsi devstack@n-api.service[120741]: DEBUG oslo_concurrency.lockutils [None req-5ad58aeb-0e61-41ac-99e0-ebe63cb0c91b tempest-ServerRescueNegativeTestJSON-412251590 tempest-ServerRescueNegativeTestJSON-412251590-project] Acquiring lock "1daf4f4c-0e4a-4779-b53a-78c48397ea2f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120741) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 18:06:29.104780 dv-cinder-852009-8-iscsi devstack@n-api.service[120741]: DEBUG oslo_concurrency.lockutils [None req-5ad58aeb-0e61-41ac-99e0-ebe63cb0c91b tempest-ServerRescueNegativeTestJSON-412251590 tempest-ServerRescueNegativeTestJSON-412251590-project] Lock "1daf4f4c-0e4a-4779-b53a-78c48397ea2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120741) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 18:06:29.105286 dv-cinder-852009-8-iscsi devstack@n-api.service[120741]: DEBUG oslo_concurrency.lockutils [None req-5ad58aeb-0e61-41ac-99e0-ebe63cb0c91b tempest-ServerRescueNegativeTestJSON-412251590 tempest-ServerRescueNegativeTestJSON-412251590-project] Lock "1daf4f4c-0e4a-4779-b53a-78c48397ea2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120741) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 18:06:29.106754 dv-cinder-852009-8-iscsi devstack@n-api.service[120741]: DEBUG oslo_concurrency.lockutils [None req-5ad58aeb-0e61-41ac-99e0-ebe63cb0c91b tempest-ServerRescueNegativeTestJSON-412251590 tempest-ServerRescueNegativeTestJSON-412251590-project] Acquiring lock "1daf4f4c-0e4a-4779-b53a-78c48397ea2f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120741) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 18:06:29.107215 dv-cinder-852009-8-iscsi devstack@n-api.service[120741]: DEBUG oslo_concurrency.lockutils [None req-5ad58aeb-0e61-41ac-99e0-ebe63cb0c91b tempest-ServerRescueNegativeTestJSON-412251590 tempest-ServerRescueNegativeTestJSON-412251590-project] Lock "1daf4f4c-0e4a-4779-b53a-78c48397ea2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120741) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 18:06:29.107635 dv-cinder-852009-8-iscsi devstack@n-api.service[120741]: DEBUG oslo_concurrency.lockutils [None req-5ad58aeb-0e61-41ac-99e0-ebe63cb0c91b tempest-ServerRescueNegativeTestJSON-412251590 tempest-ServerRescueNegativeTestJSON-412251590-project] Lock "1daf4f4c-0e4a-4779-b53a-78c48397ea2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120741) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 18:06:29.142039 dv-cinder-852009-8-iscsi devstack@n-api.service[120741]: INFO nova.api.openstack.requestlog [None req-5ad58aeb-0e61-41ac-99e0-ebe63cb0c91b tempest-ServerRescueNegativeTestJSON-412251590 tempest-ServerRescueNegativeTestJSON-412251590-project] 10.222.0.43 "GET /compute/v2.1/servers/e8ce7158-6b73-4586-9f78-8e821988e71c/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.053817 Sep 13 18:06:29.142748 dv-cinder-852009-8-iscsi devstack@n-api.service[120741]: [pid: 120741|app: 0|req: 244/496] 10.222.0.43 () {58 vars in 1302 bytes} [Tue Sep 13 18:06:29 2022] GET /compute/v2.1/servers/e8ce7158-6b73-4586-9f78-8e821988e71c/os-volume_attachments => generated 197 bytes in 55 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 13 18:06:29.228684 dv-cinder-852009-8-iscsi devstack@n-api.service[120740]: DEBUG nova.api.openstack.wsgi [req-bf90d0b5-af3b-4909-88f7-30ea0883357a req-cc699a33-3639-43a3-b539-a68fcd66f2bc service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "d0983ec1-bb82-4a7d-9dba-ace1e3eb383a", "name": "network-vif-plugged", "status": "completed", "tag": "074897ee-2ee0-4645-801c-17076daefc87"}]} {{(pid=120740) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 13 18:06:29.238696 dv-cinder-852009-8-iscsi devstack@n-api.service[120740]: DEBUG oslo_concurrency.lockutils [req-bf90d0b5-af3b-4909-88f7-30ea0883357a req-cc699a33-3639-43a3-b539-a68fcd66f2bc service nova] Acquiring lock "1daf4f4c-0e4a-4779-b53a-78c48397ea2f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120740) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 18:06:29.239199 dv-cinder-852009-8-iscsi devstack@n-api.service[120740]: DEBUG oslo_concurrency.lockutils [req-bf90d0b5-af3b-4909-88f7-30ea0883357a req-cc699a33-3639-43a3-b539-a68fcd66f2bc service nova] Lock "1daf4f4c-0e4a-4779-b53a-78c48397ea2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120740) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 18:06:29.239645 dv-cinder-852009-8-iscsi devstack@n-api.service[120740]: DEBUG oslo_concurrency.lockutils [req-bf90d0b5-af3b-4909-88f7-30ea0883357a req-cc699a33-3639-43a3-b539-a68fcd66f2bc service nova] Lock "1daf4f4c-0e4a-4779-b53a-78c48397ea2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120740) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 18:06:29.252405 dv-cinder-852009-8-iscsi devstack@n-api.service[120740]: INFO nova.api.openstack.compute.server_external_events [req-bf90d0b5-af3b-4909-88f7-30ea0883357a req-cc699a33-3639-43a3-b539-a68fcd66f2bc service nova] Creating event network-vif-plugged:074897ee-2ee0-4645-801c-17076daefc87 for instance d0983ec1-bb82-4a7d-9dba-ace1e3eb383a on hv-cinder-85200 Sep 13 18:06:29.257259 dv-cinder-852009-8-iscsi devstack@n-api.service[120740]: INFO nova.api.openstack.requestlog [req-bf90d0b5-af3b-4909-88f7-30ea0883357a req-cc699a33-3639-43a3-b539-a68fcd66f2bc service nova] 10.222.0.43 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.032696 Sep 13 18:06:29.257831 dv-cinder-852009-8-iscsi devstack@n-api.service[120740]: [pid: 120740|app: 0|req: 253/497] 10.222.0.43 () {64 vars in 1317 bytes} [Tue Sep 13 18:06:29 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 34 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 13 18:06:29.518604 dv-cinder-852009-8-iscsi devstack@n-api.service[120741]: DEBUG nova.api.openstack.wsgi [None req-63b4f74e-8d35-472f-9781-98d9d57979df tempest-AttachVolumeTestJSON-555093534 tempest-AttachVolumeTestJSON-555093534-project] Calling method '>' {{(pid=120741) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 18:06:29.519473 dv-cinder-852009-8-iscsi devstack@n-api.service[120741]: DEBUG nova.compute.api [None req-63b4f74e-8d35-472f-9781-98d9d57979df tempest-AttachVolumeTestJSON-555093534 tempest-AttachVolumeTestJSON-555093534-project] [instance: d0983ec1-bb82-4a7d-9dba-ace1e3eb383a] Fetching instance by UUID {{(pid=120741) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 18:06:29.530315 dv-cinder-852009-8-iscsi devstack@n-api.service[120741]: DEBUG oslo_concurrency.lockutils [None req-63b4f74e-8d35-472f-9781-98d9d57979df tempest-AttachVolumeTestJSON-555093534 tempest-AttachVolumeTestJSON-555093534-project] Acquiring lock "1daf4f4c-0e4a-4779-b53a-78c48397ea2f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120741) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 18:06:29.531103 dv-cinder-852009-8-iscsi devstack@n-api.service[120741]: DEBUG oslo_concurrency.lockutils [None req-63b4f74e-8d35-472f-9781-98d9d57979df tempest-AttachVolumeTestJSON-555093534 tempest-AttachVolumeTestJSON-555093534-project] Lock "1daf4f4c-0e4a-4779-b53a-78c48397ea2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120741) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 18:06:29.531865 dv-cinder-852009-8-iscsi devstack@n-api.service[120741]: DEBUG oslo_concurrency.lockutils [None req-63b4f74e-8d35-472f-9781-98d9d57979df tempest-AttachVolumeTestJSON-555093534 tempest-AttachVolumeTestJSON-555093534-project] Lock "1daf4f4c-0e4a-4779-b53a-78c48397ea2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120741) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 18:06:29.533162 dv-cinder-852009-8-iscsi devstack@n-api.service[120741]: DEBUG oslo_concurrency.lockutils [None req-63b4f74e-8d35-472f-9781-98d9d57979df tempest-AttachVolumeTestJSON-555093534 tempest-AttachVolumeTestJSON-555093534-project] Acquiring lock "1daf4f4c-0e4a-4779-b53a-78c48397ea2f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120741) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 18:06:29.533926 dv-cinder-852009-8-iscsi devstack@n-api.service[120741]: DEBUG oslo_concurrency.lockutils [None req-63b4f74e-8d35-472f-9781-98d9d57979df tempest-AttachVolumeTestJSON-555093534 tempest-AttachVolumeTestJSON-555093534-project] Lock "1daf4f4c-0e4a-4779-b53a-78c48397ea2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120741) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 18:06:29.534625 dv-cinder-852009-8-iscsi devstack@n-api.service[120741]: DEBUG oslo_concurrency.lockutils [None req-63b4f74e-8d35-472f-9781-98d9d57979df tempest-AttachVolumeTestJSON-555093534 tempest-AttachVolumeTestJSON-555093534-project] Lock "1daf4f4c-0e4a-4779-b53a-78c48397ea2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120741) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 18:06:29.673187 dv-cinder-852009-8-iscsi devstack@n-api.service[120741]: DEBUG nova.policy [None req-63b4f74e-8d35-472f-9781-98d9d57979df tempest-AttachVolumeTestJSON-555093534 tempest-AttachVolumeTestJSON-555093534-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0625b3113ce044bbac4f6142eaade11c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a279fcbf274c4704a31a2b95061e1469', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120741) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 18:06:29.681122 dv-cinder-852009-8-iscsi devstack@n-api.service[120741]: INFO nova.api.openstack.requestlog [None req-63b4f74e-8d35-472f-9781-98d9d57979df tempest-AttachVolumeTestJSON-555093534 tempest-AttachVolumeTestJSON-555093534-project] 10.222.0.43 "GET /compute/v2.1/servers/d0983ec1-bb82-4a7d-9dba-ace1e3eb383a" status: 200 len: 1363 microversion: 2.1 time: 0.169248 Sep 13 18:06:29.681689 dv-cinder-852009-8-iscsi devstack@n-api.service[120741]: [pid: 120741|app: 0|req: 245/498] 10.222.0.43 () {58 vars in 1236 bytes} [Tue Sep 13 18:06:29 2022] GET /compute/v2.1/servers/d0983ec1-bb82-4a7d-9dba-ace1e3eb383a => generated 1363 bytes in 171 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 13 18:06:30.157737 dv-cinder-852009-8-iscsi devstack@n-api.service[120740]: DEBUG nova.api.openstack.wsgi [None req-db850b66-5c96-496b-b037-eeb0228357e7 tempest-ServerRescueNegativeTestJSON-412251590 tempest-ServerRescueNegativeTestJSON-412251590-project] Calling method '>' {{(pid=120740) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 18:06:30.161103 dv-cinder-852009-8-iscsi devstack@n-api.service[120740]: DEBUG nova.compute.api [None req-db850b66-5c96-496b-b037-eeb0228357e7 tempest-ServerRescueNegativeTestJSON-412251590 tempest-ServerRescueNegativeTestJSON-412251590-project] [instance: e8ce7158-6b73-4586-9f78-8e821988e71c] Fetching instance by UUID {{(pid=120740) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 18:06:30.167874 dv-cinder-852009-8-iscsi devstack@n-api.service[120740]: DEBUG oslo_concurrency.lockutils [None req-db850b66-5c96-496b-b037-eeb0228357e7 tempest-ServerRescueNegativeTestJSON-412251590 tempest-ServerRescueNegativeTestJSON-412251590-project] Acquiring lock "1daf4f4c-0e4a-4779-b53a-78c48397ea2f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120740) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 18:06:30.168326 dv-cinder-852009-8-iscsi devstack@n-api.service[120740]: DEBUG oslo_concurrency.lockutils [None req-db850b66-5c96-496b-b037-eeb0228357e7 tempest-ServerRescueNegativeTestJSON-412251590 tempest-ServerRescueNegativeTestJSON-412251590-project] Lock "1daf4f4c-0e4a-4779-b53a-78c48397ea2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120740) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 18:06:30.168788 dv-cinder-852009-8-iscsi devstack@n-api.service[120740]: DEBUG oslo_concurrency.lockutils [None req-db850b66-5c96-496b-b037-eeb0228357e7 tempest-ServerRescueNegativeTestJSON-412251590 tempest-ServerRescueNegativeTestJSON-412251590-project] Lock "1daf4f4c-0e4a-4779-b53a-78c48397ea2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120740) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 18:06:30.169507 dv-cinder-852009-8-iscsi devstack@n-api.service[120740]: DEBUG oslo_concurrency.lockutils [None req-db850b66-5c96-496b-b037-eeb0228357e7 tempest-ServerRescueNegativeTestJSON-412251590 tempest-ServerRescueNegativeTestJSON-412251590-project] Acquiring lock "1daf4f4c-0e4a-4779-b53a-78c48397ea2f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120740) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 18:06:30.170562 dv-cinder-852009-8-iscsi devstack@n-api.service[120740]: DEBUG oslo_concurrency.lockutils [None req-db850b66-5c96-496b-b037-eeb0228357e7 tempest-ServerRescueNegativeTestJSON-412251590 tempest-ServerRescueNegativeTestJSON-412251590-project] Lock "1daf4f4c-0e4a-4779-b53a-78c48397ea2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120740) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 18:06:30.170981 dv-cinder-852009-8-iscsi devstack@n-api.service[120740]: DEBUG oslo_concurrency.lockutils [None req-db850b66-5c96-496b-b037-eeb0228357e7 tempest-ServerRescueNegativeTestJSON-412251590 tempest-ServerRescueNegativeTestJSON-412251590-project] Lock "1daf4f4c-0e4a-4779-b53a-78c48397ea2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120740) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 18:06:30.205109 dv-cinder-852009-8-iscsi devstack@n-api.service[120740]: INFO nova.api.openstack.requestlog [None req-db850b66-5c96-496b-b037-eeb0228357e7 tempest-ServerRescueNegativeTestJSON-412251590 tempest-ServerRescueNegativeTestJSON-412251590-project] 10.222.0.43 "GET /compute/v2.1/servers/e8ce7158-6b73-4586-9f78-8e821988e71c/os-volume_attachments" status: 200 len: 25 microversion: 2.1 time: 0.053265 Sep 13 18:06:30.205679 dv-cinder-852009-8-iscsi devstack@n-api.service[120740]: [pid: 120740|app: 0|req: 254/499] 10.222.0.43 () {58 vars in 1302 bytes} [Tue Sep 13 18:06:30 2022] GET /compute/v2.1/servers/e8ce7158-6b73-4586-9f78-8e821988e71c/os-volume_attachments => generated 25 bytes in 55 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Sep 13 18:06:30.287893 dv-cinder-852009-8-iscsi devstack@n-api.service[120741]: DEBUG nova.api.openstack.wsgi [None req-6384728e-350e-4639-a9d9-c8e30578ccd4 tempest-ServerRescueNegativeTestJSON-412251590 tempest-ServerRescueNegativeTestJSON-412251590-project] Calling method '>' {{(pid=120741) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 18:06:30.288392 dv-cinder-852009-8-iscsi devstack@n-api.service[120741]: DEBUG nova.compute.api [None req-6384728e-350e-4639-a9d9-c8e30578ccd4 tempest-ServerRescueNegativeTestJSON-412251590 tempest-ServerRescueNegativeTestJSON-412251590-project] [instance: e8ce7158-6b73-4586-9f78-8e821988e71c] Fetching instance by UUID {{(pid=120741) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 18:06:30.294535 dv-cinder-852009-8-iscsi devstack@n-api.service[120741]: DEBUG oslo_concurrency.lockutils [None req-6384728e-350e-4639-a9d9-c8e30578ccd4 tempest-ServerRescueNegativeTestJSON-412251590 tempest-ServerRescueNegativeTestJSON-412251590-project] Acquiring lock "1daf4f4c-0e4a-4779-b53a-78c48397ea2f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120741) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 18:06:30.295013 dv-cinder-852009-8-iscsi devstack@n-api.service[120741]: DEBUG oslo_concurrency.lockutils [None req-6384728e-350e-4639-a9d9-c8e30578ccd4 tempest-ServerRescueNegativeTestJSON-412251590 tempest-ServerRescueNegativeTestJSON-412251590-project] Lock "1daf4f4c-0e4a-4779-b53a-78c48397ea2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120741) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 18:06:30.295438 dv-cinder-852009-8-iscsi devstack@n-api.service[120741]: DEBUG oslo_concurrency.lockutils [None req-6384728e-350e-4639-a9d9-c8e30578ccd4 tempest-ServerRescueNegativeTestJSON-412251590 tempest-ServerRescueNegativeTestJSON-412251590-project] Lock "1daf4f4c-0e4a-4779-b53a-78c48397ea2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120741) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 18:06:30.296124 dv-cinder-852009-8-iscsi devstack@n-api.service[120741]: DEBUG oslo_concurrency.lockutils [None req-6384728e-350e-4639-a9d9-c8e30578ccd4 tempest-ServerRescueNegativeTestJSON-412251590 tempest-ServerRescueNegativeTestJSON-412251590-project] Acquiring lock "1daf4f4c-0e4a-4779-b53a-78c48397ea2f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120741) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 18:06:30.296604 dv-cinder-852009-8-iscsi devstack@n-api.service[120741]: DEBUG oslo_concurrency.lockutils [None req-6384728e-350e-4639-a9d9-c8e30578ccd4 tempest-ServerRescueNegativeTestJSON-412251590 tempest-ServerRescueNegativeTestJSON-412251590-project] Lock "1daf4f4c-0e4a-4779-b53a-78c48397ea2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120741) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 18:06:30.297027 dv-cinder-852009-8-iscsi devstack@n-api.service[120741]: DEBUG oslo_concurrency.lockutils [None req-6384728e-350e-4639-a9d9-c8e30578ccd4 tempest-ServerRescueNegativeTestJSON-412251590 tempest-ServerRescueNegativeTestJSON-412251590-project] Lock "1daf4f4c-0e4a-4779-b53a-78c48397ea2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120741) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 18:06:30.315223 dv-cinder-852009-8-iscsi devstack@n-api.service[120741]: DEBUG dbcounter [-] [120741] Writing DB stats nova_cell1:SELECT=76,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=120741) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 18:06:30.323790 dv-cinder-852009-8-iscsi devstack@n-api.service[120741]: DEBUG nova.compute.api [None req-6384728e-350e-4639-a9d9-c8e30578ccd4 tempest-ServerRescueNegativeTestJSON-412251590 tempest-ServerRescueNegativeTestJSON-412251590-project] [instance: e8ce7158-6b73-4586-9f78-8e821988e71c] Going to try to terminate instance {{(pid=120741) delete /opt/stack/nova/nova/compute/api.py:2719}} Sep 13 18:06:30.401142 dv-cinder-852009-8-iscsi devstack@n-api.service[120741]: INFO nova.api.openstack.requestlog [None req-6384728e-350e-4639-a9d9-c8e30578ccd4 tempest-ServerRescueNegativeTestJSON-412251590 tempest-ServerRescueNegativeTestJSON-412251590-project] 10.222.0.43 "DELETE /compute/v2.1/servers/e8ce7158-6b73-4586-9f78-8e821988e71c" status: 204 len: 0 microversion: 2.1 time: 0.117003 Sep 13 18:06:30.401735 dv-cinder-852009-8-iscsi devstack@n-api.service[120741]: [pid: 120741|app: 0|req: 246/500] 10.222.0.43 () {58 vars in 1239 bytes} [Tue Sep 13 18:06:30 2022] DELETE /compute/v2.1/servers/e8ce7158-6b73-4586-9f78-8e821988e71c => generated 0 bytes in 118 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Sep 13 18:06:30.409741 dv-cinder-852009-8-iscsi devstack@n-api.service[120740]: DEBUG nova.api.openstack.wsgi [None req-87480d08-2997-4190-b38d-9df9c02be5a8 tempest-ServerRescueNegativeTestJSON-412251590 tempest-ServerRescueNegativeTestJSON-412251590-project] Calling method '>' {{(pid=120740) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 18:06:30.410348 dv-cinder-852009-8-iscsi devstack@n-api.service[120740]: DEBUG nova.compute.api [None req-87480d08-2997-4190-b38d-9df9c02be5a8 tempest-ServerRescueNegativeTestJSON-412251590 tempest-ServerRescueNegativeTestJSON-412251590-project] [instance: e8ce7158-6b73-4586-9f78-8e821988e71c] Fetching instance by UUID {{(pid=120740) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 18:06:30.416371 dv-cinder-852009-8-iscsi devstack@n-api.service[120740]: DEBUG oslo_concurrency.lockutils [None req-87480d08-2997-4190-b38d-9df9c02be5a8 tempest-ServerRescueNegativeTestJSON-412251590 tempest-ServerRescueNegativeTestJSON-412251590-project] Acquiring lock "1daf4f4c-0e4a-4779-b53a-78c48397ea2f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120740) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 18:06:30.416898 dv-cinder-852009-8-iscsi devstack@n-api.service[120740]: DEBUG oslo_concurrency.lockutils [None req-87480d08-2997-4190-b38d-9df9c02be5a8 tempest-ServerRescueNegativeTestJSON-412251590 tempest-ServerRescueNegativeTestJSON-412251590-project] Lock "1daf4f4c-0e4a-4779-b53a-78c48397ea2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120740) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 18:06:30.417344 dv-cinder-852009-8-iscsi devstack@n-api.service[120740]: DEBUG oslo_concurrency.lockutils [None req-87480d08-2997-4190-b38d-9df9c02be5a8 tempest-ServerRescueNegativeTestJSON-412251590 tempest-ServerRescueNegativeTestJSON-412251590-project] Lock "1daf4f4c-0e4a-4779-b53a-78c48397ea2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120740) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 18:06:30.418027 dv-cinder-852009-8-iscsi devstack@n-api.service[120740]: DEBUG oslo_concurrency.lockutils [None req-87480d08-2997-4190-b38d-9df9c02be5a8 tempest-ServerRescueNegativeTestJSON-412251590 tempest-ServerRescueNegativeTestJSON-412251590-project] Acquiring lock "1daf4f4c-0e4a-4779-b53a-78c48397ea2f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120740) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 18:06:30.418476 dv-cinder-852009-8-iscsi devstack@n-api.service[120740]: DEBUG oslo_concurrency.lockutils [None req-87480d08-2997-4190-b38d-9df9c02be5a8 tempest-ServerRescueNegativeTestJSON-412251590 tempest-ServerRescueNegativeTestJSON-412251590-project] Lock "1daf4f4c-0e4a-4779-b53a-78c48397ea2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120740) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 18:06:30.418919 dv-cinder-852009-8-iscsi devstack@n-api.service[120740]: DEBUG oslo_concurrency.lockutils [None req-87480d08-2997-4190-b38d-9df9c02be5a8 tempest-ServerRescueNegativeTestJSON-412251590 tempest-ServerRescueNegativeTestJSON-412251590-project] Lock "1daf4f4c-0e4a-4779-b53a-78c48397ea2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120740) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 18:06:30.540208 dv-cinder-852009-8-iscsi devstack@n-api.service[120741]: DEBUG nova.api.openstack.wsgi [None req-c58094c8-26e2-422f-a3d9-3cdbf6ea217c tempest-TestMinimumBasicScenario-820002800 tempest-TestMinimumBasicScenario-820002800-project] Action: 'action', calling method: >, body: {"reboot": {"type": "SOFT"}} {{(pid=120741) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 13 18:06:30.542529 dv-cinder-852009-8-iscsi devstack@n-api.service[120741]: DEBUG nova.compute.api [None req-c58094c8-26e2-422f-a3d9-3cdbf6ea217c tempest-TestMinimumBasicScenario-820002800 tempest-TestMinimumBasicScenario-820002800-project] [instance: f8247a13-94cd-45b2-acc8-8717e1260f37] Fetching instance by UUID {{(pid=120741) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 18:06:30.549215 dv-cinder-852009-8-iscsi devstack@n-api.service[120741]: DEBUG oslo_concurrency.lockutils [None req-c58094c8-26e2-422f-a3d9-3cdbf6ea217c tempest-TestMinimumBasicScenario-820002800 tempest-TestMinimumBasicScenario-820002800-project] Acquiring lock "1daf4f4c-0e4a-4779-b53a-78c48397ea2f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120741) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 18:06:30.549822 dv-cinder-852009-8-iscsi devstack@n-api.service[120741]: DEBUG oslo_concurrency.lockutils [None req-c58094c8-26e2-422f-a3d9-3cdbf6ea217c tempest-TestMinimumBasicScenario-820002800 tempest-TestMinimumBasicScenario-820002800-project] Lock "1daf4f4c-0e4a-4779-b53a-78c48397ea2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120741) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 18:06:30.550317 dv-cinder-852009-8-iscsi devstack@n-api.service[120741]: DEBUG oslo_concurrency.lockutils [None req-c58094c8-26e2-422f-a3d9-3cdbf6ea217c tempest-TestMinimumBasicScenario-820002800 tempest-TestMinimumBasicScenario-820002800-project] Lock "1daf4f4c-0e4a-4779-b53a-78c48397ea2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120741) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 18:06:30.551084 dv-cinder-852009-8-iscsi devstack@n-api.service[120741]: DEBUG oslo_concurrency.lockutils [None req-c58094c8-26e2-422f-a3d9-3cdbf6ea217c tempest-TestMinimumBasicScenario-820002800 tempest-TestMinimumBasicScenario-820002800-project] Acquiring lock "1daf4f4c-0e4a-4779-b53a-78c48397ea2f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120741) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 18:06:30.551683 dv-cinder-852009-8-iscsi devstack@n-api.service[120741]: DEBUG oslo_concurrency.lockutils [None req-c58094c8-26e2-422f-a3d9-3cdbf6ea217c tempest-TestMinimumBasicScenario-820002800 tempest-TestMinimumBasicScenario-820002800-project] Lock "1daf4f4c-0e4a-4779-b53a-78c48397ea2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120741) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 18:06:30.552112 dv-cinder-852009-8-iscsi devstack@n-api.service[120741]: DEBUG oslo_concurrency.lockutils [None req-c58094c8-26e2-422f-a3d9-3cdbf6ea217c tempest-TestMinimumBasicScenario-820002800 tempest-TestMinimumBasicScenario-820002800-project] Lock "1daf4f4c-0e4a-4779-b53a-78c48397ea2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120741) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 18:06:30.559302 dv-cinder-852009-8-iscsi devstack@n-api.service[120740]: DEBUG nova.policy [None req-87480d08-2997-4190-b38d-9df9c02be5a8 tempest-ServerRescueNegativeTestJSON-412251590 tempest-ServerRescueNegativeTestJSON-412251590-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '60800cf2774e409d9c1b6f4992669991', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2eae4acecf6c4961830ead78d71b2ad3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120740) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 18:06:30.567427 dv-cinder-852009-8-iscsi devstack@n-api.service[120740]: INFO nova.api.openstack.requestlog [None req-87480d08-2997-4190-b38d-9df9c02be5a8 tempest-ServerRescueNegativeTestJSON-412251590 tempest-ServerRescueNegativeTestJSON-412251590-project] 10.222.0.43 "GET /compute/v2.1/servers/e8ce7158-6b73-4586-9f78-8e821988e71c" status: 200 len: 1690 microversion: 2.1 time: 0.161399 Sep 13 18:06:30.567917 dv-cinder-852009-8-iscsi devstack@n-api.service[120740]: [pid: 120740|app: 0|req: 255/501] 10.222.0.43 () {58 vars in 1236 bytes} [Tue Sep 13 18:06:30 2022] GET /compute/v2.1/servers/e8ce7158-6b73-4586-9f78-8e821988e71c => generated 1690 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 13 18:06:30.628030 dv-cinder-852009-8-iscsi devstack@n-api.service[120741]: INFO nova.api.openstack.requestlog [None req-c58094c8-26e2-422f-a3d9-3cdbf6ea217c tempest-TestMinimumBasicScenario-820002800 tempest-TestMinimumBasicScenario-820002800-project] 10.222.0.43 "POST /compute/v2.1/servers/f8247a13-94cd-45b2-acc8-8717e1260f37/action" status: 202 len: 0 microversion: 2.1 time: 0.092008 Sep 13 18:06:30.628688 dv-cinder-852009-8-iscsi devstack@n-api.service[120741]: [pid: 120741|app: 0|req: 247/502] 10.222.0.43 () {60 vars in 1278 bytes} [Tue Sep 13 18:06:30 2022] POST /compute/v2.1/servers/f8247a13-94cd-45b2-acc8-8717e1260f37/action => generated 0 bytes in 94 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Sep 13 18:06:30.636887 dv-cinder-852009-8-iscsi devstack@n-api.service[120740]: DEBUG nova.api.openstack.wsgi [None req-57176480-42ab-4cbe-a9a0-a56dc622062f tempest-TestMinimumBasicScenario-820002800 tempest-TestMinimumBasicScenario-820002800-project] Calling method '>' {{(pid=120740) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 18:06:30.637524 dv-cinder-852009-8-iscsi devstack@n-api.service[120740]: DEBUG nova.compute.api [None req-57176480-42ab-4cbe-a9a0-a56dc622062f tempest-TestMinimumBasicScenario-820002800 tempest-TestMinimumBasicScenario-820002800-project] [instance: f8247a13-94cd-45b2-acc8-8717e1260f37] Fetching instance by UUID {{(pid=120740) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 18:06:30.644148 dv-cinder-852009-8-iscsi devstack@n-api.service[120740]: DEBUG oslo_concurrency.lockutils [None req-57176480-42ab-4cbe-a9a0-a56dc622062f tempest-TestMinimumBasicScenario-820002800 tempest-TestMinimumBasicScenario-820002800-project] Acquiring lock "1daf4f4c-0e4a-4779-b53a-78c48397ea2f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120740) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 18:06:30.644663 dv-cinder-852009-8-iscsi devstack@n-api.service[120740]: DEBUG oslo_concurrency.lockutils [None req-57176480-42ab-4cbe-a9a0-a56dc622062f tempest-TestMinimumBasicScenario-820002800 tempest-TestMinimumBasicScenario-820002800-project] Lock "1daf4f4c-0e4a-4779-b53a-78c48397ea2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120740) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 18:06:30.645125 dv-cinder-852009-8-iscsi devstack@n-api.service[120740]: DEBUG oslo_concurrency.lockutils [None req-57176480-42ab-4cbe-a9a0-a56dc622062f tempest-TestMinimumBasicScenario-820002800 tempest-TestMinimumBasicScenario-820002800-project] Lock "1daf4f4c-0e4a-4779-b53a-78c48397ea2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120740) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 18:06:30.645844 dv-cinder-852009-8-iscsi devstack@n-api.service[120740]: DEBUG oslo_concurrency.lockutils [None req-57176480-42ab-4cbe-a9a0-a56dc622062f tempest-TestMinimumBasicScenario-820002800 tempest-TestMinimumBasicScenario-820002800-project] Acquiring lock "1daf4f4c-0e4a-4779-b53a-78c48397ea2f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120740) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 18:06:30.646347 dv-cinder-852009-8-iscsi devstack@n-api.service[120740]: DEBUG oslo_concurrency.lockutils [None req-57176480-42ab-4cbe-a9a0-a56dc622062f tempest-TestMinimumBasicScenario-820002800 tempest-TestMinimumBasicScenario-820002800-project] Lock "1daf4f4c-0e4a-4779-b53a-78c48397ea2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120740) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 18:06:30.646770 dv-cinder-852009-8-iscsi devstack@n-api.service[120740]: DEBUG oslo_concurrency.lockutils [None req-57176480-42ab-4cbe-a9a0-a56dc622062f tempest-TestMinimumBasicScenario-820002800 tempest-TestMinimumBasicScenario-820002800-project] Lock "1daf4f4c-0e4a-4779-b53a-78c48397ea2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120740) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 18:06:30.703825 dv-cinder-852009-8-iscsi devstack@n-api.service[120741]: DEBUG nova.api.openstack.wsgi [None req-ba353b3a-d795-4d63-aed5-efdb3937f7f6 tempest-AttachVolumeTestJSON-555093534 tempest-AttachVolumeTestJSON-555093534-project] Calling method '>' {{(pid=120741) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 18:06:30.704650 dv-cinder-852009-8-iscsi devstack@n-api.service[120741]: DEBUG nova.compute.api [None req-ba353b3a-d795-4d63-aed5-efdb3937f7f6 tempest-AttachVolumeTestJSON-555093534 tempest-AttachVolumeTestJSON-555093534-project] [instance: d0983ec1-bb82-4a7d-9dba-ace1e3eb383a] Fetching instance by UUID {{(pid=120741) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 18:06:30.711107 dv-cinder-852009-8-iscsi devstack@n-api.service[120741]: DEBUG oslo_concurrency.lockutils [None req-ba353b3a-d795-4d63-aed5-efdb3937f7f6 tempest-AttachVolumeTestJSON-555093534 tempest-AttachVolumeTestJSON-555093534-project] Acquiring lock "1daf4f4c-0e4a-4779-b53a-78c48397ea2f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120741) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 18:06:30.711586 dv-cinder-852009-8-iscsi devstack@n-api.service[120741]: DEBUG oslo_concurrency.lockutils [None req-ba353b3a-d795-4d63-aed5-efdb3937f7f6 tempest-AttachVolumeTestJSON-555093534 tempest-AttachVolumeTestJSON-555093534-project] Lock "1daf4f4c-0e4a-4779-b53a-78c48397ea2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120741) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 18:06:30.712008 dv-cinder-852009-8-iscsi devstack@n-api.service[120741]: DEBUG oslo_concurrency.lockutils [None req-ba353b3a-d795-4d63-aed5-efdb3937f7f6 tempest-AttachVolumeTestJSON-555093534 tempest-AttachVolumeTestJSON-555093534-project] Lock "1daf4f4c-0e4a-4779-b53a-78c48397ea2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120741) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 18:06:30.712725 dv-cinder-852009-8-iscsi devstack@n-api.service[120741]: DEBUG oslo_concurrency.lockutils [None req-ba353b3a-d795-4d63-aed5-efdb3937f7f6 tempest-AttachVolumeTestJSON-555093534 tempest-AttachVolumeTestJSON-555093534-project] Acquiring lock "1daf4f4c-0e4a-4779-b53a-78c48397ea2f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120741) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 18:06:30.713173 dv-cinder-852009-8-iscsi devstack@n-api.service[120741]: DEBUG oslo_concurrency.lockutils [None req-ba353b3a-d795-4d63-aed5-efdb3937f7f6 tempest-AttachVolumeTestJSON-555093534 tempest-AttachVolumeTestJSON-555093534-project] Lock "1daf4f4c-0e4a-4779-b53a-78c48397ea2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120741) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 18:06:30.714001 dv-cinder-852009-8-iscsi devstack@n-api.service[120741]: DEBUG oslo_concurrency.lockutils [None req-ba353b3a-d795-4d63-aed5-efdb3937f7f6 tempest-AttachVolumeTestJSON-555093534 tempest-AttachVolumeTestJSON-555093534-project] Lock "1daf4f4c-0e4a-4779-b53a-78c48397ea2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120741) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 18:06:30.834021 dv-cinder-852009-8-iscsi devstack@n-api.service[120740]: DEBUG nova.policy [None req-57176480-42ab-4cbe-a9a0-a56dc622062f tempest-TestMinimumBasicScenario-820002800 tempest-TestMinimumBasicScenario-820002800-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7880064ff0aa448d9c367c89eba145ff', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2f6832936c824066a4370cc45c5b0282', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120740) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 18:06:30.842917 dv-cinder-852009-8-iscsi devstack@n-api.service[120740]: INFO nova.api.openstack.requestlog [None req-57176480-42ab-4cbe-a9a0-a56dc622062f tempest-TestMinimumBasicScenario-820002800 tempest-TestMinimumBasicScenario-820002800-project] 10.222.0.43 "GET /compute/v2.1/servers/f8247a13-94cd-45b2-acc8-8717e1260f37" status: 200 len: 1753 microversion: 2.1 time: 0.209794 Sep 13 18:06:30.843495 dv-cinder-852009-8-iscsi devstack@n-api.service[120740]: [pid: 120740|app: 0|req: 256/503] 10.222.0.43 () {58 vars in 1236 bytes} [Tue Sep 13 18:06:30 2022] GET /compute/v2.1/servers/f8247a13-94cd-45b2-acc8-8717e1260f37 => generated 1753 bytes in 211 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 13 18:06:30.877728 dv-cinder-852009-8-iscsi devstack@n-api.service[120741]: DEBUG nova.policy [None req-ba353b3a-d795-4d63-aed5-efdb3937f7f6 tempest-AttachVolumeTestJSON-555093534 tempest-AttachVolumeTestJSON-555093534-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0625b3113ce044bbac4f6142eaade11c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a279fcbf274c4704a31a2b95061e1469', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120741) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 18:06:30.886212 dv-cinder-852009-8-iscsi devstack@n-api.service[120741]: INFO nova.api.openstack.requestlog [None req-ba353b3a-d795-4d63-aed5-efdb3937f7f6 tempest-AttachVolumeTestJSON-555093534 tempest-AttachVolumeTestJSON-555093534-project] 10.222.0.43 "GET /compute/v2.1/servers/d0983ec1-bb82-4a7d-9dba-ace1e3eb383a" status: 200 len: 1363 microversion: 2.1 time: 0.186681 Sep 13 18:06:30.886789 dv-cinder-852009-8-iscsi devstack@n-api.service[120741]: [pid: 120741|app: 0|req: 248/504] 10.222.0.43 () {58 vars in 1236 bytes} [Tue Sep 13 18:06:30 2022] GET /compute/v2.1/servers/d0983ec1-bb82-4a7d-9dba-ace1e3eb383a => generated 1363 bytes in 188 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 13 18:06:31.594770 dv-cinder-852009-8-iscsi devstack@n-api.service[120740]: DEBUG nova.api.openstack.wsgi [None req-d3550af7-f624-42d5-9ca0-943ec5058515 tempest-ServerRescueNegativeTestJSON-412251590 tempest-ServerRescueNegativeTestJSON-412251590-project] Calling method '>' {{(pid=120740) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 18:06:31.595731 dv-cinder-852009-8-iscsi devstack@n-api.service[120740]: DEBUG nova.compute.api [None req-d3550af7-f624-42d5-9ca0-943ec5058515 tempest-ServerRescueNegativeTestJSON-412251590 tempest-ServerRescueNegativeTestJSON-412251590-project] [instance: e8ce7158-6b73-4586-9f78-8e821988e71c] Fetching instance by UUID {{(pid=120740) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 18:06:31.599161 dv-cinder-852009-8-iscsi devstack@n-api.service[120740]: DEBUG dbcounter [-] [120740] Writing DB stats nova_cell0:SELECT=2 {{(pid=120740) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 18:06:31.599833 dv-cinder-852009-8-iscsi devstack@n-api.service[120740]: DEBUG dbcounter [-] [120740] Writing DB stats nova_cell0:SELECT=6 {{(pid=120740) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 18:06:31.606386 dv-cinder-852009-8-iscsi devstack@n-api.service[120740]: DEBUG oslo_concurrency.lockutils [None req-d3550af7-f624-42d5-9ca0-943ec5058515 tempest-ServerRescueNegativeTestJSON-412251590 tempest-ServerRescueNegativeTestJSON-412251590-project] Acquiring lock "1daf4f4c-0e4a-4779-b53a-78c48397ea2f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120740) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 18:06:31.606874 dv-cinder-852009-8-iscsi devstack@n-api.service[120740]: DEBUG oslo_concurrency.lockutils [None req-d3550af7-f624-42d5-9ca0-943ec5058515 tempest-ServerRescueNegativeTestJSON-412251590 tempest-ServerRescueNegativeTestJSON-412251590-project] Lock "1daf4f4c-0e4a-4779-b53a-78c48397ea2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120740) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 18:06:31.607311 dv-cinder-852009-8-iscsi devstack@n-api.service[120740]: DEBUG oslo_concurrency.lockutils [None req-d3550af7-f624-42d5-9ca0-943ec5058515 tempest-ServerRescueNegativeTestJSON-412251590 tempest-ServerRescueNegativeTestJSON-412251590-project] Lock "1daf4f4c-0e4a-4779-b53a-78c48397ea2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120740) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 18:06:31.608028 dv-cinder-852009-8-iscsi devstack@n-api.service[120740]: DEBUG oslo_concurrency.lockutils [None req-d3550af7-f624-42d5-9ca0-943ec5058515 tempest-ServerRescueNegativeTestJSON-412251590 tempest-ServerRescueNegativeTestJSON-412251590-project] Acquiring lock "1daf4f4c-0e4a-4779-b53a-78c48397ea2f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120740) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 18:06:31.608455 dv-cinder-852009-8-iscsi devstack@n-api.service[120740]: DEBUG oslo_concurrency.lockutils [None req-d3550af7-f624-42d5-9ca0-943ec5058515 tempest-ServerRescueNegativeTestJSON-412251590 tempest-ServerRescueNegativeTestJSON-412251590-project] Lock "1daf4f4c-0e4a-4779-b53a-78c48397ea2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120740) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 18:06:31.608902 dv-cinder-852009-8-iscsi devstack@n-api.service[120740]: DEBUG oslo_concurrency.lockutils [None req-d3550af7-f624-42d5-9ca0-943ec5058515 tempest-ServerRescueNegativeTestJSON-412251590 tempest-ServerRescueNegativeTestJSON-412251590-project] Lock "1daf4f4c-0e4a-4779-b53a-78c48397ea2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120740) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 18:06:31.743004 dv-cinder-852009-8-iscsi devstack@n-api.service[120740]: DEBUG nova.policy [None req-d3550af7-f624-42d5-9ca0-943ec5058515 tempest-ServerRescueNegativeTestJSON-412251590 tempest-ServerRescueNegativeTestJSON-412251590-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '60800cf2774e409d9c1b6f4992669991', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2eae4acecf6c4961830ead78d71b2ad3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120740) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 18:06:31.755516 dv-cinder-852009-8-iscsi devstack@n-api.service[120740]: INFO nova.api.openstack.requestlog [None req-d3550af7-f624-42d5-9ca0-943ec5058515 tempest-ServerRescueNegativeTestJSON-412251590 tempest-ServerRescueNegativeTestJSON-412251590-project] 10.222.0.43 "GET /compute/v2.1/servers/e8ce7158-6b73-4586-9f78-8e821988e71c" status: 200 len: 1690 microversion: 2.1 time: 0.167214 Sep 13 18:06:31.756094 dv-cinder-852009-8-iscsi devstack@n-api.service[120740]: [pid: 120740|app: 0|req: 257/505] 10.222.0.43 () {58 vars in 1236 bytes} [Tue Sep 13 18:06:31 2022] GET /compute/v2.1/servers/e8ce7158-6b73-4586-9f78-8e821988e71c => generated 1690 bytes in 169 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 13 18:06:31.871605 dv-cinder-852009-8-iscsi devstack@n-api.service[120741]: DEBUG nova.api.openstack.wsgi [None req-d8249067-f1c1-4d50-b5d6-0debe47ab35b tempest-TestMinimumBasicScenario-820002800 tempest-TestMinimumBasicScenario-820002800-project] Calling method '>' {{(pid=120741) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 18:06:31.872449 dv-cinder-852009-8-iscsi devstack@n-api.service[120741]: DEBUG nova.compute.api [None req-d8249067-f1c1-4d50-b5d6-0debe47ab35b tempest-TestMinimumBasicScenario-820002800 tempest-TestMinimumBasicScenario-820002800-project] [instance: f8247a13-94cd-45b2-acc8-8717e1260f37] Fetching instance by UUID {{(pid=120741) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 18:06:31.882436 dv-cinder-852009-8-iscsi devstack@n-api.service[120741]: DEBUG oslo_concurrency.lockutils [None req-d8249067-f1c1-4d50-b5d6-0debe47ab35b tempest-TestMinimumBasicScenario-820002800 tempest-TestMinimumBasicScenario-820002800-project] Acquiring lock "1daf4f4c-0e4a-4779-b53a-78c48397ea2f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120741) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 18:06:31.883226 dv-cinder-852009-8-iscsi devstack@n-api.service[120741]: DEBUG oslo_concurrency.lockutils [None req-d8249067-f1c1-4d50-b5d6-0debe47ab35b tempest-TestMinimumBasicScenario-820002800 tempest-TestMinimumBasicScenario-820002800-project] Lock "1daf4f4c-0e4a-4779-b53a-78c48397ea2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120741) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 18:06:31.883915 dv-cinder-852009-8-iscsi devstack@n-api.service[120741]: DEBUG oslo_concurrency.lockutils [None req-d8249067-f1c1-4d50-b5d6-0debe47ab35b tempest-TestMinimumBasicScenario-820002800 tempest-TestMinimumBasicScenario-820002800-project] Lock "1daf4f4c-0e4a-4779-b53a-78c48397ea2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120741) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 18:06:31.885093 dv-cinder-852009-8-iscsi devstack@n-api.service[120741]: DEBUG oslo_concurrency.lockutils [None req-d8249067-f1c1-4d50-b5d6-0debe47ab35b tempest-TestMinimumBasicScenario-820002800 tempest-TestMinimumBasicScenario-820002800-project] Acquiring lock "1daf4f4c-0e4a-4779-b53a-78c48397ea2f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120741) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 18:06:31.885760 dv-cinder-852009-8-iscsi devstack@n-api.service[120741]: DEBUG oslo_concurrency.lockutils [None req-d8249067-f1c1-4d50-b5d6-0debe47ab35b tempest-TestMinimumBasicScenario-820002800 tempest-TestMinimumBasicScenario-820002800-project] Lock "1daf4f4c-0e4a-4779-b53a-78c48397ea2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120741) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 18:06:31.886433 dv-cinder-852009-8-iscsi devstack@n-api.service[120741]: DEBUG oslo_concurrency.lockutils [None req-d8249067-f1c1-4d50-b5d6-0debe47ab35b tempest-TestMinimumBasicScenario-820002800 tempest-TestMinimumBasicScenario-820002800-project] Lock "1daf4f4c-0e4a-4779-b53a-78c48397ea2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120741) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 18:06:31.909149 dv-cinder-852009-8-iscsi devstack@n-api.service[120740]: DEBUG nova.api.openstack.wsgi [None req-3ba7c372-7e48-41ff-8fcf-03a3743cb69b tempest-AttachVolumeTestJSON-555093534 tempest-AttachVolumeTestJSON-555093534-project] Calling method '>' {{(pid=120740) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 18:06:31.909769 dv-cinder-852009-8-iscsi devstack@n-api.service[120740]: DEBUG nova.compute.api [None req-3ba7c372-7e48-41ff-8fcf-03a3743cb69b tempest-AttachVolumeTestJSON-555093534 tempest-AttachVolumeTestJSON-555093534-project] [instance: d0983ec1-bb82-4a7d-9dba-ace1e3eb383a] Fetching instance by UUID {{(pid=120740) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 18:06:31.915983 dv-cinder-852009-8-iscsi devstack@n-api.service[120740]: DEBUG oslo_concurrency.lockutils [None req-3ba7c372-7e48-41ff-8fcf-03a3743cb69b tempest-AttachVolumeTestJSON-555093534 tempest-AttachVolumeTestJSON-555093534-project] Acquiring lock "1daf4f4c-0e4a-4779-b53a-78c48397ea2f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120740) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 18:06:31.916472 dv-cinder-852009-8-iscsi devstack@n-api.service[120740]: DEBUG oslo_concurrency.lockutils [None req-3ba7c372-7e48-41ff-8fcf-03a3743cb69b tempest-AttachVolumeTestJSON-555093534 tempest-AttachVolumeTestJSON-555093534-project] Lock "1daf4f4c-0e4a-4779-b53a-78c48397ea2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120740) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 18:06:31.916954 dv-cinder-852009-8-iscsi devstack@n-api.service[120740]: DEBUG oslo_concurrency.lockutils [None req-3ba7c372-7e48-41ff-8fcf-03a3743cb69b tempest-AttachVolumeTestJSON-555093534 tempest-AttachVolumeTestJSON-555093534-project] Lock "1daf4f4c-0e4a-4779-b53a-78c48397ea2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120740) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 18:06:31.917630 dv-cinder-852009-8-iscsi devstack@n-api.service[120740]: DEBUG oslo_concurrency.lockutils [None req-3ba7c372-7e48-41ff-8fcf-03a3743cb69b tempest-AttachVolumeTestJSON-555093534 tempest-AttachVolumeTestJSON-555093534-project] Acquiring lock "1daf4f4c-0e4a-4779-b53a-78c48397ea2f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120740) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 18:06:31.918072 dv-cinder-852009-8-iscsi devstack@n-api.service[120740]: DEBUG oslo_concurrency.lockutils [None req-3ba7c372-7e48-41ff-8fcf-03a3743cb69b tempest-AttachVolumeTestJSON-555093534 tempest-AttachVolumeTestJSON-555093534-project] Lock "1daf4f4c-0e4a-4779-b53a-78c48397ea2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120740) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 18:06:31.918481 dv-cinder-852009-8-iscsi devstack@n-api.service[120740]: DEBUG oslo_concurrency.lockutils [None req-3ba7c372-7e48-41ff-8fcf-03a3743cb69b tempest-AttachVolumeTestJSON-555093534 tempest-AttachVolumeTestJSON-555093534-project] Lock "1daf4f4c-0e4a-4779-b53a-78c48397ea2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120740) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 18:06:32.096846 dv-cinder-852009-8-iscsi devstack@n-api.service[120740]: DEBUG nova.policy [None req-3ba7c372-7e48-41ff-8fcf-03a3743cb69b tempest-AttachVolumeTestJSON-555093534 tempest-AttachVolumeTestJSON-555093534-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0625b3113ce044bbac4f6142eaade11c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a279fcbf274c4704a31a2b95061e1469', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120740) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 18:06:32.101970 dv-cinder-852009-8-iscsi devstack@n-api.service[120741]: DEBUG nova.policy [None req-d8249067-f1c1-4d50-b5d6-0debe47ab35b tempest-TestMinimumBasicScenario-820002800 tempest-TestMinimumBasicScenario-820002800-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7880064ff0aa448d9c367c89eba145ff', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2f6832936c824066a4370cc45c5b0282', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120741) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 18:06:32.104695 dv-cinder-852009-8-iscsi devstack@n-api.service[120740]: INFO nova.api.openstack.requestlog [None req-3ba7c372-7e48-41ff-8fcf-03a3743cb69b tempest-AttachVolumeTestJSON-555093534 tempest-AttachVolumeTestJSON-555093534-project] 10.222.0.43 "GET /compute/v2.1/servers/d0983ec1-bb82-4a7d-9dba-ace1e3eb383a" status: 200 len: 1363 microversion: 2.1 time: 0.199354 Sep 13 18:06:32.105481 dv-cinder-852009-8-iscsi devstack@n-api.service[120740]: [pid: 120740|app: 0|req: 258/506] 10.222.0.43 () {58 vars in 1236 bytes} [Tue Sep 13 18:06:31 2022] GET /compute/v2.1/servers/d0983ec1-bb82-4a7d-9dba-ace1e3eb383a => generated 1363 bytes in 201 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 13 18:06:32.110584 dv-cinder-852009-8-iscsi devstack@n-api.service[120741]: INFO nova.api.openstack.requestlog [None req-d8249067-f1c1-4d50-b5d6-0debe47ab35b tempest-TestMinimumBasicScenario-820002800 tempest-TestMinimumBasicScenario-820002800-project] 10.222.0.43 "GET /compute/v2.1/servers/f8247a13-94cd-45b2-acc8-8717e1260f37" status: 200 len: 1753 microversion: 2.1 time: 0.245567 Sep 13 18:06:32.111146 dv-cinder-852009-8-iscsi devstack@n-api.service[120741]: [pid: 120741|app: 0|req: 249/507] 10.222.0.43 () {58 vars in 1236 bytes} [Tue Sep 13 18:06:31 2022] GET /compute/v2.1/servers/f8247a13-94cd-45b2-acc8-8717e1260f37 => generated 1753 bytes in 247 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 13 18:06:32.782222 dv-cinder-852009-8-iscsi devstack@n-api.service[120740]: DEBUG nova.api.openstack.wsgi [None req-00506718-91b4-43f0-bd8b-223d13c18234 tempest-ServerRescueNegativeTestJSON-412251590 tempest-ServerRescueNegativeTestJSON-412251590-project] Calling method '>' {{(pid=120740) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 18:06:32.783211 dv-cinder-852009-8-iscsi devstack@n-api.service[120740]: DEBUG nova.compute.api [None req-00506718-91b4-43f0-bd8b-223d13c18234 tempest-ServerRescueNegativeTestJSON-412251590 tempest-ServerRescueNegativeTestJSON-412251590-project] [instance: e8ce7158-6b73-4586-9f78-8e821988e71c] Fetching instance by UUID {{(pid=120740) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 18:06:32.794062 dv-cinder-852009-8-iscsi devstack@n-api.service[120740]: DEBUG oslo_concurrency.lockutils [None req-00506718-91b4-43f0-bd8b-223d13c18234 tempest-ServerRescueNegativeTestJSON-412251590 tempest-ServerRescueNegativeTestJSON-412251590-project] Acquiring lock "1daf4f4c-0e4a-4779-b53a-78c48397ea2f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120740) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 18:06:32.794877 dv-cinder-852009-8-iscsi devstack@n-api.service[120740]: DEBUG oslo_concurrency.lockutils [None req-00506718-91b4-43f0-bd8b-223d13c18234 tempest-ServerRescueNegativeTestJSON-412251590 tempest-ServerRescueNegativeTestJSON-412251590-project] Lock "1daf4f4c-0e4a-4779-b53a-78c48397ea2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120740) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 18:06:32.795590 dv-cinder-852009-8-iscsi devstack@n-api.service[120740]: DEBUG oslo_concurrency.lockutils [None req-00506718-91b4-43f0-bd8b-223d13c18234 tempest-ServerRescueNegativeTestJSON-412251590 tempest-ServerRescueNegativeTestJSON-412251590-project] Lock "1daf4f4c-0e4a-4779-b53a-78c48397ea2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120740) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 18:06:32.796902 dv-cinder-852009-8-iscsi devstack@n-api.service[120740]: DEBUG oslo_concurrency.lockutils [None req-00506718-91b4-43f0-bd8b-223d13c18234 tempest-ServerRescueNegativeTestJSON-412251590 tempest-ServerRescueNegativeTestJSON-412251590-project] Acquiring lock "1daf4f4c-0e4a-4779-b53a-78c48397ea2f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120740) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 18:06:32.797656 dv-cinder-852009-8-iscsi devstack@n-api.service[120740]: DEBUG oslo_concurrency.lockutils [None req-00506718-91b4-43f0-bd8b-223d13c18234 tempest-ServerRescueNegativeTestJSON-412251590 tempest-ServerRescueNegativeTestJSON-412251590-project] Lock "1daf4f4c-0e4a-4779-b53a-78c48397ea2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120740) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 18:06:32.798359 dv-cinder-852009-8-iscsi devstack@n-api.service[120740]: DEBUG oslo_concurrency.lockutils [None req-00506718-91b4-43f0-bd8b-223d13c18234 tempest-ServerRescueNegativeTestJSON-412251590 tempest-ServerRescueNegativeTestJSON-412251590-project] Lock "1daf4f4c-0e4a-4779-b53a-78c48397ea2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120740) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 18:06:32.936610 dv-cinder-852009-8-iscsi devstack@n-api.service[120740]: DEBUG nova.policy [None req-00506718-91b4-43f0-bd8b-223d13c18234 tempest-ServerRescueNegativeTestJSON-412251590 tempest-ServerRescueNegativeTestJSON-412251590-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '60800cf2774e409d9c1b6f4992669991', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2eae4acecf6c4961830ead78d71b2ad3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120740) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 18:06:32.945535 dv-cinder-852009-8-iscsi devstack@n-api.service[120740]: INFO nova.api.openstack.requestlog [None req-00506718-91b4-43f0-bd8b-223d13c18234 tempest-ServerRescueNegativeTestJSON-412251590 tempest-ServerRescueNegativeTestJSON-412251590-project] 10.222.0.43 "GET /compute/v2.1/servers/e8ce7158-6b73-4586-9f78-8e821988e71c" status: 200 len: 1690 microversion: 2.1 time: 0.169922 Sep 13 18:06:32.946094 dv-cinder-852009-8-iscsi devstack@n-api.service[120740]: [pid: 120740|app: 0|req: 259/508] 10.222.0.43 () {58 vars in 1236 bytes} [Tue Sep 13 18:06:32 2022] GET /compute/v2.1/servers/e8ce7158-6b73-4586-9f78-8e821988e71c => generated 1690 bytes in 171 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 13 18:06:33.131621 dv-cinder-852009-8-iscsi devstack@n-api.service[120741]: DEBUG nova.api.openstack.wsgi [None req-833c36b3-c7cb-43d6-885b-92539aae8801 tempest-AttachVolumeTestJSON-555093534 tempest-AttachVolumeTestJSON-555093534-project] Calling method '>' {{(pid=120741) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 18:06:33.132277 dv-cinder-852009-8-iscsi devstack@n-api.service[120741]: DEBUG nova.compute.api [None req-833c36b3-c7cb-43d6-885b-92539aae8801 tempest-AttachVolumeTestJSON-555093534 tempest-AttachVolumeTestJSON-555093534-project] [instance: d0983ec1-bb82-4a7d-9dba-ace1e3eb383a] Fetching instance by UUID {{(pid=120741) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 18:06:33.134654 dv-cinder-852009-8-iscsi devstack@n-api.service[120741]: DEBUG dbcounter [-] [120741] Writing DB stats nova_cell0:SELECT=6 {{(pid=120741) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 18:06:33.135879 dv-cinder-852009-8-iscsi devstack@n-api.service[120740]: DEBUG nova.api.openstack.wsgi [None req-ad5f2252-6194-4c6e-a83d-65019e78515c tempest-TestMinimumBasicScenario-820002800 tempest-TestMinimumBasicScenario-820002800-project] Calling method '>' {{(pid=120740) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 18:06:33.136609 dv-cinder-852009-8-iscsi devstack@n-api.service[120740]: DEBUG nova.compute.api [None req-ad5f2252-6194-4c6e-a83d-65019e78515c tempest-TestMinimumBasicScenario-820002800 tempest-TestMinimumBasicScenario-820002800-project] [instance: f8247a13-94cd-45b2-acc8-8717e1260f37] Fetching instance by UUID {{(pid=120740) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 18:06:33.142385 dv-cinder-852009-8-iscsi devstack@n-api.service[120741]: DEBUG oslo_concurrency.lockutils [None req-833c36b3-c7cb-43d6-885b-92539aae8801 tempest-AttachVolumeTestJSON-555093534 tempest-AttachVolumeTestJSON-555093534-project] Acquiring lock "1daf4f4c-0e4a-4779-b53a-78c48397ea2f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120741) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 18:06:33.142998 dv-cinder-852009-8-iscsi devstack@n-api.service[120741]: DEBUG oslo_concurrency.lockutils [None req-833c36b3-c7cb-43d6-885b-92539aae8801 tempest-AttachVolumeTestJSON-555093534 tempest-AttachVolumeTestJSON-555093534-project] Lock "1daf4f4c-0e4a-4779-b53a-78c48397ea2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120741) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 18:06:33.143498 dv-cinder-852009-8-iscsi devstack@n-api.service[120741]: DEBUG oslo_concurrency.lockutils [None req-833c36b3-c7cb-43d6-885b-92539aae8801 tempest-AttachVolumeTestJSON-555093534 tempest-AttachVolumeTestJSON-555093534-project] Lock "1daf4f4c-0e4a-4779-b53a-78c48397ea2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120741) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 18:06:33.143946 dv-cinder-852009-8-iscsi devstack@n-api.service[120740]: DEBUG oslo_concurrency.lockutils [None req-ad5f2252-6194-4c6e-a83d-65019e78515c tempest-TestMinimumBasicScenario-820002800 tempest-TestMinimumBasicScenario-820002800-project] Acquiring lock "1daf4f4c-0e4a-4779-b53a-78c48397ea2f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120740) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 18:06:33.144331 dv-cinder-852009-8-iscsi devstack@n-api.service[120741]: DEBUG oslo_concurrency.lockutils [None req-833c36b3-c7cb-43d6-885b-92539aae8801 tempest-AttachVolumeTestJSON-555093534 tempest-AttachVolumeTestJSON-555093534-project] Acquiring lock "1daf4f4c-0e4a-4779-b53a-78c48397ea2f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120741) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 18:06:33.144523 dv-cinder-852009-8-iscsi devstack@n-api.service[120740]: DEBUG oslo_concurrency.lockutils [None req-ad5f2252-6194-4c6e-a83d-65019e78515c tempest-TestMinimumBasicScenario-820002800 tempest-TestMinimumBasicScenario-820002800-project] Lock "1daf4f4c-0e4a-4779-b53a-78c48397ea2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120740) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 18:06:33.144882 dv-cinder-852009-8-iscsi devstack@n-api.service[120741]: DEBUG oslo_concurrency.lockutils [None req-833c36b3-c7cb-43d6-885b-92539aae8801 tempest-AttachVolumeTestJSON-555093534 tempest-AttachVolumeTestJSON-555093534-project] Lock "1daf4f4c-0e4a-4779-b53a-78c48397ea2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120741) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 18:06:33.145051 dv-cinder-852009-8-iscsi devstack@n-api.service[120740]: DEBUG oslo_concurrency.lockutils [None req-ad5f2252-6194-4c6e-a83d-65019e78515c tempest-TestMinimumBasicScenario-820002800 tempest-TestMinimumBasicScenario-820002800-project] Lock "1daf4f4c-0e4a-4779-b53a-78c48397ea2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120740) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 18:06:33.145397 dv-cinder-852009-8-iscsi devstack@n-api.service[120741]: DEBUG oslo_concurrency.lockutils [None req-833c36b3-c7cb-43d6-885b-92539aae8801 tempest-AttachVolumeTestJSON-555093534 tempest-AttachVolumeTestJSON-555093534-project] Lock "1daf4f4c-0e4a-4779-b53a-78c48397ea2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120741) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 18:06:33.145831 dv-cinder-852009-8-iscsi devstack@n-api.service[120740]: DEBUG oslo_concurrency.lockutils [None req-ad5f2252-6194-4c6e-a83d-65019e78515c tempest-TestMinimumBasicScenario-820002800 tempest-TestMinimumBasicScenario-820002800-project] Acquiring lock "1daf4f4c-0e4a-4779-b53a-78c48397ea2f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120740) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 18:06:33.146350 dv-cinder-852009-8-iscsi devstack@n-api.service[120740]: DEBUG oslo_concurrency.lockutils [None req-ad5f2252-6194-4c6e-a83d-65019e78515c tempest-TestMinimumBasicScenario-820002800 tempest-TestMinimumBasicScenario-820002800-project] Lock "1daf4f4c-0e4a-4779-b53a-78c48397ea2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120740) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 18:06:33.146836 dv-cinder-852009-8-iscsi devstack@n-api.service[120740]: DEBUG oslo_concurrency.lockutils [None req-ad5f2252-6194-4c6e-a83d-65019e78515c tempest-TestMinimumBasicScenario-820002800 tempest-TestMinimumBasicScenario-820002800-project] Lock "1daf4f4c-0e4a-4779-b53a-78c48397ea2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120740) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 18:06:33.350462 dv-cinder-852009-8-iscsi devstack@n-api.service[120741]: DEBUG nova.policy [None req-833c36b3-c7cb-43d6-885b-92539aae8801 tempest-AttachVolumeTestJSON-555093534 tempest-AttachVolumeTestJSON-555093534-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0625b3113ce044bbac4f6142eaade11c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a279fcbf274c4704a31a2b95061e1469', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120741) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 18:06:33.356532 dv-cinder-852009-8-iscsi devstack@n-api.service[120740]: DEBUG nova.policy [None req-ad5f2252-6194-4c6e-a83d-65019e78515c tempest-TestMinimumBasicScenario-820002800 tempest-TestMinimumBasicScenario-820002800-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7880064ff0aa448d9c367c89eba145ff', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2f6832936c824066a4370cc45c5b0282', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120740) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 18:06:33.358296 dv-cinder-852009-8-iscsi devstack@n-api.service[120741]: INFO nova.api.openstack.requestlog [None req-833c36b3-c7cb-43d6-885b-92539aae8801 tempest-AttachVolumeTestJSON-555093534 tempest-AttachVolumeTestJSON-555093534-project] 10.222.0.43 "GET /compute/v2.1/servers/d0983ec1-bb82-4a7d-9dba-ace1e3eb383a" status: 200 len: 1363 microversion: 2.1 time: 0.233578 Sep 13 18:06:33.358870 dv-cinder-852009-8-iscsi devstack@n-api.service[120741]: [pid: 120741|app: 0|req: 250/509] 10.222.0.43 () {58 vars in 1236 bytes} [Tue Sep 13 18:06:33 2022] GET /compute/v2.1/servers/d0983ec1-bb82-4a7d-9dba-ace1e3eb383a => generated 1363 bytes in 235 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 13 18:06:33.366799 dv-cinder-852009-8-iscsi devstack@n-api.service[120740]: INFO nova.api.openstack.requestlog [None req-ad5f2252-6194-4c6e-a83d-65019e78515c tempest-TestMinimumBasicScenario-820002800 tempest-TestMinimumBasicScenario-820002800-project] 10.222.0.43 "GET /compute/v2.1/servers/f8247a13-94cd-45b2-acc8-8717e1260f37" status: 200 len: 1753 microversion: 2.1 time: 0.235511 Sep 13 18:06:33.367364 dv-cinder-852009-8-iscsi devstack@n-api.service[120740]: [pid: 120740|app: 0|req: 260/510] 10.222.0.43 () {58 vars in 1236 bytes} [Tue Sep 13 18:06:33 2022] GET /compute/v2.1/servers/f8247a13-94cd-45b2-acc8-8717e1260f37 => generated 1753 bytes in 237 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 13 18:06:33.977541 dv-cinder-852009-8-iscsi devstack@n-api.service[120741]: DEBUG nova.api.openstack.wsgi [None req-6ff9de9b-6a0d-44ea-bf80-281a347e5814 tempest-ServerRescueNegativeTestJSON-412251590 tempest-ServerRescueNegativeTestJSON-412251590-project] Calling method '>' {{(pid=120741) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 18:06:33.978153 dv-cinder-852009-8-iscsi devstack@n-api.service[120741]: DEBUG nova.compute.api [None req-6ff9de9b-6a0d-44ea-bf80-281a347e5814 tempest-ServerRescueNegativeTestJSON-412251590 tempest-ServerRescueNegativeTestJSON-412251590-project] [instance: e8ce7158-6b73-4586-9f78-8e821988e71c] Fetching instance by UUID {{(pid=120741) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 18:06:33.984681 dv-cinder-852009-8-iscsi devstack@n-api.service[120741]: DEBUG oslo_concurrency.lockutils [None req-6ff9de9b-6a0d-44ea-bf80-281a347e5814 tempest-ServerRescueNegativeTestJSON-412251590 tempest-ServerRescueNegativeTestJSON-412251590-project] Acquiring lock "1daf4f4c-0e4a-4779-b53a-78c48397ea2f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120741) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 18:06:33.985176 dv-cinder-852009-8-iscsi devstack@n-api.service[120741]: DEBUG oslo_concurrency.lockutils [None req-6ff9de9b-6a0d-44ea-bf80-281a347e5814 tempest-ServerRescueNegativeTestJSON-412251590 tempest-ServerRescueNegativeTestJSON-412251590-project] Lock "1daf4f4c-0e4a-4779-b53a-78c48397ea2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120741) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 18:06:33.985608 dv-cinder-852009-8-iscsi devstack@n-api.service[120741]: DEBUG oslo_concurrency.lockutils [None req-6ff9de9b-6a0d-44ea-bf80-281a347e5814 tempest-ServerRescueNegativeTestJSON-412251590 tempest-ServerRescueNegativeTestJSON-412251590-project] Lock "1daf4f4c-0e4a-4779-b53a-78c48397ea2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120741) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 18:06:33.986303 dv-cinder-852009-8-iscsi devstack@n-api.service[120741]: DEBUG oslo_concurrency.lockutils [None req-6ff9de9b-6a0d-44ea-bf80-281a347e5814 tempest-ServerRescueNegativeTestJSON-412251590 tempest-ServerRescueNegativeTestJSON-412251590-project] Acquiring lock "1daf4f4c-0e4a-4779-b53a-78c48397ea2f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120741) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 18:06:33.986793 dv-cinder-852009-8-iscsi devstack@n-api.service[120741]: DEBUG oslo_concurrency.lockutils [None req-6ff9de9b-6a0d-44ea-bf80-281a347e5814 tempest-ServerRescueNegativeTestJSON-412251590 tempest-ServerRescueNegativeTestJSON-412251590-project] Lock "1daf4f4c-0e4a-4779-b53a-78c48397ea2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120741) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 18:06:33.987216 dv-cinder-852009-8-iscsi devstack@n-api.service[120741]: DEBUG oslo_concurrency.lockutils [None req-6ff9de9b-6a0d-44ea-bf80-281a347e5814 tempest-ServerRescueNegativeTestJSON-412251590 tempest-ServerRescueNegativeTestJSON-412251590-project] Lock "1daf4f4c-0e4a-4779-b53a-78c48397ea2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120741) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 18:06:34.122248 dv-cinder-852009-8-iscsi devstack@n-api.service[120741]: DEBUG nova.policy [None req-6ff9de9b-6a0d-44ea-bf80-281a347e5814 tempest-ServerRescueNegativeTestJSON-412251590 tempest-ServerRescueNegativeTestJSON-412251590-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '60800cf2774e409d9c1b6f4992669991', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2eae4acecf6c4961830ead78d71b2ad3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120741) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 18:06:34.131406 dv-cinder-852009-8-iscsi devstack@n-api.service[120741]: INFO nova.api.openstack.requestlog [None req-6ff9de9b-6a0d-44ea-bf80-281a347e5814 tempest-ServerRescueNegativeTestJSON-412251590 tempest-ServerRescueNegativeTestJSON-412251590-project] 10.222.0.43 "GET /compute/v2.1/servers/e8ce7158-6b73-4586-9f78-8e821988e71c" status: 200 len: 1690 microversion: 2.1 time: 0.158816 Sep 13 18:06:34.132014 dv-cinder-852009-8-iscsi devstack@n-api.service[120741]: [pid: 120741|app: 0|req: 251/511] 10.222.0.43 () {58 vars in 1236 bytes} [Tue Sep 13 18:06:33 2022] GET /compute/v2.1/servers/e8ce7158-6b73-4586-9f78-8e821988e71c => generated 1690 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 13 18:06:34.384102 dv-cinder-852009-8-iscsi devstack@n-api.service[120740]: DEBUG nova.api.openstack.wsgi [None req-27f480c9-b444-41b2-aa59-f36dda5e4e5a tempest-AttachVolumeTestJSON-555093534 tempest-AttachVolumeTestJSON-555093534-project] Calling method '>' {{(pid=120740) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 18:06:34.384847 dv-cinder-852009-8-iscsi devstack@n-api.service[120740]: DEBUG nova.compute.api [None req-27f480c9-b444-41b2-aa59-f36dda5e4e5a tempest-AttachVolumeTestJSON-555093534 tempest-AttachVolumeTestJSON-555093534-project] [instance: d0983ec1-bb82-4a7d-9dba-ace1e3eb383a] Fetching instance by UUID {{(pid=120740) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 18:06:34.390333 dv-cinder-852009-8-iscsi devstack@n-api.service[120741]: DEBUG nova.api.openstack.wsgi [None req-2157f252-165c-446b-a1bf-c79058402c88 tempest-TestMinimumBasicScenario-820002800 tempest-TestMinimumBasicScenario-820002800-project] Calling method '>' {{(pid=120741) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 18:06:34.390944 dv-cinder-852009-8-iscsi devstack@n-api.service[120741]: DEBUG nova.compute.api [None req-2157f252-165c-446b-a1bf-c79058402c88 tempest-TestMinimumBasicScenario-820002800 tempest-TestMinimumBasicScenario-820002800-project] [instance: f8247a13-94cd-45b2-acc8-8717e1260f37] Fetching instance by UUID {{(pid=120741) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 18:06:34.391844 dv-cinder-852009-8-iscsi devstack@n-api.service[120740]: DEBUG oslo_concurrency.lockutils [None req-27f480c9-b444-41b2-aa59-f36dda5e4e5a tempest-AttachVolumeTestJSON-555093534 tempest-AttachVolumeTestJSON-555093534-project] Acquiring lock "1daf4f4c-0e4a-4779-b53a-78c48397ea2f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120740) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 18:06:34.392348 dv-cinder-852009-8-iscsi devstack@n-api.service[120740]: DEBUG oslo_concurrency.lockutils [None req-27f480c9-b444-41b2-aa59-f36dda5e4e5a tempest-AttachVolumeTestJSON-555093534 tempest-AttachVolumeTestJSON-555093534-project] Lock "1daf4f4c-0e4a-4779-b53a-78c48397ea2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120740) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 18:06:34.393047 dv-cinder-852009-8-iscsi devstack@n-api.service[120740]: DEBUG oslo_concurrency.lockutils [None req-27f480c9-b444-41b2-aa59-f36dda5e4e5a tempest-AttachVolumeTestJSON-555093534 tempest-AttachVolumeTestJSON-555093534-project] Lock "1daf4f4c-0e4a-4779-b53a-78c48397ea2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120740) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 18:06:34.393757 dv-cinder-852009-8-iscsi devstack@n-api.service[120740]: DEBUG oslo_concurrency.lockutils [None req-27f480c9-b444-41b2-aa59-f36dda5e4e5a tempest-AttachVolumeTestJSON-555093534 tempest-AttachVolumeTestJSON-555093534-project] Acquiring lock "1daf4f4c-0e4a-4779-b53a-78c48397ea2f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120740) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 18:06:34.394205 dv-cinder-852009-8-iscsi devstack@n-api.service[120740]: DEBUG oslo_concurrency.lockutils [None req-27f480c9-b444-41b2-aa59-f36dda5e4e5a tempest-AttachVolumeTestJSON-555093534 tempest-AttachVolumeTestJSON-555093534-project] Lock "1daf4f4c-0e4a-4779-b53a-78c48397ea2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120740) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 18:06:34.394634 dv-cinder-852009-8-iscsi devstack@n-api.service[120740]: DEBUG oslo_concurrency.lockutils [None req-27f480c9-b444-41b2-aa59-f36dda5e4e5a tempest-AttachVolumeTestJSON-555093534 tempest-AttachVolumeTestJSON-555093534-project] Lock "1daf4f4c-0e4a-4779-b53a-78c48397ea2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120740) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 18:06:34.398866 dv-cinder-852009-8-iscsi devstack@n-api.service[120741]: DEBUG oslo_concurrency.lockutils [None req-2157f252-165c-446b-a1bf-c79058402c88 tempest-TestMinimumBasicScenario-820002800 tempest-TestMinimumBasicScenario-820002800-project] Acquiring lock "1daf4f4c-0e4a-4779-b53a-78c48397ea2f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120741) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 18:06:34.399355 dv-cinder-852009-8-iscsi devstack@n-api.service[120741]: DEBUG oslo_concurrency.lockutils [None req-2157f252-165c-446b-a1bf-c79058402c88 tempest-TestMinimumBasicScenario-820002800 tempest-TestMinimumBasicScenario-820002800-project] Lock "1daf4f4c-0e4a-4779-b53a-78c48397ea2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120741) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 18:06:34.401130 dv-cinder-852009-8-iscsi devstack@n-api.service[120741]: DEBUG oslo_concurrency.lockutils [None req-2157f252-165c-446b-a1bf-c79058402c88 tempest-TestMinimumBasicScenario-820002800 tempest-TestMinimumBasicScenario-820002800-project] Lock "1daf4f4c-0e4a-4779-b53a-78c48397ea2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120741) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 18:06:34.401130 dv-cinder-852009-8-iscsi devstack@n-api.service[120741]: DEBUG oslo_concurrency.lockutils [None req-2157f252-165c-446b-a1bf-c79058402c88 tempest-TestMinimumBasicScenario-820002800 tempest-TestMinimumBasicScenario-820002800-project] Acquiring lock "1daf4f4c-0e4a-4779-b53a-78c48397ea2f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120741) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 18:06:34.401130 dv-cinder-852009-8-iscsi devstack@n-api.service[120741]: DEBUG oslo_concurrency.lockutils [None req-2157f252-165c-446b-a1bf-c79058402c88 tempest-TestMinimumBasicScenario-820002800 tempest-TestMinimumBasicScenario-820002800-project] Lock "1daf4f4c-0e4a-4779-b53a-78c48397ea2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120741) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 18:06:34.401421 dv-cinder-852009-8-iscsi devstack@n-api.service[120741]: DEBUG oslo_concurrency.lockutils [None req-2157f252-165c-446b-a1bf-c79058402c88 tempest-TestMinimumBasicScenario-820002800 tempest-TestMinimumBasicScenario-820002800-project] Lock "1daf4f4c-0e4a-4779-b53a-78c48397ea2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120741) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 18:06:34.595527 dv-cinder-852009-8-iscsi devstack@n-api.service[120740]: DEBUG nova.policy [None req-27f480c9-b444-41b2-aa59-f36dda5e4e5a tempest-AttachVolumeTestJSON-555093534 tempest-AttachVolumeTestJSON-555093534-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0625b3113ce044bbac4f6142eaade11c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a279fcbf274c4704a31a2b95061e1469', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120740) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 18:06:34.603531 dv-cinder-852009-8-iscsi devstack@n-api.service[120740]: INFO nova.api.openstack.requestlog [None req-27f480c9-b444-41b2-aa59-f36dda5e4e5a tempest-AttachVolumeTestJSON-555093534 tempest-AttachVolumeTestJSON-555093534-project] 10.222.0.43 "GET /compute/v2.1/servers/d0983ec1-bb82-4a7d-9dba-ace1e3eb383a" status: 200 len: 1550 microversion: 2.1 time: 0.223556 Sep 13 18:06:34.604344 dv-cinder-852009-8-iscsi devstack@n-api.service[120741]: DEBUG nova.policy [None req-2157f252-165c-446b-a1bf-c79058402c88 tempest-TestMinimumBasicScenario-820002800 tempest-TestMinimumBasicScenario-820002800-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7880064ff0aa448d9c367c89eba145ff', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2f6832936c824066a4370cc45c5b0282', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120741) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 18:06:34.613463 dv-cinder-852009-8-iscsi devstack@n-api.service[120741]: INFO nova.api.openstack.requestlog [None req-2157f252-165c-446b-a1bf-c79058402c88 tempest-TestMinimumBasicScenario-820002800 tempest-TestMinimumBasicScenario-820002800-project] 10.222.0.43 "GET /compute/v2.1/servers/f8247a13-94cd-45b2-acc8-8717e1260f37" status: 200 len: 1753 microversion: 2.1 time: 0.227225 Sep 13 18:06:34.614202 dv-cinder-852009-8-iscsi devstack@n-api.service[120741]: [pid: 120741|app: 0|req: 252/512] 10.222.0.43 () {58 vars in 1236 bytes} [Tue Sep 13 18:06:34 2022] GET /compute/v2.1/servers/f8247a13-94cd-45b2-acc8-8717e1260f37 => generated 1753 bytes in 228 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 13 18:06:34.616786 dv-cinder-852009-8-iscsi devstack@n-api.service[120740]: [pid: 120740|app: 0|req: 261/513] 10.222.0.43 () {58 vars in 1236 bytes} [Tue Sep 13 18:06:34 2022] GET /compute/v2.1/servers/d0983ec1-bb82-4a7d-9dba-ace1e3eb383a => generated 1550 bytes in 237 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 13 18:06:34.626072 dv-cinder-852009-8-iscsi devstack@n-api.service[120741]: DEBUG nova.api.openstack.wsgi [None req-49577d88-c53f-41f3-88e8-faff003cd381 tempest-AttachVolumeTestJSON-555093534 tempest-AttachVolumeTestJSON-555093534-project] Calling method '>' {{(pid=120741) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 18:06:34.626611 dv-cinder-852009-8-iscsi devstack@n-api.service[120741]: DEBUG nova.compute.api [None req-49577d88-c53f-41f3-88e8-faff003cd381 tempest-AttachVolumeTestJSON-555093534 tempest-AttachVolumeTestJSON-555093534-project] [instance: d0983ec1-bb82-4a7d-9dba-ace1e3eb383a] Fetching instance by UUID {{(pid=120741) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 18:06:34.633145 dv-cinder-852009-8-iscsi devstack@n-api.service[120741]: DEBUG oslo_concurrency.lockutils [None req-49577d88-c53f-41f3-88e8-faff003cd381 tempest-AttachVolumeTestJSON-555093534 tempest-AttachVolumeTestJSON-555093534-project] Acquiring lock "1daf4f4c-0e4a-4779-b53a-78c48397ea2f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120741) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 18:06:34.633634 dv-cinder-852009-8-iscsi devstack@n-api.service[120741]: DEBUG oslo_concurrency.lockutils [None req-49577d88-c53f-41f3-88e8-faff003cd381 tempest-AttachVolumeTestJSON-555093534 tempest-AttachVolumeTestJSON-555093534-project] Lock "1daf4f4c-0e4a-4779-b53a-78c48397ea2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120741) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 18:06:34.634069 dv-cinder-852009-8-iscsi devstack@n-api.service[120741]: DEBUG oslo_concurrency.lockutils [None req-49577d88-c53f-41f3-88e8-faff003cd381 tempest-AttachVolumeTestJSON-555093534 tempest-AttachVolumeTestJSON-555093534-project] Lock "1daf4f4c-0e4a-4779-b53a-78c48397ea2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120741) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 18:06:34.634825 dv-cinder-852009-8-iscsi devstack@n-api.service[120741]: DEBUG oslo_concurrency.lockutils [None req-49577d88-c53f-41f3-88e8-faff003cd381 tempest-AttachVolumeTestJSON-555093534 tempest-AttachVolumeTestJSON-555093534-project] Acquiring lock "1daf4f4c-0e4a-4779-b53a-78c48397ea2f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120741) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 18:06:34.635877 dv-cinder-852009-8-iscsi devstack@n-api.service[120741]: DEBUG oslo_concurrency.lockutils [None req-49577d88-c53f-41f3-88e8-faff003cd381 tempest-AttachVolumeTestJSON-555093534 tempest-AttachVolumeTestJSON-555093534-project] Lock "1daf4f4c-0e4a-4779-b53a-78c48397ea2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120741) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 18:06:34.636333 dv-cinder-852009-8-iscsi devstack@n-api.service[120741]: DEBUG oslo_concurrency.lockutils [None req-49577d88-c53f-41f3-88e8-faff003cd381 tempest-AttachVolumeTestJSON-555093534 tempest-AttachVolumeTestJSON-555093534-project] Lock "1daf4f4c-0e4a-4779-b53a-78c48397ea2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120741) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 18:06:34.717865 dv-cinder-852009-8-iscsi devstack@n-api.service[120741]: INFO nova.api.openstack.requestlog [None req-49577d88-c53f-41f3-88e8-faff003cd381 tempest-AttachVolumeTestJSON-555093534 tempest-AttachVolumeTestJSON-555093534-project] 10.222.0.43 "GET /compute/v2.1/servers/d0983ec1-bb82-4a7d-9dba-ace1e3eb383a/os-interface" status: 200 len: 285 microversion: 2.1 time: 0.095743 Sep 13 18:06:34.718539 dv-cinder-852009-8-iscsi devstack@n-api.service[120741]: [pid: 120741|app: 0|req: 253/514] 10.222.0.43 () {58 vars in 1275 bytes} [Tue Sep 13 18:06:34 2022] GET /compute/v2.1/servers/d0983ec1-bb82-4a7d-9dba-ace1e3eb383a/os-interface => generated 285 bytes in 97 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 13 18:06:35.154828 dv-cinder-852009-8-iscsi devstack@n-api.service[120740]: DEBUG nova.api.openstack.wsgi [None req-6e455b37-716c-4f0b-9068-ac5d8da1796b tempest-ServerRescueNegativeTestJSON-412251590 tempest-ServerRescueNegativeTestJSON-412251590-project] Calling method '>' {{(pid=120740) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 18:06:35.155615 dv-cinder-852009-8-iscsi devstack@n-api.service[120740]: DEBUG nova.compute.api [None req-6e455b37-716c-4f0b-9068-ac5d8da1796b tempest-ServerRescueNegativeTestJSON-412251590 tempest-ServerRescueNegativeTestJSON-412251590-project] [instance: e8ce7158-6b73-4586-9f78-8e821988e71c] Fetching instance by UUID {{(pid=120740) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 18:06:35.162141 dv-cinder-852009-8-iscsi devstack@n-api.service[120740]: DEBUG oslo_concurrency.lockutils [None req-6e455b37-716c-4f0b-9068-ac5d8da1796b tempest-ServerRescueNegativeTestJSON-412251590 tempest-ServerRescueNegativeTestJSON-412251590-project] Acquiring lock "1daf4f4c-0e4a-4779-b53a-78c48397ea2f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120740) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 18:06:35.162855 dv-cinder-852009-8-iscsi devstack@n-api.service[120740]: DEBUG oslo_concurrency.lockutils [None req-6e455b37-716c-4f0b-9068-ac5d8da1796b tempest-ServerRescueNegativeTestJSON-412251590 tempest-ServerRescueNegativeTestJSON-412251590-project] Lock "1daf4f4c-0e4a-4779-b53a-78c48397ea2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120740) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 18:06:35.163432 dv-cinder-852009-8-iscsi devstack@n-api.service[120740]: DEBUG oslo_concurrency.lockutils [None req-6e455b37-716c-4f0b-9068-ac5d8da1796b tempest-ServerRescueNegativeTestJSON-412251590 tempest-ServerRescueNegativeTestJSON-412251590-project] Lock "1daf4f4c-0e4a-4779-b53a-78c48397ea2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120740) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 18:06:35.164236 dv-cinder-852009-8-iscsi devstack@n-api.service[120740]: DEBUG oslo_concurrency.lockutils [None req-6e455b37-716c-4f0b-9068-ac5d8da1796b tempest-ServerRescueNegativeTestJSON-412251590 tempest-ServerRescueNegativeTestJSON-412251590-project] Acquiring lock "1daf4f4c-0e4a-4779-b53a-78c48397ea2f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120740) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 18:06:35.164895 dv-cinder-852009-8-iscsi devstack@n-api.service[120740]: DEBUG oslo_concurrency.lockutils [None req-6e455b37-716c-4f0b-9068-ac5d8da1796b tempest-ServerRescueNegativeTestJSON-412251590 tempest-ServerRescueNegativeTestJSON-412251590-project] Lock "1daf4f4c-0e4a-4779-b53a-78c48397ea2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120740) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 18:06:35.165492 dv-cinder-852009-8-iscsi devstack@n-api.service[120740]: DEBUG oslo_concurrency.lockutils [None req-6e455b37-716c-4f0b-9068-ac5d8da1796b tempest-ServerRescueNegativeTestJSON-412251590 tempest-ServerRescueNegativeTestJSON-412251590-project] Lock "1daf4f4c-0e4a-4779-b53a-78c48397ea2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120740) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 18:06:35.501814 dv-cinder-852009-8-iscsi devstack@n-api.service[120740]: DEBUG nova.policy [None req-6e455b37-716c-4f0b-9068-ac5d8da1796b tempest-ServerRescueNegativeTestJSON-412251590 tempest-ServerRescueNegativeTestJSON-412251590-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '60800cf2774e409d9c1b6f4992669991', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2eae4acecf6c4961830ead78d71b2ad3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120740) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 18:06:35.510357 dv-cinder-852009-8-iscsi devstack@n-api.service[120740]: INFO nova.api.openstack.requestlog [None req-6e455b37-716c-4f0b-9068-ac5d8da1796b tempest-ServerRescueNegativeTestJSON-412251590 tempest-ServerRescueNegativeTestJSON-412251590-project] 10.222.0.43 "GET /compute/v2.1/servers/e8ce7158-6b73-4586-9f78-8e821988e71c" status: 200 len: 1690 microversion: 2.1 time: 0.359472 Sep 13 18:06:35.510939 dv-cinder-852009-8-iscsi devstack@n-api.service[120740]: [pid: 120740|app: 0|req: 262/515] 10.222.0.43 () {58 vars in 1236 bytes} [Tue Sep 13 18:06:35 2022] GET /compute/v2.1/servers/e8ce7158-6b73-4586-9f78-8e821988e71c => generated 1690 bytes in 361 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 13 18:06:35.638358 dv-cinder-852009-8-iscsi devstack@n-api.service[120741]: DEBUG nova.api.openstack.wsgi [None req-63c423f9-7dd0-47de-bd1d-c599933b16e0 tempest-TestMinimumBasicScenario-820002800 tempest-TestMinimumBasicScenario-820002800-project] Calling method '>' {{(pid=120741) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 18:06:35.640456 dv-cinder-852009-8-iscsi devstack@n-api.service[120741]: DEBUG nova.compute.api [None req-63c423f9-7dd0-47de-bd1d-c599933b16e0 tempest-TestMinimumBasicScenario-820002800 tempest-TestMinimumBasicScenario-820002800-project] [instance: f8247a13-94cd-45b2-acc8-8717e1260f37] Fetching instance by UUID {{(pid=120741) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 18:06:35.648912 dv-cinder-852009-8-iscsi devstack@n-api.service[120741]: DEBUG oslo_concurrency.lockutils [None req-63c423f9-7dd0-47de-bd1d-c599933b16e0 tempest-TestMinimumBasicScenario-820002800 tempest-TestMinimumBasicScenario-820002800-project] Acquiring lock "1daf4f4c-0e4a-4779-b53a-78c48397ea2f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120741) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 18:06:35.649701 dv-cinder-852009-8-iscsi devstack@n-api.service[120741]: DEBUG oslo_concurrency.lockutils [None req-63c423f9-7dd0-47de-bd1d-c599933b16e0 tempest-TestMinimumBasicScenario-820002800 tempest-TestMinimumBasicScenario-820002800-project] Lock "1daf4f4c-0e4a-4779-b53a-78c48397ea2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120741) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 18:06:35.650330 dv-cinder-852009-8-iscsi devstack@n-api.service[120741]: DEBUG oslo_concurrency.lockutils [None req-63c423f9-7dd0-47de-bd1d-c599933b16e0 tempest-TestMinimumBasicScenario-820002800 tempest-TestMinimumBasicScenario-820002800-project] Lock "1daf4f4c-0e4a-4779-b53a-78c48397ea2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120741) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 18:06:35.651878 dv-cinder-852009-8-iscsi devstack@n-api.service[120741]: DEBUG oslo_concurrency.lockutils [None req-63c423f9-7dd0-47de-bd1d-c599933b16e0 tempest-TestMinimumBasicScenario-820002800 tempest-TestMinimumBasicScenario-820002800-project] Acquiring lock "1daf4f4c-0e4a-4779-b53a-78c48397ea2f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120741) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 18:06:35.652658 dv-cinder-852009-8-iscsi devstack@n-api.service[120741]: DEBUG oslo_concurrency.lockutils [None req-63c423f9-7dd0-47de-bd1d-c599933b16e0 tempest-TestMinimumBasicScenario-820002800 tempest-TestMinimumBasicScenario-820002800-project] Lock "1daf4f4c-0e4a-4779-b53a-78c48397ea2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120741) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 18:06:35.653296 dv-cinder-852009-8-iscsi devstack@n-api.service[120741]: DEBUG oslo_concurrency.lockutils [None req-63c423f9-7dd0-47de-bd1d-c599933b16e0 tempest-TestMinimumBasicScenario-820002800 tempest-TestMinimumBasicScenario-820002800-project] Lock "1daf4f4c-0e4a-4779-b53a-78c48397ea2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120741) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 18:06:35.902586 dv-cinder-852009-8-iscsi devstack@n-api.service[120741]: DEBUG nova.policy [None req-63c423f9-7dd0-47de-bd1d-c599933b16e0 tempest-TestMinimumBasicScenario-820002800 tempest-TestMinimumBasicScenario-820002800-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7880064ff0aa448d9c367c89eba145ff', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2f6832936c824066a4370cc45c5b0282', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120741) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 18:06:35.916888 dv-cinder-852009-8-iscsi devstack@n-api.service[120740]: DEBUG nova.api.openstack.wsgi [req-4fd19325-ecc5-4989-872e-3749e1208067 req-3da60d86-3527-4fb5-9610-00ab54cecd0e service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "e8ce7158-6b73-4586-9f78-8e821988e71c", "name": "network-vif-deleted", "tag": "ea32c59b-537c-405f-b361-3a6b70e328d4"}]} {{(pid=120740) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 13 18:06:35.917838 dv-cinder-852009-8-iscsi devstack@n-api.service[120741]: INFO nova.api.openstack.requestlog [None req-63c423f9-7dd0-47de-bd1d-c599933b16e0 tempest-TestMinimumBasicScenario-820002800 tempest-TestMinimumBasicScenario-820002800-project] 10.222.0.43 "GET /compute/v2.1/servers/f8247a13-94cd-45b2-acc8-8717e1260f37" status: 200 len: 1753 microversion: 2.1 time: 0.283946 Sep 13 18:06:35.918626 dv-cinder-852009-8-iscsi devstack@n-api.service[120741]: [pid: 120741|app: 0|req: 254/516] 10.222.0.43 () {58 vars in 1236 bytes} [Tue Sep 13 18:06:35 2022] GET /compute/v2.1/servers/f8247a13-94cd-45b2-acc8-8717e1260f37 => generated 1753 bytes in 286 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 13 18:06:35.941997 dv-cinder-852009-8-iscsi devstack@n-api.service[120740]: DEBUG oslo_concurrency.lockutils [req-4fd19325-ecc5-4989-872e-3749e1208067 req-3da60d86-3527-4fb5-9610-00ab54cecd0e service nova] Acquiring lock "1daf4f4c-0e4a-4779-b53a-78c48397ea2f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120740) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 18:06:35.942898 dv-cinder-852009-8-iscsi devstack@n-api.service[120740]: DEBUG oslo_concurrency.lockutils [req-4fd19325-ecc5-4989-872e-3749e1208067 req-3da60d86-3527-4fb5-9610-00ab54cecd0e service nova] Lock "1daf4f4c-0e4a-4779-b53a-78c48397ea2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120740) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 18:06:35.943516 dv-cinder-852009-8-iscsi devstack@n-api.service[120740]: DEBUG oslo_concurrency.lockutils [req-4fd19325-ecc5-4989-872e-3749e1208067 req-3da60d86-3527-4fb5-9610-00ab54cecd0e service nova] Lock "1daf4f4c-0e4a-4779-b53a-78c48397ea2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120740) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 18:06:35.957095 dv-cinder-852009-8-iscsi devstack@n-api.service[120740]: INFO nova.api.openstack.compute.server_external_events [req-4fd19325-ecc5-4989-872e-3749e1208067 req-3da60d86-3527-4fb5-9610-00ab54cecd0e service nova] Creating event network-vif-deleted:ea32c59b-537c-405f-b361-3a6b70e328d4 for instance e8ce7158-6b73-4586-9f78-8e821988e71c on hv-cinder-85200 Sep 13 18:06:35.968094 dv-cinder-852009-8-iscsi devstack@n-api.service[120740]: INFO nova.api.openstack.requestlog [req-4fd19325-ecc5-4989-872e-3749e1208067 req-3da60d86-3527-4fb5-9610-00ab54cecd0e service nova] 10.222.0.43 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.057799 Sep 13 18:06:35.969186 dv-cinder-852009-8-iscsi devstack@n-api.service[120740]: [pid: 120740|app: 0|req: 263/517] 10.222.0.43 () {64 vars in 1317 bytes} [Tue Sep 13 18:06:35 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 60 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 13 18:06:36.104161 dv-cinder-852009-8-iscsi devstack@n-api.service[120741]: DEBUG nova.api.openstack.wsgi [req-c9a7d139-3fe4-49bc-9b4e-e1f7f089a76a req-588e0c9f-022e-4bdf-8238-18036a80a4c4 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "d0983ec1-bb82-4a7d-9dba-ace1e3eb383a", "tag": "074897ee-2ee0-4645-801c-17076daefc87"}]} {{(pid=120741) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 13 18:06:36.115697 dv-cinder-852009-8-iscsi devstack@n-api.service[120741]: DEBUG oslo_concurrency.lockutils [req-c9a7d139-3fe4-49bc-9b4e-e1f7f089a76a req-588e0c9f-022e-4bdf-8238-18036a80a4c4 service nova] Acquiring lock "1daf4f4c-0e4a-4779-b53a-78c48397ea2f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120741) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 18:06:36.116184 dv-cinder-852009-8-iscsi devstack@n-api.service[120741]: DEBUG oslo_concurrency.lockutils [req-c9a7d139-3fe4-49bc-9b4e-e1f7f089a76a req-588e0c9f-022e-4bdf-8238-18036a80a4c4 service nova] Lock "1daf4f4c-0e4a-4779-b53a-78c48397ea2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120741) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 18:06:36.117050 dv-cinder-852009-8-iscsi devstack@n-api.service[120741]: DEBUG oslo_concurrency.lockutils [req-c9a7d139-3fe4-49bc-9b4e-e1f7f089a76a req-588e0c9f-022e-4bdf-8238-18036a80a4c4 service nova] Lock "1daf4f4c-0e4a-4779-b53a-78c48397ea2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120741) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 18:06:36.138482 dv-cinder-852009-8-iscsi devstack@n-api.service[120741]: INFO nova.api.openstack.compute.server_external_events [req-c9a7d139-3fe4-49bc-9b4e-e1f7f089a76a req-588e0c9f-022e-4bdf-8238-18036a80a4c4 service nova] Creating event network-changed:074897ee-2ee0-4645-801c-17076daefc87 for instance d0983ec1-bb82-4a7d-9dba-ace1e3eb383a on hv-cinder-85200 Sep 13 18:06:36.149071 dv-cinder-852009-8-iscsi devstack@n-api.service[120741]: INFO nova.api.openstack.requestlog [req-c9a7d139-3fe4-49bc-9b4e-e1f7f089a76a req-588e0c9f-022e-4bdf-8238-18036a80a4c4 service nova] 10.222.0.43 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.049266 Sep 13 18:06:36.149950 dv-cinder-852009-8-iscsi devstack@n-api.service[120741]: [pid: 120741|app: 0|req: 255/518] 10.222.0.43 () {64 vars in 1317 bytes} [Tue Sep 13 18:06:36 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 51 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 13 18:06:36.535546 dv-cinder-852009-8-iscsi devstack@n-api.service[120740]: DEBUG nova.api.openstack.wsgi [None req-3d35c4c3-5e05-425e-8b0e-fc75bf89a4c6 tempest-ServerRescueNegativeTestJSON-412251590 tempest-ServerRescueNegativeTestJSON-412251590-project] Calling method '>' {{(pid=120740) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 18:06:36.536358 dv-cinder-852009-8-iscsi devstack@n-api.service[120740]: DEBUG nova.compute.api [None req-3d35c4c3-5e05-425e-8b0e-fc75bf89a4c6 tempest-ServerRescueNegativeTestJSON-412251590 tempest-ServerRescueNegativeTestJSON-412251590-project] [instance: e8ce7158-6b73-4586-9f78-8e821988e71c] Fetching instance by UUID {{(pid=120740) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 18:06:36.542888 dv-cinder-852009-8-iscsi devstack@n-api.service[120740]: DEBUG oslo_concurrency.lockutils [None req-3d35c4c3-5e05-425e-8b0e-fc75bf89a4c6 tempest-ServerRescueNegativeTestJSON-412251590 tempest-ServerRescueNegativeTestJSON-412251590-project] Acquiring lock "1daf4f4c-0e4a-4779-b53a-78c48397ea2f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120740) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 18:06:36.543516 dv-cinder-852009-8-iscsi devstack@n-api.service[120740]: DEBUG oslo_concurrency.lockutils [None req-3d35c4c3-5e05-425e-8b0e-fc75bf89a4c6 tempest-ServerRescueNegativeTestJSON-412251590 tempest-ServerRescueNegativeTestJSON-412251590-project] Lock "1daf4f4c-0e4a-4779-b53a-78c48397ea2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120740) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 18:06:36.544139 dv-cinder-852009-8-iscsi devstack@n-api.service[120740]: DEBUG oslo_concurrency.lockutils [None req-3d35c4c3-5e05-425e-8b0e-fc75bf89a4c6 tempest-ServerRescueNegativeTestJSON-412251590 tempest-ServerRescueNegativeTestJSON-412251590-project] Lock "1daf4f4c-0e4a-4779-b53a-78c48397ea2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120740) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 18:06:36.545041 dv-cinder-852009-8-iscsi devstack@n-api.service[120740]: DEBUG oslo_concurrency.lockutils [None req-3d35c4c3-5e05-425e-8b0e-fc75bf89a4c6 tempest-ServerRescueNegativeTestJSON-412251590 tempest-ServerRescueNegativeTestJSON-412251590-project] Acquiring lock "1daf4f4c-0e4a-4779-b53a-78c48397ea2f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120740) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 18:06:36.545724 dv-cinder-852009-8-iscsi devstack@n-api.service[120740]: DEBUG oslo_concurrency.lockutils [None req-3d35c4c3-5e05-425e-8b0e-fc75bf89a4c6 tempest-ServerRescueNegativeTestJSON-412251590 tempest-ServerRescueNegativeTestJSON-412251590-project] Lock "1daf4f4c-0e4a-4779-b53a-78c48397ea2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120740) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 18:06:36.546255 dv-cinder-852009-8-iscsi devstack@n-api.service[120740]: DEBUG oslo_concurrency.lockutils [None req-3d35c4c3-5e05-425e-8b0e-fc75bf89a4c6 tempest-ServerRescueNegativeTestJSON-412251590 tempest-ServerRescueNegativeTestJSON-412251590-project] Lock "1daf4f4c-0e4a-4779-b53a-78c48397ea2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120740) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 18:06:36.578755 dv-cinder-852009-8-iscsi devstack@n-api.service[120740]: DEBUG oslo_concurrency.lockutils [None req-3d35c4c3-5e05-425e-8b0e-fc75bf89a4c6 tempest-ServerRescueNegativeTestJSON-412251590 tempest-ServerRescueNegativeTestJSON-412251590-project] Acquiring lock "1daf4f4c-0e4a-4779-b53a-78c48397ea2f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120740) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 18:06:36.579749 dv-cinder-852009-8-iscsi devstack@n-api.service[120740]: DEBUG oslo_concurrency.lockutils [None req-3d35c4c3-5e05-425e-8b0e-fc75bf89a4c6 tempest-ServerRescueNegativeTestJSON-412251590 tempest-ServerRescueNegativeTestJSON-412251590-project] Lock "1daf4f4c-0e4a-4779-b53a-78c48397ea2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120740) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 18:06:36.579749 dv-cinder-852009-8-iscsi devstack@n-api.service[120740]: DEBUG oslo_concurrency.lockutils [None req-3d35c4c3-5e05-425e-8b0e-fc75bf89a4c6 tempest-ServerRescueNegativeTestJSON-412251590 tempest-ServerRescueNegativeTestJSON-412251590-project] Lock "1daf4f4c-0e4a-4779-b53a-78c48397ea2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120740) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 18:06:36.580023 dv-cinder-852009-8-iscsi devstack@n-api.service[120740]: DEBUG nova.objects.instance [None req-3d35c4c3-5e05-425e-8b0e-fc75bf89a4c6 tempest-ServerRescueNegativeTestJSON-412251590 tempest-ServerRescueNegativeTestJSON-412251590-project] Lazy-loading 'fault' on Instance uuid e8ce7158-6b73-4586-9f78-8e821988e71c {{(pid=120740) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Sep 13 18:06:36.621619 dv-cinder-852009-8-iscsi devstack@n-api.service[120740]: DEBUG nova.policy [None req-3d35c4c3-5e05-425e-8b0e-fc75bf89a4c6 tempest-ServerRescueNegativeTestJSON-412251590 tempest-ServerRescueNegativeTestJSON-412251590-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '60800cf2774e409d9c1b6f4992669991', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2eae4acecf6c4961830ead78d71b2ad3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120740) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 18:06:36.634780 dv-cinder-852009-8-iscsi devstack@n-api.service[120740]: INFO nova.api.openstack.requestlog [None req-3d35c4c3-5e05-425e-8b0e-fc75bf89a4c6 tempest-ServerRescueNegativeTestJSON-412251590 tempest-ServerRescueNegativeTestJSON-412251590-project] 10.222.0.43 "GET /compute/v2.1/servers/e8ce7158-6b73-4586-9f78-8e821988e71c" status: 200 len: 1336 microversion: 2.1 time: 0.104221 Sep 13 18:06:36.648872 dv-cinder-852009-8-iscsi devstack@n-api.service[120740]: [pid: 120740|app: 0|req: 264/519] 10.222.0.43 () {58 vars in 1236 bytes} [Tue Sep 13 18:06:36 2022] GET /compute/v2.1/servers/e8ce7158-6b73-4586-9f78-8e821988e71c => generated 1336 bytes in 119 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 13 18:06:36.942328 dv-cinder-852009-8-iscsi devstack@n-api.service[120741]: DEBUG nova.api.openstack.wsgi [None req-66b1d27b-c686-4399-bce7-a214f156a0b8 tempest-TestMinimumBasicScenario-820002800 tempest-TestMinimumBasicScenario-820002800-project] Calling method '>' {{(pid=120741) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 18:06:36.943012 dv-cinder-852009-8-iscsi devstack@n-api.service[120741]: DEBUG nova.compute.api [None req-66b1d27b-c686-4399-bce7-a214f156a0b8 tempest-TestMinimumBasicScenario-820002800 tempest-TestMinimumBasicScenario-820002800-project] [instance: f8247a13-94cd-45b2-acc8-8717e1260f37] Fetching instance by UUID {{(pid=120741) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 18:06:36.950675 dv-cinder-852009-8-iscsi devstack@n-api.service[120741]: DEBUG oslo_concurrency.lockutils [None req-66b1d27b-c686-4399-bce7-a214f156a0b8 tempest-TestMinimumBasicScenario-820002800 tempest-TestMinimumBasicScenario-820002800-project] Acquiring lock "1daf4f4c-0e4a-4779-b53a-78c48397ea2f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120741) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 18:06:36.951386 dv-cinder-852009-8-iscsi devstack@n-api.service[120741]: DEBUG oslo_concurrency.lockutils [None req-66b1d27b-c686-4399-bce7-a214f156a0b8 tempest-TestMinimumBasicScenario-820002800 tempest-TestMinimumBasicScenario-820002800-project] Lock "1daf4f4c-0e4a-4779-b53a-78c48397ea2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120741) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 18:06:36.951810 dv-cinder-852009-8-iscsi devstack@n-api.service[120741]: DEBUG oslo_concurrency.lockutils [None req-66b1d27b-c686-4399-bce7-a214f156a0b8 tempest-TestMinimumBasicScenario-820002800 tempest-TestMinimumBasicScenario-820002800-project] Lock "1daf4f4c-0e4a-4779-b53a-78c48397ea2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120741) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 18:06:36.952540 dv-cinder-852009-8-iscsi devstack@n-api.service[120741]: DEBUG oslo_concurrency.lockutils [None req-66b1d27b-c686-4399-bce7-a214f156a0b8 tempest-TestMinimumBasicScenario-820002800 tempest-TestMinimumBasicScenario-820002800-project] Acquiring lock "1daf4f4c-0e4a-4779-b53a-78c48397ea2f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120741) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 18:06:36.953132 dv-cinder-852009-8-iscsi devstack@n-api.service[120741]: DEBUG oslo_concurrency.lockutils [None req-66b1d27b-c686-4399-bce7-a214f156a0b8 tempest-TestMinimumBasicScenario-820002800 tempest-TestMinimumBasicScenario-820002800-project] Lock "1daf4f4c-0e4a-4779-b53a-78c48397ea2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120741) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 18:06:36.953710 dv-cinder-852009-8-iscsi devstack@n-api.service[120741]: DEBUG oslo_concurrency.lockutils [None req-66b1d27b-c686-4399-bce7-a214f156a0b8 tempest-TestMinimumBasicScenario-820002800 tempest-TestMinimumBasicScenario-820002800-project] Lock "1daf4f4c-0e4a-4779-b53a-78c48397ea2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120741) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 18:06:37.141513 dv-cinder-852009-8-iscsi devstack@n-api.service[120741]: DEBUG nova.policy [None req-66b1d27b-c686-4399-bce7-a214f156a0b8 tempest-TestMinimumBasicScenario-820002800 tempest-TestMinimumBasicScenario-820002800-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7880064ff0aa448d9c367c89eba145ff', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2f6832936c824066a4370cc45c5b0282', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120741) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 18:06:37.152369 dv-cinder-852009-8-iscsi devstack@n-api.service[120741]: INFO nova.api.openstack.requestlog [None req-66b1d27b-c686-4399-bce7-a214f156a0b8 tempest-TestMinimumBasicScenario-820002800 tempest-TestMinimumBasicScenario-820002800-project] 10.222.0.43 "GET /compute/v2.1/servers/f8247a13-94cd-45b2-acc8-8717e1260f37" status: 200 len: 1758 microversion: 2.1 time: 0.214220 Sep 13 18:06:37.157753 dv-cinder-852009-8-iscsi devstack@n-api.service[120741]: [pid: 120741|app: 0|req: 256/520] 10.222.0.43 () {58 vars in 1236 bytes} [Tue Sep 13 18:06:36 2022] GET /compute/v2.1/servers/f8247a13-94cd-45b2-acc8-8717e1260f37 => generated 1758 bytes in 221 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 13 18:06:37.662499 dv-cinder-852009-8-iscsi devstack@n-api.service[120740]: DEBUG nova.api.openstack.wsgi [None req-b0bbe617-dfa7-47f3-8d84-f6b8e211a182 tempest-ServerRescueNegativeTestJSON-412251590 tempest-ServerRescueNegativeTestJSON-412251590-project] Calling method '>' {{(pid=120740) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 18:06:37.663112 dv-cinder-852009-8-iscsi devstack@n-api.service[120740]: DEBUG nova.compute.api [None req-b0bbe617-dfa7-47f3-8d84-f6b8e211a182 tempest-ServerRescueNegativeTestJSON-412251590 tempest-ServerRescueNegativeTestJSON-412251590-project] [instance: e8ce7158-6b73-4586-9f78-8e821988e71c] Fetching instance by UUID {{(pid=120740) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 18:06:37.669947 dv-cinder-852009-8-iscsi devstack@n-api.service[120740]: DEBUG oslo_concurrency.lockutils [None req-b0bbe617-dfa7-47f3-8d84-f6b8e211a182 tempest-ServerRescueNegativeTestJSON-412251590 tempest-ServerRescueNegativeTestJSON-412251590-project] Acquiring lock "1daf4f4c-0e4a-4779-b53a-78c48397ea2f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120740) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 18:06:37.670442 dv-cinder-852009-8-iscsi devstack@n-api.service[120740]: DEBUG oslo_concurrency.lockutils [None req-b0bbe617-dfa7-47f3-8d84-f6b8e211a182 tempest-ServerRescueNegativeTestJSON-412251590 tempest-ServerRescueNegativeTestJSON-412251590-project] Lock "1daf4f4c-0e4a-4779-b53a-78c48397ea2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120740) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 18:06:37.670873 dv-cinder-852009-8-iscsi devstack@n-api.service[120740]: DEBUG oslo_concurrency.lockutils [None req-b0bbe617-dfa7-47f3-8d84-f6b8e211a182 tempest-ServerRescueNegativeTestJSON-412251590 tempest-ServerRescueNegativeTestJSON-412251590-project] Lock "1daf4f4c-0e4a-4779-b53a-78c48397ea2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120740) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 18:06:37.671572 dv-cinder-852009-8-iscsi devstack@n-api.service[120740]: DEBUG oslo_concurrency.lockutils [None req-b0bbe617-dfa7-47f3-8d84-f6b8e211a182 tempest-ServerRescueNegativeTestJSON-412251590 tempest-ServerRescueNegativeTestJSON-412251590-project] Acquiring lock "1daf4f4c-0e4a-4779-b53a-78c48397ea2f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120740) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 18:06:37.672018 dv-cinder-852009-8-iscsi devstack@n-api.service[120740]: DEBUG oslo_concurrency.lockutils [None req-b0bbe617-dfa7-47f3-8d84-f6b8e211a182 tempest-ServerRescueNegativeTestJSON-412251590 tempest-ServerRescueNegativeTestJSON-412251590-project] Lock "1daf4f4c-0e4a-4779-b53a-78c48397ea2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120740) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 18:06:37.672455 dv-cinder-852009-8-iscsi devstack@n-api.service[120740]: DEBUG oslo_concurrency.lockutils [None req-b0bbe617-dfa7-47f3-8d84-f6b8e211a182 tempest-ServerRescueNegativeTestJSON-412251590 tempest-ServerRescueNegativeTestJSON-412251590-project] Lock "1daf4f4c-0e4a-4779-b53a-78c48397ea2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120740) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 18:06:37.686375 dv-cinder-852009-8-iscsi devstack@n-api.service[120740]: INFO nova.api.openstack.wsgi [None req-b0bbe617-dfa7-47f3-8d84-f6b8e211a182 tempest-ServerRescueNegativeTestJSON-412251590 tempest-ServerRescueNegativeTestJSON-412251590-project] HTTP exception thrown: Instance e8ce7158-6b73-4586-9f78-8e821988e71c could not be found. Sep 13 18:06:37.688038 dv-cinder-852009-8-iscsi devstack@n-api.service[120740]: DEBUG nova.api.openstack.wsgi [None req-b0bbe617-dfa7-47f3-8d84-f6b8e211a182 tempest-ServerRescueNegativeTestJSON-412251590 tempest-ServerRescueNegativeTestJSON-412251590-project] Request method failure captured: Sep 13 18:06:37.688038 dv-cinder-852009-8-iscsi devstack@n-api.service[120740]: request: GET /compute/v2.1/servers/e8ce7158-6b73-4586-9f78-8e821988e71c HTTP/1.1 Sep 13 18:06:37.688038 dv-cinder-852009-8-iscsi devstack@n-api.service[120740]: Accept: application/json Sep 13 18:06:37.688038 dv-cinder-852009-8-iscsi devstack@n-api.service[120740]: Accept-Encoding: identity Sep 13 18:06:37.688038 dv-cinder-852009-8-iscsi devstack@n-api.service[120740]: Connection: close Sep 13 18:06:37.688038 dv-cinder-852009-8-iscsi devstack@n-api.service[120740]: Content-Length: 0 Sep 13 18:06:37.688038 dv-cinder-852009-8-iscsi devstack@n-api.service[120740]: Content-Type: application/json Sep 13 18:06:37.688038 dv-cinder-852009-8-iscsi devstack@n-api.service[120740]: Host: 10.222.0.43 Sep 13 18:06:37.688038 dv-cinder-852009-8-iscsi devstack@n-api.service[120740]: Openstack-System-Scope: None Sep 13 18:06:37.688038 dv-cinder-852009-8-iscsi devstack@n-api.service[120740]: User-Agent: python-urllib3/1.26.12 Sep 13 18:06:37.688038 dv-cinder-852009-8-iscsi devstack@n-api.service[120740]: X-Auth-Token: gAAAAABjIMWLGCNoeMW1liDJB1gW9y5zhqmLF-sp8LIXP_r2MtlxdDHDtH71A_-WwD3h6pxNpP_1J3-5dl1onM_1dz3k03VMJo2rjFEdcnLe1SaUhiMh3RVhtixTQiirGhUKXyKFRgOaQ5UOSPmq2sc9F0EVe-crpqJDqeSJGSsHbG1iIfI3v08 Sep 13 18:06:37.688038 dv-cinder-852009-8-iscsi devstack@n-api.service[120740]: X-Domain-Id: None Sep 13 18:06:37.688038 dv-cinder-852009-8-iscsi devstack@n-api.service[120740]: X-Domain-Name: None Sep 13 18:06:37.688038 dv-cinder-852009-8-iscsi devstack@n-api.service[120740]: X-Identity-Status: Confirmed Sep 13 18:06:37.688038 dv-cinder-852009-8-iscsi devstack@n-api.service[120740]: X-Is-Admin-Project: True Sep 13 18:06:37.688038 dv-cinder-852009-8-iscsi devstack@n-api.service[120740]: X-Project-Domain-Id: default Sep 13 18:06:37.688038 dv-cinder-852009-8-iscsi devstack@n-api.service[120740]: X-Project-Domain-Name: Default Sep 13 18:06:37.688038 dv-cinder-852009-8-iscsi devstack@n-api.service[120740]: X-Project-Id: 2eae4acecf6c4961830ead78d71b2ad3 Sep 13 18:06:37.688038 dv-cinder-852009-8-iscsi devstack@n-api.service[120740]: X-Project-Name: tempest-ServerRescueNegativeTestJSON-412251590 Sep 13 18:06:37.688038 dv-cinder-852009-8-iscsi devstack@n-api.service[120740]: X-Role: reader,member Sep 13 18:06:37.688038 dv-cinder-852009-8-iscsi devstack@n-api.service[120740]: X-Roles: reader,member Sep 13 18:06:37.689552 dv-cinder-852009-8-iscsi devstack@n-api.service[120740]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/identity"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/compute/v2/2eae4acecf6c4961830ead78d71b2ad3"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.43:8080", "publicURL": "http://10.222.0.43:8080/v1/AUTH_2eae4acecf6c4961830ead78d71b2ad3"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43:9696/networking"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/volume/v3/2eae4acecf6c4961830ead78d71b2ad3"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/compute/v2.1"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/placement"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/volume/v3/2eae4acecf6c4961830ead78d71b2ad3"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/image"}]}] Sep 13 18:06:37.689552 dv-cinder-852009-8-iscsi devstack@n-api.service[120740]: X-Tenant: tempest-ServerRescueNegativeTestJSON-412251590 Sep 13 18:06:37.689552 dv-cinder-852009-8-iscsi devstack@n-api.service[120740]: X-Tenant-Id: 2eae4acecf6c4961830ead78d71b2ad3 Sep 13 18:06:37.689552 dv-cinder-852009-8-iscsi devstack@n-api.service[120740]: X-Tenant-Name: tempest-ServerRescueNegativeTestJSON-412251590 Sep 13 18:06:37.689552 dv-cinder-852009-8-iscsi devstack@n-api.service[120740]: X-User: tempest-ServerRescueNegativeTestJSON-412251590-project Sep 13 18:06:37.689552 dv-cinder-852009-8-iscsi devstack@n-api.service[120740]: X-User-Domain-Id: default Sep 13 18:06:37.689552 dv-cinder-852009-8-iscsi devstack@n-api.service[120740]: X-User-Domain-Name: Default Sep 13 18:06:37.689552 dv-cinder-852009-8-iscsi devstack@n-api.service[120740]: X-User-Id: 60800cf2774e409d9c1b6f4992669991 Sep 13 18:06:37.689552 dv-cinder-852009-8-iscsi devstack@n-api.service[120740]: X-User-Name: tempest-ServerRescueNegativeTestJSON-412251590-project Sep 13 18:06:37.689552 dv-cinder-852009-8-iscsi devstack@n-api.service[120740]: method: > Sep 13 18:06:37.689552 dv-cinder-852009-8-iscsi devstack@n-api.service[120740]: exception: Instance e8ce7158-6b73-4586-9f78-8e821988e71c could not be found. Sep 13 18:06:37.689552 dv-cinder-852009-8-iscsi devstack@n-api.service[120740]: action_args: {'id': 'e8ce7158-6b73-4586-9f78-8e821988e71c'} Sep 13 18:06:37.690398 dv-cinder-852009-8-iscsi devstack@n-api.service[120740]: {{(pid=120740) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 13 18:06:37.690398 dv-cinder-852009-8-iscsi devstack@n-api.service[120740]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 13 18:06:37.690398 dv-cinder-852009-8-iscsi devstack@n-api.service[120740]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Sep 13 18:06:37.690398 dv-cinder-852009-8-iscsi devstack@n-api.service[120740]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Sep 13 18:06:37.690398 dv-cinder-852009-8-iscsi devstack@n-api.service[120740]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Sep 13 18:06:37.690398 dv-cinder-852009-8-iscsi devstack@n-api.service[120740]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Sep 13 18:06:37.690398 dv-cinder-852009-8-iscsi devstack@n-api.service[120740]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Sep 13 18:06:37.690398 dv-cinder-852009-8-iscsi devstack@n-api.service[120740]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Sep 13 18:06:37.690398 dv-cinder-852009-8-iscsi devstack@n-api.service[120740]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Sep 13 18:06:37.690398 dv-cinder-852009-8-iscsi devstack@n-api.service[120740]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Sep 13 18:06:37.690398 dv-cinder-852009-8-iscsi devstack@n-api.service[120740]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance e8ce7158-6b73-4586-9f78-8e821988e71c could not be found. Sep 13 18:06:37.690398 dv-cinder-852009-8-iscsi devstack@n-api.service[120740]: ERROR nova.api.openstack.wsgi Sep 13 18:06:37.690398 dv-cinder-852009-8-iscsi devstack@n-api.service[120740]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 13 18:06:37.690398 dv-cinder-852009-8-iscsi devstack@n-api.service[120740]: ERROR nova.api.openstack.wsgi Sep 13 18:06:37.690398 dv-cinder-852009-8-iscsi devstack@n-api.service[120740]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 13 18:06:37.690398 dv-cinder-852009-8-iscsi devstack@n-api.service[120740]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 13 18:06:37.690398 dv-cinder-852009-8-iscsi devstack@n-api.service[120740]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 13 18:06:37.690398 dv-cinder-852009-8-iscsi devstack@n-api.service[120740]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 13 18:06:37.690398 dv-cinder-852009-8-iscsi devstack@n-api.service[120740]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 13 18:06:37.690398 dv-cinder-852009-8-iscsi devstack@n-api.service[120740]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 13 18:06:37.691738 dv-cinder-852009-8-iscsi devstack@n-api.service[120740]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 13 18:06:37.691738 dv-cinder-852009-8-iscsi devstack@n-api.service[120740]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Sep 13 18:06:37.691738 dv-cinder-852009-8-iscsi devstack@n-api.service[120740]: ERROR nova.api.openstack.wsgi instance = self._get_server( Sep 13 18:06:37.691738 dv-cinder-852009-8-iscsi devstack@n-api.service[120740]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Sep 13 18:06:37.691738 dv-cinder-852009-8-iscsi devstack@n-api.service[120740]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Sep 13 18:06:37.691738 dv-cinder-852009-8-iscsi devstack@n-api.service[120740]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Sep 13 18:06:37.691738 dv-cinder-852009-8-iscsi devstack@n-api.service[120740]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Sep 13 18:06:37.691738 dv-cinder-852009-8-iscsi devstack@n-api.service[120740]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance e8ce7158-6b73-4586-9f78-8e821988e71c could not be found. Sep 13 18:06:37.691738 dv-cinder-852009-8-iscsi devstack@n-api.service[120740]: ERROR nova.api.openstack.wsgi Sep 13 18:06:37.691738 dv-cinder-852009-8-iscsi devstack@n-api.service[120740]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 13 18:06:37.691738 dv-cinder-852009-8-iscsi devstack@n-api.service[120740]: ERROR nova.api.openstack.wsgi Sep 13 18:06:37.691738 dv-cinder-852009-8-iscsi devstack@n-api.service[120740]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 13 18:06:37.691738 dv-cinder-852009-8-iscsi devstack@n-api.service[120740]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 13 18:06:37.691738 dv-cinder-852009-8-iscsi devstack@n-api.service[120740]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 13 18:06:37.691738 dv-cinder-852009-8-iscsi devstack@n-api.service[120740]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 13 18:06:37.691738 dv-cinder-852009-8-iscsi devstack@n-api.service[120740]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 13 18:06:37.691738 dv-cinder-852009-8-iscsi devstack@n-api.service[120740]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance e8ce7158-6b73-4586-9f78-8e821988e71c could not be found. Sep 13 18:06:37.691738 dv-cinder-852009-8-iscsi devstack@n-api.service[120740]: ERROR nova.api.openstack.wsgi Sep 13 18:06:37.693031 dv-cinder-852009-8-iscsi devstack@n-api.service[120740]: DEBUG nova.api.openstack.wsgi [None req-b0bbe617-dfa7-47f3-8d84-f6b8e211a182 tempest-ServerRescueNegativeTestJSON-412251590 tempest-ServerRescueNegativeTestJSON-412251590-project] Returning 404 to user: Instance e8ce7158-6b73-4586-9f78-8e821988e71c could not be found. {{(pid=120740) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 13 18:06:37.693031 dv-cinder-852009-8-iscsi devstack@n-api.service[120740]: INFO nova.api.openstack.requestlog [None req-b0bbe617-dfa7-47f3-8d84-f6b8e211a182 tempest-ServerRescueNegativeTestJSON-412251590 tempest-ServerRescueNegativeTestJSON-412251590-project] 10.222.0.43 "GET /compute/v2.1/servers/e8ce7158-6b73-4586-9f78-8e821988e71c" status: 404 len: 111 microversion: 2.1 time: 0.033627 Sep 13 18:06:37.693031 dv-cinder-852009-8-iscsi devstack@n-api.service[120740]: [pid: 120740|app: 0|req: 265/521] 10.222.0.43 () {58 vars in 1236 bytes} [Tue Sep 13 18:06:37 2022] GET /compute/v2.1/servers/e8ce7158-6b73-4586-9f78-8e821988e71c => generated 111 bytes in 35 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Sep 13 18:06:37.698453 dv-cinder-852009-8-iscsi devstack@n-api.service[120741]: DEBUG nova.api.openstack.wsgi [None req-17b3e011-d8e7-4cac-bd54-f2357cfbcb13 tempest-ServerRescueNegativeTestJSON-412251590 tempest-ServerRescueNegativeTestJSON-412251590-project] Calling method '.version_select at 0x7fa626a00160>' {{(pid=120741) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 18:06:37.720242 dv-cinder-852009-8-iscsi devstack@n-api.service[120741]: INFO nova.api.openstack.requestlog [None req-17b3e011-d8e7-4cac-bd54-f2357cfbcb13 tempest-ServerRescueNegativeTestJSON-412251590 tempest-ServerRescueNegativeTestJSON-412251590-project] 10.222.0.43 "DELETE /compute/v2.1/os-keypairs/tempest-keypair-1939634926" status: 202 len: 0 microversion: 2.1 time: 0.025689 Sep 13 18:06:37.720831 dv-cinder-852009-8-iscsi devstack@n-api.service[120741]: [pid: 120741|app: 0|req: 257/522] 10.222.0.43 () {58 vars in 1221 bytes} [Tue Sep 13 18:06:37 2022] DELETE /compute/v2.1/os-keypairs/tempest-keypair-1939634926 => generated 0 bytes in 27 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Sep 13 18:06:38.183166 dv-cinder-852009-8-iscsi devstack@n-api.service[120740]: DEBUG nova.api.openstack.wsgi [None req-7dcb0f53-95f6-4bde-9b6e-69e5078c4476 tempest-TestMinimumBasicScenario-820002800 tempest-TestMinimumBasicScenario-820002800-project] Calling method '>' {{(pid=120740) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 18:06:38.183778 dv-cinder-852009-8-iscsi devstack@n-api.service[120740]: DEBUG nova.compute.api [None req-7dcb0f53-95f6-4bde-9b6e-69e5078c4476 tempest-TestMinimumBasicScenario-820002800 tempest-TestMinimumBasicScenario-820002800-project] [instance: f8247a13-94cd-45b2-acc8-8717e1260f37] Fetching instance by UUID {{(pid=120740) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 18:06:38.189799 dv-cinder-852009-8-iscsi devstack@n-api.service[120740]: DEBUG oslo_concurrency.lockutils [None req-7dcb0f53-95f6-4bde-9b6e-69e5078c4476 tempest-TestMinimumBasicScenario-820002800 tempest-TestMinimumBasicScenario-820002800-project] Acquiring lock "1daf4f4c-0e4a-4779-b53a-78c48397ea2f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120740) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 18:06:38.190281 dv-cinder-852009-8-iscsi devstack@n-api.service[120740]: DEBUG oslo_concurrency.lockutils [None req-7dcb0f53-95f6-4bde-9b6e-69e5078c4476 tempest-TestMinimumBasicScenario-820002800 tempest-TestMinimumBasicScenario-820002800-project] Lock "1daf4f4c-0e4a-4779-b53a-78c48397ea2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120740) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 18:06:38.190708 dv-cinder-852009-8-iscsi devstack@n-api.service[120740]: DEBUG oslo_concurrency.lockutils [None req-7dcb0f53-95f6-4bde-9b6e-69e5078c4476 tempest-TestMinimumBasicScenario-820002800 tempest-TestMinimumBasicScenario-820002800-project] Lock "1daf4f4c-0e4a-4779-b53a-78c48397ea2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120740) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 18:06:38.191400 dv-cinder-852009-8-iscsi devstack@n-api.service[120740]: DEBUG oslo_concurrency.lockutils [None req-7dcb0f53-95f6-4bde-9b6e-69e5078c4476 tempest-TestMinimumBasicScenario-820002800 tempest-TestMinimumBasicScenario-820002800-project] Acquiring lock "1daf4f4c-0e4a-4779-b53a-78c48397ea2f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120740) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 18:06:38.191804 dv-cinder-852009-8-iscsi devstack@n-api.service[120740]: DEBUG oslo_concurrency.lockutils [None req-7dcb0f53-95f6-4bde-9b6e-69e5078c4476 tempest-TestMinimumBasicScenario-820002800 tempest-TestMinimumBasicScenario-820002800-project] Lock "1daf4f4c-0e4a-4779-b53a-78c48397ea2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120740) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 18:06:38.192471 dv-cinder-852009-8-iscsi devstack@n-api.service[120740]: DEBUG oslo_concurrency.lockutils [None req-7dcb0f53-95f6-4bde-9b6e-69e5078c4476 tempest-TestMinimumBasicScenario-820002800 tempest-TestMinimumBasicScenario-820002800-project] Lock "1daf4f4c-0e4a-4779-b53a-78c48397ea2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120740) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 18:06:38.351480 dv-cinder-852009-8-iscsi devstack@n-api.service[120740]: DEBUG nova.policy [None req-7dcb0f53-95f6-4bde-9b6e-69e5078c4476 tempest-TestMinimumBasicScenario-820002800 tempest-TestMinimumBasicScenario-820002800-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7880064ff0aa448d9c367c89eba145ff', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2f6832936c824066a4370cc45c5b0282', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120740) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 18:06:38.360321 dv-cinder-852009-8-iscsi devstack@n-api.service[120740]: INFO nova.api.openstack.requestlog [None req-7dcb0f53-95f6-4bde-9b6e-69e5078c4476 tempest-TestMinimumBasicScenario-820002800 tempest-TestMinimumBasicScenario-820002800-project] 10.222.0.43 "GET /compute/v2.1/servers/f8247a13-94cd-45b2-acc8-8717e1260f37" status: 200 len: 1758 microversion: 2.1 time: 0.180945 Sep 13 18:06:38.360957 dv-cinder-852009-8-iscsi devstack@n-api.service[120740]: [pid: 120740|app: 0|req: 266/523] 10.222.0.43 () {58 vars in 1236 bytes} [Tue Sep 13 18:06:38 2022] GET /compute/v2.1/servers/f8247a13-94cd-45b2-acc8-8717e1260f37 => generated 1758 bytes in 182 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 13 18:06:39.387081 dv-cinder-852009-8-iscsi devstack@n-api.service[120741]: DEBUG nova.api.openstack.wsgi [None req-28fbca83-271d-4503-b1c4-b480567fdc01 tempest-TestMinimumBasicScenario-820002800 tempest-TestMinimumBasicScenario-820002800-project] Calling method '>' {{(pid=120741) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 18:06:39.387827 dv-cinder-852009-8-iscsi devstack@n-api.service[120741]: DEBUG nova.compute.api [None req-28fbca83-271d-4503-b1c4-b480567fdc01 tempest-TestMinimumBasicScenario-820002800 tempest-TestMinimumBasicScenario-820002800-project] [instance: f8247a13-94cd-45b2-acc8-8717e1260f37] Fetching instance by UUID {{(pid=120741) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 18:06:39.395797 dv-cinder-852009-8-iscsi devstack@n-api.service[120741]: DEBUG oslo_concurrency.lockutils [None req-28fbca83-271d-4503-b1c4-b480567fdc01 tempest-TestMinimumBasicScenario-820002800 tempest-TestMinimumBasicScenario-820002800-project] Acquiring lock "1daf4f4c-0e4a-4779-b53a-78c48397ea2f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120741) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 18:06:39.396385 dv-cinder-852009-8-iscsi devstack@n-api.service[120741]: DEBUG oslo_concurrency.lockutils [None req-28fbca83-271d-4503-b1c4-b480567fdc01 tempest-TestMinimumBasicScenario-820002800 tempest-TestMinimumBasicScenario-820002800-project] Lock "1daf4f4c-0e4a-4779-b53a-78c48397ea2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120741) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 18:06:39.396953 dv-cinder-852009-8-iscsi devstack@n-api.service[120741]: DEBUG oslo_concurrency.lockutils [None req-28fbca83-271d-4503-b1c4-b480567fdc01 tempest-TestMinimumBasicScenario-820002800 tempest-TestMinimumBasicScenario-820002800-project] Lock "1daf4f4c-0e4a-4779-b53a-78c48397ea2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120741) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 18:06:39.397826 dv-cinder-852009-8-iscsi devstack@n-api.service[120741]: DEBUG oslo_concurrency.lockutils [None req-28fbca83-271d-4503-b1c4-b480567fdc01 tempest-TestMinimumBasicScenario-820002800 tempest-TestMinimumBasicScenario-820002800-project] Acquiring lock "1daf4f4c-0e4a-4779-b53a-78c48397ea2f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120741) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 18:06:39.398378 dv-cinder-852009-8-iscsi devstack@n-api.service[120741]: DEBUG oslo_concurrency.lockutils [None req-28fbca83-271d-4503-b1c4-b480567fdc01 tempest-TestMinimumBasicScenario-820002800 tempest-TestMinimumBasicScenario-820002800-project] Lock "1daf4f4c-0e4a-4779-b53a-78c48397ea2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120741) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 18:06:39.398884 dv-cinder-852009-8-iscsi devstack@n-api.service[120741]: DEBUG oslo_concurrency.lockutils [None req-28fbca83-271d-4503-b1c4-b480567fdc01 tempest-TestMinimumBasicScenario-820002800 tempest-TestMinimumBasicScenario-820002800-project] Lock "1daf4f4c-0e4a-4779-b53a-78c48397ea2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120741) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 18:06:39.548658 dv-cinder-852009-8-iscsi devstack@n-api.service[120741]: DEBUG nova.policy [None req-28fbca83-271d-4503-b1c4-b480567fdc01 tempest-TestMinimumBasicScenario-820002800 tempest-TestMinimumBasicScenario-820002800-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7880064ff0aa448d9c367c89eba145ff', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2f6832936c824066a4370cc45c5b0282', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120741) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 18:06:39.557631 dv-cinder-852009-8-iscsi devstack@n-api.service[120741]: INFO nova.api.openstack.requestlog [None req-28fbca83-271d-4503-b1c4-b480567fdc01 tempest-TestMinimumBasicScenario-820002800 tempest-TestMinimumBasicScenario-820002800-project] 10.222.0.43 "GET /compute/v2.1/servers/f8247a13-94cd-45b2-acc8-8717e1260f37" status: 200 len: 1758 microversion: 2.1 time: 0.176358 Sep 13 18:06:39.558305 dv-cinder-852009-8-iscsi devstack@n-api.service[120741]: [pid: 120741|app: 0|req: 258/524] 10.222.0.43 () {58 vars in 1236 bytes} [Tue Sep 13 18:06:39 2022] GET /compute/v2.1/servers/f8247a13-94cd-45b2-acc8-8717e1260f37 => generated 1758 bytes in 178 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 13 18:06:40.584973 dv-cinder-852009-8-iscsi devstack@n-api.service[120740]: DEBUG nova.api.openstack.wsgi [None req-5a19adcf-148b-430e-8ee8-681e0cc7d8e0 tempest-TestMinimumBasicScenario-820002800 tempest-TestMinimumBasicScenario-820002800-project] Calling method '>' {{(pid=120740) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 18:06:40.585700 dv-cinder-852009-8-iscsi devstack@n-api.service[120740]: DEBUG nova.compute.api [None req-5a19adcf-148b-430e-8ee8-681e0cc7d8e0 tempest-TestMinimumBasicScenario-820002800 tempest-TestMinimumBasicScenario-820002800-project] [instance: f8247a13-94cd-45b2-acc8-8717e1260f37] Fetching instance by UUID {{(pid=120740) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 18:06:40.597824 dv-cinder-852009-8-iscsi devstack@n-api.service[120740]: DEBUG oslo_concurrency.lockutils [None req-5a19adcf-148b-430e-8ee8-681e0cc7d8e0 tempest-TestMinimumBasicScenario-820002800 tempest-TestMinimumBasicScenario-820002800-project] Acquiring lock "1daf4f4c-0e4a-4779-b53a-78c48397ea2f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120740) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 18:06:40.598439 dv-cinder-852009-8-iscsi devstack@n-api.service[120740]: DEBUG oslo_concurrency.lockutils [None req-5a19adcf-148b-430e-8ee8-681e0cc7d8e0 tempest-TestMinimumBasicScenario-820002800 tempest-TestMinimumBasicScenario-820002800-project] Lock "1daf4f4c-0e4a-4779-b53a-78c48397ea2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120740) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 18:06:40.599014 dv-cinder-852009-8-iscsi devstack@n-api.service[120740]: DEBUG oslo_concurrency.lockutils [None req-5a19adcf-148b-430e-8ee8-681e0cc7d8e0 tempest-TestMinimumBasicScenario-820002800 tempest-TestMinimumBasicScenario-820002800-project] Lock "1daf4f4c-0e4a-4779-b53a-78c48397ea2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120740) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 18:06:40.599880 dv-cinder-852009-8-iscsi devstack@n-api.service[120740]: DEBUG oslo_concurrency.lockutils [None req-5a19adcf-148b-430e-8ee8-681e0cc7d8e0 tempest-TestMinimumBasicScenario-820002800 tempest-TestMinimumBasicScenario-820002800-project] Acquiring lock "1daf4f4c-0e4a-4779-b53a-78c48397ea2f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120740) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 18:06:40.600481 dv-cinder-852009-8-iscsi devstack@n-api.service[120740]: DEBUG oslo_concurrency.lockutils [None req-5a19adcf-148b-430e-8ee8-681e0cc7d8e0 tempest-TestMinimumBasicScenario-820002800 tempest-TestMinimumBasicScenario-820002800-project] Lock "1daf4f4c-0e4a-4779-b53a-78c48397ea2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120740) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 18:06:40.601109 dv-cinder-852009-8-iscsi devstack@n-api.service[120740]: DEBUG oslo_concurrency.lockutils [None req-5a19adcf-148b-430e-8ee8-681e0cc7d8e0 tempest-TestMinimumBasicScenario-820002800 tempest-TestMinimumBasicScenario-820002800-project] Lock "1daf4f4c-0e4a-4779-b53a-78c48397ea2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120740) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 18:06:40.622022 dv-cinder-852009-8-iscsi devstack@n-api.service[120740]: DEBUG dbcounter [-] [120740] Writing DB stats nova_cell1:SELECT=99,nova_cell1:INSERT=1 {{(pid=120740) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 18:06:40.633789 dv-cinder-852009-8-iscsi devstack@n-api.service[120741]: DEBUG nova.api.openstack.wsgi [None req-1e3889c5-038b-4766-a6a3-fa35c045082d tempest-ServerRescueNegativeTestJSON-412251590 tempest-ServerRescueNegativeTestJSON-412251590-project] Calling method '>' {{(pid=120741) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 18:06:40.634381 dv-cinder-852009-8-iscsi devstack@n-api.service[120741]: DEBUG nova.compute.api [None req-1e3889c5-038b-4766-a6a3-fa35c045082d tempest-ServerRescueNegativeTestJSON-412251590 tempest-ServerRescueNegativeTestJSON-412251590-project] [instance: 8cd29851-35c1-4032-a137-ab9419a2ec5b] Fetching instance by UUID {{(pid=120741) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 18:06:40.640822 dv-cinder-852009-8-iscsi devstack@n-api.service[120741]: DEBUG oslo_concurrency.lockutils [None req-1e3889c5-038b-4766-a6a3-fa35c045082d tempest-ServerRescueNegativeTestJSON-412251590 tempest-ServerRescueNegativeTestJSON-412251590-project] Acquiring lock "1daf4f4c-0e4a-4779-b53a-78c48397ea2f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120741) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 18:06:40.641323 dv-cinder-852009-8-iscsi devstack@n-api.service[120741]: DEBUG oslo_concurrency.lockutils [None req-1e3889c5-038b-4766-a6a3-fa35c045082d tempest-ServerRescueNegativeTestJSON-412251590 tempest-ServerRescueNegativeTestJSON-412251590-project] Lock "1daf4f4c-0e4a-4779-b53a-78c48397ea2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120741) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 18:06:40.641725 dv-cinder-852009-8-iscsi devstack@n-api.service[120741]: DEBUG oslo_concurrency.lockutils [None req-1e3889c5-038b-4766-a6a3-fa35c045082d tempest-ServerRescueNegativeTestJSON-412251590 tempest-ServerRescueNegativeTestJSON-412251590-project] Lock "1daf4f4c-0e4a-4779-b53a-78c48397ea2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120741) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 18:06:40.642421 dv-cinder-852009-8-iscsi devstack@n-api.service[120741]: DEBUG oslo_concurrency.lockutils [None req-1e3889c5-038b-4766-a6a3-fa35c045082d tempest-ServerRescueNegativeTestJSON-412251590 tempest-ServerRescueNegativeTestJSON-412251590-project] Acquiring lock "1daf4f4c-0e4a-4779-b53a-78c48397ea2f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120741) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 18:06:40.642859 dv-cinder-852009-8-iscsi devstack@n-api.service[120741]: DEBUG oslo_concurrency.lockutils [None req-1e3889c5-038b-4766-a6a3-fa35c045082d tempest-ServerRescueNegativeTestJSON-412251590 tempest-ServerRescueNegativeTestJSON-412251590-project] Lock "1daf4f4c-0e4a-4779-b53a-78c48397ea2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120741) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 18:06:40.643260 dv-cinder-852009-8-iscsi devstack@n-api.service[120741]: DEBUG oslo_concurrency.lockutils [None req-1e3889c5-038b-4766-a6a3-fa35c045082d tempest-ServerRescueNegativeTestJSON-412251590 tempest-ServerRescueNegativeTestJSON-412251590-project] Lock "1daf4f4c-0e4a-4779-b53a-78c48397ea2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120741) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 18:06:40.669395 dv-cinder-852009-8-iscsi devstack@n-api.service[120741]: DEBUG nova.compute.api [None req-1e3889c5-038b-4766-a6a3-fa35c045082d tempest-ServerRescueNegativeTestJSON-412251590 tempest-ServerRescueNegativeTestJSON-412251590-project] [instance: 8cd29851-35c1-4032-a137-ab9419a2ec5b] Going to try to terminate instance {{(pid=120741) delete /opt/stack/nova/nova/compute/api.py:2719}} Sep 13 18:06:40.749681 dv-cinder-852009-8-iscsi devstack@n-api.service[120741]: INFO nova.api.openstack.requestlog [None req-1e3889c5-038b-4766-a6a3-fa35c045082d tempest-ServerRescueNegativeTestJSON-412251590 tempest-ServerRescueNegativeTestJSON-412251590-project] 10.222.0.43 "DELETE /compute/v2.1/servers/8cd29851-35c1-4032-a137-ab9419a2ec5b" status: 204 len: 0 microversion: 2.1 time: 0.119373 Sep 13 18:06:40.750537 dv-cinder-852009-8-iscsi devstack@n-api.service[120741]: [pid: 120741|app: 0|req: 259/525] 10.222.0.43 () {58 vars in 1239 bytes} [Tue Sep 13 18:06:40 2022] DELETE /compute/v2.1/servers/8cd29851-35c1-4032-a137-ab9419a2ec5b => generated 0 bytes in 121 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Sep 13 18:06:40.759600 dv-cinder-852009-8-iscsi devstack@n-api.service[120741]: DEBUG nova.api.openstack.wsgi [None req-fd532d30-d4f5-4ddf-8408-b181113f4ad6 tempest-ServerRescueNegativeTestJSON-412251590 tempest-ServerRescueNegativeTestJSON-412251590-project] Calling method '>' {{(pid=120741) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 18:06:40.760296 dv-cinder-852009-8-iscsi devstack@n-api.service[120741]: DEBUG nova.compute.api [None req-fd532d30-d4f5-4ddf-8408-b181113f4ad6 tempest-ServerRescueNegativeTestJSON-412251590 tempest-ServerRescueNegativeTestJSON-412251590-project] [instance: 8cd29851-35c1-4032-a137-ab9419a2ec5b] Fetching instance by UUID {{(pid=120741) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 18:06:40.761922 dv-cinder-852009-8-iscsi devstack@n-api.service[120740]: DEBUG nova.policy [None req-5a19adcf-148b-430e-8ee8-681e0cc7d8e0 tempest-TestMinimumBasicScenario-820002800 tempest-TestMinimumBasicScenario-820002800-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7880064ff0aa448d9c367c89eba145ff', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2f6832936c824066a4370cc45c5b0282', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120740) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 18:06:40.766435 dv-cinder-852009-8-iscsi devstack@n-api.service[120741]: DEBUG oslo_concurrency.lockutils [None req-fd532d30-d4f5-4ddf-8408-b181113f4ad6 tempest-ServerRescueNegativeTestJSON-412251590 tempest-ServerRescueNegativeTestJSON-412251590-project] Acquiring lock "1daf4f4c-0e4a-4779-b53a-78c48397ea2f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120741) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 18:06:40.766914 dv-cinder-852009-8-iscsi devstack@n-api.service[120741]: DEBUG oslo_concurrency.lockutils [None req-fd532d30-d4f5-4ddf-8408-b181113f4ad6 tempest-ServerRescueNegativeTestJSON-412251590 tempest-ServerRescueNegativeTestJSON-412251590-project] Lock "1daf4f4c-0e4a-4779-b53a-78c48397ea2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120741) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 18:06:40.767409 dv-cinder-852009-8-iscsi devstack@n-api.service[120741]: DEBUG oslo_concurrency.lockutils [None req-fd532d30-d4f5-4ddf-8408-b181113f4ad6 tempest-ServerRescueNegativeTestJSON-412251590 tempest-ServerRescueNegativeTestJSON-412251590-project] Lock "1daf4f4c-0e4a-4779-b53a-78c48397ea2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120741) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 18:06:40.768090 dv-cinder-852009-8-iscsi devstack@n-api.service[120741]: DEBUG oslo_concurrency.lockutils [None req-fd532d30-d4f5-4ddf-8408-b181113f4ad6 tempest-ServerRescueNegativeTestJSON-412251590 tempest-ServerRescueNegativeTestJSON-412251590-project] Acquiring lock "1daf4f4c-0e4a-4779-b53a-78c48397ea2f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120741) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 18:06:40.768572 dv-cinder-852009-8-iscsi devstack@n-api.service[120741]: DEBUG oslo_concurrency.lockutils [None req-fd532d30-d4f5-4ddf-8408-b181113f4ad6 tempest-ServerRescueNegativeTestJSON-412251590 tempest-ServerRescueNegativeTestJSON-412251590-project] Lock "1daf4f4c-0e4a-4779-b53a-78c48397ea2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120741) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 18:06:40.768984 dv-cinder-852009-8-iscsi devstack@n-api.service[120741]: DEBUG oslo_concurrency.lockutils [None req-fd532d30-d4f5-4ddf-8408-b181113f4ad6 tempest-ServerRescueNegativeTestJSON-412251590 tempest-ServerRescueNegativeTestJSON-412251590-project] Lock "1daf4f4c-0e4a-4779-b53a-78c48397ea2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120741) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 18:06:40.770695 dv-cinder-852009-8-iscsi devstack@n-api.service[120740]: INFO nova.api.openstack.requestlog [None req-5a19adcf-148b-430e-8ee8-681e0cc7d8e0 tempest-TestMinimumBasicScenario-820002800 tempest-TestMinimumBasicScenario-820002800-project] 10.222.0.43 "GET /compute/v2.1/servers/f8247a13-94cd-45b2-acc8-8717e1260f37" status: 200 len: 1758 microversion: 2.1 time: 0.192346 Sep 13 18:06:40.771414 dv-cinder-852009-8-iscsi devstack@n-api.service[120740]: [pid: 120740|app: 0|req: 267/526] 10.222.0.43 () {58 vars in 1236 bytes} [Tue Sep 13 18:06:40 2022] GET /compute/v2.1/servers/f8247a13-94cd-45b2-acc8-8717e1260f37 => generated 1758 bytes in 194 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 13 18:06:40.906208 dv-cinder-852009-8-iscsi devstack@n-api.service[120741]: DEBUG nova.policy [None req-fd532d30-d4f5-4ddf-8408-b181113f4ad6 tempest-ServerRescueNegativeTestJSON-412251590 tempest-ServerRescueNegativeTestJSON-412251590-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '60800cf2774e409d9c1b6f4992669991', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2eae4acecf6c4961830ead78d71b2ad3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120741) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 18:06:40.910807 dv-cinder-852009-8-iscsi devstack@n-api.service[120741]: DEBUG dbcounter [-] [120741] Writing DB stats nova_cell1:SELECT=94,nova_cell1:UPDATE=3,nova_cell1:INSERT=3 {{(pid=120741) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 18:06:40.916013 dv-cinder-852009-8-iscsi devstack@n-api.service[120741]: INFO nova.api.openstack.requestlog [None req-fd532d30-d4f5-4ddf-8408-b181113f4ad6 tempest-ServerRescueNegativeTestJSON-412251590 tempest-ServerRescueNegativeTestJSON-412251590-project] 10.222.0.43 "GET /compute/v2.1/servers/8cd29851-35c1-4032-a137-ab9419a2ec5b" status: 200 len: 1508 microversion: 2.1 time: 0.160681 Sep 13 18:06:40.916611 dv-cinder-852009-8-iscsi devstack@n-api.service[120741]: [pid: 120741|app: 0|req: 260/527] 10.222.0.43 () {58 vars in 1236 bytes} [Tue Sep 13 18:06:40 2022] GET /compute/v2.1/servers/8cd29851-35c1-4032-a137-ab9419a2ec5b => generated 1508 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 13 18:06:41.798264 dv-cinder-852009-8-iscsi devstack@n-api.service[120740]: DEBUG nova.api.openstack.wsgi [None req-dc1dcdc8-29ad-493d-a98b-98de69b9d78c tempest-TestMinimumBasicScenario-820002800 tempest-TestMinimumBasicScenario-820002800-project] Calling method '>' {{(pid=120740) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 18:06:41.799304 dv-cinder-852009-8-iscsi devstack@n-api.service[120740]: DEBUG nova.compute.api [None req-dc1dcdc8-29ad-493d-a98b-98de69b9d78c tempest-TestMinimumBasicScenario-820002800 tempest-TestMinimumBasicScenario-820002800-project] [instance: f8247a13-94cd-45b2-acc8-8717e1260f37] Fetching instance by UUID {{(pid=120740) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 18:06:41.810383 dv-cinder-852009-8-iscsi devstack@n-api.service[120740]: DEBUG oslo_concurrency.lockutils [None req-dc1dcdc8-29ad-493d-a98b-98de69b9d78c tempest-TestMinimumBasicScenario-820002800 tempest-TestMinimumBasicScenario-820002800-project] Acquiring lock "1daf4f4c-0e4a-4779-b53a-78c48397ea2f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120740) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 18:06:41.811195 dv-cinder-852009-8-iscsi devstack@n-api.service[120740]: DEBUG oslo_concurrency.lockutils [None req-dc1dcdc8-29ad-493d-a98b-98de69b9d78c tempest-TestMinimumBasicScenario-820002800 tempest-TestMinimumBasicScenario-820002800-project] Lock "1daf4f4c-0e4a-4779-b53a-78c48397ea2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120740) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 18:06:41.811898 dv-cinder-852009-8-iscsi devstack@n-api.service[120740]: DEBUG oslo_concurrency.lockutils [None req-dc1dcdc8-29ad-493d-a98b-98de69b9d78c tempest-TestMinimumBasicScenario-820002800 tempest-TestMinimumBasicScenario-820002800-project] Lock "1daf4f4c-0e4a-4779-b53a-78c48397ea2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120740) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 18:06:41.813087 dv-cinder-852009-8-iscsi devstack@n-api.service[120740]: DEBUG oslo_concurrency.lockutils [None req-dc1dcdc8-29ad-493d-a98b-98de69b9d78c tempest-TestMinimumBasicScenario-820002800 tempest-TestMinimumBasicScenario-820002800-project] Acquiring lock "1daf4f4c-0e4a-4779-b53a-78c48397ea2f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120740) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 18:06:41.813832 dv-cinder-852009-8-iscsi devstack@n-api.service[120740]: DEBUG oslo_concurrency.lockutils [None req-dc1dcdc8-29ad-493d-a98b-98de69b9d78c tempest-TestMinimumBasicScenario-820002800 tempest-TestMinimumBasicScenario-820002800-project] Lock "1daf4f4c-0e4a-4779-b53a-78c48397ea2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120740) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 18:06:41.814538 dv-cinder-852009-8-iscsi devstack@n-api.service[120740]: DEBUG oslo_concurrency.lockutils [None req-dc1dcdc8-29ad-493d-a98b-98de69b9d78c tempest-TestMinimumBasicScenario-820002800 tempest-TestMinimumBasicScenario-820002800-project] Lock "1daf4f4c-0e4a-4779-b53a-78c48397ea2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120740) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 18:06:41.938470 dv-cinder-852009-8-iscsi devstack@n-api.service[120741]: DEBUG nova.api.openstack.wsgi [None req-c5de9a51-b6e5-452b-9e9c-fd5c147151f7 tempest-ServerRescueNegativeTestJSON-412251590 tempest-ServerRescueNegativeTestJSON-412251590-project] Calling method '>' {{(pid=120741) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 18:06:41.939114 dv-cinder-852009-8-iscsi devstack@n-api.service[120741]: DEBUG nova.compute.api [None req-c5de9a51-b6e5-452b-9e9c-fd5c147151f7 tempest-ServerRescueNegativeTestJSON-412251590 tempest-ServerRescueNegativeTestJSON-412251590-project] [instance: 8cd29851-35c1-4032-a137-ab9419a2ec5b] Fetching instance by UUID {{(pid=120741) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 18:06:41.946350 dv-cinder-852009-8-iscsi devstack@n-api.service[120741]: DEBUG oslo_concurrency.lockutils [None req-c5de9a51-b6e5-452b-9e9c-fd5c147151f7 tempest-ServerRescueNegativeTestJSON-412251590 tempest-ServerRescueNegativeTestJSON-412251590-project] Acquiring lock "1daf4f4c-0e4a-4779-b53a-78c48397ea2f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120741) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 18:06:41.946878 dv-cinder-852009-8-iscsi devstack@n-api.service[120741]: DEBUG oslo_concurrency.lockutils [None req-c5de9a51-b6e5-452b-9e9c-fd5c147151f7 tempest-ServerRescueNegativeTestJSON-412251590 tempest-ServerRescueNegativeTestJSON-412251590-project] Lock "1daf4f4c-0e4a-4779-b53a-78c48397ea2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120741) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 18:06:41.947307 dv-cinder-852009-8-iscsi devstack@n-api.service[120741]: DEBUG oslo_concurrency.lockutils [None req-c5de9a51-b6e5-452b-9e9c-fd5c147151f7 tempest-ServerRescueNegativeTestJSON-412251590 tempest-ServerRescueNegativeTestJSON-412251590-project] Lock "1daf4f4c-0e4a-4779-b53a-78c48397ea2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120741) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 18:06:41.947995 dv-cinder-852009-8-iscsi devstack@n-api.service[120741]: DEBUG oslo_concurrency.lockutils [None req-c5de9a51-b6e5-452b-9e9c-fd5c147151f7 tempest-ServerRescueNegativeTestJSON-412251590 tempest-ServerRescueNegativeTestJSON-412251590-project] Acquiring lock "1daf4f4c-0e4a-4779-b53a-78c48397ea2f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120741) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 18:06:41.948465 dv-cinder-852009-8-iscsi devstack@n-api.service[120741]: DEBUG oslo_concurrency.lockutils [None req-c5de9a51-b6e5-452b-9e9c-fd5c147151f7 tempest-ServerRescueNegativeTestJSON-412251590 tempest-ServerRescueNegativeTestJSON-412251590-project] Lock "1daf4f4c-0e4a-4779-b53a-78c48397ea2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120741) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 18:06:41.948884 dv-cinder-852009-8-iscsi devstack@n-api.service[120741]: DEBUG oslo_concurrency.lockutils [None req-c5de9a51-b6e5-452b-9e9c-fd5c147151f7 tempest-ServerRescueNegativeTestJSON-412251590 tempest-ServerRescueNegativeTestJSON-412251590-project] Lock "1daf4f4c-0e4a-4779-b53a-78c48397ea2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120741) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 18:06:41.958614 dv-cinder-852009-8-iscsi devstack@n-api.service[120740]: DEBUG nova.policy [None req-dc1dcdc8-29ad-493d-a98b-98de69b9d78c tempest-TestMinimumBasicScenario-820002800 tempest-TestMinimumBasicScenario-820002800-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7880064ff0aa448d9c367c89eba145ff', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2f6832936c824066a4370cc45c5b0282', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120740) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 18:06:41.967226 dv-cinder-852009-8-iscsi devstack@n-api.service[120740]: INFO nova.api.openstack.requestlog [None req-dc1dcdc8-29ad-493d-a98b-98de69b9d78c tempest-TestMinimumBasicScenario-820002800 tempest-TestMinimumBasicScenario-820002800-project] 10.222.0.43 "GET /compute/v2.1/servers/f8247a13-94cd-45b2-acc8-8717e1260f37" status: 200 len: 1758 microversion: 2.1 time: 0.175434 Sep 13 18:06:41.968036 dv-cinder-852009-8-iscsi devstack@n-api.service[120740]: [pid: 120740|app: 0|req: 268/528] 10.222.0.43 () {58 vars in 1236 bytes} [Tue Sep 13 18:06:41 2022] GET /compute/v2.1/servers/f8247a13-94cd-45b2-acc8-8717e1260f37 => generated 1758 bytes in 177 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 13 18:06:42.091830 dv-cinder-852009-8-iscsi devstack@n-api.service[120741]: DEBUG nova.policy [None req-c5de9a51-b6e5-452b-9e9c-fd5c147151f7 tempest-ServerRescueNegativeTestJSON-412251590 tempest-ServerRescueNegativeTestJSON-412251590-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '60800cf2774e409d9c1b6f4992669991', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2eae4acecf6c4961830ead78d71b2ad3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120741) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 18:06:42.103488 dv-cinder-852009-8-iscsi devstack@n-api.service[120741]: INFO nova.api.openstack.requestlog [None req-c5de9a51-b6e5-452b-9e9c-fd5c147151f7 tempest-ServerRescueNegativeTestJSON-412251590 tempest-ServerRescueNegativeTestJSON-412251590-project] 10.222.0.43 "GET /compute/v2.1/servers/8cd29851-35c1-4032-a137-ab9419a2ec5b" status: 200 len: 1508 microversion: 2.1 time: 0.168717 Sep 13 18:06:42.104208 dv-cinder-852009-8-iscsi devstack@n-api.service[120741]: [pid: 120741|app: 0|req: 261/529] 10.222.0.43 () {58 vars in 1236 bytes} [Tue Sep 13 18:06:41 2022] GET /compute/v2.1/servers/8cd29851-35c1-4032-a137-ab9419a2ec5b => generated 1508 bytes in 170 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 13 18:06:42.992418 dv-cinder-852009-8-iscsi devstack@n-api.service[120740]: DEBUG nova.api.openstack.wsgi [None req-6cdb9a8d-1a04-4312-9060-97d2b81cdae2 tempest-TestMinimumBasicScenario-820002800 tempest-TestMinimumBasicScenario-820002800-project] Calling method '>' {{(pid=120740) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 18:06:42.993012 dv-cinder-852009-8-iscsi devstack@n-api.service[120740]: DEBUG nova.compute.api [None req-6cdb9a8d-1a04-4312-9060-97d2b81cdae2 tempest-TestMinimumBasicScenario-820002800 tempest-TestMinimumBasicScenario-820002800-project] [instance: f8247a13-94cd-45b2-acc8-8717e1260f37] Fetching instance by UUID {{(pid=120740) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 18:06:43.000138 dv-cinder-852009-8-iscsi devstack@n-api.service[120740]: DEBUG oslo_concurrency.lockutils [None req-6cdb9a8d-1a04-4312-9060-97d2b81cdae2 tempest-TestMinimumBasicScenario-820002800 tempest-TestMinimumBasicScenario-820002800-project] Acquiring lock "1daf4f4c-0e4a-4779-b53a-78c48397ea2f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120740) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 18:06:43.000715 dv-cinder-852009-8-iscsi devstack@n-api.service[120740]: DEBUG oslo_concurrency.lockutils [None req-6cdb9a8d-1a04-4312-9060-97d2b81cdae2 tempest-TestMinimumBasicScenario-820002800 tempest-TestMinimumBasicScenario-820002800-project] Lock "1daf4f4c-0e4a-4779-b53a-78c48397ea2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120740) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 18:06:43.001149 dv-cinder-852009-8-iscsi devstack@n-api.service[120740]: DEBUG oslo_concurrency.lockutils [None req-6cdb9a8d-1a04-4312-9060-97d2b81cdae2 tempest-TestMinimumBasicScenario-820002800 tempest-TestMinimumBasicScenario-820002800-project] Lock "1daf4f4c-0e4a-4779-b53a-78c48397ea2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120740) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 18:06:43.002229 dv-cinder-852009-8-iscsi devstack@n-api.service[120740]: DEBUG oslo_concurrency.lockutils [None req-6cdb9a8d-1a04-4312-9060-97d2b81cdae2 tempest-TestMinimumBasicScenario-820002800 tempest-TestMinimumBasicScenario-820002800-project] Acquiring lock "1daf4f4c-0e4a-4779-b53a-78c48397ea2f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120740) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 18:06:43.002689 dv-cinder-852009-8-iscsi devstack@n-api.service[120740]: DEBUG oslo_concurrency.lockutils [None req-6cdb9a8d-1a04-4312-9060-97d2b81cdae2 tempest-TestMinimumBasicScenario-820002800 tempest-TestMinimumBasicScenario-820002800-project] Lock "1daf4f4c-0e4a-4779-b53a-78c48397ea2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120740) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 18:06:43.003113 dv-cinder-852009-8-iscsi devstack@n-api.service[120740]: DEBUG oslo_concurrency.lockutils [None req-6cdb9a8d-1a04-4312-9060-97d2b81cdae2 tempest-TestMinimumBasicScenario-820002800 tempest-TestMinimumBasicScenario-820002800-project] Lock "1daf4f4c-0e4a-4779-b53a-78c48397ea2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120740) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 18:06:43.131344 dv-cinder-852009-8-iscsi devstack@n-api.service[120741]: DEBUG nova.api.openstack.wsgi [None req-c0599f6c-c161-4dbd-b561-3684c0182e6c tempest-ServerRescueNegativeTestJSON-412251590 tempest-ServerRescueNegativeTestJSON-412251590-project] Calling method '>' {{(pid=120741) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 18:06:43.131994 dv-cinder-852009-8-iscsi devstack@n-api.service[120741]: DEBUG nova.compute.api [None req-c0599f6c-c161-4dbd-b561-3684c0182e6c tempest-ServerRescueNegativeTestJSON-412251590 tempest-ServerRescueNegativeTestJSON-412251590-project] [instance: 8cd29851-35c1-4032-a137-ab9419a2ec5b] Fetching instance by UUID {{(pid=120741) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 18:06:43.138666 dv-cinder-852009-8-iscsi devstack@n-api.service[120741]: DEBUG oslo_concurrency.lockutils [None req-c0599f6c-c161-4dbd-b561-3684c0182e6c tempest-ServerRescueNegativeTestJSON-412251590 tempest-ServerRescueNegativeTestJSON-412251590-project] Acquiring lock "1daf4f4c-0e4a-4779-b53a-78c48397ea2f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120741) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 18:06:43.139149 dv-cinder-852009-8-iscsi devstack@n-api.service[120741]: DEBUG oslo_concurrency.lockutils [None req-c0599f6c-c161-4dbd-b561-3684c0182e6c tempest-ServerRescueNegativeTestJSON-412251590 tempest-ServerRescueNegativeTestJSON-412251590-project] Lock "1daf4f4c-0e4a-4779-b53a-78c48397ea2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120741) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 18:06:43.139583 dv-cinder-852009-8-iscsi devstack@n-api.service[120741]: DEBUG oslo_concurrency.lockutils [None req-c0599f6c-c161-4dbd-b561-3684c0182e6c tempest-ServerRescueNegativeTestJSON-412251590 tempest-ServerRescueNegativeTestJSON-412251590-project] Lock "1daf4f4c-0e4a-4779-b53a-78c48397ea2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120741) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 18:06:43.140270 dv-cinder-852009-8-iscsi devstack@n-api.service[120741]: DEBUG oslo_concurrency.lockutils [None req-c0599f6c-c161-4dbd-b561-3684c0182e6c tempest-ServerRescueNegativeTestJSON-412251590 tempest-ServerRescueNegativeTestJSON-412251590-project] Acquiring lock "1daf4f4c-0e4a-4779-b53a-78c48397ea2f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120741) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 18:06:43.140754 dv-cinder-852009-8-iscsi devstack@n-api.service[120741]: DEBUG oslo_concurrency.lockutils [None req-c0599f6c-c161-4dbd-b561-3684c0182e6c tempest-ServerRescueNegativeTestJSON-412251590 tempest-ServerRescueNegativeTestJSON-412251590-project] Lock "1daf4f4c-0e4a-4779-b53a-78c48397ea2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120741) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 18:06:43.141171 dv-cinder-852009-8-iscsi devstack@n-api.service[120741]: DEBUG oslo_concurrency.lockutils [None req-c0599f6c-c161-4dbd-b561-3684c0182e6c tempest-ServerRescueNegativeTestJSON-412251590 tempest-ServerRescueNegativeTestJSON-412251590-project] Lock "1daf4f4c-0e4a-4779-b53a-78c48397ea2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120741) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 18:06:43.166466 dv-cinder-852009-8-iscsi devstack@n-api.service[120740]: DEBUG nova.policy [None req-6cdb9a8d-1a04-4312-9060-97d2b81cdae2 tempest-TestMinimumBasicScenario-820002800 tempest-TestMinimumBasicScenario-820002800-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7880064ff0aa448d9c367c89eba145ff', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2f6832936c824066a4370cc45c5b0282', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120740) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 18:06:43.175431 dv-cinder-852009-8-iscsi devstack@n-api.service[120740]: INFO nova.api.openstack.requestlog [None req-6cdb9a8d-1a04-4312-9060-97d2b81cdae2 tempest-TestMinimumBasicScenario-820002800 tempest-TestMinimumBasicScenario-820002800-project] 10.222.0.43 "GET /compute/v2.1/servers/f8247a13-94cd-45b2-acc8-8717e1260f37" status: 200 len: 1758 microversion: 2.1 time: 0.188063 Sep 13 18:06:43.176349 dv-cinder-852009-8-iscsi devstack@n-api.service[120740]: [pid: 120740|app: 0|req: 269/530] 10.222.0.43 () {58 vars in 1236 bytes} [Tue Sep 13 18:06:42 2022] GET /compute/v2.1/servers/f8247a13-94cd-45b2-acc8-8717e1260f37 => generated 1758 bytes in 190 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 13 18:06:43.272302 dv-cinder-852009-8-iscsi devstack@n-api.service[120741]: DEBUG nova.policy [None req-c0599f6c-c161-4dbd-b561-3684c0182e6c tempest-ServerRescueNegativeTestJSON-412251590 tempest-ServerRescueNegativeTestJSON-412251590-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '60800cf2774e409d9c1b6f4992669991', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2eae4acecf6c4961830ead78d71b2ad3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120741) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 18:06:43.280132 dv-cinder-852009-8-iscsi devstack@n-api.service[120741]: INFO nova.api.openstack.requestlog [None req-c0599f6c-c161-4dbd-b561-3684c0182e6c tempest-ServerRescueNegativeTestJSON-412251590 tempest-ServerRescueNegativeTestJSON-412251590-project] 10.222.0.43 "GET /compute/v2.1/servers/8cd29851-35c1-4032-a137-ab9419a2ec5b" status: 200 len: 1508 microversion: 2.1 time: 0.153162 Sep 13 18:06:43.280732 dv-cinder-852009-8-iscsi devstack@n-api.service[120741]: [pid: 120741|app: 0|req: 262/531] 10.222.0.43 () {58 vars in 1236 bytes} [Tue Sep 13 18:06:43 2022] GET /compute/v2.1/servers/8cd29851-35c1-4032-a137-ab9419a2ec5b => generated 1508 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 13 18:06:43.567579 dv-cinder-852009-8-iscsi devstack@n-api.service[120740]: DEBUG nova.api.openstack.wsgi [req-2a78fb8e-6739-4e16-b7aa-3854f74a8e59 req-f34fbce5-d31f-458f-83b6-20d4d562e862 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "8cd29851-35c1-4032-a137-ab9419a2ec5b", "name": "network-vif-deleted", "tag": "eb1bc841-d939-422b-b6e4-a6ed6ba2c0a1"}]} {{(pid=120740) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 13 18:06:43.577722 dv-cinder-852009-8-iscsi devstack@n-api.service[120740]: DEBUG oslo_concurrency.lockutils [req-2a78fb8e-6739-4e16-b7aa-3854f74a8e59 req-f34fbce5-d31f-458f-83b6-20d4d562e862 service nova] Acquiring lock "1daf4f4c-0e4a-4779-b53a-78c48397ea2f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120740) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 18:06:43.578091 dv-cinder-852009-8-iscsi devstack@n-api.service[120740]: DEBUG oslo_concurrency.lockutils [req-2a78fb8e-6739-4e16-b7aa-3854f74a8e59 req-f34fbce5-d31f-458f-83b6-20d4d562e862 service nova] Lock "1daf4f4c-0e4a-4779-b53a-78c48397ea2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120740) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 18:06:43.578521 dv-cinder-852009-8-iscsi devstack@n-api.service[120740]: DEBUG oslo_concurrency.lockutils [req-2a78fb8e-6739-4e16-b7aa-3854f74a8e59 req-f34fbce5-d31f-458f-83b6-20d4d562e862 service nova] Lock "1daf4f4c-0e4a-4779-b53a-78c48397ea2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120740) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 18:06:43.590448 dv-cinder-852009-8-iscsi devstack@n-api.service[120740]: INFO nova.api.openstack.compute.server_external_events [req-2a78fb8e-6739-4e16-b7aa-3854f74a8e59 req-f34fbce5-d31f-458f-83b6-20d4d562e862 service nova] Creating event network-vif-deleted:eb1bc841-d939-422b-b6e4-a6ed6ba2c0a1 for instance 8cd29851-35c1-4032-a137-ab9419a2ec5b on hv-cinder-85200 Sep 13 18:06:43.596246 dv-cinder-852009-8-iscsi devstack@n-api.service[120740]: INFO nova.api.openstack.requestlog [req-2a78fb8e-6739-4e16-b7aa-3854f74a8e59 req-f34fbce5-d31f-458f-83b6-20d4d562e862 service nova] 10.222.0.43 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.032373 Sep 13 18:06:43.596923 dv-cinder-852009-8-iscsi devstack@n-api.service[120740]: [pid: 120740|app: 0|req: 270/532] 10.222.0.43 () {64 vars in 1317 bytes} [Tue Sep 13 18:06:43 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 34 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 13 18:06:44.198261 dv-cinder-852009-8-iscsi devstack@n-api.service[120741]: DEBUG nova.api.openstack.wsgi [None req-45381daa-15be-4bc6-8b29-917ccedafe72 tempest-TestMinimumBasicScenario-820002800 tempest-TestMinimumBasicScenario-820002800-project] Calling method '>' {{(pid=120741) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 18:06:44.198856 dv-cinder-852009-8-iscsi devstack@n-api.service[120741]: DEBUG nova.compute.api [None req-45381daa-15be-4bc6-8b29-917ccedafe72 tempest-TestMinimumBasicScenario-820002800 tempest-TestMinimumBasicScenario-820002800-project] [instance: f8247a13-94cd-45b2-acc8-8717e1260f37] Fetching instance by UUID {{(pid=120741) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 18:06:44.201427 dv-cinder-852009-8-iscsi devstack@n-api.service[120741]: DEBUG dbcounter [-] [120741] Writing DB stats nova_api:SELECT=83,nova_api:UPDATE=3,nova_api:INSERT=1,nova_api:DELETE=1 {{(pid=120741) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 18:06:44.208295 dv-cinder-852009-8-iscsi devstack@n-api.service[120741]: DEBUG oslo_concurrency.lockutils [None req-45381daa-15be-4bc6-8b29-917ccedafe72 tempest-TestMinimumBasicScenario-820002800 tempest-TestMinimumBasicScenario-820002800-project] Acquiring lock "1daf4f4c-0e4a-4779-b53a-78c48397ea2f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120741) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 18:06:44.208837 dv-cinder-852009-8-iscsi devstack@n-api.service[120741]: DEBUG oslo_concurrency.lockutils [None req-45381daa-15be-4bc6-8b29-917ccedafe72 tempest-TestMinimumBasicScenario-820002800 tempest-TestMinimumBasicScenario-820002800-project] Lock "1daf4f4c-0e4a-4779-b53a-78c48397ea2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120741) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 18:06:44.209264 dv-cinder-852009-8-iscsi devstack@n-api.service[120741]: DEBUG oslo_concurrency.lockutils [None req-45381daa-15be-4bc6-8b29-917ccedafe72 tempest-TestMinimumBasicScenario-820002800 tempest-TestMinimumBasicScenario-820002800-project] Lock "1daf4f4c-0e4a-4779-b53a-78c48397ea2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120741) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 18:06:44.210055 dv-cinder-852009-8-iscsi devstack@n-api.service[120741]: DEBUG oslo_concurrency.lockutils [None req-45381daa-15be-4bc6-8b29-917ccedafe72 tempest-TestMinimumBasicScenario-820002800 tempest-TestMinimumBasicScenario-820002800-project] Acquiring lock "1daf4f4c-0e4a-4779-b53a-78c48397ea2f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120741) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 18:06:44.210507 dv-cinder-852009-8-iscsi devstack@n-api.service[120741]: DEBUG oslo_concurrency.lockutils [None req-45381daa-15be-4bc6-8b29-917ccedafe72 tempest-TestMinimumBasicScenario-820002800 tempest-TestMinimumBasicScenario-820002800-project] Lock "1daf4f4c-0e4a-4779-b53a-78c48397ea2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120741) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 18:06:44.211458 dv-cinder-852009-8-iscsi devstack@n-api.service[120741]: DEBUG oslo_concurrency.lockutils [None req-45381daa-15be-4bc6-8b29-917ccedafe72 tempest-TestMinimumBasicScenario-820002800 tempest-TestMinimumBasicScenario-820002800-project] Lock "1daf4f4c-0e4a-4779-b53a-78c48397ea2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120741) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 18:06:44.303918 dv-cinder-852009-8-iscsi devstack@n-api.service[120740]: DEBUG nova.api.openstack.wsgi [None req-21300ca4-59de-4eb1-85d3-f1690eabd1ca tempest-ServerRescueNegativeTestJSON-412251590 tempest-ServerRescueNegativeTestJSON-412251590-project] Calling method '>' {{(pid=120740) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 18:06:44.304903 dv-cinder-852009-8-iscsi devstack@n-api.service[120740]: DEBUG nova.compute.api [None req-21300ca4-59de-4eb1-85d3-f1690eabd1ca tempest-ServerRescueNegativeTestJSON-412251590 tempest-ServerRescueNegativeTestJSON-412251590-project] [instance: 8cd29851-35c1-4032-a137-ab9419a2ec5b] Fetching instance by UUID {{(pid=120740) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 18:06:44.311484 dv-cinder-852009-8-iscsi devstack@n-api.service[120740]: DEBUG oslo_concurrency.lockutils [None req-21300ca4-59de-4eb1-85d3-f1690eabd1ca tempest-ServerRescueNegativeTestJSON-412251590 tempest-ServerRescueNegativeTestJSON-412251590-project] Acquiring lock "1daf4f4c-0e4a-4779-b53a-78c48397ea2f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120740) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 18:06:44.312347 dv-cinder-852009-8-iscsi devstack@n-api.service[120740]: DEBUG oslo_concurrency.lockutils [None req-21300ca4-59de-4eb1-85d3-f1690eabd1ca tempest-ServerRescueNegativeTestJSON-412251590 tempest-ServerRescueNegativeTestJSON-412251590-project] Lock "1daf4f4c-0e4a-4779-b53a-78c48397ea2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120740) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 18:06:44.312812 dv-cinder-852009-8-iscsi devstack@n-api.service[120740]: DEBUG oslo_concurrency.lockutils [None req-21300ca4-59de-4eb1-85d3-f1690eabd1ca tempest-ServerRescueNegativeTestJSON-412251590 tempest-ServerRescueNegativeTestJSON-412251590-project] Lock "1daf4f4c-0e4a-4779-b53a-78c48397ea2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120740) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 18:06:44.313608 dv-cinder-852009-8-iscsi devstack@n-api.service[120740]: DEBUG oslo_concurrency.lockutils [None req-21300ca4-59de-4eb1-85d3-f1690eabd1ca tempest-ServerRescueNegativeTestJSON-412251590 tempest-ServerRescueNegativeTestJSON-412251590-project] Acquiring lock "1daf4f4c-0e4a-4779-b53a-78c48397ea2f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120740) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 18:06:44.314091 dv-cinder-852009-8-iscsi devstack@n-api.service[120740]: DEBUG oslo_concurrency.lockutils [None req-21300ca4-59de-4eb1-85d3-f1690eabd1ca tempest-ServerRescueNegativeTestJSON-412251590 tempest-ServerRescueNegativeTestJSON-412251590-project] Lock "1daf4f4c-0e4a-4779-b53a-78c48397ea2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120740) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 18:06:44.314531 dv-cinder-852009-8-iscsi devstack@n-api.service[120740]: DEBUG oslo_concurrency.lockutils [None req-21300ca4-59de-4eb1-85d3-f1690eabd1ca tempest-ServerRescueNegativeTestJSON-412251590 tempest-ServerRescueNegativeTestJSON-412251590-project] Lock "1daf4f4c-0e4a-4779-b53a-78c48397ea2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120740) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 18:06:44.328007 dv-cinder-852009-8-iscsi devstack@n-api.service[120740]: INFO nova.api.openstack.wsgi [None req-21300ca4-59de-4eb1-85d3-f1690eabd1ca tempest-ServerRescueNegativeTestJSON-412251590 tempest-ServerRescueNegativeTestJSON-412251590-project] HTTP exception thrown: Instance 8cd29851-35c1-4032-a137-ab9419a2ec5b could not be found. Sep 13 18:06:44.329626 dv-cinder-852009-8-iscsi devstack@n-api.service[120740]: DEBUG nova.api.openstack.wsgi [None req-21300ca4-59de-4eb1-85d3-f1690eabd1ca tempest-ServerRescueNegativeTestJSON-412251590 tempest-ServerRescueNegativeTestJSON-412251590-project] Request method failure captured: Sep 13 18:06:44.329626 dv-cinder-852009-8-iscsi devstack@n-api.service[120740]: request: GET /compute/v2.1/servers/8cd29851-35c1-4032-a137-ab9419a2ec5b HTTP/1.1 Sep 13 18:06:44.329626 dv-cinder-852009-8-iscsi devstack@n-api.service[120740]: Accept: application/json Sep 13 18:06:44.329626 dv-cinder-852009-8-iscsi devstack@n-api.service[120740]: Accept-Encoding: identity Sep 13 18:06:44.329626 dv-cinder-852009-8-iscsi devstack@n-api.service[120740]: Connection: close Sep 13 18:06:44.329626 dv-cinder-852009-8-iscsi devstack@n-api.service[120740]: Content-Length: 0 Sep 13 18:06:44.329626 dv-cinder-852009-8-iscsi devstack@n-api.service[120740]: Content-Type: application/json Sep 13 18:06:44.329626 dv-cinder-852009-8-iscsi devstack@n-api.service[120740]: Host: 10.222.0.43 Sep 13 18:06:44.329626 dv-cinder-852009-8-iscsi devstack@n-api.service[120740]: Openstack-System-Scope: None Sep 13 18:06:44.329626 dv-cinder-852009-8-iscsi devstack@n-api.service[120740]: User-Agent: python-urllib3/1.26.12 Sep 13 18:06:44.329626 dv-cinder-852009-8-iscsi devstack@n-api.service[120740]: X-Auth-Token: gAAAAABjIMWLGCNoeMW1liDJB1gW9y5zhqmLF-sp8LIXP_r2MtlxdDHDtH71A_-WwD3h6pxNpP_1J3-5dl1onM_1dz3k03VMJo2rjFEdcnLe1SaUhiMh3RVhtixTQiirGhUKXyKFRgOaQ5UOSPmq2sc9F0EVe-crpqJDqeSJGSsHbG1iIfI3v08 Sep 13 18:06:44.329626 dv-cinder-852009-8-iscsi devstack@n-api.service[120740]: X-Domain-Id: None Sep 13 18:06:44.329626 dv-cinder-852009-8-iscsi devstack@n-api.service[120740]: X-Domain-Name: None Sep 13 18:06:44.329626 dv-cinder-852009-8-iscsi devstack@n-api.service[120740]: X-Identity-Status: Confirmed Sep 13 18:06:44.329626 dv-cinder-852009-8-iscsi devstack@n-api.service[120740]: X-Is-Admin-Project: True Sep 13 18:06:44.329626 dv-cinder-852009-8-iscsi devstack@n-api.service[120740]: X-Project-Domain-Id: default Sep 13 18:06:44.329626 dv-cinder-852009-8-iscsi devstack@n-api.service[120740]: X-Project-Domain-Name: Default Sep 13 18:06:44.329626 dv-cinder-852009-8-iscsi devstack@n-api.service[120740]: X-Project-Id: 2eae4acecf6c4961830ead78d71b2ad3 Sep 13 18:06:44.329626 dv-cinder-852009-8-iscsi devstack@n-api.service[120740]: X-Project-Name: tempest-ServerRescueNegativeTestJSON-412251590 Sep 13 18:06:44.329626 dv-cinder-852009-8-iscsi devstack@n-api.service[120740]: X-Role: reader,member Sep 13 18:06:44.329626 dv-cinder-852009-8-iscsi devstack@n-api.service[120740]: X-Roles: reader,member Sep 13 18:06:44.331090 dv-cinder-852009-8-iscsi devstack@n-api.service[120740]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/identity"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/compute/v2/2eae4acecf6c4961830ead78d71b2ad3"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.43:8080", "publicURL": "http://10.222.0.43:8080/v1/AUTH_2eae4acecf6c4961830ead78d71b2ad3"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43:9696/networking"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/volume/v3/2eae4acecf6c4961830ead78d71b2ad3"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/compute/v2.1"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/placement"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/volume/v3/2eae4acecf6c4961830ead78d71b2ad3"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/image"}]}] Sep 13 18:06:44.331090 dv-cinder-852009-8-iscsi devstack@n-api.service[120740]: X-Tenant: tempest-ServerRescueNegativeTestJSON-412251590 Sep 13 18:06:44.331090 dv-cinder-852009-8-iscsi devstack@n-api.service[120740]: X-Tenant-Id: 2eae4acecf6c4961830ead78d71b2ad3 Sep 13 18:06:44.331090 dv-cinder-852009-8-iscsi devstack@n-api.service[120740]: X-Tenant-Name: tempest-ServerRescueNegativeTestJSON-412251590 Sep 13 18:06:44.331090 dv-cinder-852009-8-iscsi devstack@n-api.service[120740]: X-User: tempest-ServerRescueNegativeTestJSON-412251590-project Sep 13 18:06:44.331090 dv-cinder-852009-8-iscsi devstack@n-api.service[120740]: X-User-Domain-Id: default Sep 13 18:06:44.331090 dv-cinder-852009-8-iscsi devstack@n-api.service[120740]: X-User-Domain-Name: Default Sep 13 18:06:44.331090 dv-cinder-852009-8-iscsi devstack@n-api.service[120740]: X-User-Id: 60800cf2774e409d9c1b6f4992669991 Sep 13 18:06:44.331090 dv-cinder-852009-8-iscsi devstack@n-api.service[120740]: X-User-Name: tempest-ServerRescueNegativeTestJSON-412251590-project Sep 13 18:06:44.331090 dv-cinder-852009-8-iscsi devstack@n-api.service[120740]: method: > Sep 13 18:06:44.331090 dv-cinder-852009-8-iscsi devstack@n-api.service[120740]: exception: Instance 8cd29851-35c1-4032-a137-ab9419a2ec5b could not be found. Sep 13 18:06:44.331090 dv-cinder-852009-8-iscsi devstack@n-api.service[120740]: action_args: {'id': '8cd29851-35c1-4032-a137-ab9419a2ec5b'} Sep 13 18:06:44.331941 dv-cinder-852009-8-iscsi devstack@n-api.service[120740]: {{(pid=120740) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 13 18:06:44.331941 dv-cinder-852009-8-iscsi devstack@n-api.service[120740]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 13 18:06:44.331941 dv-cinder-852009-8-iscsi devstack@n-api.service[120740]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Sep 13 18:06:44.331941 dv-cinder-852009-8-iscsi devstack@n-api.service[120740]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Sep 13 18:06:44.331941 dv-cinder-852009-8-iscsi devstack@n-api.service[120740]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Sep 13 18:06:44.331941 dv-cinder-852009-8-iscsi devstack@n-api.service[120740]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Sep 13 18:06:44.331941 dv-cinder-852009-8-iscsi devstack@n-api.service[120740]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Sep 13 18:06:44.331941 dv-cinder-852009-8-iscsi devstack@n-api.service[120740]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Sep 13 18:06:44.331941 dv-cinder-852009-8-iscsi devstack@n-api.service[120740]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Sep 13 18:06:44.331941 dv-cinder-852009-8-iscsi devstack@n-api.service[120740]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Sep 13 18:06:44.331941 dv-cinder-852009-8-iscsi devstack@n-api.service[120740]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 8cd29851-35c1-4032-a137-ab9419a2ec5b could not be found. Sep 13 18:06:44.331941 dv-cinder-852009-8-iscsi devstack@n-api.service[120740]: ERROR nova.api.openstack.wsgi Sep 13 18:06:44.331941 dv-cinder-852009-8-iscsi devstack@n-api.service[120740]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 13 18:06:44.331941 dv-cinder-852009-8-iscsi devstack@n-api.service[120740]: ERROR nova.api.openstack.wsgi Sep 13 18:06:44.331941 dv-cinder-852009-8-iscsi devstack@n-api.service[120740]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 13 18:06:44.331941 dv-cinder-852009-8-iscsi devstack@n-api.service[120740]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 13 18:06:44.331941 dv-cinder-852009-8-iscsi devstack@n-api.service[120740]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 13 18:06:44.331941 dv-cinder-852009-8-iscsi devstack@n-api.service[120740]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 13 18:06:44.331941 dv-cinder-852009-8-iscsi devstack@n-api.service[120740]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 13 18:06:44.331941 dv-cinder-852009-8-iscsi devstack@n-api.service[120740]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 13 18:06:44.333258 dv-cinder-852009-8-iscsi devstack@n-api.service[120740]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 13 18:06:44.333258 dv-cinder-852009-8-iscsi devstack@n-api.service[120740]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Sep 13 18:06:44.333258 dv-cinder-852009-8-iscsi devstack@n-api.service[120740]: ERROR nova.api.openstack.wsgi instance = self._get_server( Sep 13 18:06:44.333258 dv-cinder-852009-8-iscsi devstack@n-api.service[120740]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Sep 13 18:06:44.333258 dv-cinder-852009-8-iscsi devstack@n-api.service[120740]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Sep 13 18:06:44.333258 dv-cinder-852009-8-iscsi devstack@n-api.service[120740]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Sep 13 18:06:44.333258 dv-cinder-852009-8-iscsi devstack@n-api.service[120740]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Sep 13 18:06:44.333258 dv-cinder-852009-8-iscsi devstack@n-api.service[120740]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 8cd29851-35c1-4032-a137-ab9419a2ec5b could not be found. Sep 13 18:06:44.333258 dv-cinder-852009-8-iscsi devstack@n-api.service[120740]: ERROR nova.api.openstack.wsgi Sep 13 18:06:44.333258 dv-cinder-852009-8-iscsi devstack@n-api.service[120740]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 13 18:06:44.333258 dv-cinder-852009-8-iscsi devstack@n-api.service[120740]: ERROR nova.api.openstack.wsgi Sep 13 18:06:44.333258 dv-cinder-852009-8-iscsi devstack@n-api.service[120740]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 13 18:06:44.333258 dv-cinder-852009-8-iscsi devstack@n-api.service[120740]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 13 18:06:44.333258 dv-cinder-852009-8-iscsi devstack@n-api.service[120740]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 13 18:06:44.333258 dv-cinder-852009-8-iscsi devstack@n-api.service[120740]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 13 18:06:44.333258 dv-cinder-852009-8-iscsi devstack@n-api.service[120740]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 13 18:06:44.333258 dv-cinder-852009-8-iscsi devstack@n-api.service[120740]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 8cd29851-35c1-4032-a137-ab9419a2ec5b could not be found. Sep 13 18:06:44.333258 dv-cinder-852009-8-iscsi devstack@n-api.service[120740]: ERROR nova.api.openstack.wsgi Sep 13 18:06:44.334375 dv-cinder-852009-8-iscsi devstack@n-api.service[120740]: DEBUG nova.api.openstack.wsgi [None req-21300ca4-59de-4eb1-85d3-f1690eabd1ca tempest-ServerRescueNegativeTestJSON-412251590 tempest-ServerRescueNegativeTestJSON-412251590-project] Returning 404 to user: Instance 8cd29851-35c1-4032-a137-ab9419a2ec5b could not be found. {{(pid=120740) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 13 18:06:44.334375 dv-cinder-852009-8-iscsi devstack@n-api.service[120740]: INFO nova.api.openstack.requestlog [None req-21300ca4-59de-4eb1-85d3-f1690eabd1ca tempest-ServerRescueNegativeTestJSON-412251590 tempest-ServerRescueNegativeTestJSON-412251590-project] 10.222.0.43 "GET /compute/v2.1/servers/8cd29851-35c1-4032-a137-ab9419a2ec5b" status: 404 len: 111 microversion: 2.1 time: 0.031891 Sep 13 18:06:44.334375 dv-cinder-852009-8-iscsi devstack@n-api.service[120740]: [pid: 120740|app: 0|req: 271/533] 10.222.0.43 () {58 vars in 1236 bytes} [Tue Sep 13 18:06:44 2022] GET /compute/v2.1/servers/8cd29851-35c1-4032-a137-ab9419a2ec5b => generated 111 bytes in 33 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Sep 13 18:06:44.339322 dv-cinder-852009-8-iscsi devstack@n-api.service[120740]: DEBUG nova.api.openstack.wsgi [None req-65385803-49b0-42f4-827c-67317d296e8d tempest-ServerRescueNegativeTestJSON-412251590 tempest-ServerRescueNegativeTestJSON-412251590-project] Calling method '>' {{(pid=120740) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 18:06:44.339803 dv-cinder-852009-8-iscsi devstack@n-api.service[120740]: DEBUG nova.compute.api [None req-65385803-49b0-42f4-827c-67317d296e8d tempest-ServerRescueNegativeTestJSON-412251590 tempest-ServerRescueNegativeTestJSON-412251590-project] [instance: a9c22f82-a945-4a94-b3c9-fe95265053bd] Fetching instance by UUID {{(pid=120740) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 18:06:44.345628 dv-cinder-852009-8-iscsi devstack@n-api.service[120740]: DEBUG oslo_concurrency.lockutils [None req-65385803-49b0-42f4-827c-67317d296e8d tempest-ServerRescueNegativeTestJSON-412251590 tempest-ServerRescueNegativeTestJSON-412251590-project] Acquiring lock "1daf4f4c-0e4a-4779-b53a-78c48397ea2f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120740) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 18:06:44.346103 dv-cinder-852009-8-iscsi devstack@n-api.service[120740]: DEBUG oslo_concurrency.lockutils [None req-65385803-49b0-42f4-827c-67317d296e8d tempest-ServerRescueNegativeTestJSON-412251590 tempest-ServerRescueNegativeTestJSON-412251590-project] Lock "1daf4f4c-0e4a-4779-b53a-78c48397ea2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120740) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 18:06:44.346527 dv-cinder-852009-8-iscsi devstack@n-api.service[120740]: DEBUG oslo_concurrency.lockutils [None req-65385803-49b0-42f4-827c-67317d296e8d tempest-ServerRescueNegativeTestJSON-412251590 tempest-ServerRescueNegativeTestJSON-412251590-project] Lock "1daf4f4c-0e4a-4779-b53a-78c48397ea2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120740) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 18:06:44.347201 dv-cinder-852009-8-iscsi devstack@n-api.service[120740]: DEBUG oslo_concurrency.lockutils [None req-65385803-49b0-42f4-827c-67317d296e8d tempest-ServerRescueNegativeTestJSON-412251590 tempest-ServerRescueNegativeTestJSON-412251590-project] Acquiring lock "1daf4f4c-0e4a-4779-b53a-78c48397ea2f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120740) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 18:06:44.347688 dv-cinder-852009-8-iscsi devstack@n-api.service[120740]: DEBUG oslo_concurrency.lockutils [None req-65385803-49b0-42f4-827c-67317d296e8d tempest-ServerRescueNegativeTestJSON-412251590 tempest-ServerRescueNegativeTestJSON-412251590-project] Lock "1daf4f4c-0e4a-4779-b53a-78c48397ea2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120740) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 18:06:44.348041 dv-cinder-852009-8-iscsi devstack@n-api.service[120740]: DEBUG oslo_concurrency.lockutils [None req-65385803-49b0-42f4-827c-67317d296e8d tempest-ServerRescueNegativeTestJSON-412251590 tempest-ServerRescueNegativeTestJSON-412251590-project] Lock "1daf4f4c-0e4a-4779-b53a-78c48397ea2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120740) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 18:06:44.366283 dv-cinder-852009-8-iscsi devstack@n-api.service[120741]: DEBUG nova.policy [None req-45381daa-15be-4bc6-8b29-917ccedafe72 tempest-TestMinimumBasicScenario-820002800 tempest-TestMinimumBasicScenario-820002800-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7880064ff0aa448d9c367c89eba145ff', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2f6832936c824066a4370cc45c5b0282', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120741) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 18:06:44.373164 dv-cinder-852009-8-iscsi devstack@n-api.service[120740]: DEBUG nova.compute.api [None req-65385803-49b0-42f4-827c-67317d296e8d tempest-ServerRescueNegativeTestJSON-412251590 tempest-ServerRescueNegativeTestJSON-412251590-project] [instance: a9c22f82-a945-4a94-b3c9-fe95265053bd] Going to try to terminate instance {{(pid=120740) delete /opt/stack/nova/nova/compute/api.py:2719}} Sep 13 18:06:44.374673 dv-cinder-852009-8-iscsi devstack@n-api.service[120741]: INFO nova.api.openstack.requestlog [None req-45381daa-15be-4bc6-8b29-917ccedafe72 tempest-TestMinimumBasicScenario-820002800 tempest-TestMinimumBasicScenario-820002800-project] 10.222.0.43 "GET /compute/v2.1/servers/f8247a13-94cd-45b2-acc8-8717e1260f37" status: 200 len: 1758 microversion: 2.1 time: 0.180397 Sep 13 18:06:44.375251 dv-cinder-852009-8-iscsi devstack@n-api.service[120741]: [pid: 120741|app: 0|req: 263/534] 10.222.0.43 () {58 vars in 1236 bytes} [Tue Sep 13 18:06:44 2022] GET /compute/v2.1/servers/f8247a13-94cd-45b2-acc8-8717e1260f37 => generated 1758 bytes in 182 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 13 18:06:44.452817 dv-cinder-852009-8-iscsi devstack@n-api.service[120740]: INFO nova.api.openstack.requestlog [None req-65385803-49b0-42f4-827c-67317d296e8d tempest-ServerRescueNegativeTestJSON-412251590 tempest-ServerRescueNegativeTestJSON-412251590-project] 10.222.0.43 "DELETE /compute/v2.1/servers/a9c22f82-a945-4a94-b3c9-fe95265053bd" status: 204 len: 0 microversion: 2.1 time: 0.116743 Sep 13 18:06:44.453521 dv-cinder-852009-8-iscsi devstack@n-api.service[120740]: [pid: 120740|app: 0|req: 272/535] 10.222.0.43 () {58 vars in 1239 bytes} [Tue Sep 13 18:06:44 2022] DELETE /compute/v2.1/servers/a9c22f82-a945-4a94-b3c9-fe95265053bd => generated 0 bytes in 118 msecs (HTTP/1.1 204) 9 headers in 363 bytes (2 switches on core 0) Sep 13 18:06:44.462868 dv-cinder-852009-8-iscsi devstack@n-api.service[120741]: DEBUG nova.api.openstack.wsgi [None req-ab9b7cec-8fd4-4127-b7c3-f0dc8ad59730 tempest-ServerRescueNegativeTestJSON-412251590 tempest-ServerRescueNegativeTestJSON-412251590-project] Calling method '>' {{(pid=120741) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 18:06:44.463477 dv-cinder-852009-8-iscsi devstack@n-api.service[120741]: DEBUG nova.compute.api [None req-ab9b7cec-8fd4-4127-b7c3-f0dc8ad59730 tempest-ServerRescueNegativeTestJSON-412251590 tempest-ServerRescueNegativeTestJSON-412251590-project] [instance: a9c22f82-a945-4a94-b3c9-fe95265053bd] Fetching instance by UUID {{(pid=120741) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 18:06:44.469665 dv-cinder-852009-8-iscsi devstack@n-api.service[120741]: DEBUG oslo_concurrency.lockutils [None req-ab9b7cec-8fd4-4127-b7c3-f0dc8ad59730 tempest-ServerRescueNegativeTestJSON-412251590 tempest-ServerRescueNegativeTestJSON-412251590-project] Acquiring lock "1daf4f4c-0e4a-4779-b53a-78c48397ea2f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120741) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 18:06:44.470212 dv-cinder-852009-8-iscsi devstack@n-api.service[120741]: DEBUG oslo_concurrency.lockutils [None req-ab9b7cec-8fd4-4127-b7c3-f0dc8ad59730 tempest-ServerRescueNegativeTestJSON-412251590 tempest-ServerRescueNegativeTestJSON-412251590-project] Lock "1daf4f4c-0e4a-4779-b53a-78c48397ea2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120741) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 18:06:44.470648 dv-cinder-852009-8-iscsi devstack@n-api.service[120741]: DEBUG oslo_concurrency.lockutils [None req-ab9b7cec-8fd4-4127-b7c3-f0dc8ad59730 tempest-ServerRescueNegativeTestJSON-412251590 tempest-ServerRescueNegativeTestJSON-412251590-project] Lock "1daf4f4c-0e4a-4779-b53a-78c48397ea2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120741) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 18:06:44.471343 dv-cinder-852009-8-iscsi devstack@n-api.service[120741]: DEBUG oslo_concurrency.lockutils [None req-ab9b7cec-8fd4-4127-b7c3-f0dc8ad59730 tempest-ServerRescueNegativeTestJSON-412251590 tempest-ServerRescueNegativeTestJSON-412251590-project] Acquiring lock "1daf4f4c-0e4a-4779-b53a-78c48397ea2f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120741) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 18:06:44.471793 dv-cinder-852009-8-iscsi devstack@n-api.service[120741]: DEBUG oslo_concurrency.lockutils [None req-ab9b7cec-8fd4-4127-b7c3-f0dc8ad59730 tempest-ServerRescueNegativeTestJSON-412251590 tempest-ServerRescueNegativeTestJSON-412251590-project] Lock "1daf4f4c-0e4a-4779-b53a-78c48397ea2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120741) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 18:06:44.472523 dv-cinder-852009-8-iscsi devstack@n-api.service[120741]: DEBUG oslo_concurrency.lockutils [None req-ab9b7cec-8fd4-4127-b7c3-f0dc8ad59730 tempest-ServerRescueNegativeTestJSON-412251590 tempest-ServerRescueNegativeTestJSON-412251590-project] Lock "1daf4f4c-0e4a-4779-b53a-78c48397ea2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120741) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 18:06:44.612596 dv-cinder-852009-8-iscsi devstack@n-api.service[120741]: DEBUG nova.policy [None req-ab9b7cec-8fd4-4127-b7c3-f0dc8ad59730 tempest-ServerRescueNegativeTestJSON-412251590 tempest-ServerRescueNegativeTestJSON-412251590-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '60800cf2774e409d9c1b6f4992669991', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2eae4acecf6c4961830ead78d71b2ad3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120741) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 18:06:44.624503 dv-cinder-852009-8-iscsi devstack@n-api.service[120741]: INFO nova.api.openstack.requestlog [None req-ab9b7cec-8fd4-4127-b7c3-f0dc8ad59730 tempest-ServerRescueNegativeTestJSON-412251590 tempest-ServerRescueNegativeTestJSON-412251590-project] 10.222.0.43 "GET /compute/v2.1/servers/a9c22f82-a945-4a94-b3c9-fe95265053bd" status: 200 len: 1523 microversion: 2.1 time: 0.166067 Sep 13 18:06:44.625356 dv-cinder-852009-8-iscsi devstack@n-api.service[120741]: [pid: 120741|app: 0|req: 264/536] 10.222.0.43 () {58 vars in 1236 bytes} [Tue Sep 13 18:06:44 2022] GET /compute/v2.1/servers/a9c22f82-a945-4a94-b3c9-fe95265053bd => generated 1523 bytes in 168 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 13 18:06:45.403472 dv-cinder-852009-8-iscsi devstack@n-api.service[120740]: DEBUG nova.api.openstack.wsgi [None req-27bf0c87-b550-4d6e-990d-7e1363821286 tempest-TestMinimumBasicScenario-820002800 tempest-TestMinimumBasicScenario-820002800-project] Calling method '>' {{(pid=120740) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 18:06:45.404722 dv-cinder-852009-8-iscsi devstack@n-api.service[120740]: DEBUG nova.compute.api [None req-27bf0c87-b550-4d6e-990d-7e1363821286 tempest-TestMinimumBasicScenario-820002800 tempest-TestMinimumBasicScenario-820002800-project] [instance: f8247a13-94cd-45b2-acc8-8717e1260f37] Fetching instance by UUID {{(pid=120740) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 18:06:45.414779 dv-cinder-852009-8-iscsi devstack@n-api.service[120740]: DEBUG oslo_concurrency.lockutils [None req-27bf0c87-b550-4d6e-990d-7e1363821286 tempest-TestMinimumBasicScenario-820002800 tempest-TestMinimumBasicScenario-820002800-project] Acquiring lock "1daf4f4c-0e4a-4779-b53a-78c48397ea2f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120740) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 18:06:45.415268 dv-cinder-852009-8-iscsi devstack@n-api.service[120740]: DEBUG oslo_concurrency.lockutils [None req-27bf0c87-b550-4d6e-990d-7e1363821286 tempest-TestMinimumBasicScenario-820002800 tempest-TestMinimumBasicScenario-820002800-project] Lock "1daf4f4c-0e4a-4779-b53a-78c48397ea2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120740) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 18:06:45.415702 dv-cinder-852009-8-iscsi devstack@n-api.service[120740]: DEBUG oslo_concurrency.lockutils [None req-27bf0c87-b550-4d6e-990d-7e1363821286 tempest-TestMinimumBasicScenario-820002800 tempest-TestMinimumBasicScenario-820002800-project] Lock "1daf4f4c-0e4a-4779-b53a-78c48397ea2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120740) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 18:06:45.416395 dv-cinder-852009-8-iscsi devstack@n-api.service[120740]: DEBUG oslo_concurrency.lockutils [None req-27bf0c87-b550-4d6e-990d-7e1363821286 tempest-TestMinimumBasicScenario-820002800 tempest-TestMinimumBasicScenario-820002800-project] Acquiring lock "1daf4f4c-0e4a-4779-b53a-78c48397ea2f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120740) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 18:06:45.416883 dv-cinder-852009-8-iscsi devstack@n-api.service[120740]: DEBUG oslo_concurrency.lockutils [None req-27bf0c87-b550-4d6e-990d-7e1363821286 tempest-TestMinimumBasicScenario-820002800 tempest-TestMinimumBasicScenario-820002800-project] Lock "1daf4f4c-0e4a-4779-b53a-78c48397ea2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120740) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 18:06:45.417308 dv-cinder-852009-8-iscsi devstack@n-api.service[120740]: DEBUG oslo_concurrency.lockutils [None req-27bf0c87-b550-4d6e-990d-7e1363821286 tempest-TestMinimumBasicScenario-820002800 tempest-TestMinimumBasicScenario-820002800-project] Lock "1daf4f4c-0e4a-4779-b53a-78c48397ea2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120740) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 18:06:45.567426 dv-cinder-852009-8-iscsi devstack@n-api.service[120740]: DEBUG nova.policy [None req-27bf0c87-b550-4d6e-990d-7e1363821286 tempest-TestMinimumBasicScenario-820002800 tempest-TestMinimumBasicScenario-820002800-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7880064ff0aa448d9c367c89eba145ff', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2f6832936c824066a4370cc45c5b0282', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120740) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 18:06:45.576051 dv-cinder-852009-8-iscsi devstack@n-api.service[120740]: INFO nova.api.openstack.requestlog [None req-27bf0c87-b550-4d6e-990d-7e1363821286 tempest-TestMinimumBasicScenario-820002800 tempest-TestMinimumBasicScenario-820002800-project] 10.222.0.43 "GET /compute/v2.1/servers/f8247a13-94cd-45b2-acc8-8717e1260f37" status: 200 len: 1758 microversion: 2.1 time: 0.180014 Sep 13 18:06:45.576631 dv-cinder-852009-8-iscsi devstack@n-api.service[120740]: [pid: 120740|app: 0|req: 273/537] 10.222.0.43 () {58 vars in 1236 bytes} [Tue Sep 13 18:06:45 2022] GET /compute/v2.1/servers/f8247a13-94cd-45b2-acc8-8717e1260f37 => generated 1758 bytes in 182 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 13 18:06:45.650522 dv-cinder-852009-8-iscsi devstack@n-api.service[120741]: DEBUG nova.api.openstack.wsgi [None req-a49edfa3-a9d8-4336-af24-7fa4bf69d531 tempest-ServerRescueNegativeTestJSON-412251590 tempest-ServerRescueNegativeTestJSON-412251590-project] Calling method '>' {{(pid=120741) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 18:06:45.651190 dv-cinder-852009-8-iscsi devstack@n-api.service[120741]: DEBUG nova.compute.api [None req-a49edfa3-a9d8-4336-af24-7fa4bf69d531 tempest-ServerRescueNegativeTestJSON-412251590 tempest-ServerRescueNegativeTestJSON-412251590-project] [instance: a9c22f82-a945-4a94-b3c9-fe95265053bd] Fetching instance by UUID {{(pid=120741) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 18:06:45.658916 dv-cinder-852009-8-iscsi devstack@n-api.service[120741]: DEBUG oslo_concurrency.lockutils [None req-a49edfa3-a9d8-4336-af24-7fa4bf69d531 tempest-ServerRescueNegativeTestJSON-412251590 tempest-ServerRescueNegativeTestJSON-412251590-project] Acquiring lock "1daf4f4c-0e4a-4779-b53a-78c48397ea2f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120741) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 18:06:45.659380 dv-cinder-852009-8-iscsi devstack@n-api.service[120741]: DEBUG oslo_concurrency.lockutils [None req-a49edfa3-a9d8-4336-af24-7fa4bf69d531 tempest-ServerRescueNegativeTestJSON-412251590 tempest-ServerRescueNegativeTestJSON-412251590-project] Lock "1daf4f4c-0e4a-4779-b53a-78c48397ea2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120741) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 18:06:45.659856 dv-cinder-852009-8-iscsi devstack@n-api.service[120741]: DEBUG oslo_concurrency.lockutils [None req-a49edfa3-a9d8-4336-af24-7fa4bf69d531 tempest-ServerRescueNegativeTestJSON-412251590 tempest-ServerRescueNegativeTestJSON-412251590-project] Lock "1daf4f4c-0e4a-4779-b53a-78c48397ea2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120741) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 18:06:45.660715 dv-cinder-852009-8-iscsi devstack@n-api.service[120741]: DEBUG oslo_concurrency.lockutils [None req-a49edfa3-a9d8-4336-af24-7fa4bf69d531 tempest-ServerRescueNegativeTestJSON-412251590 tempest-ServerRescueNegativeTestJSON-412251590-project] Acquiring lock "1daf4f4c-0e4a-4779-b53a-78c48397ea2f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120741) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 18:06:45.661218 dv-cinder-852009-8-iscsi devstack@n-api.service[120741]: DEBUG oslo_concurrency.lockutils [None req-a49edfa3-a9d8-4336-af24-7fa4bf69d531 tempest-ServerRescueNegativeTestJSON-412251590 tempest-ServerRescueNegativeTestJSON-412251590-project] Lock "1daf4f4c-0e4a-4779-b53a-78c48397ea2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120741) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 18:06:45.661672 dv-cinder-852009-8-iscsi devstack@n-api.service[120741]: DEBUG oslo_concurrency.lockutils [None req-a49edfa3-a9d8-4336-af24-7fa4bf69d531 tempest-ServerRescueNegativeTestJSON-412251590 tempest-ServerRescueNegativeTestJSON-412251590-project] Lock "1daf4f4c-0e4a-4779-b53a-78c48397ea2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120741) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 18:06:45.799030 dv-cinder-852009-8-iscsi devstack@n-api.service[120741]: DEBUG nova.policy [None req-a49edfa3-a9d8-4336-af24-7fa4bf69d531 tempest-ServerRescueNegativeTestJSON-412251590 tempest-ServerRescueNegativeTestJSON-412251590-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '60800cf2774e409d9c1b6f4992669991', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2eae4acecf6c4961830ead78d71b2ad3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120741) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 18:06:45.807515 dv-cinder-852009-8-iscsi devstack@n-api.service[120741]: INFO nova.api.openstack.requestlog [None req-a49edfa3-a9d8-4336-af24-7fa4bf69d531 tempest-ServerRescueNegativeTestJSON-412251590 tempest-ServerRescueNegativeTestJSON-412251590-project] 10.222.0.43 "GET /compute/v2.1/servers/a9c22f82-a945-4a94-b3c9-fe95265053bd" status: 200 len: 1523 microversion: 2.1 time: 0.162065 Sep 13 18:06:45.808127 dv-cinder-852009-8-iscsi devstack@n-api.service[120741]: [pid: 120741|app: 0|req: 265/538] 10.222.0.43 () {58 vars in 1236 bytes} [Tue Sep 13 18:06:45 2022] GET /compute/v2.1/servers/a9c22f82-a945-4a94-b3c9-fe95265053bd => generated 1523 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 13 18:06:46.099548 dv-cinder-852009-8-iscsi devstack@n-api.service[120740]: DEBUG nova.api.openstack.wsgi [None req-8c796828-b0ab-4186-8d90-cc38770e7165 tempest-AttachVolumeShelveTestJSON-385853788 tempest-AttachVolumeShelveTestJSON-385853788-project] Calling method '>' {{(pid=120740) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 18:06:46.100473 dv-cinder-852009-8-iscsi devstack@n-api.service[120740]: DEBUG nova.compute.api [None req-8c796828-b0ab-4186-8d90-cc38770e7165 tempest-AttachVolumeShelveTestJSON-385853788 tempest-AttachVolumeShelveTestJSON-385853788-project] [instance: 8cecf08e-bea8-4cef-9439-0eaa242bfed1] Fetching instance by UUID {{(pid=120740) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 18:06:46.106841 dv-cinder-852009-8-iscsi devstack@n-api.service[120740]: DEBUG oslo_concurrency.lockutils [None req-8c796828-b0ab-4186-8d90-cc38770e7165 tempest-AttachVolumeShelveTestJSON-385853788 tempest-AttachVolumeShelveTestJSON-385853788-project] Acquiring lock "1daf4f4c-0e4a-4779-b53a-78c48397ea2f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120740) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 18:06:46.107316 dv-cinder-852009-8-iscsi devstack@n-api.service[120740]: DEBUG oslo_concurrency.lockutils [None req-8c796828-b0ab-4186-8d90-cc38770e7165 tempest-AttachVolumeShelveTestJSON-385853788 tempest-AttachVolumeShelveTestJSON-385853788-project] Lock "1daf4f4c-0e4a-4779-b53a-78c48397ea2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120740) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 18:06:46.107740 dv-cinder-852009-8-iscsi devstack@n-api.service[120740]: DEBUG oslo_concurrency.lockutils [None req-8c796828-b0ab-4186-8d90-cc38770e7165 tempest-AttachVolumeShelveTestJSON-385853788 tempest-AttachVolumeShelveTestJSON-385853788-project] Lock "1daf4f4c-0e4a-4779-b53a-78c48397ea2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120740) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 18:06:46.108493 dv-cinder-852009-8-iscsi devstack@n-api.service[120740]: DEBUG oslo_concurrency.lockutils [None req-8c796828-b0ab-4186-8d90-cc38770e7165 tempest-AttachVolumeShelveTestJSON-385853788 tempest-AttachVolumeShelveTestJSON-385853788-project] Acquiring lock "1daf4f4c-0e4a-4779-b53a-78c48397ea2f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120740) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 18:06:46.108970 dv-cinder-852009-8-iscsi devstack@n-api.service[120740]: DEBUG oslo_concurrency.lockutils [None req-8c796828-b0ab-4186-8d90-cc38770e7165 tempest-AttachVolumeShelveTestJSON-385853788 tempest-AttachVolumeShelveTestJSON-385853788-project] Lock "1daf4f4c-0e4a-4779-b53a-78c48397ea2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120740) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 18:06:46.109379 dv-cinder-852009-8-iscsi devstack@n-api.service[120740]: DEBUG oslo_concurrency.lockutils [None req-8c796828-b0ab-4186-8d90-cc38770e7165 tempest-AttachVolumeShelveTestJSON-385853788 tempest-AttachVolumeShelveTestJSON-385853788-project] Lock "1daf4f4c-0e4a-4779-b53a-78c48397ea2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120740) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 18:06:46.135096 dv-cinder-852009-8-iscsi devstack@n-api.service[120740]: INFO nova.api.openstack.requestlog [None req-8c796828-b0ab-4186-8d90-cc38770e7165 tempest-AttachVolumeShelveTestJSON-385853788 tempest-AttachVolumeShelveTestJSON-385853788-project] 10.222.0.43 "GET /compute/v2.1/servers/8cecf08e-bea8-4cef-9439-0eaa242bfed1/ips" status: 200 len: 151 microversion: 2.20 time: 0.042430 Sep 13 18:06:46.135656 dv-cinder-852009-8-iscsi devstack@n-api.service[120740]: [pid: 120740|app: 0|req: 274/539] 10.222.0.43 () {60 vars in 1289 bytes} [Tue Sep 13 18:06:46 2022] GET /compute/v2.1/servers/8cecf08e-bea8-4cef-9439-0eaa242bfed1/ips => generated 151 bytes in 44 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Sep 13 18:06:46.603349 dv-cinder-852009-8-iscsi devstack@n-api.service[120741]: DEBUG nova.api.openstack.wsgi [None req-4c3c917e-d23e-4b21-9dfb-375679a942a6 tempest-TestMinimumBasicScenario-820002800 tempest-TestMinimumBasicScenario-820002800-project] Calling method '>' {{(pid=120741) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 18:06:46.604371 dv-cinder-852009-8-iscsi devstack@n-api.service[120741]: DEBUG nova.compute.api [None req-4c3c917e-d23e-4b21-9dfb-375679a942a6 tempest-TestMinimumBasicScenario-820002800 tempest-TestMinimumBasicScenario-820002800-project] [instance: f8247a13-94cd-45b2-acc8-8717e1260f37] Fetching instance by UUID {{(pid=120741) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 18:06:46.614649 dv-cinder-852009-8-iscsi devstack@n-api.service[120741]: DEBUG oslo_concurrency.lockutils [None req-4c3c917e-d23e-4b21-9dfb-375679a942a6 tempest-TestMinimumBasicScenario-820002800 tempest-TestMinimumBasicScenario-820002800-project] Acquiring lock "1daf4f4c-0e4a-4779-b53a-78c48397ea2f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120741) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 18:06:46.615429 dv-cinder-852009-8-iscsi devstack@n-api.service[120741]: DEBUG oslo_concurrency.lockutils [None req-4c3c917e-d23e-4b21-9dfb-375679a942a6 tempest-TestMinimumBasicScenario-820002800 tempest-TestMinimumBasicScenario-820002800-project] Lock "1daf4f4c-0e4a-4779-b53a-78c48397ea2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120741) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 18:06:46.616124 dv-cinder-852009-8-iscsi devstack@n-api.service[120741]: DEBUG oslo_concurrency.lockutils [None req-4c3c917e-d23e-4b21-9dfb-375679a942a6 tempest-TestMinimumBasicScenario-820002800 tempest-TestMinimumBasicScenario-820002800-project] Lock "1daf4f4c-0e4a-4779-b53a-78c48397ea2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120741) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 18:06:46.616849 dv-cinder-852009-8-iscsi devstack@n-api.service[120741]: DEBUG oslo_concurrency.lockutils [None req-4c3c917e-d23e-4b21-9dfb-375679a942a6 tempest-TestMinimumBasicScenario-820002800 tempest-TestMinimumBasicScenario-820002800-project] Acquiring lock "1daf4f4c-0e4a-4779-b53a-78c48397ea2f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120741) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 18:06:46.617284 dv-cinder-852009-8-iscsi devstack@n-api.service[120741]: DEBUG oslo_concurrency.lockutils [None req-4c3c917e-d23e-4b21-9dfb-375679a942a6 tempest-TestMinimumBasicScenario-820002800 tempest-TestMinimumBasicScenario-820002800-project] Lock "1daf4f4c-0e4a-4779-b53a-78c48397ea2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120741) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 18:06:46.617701 dv-cinder-852009-8-iscsi devstack@n-api.service[120741]: DEBUG oslo_concurrency.lockutils [None req-4c3c917e-d23e-4b21-9dfb-375679a942a6 tempest-TestMinimumBasicScenario-820002800 tempest-TestMinimumBasicScenario-820002800-project] Lock "1daf4f4c-0e4a-4779-b53a-78c48397ea2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120741) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 18:06:46.762807 dv-cinder-852009-8-iscsi devstack@n-api.service[120741]: DEBUG nova.policy [None req-4c3c917e-d23e-4b21-9dfb-375679a942a6 tempest-TestMinimumBasicScenario-820002800 tempest-TestMinimumBasicScenario-820002800-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7880064ff0aa448d9c367c89eba145ff', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2f6832936c824066a4370cc45c5b0282', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120741) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 18:06:46.775254 dv-cinder-852009-8-iscsi devstack@n-api.service[120741]: INFO nova.api.openstack.requestlog [None req-4c3c917e-d23e-4b21-9dfb-375679a942a6 tempest-TestMinimumBasicScenario-820002800 tempest-TestMinimumBasicScenario-820002800-project] 10.222.0.43 "GET /compute/v2.1/servers/f8247a13-94cd-45b2-acc8-8717e1260f37" status: 200 len: 1758 microversion: 2.1 time: 0.178127 Sep 13 18:06:46.776037 dv-cinder-852009-8-iscsi devstack@n-api.service[120741]: [pid: 120741|app: 0|req: 266/540] 10.222.0.43 () {58 vars in 1236 bytes} [Tue Sep 13 18:06:46 2022] GET /compute/v2.1/servers/f8247a13-94cd-45b2-acc8-8717e1260f37 => generated 1758 bytes in 180 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 13 18:06:46.964044 dv-cinder-852009-8-iscsi devstack@n-api.service[120740]: DEBUG nova.api.openstack.wsgi [None req-7bb00bb5-9809-4b0c-953b-67b8f27b574c tempest-ServerRescueNegativeTestJSON-412251590 tempest-ServerRescueNegativeTestJSON-412251590-project] Calling method '>' {{(pid=120740) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 18:06:46.964774 dv-cinder-852009-8-iscsi devstack@n-api.service[120740]: DEBUG nova.compute.api [None req-7bb00bb5-9809-4b0c-953b-67b8f27b574c tempest-ServerRescueNegativeTestJSON-412251590 tempest-ServerRescueNegativeTestJSON-412251590-project] [instance: a9c22f82-a945-4a94-b3c9-fe95265053bd] Fetching instance by UUID {{(pid=120740) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 18:06:46.972508 dv-cinder-852009-8-iscsi devstack@n-api.service[120740]: DEBUG oslo_concurrency.lockutils [None req-7bb00bb5-9809-4b0c-953b-67b8f27b574c tempest-ServerRescueNegativeTestJSON-412251590 tempest-ServerRescueNegativeTestJSON-412251590-project] Acquiring lock "1daf4f4c-0e4a-4779-b53a-78c48397ea2f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120740) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 18:06:46.973000 dv-cinder-852009-8-iscsi devstack@n-api.service[120740]: DEBUG oslo_concurrency.lockutils [None req-7bb00bb5-9809-4b0c-953b-67b8f27b574c tempest-ServerRescueNegativeTestJSON-412251590 tempest-ServerRescueNegativeTestJSON-412251590-project] Lock "1daf4f4c-0e4a-4779-b53a-78c48397ea2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120740) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 18:06:46.973440 dv-cinder-852009-8-iscsi devstack@n-api.service[120740]: DEBUG oslo_concurrency.lockutils [None req-7bb00bb5-9809-4b0c-953b-67b8f27b574c tempest-ServerRescueNegativeTestJSON-412251590 tempest-ServerRescueNegativeTestJSON-412251590-project] Lock "1daf4f4c-0e4a-4779-b53a-78c48397ea2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120740) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 18:06:46.974160 dv-cinder-852009-8-iscsi devstack@n-api.service[120740]: DEBUG oslo_concurrency.lockutils [None req-7bb00bb5-9809-4b0c-953b-67b8f27b574c tempest-ServerRescueNegativeTestJSON-412251590 tempest-ServerRescueNegativeTestJSON-412251590-project] Acquiring lock "1daf4f4c-0e4a-4779-b53a-78c48397ea2f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120740) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 18:06:46.974613 dv-cinder-852009-8-iscsi devstack@n-api.service[120740]: DEBUG oslo_concurrency.lockutils [None req-7bb00bb5-9809-4b0c-953b-67b8f27b574c tempest-ServerRescueNegativeTestJSON-412251590 tempest-ServerRescueNegativeTestJSON-412251590-project] Lock "1daf4f4c-0e4a-4779-b53a-78c48397ea2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120740) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 18:06:46.975038 dv-cinder-852009-8-iscsi devstack@n-api.service[120740]: DEBUG oslo_concurrency.lockutils [None req-7bb00bb5-9809-4b0c-953b-67b8f27b574c tempest-ServerRescueNegativeTestJSON-412251590 tempest-ServerRescueNegativeTestJSON-412251590-project] Lock "1daf4f4c-0e4a-4779-b53a-78c48397ea2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120740) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 18:06:47.116837 dv-cinder-852009-8-iscsi devstack@n-api.service[120740]: DEBUG nova.policy [None req-7bb00bb5-9809-4b0c-953b-67b8f27b574c tempest-ServerRescueNegativeTestJSON-412251590 tempest-ServerRescueNegativeTestJSON-412251590-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '60800cf2774e409d9c1b6f4992669991', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2eae4acecf6c4961830ead78d71b2ad3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120740) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 18:06:47.124878 dv-cinder-852009-8-iscsi devstack@n-api.service[120740]: INFO nova.api.openstack.requestlog [None req-7bb00bb5-9809-4b0c-953b-67b8f27b574c tempest-ServerRescueNegativeTestJSON-412251590 tempest-ServerRescueNegativeTestJSON-412251590-project] 10.222.0.43 "GET /compute/v2.1/servers/a9c22f82-a945-4a94-b3c9-fe95265053bd" status: 200 len: 1523 microversion: 2.1 time: 0.291383 Sep 13 18:06:47.125542 dv-cinder-852009-8-iscsi devstack@n-api.service[120740]: [pid: 120740|app: 0|req: 275/541] 10.222.0.43 () {58 vars in 1236 bytes} [Tue Sep 13 18:06:46 2022] GET /compute/v2.1/servers/a9c22f82-a945-4a94-b3c9-fe95265053bd => generated 1523 bytes in 293 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 13 18:06:47.807523 dv-cinder-852009-8-iscsi devstack@n-api.service[120741]: DEBUG nova.api.openstack.wsgi [None req-e597a919-87dc-490c-9809-0232fce8c15c tempest-TestMinimumBasicScenario-820002800 tempest-TestMinimumBasicScenario-820002800-project] Calling method '>' {{(pid=120741) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 18:06:47.808538 dv-cinder-852009-8-iscsi devstack@n-api.service[120741]: DEBUG nova.compute.api [None req-e597a919-87dc-490c-9809-0232fce8c15c tempest-TestMinimumBasicScenario-820002800 tempest-TestMinimumBasicScenario-820002800-project] [instance: f8247a13-94cd-45b2-acc8-8717e1260f37] Fetching instance by UUID {{(pid=120741) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 18:06:47.819406 dv-cinder-852009-8-iscsi devstack@n-api.service[120741]: DEBUG oslo_concurrency.lockutils [None req-e597a919-87dc-490c-9809-0232fce8c15c tempest-TestMinimumBasicScenario-820002800 tempest-TestMinimumBasicScenario-820002800-project] Acquiring lock "1daf4f4c-0e4a-4779-b53a-78c48397ea2f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120741) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 18:06:47.819893 dv-cinder-852009-8-iscsi devstack@n-api.service[120741]: DEBUG oslo_concurrency.lockutils [None req-e597a919-87dc-490c-9809-0232fce8c15c tempest-TestMinimumBasicScenario-820002800 tempest-TestMinimumBasicScenario-820002800-project] Lock "1daf4f4c-0e4a-4779-b53a-78c48397ea2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120741) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 18:06:47.820315 dv-cinder-852009-8-iscsi devstack@n-api.service[120741]: DEBUG oslo_concurrency.lockutils [None req-e597a919-87dc-490c-9809-0232fce8c15c tempest-TestMinimumBasicScenario-820002800 tempest-TestMinimumBasicScenario-820002800-project] Lock "1daf4f4c-0e4a-4779-b53a-78c48397ea2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120741) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 18:06:47.821043 dv-cinder-852009-8-iscsi devstack@n-api.service[120741]: DEBUG oslo_concurrency.lockutils [None req-e597a919-87dc-490c-9809-0232fce8c15c tempest-TestMinimumBasicScenario-820002800 tempest-TestMinimumBasicScenario-820002800-project] Acquiring lock "1daf4f4c-0e4a-4779-b53a-78c48397ea2f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120741) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 18:06:47.821490 dv-cinder-852009-8-iscsi devstack@n-api.service[120741]: DEBUG oslo_concurrency.lockutils [None req-e597a919-87dc-490c-9809-0232fce8c15c tempest-TestMinimumBasicScenario-820002800 tempest-TestMinimumBasicScenario-820002800-project] Lock "1daf4f4c-0e4a-4779-b53a-78c48397ea2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120741) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 18:06:47.821904 dv-cinder-852009-8-iscsi devstack@n-api.service[120741]: DEBUG oslo_concurrency.lockutils [None req-e597a919-87dc-490c-9809-0232fce8c15c tempest-TestMinimumBasicScenario-820002800 tempest-TestMinimumBasicScenario-820002800-project] Lock "1daf4f4c-0e4a-4779-b53a-78c48397ea2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120741) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 18:06:48.007149 dv-cinder-852009-8-iscsi devstack@n-api.service[120740]: DEBUG nova.api.openstack.wsgi [None req-1358d988-aa2d-4b97-876a-d8403388855e tempest-TestShelveInstance-6258502 tempest-TestShelveInstance-6258502-project] Action: 'action', calling method: >, body: {"shelve": {}} {{(pid=120740) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 13 18:06:48.007706 dv-cinder-852009-8-iscsi devstack@n-api.service[120740]: DEBUG nova.compute.api [None req-1358d988-aa2d-4b97-876a-d8403388855e tempest-TestShelveInstance-6258502 tempest-TestShelveInstance-6258502-project] [instance: 2d60cc6d-a699-417d-aa20-fe3e1bfc351e] Fetching instance by UUID {{(pid=120740) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 18:06:48.010010 dv-cinder-852009-8-iscsi devstack@n-api.service[120740]: DEBUG dbcounter [-] [120740] Writing DB stats nova_api:SELECT=83,nova_api:DELETE=1,nova_api:INSERT=3,nova_api:UPDATE=1 {{(pid=120740) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 18:06:48.015053 dv-cinder-852009-8-iscsi devstack@n-api.service[120740]: DEBUG oslo_concurrency.lockutils [None req-1358d988-aa2d-4b97-876a-d8403388855e tempest-TestShelveInstance-6258502 tempest-TestShelveInstance-6258502-project] Acquiring lock "1daf4f4c-0e4a-4779-b53a-78c48397ea2f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120740) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 18:06:48.015822 dv-cinder-852009-8-iscsi devstack@n-api.service[120740]: DEBUG oslo_concurrency.lockutils [None req-1358d988-aa2d-4b97-876a-d8403388855e tempest-TestShelveInstance-6258502 tempest-TestShelveInstance-6258502-project] Lock "1daf4f4c-0e4a-4779-b53a-78c48397ea2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120740) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 18:06:48.016301 dv-cinder-852009-8-iscsi devstack@n-api.service[120740]: DEBUG oslo_concurrency.lockutils [None req-1358d988-aa2d-4b97-876a-d8403388855e tempest-TestShelveInstance-6258502 tempest-TestShelveInstance-6258502-project] Lock "1daf4f4c-0e4a-4779-b53a-78c48397ea2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120740) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 18:06:48.017028 dv-cinder-852009-8-iscsi devstack@n-api.service[120740]: DEBUG oslo_concurrency.lockutils [None req-1358d988-aa2d-4b97-876a-d8403388855e tempest-TestShelveInstance-6258502 tempest-TestShelveInstance-6258502-project] Acquiring lock "1daf4f4c-0e4a-4779-b53a-78c48397ea2f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120740) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 18:06:48.017464 dv-cinder-852009-8-iscsi devstack@n-api.service[120740]: DEBUG oslo_concurrency.lockutils [None req-1358d988-aa2d-4b97-876a-d8403388855e tempest-TestShelveInstance-6258502 tempest-TestShelveInstance-6258502-project] Lock "1daf4f4c-0e4a-4779-b53a-78c48397ea2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120740) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 18:06:48.017872 dv-cinder-852009-8-iscsi devstack@n-api.service[120740]: DEBUG oslo_concurrency.lockutils [None req-1358d988-aa2d-4b97-876a-d8403388855e tempest-TestShelveInstance-6258502 tempest-TestShelveInstance-6258502-project] Lock "1daf4f4c-0e4a-4779-b53a-78c48397ea2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120740) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 18:06:48.022911 dv-cinder-852009-8-iscsi devstack@n-api.service[120741]: DEBUG nova.policy [None req-e597a919-87dc-490c-9809-0232fce8c15c tempest-TestMinimumBasicScenario-820002800 tempest-TestMinimumBasicScenario-820002800-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7880064ff0aa448d9c367c89eba145ff', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2f6832936c824066a4370cc45c5b0282', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120741) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 18:06:48.032547 dv-cinder-852009-8-iscsi devstack@n-api.service[120741]: INFO nova.api.openstack.requestlog [None req-e597a919-87dc-490c-9809-0232fce8c15c tempest-TestMinimumBasicScenario-820002800 tempest-TestMinimumBasicScenario-820002800-project] 10.222.0.43 "GET /compute/v2.1/servers/f8247a13-94cd-45b2-acc8-8717e1260f37" status: 200 len: 1758 microversion: 2.1 time: 0.231119 Sep 13 18:06:48.032547 dv-cinder-852009-8-iscsi devstack@n-api.service[120741]: [pid: 120741|app: 0|req: 267/542] 10.222.0.43 () {58 vars in 1236 bytes} [Tue Sep 13 18:06:47 2022] GET /compute/v2.1/servers/f8247a13-94cd-45b2-acc8-8717e1260f37 => generated 1758 bytes in 233 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 13 18:06:48.052741 dv-cinder-852009-8-iscsi devstack@n-api.service[120740]: DEBUG nova.objects.instance [None req-1358d988-aa2d-4b97-876a-d8403388855e tempest-TestShelveInstance-6258502 tempest-TestShelveInstance-6258502-project] Lazy-loading 'flavor' on Instance uuid 2d60cc6d-a699-417d-aa20-fe3e1bfc351e {{(pid=120740) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Sep 13 18:06:48.132514 dv-cinder-852009-8-iscsi devstack@n-api.service[120740]: INFO nova.api.openstack.requestlog [None req-1358d988-aa2d-4b97-876a-d8403388855e tempest-TestShelveInstance-6258502 tempest-TestShelveInstance-6258502-project] 10.222.0.43 "POST /compute/v2.1/servers/2d60cc6d-a699-417d-aa20-fe3e1bfc351e/action" status: 202 len: 0 microversion: 2.1 time: 0.129291 Sep 13 18:06:48.134022 dv-cinder-852009-8-iscsi devstack@n-api.service[120740]: [pid: 120740|app: 0|req: 276/543] 10.222.0.43 () {60 vars in 1278 bytes} [Tue Sep 13 18:06:48 2022] POST /compute/v2.1/servers/2d60cc6d-a699-417d-aa20-fe3e1bfc351e/action => generated 0 bytes in 132 msecs (HTTP/1.1 202) 9 headers in 361 bytes (2 switches on core 0) Sep 13 18:06:48.141799 dv-cinder-852009-8-iscsi devstack@n-api.service[120741]: DEBUG nova.api.openstack.wsgi [None req-860545dc-9345-4baa-b620-23f7656103f6 tempest-TestShelveInstance-6258502 tempest-TestShelveInstance-6258502-project] Calling method '>' {{(pid=120741) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 18:06:48.142390 dv-cinder-852009-8-iscsi devstack@n-api.service[120741]: DEBUG nova.compute.api [None req-860545dc-9345-4baa-b620-23f7656103f6 tempest-TestShelveInstance-6258502 tempest-TestShelveInstance-6258502-project] [instance: 2d60cc6d-a699-417d-aa20-fe3e1bfc351e] Fetching instance by UUID {{(pid=120741) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 18:06:48.148768 dv-cinder-852009-8-iscsi devstack@n-api.service[120740]: DEBUG nova.api.openstack.wsgi [None req-40b56e07-0ddf-4703-8e19-800c714ea327 tempest-ServerRescueNegativeTestJSON-412251590 tempest-ServerRescueNegativeTestJSON-412251590-project] Calling method '>' {{(pid=120740) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 18:06:48.149668 dv-cinder-852009-8-iscsi devstack@n-api.service[120740]: DEBUG nova.compute.api [None req-40b56e07-0ddf-4703-8e19-800c714ea327 tempest-ServerRescueNegativeTestJSON-412251590 tempest-ServerRescueNegativeTestJSON-412251590-project] [instance: a9c22f82-a945-4a94-b3c9-fe95265053bd] Fetching instance by UUID {{(pid=120740) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 18:06:48.152084 dv-cinder-852009-8-iscsi devstack@n-api.service[120741]: DEBUG oslo_concurrency.lockutils [None req-860545dc-9345-4baa-b620-23f7656103f6 tempest-TestShelveInstance-6258502 tempest-TestShelveInstance-6258502-project] Acquiring lock "1daf4f4c-0e4a-4779-b53a-78c48397ea2f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120741) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 18:06:48.152752 dv-cinder-852009-8-iscsi devstack@n-api.service[120741]: DEBUG oslo_concurrency.lockutils [None req-860545dc-9345-4baa-b620-23f7656103f6 tempest-TestShelveInstance-6258502 tempest-TestShelveInstance-6258502-project] Lock "1daf4f4c-0e4a-4779-b53a-78c48397ea2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120741) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 18:06:48.153023 dv-cinder-852009-8-iscsi devstack@n-api.service[120741]: DEBUG oslo_concurrency.lockutils [None req-860545dc-9345-4baa-b620-23f7656103f6 tempest-TestShelveInstance-6258502 tempest-TestShelveInstance-6258502-project] Lock "1daf4f4c-0e4a-4779-b53a-78c48397ea2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120741) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 18:06:48.153710 dv-cinder-852009-8-iscsi devstack@n-api.service[120741]: DEBUG oslo_concurrency.lockutils [None req-860545dc-9345-4baa-b620-23f7656103f6 tempest-TestShelveInstance-6258502 tempest-TestShelveInstance-6258502-project] Acquiring lock "1daf4f4c-0e4a-4779-b53a-78c48397ea2f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120741) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 18:06:48.154942 dv-cinder-852009-8-iscsi devstack@n-api.service[120741]: DEBUG oslo_concurrency.lockutils [None req-860545dc-9345-4baa-b620-23f7656103f6 tempest-TestShelveInstance-6258502 tempest-TestShelveInstance-6258502-project] Lock "1daf4f4c-0e4a-4779-b53a-78c48397ea2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120741) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 18:06:48.155363 dv-cinder-852009-8-iscsi devstack@n-api.service[120741]: DEBUG oslo_concurrency.lockutils [None req-860545dc-9345-4baa-b620-23f7656103f6 tempest-TestShelveInstance-6258502 tempest-TestShelveInstance-6258502-project] Lock "1daf4f4c-0e4a-4779-b53a-78c48397ea2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120741) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 18:06:48.156250 dv-cinder-852009-8-iscsi devstack@n-api.service[120740]: DEBUG oslo_concurrency.lockutils [None req-40b56e07-0ddf-4703-8e19-800c714ea327 tempest-ServerRescueNegativeTestJSON-412251590 tempest-ServerRescueNegativeTestJSON-412251590-project] Acquiring lock "1daf4f4c-0e4a-4779-b53a-78c48397ea2f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120740) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 18:06:48.156833 dv-cinder-852009-8-iscsi devstack@n-api.service[120740]: DEBUG oslo_concurrency.lockutils [None req-40b56e07-0ddf-4703-8e19-800c714ea327 tempest-ServerRescueNegativeTestJSON-412251590 tempest-ServerRescueNegativeTestJSON-412251590-project] Lock "1daf4f4c-0e4a-4779-b53a-78c48397ea2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120740) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 18:06:48.157332 dv-cinder-852009-8-iscsi devstack@n-api.service[120740]: DEBUG oslo_concurrency.lockutils [None req-40b56e07-0ddf-4703-8e19-800c714ea327 tempest-ServerRescueNegativeTestJSON-412251590 tempest-ServerRescueNegativeTestJSON-412251590-project] Lock "1daf4f4c-0e4a-4779-b53a-78c48397ea2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120740) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 18:06:48.158112 dv-cinder-852009-8-iscsi devstack@n-api.service[120740]: DEBUG oslo_concurrency.lockutils [None req-40b56e07-0ddf-4703-8e19-800c714ea327 tempest-ServerRescueNegativeTestJSON-412251590 tempest-ServerRescueNegativeTestJSON-412251590-project] Acquiring lock "1daf4f4c-0e4a-4779-b53a-78c48397ea2f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120740) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 18:06:48.158656 dv-cinder-852009-8-iscsi devstack@n-api.service[120740]: DEBUG oslo_concurrency.lockutils [None req-40b56e07-0ddf-4703-8e19-800c714ea327 tempest-ServerRescueNegativeTestJSON-412251590 tempest-ServerRescueNegativeTestJSON-412251590-project] Lock "1daf4f4c-0e4a-4779-b53a-78c48397ea2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120740) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 18:06:48.159138 dv-cinder-852009-8-iscsi devstack@n-api.service[120740]: DEBUG oslo_concurrency.lockutils [None req-40b56e07-0ddf-4703-8e19-800c714ea327 tempest-ServerRescueNegativeTestJSON-412251590 tempest-ServerRescueNegativeTestJSON-412251590-project] Lock "1daf4f4c-0e4a-4779-b53a-78c48397ea2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120740) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 18:06:48.360394 dv-cinder-852009-8-iscsi devstack@n-api.service[120741]: DEBUG nova.policy [None req-860545dc-9345-4baa-b620-23f7656103f6 tempest-TestShelveInstance-6258502 tempest-TestShelveInstance-6258502-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2ab9930d6ce54cacbb3d4fd6313294d5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5eafd54351bd4049b87ad308a3638f80', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120741) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 18:06:48.372574 dv-cinder-852009-8-iscsi devstack@n-api.service[120741]: INFO nova.api.openstack.requestlog [None req-860545dc-9345-4baa-b620-23f7656103f6 tempest-TestShelveInstance-6258502 tempest-TestShelveInstance-6258502-project] 10.222.0.43 "GET /compute/v2.1/servers/2d60cc6d-a699-417d-aa20-fe3e1bfc351e" status: 200 len: 1570 microversion: 2.1 time: 0.234257 Sep 13 18:06:48.378498 dv-cinder-852009-8-iscsi devstack@n-api.service[120740]: DEBUG nova.policy [None req-40b56e07-0ddf-4703-8e19-800c714ea327 tempest-ServerRescueNegativeTestJSON-412251590 tempest-ServerRescueNegativeTestJSON-412251590-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '60800cf2774e409d9c1b6f4992669991', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2eae4acecf6c4961830ead78d71b2ad3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120740) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 18:06:48.388746 dv-cinder-852009-8-iscsi devstack@n-api.service[120740]: INFO nova.api.openstack.requestlog [None req-40b56e07-0ddf-4703-8e19-800c714ea327 tempest-ServerRescueNegativeTestJSON-412251590 tempest-ServerRescueNegativeTestJSON-412251590-project] 10.222.0.43 "GET /compute/v2.1/servers/a9c22f82-a945-4a94-b3c9-fe95265053bd" status: 200 len: 1523 microversion: 2.1 time: 0.244624 Sep 13 18:06:48.389426 dv-cinder-852009-8-iscsi devstack@n-api.service[120740]: [pid: 120740|app: 0|req: 277/544] 10.222.0.43 () {58 vars in 1236 bytes} [Tue Sep 13 18:06:48 2022] GET /compute/v2.1/servers/a9c22f82-a945-4a94-b3c9-fe95265053bd => generated 1523 bytes in 246 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 13 18:06:48.391108 dv-cinder-852009-8-iscsi devstack@n-api.service[120741]: [pid: 120741|app: 0|req: 268/545] 10.222.0.43 () {58 vars in 1236 bytes} [Tue Sep 13 18:06:48 2022] GET /compute/v2.1/servers/2d60cc6d-a699-417d-aa20-fe3e1bfc351e => generated 1570 bytes in 254 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 13 18:06:48.394573 dv-cinder-852009-8-iscsi devstack@n-api.service[120740]: DEBUG nova.api.openstack.wsgi [None req-b14c7179-b85e-4538-9a7b-5b6a93e22ac1 tempest-AttachVolumeShelveTestJSON-385853788 tempest-AttachVolumeShelveTestJSON-385853788-project] Action: 'action', calling method: >, body: {"shelve": {}} {{(pid=120740) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 13 18:06:48.395343 dv-cinder-852009-8-iscsi devstack@n-api.service[120740]: DEBUG nova.compute.api [None req-b14c7179-b85e-4538-9a7b-5b6a93e22ac1 tempest-AttachVolumeShelveTestJSON-385853788 tempest-AttachVolumeShelveTestJSON-385853788-project] [instance: 8cecf08e-bea8-4cef-9439-0eaa242bfed1] Fetching instance by UUID {{(pid=120740) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 18:06:48.397331 dv-cinder-852009-8-iscsi devstack@n-api.service[120741]: DEBUG nova.api.openstack.wsgi [req-082fd61f-484c-4918-a060-2e08c9834bd7 req-8b7d19cb-c126-41e0-af66-5a8be46b9c70 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "a9c22f82-a945-4a94-b3c9-fe95265053bd", "name": "network-vif-deleted", "tag": "e84094dd-b823-4e24-a968-9356ccb4ceb5"}]} {{(pid=120741) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 13 18:06:48.402004 dv-cinder-852009-8-iscsi devstack@n-api.service[120740]: DEBUG oslo_concurrency.lockutils [None req-b14c7179-b85e-4538-9a7b-5b6a93e22ac1 tempest-AttachVolumeShelveTestJSON-385853788 tempest-AttachVolumeShelveTestJSON-385853788-project] Acquiring lock "1daf4f4c-0e4a-4779-b53a-78c48397ea2f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120740) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 18:06:48.402732 dv-cinder-852009-8-iscsi devstack@n-api.service[120740]: DEBUG oslo_concurrency.lockutils [None req-b14c7179-b85e-4538-9a7b-5b6a93e22ac1 tempest-AttachVolumeShelveTestJSON-385853788 tempest-AttachVolumeShelveTestJSON-385853788-project] Lock "1daf4f4c-0e4a-4779-b53a-78c48397ea2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120740) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 18:06:48.403389 dv-cinder-852009-8-iscsi devstack@n-api.service[120740]: DEBUG oslo_concurrency.lockutils [None req-b14c7179-b85e-4538-9a7b-5b6a93e22ac1 tempest-AttachVolumeShelveTestJSON-385853788 tempest-AttachVolumeShelveTestJSON-385853788-project] Lock "1daf4f4c-0e4a-4779-b53a-78c48397ea2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120740) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 18:06:48.404538 dv-cinder-852009-8-iscsi devstack@n-api.service[120740]: DEBUG oslo_concurrency.lockutils [None req-b14c7179-b85e-4538-9a7b-5b6a93e22ac1 tempest-AttachVolumeShelveTestJSON-385853788 tempest-AttachVolumeShelveTestJSON-385853788-project] Acquiring lock "1daf4f4c-0e4a-4779-b53a-78c48397ea2f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120740) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 18:06:48.405200 dv-cinder-852009-8-iscsi devstack@n-api.service[120740]: DEBUG oslo_concurrency.lockutils [None req-b14c7179-b85e-4538-9a7b-5b6a93e22ac1 tempest-AttachVolumeShelveTestJSON-385853788 tempest-AttachVolumeShelveTestJSON-385853788-project] Lock "1daf4f4c-0e4a-4779-b53a-78c48397ea2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120740) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 18:06:48.405697 dv-cinder-852009-8-iscsi devstack@n-api.service[120740]: DEBUG oslo_concurrency.lockutils [None req-b14c7179-b85e-4538-9a7b-5b6a93e22ac1 tempest-AttachVolumeShelveTestJSON-385853788 tempest-AttachVolumeShelveTestJSON-385853788-project] Lock "1daf4f4c-0e4a-4779-b53a-78c48397ea2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120740) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 18:06:48.409488 dv-cinder-852009-8-iscsi devstack@n-api.service[120741]: DEBUG oslo_concurrency.lockutils [req-082fd61f-484c-4918-a060-2e08c9834bd7 req-8b7d19cb-c126-41e0-af66-5a8be46b9c70 service nova] Acquiring lock "1daf4f4c-0e4a-4779-b53a-78c48397ea2f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120741) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 18:06:48.410176 dv-cinder-852009-8-iscsi devstack@n-api.service[120741]: DEBUG oslo_concurrency.lockutils [req-082fd61f-484c-4918-a060-2e08c9834bd7 req-8b7d19cb-c126-41e0-af66-5a8be46b9c70 service nova] Lock "1daf4f4c-0e4a-4779-b53a-78c48397ea2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120741) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 18:06:48.410760 dv-cinder-852009-8-iscsi devstack@n-api.service[120741]: DEBUG oslo_concurrency.lockutils [req-082fd61f-484c-4918-a060-2e08c9834bd7 req-8b7d19cb-c126-41e0-af66-5a8be46b9c70 service nova] Lock "1daf4f4c-0e4a-4779-b53a-78c48397ea2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120741) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 18:06:48.428140 dv-cinder-852009-8-iscsi devstack@n-api.service[120741]: INFO nova.api.openstack.compute.server_external_events [req-082fd61f-484c-4918-a060-2e08c9834bd7 req-8b7d19cb-c126-41e0-af66-5a8be46b9c70 service nova] Creating event network-vif-deleted:e84094dd-b823-4e24-a968-9356ccb4ceb5 for instance a9c22f82-a945-4a94-b3c9-fe95265053bd on hv-cinder-85200 Sep 13 18:06:48.433078 dv-cinder-852009-8-iscsi devstack@n-api.service[120740]: DEBUG nova.objects.instance [None req-b14c7179-b85e-4538-9a7b-5b6a93e22ac1 tempest-AttachVolumeShelveTestJSON-385853788 tempest-AttachVolumeShelveTestJSON-385853788-project] Lazy-loading 'flavor' on Instance uuid 8cecf08e-bea8-4cef-9439-0eaa242bfed1 {{(pid=120740) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Sep 13 18:06:48.433886 dv-cinder-852009-8-iscsi devstack@n-api.service[120741]: INFO nova.api.openstack.requestlog [req-082fd61f-484c-4918-a060-2e08c9834bd7 req-8b7d19cb-c126-41e0-af66-5a8be46b9c70 service nova] 10.222.0.43 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.040694 Sep 13 18:06:48.434692 dv-cinder-852009-8-iscsi devstack@n-api.service[120741]: [pid: 120741|app: 0|req: 269/546] 10.222.0.43 () {64 vars in 1317 bytes} [Tue Sep 13 18:06:48 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 43 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 13 18:06:48.629756 dv-cinder-852009-8-iscsi devstack@n-api.service[120740]: INFO nova.api.openstack.requestlog [None req-b14c7179-b85e-4538-9a7b-5b6a93e22ac1 tempest-AttachVolumeShelveTestJSON-385853788 tempest-AttachVolumeShelveTestJSON-385853788-project] 10.222.0.43 "POST /compute/v2.1/servers/8cecf08e-bea8-4cef-9439-0eaa242bfed1/action" status: 202 len: 0 microversion: 2.20 time: 0.238736 Sep 13 18:06:48.633732 dv-cinder-852009-8-iscsi devstack@n-api.service[120740]: [pid: 120740|app: 0|req: 278/547] 10.222.0.43 () {62 vars in 1319 bytes} [Tue Sep 13 18:06:48 2022] POST /compute/v2.1/servers/8cecf08e-bea8-4cef-9439-0eaa242bfed1/action => generated 0 bytes in 244 msecs (HTTP/1.1 202) 9 headers in 363 bytes (1 switches on core 0) Sep 13 18:06:48.703753 dv-cinder-852009-8-iscsi devstack@n-api.service[120741]: DEBUG nova.api.openstack.wsgi [None req-2b014a5e-7751-456a-81a0-d6bbb94f5b78 tempest-AttachVolumeShelveTestJSON-385853788 tempest-AttachVolumeShelveTestJSON-385853788-project] Calling method '>' {{(pid=120741) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 18:06:48.704534 dv-cinder-852009-8-iscsi devstack@n-api.service[120741]: DEBUG nova.compute.api [None req-2b014a5e-7751-456a-81a0-d6bbb94f5b78 tempest-AttachVolumeShelveTestJSON-385853788 tempest-AttachVolumeShelveTestJSON-385853788-project] [instance: 8cecf08e-bea8-4cef-9439-0eaa242bfed1] Fetching instance by UUID {{(pid=120741) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 18:06:48.711279 dv-cinder-852009-8-iscsi devstack@n-api.service[120741]: DEBUG oslo_concurrency.lockutils [None req-2b014a5e-7751-456a-81a0-d6bbb94f5b78 tempest-AttachVolumeShelveTestJSON-385853788 tempest-AttachVolumeShelveTestJSON-385853788-project] Acquiring lock "1daf4f4c-0e4a-4779-b53a-78c48397ea2f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120741) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 18:06:48.711869 dv-cinder-852009-8-iscsi devstack@n-api.service[120741]: DEBUG oslo_concurrency.lockutils [None req-2b014a5e-7751-456a-81a0-d6bbb94f5b78 tempest-AttachVolumeShelveTestJSON-385853788 tempest-AttachVolumeShelveTestJSON-385853788-project] Lock "1daf4f4c-0e4a-4779-b53a-78c48397ea2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120741) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 18:06:48.712330 dv-cinder-852009-8-iscsi devstack@n-api.service[120741]: DEBUG oslo_concurrency.lockutils [None req-2b014a5e-7751-456a-81a0-d6bbb94f5b78 tempest-AttachVolumeShelveTestJSON-385853788 tempest-AttachVolumeShelveTestJSON-385853788-project] Lock "1daf4f4c-0e4a-4779-b53a-78c48397ea2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120741) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 18:06:48.713074 dv-cinder-852009-8-iscsi devstack@n-api.service[120741]: DEBUG oslo_concurrency.lockutils [None req-2b014a5e-7751-456a-81a0-d6bbb94f5b78 tempest-AttachVolumeShelveTestJSON-385853788 tempest-AttachVolumeShelveTestJSON-385853788-project] Acquiring lock "1daf4f4c-0e4a-4779-b53a-78c48397ea2f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120741) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 18:06:48.713525 dv-cinder-852009-8-iscsi devstack@n-api.service[120741]: DEBUG oslo_concurrency.lockutils [None req-2b014a5e-7751-456a-81a0-d6bbb94f5b78 tempest-AttachVolumeShelveTestJSON-385853788 tempest-AttachVolumeShelveTestJSON-385853788-project] Lock "1daf4f4c-0e4a-4779-b53a-78c48397ea2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120741) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 18:06:48.713942 dv-cinder-852009-8-iscsi devstack@n-api.service[120741]: DEBUG oslo_concurrency.lockutils [None req-2b014a5e-7751-456a-81a0-d6bbb94f5b78 tempest-AttachVolumeShelveTestJSON-385853788 tempest-AttachVolumeShelveTestJSON-385853788-project] Lock "1daf4f4c-0e4a-4779-b53a-78c48397ea2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120741) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 18:06:48.853299 dv-cinder-852009-8-iscsi devstack@n-api.service[120741]: DEBUG nova.policy [None req-2b014a5e-7751-456a-81a0-d6bbb94f5b78 tempest-AttachVolumeShelveTestJSON-385853788 tempest-AttachVolumeShelveTestJSON-385853788-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e68ecd9b3ca643539b109f75bb242d6f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '75e14fd88bfb4cd896fa7b070a0fac47', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120741) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 18:06:48.861845 dv-cinder-852009-8-iscsi devstack@n-api.service[120741]: DEBUG nova.policy [None req-2b014a5e-7751-456a-81a0-d6bbb94f5b78 tempest-AttachVolumeShelveTestJSON-385853788 tempest-AttachVolumeShelveTestJSON-385853788-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'e68ecd9b3ca643539b109f75bb242d6f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '75e14fd88bfb4cd896fa7b070a0fac47', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120741) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 18:06:48.863223 dv-cinder-852009-8-iscsi devstack@n-api.service[120741]: DEBUG nova.policy [None req-2b014a5e-7751-456a-81a0-d6bbb94f5b78 tempest-AttachVolumeShelveTestJSON-385853788 tempest-AttachVolumeShelveTestJSON-385853788-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'e68ecd9b3ca643539b109f75bb242d6f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '75e14fd88bfb4cd896fa7b070a0fac47', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120741) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 18:06:48.864385 dv-cinder-852009-8-iscsi devstack@n-api.service[120741]: INFO nova.api.openstack.requestlog [None req-2b014a5e-7751-456a-81a0-d6bbb94f5b78 tempest-AttachVolumeShelveTestJSON-385853788 tempest-AttachVolumeShelveTestJSON-385853788-project] 10.222.0.43 "GET /compute/v2.1/servers/8cecf08e-bea8-4cef-9439-0eaa242bfed1" status: 200 len: 1722 microversion: 2.20 time: 0.228608 Sep 13 18:06:48.864967 dv-cinder-852009-8-iscsi devstack@n-api.service[120741]: [pid: 120741|app: 0|req: 270/548] 10.222.0.43 () {60 vars in 1277 bytes} [Tue Sep 13 18:06:48 2022] GET /compute/v2.1/servers/8cecf08e-bea8-4cef-9439-0eaa242bfed1 => generated 1722 bytes in 231 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 13 18:06:49.061075 dv-cinder-852009-8-iscsi devstack@n-api.service[120740]: DEBUG nova.api.openstack.wsgi [None req-5c6a4827-03bc-411f-945a-436846e32304 tempest-TestMinimumBasicScenario-820002800 tempest-TestMinimumBasicScenario-820002800-project] Calling method '>' {{(pid=120740) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 18:06:49.062174 dv-cinder-852009-8-iscsi devstack@n-api.service[120740]: DEBUG nova.compute.api [None req-5c6a4827-03bc-411f-945a-436846e32304 tempest-TestMinimumBasicScenario-820002800 tempest-TestMinimumBasicScenario-820002800-project] [instance: f8247a13-94cd-45b2-acc8-8717e1260f37] Fetching instance by UUID {{(pid=120740) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 18:06:49.071546 dv-cinder-852009-8-iscsi devstack@n-api.service[120740]: DEBUG oslo_concurrency.lockutils [None req-5c6a4827-03bc-411f-945a-436846e32304 tempest-TestMinimumBasicScenario-820002800 tempest-TestMinimumBasicScenario-820002800-project] Acquiring lock "1daf4f4c-0e4a-4779-b53a-78c48397ea2f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120740) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 18:06:49.072029 dv-cinder-852009-8-iscsi devstack@n-api.service[120740]: DEBUG oslo_concurrency.lockutils [None req-5c6a4827-03bc-411f-945a-436846e32304 tempest-TestMinimumBasicScenario-820002800 tempest-TestMinimumBasicScenario-820002800-project] Lock "1daf4f4c-0e4a-4779-b53a-78c48397ea2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120740) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 18:06:49.072456 dv-cinder-852009-8-iscsi devstack@n-api.service[120740]: DEBUG oslo_concurrency.lockutils [None req-5c6a4827-03bc-411f-945a-436846e32304 tempest-TestMinimumBasicScenario-820002800 tempest-TestMinimumBasicScenario-820002800-project] Lock "1daf4f4c-0e4a-4779-b53a-78c48397ea2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120740) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 18:06:49.073203 dv-cinder-852009-8-iscsi devstack@n-api.service[120740]: DEBUG oslo_concurrency.lockutils [None req-5c6a4827-03bc-411f-945a-436846e32304 tempest-TestMinimumBasicScenario-820002800 tempest-TestMinimumBasicScenario-820002800-project] Acquiring lock "1daf4f4c-0e4a-4779-b53a-78c48397ea2f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120740) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 18:06:49.073650 dv-cinder-852009-8-iscsi devstack@n-api.service[120740]: DEBUG oslo_concurrency.lockutils [None req-5c6a4827-03bc-411f-945a-436846e32304 tempest-TestMinimumBasicScenario-820002800 tempest-TestMinimumBasicScenario-820002800-project] Lock "1daf4f4c-0e4a-4779-b53a-78c48397ea2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120740) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 18:06:49.074074 dv-cinder-852009-8-iscsi devstack@n-api.service[120740]: DEBUG oslo_concurrency.lockutils [None req-5c6a4827-03bc-411f-945a-436846e32304 tempest-TestMinimumBasicScenario-820002800 tempest-TestMinimumBasicScenario-820002800-project] Lock "1daf4f4c-0e4a-4779-b53a-78c48397ea2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120740) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 18:06:49.222025 dv-cinder-852009-8-iscsi devstack@n-api.service[120740]: DEBUG nova.policy [None req-5c6a4827-03bc-411f-945a-436846e32304 tempest-TestMinimumBasicScenario-820002800 tempest-TestMinimumBasicScenario-820002800-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7880064ff0aa448d9c367c89eba145ff', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2f6832936c824066a4370cc45c5b0282', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120740) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 18:06:49.230732 dv-cinder-852009-8-iscsi devstack@n-api.service[120740]: INFO nova.api.openstack.requestlog [None req-5c6a4827-03bc-411f-945a-436846e32304 tempest-TestMinimumBasicScenario-820002800 tempest-TestMinimumBasicScenario-820002800-project] 10.222.0.43 "GET /compute/v2.1/servers/f8247a13-94cd-45b2-acc8-8717e1260f37" status: 200 len: 1758 microversion: 2.1 time: 0.177710 Sep 13 18:06:49.231300 dv-cinder-852009-8-iscsi devstack@n-api.service[120740]: [pid: 120740|app: 0|req: 279/549] 10.222.0.43 () {58 vars in 1236 bytes} [Tue Sep 13 18:06:49 2022] GET /compute/v2.1/servers/f8247a13-94cd-45b2-acc8-8717e1260f37 => generated 1758 bytes in 180 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 13 18:06:49.397836 dv-cinder-852009-8-iscsi devstack@n-api.service[120741]: DEBUG nova.api.openstack.wsgi [None req-5b2f9ae5-1771-4afc-acf8-128d22bac7e3 tempest-TestShelveInstance-6258502 tempest-TestShelveInstance-6258502-project] Calling method '>' {{(pid=120741) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 18:06:49.398344 dv-cinder-852009-8-iscsi devstack@n-api.service[120741]: DEBUG nova.compute.api [None req-5b2f9ae5-1771-4afc-acf8-128d22bac7e3 tempest-TestShelveInstance-6258502 tempest-TestShelveInstance-6258502-project] [instance: 2d60cc6d-a699-417d-aa20-fe3e1bfc351e] Fetching instance by UUID {{(pid=120741) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 18:06:49.404945 dv-cinder-852009-8-iscsi devstack@n-api.service[120741]: DEBUG oslo_concurrency.lockutils [None req-5b2f9ae5-1771-4afc-acf8-128d22bac7e3 tempest-TestShelveInstance-6258502 tempest-TestShelveInstance-6258502-project] Acquiring lock "1daf4f4c-0e4a-4779-b53a-78c48397ea2f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120741) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 18:06:49.405450 dv-cinder-852009-8-iscsi devstack@n-api.service[120741]: DEBUG oslo_concurrency.lockutils [None req-5b2f9ae5-1771-4afc-acf8-128d22bac7e3 tempest-TestShelveInstance-6258502 tempest-TestShelveInstance-6258502-project] Lock "1daf4f4c-0e4a-4779-b53a-78c48397ea2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120741) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 18:06:49.405842 dv-cinder-852009-8-iscsi devstack@n-api.service[120741]: DEBUG oslo_concurrency.lockutils [None req-5b2f9ae5-1771-4afc-acf8-128d22bac7e3 tempest-TestShelveInstance-6258502 tempest-TestShelveInstance-6258502-project] Lock "1daf4f4c-0e4a-4779-b53a-78c48397ea2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120741) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 18:06:49.406516 dv-cinder-852009-8-iscsi devstack@n-api.service[120741]: DEBUG oslo_concurrency.lockutils [None req-5b2f9ae5-1771-4afc-acf8-128d22bac7e3 tempest-TestShelveInstance-6258502 tempest-TestShelveInstance-6258502-project] Acquiring lock "1daf4f4c-0e4a-4779-b53a-78c48397ea2f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120741) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 18:06:49.406976 dv-cinder-852009-8-iscsi devstack@n-api.service[120741]: DEBUG oslo_concurrency.lockutils [None req-5b2f9ae5-1771-4afc-acf8-128d22bac7e3 tempest-TestShelveInstance-6258502 tempest-TestShelveInstance-6258502-project] Lock "1daf4f4c-0e4a-4779-b53a-78c48397ea2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120741) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 18:06:49.407334 dv-cinder-852009-8-iscsi devstack@n-api.service[120741]: DEBUG oslo_concurrency.lockutils [None req-5b2f9ae5-1771-4afc-acf8-128d22bac7e3 tempest-TestShelveInstance-6258502 tempest-TestShelveInstance-6258502-project] Lock "1daf4f4c-0e4a-4779-b53a-78c48397ea2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120741) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 18:06:49.412127 dv-cinder-852009-8-iscsi devstack@n-api.service[120740]: DEBUG nova.api.openstack.wsgi [None req-9225788d-6a16-4a5a-851c-5f677fbbcf47 tempest-ServerRescueNegativeTestJSON-412251590 tempest-ServerRescueNegativeTestJSON-412251590-project] Calling method '>' {{(pid=120740) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 18:06:49.412771 dv-cinder-852009-8-iscsi devstack@n-api.service[120740]: DEBUG nova.compute.api [None req-9225788d-6a16-4a5a-851c-5f677fbbcf47 tempest-ServerRescueNegativeTestJSON-412251590 tempest-ServerRescueNegativeTestJSON-412251590-project] [instance: a9c22f82-a945-4a94-b3c9-fe95265053bd] Fetching instance by UUID {{(pid=120740) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 18:06:49.419138 dv-cinder-852009-8-iscsi devstack@n-api.service[120740]: DEBUG oslo_concurrency.lockutils [None req-9225788d-6a16-4a5a-851c-5f677fbbcf47 tempest-ServerRescueNegativeTestJSON-412251590 tempest-ServerRescueNegativeTestJSON-412251590-project] Acquiring lock "1daf4f4c-0e4a-4779-b53a-78c48397ea2f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120740) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 18:06:49.419627 dv-cinder-852009-8-iscsi devstack@n-api.service[120740]: DEBUG oslo_concurrency.lockutils [None req-9225788d-6a16-4a5a-851c-5f677fbbcf47 tempest-ServerRescueNegativeTestJSON-412251590 tempest-ServerRescueNegativeTestJSON-412251590-project] Lock "1daf4f4c-0e4a-4779-b53a-78c48397ea2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120740) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 18:06:49.420068 dv-cinder-852009-8-iscsi devstack@n-api.service[120740]: DEBUG oslo_concurrency.lockutils [None req-9225788d-6a16-4a5a-851c-5f677fbbcf47 tempest-ServerRescueNegativeTestJSON-412251590 tempest-ServerRescueNegativeTestJSON-412251590-project] Lock "1daf4f4c-0e4a-4779-b53a-78c48397ea2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120740) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 18:06:49.420783 dv-cinder-852009-8-iscsi devstack@n-api.service[120740]: DEBUG oslo_concurrency.lockutils [None req-9225788d-6a16-4a5a-851c-5f677fbbcf47 tempest-ServerRescueNegativeTestJSON-412251590 tempest-ServerRescueNegativeTestJSON-412251590-project] Acquiring lock "1daf4f4c-0e4a-4779-b53a-78c48397ea2f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120740) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 18:06:49.421257 dv-cinder-852009-8-iscsi devstack@n-api.service[120740]: DEBUG oslo_concurrency.lockutils [None req-9225788d-6a16-4a5a-851c-5f677fbbcf47 tempest-ServerRescueNegativeTestJSON-412251590 tempest-ServerRescueNegativeTestJSON-412251590-project] Lock "1daf4f4c-0e4a-4779-b53a-78c48397ea2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120740) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 18:06:49.421670 dv-cinder-852009-8-iscsi devstack@n-api.service[120740]: DEBUG oslo_concurrency.lockutils [None req-9225788d-6a16-4a5a-851c-5f677fbbcf47 tempest-ServerRescueNegativeTestJSON-412251590 tempest-ServerRescueNegativeTestJSON-412251590-project] Lock "1daf4f4c-0e4a-4779-b53a-78c48397ea2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120740) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 18:06:49.424393 dv-cinder-852009-8-iscsi devstack@n-api.service[120740]: DEBUG dbcounter [-] [120740] Writing DB stats nova_cell1:SELECT=92,nova_cell1:UPDATE=5,nova_cell1:INSERT=3 {{(pid=120740) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 18:06:49.457731 dv-cinder-852009-8-iscsi devstack@n-api.service[120740]: DEBUG oslo_concurrency.lockutils [None req-9225788d-6a16-4a5a-851c-5f677fbbcf47 tempest-ServerRescueNegativeTestJSON-412251590 tempest-ServerRescueNegativeTestJSON-412251590-project] Acquiring lock "1daf4f4c-0e4a-4779-b53a-78c48397ea2f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120740) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 18:06:49.458206 dv-cinder-852009-8-iscsi devstack@n-api.service[120740]: DEBUG oslo_concurrency.lockutils [None req-9225788d-6a16-4a5a-851c-5f677fbbcf47 tempest-ServerRescueNegativeTestJSON-412251590 tempest-ServerRescueNegativeTestJSON-412251590-project] Lock "1daf4f4c-0e4a-4779-b53a-78c48397ea2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120740) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 18:06:49.458628 dv-cinder-852009-8-iscsi devstack@n-api.service[120740]: DEBUG oslo_concurrency.lockutils [None req-9225788d-6a16-4a5a-851c-5f677fbbcf47 tempest-ServerRescueNegativeTestJSON-412251590 tempest-ServerRescueNegativeTestJSON-412251590-project] Lock "1daf4f4c-0e4a-4779-b53a-78c48397ea2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120740) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 18:06:49.459066 dv-cinder-852009-8-iscsi devstack@n-api.service[120740]: DEBUG nova.objects.instance [None req-9225788d-6a16-4a5a-851c-5f677fbbcf47 tempest-ServerRescueNegativeTestJSON-412251590 tempest-ServerRescueNegativeTestJSON-412251590-project] Lazy-loading 'fault' on Instance uuid a9c22f82-a945-4a94-b3c9-fe95265053bd {{(pid=120740) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Sep 13 18:06:49.503957 dv-cinder-852009-8-iscsi devstack@n-api.service[120740]: DEBUG nova.policy [None req-9225788d-6a16-4a5a-851c-5f677fbbcf47 tempest-ServerRescueNegativeTestJSON-412251590 tempest-ServerRescueNegativeTestJSON-412251590-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '60800cf2774e409d9c1b6f4992669991', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2eae4acecf6c4961830ead78d71b2ad3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120740) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 18:06:49.511718 dv-cinder-852009-8-iscsi devstack@n-api.service[120740]: INFO nova.api.openstack.requestlog [None req-9225788d-6a16-4a5a-851c-5f677fbbcf47 tempest-ServerRescueNegativeTestJSON-412251590 tempest-ServerRescueNegativeTestJSON-412251590-project] 10.222.0.43 "GET /compute/v2.1/servers/a9c22f82-a945-4a94-b3c9-fe95265053bd" status: 200 len: 1312 microversion: 2.1 time: 0.103389 Sep 13 18:06:49.512284 dv-cinder-852009-8-iscsi devstack@n-api.service[120740]: [pid: 120740|app: 0|req: 280/550] 10.222.0.43 () {58 vars in 1236 bytes} [Tue Sep 13 18:06:49 2022] GET /compute/v2.1/servers/a9c22f82-a945-4a94-b3c9-fe95265053bd => generated 1312 bytes in 105 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 13 18:06:49.567015 dv-cinder-852009-8-iscsi devstack@n-api.service[120741]: DEBUG nova.policy [None req-5b2f9ae5-1771-4afc-acf8-128d22bac7e3 tempest-TestShelveInstance-6258502 tempest-TestShelveInstance-6258502-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2ab9930d6ce54cacbb3d4fd6313294d5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5eafd54351bd4049b87ad308a3638f80', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120741) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 18:06:49.576333 dv-cinder-852009-8-iscsi devstack@n-api.service[120741]: INFO nova.api.openstack.requestlog [None req-5b2f9ae5-1771-4afc-acf8-128d22bac7e3 tempest-TestShelveInstance-6258502 tempest-TestShelveInstance-6258502-project] 10.222.0.43 "GET /compute/v2.1/servers/2d60cc6d-a699-417d-aa20-fe3e1bfc351e" status: 200 len: 1570 microversion: 2.1 time: 0.182917 Sep 13 18:06:49.577058 dv-cinder-852009-8-iscsi devstack@n-api.service[120741]: [pid: 120741|app: 0|req: 271/551] 10.222.0.43 () {58 vars in 1236 bytes} [Tue Sep 13 18:06:49 2022] GET /compute/v2.1/servers/2d60cc6d-a699-417d-aa20-fe3e1bfc351e => generated 1570 bytes in 184 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 13 18:06:49.891663 dv-cinder-852009-8-iscsi devstack@n-api.service[120740]: DEBUG nova.api.openstack.wsgi [None req-94f90030-d934-41c8-a975-7a2fd8e9903e tempest-AttachVolumeShelveTestJSON-385853788 tempest-AttachVolumeShelveTestJSON-385853788-project] Calling method '>' {{(pid=120740) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 18:06:49.892267 dv-cinder-852009-8-iscsi devstack@n-api.service[120740]: DEBUG nova.compute.api [None req-94f90030-d934-41c8-a975-7a2fd8e9903e tempest-AttachVolumeShelveTestJSON-385853788 tempest-AttachVolumeShelveTestJSON-385853788-project] [instance: 8cecf08e-bea8-4cef-9439-0eaa242bfed1] Fetching instance by UUID {{(pid=120740) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 18:06:49.898940 dv-cinder-852009-8-iscsi devstack@n-api.service[120740]: DEBUG oslo_concurrency.lockutils [None req-94f90030-d934-41c8-a975-7a2fd8e9903e tempest-AttachVolumeShelveTestJSON-385853788 tempest-AttachVolumeShelveTestJSON-385853788-project] Acquiring lock "1daf4f4c-0e4a-4779-b53a-78c48397ea2f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120740) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 18:06:49.899426 dv-cinder-852009-8-iscsi devstack@n-api.service[120740]: DEBUG oslo_concurrency.lockutils [None req-94f90030-d934-41c8-a975-7a2fd8e9903e tempest-AttachVolumeShelveTestJSON-385853788 tempest-AttachVolumeShelveTestJSON-385853788-project] Lock "1daf4f4c-0e4a-4779-b53a-78c48397ea2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120740) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 18:06:49.899861 dv-cinder-852009-8-iscsi devstack@n-api.service[120740]: DEBUG oslo_concurrency.lockutils [None req-94f90030-d934-41c8-a975-7a2fd8e9903e tempest-AttachVolumeShelveTestJSON-385853788 tempest-AttachVolumeShelveTestJSON-385853788-project] Lock "1daf4f4c-0e4a-4779-b53a-78c48397ea2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120740) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 18:06:49.900596 dv-cinder-852009-8-iscsi devstack@n-api.service[120740]: DEBUG oslo_concurrency.lockutils [None req-94f90030-d934-41c8-a975-7a2fd8e9903e tempest-AttachVolumeShelveTestJSON-385853788 tempest-AttachVolumeShelveTestJSON-385853788-project] Acquiring lock "1daf4f4c-0e4a-4779-b53a-78c48397ea2f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120740) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 18:06:49.901046 dv-cinder-852009-8-iscsi devstack@n-api.service[120740]: DEBUG oslo_concurrency.lockutils [None req-94f90030-d934-41c8-a975-7a2fd8e9903e tempest-AttachVolumeShelveTestJSON-385853788 tempest-AttachVolumeShelveTestJSON-385853788-project] Lock "1daf4f4c-0e4a-4779-b53a-78c48397ea2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120740) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 18:06:49.901470 dv-cinder-852009-8-iscsi devstack@n-api.service[120740]: DEBUG oslo_concurrency.lockutils [None req-94f90030-d934-41c8-a975-7a2fd8e9903e tempest-AttachVolumeShelveTestJSON-385853788 tempest-AttachVolumeShelveTestJSON-385853788-project] Lock "1daf4f4c-0e4a-4779-b53a-78c48397ea2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120740) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 18:06:50.037455 dv-cinder-852009-8-iscsi devstack@n-api.service[120740]: DEBUG nova.policy [None req-94f90030-d934-41c8-a975-7a2fd8e9903e tempest-AttachVolumeShelveTestJSON-385853788 tempest-AttachVolumeShelveTestJSON-385853788-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e68ecd9b3ca643539b109f75bb242d6f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '75e14fd88bfb4cd896fa7b070a0fac47', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120740) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 18:06:50.046635 dv-cinder-852009-8-iscsi devstack@n-api.service[120740]: DEBUG nova.policy [None req-94f90030-d934-41c8-a975-7a2fd8e9903e tempest-AttachVolumeShelveTestJSON-385853788 tempest-AttachVolumeShelveTestJSON-385853788-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'e68ecd9b3ca643539b109f75bb242d6f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '75e14fd88bfb4cd896fa7b070a0fac47', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120740) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 18:06:50.048075 dv-cinder-852009-8-iscsi devstack@n-api.service[120740]: DEBUG nova.policy [None req-94f90030-d934-41c8-a975-7a2fd8e9903e tempest-AttachVolumeShelveTestJSON-385853788 tempest-AttachVolumeShelveTestJSON-385853788-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'e68ecd9b3ca643539b109f75bb242d6f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '75e14fd88bfb4cd896fa7b070a0fac47', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120740) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 18:06:50.049259 dv-cinder-852009-8-iscsi devstack@n-api.service[120740]: INFO nova.api.openstack.requestlog [None req-94f90030-d934-41c8-a975-7a2fd8e9903e tempest-AttachVolumeShelveTestJSON-385853788 tempest-AttachVolumeShelveTestJSON-385853788-project] 10.222.0.43 "GET /compute/v2.1/servers/8cecf08e-bea8-4cef-9439-0eaa242bfed1" status: 200 len: 1722 microversion: 2.20 time: 0.161612 Sep 13 18:06:50.049814 dv-cinder-852009-8-iscsi devstack@n-api.service[120740]: [pid: 120740|app: 0|req: 281/552] 10.222.0.43 () {60 vars in 1277 bytes} [Tue Sep 13 18:06:49 2022] GET /compute/v2.1/servers/8cecf08e-bea8-4cef-9439-0eaa242bfed1 => generated 1722 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 13 18:06:50.258947 dv-cinder-852009-8-iscsi devstack@n-api.service[120741]: DEBUG nova.api.openstack.wsgi [None req-804e41e7-857d-4efb-ac8a-a52102832e7c tempest-TestMinimumBasicScenario-820002800 tempest-TestMinimumBasicScenario-820002800-project] Calling method '>' {{(pid=120741) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 18:06:50.259820 dv-cinder-852009-8-iscsi devstack@n-api.service[120741]: DEBUG nova.compute.api [None req-804e41e7-857d-4efb-ac8a-a52102832e7c tempest-TestMinimumBasicScenario-820002800 tempest-TestMinimumBasicScenario-820002800-project] [instance: f8247a13-94cd-45b2-acc8-8717e1260f37] Fetching instance by UUID {{(pid=120741) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 18:06:50.270551 dv-cinder-852009-8-iscsi devstack@n-api.service[120741]: DEBUG oslo_concurrency.lockutils [None req-804e41e7-857d-4efb-ac8a-a52102832e7c tempest-TestMinimumBasicScenario-820002800 tempest-TestMinimumBasicScenario-820002800-project] Acquiring lock "1daf4f4c-0e4a-4779-b53a-78c48397ea2f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120741) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 18:06:50.271350 dv-cinder-852009-8-iscsi devstack@n-api.service[120741]: DEBUG oslo_concurrency.lockutils [None req-804e41e7-857d-4efb-ac8a-a52102832e7c tempest-TestMinimumBasicScenario-820002800 tempest-TestMinimumBasicScenario-820002800-project] Lock "1daf4f4c-0e4a-4779-b53a-78c48397ea2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120741) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 18:06:50.272068 dv-cinder-852009-8-iscsi devstack@n-api.service[120741]: DEBUG oslo_concurrency.lockutils [None req-804e41e7-857d-4efb-ac8a-a52102832e7c tempest-TestMinimumBasicScenario-820002800 tempest-TestMinimumBasicScenario-820002800-project] Lock "1daf4f4c-0e4a-4779-b53a-78c48397ea2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120741) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 18:06:50.273257 dv-cinder-852009-8-iscsi devstack@n-api.service[120741]: DEBUG oslo_concurrency.lockutils [None req-804e41e7-857d-4efb-ac8a-a52102832e7c tempest-TestMinimumBasicScenario-820002800 tempest-TestMinimumBasicScenario-820002800-project] Acquiring lock "1daf4f4c-0e4a-4779-b53a-78c48397ea2f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120741) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 18:06:50.273997 dv-cinder-852009-8-iscsi devstack@n-api.service[120741]: DEBUG oslo_concurrency.lockutils [None req-804e41e7-857d-4efb-ac8a-a52102832e7c tempest-TestMinimumBasicScenario-820002800 tempest-TestMinimumBasicScenario-820002800-project] Lock "1daf4f4c-0e4a-4779-b53a-78c48397ea2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120741) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 18:06:50.274443 dv-cinder-852009-8-iscsi devstack@n-api.service[120741]: DEBUG oslo_concurrency.lockutils [None req-804e41e7-857d-4efb-ac8a-a52102832e7c tempest-TestMinimumBasicScenario-820002800 tempest-TestMinimumBasicScenario-820002800-project] Lock "1daf4f4c-0e4a-4779-b53a-78c48397ea2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120741) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 18:06:50.422883 dv-cinder-852009-8-iscsi devstack@n-api.service[120741]: DEBUG nova.policy [None req-804e41e7-857d-4efb-ac8a-a52102832e7c tempest-TestMinimumBasicScenario-820002800 tempest-TestMinimumBasicScenario-820002800-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7880064ff0aa448d9c367c89eba145ff', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2f6832936c824066a4370cc45c5b0282', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120741) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 18:06:50.431353 dv-cinder-852009-8-iscsi devstack@n-api.service[120741]: INFO nova.api.openstack.requestlog [None req-804e41e7-857d-4efb-ac8a-a52102832e7c tempest-TestMinimumBasicScenario-820002800 tempest-TestMinimumBasicScenario-820002800-project] 10.222.0.43 "GET /compute/v2.1/servers/f8247a13-94cd-45b2-acc8-8717e1260f37" status: 200 len: 1758 microversion: 2.1 time: 0.179399 Sep 13 18:06:50.431949 dv-cinder-852009-8-iscsi devstack@n-api.service[120741]: [pid: 120741|app: 0|req: 272/553] 10.222.0.43 () {58 vars in 1236 bytes} [Tue Sep 13 18:06:50 2022] GET /compute/v2.1/servers/f8247a13-94cd-45b2-acc8-8717e1260f37 => generated 1758 bytes in 181 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 13 18:06:50.539594 dv-cinder-852009-8-iscsi devstack@n-api.service[120740]: DEBUG nova.api.openstack.wsgi [None req-a10bf161-7be4-4e6f-9d25-aa089216527f tempest-ServerRescueNegativeTestJSON-412251590 tempest-ServerRescueNegativeTestJSON-412251590-project] Calling method '>' {{(pid=120740) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 18:06:50.540277 dv-cinder-852009-8-iscsi devstack@n-api.service[120740]: DEBUG nova.compute.api [None req-a10bf161-7be4-4e6f-9d25-aa089216527f tempest-ServerRescueNegativeTestJSON-412251590 tempest-ServerRescueNegativeTestJSON-412251590-project] [instance: a9c22f82-a945-4a94-b3c9-fe95265053bd] Fetching instance by UUID {{(pid=120740) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 18:06:50.547770 dv-cinder-852009-8-iscsi devstack@n-api.service[120740]: DEBUG oslo_concurrency.lockutils [None req-a10bf161-7be4-4e6f-9d25-aa089216527f tempest-ServerRescueNegativeTestJSON-412251590 tempest-ServerRescueNegativeTestJSON-412251590-project] Acquiring lock "1daf4f4c-0e4a-4779-b53a-78c48397ea2f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120740) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 18:06:50.548315 dv-cinder-852009-8-iscsi devstack@n-api.service[120740]: DEBUG oslo_concurrency.lockutils [None req-a10bf161-7be4-4e6f-9d25-aa089216527f tempest-ServerRescueNegativeTestJSON-412251590 tempest-ServerRescueNegativeTestJSON-412251590-project] Lock "1daf4f4c-0e4a-4779-b53a-78c48397ea2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120740) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 18:06:50.548837 dv-cinder-852009-8-iscsi devstack@n-api.service[120740]: DEBUG oslo_concurrency.lockutils [None req-a10bf161-7be4-4e6f-9d25-aa089216527f tempest-ServerRescueNegativeTestJSON-412251590 tempest-ServerRescueNegativeTestJSON-412251590-project] Lock "1daf4f4c-0e4a-4779-b53a-78c48397ea2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120740) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 18:06:50.549615 dv-cinder-852009-8-iscsi devstack@n-api.service[120740]: DEBUG oslo_concurrency.lockutils [None req-a10bf161-7be4-4e6f-9d25-aa089216527f tempest-ServerRescueNegativeTestJSON-412251590 tempest-ServerRescueNegativeTestJSON-412251590-project] Acquiring lock "1daf4f4c-0e4a-4779-b53a-78c48397ea2f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120740) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 18:06:50.550122 dv-cinder-852009-8-iscsi devstack@n-api.service[120740]: DEBUG oslo_concurrency.lockutils [None req-a10bf161-7be4-4e6f-9d25-aa089216527f tempest-ServerRescueNegativeTestJSON-412251590 tempest-ServerRescueNegativeTestJSON-412251590-project] Lock "1daf4f4c-0e4a-4779-b53a-78c48397ea2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120740) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 18:06:50.550595 dv-cinder-852009-8-iscsi devstack@n-api.service[120740]: DEBUG oslo_concurrency.lockutils [None req-a10bf161-7be4-4e6f-9d25-aa089216527f tempest-ServerRescueNegativeTestJSON-412251590 tempest-ServerRescueNegativeTestJSON-412251590-project] Lock "1daf4f4c-0e4a-4779-b53a-78c48397ea2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120740) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 18:06:50.565848 dv-cinder-852009-8-iscsi devstack@n-api.service[120740]: INFO nova.api.openstack.wsgi [None req-a10bf161-7be4-4e6f-9d25-aa089216527f tempest-ServerRescueNegativeTestJSON-412251590 tempest-ServerRescueNegativeTestJSON-412251590-project] HTTP exception thrown: Instance a9c22f82-a945-4a94-b3c9-fe95265053bd could not be found. Sep 13 18:06:50.567667 dv-cinder-852009-8-iscsi devstack@n-api.service[120740]: DEBUG nova.api.openstack.wsgi [None req-a10bf161-7be4-4e6f-9d25-aa089216527f tempest-ServerRescueNegativeTestJSON-412251590 tempest-ServerRescueNegativeTestJSON-412251590-project] Request method failure captured: Sep 13 18:06:50.567667 dv-cinder-852009-8-iscsi devstack@n-api.service[120740]: request: GET /compute/v2.1/servers/a9c22f82-a945-4a94-b3c9-fe95265053bd HTTP/1.1 Sep 13 18:06:50.567667 dv-cinder-852009-8-iscsi devstack@n-api.service[120740]: Accept: application/json Sep 13 18:06:50.567667 dv-cinder-852009-8-iscsi devstack@n-api.service[120740]: Accept-Encoding: identity Sep 13 18:06:50.567667 dv-cinder-852009-8-iscsi devstack@n-api.service[120740]: Connection: close Sep 13 18:06:50.567667 dv-cinder-852009-8-iscsi devstack@n-api.service[120740]: Content-Length: 0 Sep 13 18:06:50.567667 dv-cinder-852009-8-iscsi devstack@n-api.service[120740]: Content-Type: application/json Sep 13 18:06:50.567667 dv-cinder-852009-8-iscsi devstack@n-api.service[120740]: Host: 10.222.0.43 Sep 13 18:06:50.567667 dv-cinder-852009-8-iscsi devstack@n-api.service[120740]: Openstack-System-Scope: None Sep 13 18:06:50.567667 dv-cinder-852009-8-iscsi devstack@n-api.service[120740]: User-Agent: python-urllib3/1.26.12 Sep 13 18:06:50.567667 dv-cinder-852009-8-iscsi devstack@n-api.service[120740]: X-Auth-Token: gAAAAABjIMWLGCNoeMW1liDJB1gW9y5zhqmLF-sp8LIXP_r2MtlxdDHDtH71A_-WwD3h6pxNpP_1J3-5dl1onM_1dz3k03VMJo2rjFEdcnLe1SaUhiMh3RVhtixTQiirGhUKXyKFRgOaQ5UOSPmq2sc9F0EVe-crpqJDqeSJGSsHbG1iIfI3v08 Sep 13 18:06:50.567667 dv-cinder-852009-8-iscsi devstack@n-api.service[120740]: X-Domain-Id: None Sep 13 18:06:50.567667 dv-cinder-852009-8-iscsi devstack@n-api.service[120740]: X-Domain-Name: None Sep 13 18:06:50.567667 dv-cinder-852009-8-iscsi devstack@n-api.service[120740]: X-Identity-Status: Confirmed Sep 13 18:06:50.567667 dv-cinder-852009-8-iscsi devstack@n-api.service[120740]: X-Is-Admin-Project: True Sep 13 18:06:50.567667 dv-cinder-852009-8-iscsi devstack@n-api.service[120740]: X-Project-Domain-Id: default Sep 13 18:06:50.567667 dv-cinder-852009-8-iscsi devstack@n-api.service[120740]: X-Project-Domain-Name: Default Sep 13 18:06:50.567667 dv-cinder-852009-8-iscsi devstack@n-api.service[120740]: X-Project-Id: 2eae4acecf6c4961830ead78d71b2ad3 Sep 13 18:06:50.567667 dv-cinder-852009-8-iscsi devstack@n-api.service[120740]: X-Project-Name: tempest-ServerRescueNegativeTestJSON-412251590 Sep 13 18:06:50.567667 dv-cinder-852009-8-iscsi devstack@n-api.service[120740]: X-Role: reader,member Sep 13 18:06:50.567667 dv-cinder-852009-8-iscsi devstack@n-api.service[120740]: X-Roles: reader,member Sep 13 18:06:50.569174 dv-cinder-852009-8-iscsi devstack@n-api.service[120740]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/identity"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/compute/v2/2eae4acecf6c4961830ead78d71b2ad3"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.43:8080", "publicURL": "http://10.222.0.43:8080/v1/AUTH_2eae4acecf6c4961830ead78d71b2ad3"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43:9696/networking"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/volume/v3/2eae4acecf6c4961830ead78d71b2ad3"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/compute/v2.1"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/placement"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/volume/v3/2eae4acecf6c4961830ead78d71b2ad3"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/image"}]}] Sep 13 18:06:50.569174 dv-cinder-852009-8-iscsi devstack@n-api.service[120740]: X-Tenant: tempest-ServerRescueNegativeTestJSON-412251590 Sep 13 18:06:50.569174 dv-cinder-852009-8-iscsi devstack@n-api.service[120740]: X-Tenant-Id: 2eae4acecf6c4961830ead78d71b2ad3 Sep 13 18:06:50.569174 dv-cinder-852009-8-iscsi devstack@n-api.service[120740]: X-Tenant-Name: tempest-ServerRescueNegativeTestJSON-412251590 Sep 13 18:06:50.569174 dv-cinder-852009-8-iscsi devstack@n-api.service[120740]: X-User: tempest-ServerRescueNegativeTestJSON-412251590-project Sep 13 18:06:50.569174 dv-cinder-852009-8-iscsi devstack@n-api.service[120740]: X-User-Domain-Id: default Sep 13 18:06:50.569174 dv-cinder-852009-8-iscsi devstack@n-api.service[120740]: X-User-Domain-Name: Default Sep 13 18:06:50.569174 dv-cinder-852009-8-iscsi devstack@n-api.service[120740]: X-User-Id: 60800cf2774e409d9c1b6f4992669991 Sep 13 18:06:50.569174 dv-cinder-852009-8-iscsi devstack@n-api.service[120740]: X-User-Name: tempest-ServerRescueNegativeTestJSON-412251590-project Sep 13 18:06:50.569174 dv-cinder-852009-8-iscsi devstack@n-api.service[120740]: method: > Sep 13 18:06:50.569174 dv-cinder-852009-8-iscsi devstack@n-api.service[120740]: exception: Instance a9c22f82-a945-4a94-b3c9-fe95265053bd could not be found. Sep 13 18:06:50.569174 dv-cinder-852009-8-iscsi devstack@n-api.service[120740]: action_args: {'id': 'a9c22f82-a945-4a94-b3c9-fe95265053bd'} Sep 13 18:06:50.569963 dv-cinder-852009-8-iscsi devstack@n-api.service[120740]: {{(pid=120740) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 13 18:06:50.569963 dv-cinder-852009-8-iscsi devstack@n-api.service[120740]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 13 18:06:50.569963 dv-cinder-852009-8-iscsi devstack@n-api.service[120740]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Sep 13 18:06:50.569963 dv-cinder-852009-8-iscsi devstack@n-api.service[120740]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Sep 13 18:06:50.569963 dv-cinder-852009-8-iscsi devstack@n-api.service[120740]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Sep 13 18:06:50.569963 dv-cinder-852009-8-iscsi devstack@n-api.service[120740]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Sep 13 18:06:50.569963 dv-cinder-852009-8-iscsi devstack@n-api.service[120740]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Sep 13 18:06:50.569963 dv-cinder-852009-8-iscsi devstack@n-api.service[120740]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Sep 13 18:06:50.569963 dv-cinder-852009-8-iscsi devstack@n-api.service[120740]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Sep 13 18:06:50.569963 dv-cinder-852009-8-iscsi devstack@n-api.service[120740]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Sep 13 18:06:50.569963 dv-cinder-852009-8-iscsi devstack@n-api.service[120740]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance a9c22f82-a945-4a94-b3c9-fe95265053bd could not be found. Sep 13 18:06:50.569963 dv-cinder-852009-8-iscsi devstack@n-api.service[120740]: ERROR nova.api.openstack.wsgi Sep 13 18:06:50.569963 dv-cinder-852009-8-iscsi devstack@n-api.service[120740]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 13 18:06:50.569963 dv-cinder-852009-8-iscsi devstack@n-api.service[120740]: ERROR nova.api.openstack.wsgi Sep 13 18:06:50.569963 dv-cinder-852009-8-iscsi devstack@n-api.service[120740]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 13 18:06:50.569963 dv-cinder-852009-8-iscsi devstack@n-api.service[120740]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 13 18:06:50.569963 dv-cinder-852009-8-iscsi devstack@n-api.service[120740]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 13 18:06:50.569963 dv-cinder-852009-8-iscsi devstack@n-api.service[120740]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 13 18:06:50.569963 dv-cinder-852009-8-iscsi devstack@n-api.service[120740]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 13 18:06:50.569963 dv-cinder-852009-8-iscsi devstack@n-api.service[120740]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 13 18:06:50.571445 dv-cinder-852009-8-iscsi devstack@n-api.service[120740]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 13 18:06:50.571445 dv-cinder-852009-8-iscsi devstack@n-api.service[120740]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Sep 13 18:06:50.571445 dv-cinder-852009-8-iscsi devstack@n-api.service[120740]: ERROR nova.api.openstack.wsgi instance = self._get_server( Sep 13 18:06:50.571445 dv-cinder-852009-8-iscsi devstack@n-api.service[120740]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Sep 13 18:06:50.571445 dv-cinder-852009-8-iscsi devstack@n-api.service[120740]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Sep 13 18:06:50.571445 dv-cinder-852009-8-iscsi devstack@n-api.service[120740]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Sep 13 18:06:50.571445 dv-cinder-852009-8-iscsi devstack@n-api.service[120740]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Sep 13 18:06:50.571445 dv-cinder-852009-8-iscsi devstack@n-api.service[120740]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance a9c22f82-a945-4a94-b3c9-fe95265053bd could not be found. Sep 13 18:06:50.571445 dv-cinder-852009-8-iscsi devstack@n-api.service[120740]: ERROR nova.api.openstack.wsgi Sep 13 18:06:50.571445 dv-cinder-852009-8-iscsi devstack@n-api.service[120740]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 13 18:06:50.571445 dv-cinder-852009-8-iscsi devstack@n-api.service[120740]: ERROR nova.api.openstack.wsgi Sep 13 18:06:50.571445 dv-cinder-852009-8-iscsi devstack@n-api.service[120740]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 13 18:06:50.571445 dv-cinder-852009-8-iscsi devstack@n-api.service[120740]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 13 18:06:50.571445 dv-cinder-852009-8-iscsi devstack@n-api.service[120740]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 13 18:06:50.571445 dv-cinder-852009-8-iscsi devstack@n-api.service[120740]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 13 18:06:50.571445 dv-cinder-852009-8-iscsi devstack@n-api.service[120740]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 13 18:06:50.571445 dv-cinder-852009-8-iscsi devstack@n-api.service[120740]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance a9c22f82-a945-4a94-b3c9-fe95265053bd could not be found. Sep 13 18:06:50.571445 dv-cinder-852009-8-iscsi devstack@n-api.service[120740]: ERROR nova.api.openstack.wsgi Sep 13 18:06:50.572733 dv-cinder-852009-8-iscsi devstack@n-api.service[120740]: DEBUG nova.api.openstack.wsgi [None req-a10bf161-7be4-4e6f-9d25-aa089216527f tempest-ServerRescueNegativeTestJSON-412251590 tempest-ServerRescueNegativeTestJSON-412251590-project] Returning 404 to user: Instance a9c22f82-a945-4a94-b3c9-fe95265053bd could not be found. {{(pid=120740) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 13 18:06:50.572733 dv-cinder-852009-8-iscsi devstack@n-api.service[120740]: INFO nova.api.openstack.requestlog [None req-a10bf161-7be4-4e6f-9d25-aa089216527f tempest-ServerRescueNegativeTestJSON-412251590 tempest-ServerRescueNegativeTestJSON-412251590-project] 10.222.0.43 "GET /compute/v2.1/servers/a9c22f82-a945-4a94-b3c9-fe95265053bd" status: 404 len: 111 microversion: 2.1 time: 0.036232 Sep 13 18:06:50.572733 dv-cinder-852009-8-iscsi devstack@n-api.service[120740]: [pid: 120740|app: 0|req: 282/554] 10.222.0.43 () {58 vars in 1236 bytes} [Tue Sep 13 18:06:50 2022] GET /compute/v2.1/servers/a9c22f82-a945-4a94-b3c9-fe95265053bd => generated 111 bytes in 38 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Sep 13 18:06:50.600926 dv-cinder-852009-8-iscsi devstack@n-api.service[120741]: DEBUG nova.api.openstack.wsgi [None req-259418c0-7dbf-4272-b82e-2ee412bd126f tempest-TestShelveInstance-6258502 tempest-TestShelveInstance-6258502-project] Calling method '>' {{(pid=120741) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 18:06:50.601530 dv-cinder-852009-8-iscsi devstack@n-api.service[120741]: DEBUG nova.compute.api [None req-259418c0-7dbf-4272-b82e-2ee412bd126f tempest-TestShelveInstance-6258502 tempest-TestShelveInstance-6258502-project] [instance: 2d60cc6d-a699-417d-aa20-fe3e1bfc351e] Fetching instance by UUID {{(pid=120741) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 18:06:50.608333 dv-cinder-852009-8-iscsi devstack@n-api.service[120741]: DEBUG oslo_concurrency.lockutils [None req-259418c0-7dbf-4272-b82e-2ee412bd126f tempest-TestShelveInstance-6258502 tempest-TestShelveInstance-6258502-project] Acquiring lock "1daf4f4c-0e4a-4779-b53a-78c48397ea2f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120741) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 18:06:50.608849 dv-cinder-852009-8-iscsi devstack@n-api.service[120741]: DEBUG oslo_concurrency.lockutils [None req-259418c0-7dbf-4272-b82e-2ee412bd126f tempest-TestShelveInstance-6258502 tempest-TestShelveInstance-6258502-project] Lock "1daf4f4c-0e4a-4779-b53a-78c48397ea2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120741) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 18:06:50.609406 dv-cinder-852009-8-iscsi devstack@n-api.service[120741]: DEBUG oslo_concurrency.lockutils [None req-259418c0-7dbf-4272-b82e-2ee412bd126f tempest-TestShelveInstance-6258502 tempest-TestShelveInstance-6258502-project] Lock "1daf4f4c-0e4a-4779-b53a-78c48397ea2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120741) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 18:06:50.610099 dv-cinder-852009-8-iscsi devstack@n-api.service[120741]: DEBUG oslo_concurrency.lockutils [None req-259418c0-7dbf-4272-b82e-2ee412bd126f tempest-TestShelveInstance-6258502 tempest-TestShelveInstance-6258502-project] Acquiring lock "1daf4f4c-0e4a-4779-b53a-78c48397ea2f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120741) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 18:06:50.610549 dv-cinder-852009-8-iscsi devstack@n-api.service[120741]: DEBUG oslo_concurrency.lockutils [None req-259418c0-7dbf-4272-b82e-2ee412bd126f tempest-TestShelveInstance-6258502 tempest-TestShelveInstance-6258502-project] Lock "1daf4f4c-0e4a-4779-b53a-78c48397ea2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120741) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 18:06:50.610964 dv-cinder-852009-8-iscsi devstack@n-api.service[120741]: DEBUG oslo_concurrency.lockutils [None req-259418c0-7dbf-4272-b82e-2ee412bd126f tempest-TestShelveInstance-6258502 tempest-TestShelveInstance-6258502-project] Lock "1daf4f4c-0e4a-4779-b53a-78c48397ea2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120741) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 18:06:50.826472 dv-cinder-852009-8-iscsi devstack@n-api.service[120741]: DEBUG nova.policy [None req-259418c0-7dbf-4272-b82e-2ee412bd126f tempest-TestShelveInstance-6258502 tempest-TestShelveInstance-6258502-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2ab9930d6ce54cacbb3d4fd6313294d5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5eafd54351bd4049b87ad308a3638f80', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120741) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 18:06:50.834264 dv-cinder-852009-8-iscsi devstack@n-api.service[120741]: INFO nova.api.openstack.requestlog [None req-259418c0-7dbf-4272-b82e-2ee412bd126f tempest-TestShelveInstance-6258502 tempest-TestShelveInstance-6258502-project] 10.222.0.43 "GET /compute/v2.1/servers/2d60cc6d-a699-417d-aa20-fe3e1bfc351e" status: 200 len: 1570 microversion: 2.1 time: 0.237252 Sep 13 18:06:50.834840 dv-cinder-852009-8-iscsi devstack@n-api.service[120741]: [pid: 120741|app: 0|req: 273/555] 10.222.0.43 () {58 vars in 1236 bytes} [Tue Sep 13 18:06:50 2022] GET /compute/v2.1/servers/2d60cc6d-a699-417d-aa20-fe3e1bfc351e => generated 1570 bytes in 239 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 13 18:06:51.075304 dv-cinder-852009-8-iscsi devstack@n-api.service[120740]: DEBUG nova.api.openstack.wsgi [None req-a3b689d9-ec44-4db0-b6bf-be6467782c16 tempest-AttachVolumeShelveTestJSON-385853788 tempest-AttachVolumeShelveTestJSON-385853788-project] Calling method '>' {{(pid=120740) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 18:06:51.076024 dv-cinder-852009-8-iscsi devstack@n-api.service[120740]: DEBUG nova.compute.api [None req-a3b689d9-ec44-4db0-b6bf-be6467782c16 tempest-AttachVolumeShelveTestJSON-385853788 tempest-AttachVolumeShelveTestJSON-385853788-project] [instance: 8cecf08e-bea8-4cef-9439-0eaa242bfed1] Fetching instance by UUID {{(pid=120740) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 18:06:51.082401 dv-cinder-852009-8-iscsi devstack@n-api.service[120740]: DEBUG oslo_concurrency.lockutils [None req-a3b689d9-ec44-4db0-b6bf-be6467782c16 tempest-AttachVolumeShelveTestJSON-385853788 tempest-AttachVolumeShelveTestJSON-385853788-project] Acquiring lock "1daf4f4c-0e4a-4779-b53a-78c48397ea2f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120740) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 18:06:51.082895 dv-cinder-852009-8-iscsi devstack@n-api.service[120740]: DEBUG oslo_concurrency.lockutils [None req-a3b689d9-ec44-4db0-b6bf-be6467782c16 tempest-AttachVolumeShelveTestJSON-385853788 tempest-AttachVolumeShelveTestJSON-385853788-project] Lock "1daf4f4c-0e4a-4779-b53a-78c48397ea2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120740) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 18:06:51.083351 dv-cinder-852009-8-iscsi devstack@n-api.service[120740]: DEBUG oslo_concurrency.lockutils [None req-a3b689d9-ec44-4db0-b6bf-be6467782c16 tempest-AttachVolumeShelveTestJSON-385853788 tempest-AttachVolumeShelveTestJSON-385853788-project] Lock "1daf4f4c-0e4a-4779-b53a-78c48397ea2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120740) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 18:06:51.084068 dv-cinder-852009-8-iscsi devstack@n-api.service[120740]: DEBUG oslo_concurrency.lockutils [None req-a3b689d9-ec44-4db0-b6bf-be6467782c16 tempest-AttachVolumeShelveTestJSON-385853788 tempest-AttachVolumeShelveTestJSON-385853788-project] Acquiring lock "1daf4f4c-0e4a-4779-b53a-78c48397ea2f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120740) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 18:06:51.084559 dv-cinder-852009-8-iscsi devstack@n-api.service[120740]: DEBUG oslo_concurrency.lockutils [None req-a3b689d9-ec44-4db0-b6bf-be6467782c16 tempest-AttachVolumeShelveTestJSON-385853788 tempest-AttachVolumeShelveTestJSON-385853788-project] Lock "1daf4f4c-0e4a-4779-b53a-78c48397ea2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120740) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 18:06:51.085087 dv-cinder-852009-8-iscsi devstack@n-api.service[120740]: DEBUG oslo_concurrency.lockutils [None req-a3b689d9-ec44-4db0-b6bf-be6467782c16 tempest-AttachVolumeShelveTestJSON-385853788 tempest-AttachVolumeShelveTestJSON-385853788-project] Lock "1daf4f4c-0e4a-4779-b53a-78c48397ea2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120740) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 18:06:51.359237 dv-cinder-852009-8-iscsi devstack@n-api.service[120740]: DEBUG nova.policy [None req-a3b689d9-ec44-4db0-b6bf-be6467782c16 tempest-AttachVolumeShelveTestJSON-385853788 tempest-AttachVolumeShelveTestJSON-385853788-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e68ecd9b3ca643539b109f75bb242d6f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '75e14fd88bfb4cd896fa7b070a0fac47', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120740) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 18:06:51.368615 dv-cinder-852009-8-iscsi devstack@n-api.service[120740]: DEBUG nova.policy [None req-a3b689d9-ec44-4db0-b6bf-be6467782c16 tempest-AttachVolumeShelveTestJSON-385853788 tempest-AttachVolumeShelveTestJSON-385853788-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'e68ecd9b3ca643539b109f75bb242d6f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '75e14fd88bfb4cd896fa7b070a0fac47', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120740) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 18:06:51.370102 dv-cinder-852009-8-iscsi devstack@n-api.service[120740]: DEBUG nova.policy [None req-a3b689d9-ec44-4db0-b6bf-be6467782c16 tempest-AttachVolumeShelveTestJSON-385853788 tempest-AttachVolumeShelveTestJSON-385853788-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'e68ecd9b3ca643539b109f75bb242d6f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '75e14fd88bfb4cd896fa7b070a0fac47', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120740) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 18:06:51.371261 dv-cinder-852009-8-iscsi devstack@n-api.service[120740]: INFO nova.api.openstack.requestlog [None req-a3b689d9-ec44-4db0-b6bf-be6467782c16 tempest-AttachVolumeShelveTestJSON-385853788 tempest-AttachVolumeShelveTestJSON-385853788-project] 10.222.0.43 "GET /compute/v2.1/servers/8cecf08e-bea8-4cef-9439-0eaa242bfed1" status: 200 len: 1722 microversion: 2.20 time: 0.300252 Sep 13 18:06:51.371807 dv-cinder-852009-8-iscsi devstack@n-api.service[120740]: [pid: 120740|app: 0|req: 283/556] 10.222.0.43 () {60 vars in 1277 bytes} [Tue Sep 13 18:06:51 2022] GET /compute/v2.1/servers/8cecf08e-bea8-4cef-9439-0eaa242bfed1 => generated 1722 bytes in 301 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 13 18:06:51.455140 dv-cinder-852009-8-iscsi devstack@n-api.service[120741]: DEBUG nova.api.openstack.wsgi [None req-24cd7c35-97da-4463-b147-d9c7a9e8946f tempest-TestMinimumBasicScenario-820002800 tempest-TestMinimumBasicScenario-820002800-project] Calling method '>' {{(pid=120741) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 18:06:51.455732 dv-cinder-852009-8-iscsi devstack@n-api.service[120741]: DEBUG nova.compute.api [None req-24cd7c35-97da-4463-b147-d9c7a9e8946f tempest-TestMinimumBasicScenario-820002800 tempest-TestMinimumBasicScenario-820002800-project] [instance: f8247a13-94cd-45b2-acc8-8717e1260f37] Fetching instance by UUID {{(pid=120741) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 18:06:51.462544 dv-cinder-852009-8-iscsi devstack@n-api.service[120741]: DEBUG oslo_concurrency.lockutils [None req-24cd7c35-97da-4463-b147-d9c7a9e8946f tempest-TestMinimumBasicScenario-820002800 tempest-TestMinimumBasicScenario-820002800-project] Acquiring lock "1daf4f4c-0e4a-4779-b53a-78c48397ea2f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120741) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 18:06:51.463033 dv-cinder-852009-8-iscsi devstack@n-api.service[120741]: DEBUG oslo_concurrency.lockutils [None req-24cd7c35-97da-4463-b147-d9c7a9e8946f tempest-TestMinimumBasicScenario-820002800 tempest-TestMinimumBasicScenario-820002800-project] Lock "1daf4f4c-0e4a-4779-b53a-78c48397ea2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120741) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 18:06:51.463461 dv-cinder-852009-8-iscsi devstack@n-api.service[120741]: DEBUG oslo_concurrency.lockutils [None req-24cd7c35-97da-4463-b147-d9c7a9e8946f tempest-TestMinimumBasicScenario-820002800 tempest-TestMinimumBasicScenario-820002800-project] Lock "1daf4f4c-0e4a-4779-b53a-78c48397ea2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120741) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 18:06:51.464155 dv-cinder-852009-8-iscsi devstack@n-api.service[120741]: DEBUG oslo_concurrency.lockutils [None req-24cd7c35-97da-4463-b147-d9c7a9e8946f tempest-TestMinimumBasicScenario-820002800 tempest-TestMinimumBasicScenario-820002800-project] Acquiring lock "1daf4f4c-0e4a-4779-b53a-78c48397ea2f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120741) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 18:06:51.464709 dv-cinder-852009-8-iscsi devstack@n-api.service[120741]: DEBUG oslo_concurrency.lockutils [None req-24cd7c35-97da-4463-b147-d9c7a9e8946f tempest-TestMinimumBasicScenario-820002800 tempest-TestMinimumBasicScenario-820002800-project] Lock "1daf4f4c-0e4a-4779-b53a-78c48397ea2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120741) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 18:06:51.465120 dv-cinder-852009-8-iscsi devstack@n-api.service[120741]: DEBUG oslo_concurrency.lockutils [None req-24cd7c35-97da-4463-b147-d9c7a9e8946f tempest-TestMinimumBasicScenario-820002800 tempest-TestMinimumBasicScenario-820002800-project] Lock "1daf4f4c-0e4a-4779-b53a-78c48397ea2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120741) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 18:06:51.858338 dv-cinder-852009-8-iscsi devstack@n-api.service[120740]: DEBUG nova.api.openstack.wsgi [None req-026a71f0-137c-4a04-936c-a3fb9a06db82 tempest-TestShelveInstance-6258502 tempest-TestShelveInstance-6258502-project] Calling method '>' {{(pid=120740) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 18:06:51.858921 dv-cinder-852009-8-iscsi devstack@n-api.service[120740]: DEBUG nova.compute.api [None req-026a71f0-137c-4a04-936c-a3fb9a06db82 tempest-TestShelveInstance-6258502 tempest-TestShelveInstance-6258502-project] [instance: 2d60cc6d-a699-417d-aa20-fe3e1bfc351e] Fetching instance by UUID {{(pid=120740) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 18:06:51.865590 dv-cinder-852009-8-iscsi devstack@n-api.service[120740]: DEBUG oslo_concurrency.lockutils [None req-026a71f0-137c-4a04-936c-a3fb9a06db82 tempest-TestShelveInstance-6258502 tempest-TestShelveInstance-6258502-project] Acquiring lock "1daf4f4c-0e4a-4779-b53a-78c48397ea2f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120740) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 18:06:51.866077 dv-cinder-852009-8-iscsi devstack@n-api.service[120740]: DEBUG oslo_concurrency.lockutils [None req-026a71f0-137c-4a04-936c-a3fb9a06db82 tempest-TestShelveInstance-6258502 tempest-TestShelveInstance-6258502-project] Lock "1daf4f4c-0e4a-4779-b53a-78c48397ea2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120740) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 18:06:51.866513 dv-cinder-852009-8-iscsi devstack@n-api.service[120740]: DEBUG oslo_concurrency.lockutils [None req-026a71f0-137c-4a04-936c-a3fb9a06db82 tempest-TestShelveInstance-6258502 tempest-TestShelveInstance-6258502-project] Lock "1daf4f4c-0e4a-4779-b53a-78c48397ea2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120740) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 18:06:51.867185 dv-cinder-852009-8-iscsi devstack@n-api.service[120740]: DEBUG oslo_concurrency.lockutils [None req-026a71f0-137c-4a04-936c-a3fb9a06db82 tempest-TestShelveInstance-6258502 tempest-TestShelveInstance-6258502-project] Acquiring lock "1daf4f4c-0e4a-4779-b53a-78c48397ea2f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120740) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 18:06:51.867772 dv-cinder-852009-8-iscsi devstack@n-api.service[120740]: DEBUG oslo_concurrency.lockutils [None req-026a71f0-137c-4a04-936c-a3fb9a06db82 tempest-TestShelveInstance-6258502 tempest-TestShelveInstance-6258502-project] Lock "1daf4f4c-0e4a-4779-b53a-78c48397ea2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120740) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 18:06:51.868190 dv-cinder-852009-8-iscsi devstack@n-api.service[120740]: DEBUG oslo_concurrency.lockutils [None req-026a71f0-137c-4a04-936c-a3fb9a06db82 tempest-TestShelveInstance-6258502 tempest-TestShelveInstance-6258502-project] Lock "1daf4f4c-0e4a-4779-b53a-78c48397ea2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120740) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 18:06:51.881320 dv-cinder-852009-8-iscsi devstack@n-api.service[120741]: DEBUG nova.policy [None req-24cd7c35-97da-4463-b147-d9c7a9e8946f tempest-TestMinimumBasicScenario-820002800 tempest-TestMinimumBasicScenario-820002800-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7880064ff0aa448d9c367c89eba145ff', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2f6832936c824066a4370cc45c5b0282', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120741) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 18:06:51.890485 dv-cinder-852009-8-iscsi devstack@n-api.service[120741]: INFO nova.api.openstack.requestlog [None req-24cd7c35-97da-4463-b147-d9c7a9e8946f tempest-TestMinimumBasicScenario-820002800 tempest-TestMinimumBasicScenario-820002800-project] 10.222.0.43 "GET /compute/v2.1/servers/f8247a13-94cd-45b2-acc8-8717e1260f37" status: 200 len: 1758 microversion: 2.1 time: 0.439322 Sep 13 18:06:51.891184 dv-cinder-852009-8-iscsi devstack@n-api.service[120741]: [pid: 120741|app: 0|req: 274/557] 10.222.0.43 () {58 vars in 1236 bytes} [Tue Sep 13 18:06:51 2022] GET /compute/v2.1/servers/f8247a13-94cd-45b2-acc8-8717e1260f37 => generated 1758 bytes in 441 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 13 18:06:52.098845 dv-cinder-852009-8-iscsi devstack@n-api.service[120740]: DEBUG nova.policy [None req-026a71f0-137c-4a04-936c-a3fb9a06db82 tempest-TestShelveInstance-6258502 tempest-TestShelveInstance-6258502-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2ab9930d6ce54cacbb3d4fd6313294d5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5eafd54351bd4049b87ad308a3638f80', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120740) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 18:06:52.107748 dv-cinder-852009-8-iscsi devstack@n-api.service[120740]: INFO nova.api.openstack.requestlog [None req-026a71f0-137c-4a04-936c-a3fb9a06db82 tempest-TestShelveInstance-6258502 tempest-TestShelveInstance-6258502-project] 10.222.0.43 "GET /compute/v2.1/servers/2d60cc6d-a699-417d-aa20-fe3e1bfc351e" status: 200 len: 1570 microversion: 2.1 time: 0.252551 Sep 13 18:06:52.108791 dv-cinder-852009-8-iscsi devstack@n-api.service[120740]: [pid: 120740|app: 0|req: 284/558] 10.222.0.43 () {58 vars in 1236 bytes} [Tue Sep 13 18:06:51 2022] GET /compute/v2.1/servers/2d60cc6d-a699-417d-aa20-fe3e1bfc351e => generated 1570 bytes in 255 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 13 18:06:52.397660 dv-cinder-852009-8-iscsi devstack@n-api.service[120741]: DEBUG nova.api.openstack.wsgi [None req-f3167653-851d-4414-a46a-7fdbb8902aef tempest-AttachVolumeShelveTestJSON-385853788 tempest-AttachVolumeShelveTestJSON-385853788-project] Calling method '>' {{(pid=120741) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 18:06:52.398392 dv-cinder-852009-8-iscsi devstack@n-api.service[120741]: DEBUG nova.compute.api [None req-f3167653-851d-4414-a46a-7fdbb8902aef tempest-AttachVolumeShelveTestJSON-385853788 tempest-AttachVolumeShelveTestJSON-385853788-project] [instance: 8cecf08e-bea8-4cef-9439-0eaa242bfed1] Fetching instance by UUID {{(pid=120741) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 18:06:52.405233 dv-cinder-852009-8-iscsi devstack@n-api.service[120741]: DEBUG oslo_concurrency.lockutils [None req-f3167653-851d-4414-a46a-7fdbb8902aef tempest-AttachVolumeShelveTestJSON-385853788 tempest-AttachVolumeShelveTestJSON-385853788-project] Acquiring lock "1daf4f4c-0e4a-4779-b53a-78c48397ea2f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120741) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 18:06:52.406553 dv-cinder-852009-8-iscsi devstack@n-api.service[120741]: DEBUG oslo_concurrency.lockutils [None req-f3167653-851d-4414-a46a-7fdbb8902aef tempest-AttachVolumeShelveTestJSON-385853788 tempest-AttachVolumeShelveTestJSON-385853788-project] Lock "1daf4f4c-0e4a-4779-b53a-78c48397ea2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120741) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 18:06:52.407272 dv-cinder-852009-8-iscsi devstack@n-api.service[120741]: DEBUG oslo_concurrency.lockutils [None req-f3167653-851d-4414-a46a-7fdbb8902aef tempest-AttachVolumeShelveTestJSON-385853788 tempest-AttachVolumeShelveTestJSON-385853788-project] Lock "1daf4f4c-0e4a-4779-b53a-78c48397ea2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120741) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 18:06:52.408113 dv-cinder-852009-8-iscsi devstack@n-api.service[120741]: DEBUG oslo_concurrency.lockutils [None req-f3167653-851d-4414-a46a-7fdbb8902aef tempest-AttachVolumeShelveTestJSON-385853788 tempest-AttachVolumeShelveTestJSON-385853788-project] Acquiring lock "1daf4f4c-0e4a-4779-b53a-78c48397ea2f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120741) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 18:06:52.408593 dv-cinder-852009-8-iscsi devstack@n-api.service[120741]: DEBUG oslo_concurrency.lockutils [None req-f3167653-851d-4414-a46a-7fdbb8902aef tempest-AttachVolumeShelveTestJSON-385853788 tempest-AttachVolumeShelveTestJSON-385853788-project] Lock "1daf4f4c-0e4a-4779-b53a-78c48397ea2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120741) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 18:06:52.409009 dv-cinder-852009-8-iscsi devstack@n-api.service[120741]: DEBUG oslo_concurrency.lockutils [None req-f3167653-851d-4414-a46a-7fdbb8902aef tempest-AttachVolumeShelveTestJSON-385853788 tempest-AttachVolumeShelveTestJSON-385853788-project] Lock "1daf4f4c-0e4a-4779-b53a-78c48397ea2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120741) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 18:06:52.608228 dv-cinder-852009-8-iscsi devstack@n-api.service[120741]: DEBUG nova.policy [None req-f3167653-851d-4414-a46a-7fdbb8902aef tempest-AttachVolumeShelveTestJSON-385853788 tempest-AttachVolumeShelveTestJSON-385853788-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e68ecd9b3ca643539b109f75bb242d6f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '75e14fd88bfb4cd896fa7b070a0fac47', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120741) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 18:06:52.617013 dv-cinder-852009-8-iscsi devstack@n-api.service[120741]: DEBUG nova.policy [None req-f3167653-851d-4414-a46a-7fdbb8902aef tempest-AttachVolumeShelveTestJSON-385853788 tempest-AttachVolumeShelveTestJSON-385853788-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'e68ecd9b3ca643539b109f75bb242d6f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '75e14fd88bfb4cd896fa7b070a0fac47', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120741) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 18:06:52.618767 dv-cinder-852009-8-iscsi devstack@n-api.service[120741]: DEBUG nova.policy [None req-f3167653-851d-4414-a46a-7fdbb8902aef tempest-AttachVolumeShelveTestJSON-385853788 tempest-AttachVolumeShelveTestJSON-385853788-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'e68ecd9b3ca643539b109f75bb242d6f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '75e14fd88bfb4cd896fa7b070a0fac47', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120741) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 18:06:52.620143 dv-cinder-852009-8-iscsi devstack@n-api.service[120741]: INFO nova.api.openstack.requestlog [None req-f3167653-851d-4414-a46a-7fdbb8902aef tempest-AttachVolumeShelveTestJSON-385853788 tempest-AttachVolumeShelveTestJSON-385853788-project] 10.222.0.43 "GET /compute/v2.1/servers/8cecf08e-bea8-4cef-9439-0eaa242bfed1" status: 200 len: 1722 microversion: 2.20 time: 0.226667 Sep 13 18:06:52.629244 dv-cinder-852009-8-iscsi devstack@n-api.service[120741]: [pid: 120741|app: 0|req: 275/559] 10.222.0.43 () {60 vars in 1277 bytes} [Tue Sep 13 18:06:52 2022] GET /compute/v2.1/servers/8cecf08e-bea8-4cef-9439-0eaa242bfed1 => generated 1722 bytes in 236 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 13 18:06:52.914718 dv-cinder-852009-8-iscsi devstack@n-api.service[120740]: DEBUG nova.api.openstack.wsgi [None req-01b6288a-e081-4ac3-9324-42a40c59add6 tempest-TestMinimumBasicScenario-820002800 tempest-TestMinimumBasicScenario-820002800-project] Calling method '>' {{(pid=120740) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 18:06:52.915320 dv-cinder-852009-8-iscsi devstack@n-api.service[120740]: DEBUG nova.compute.api [None req-01b6288a-e081-4ac3-9324-42a40c59add6 tempest-TestMinimumBasicScenario-820002800 tempest-TestMinimumBasicScenario-820002800-project] [instance: f8247a13-94cd-45b2-acc8-8717e1260f37] Fetching instance by UUID {{(pid=120740) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 18:06:52.922065 dv-cinder-852009-8-iscsi devstack@n-api.service[120740]: DEBUG oslo_concurrency.lockutils [None req-01b6288a-e081-4ac3-9324-42a40c59add6 tempest-TestMinimumBasicScenario-820002800 tempest-TestMinimumBasicScenario-820002800-project] Acquiring lock "1daf4f4c-0e4a-4779-b53a-78c48397ea2f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120740) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 18:06:52.922782 dv-cinder-852009-8-iscsi devstack@n-api.service[120740]: DEBUG oslo_concurrency.lockutils [None req-01b6288a-e081-4ac3-9324-42a40c59add6 tempest-TestMinimumBasicScenario-820002800 tempest-TestMinimumBasicScenario-820002800-project] Lock "1daf4f4c-0e4a-4779-b53a-78c48397ea2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120740) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 18:06:52.923359 dv-cinder-852009-8-iscsi devstack@n-api.service[120740]: DEBUG oslo_concurrency.lockutils [None req-01b6288a-e081-4ac3-9324-42a40c59add6 tempest-TestMinimumBasicScenario-820002800 tempest-TestMinimumBasicScenario-820002800-project] Lock "1daf4f4c-0e4a-4779-b53a-78c48397ea2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120740) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 18:06:52.924206 dv-cinder-852009-8-iscsi devstack@n-api.service[120740]: DEBUG oslo_concurrency.lockutils [None req-01b6288a-e081-4ac3-9324-42a40c59add6 tempest-TestMinimumBasicScenario-820002800 tempest-TestMinimumBasicScenario-820002800-project] Acquiring lock "1daf4f4c-0e4a-4779-b53a-78c48397ea2f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120740) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 18:06:52.924825 dv-cinder-852009-8-iscsi devstack@n-api.service[120740]: DEBUG oslo_concurrency.lockutils [None req-01b6288a-e081-4ac3-9324-42a40c59add6 tempest-TestMinimumBasicScenario-820002800 tempest-TestMinimumBasicScenario-820002800-project] Lock "1daf4f4c-0e4a-4779-b53a-78c48397ea2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120740) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 18:06:52.925447 dv-cinder-852009-8-iscsi devstack@n-api.service[120740]: DEBUG oslo_concurrency.lockutils [None req-01b6288a-e081-4ac3-9324-42a40c59add6 tempest-TestMinimumBasicScenario-820002800 tempest-TestMinimumBasicScenario-820002800-project] Lock "1daf4f4c-0e4a-4779-b53a-78c48397ea2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120740) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 18:06:53.133682 dv-cinder-852009-8-iscsi devstack@n-api.service[120741]: DEBUG nova.api.openstack.wsgi [None req-489697b1-e1b9-4d75-88c6-72835911d22f tempest-TestShelveInstance-6258502 tempest-TestShelveInstance-6258502-project] Calling method '>' {{(pid=120741) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 18:06:53.135010 dv-cinder-852009-8-iscsi devstack@n-api.service[120741]: DEBUG nova.compute.api [None req-489697b1-e1b9-4d75-88c6-72835911d22f tempest-TestShelveInstance-6258502 tempest-TestShelveInstance-6258502-project] [instance: 2d60cc6d-a699-417d-aa20-fe3e1bfc351e] Fetching instance by UUID {{(pid=120741) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 18:06:53.141408 dv-cinder-852009-8-iscsi devstack@n-api.service[120741]: DEBUG oslo_concurrency.lockutils [None req-489697b1-e1b9-4d75-88c6-72835911d22f tempest-TestShelveInstance-6258502 tempest-TestShelveInstance-6258502-project] Acquiring lock "1daf4f4c-0e4a-4779-b53a-78c48397ea2f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120741) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 18:06:53.142614 dv-cinder-852009-8-iscsi devstack@n-api.service[120741]: DEBUG oslo_concurrency.lockutils [None req-489697b1-e1b9-4d75-88c6-72835911d22f tempest-TestShelveInstance-6258502 tempest-TestShelveInstance-6258502-project] Lock "1daf4f4c-0e4a-4779-b53a-78c48397ea2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120741) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 18:06:53.143257 dv-cinder-852009-8-iscsi devstack@n-api.service[120741]: DEBUG oslo_concurrency.lockutils [None req-489697b1-e1b9-4d75-88c6-72835911d22f tempest-TestShelveInstance-6258502 tempest-TestShelveInstance-6258502-project] Lock "1daf4f4c-0e4a-4779-b53a-78c48397ea2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120741) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 18:06:53.143876 dv-cinder-852009-8-iscsi devstack@n-api.service[120741]: DEBUG oslo_concurrency.lockutils [None req-489697b1-e1b9-4d75-88c6-72835911d22f tempest-TestShelveInstance-6258502 tempest-TestShelveInstance-6258502-project] Acquiring lock "1daf4f4c-0e4a-4779-b53a-78c48397ea2f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120741) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 18:06:53.144938 dv-cinder-852009-8-iscsi devstack@n-api.service[120741]: DEBUG oslo_concurrency.lockutils [None req-489697b1-e1b9-4d75-88c6-72835911d22f tempest-TestShelveInstance-6258502 tempest-TestShelveInstance-6258502-project] Lock "1daf4f4c-0e4a-4779-b53a-78c48397ea2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120741) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 18:06:53.145388 dv-cinder-852009-8-iscsi devstack@n-api.service[120741]: DEBUG oslo_concurrency.lockutils [None req-489697b1-e1b9-4d75-88c6-72835911d22f tempest-TestShelveInstance-6258502 tempest-TestShelveInstance-6258502-project] Lock "1daf4f4c-0e4a-4779-b53a-78c48397ea2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120741) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 18:06:53.177819 dv-cinder-852009-8-iscsi devstack@n-api.service[120740]: DEBUG nova.policy [None req-01b6288a-e081-4ac3-9324-42a40c59add6 tempest-TestMinimumBasicScenario-820002800 tempest-TestMinimumBasicScenario-820002800-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7880064ff0aa448d9c367c89eba145ff', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2f6832936c824066a4370cc45c5b0282', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120740) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 18:06:53.187496 dv-cinder-852009-8-iscsi devstack@n-api.service[120740]: INFO nova.api.openstack.requestlog [None req-01b6288a-e081-4ac3-9324-42a40c59add6 tempest-TestMinimumBasicScenario-820002800 tempest-TestMinimumBasicScenario-820002800-project] 10.222.0.43 "GET /compute/v2.1/servers/f8247a13-94cd-45b2-acc8-8717e1260f37" status: 200 len: 1758 microversion: 2.1 time: 0.276843 Sep 13 18:06:53.188859 dv-cinder-852009-8-iscsi devstack@n-api.service[120740]: [pid: 120740|app: 0|req: 285/560] 10.222.0.43 () {58 vars in 1236 bytes} [Tue Sep 13 18:06:52 2022] GET /compute/v2.1/servers/f8247a13-94cd-45b2-acc8-8717e1260f37 => generated 1758 bytes in 279 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 13 18:06:53.390803 dv-cinder-852009-8-iscsi devstack@n-api.service[120741]: DEBUG nova.policy [None req-489697b1-e1b9-4d75-88c6-72835911d22f tempest-TestShelveInstance-6258502 tempest-TestShelveInstance-6258502-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2ab9930d6ce54cacbb3d4fd6313294d5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5eafd54351bd4049b87ad308a3638f80', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120741) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 18:06:53.399497 dv-cinder-852009-8-iscsi devstack@n-api.service[120741]: INFO nova.api.openstack.requestlog [None req-489697b1-e1b9-4d75-88c6-72835911d22f tempest-TestShelveInstance-6258502 tempest-TestShelveInstance-6258502-project] 10.222.0.43 "GET /compute/v2.1/servers/2d60cc6d-a699-417d-aa20-fe3e1bfc351e" status: 200 len: 1570 microversion: 2.1 time: 0.269826 Sep 13 18:06:53.400075 dv-cinder-852009-8-iscsi devstack@n-api.service[120741]: [pid: 120741|app: 0|req: 276/561] 10.222.0.43 () {58 vars in 1236 bytes} [Tue Sep 13 18:06:53 2022] GET /compute/v2.1/servers/2d60cc6d-a699-417d-aa20-fe3e1bfc351e => generated 1570 bytes in 271 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 13 18:06:53.652743 dv-cinder-852009-8-iscsi devstack@n-api.service[120740]: DEBUG nova.api.openstack.wsgi [None req-73f51dc2-d199-4ed1-bb33-bad70c83ab81 tempest-AttachVolumeShelveTestJSON-385853788 tempest-AttachVolumeShelveTestJSON-385853788-project] Calling method '>' {{(pid=120740) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 18:06:53.653403 dv-cinder-852009-8-iscsi devstack@n-api.service[120740]: DEBUG nova.compute.api [None req-73f51dc2-d199-4ed1-bb33-bad70c83ab81 tempest-AttachVolumeShelveTestJSON-385853788 tempest-AttachVolumeShelveTestJSON-385853788-project] [instance: 8cecf08e-bea8-4cef-9439-0eaa242bfed1] Fetching instance by UUID {{(pid=120740) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 18:06:53.661490 dv-cinder-852009-8-iscsi devstack@n-api.service[120740]: DEBUG oslo_concurrency.lockutils [None req-73f51dc2-d199-4ed1-bb33-bad70c83ab81 tempest-AttachVolumeShelveTestJSON-385853788 tempest-AttachVolumeShelveTestJSON-385853788-project] Acquiring lock "1daf4f4c-0e4a-4779-b53a-78c48397ea2f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120740) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 18:06:53.662034 dv-cinder-852009-8-iscsi devstack@n-api.service[120740]: DEBUG oslo_concurrency.lockutils [None req-73f51dc2-d199-4ed1-bb33-bad70c83ab81 tempest-AttachVolumeShelveTestJSON-385853788 tempest-AttachVolumeShelveTestJSON-385853788-project] Lock "1daf4f4c-0e4a-4779-b53a-78c48397ea2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120740) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 18:06:53.662589 dv-cinder-852009-8-iscsi devstack@n-api.service[120740]: DEBUG oslo_concurrency.lockutils [None req-73f51dc2-d199-4ed1-bb33-bad70c83ab81 tempest-AttachVolumeShelveTestJSON-385853788 tempest-AttachVolumeShelveTestJSON-385853788-project] Lock "1daf4f4c-0e4a-4779-b53a-78c48397ea2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120740) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 18:06:53.663443 dv-cinder-852009-8-iscsi devstack@n-api.service[120740]: DEBUG oslo_concurrency.lockutils [None req-73f51dc2-d199-4ed1-bb33-bad70c83ab81 tempest-AttachVolumeShelveTestJSON-385853788 tempest-AttachVolumeShelveTestJSON-385853788-project] Acquiring lock "1daf4f4c-0e4a-4779-b53a-78c48397ea2f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120740) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 18:06:53.664033 dv-cinder-852009-8-iscsi devstack@n-api.service[120740]: DEBUG oslo_concurrency.lockutils [None req-73f51dc2-d199-4ed1-bb33-bad70c83ab81 tempest-AttachVolumeShelveTestJSON-385853788 tempest-AttachVolumeShelveTestJSON-385853788-project] Lock "1daf4f4c-0e4a-4779-b53a-78c48397ea2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120740) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 18:06:53.664642 dv-cinder-852009-8-iscsi devstack@n-api.service[120740]: DEBUG oslo_concurrency.lockutils [None req-73f51dc2-d199-4ed1-bb33-bad70c83ab81 tempest-AttachVolumeShelveTestJSON-385853788 tempest-AttachVolumeShelveTestJSON-385853788-project] Lock "1daf4f4c-0e4a-4779-b53a-78c48397ea2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120740) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 18:06:53.825311 dv-cinder-852009-8-iscsi devstack@n-api.service[120740]: DEBUG nova.policy [None req-73f51dc2-d199-4ed1-bb33-bad70c83ab81 tempest-AttachVolumeShelveTestJSON-385853788 tempest-AttachVolumeShelveTestJSON-385853788-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e68ecd9b3ca643539b109f75bb242d6f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '75e14fd88bfb4cd896fa7b070a0fac47', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120740) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 18:06:53.833573 dv-cinder-852009-8-iscsi devstack@n-api.service[120740]: DEBUG nova.policy [None req-73f51dc2-d199-4ed1-bb33-bad70c83ab81 tempest-AttachVolumeShelveTestJSON-385853788 tempest-AttachVolumeShelveTestJSON-385853788-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'e68ecd9b3ca643539b109f75bb242d6f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '75e14fd88bfb4cd896fa7b070a0fac47', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120740) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 18:06:53.835047 dv-cinder-852009-8-iscsi devstack@n-api.service[120740]: DEBUG nova.policy [None req-73f51dc2-d199-4ed1-bb33-bad70c83ab81 tempest-AttachVolumeShelveTestJSON-385853788 tempest-AttachVolumeShelveTestJSON-385853788-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'e68ecd9b3ca643539b109f75bb242d6f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '75e14fd88bfb4cd896fa7b070a0fac47', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120740) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 18:06:53.836269 dv-cinder-852009-8-iscsi devstack@n-api.service[120740]: INFO nova.api.openstack.requestlog [None req-73f51dc2-d199-4ed1-bb33-bad70c83ab81 tempest-AttachVolumeShelveTestJSON-385853788 tempest-AttachVolumeShelveTestJSON-385853788-project] 10.222.0.43 "GET /compute/v2.1/servers/8cecf08e-bea8-4cef-9439-0eaa242bfed1" status: 200 len: 1722 microversion: 2.20 time: 0.191945 Sep 13 18:06:53.836816 dv-cinder-852009-8-iscsi devstack@n-api.service[120740]: [pid: 120740|app: 0|req: 286/562] 10.222.0.43 () {60 vars in 1277 bytes} [Tue Sep 13 18:06:53 2022] GET /compute/v2.1/servers/8cecf08e-bea8-4cef-9439-0eaa242bfed1 => generated 1722 bytes in 194 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 13 18:06:54.212572 dv-cinder-852009-8-iscsi devstack@n-api.service[120741]: DEBUG nova.api.openstack.wsgi [None req-a8e8b88d-aafd-47e0-b94c-bce7fa323afe tempest-TestMinimumBasicScenario-820002800 tempest-TestMinimumBasicScenario-820002800-project] Calling method '>' {{(pid=120741) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 18:06:54.213830 dv-cinder-852009-8-iscsi devstack@n-api.service[120741]: DEBUG nova.compute.api [None req-a8e8b88d-aafd-47e0-b94c-bce7fa323afe tempest-TestMinimumBasicScenario-820002800 tempest-TestMinimumBasicScenario-820002800-project] [instance: f8247a13-94cd-45b2-acc8-8717e1260f37] Fetching instance by UUID {{(pid=120741) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 18:06:54.221937 dv-cinder-852009-8-iscsi devstack@n-api.service[120741]: DEBUG oslo_concurrency.lockutils [None req-a8e8b88d-aafd-47e0-b94c-bce7fa323afe tempest-TestMinimumBasicScenario-820002800 tempest-TestMinimumBasicScenario-820002800-project] Acquiring lock "1daf4f4c-0e4a-4779-b53a-78c48397ea2f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120741) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 18:06:54.223343 dv-cinder-852009-8-iscsi devstack@n-api.service[120741]: DEBUG oslo_concurrency.lockutils [None req-a8e8b88d-aafd-47e0-b94c-bce7fa323afe tempest-TestMinimumBasicScenario-820002800 tempest-TestMinimumBasicScenario-820002800-project] Lock "1daf4f4c-0e4a-4779-b53a-78c48397ea2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120741) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 18:06:54.224216 dv-cinder-852009-8-iscsi devstack@n-api.service[120741]: DEBUG oslo_concurrency.lockutils [None req-a8e8b88d-aafd-47e0-b94c-bce7fa323afe tempest-TestMinimumBasicScenario-820002800 tempest-TestMinimumBasicScenario-820002800-project] Lock "1daf4f4c-0e4a-4779-b53a-78c48397ea2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120741) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 18:06:54.225397 dv-cinder-852009-8-iscsi devstack@n-api.service[120741]: DEBUG oslo_concurrency.lockutils [None req-a8e8b88d-aafd-47e0-b94c-bce7fa323afe tempest-TestMinimumBasicScenario-820002800 tempest-TestMinimumBasicScenario-820002800-project] Acquiring lock "1daf4f4c-0e4a-4779-b53a-78c48397ea2f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120741) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 18:06:54.226525 dv-cinder-852009-8-iscsi devstack@n-api.service[120741]: DEBUG oslo_concurrency.lockutils [None req-a8e8b88d-aafd-47e0-b94c-bce7fa323afe tempest-TestMinimumBasicScenario-820002800 tempest-TestMinimumBasicScenario-820002800-project] Lock "1daf4f4c-0e4a-4779-b53a-78c48397ea2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120741) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 18:06:54.227423 dv-cinder-852009-8-iscsi devstack@n-api.service[120741]: DEBUG oslo_concurrency.lockutils [None req-a8e8b88d-aafd-47e0-b94c-bce7fa323afe tempest-TestMinimumBasicScenario-820002800 tempest-TestMinimumBasicScenario-820002800-project] Lock "1daf4f4c-0e4a-4779-b53a-78c48397ea2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120741) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 18:06:54.424815 dv-cinder-852009-8-iscsi devstack@n-api.service[120740]: DEBUG nova.api.openstack.wsgi [None req-7fb86029-ed19-41e1-b1c9-165f75578239 tempest-TestShelveInstance-6258502 tempest-TestShelveInstance-6258502-project] Calling method '>' {{(pid=120740) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 18:06:54.425310 dv-cinder-852009-8-iscsi devstack@n-api.service[120740]: DEBUG nova.compute.api [None req-7fb86029-ed19-41e1-b1c9-165f75578239 tempest-TestShelveInstance-6258502 tempest-TestShelveInstance-6258502-project] [instance: 2d60cc6d-a699-417d-aa20-fe3e1bfc351e] Fetching instance by UUID {{(pid=120740) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 18:06:54.431766 dv-cinder-852009-8-iscsi devstack@n-api.service[120740]: DEBUG oslo_concurrency.lockutils [None req-7fb86029-ed19-41e1-b1c9-165f75578239 tempest-TestShelveInstance-6258502 tempest-TestShelveInstance-6258502-project] Acquiring lock "1daf4f4c-0e4a-4779-b53a-78c48397ea2f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120740) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 18:06:54.432638 dv-cinder-852009-8-iscsi devstack@n-api.service[120740]: DEBUG oslo_concurrency.lockutils [None req-7fb86029-ed19-41e1-b1c9-165f75578239 tempest-TestShelveInstance-6258502 tempest-TestShelveInstance-6258502-project] Lock "1daf4f4c-0e4a-4779-b53a-78c48397ea2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120740) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 18:06:54.433333 dv-cinder-852009-8-iscsi devstack@n-api.service[120740]: DEBUG oslo_concurrency.lockutils [None req-7fb86029-ed19-41e1-b1c9-165f75578239 tempest-TestShelveInstance-6258502 tempest-TestShelveInstance-6258502-project] Lock "1daf4f4c-0e4a-4779-b53a-78c48397ea2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120740) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 18:06:54.434259 dv-cinder-852009-8-iscsi devstack@n-api.service[120740]: DEBUG oslo_concurrency.lockutils [None req-7fb86029-ed19-41e1-b1c9-165f75578239 tempest-TestShelveInstance-6258502 tempest-TestShelveInstance-6258502-project] Acquiring lock "1daf4f4c-0e4a-4779-b53a-78c48397ea2f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120740) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 18:06:54.434889 dv-cinder-852009-8-iscsi devstack@n-api.service[120740]: DEBUG oslo_concurrency.lockutils [None req-7fb86029-ed19-41e1-b1c9-165f75578239 tempest-TestShelveInstance-6258502 tempest-TestShelveInstance-6258502-project] Lock "1daf4f4c-0e4a-4779-b53a-78c48397ea2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120740) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 18:06:54.435483 dv-cinder-852009-8-iscsi devstack@n-api.service[120740]: DEBUG oslo_concurrency.lockutils [None req-7fb86029-ed19-41e1-b1c9-165f75578239 tempest-TestShelveInstance-6258502 tempest-TestShelveInstance-6258502-project] Lock "1daf4f4c-0e4a-4779-b53a-78c48397ea2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120740) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 18:06:54.589148 dv-cinder-852009-8-iscsi devstack@n-api.service[120741]: DEBUG nova.policy [None req-a8e8b88d-aafd-47e0-b94c-bce7fa323afe tempest-TestMinimumBasicScenario-820002800 tempest-TestMinimumBasicScenario-820002800-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7880064ff0aa448d9c367c89eba145ff', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2f6832936c824066a4370cc45c5b0282', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120741) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 18:06:54.597959 dv-cinder-852009-8-iscsi devstack@n-api.service[120741]: INFO nova.api.openstack.requestlog [None req-a8e8b88d-aafd-47e0-b94c-bce7fa323afe tempest-TestMinimumBasicScenario-820002800 tempest-TestMinimumBasicScenario-820002800-project] 10.222.0.43 "GET /compute/v2.1/servers/f8247a13-94cd-45b2-acc8-8717e1260f37" status: 200 len: 1761 microversion: 2.1 time: 0.390474 Sep 13 18:06:54.598742 dv-cinder-852009-8-iscsi devstack@n-api.service[120741]: [pid: 120741|app: 0|req: 277/563] 10.222.0.43 () {58 vars in 1236 bytes} [Tue Sep 13 18:06:54 2022] GET /compute/v2.1/servers/f8247a13-94cd-45b2-acc8-8717e1260f37 => generated 1761 bytes in 392 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 13 18:06:54.738898 dv-cinder-852009-8-iscsi devstack@n-api.service[120740]: DEBUG nova.policy [None req-7fb86029-ed19-41e1-b1c9-165f75578239 tempest-TestShelveInstance-6258502 tempest-TestShelveInstance-6258502-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2ab9930d6ce54cacbb3d4fd6313294d5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5eafd54351bd4049b87ad308a3638f80', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120740) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 18:06:54.747134 dv-cinder-852009-8-iscsi devstack@n-api.service[120740]: INFO nova.api.openstack.requestlog [None req-7fb86029-ed19-41e1-b1c9-165f75578239 tempest-TestShelveInstance-6258502 tempest-TestShelveInstance-6258502-project] 10.222.0.43 "GET /compute/v2.1/servers/2d60cc6d-a699-417d-aa20-fe3e1bfc351e" status: 200 len: 1570 microversion: 2.1 time: 0.326321 Sep 13 18:06:54.747704 dv-cinder-852009-8-iscsi devstack@n-api.service[120740]: [pid: 120740|app: 0|req: 287/564] 10.222.0.43 () {58 vars in 1236 bytes} [Tue Sep 13 18:06:54 2022] GET /compute/v2.1/servers/2d60cc6d-a699-417d-aa20-fe3e1bfc351e => generated 1570 bytes in 328 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 13 18:06:54.863510 dv-cinder-852009-8-iscsi devstack@n-api.service[120741]: DEBUG nova.api.openstack.wsgi [None req-31a097cf-0846-482c-bdba-a987a48c71b9 tempest-AttachVolumeShelveTestJSON-385853788 tempest-AttachVolumeShelveTestJSON-385853788-project] Calling method '>' {{(pid=120741) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 18:06:54.864130 dv-cinder-852009-8-iscsi devstack@n-api.service[120741]: DEBUG nova.compute.api [None req-31a097cf-0846-482c-bdba-a987a48c71b9 tempest-AttachVolumeShelveTestJSON-385853788 tempest-AttachVolumeShelveTestJSON-385853788-project] [instance: 8cecf08e-bea8-4cef-9439-0eaa242bfed1] Fetching instance by UUID {{(pid=120741) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 18:06:54.870756 dv-cinder-852009-8-iscsi devstack@n-api.service[120741]: DEBUG oslo_concurrency.lockutils [None req-31a097cf-0846-482c-bdba-a987a48c71b9 tempest-AttachVolumeShelveTestJSON-385853788 tempest-AttachVolumeShelveTestJSON-385853788-project] Acquiring lock "1daf4f4c-0e4a-4779-b53a-78c48397ea2f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120741) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 18:06:54.871242 dv-cinder-852009-8-iscsi devstack@n-api.service[120741]: DEBUG oslo_concurrency.lockutils [None req-31a097cf-0846-482c-bdba-a987a48c71b9 tempest-AttachVolumeShelveTestJSON-385853788 tempest-AttachVolumeShelveTestJSON-385853788-project] Lock "1daf4f4c-0e4a-4779-b53a-78c48397ea2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120741) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 18:06:54.871673 dv-cinder-852009-8-iscsi devstack@n-api.service[120741]: DEBUG oslo_concurrency.lockutils [None req-31a097cf-0846-482c-bdba-a987a48c71b9 tempest-AttachVolumeShelveTestJSON-385853788 tempest-AttachVolumeShelveTestJSON-385853788-project] Lock "1daf4f4c-0e4a-4779-b53a-78c48397ea2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120741) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 18:06:54.872380 dv-cinder-852009-8-iscsi devstack@n-api.service[120741]: DEBUG oslo_concurrency.lockutils [None req-31a097cf-0846-482c-bdba-a987a48c71b9 tempest-AttachVolumeShelveTestJSON-385853788 tempest-AttachVolumeShelveTestJSON-385853788-project] Acquiring lock "1daf4f4c-0e4a-4779-b53a-78c48397ea2f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120741) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 18:06:54.872863 dv-cinder-852009-8-iscsi devstack@n-api.service[120741]: DEBUG oslo_concurrency.lockutils [None req-31a097cf-0846-482c-bdba-a987a48c71b9 tempest-AttachVolumeShelveTestJSON-385853788 tempest-AttachVolumeShelveTestJSON-385853788-project] Lock "1daf4f4c-0e4a-4779-b53a-78c48397ea2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120741) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 18:06:54.873287 dv-cinder-852009-8-iscsi devstack@n-api.service[120741]: DEBUG oslo_concurrency.lockutils [None req-31a097cf-0846-482c-bdba-a987a48c71b9 tempest-AttachVolumeShelveTestJSON-385853788 tempest-AttachVolumeShelveTestJSON-385853788-project] Lock "1daf4f4c-0e4a-4779-b53a-78c48397ea2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120741) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 18:06:54.877930 dv-cinder-852009-8-iscsi devstack@n-api.service[120741]: DEBUG dbcounter [-] [120741] Writing DB stats nova_cell1:SELECT=100 {{(pid=120741) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 18:06:55.009753 dv-cinder-852009-8-iscsi devstack@n-api.service[120741]: DEBUG nova.policy [None req-31a097cf-0846-482c-bdba-a987a48c71b9 tempest-AttachVolumeShelveTestJSON-385853788 tempest-AttachVolumeShelveTestJSON-385853788-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e68ecd9b3ca643539b109f75bb242d6f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '75e14fd88bfb4cd896fa7b070a0fac47', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120741) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 18:06:55.018329 dv-cinder-852009-8-iscsi devstack@n-api.service[120741]: DEBUG nova.policy [None req-31a097cf-0846-482c-bdba-a987a48c71b9 tempest-AttachVolumeShelveTestJSON-385853788 tempest-AttachVolumeShelveTestJSON-385853788-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'e68ecd9b3ca643539b109f75bb242d6f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '75e14fd88bfb4cd896fa7b070a0fac47', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120741) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 18:06:55.020041 dv-cinder-852009-8-iscsi devstack@n-api.service[120741]: DEBUG nova.policy [None req-31a097cf-0846-482c-bdba-a987a48c71b9 tempest-AttachVolumeShelveTestJSON-385853788 tempest-AttachVolumeShelveTestJSON-385853788-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'e68ecd9b3ca643539b109f75bb242d6f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '75e14fd88bfb4cd896fa7b070a0fac47', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120741) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 18:06:55.021190 dv-cinder-852009-8-iscsi devstack@n-api.service[120741]: INFO nova.api.openstack.requestlog [None req-31a097cf-0846-482c-bdba-a987a48c71b9 tempest-AttachVolumeShelveTestJSON-385853788 tempest-AttachVolumeShelveTestJSON-385853788-project] 10.222.0.43 "GET /compute/v2.1/servers/8cecf08e-bea8-4cef-9439-0eaa242bfed1" status: 200 len: 1722 microversion: 2.20 time: 0.163169 Sep 13 18:06:55.024477 dv-cinder-852009-8-iscsi devstack@n-api.service[120741]: [pid: 120741|app: 0|req: 278/565] 10.222.0.43 () {60 vars in 1277 bytes} [Tue Sep 13 18:06:54 2022] GET /compute/v2.1/servers/8cecf08e-bea8-4cef-9439-0eaa242bfed1 => generated 1722 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 13 18:06:55.770671 dv-cinder-852009-8-iscsi devstack@n-api.service[120740]: DEBUG nova.api.openstack.wsgi [None req-84005449-5b29-401b-a7a3-21e9f4de3288 tempest-TestShelveInstance-6258502 tempest-TestShelveInstance-6258502-project] Calling method '>' {{(pid=120740) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 18:06:55.771240 dv-cinder-852009-8-iscsi devstack@n-api.service[120740]: DEBUG nova.compute.api [None req-84005449-5b29-401b-a7a3-21e9f4de3288 tempest-TestShelveInstance-6258502 tempest-TestShelveInstance-6258502-project] [instance: 2d60cc6d-a699-417d-aa20-fe3e1bfc351e] Fetching instance by UUID {{(pid=120740) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 18:06:55.777899 dv-cinder-852009-8-iscsi devstack@n-api.service[120740]: DEBUG oslo_concurrency.lockutils [None req-84005449-5b29-401b-a7a3-21e9f4de3288 tempest-TestShelveInstance-6258502 tempest-TestShelveInstance-6258502-project] Acquiring lock "1daf4f4c-0e4a-4779-b53a-78c48397ea2f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120740) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 18:06:55.778383 dv-cinder-852009-8-iscsi devstack@n-api.service[120740]: DEBUG oslo_concurrency.lockutils [None req-84005449-5b29-401b-a7a3-21e9f4de3288 tempest-TestShelveInstance-6258502 tempest-TestShelveInstance-6258502-project] Lock "1daf4f4c-0e4a-4779-b53a-78c48397ea2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120740) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 18:06:55.778806 dv-cinder-852009-8-iscsi devstack@n-api.service[120740]: DEBUG oslo_concurrency.lockutils [None req-84005449-5b29-401b-a7a3-21e9f4de3288 tempest-TestShelveInstance-6258502 tempest-TestShelveInstance-6258502-project] Lock "1daf4f4c-0e4a-4779-b53a-78c48397ea2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120740) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 18:06:55.779468 dv-cinder-852009-8-iscsi devstack@n-api.service[120740]: DEBUG oslo_concurrency.lockutils [None req-84005449-5b29-401b-a7a3-21e9f4de3288 tempest-TestShelveInstance-6258502 tempest-TestShelveInstance-6258502-project] Acquiring lock "1daf4f4c-0e4a-4779-b53a-78c48397ea2f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120740) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 18:06:55.779923 dv-cinder-852009-8-iscsi devstack@n-api.service[120740]: DEBUG oslo_concurrency.lockutils [None req-84005449-5b29-401b-a7a3-21e9f4de3288 tempest-TestShelveInstance-6258502 tempest-TestShelveInstance-6258502-project] Lock "1daf4f4c-0e4a-4779-b53a-78c48397ea2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120740) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 18:06:55.780364 dv-cinder-852009-8-iscsi devstack@n-api.service[120740]: DEBUG oslo_concurrency.lockutils [None req-84005449-5b29-401b-a7a3-21e9f4de3288 tempest-TestShelveInstance-6258502 tempest-TestShelveInstance-6258502-project] Lock "1daf4f4c-0e4a-4779-b53a-78c48397ea2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120740) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 18:06:55.918388 dv-cinder-852009-8-iscsi devstack@n-api.service[120740]: DEBUG nova.policy [None req-84005449-5b29-401b-a7a3-21e9f4de3288 tempest-TestShelveInstance-6258502 tempest-TestShelveInstance-6258502-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2ab9930d6ce54cacbb3d4fd6313294d5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5eafd54351bd4049b87ad308a3638f80', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120740) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 18:06:55.928744 dv-cinder-852009-8-iscsi devstack@n-api.service[120740]: INFO nova.api.openstack.requestlog [None req-84005449-5b29-401b-a7a3-21e9f4de3288 tempest-TestShelveInstance-6258502 tempest-TestShelveInstance-6258502-project] 10.222.0.43 "GET /compute/v2.1/servers/2d60cc6d-a699-417d-aa20-fe3e1bfc351e" status: 200 len: 1570 microversion: 2.1 time: 0.161544 Sep 13 18:06:55.929544 dv-cinder-852009-8-iscsi devstack@n-api.service[120740]: [pid: 120740|app: 0|req: 288/566] 10.222.0.43 () {58 vars in 1236 bytes} [Tue Sep 13 18:06:55 2022] GET /compute/v2.1/servers/2d60cc6d-a699-417d-aa20-fe3e1bfc351e => generated 1570 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 13 18:06:56.047786 dv-cinder-852009-8-iscsi devstack@n-api.service[120741]: DEBUG nova.api.openstack.wsgi [None req-9a0efe15-9199-46c1-aaca-9dfc8e03cf50 tempest-AttachVolumeShelveTestJSON-385853788 tempest-AttachVolumeShelveTestJSON-385853788-project] Calling method '>' {{(pid=120741) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 18:06:56.048396 dv-cinder-852009-8-iscsi devstack@n-api.service[120741]: DEBUG nova.compute.api [None req-9a0efe15-9199-46c1-aaca-9dfc8e03cf50 tempest-AttachVolumeShelveTestJSON-385853788 tempest-AttachVolumeShelveTestJSON-385853788-project] [instance: 8cecf08e-bea8-4cef-9439-0eaa242bfed1] Fetching instance by UUID {{(pid=120741) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 18:06:56.055383 dv-cinder-852009-8-iscsi devstack@n-api.service[120741]: DEBUG oslo_concurrency.lockutils [None req-9a0efe15-9199-46c1-aaca-9dfc8e03cf50 tempest-AttachVolumeShelveTestJSON-385853788 tempest-AttachVolumeShelveTestJSON-385853788-project] Acquiring lock "1daf4f4c-0e4a-4779-b53a-78c48397ea2f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120741) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 18:06:56.055884 dv-cinder-852009-8-iscsi devstack@n-api.service[120741]: DEBUG oslo_concurrency.lockutils [None req-9a0efe15-9199-46c1-aaca-9dfc8e03cf50 tempest-AttachVolumeShelveTestJSON-385853788 tempest-AttachVolumeShelveTestJSON-385853788-project] Lock "1daf4f4c-0e4a-4779-b53a-78c48397ea2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120741) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 18:06:56.056471 dv-cinder-852009-8-iscsi devstack@n-api.service[120741]: DEBUG oslo_concurrency.lockutils [None req-9a0efe15-9199-46c1-aaca-9dfc8e03cf50 tempest-AttachVolumeShelveTestJSON-385853788 tempest-AttachVolumeShelveTestJSON-385853788-project] Lock "1daf4f4c-0e4a-4779-b53a-78c48397ea2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120741) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 18:06:56.057204 dv-cinder-852009-8-iscsi devstack@n-api.service[120741]: DEBUG oslo_concurrency.lockutils [None req-9a0efe15-9199-46c1-aaca-9dfc8e03cf50 tempest-AttachVolumeShelveTestJSON-385853788 tempest-AttachVolumeShelveTestJSON-385853788-project] Acquiring lock "1daf4f4c-0e4a-4779-b53a-78c48397ea2f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120741) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 18:06:56.057706 dv-cinder-852009-8-iscsi devstack@n-api.service[120741]: DEBUG oslo_concurrency.lockutils [None req-9a0efe15-9199-46c1-aaca-9dfc8e03cf50 tempest-AttachVolumeShelveTestJSON-385853788 tempest-AttachVolumeShelveTestJSON-385853788-project] Lock "1daf4f4c-0e4a-4779-b53a-78c48397ea2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120741) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 18:06:56.058154 dv-cinder-852009-8-iscsi devstack@n-api.service[120741]: DEBUG oslo_concurrency.lockutils [None req-9a0efe15-9199-46c1-aaca-9dfc8e03cf50 tempest-AttachVolumeShelveTestJSON-385853788 tempest-AttachVolumeShelveTestJSON-385853788-project] Lock "1daf4f4c-0e4a-4779-b53a-78c48397ea2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120741) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 18:06:56.192970 dv-cinder-852009-8-iscsi devstack@n-api.service[120741]: DEBUG nova.policy [None req-9a0efe15-9199-46c1-aaca-9dfc8e03cf50 tempest-AttachVolumeShelveTestJSON-385853788 tempest-AttachVolumeShelveTestJSON-385853788-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e68ecd9b3ca643539b109f75bb242d6f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '75e14fd88bfb4cd896fa7b070a0fac47', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120741) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 18:06:56.201181 dv-cinder-852009-8-iscsi devstack@n-api.service[120741]: DEBUG nova.policy [None req-9a0efe15-9199-46c1-aaca-9dfc8e03cf50 tempest-AttachVolumeShelveTestJSON-385853788 tempest-AttachVolumeShelveTestJSON-385853788-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'e68ecd9b3ca643539b109f75bb242d6f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '75e14fd88bfb4cd896fa7b070a0fac47', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120741) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 18:06:56.202603 dv-cinder-852009-8-iscsi devstack@n-api.service[120741]: DEBUG nova.policy [None req-9a0efe15-9199-46c1-aaca-9dfc8e03cf50 tempest-AttachVolumeShelveTestJSON-385853788 tempest-AttachVolumeShelveTestJSON-385853788-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'e68ecd9b3ca643539b109f75bb242d6f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '75e14fd88bfb4cd896fa7b070a0fac47', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120741) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 18:06:56.203770 dv-cinder-852009-8-iscsi devstack@n-api.service[120741]: INFO nova.api.openstack.requestlog [None req-9a0efe15-9199-46c1-aaca-9dfc8e03cf50 tempest-AttachVolumeShelveTestJSON-385853788 tempest-AttachVolumeShelveTestJSON-385853788-project] 10.222.0.43 "GET /compute/v2.1/servers/8cecf08e-bea8-4cef-9439-0eaa242bfed1" status: 200 len: 1722 microversion: 2.20 time: 0.160468 Sep 13 18:06:56.204333 dv-cinder-852009-8-iscsi devstack@n-api.service[120741]: [pid: 120741|app: 0|req: 279/567] 10.222.0.43 () {60 vars in 1277 bytes} [Tue Sep 13 18:06:56 2022] GET /compute/v2.1/servers/8cecf08e-bea8-4cef-9439-0eaa242bfed1 => generated 1722 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 13 18:06:56.957020 dv-cinder-852009-8-iscsi devstack@n-api.service[120740]: DEBUG nova.api.openstack.wsgi [None req-6ef79e53-da4c-4a6b-9a2d-bae5253b8fd2 tempest-TestShelveInstance-6258502 tempest-TestShelveInstance-6258502-project] Calling method '>' {{(pid=120740) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 18:06:56.958098 dv-cinder-852009-8-iscsi devstack@n-api.service[120740]: DEBUG nova.compute.api [None req-6ef79e53-da4c-4a6b-9a2d-bae5253b8fd2 tempest-TestShelveInstance-6258502 tempest-TestShelveInstance-6258502-project] [instance: 2d60cc6d-a699-417d-aa20-fe3e1bfc351e] Fetching instance by UUID {{(pid=120740) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 18:06:56.966178 dv-cinder-852009-8-iscsi devstack@n-api.service[120740]: DEBUG oslo_concurrency.lockutils [None req-6ef79e53-da4c-4a6b-9a2d-bae5253b8fd2 tempest-TestShelveInstance-6258502 tempest-TestShelveInstance-6258502-project] Acquiring lock "1daf4f4c-0e4a-4779-b53a-78c48397ea2f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120740) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 18:06:56.966669 dv-cinder-852009-8-iscsi devstack@n-api.service[120740]: DEBUG oslo_concurrency.lockutils [None req-6ef79e53-da4c-4a6b-9a2d-bae5253b8fd2 tempest-TestShelveInstance-6258502 tempest-TestShelveInstance-6258502-project] Lock "1daf4f4c-0e4a-4779-b53a-78c48397ea2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120740) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 18:06:56.967104 dv-cinder-852009-8-iscsi devstack@n-api.service[120740]: DEBUG oslo_concurrency.lockutils [None req-6ef79e53-da4c-4a6b-9a2d-bae5253b8fd2 tempest-TestShelveInstance-6258502 tempest-TestShelveInstance-6258502-project] Lock "1daf4f4c-0e4a-4779-b53a-78c48397ea2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120740) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 18:06:56.967806 dv-cinder-852009-8-iscsi devstack@n-api.service[120740]: DEBUG oslo_concurrency.lockutils [None req-6ef79e53-da4c-4a6b-9a2d-bae5253b8fd2 tempest-TestShelveInstance-6258502 tempest-TestShelveInstance-6258502-project] Acquiring lock "1daf4f4c-0e4a-4779-b53a-78c48397ea2f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120740) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 18:06:56.968250 dv-cinder-852009-8-iscsi devstack@n-api.service[120740]: DEBUG oslo_concurrency.lockutils [None req-6ef79e53-da4c-4a6b-9a2d-bae5253b8fd2 tempest-TestShelveInstance-6258502 tempest-TestShelveInstance-6258502-project] Lock "1daf4f4c-0e4a-4779-b53a-78c48397ea2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120740) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 18:06:56.968722 dv-cinder-852009-8-iscsi devstack@n-api.service[120740]: DEBUG oslo_concurrency.lockutils [None req-6ef79e53-da4c-4a6b-9a2d-bae5253b8fd2 tempest-TestShelveInstance-6258502 tempest-TestShelveInstance-6258502-project] Lock "1daf4f4c-0e4a-4779-b53a-78c48397ea2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120740) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 18:06:57.101642 dv-cinder-852009-8-iscsi devstack@n-api.service[120740]: DEBUG nova.policy [None req-6ef79e53-da4c-4a6b-9a2d-bae5253b8fd2 tempest-TestShelveInstance-6258502 tempest-TestShelveInstance-6258502-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2ab9930d6ce54cacbb3d4fd6313294d5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5eafd54351bd4049b87ad308a3638f80', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120740) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 18:06:57.113682 dv-cinder-852009-8-iscsi devstack@n-api.service[120740]: INFO nova.api.openstack.requestlog [None req-6ef79e53-da4c-4a6b-9a2d-bae5253b8fd2 tempest-TestShelveInstance-6258502 tempest-TestShelveInstance-6258502-project] 10.222.0.43 "GET /compute/v2.1/servers/2d60cc6d-a699-417d-aa20-fe3e1bfc351e" status: 200 len: 1570 microversion: 2.1 time: 0.163180 Sep 13 18:06:57.114470 dv-cinder-852009-8-iscsi devstack@n-api.service[120740]: [pid: 120740|app: 0|req: 289/568] 10.222.0.43 () {58 vars in 1236 bytes} [Tue Sep 13 18:06:56 2022] GET /compute/v2.1/servers/2d60cc6d-a699-417d-aa20-fe3e1bfc351e => generated 1570 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 13 18:06:57.232129 dv-cinder-852009-8-iscsi devstack@n-api.service[120741]: DEBUG nova.api.openstack.wsgi [None req-3e248aa8-fdd5-498f-b4cf-6e70825a82c9 tempest-AttachVolumeShelveTestJSON-385853788 tempest-AttachVolumeShelveTestJSON-385853788-project] Calling method '>' {{(pid=120741) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 18:06:57.233075 dv-cinder-852009-8-iscsi devstack@n-api.service[120741]: DEBUG nova.compute.api [None req-3e248aa8-fdd5-498f-b4cf-6e70825a82c9 tempest-AttachVolumeShelveTestJSON-385853788 tempest-AttachVolumeShelveTestJSON-385853788-project] [instance: 8cecf08e-bea8-4cef-9439-0eaa242bfed1] Fetching instance by UUID {{(pid=120741) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 18:06:57.239918 dv-cinder-852009-8-iscsi devstack@n-api.service[120741]: DEBUG oslo_concurrency.lockutils [None req-3e248aa8-fdd5-498f-b4cf-6e70825a82c9 tempest-AttachVolumeShelveTestJSON-385853788 tempest-AttachVolumeShelveTestJSON-385853788-project] Acquiring lock "1daf4f4c-0e4a-4779-b53a-78c48397ea2f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120741) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 18:06:57.240404 dv-cinder-852009-8-iscsi devstack@n-api.service[120741]: DEBUG oslo_concurrency.lockutils [None req-3e248aa8-fdd5-498f-b4cf-6e70825a82c9 tempest-AttachVolumeShelveTestJSON-385853788 tempest-AttachVolumeShelveTestJSON-385853788-project] Lock "1daf4f4c-0e4a-4779-b53a-78c48397ea2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120741) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 18:06:57.240860 dv-cinder-852009-8-iscsi devstack@n-api.service[120741]: DEBUG oslo_concurrency.lockutils [None req-3e248aa8-fdd5-498f-b4cf-6e70825a82c9 tempest-AttachVolumeShelveTestJSON-385853788 tempest-AttachVolumeShelveTestJSON-385853788-project] Lock "1daf4f4c-0e4a-4779-b53a-78c48397ea2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120741) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 18:06:57.241574 dv-cinder-852009-8-iscsi devstack@n-api.service[120741]: DEBUG oslo_concurrency.lockutils [None req-3e248aa8-fdd5-498f-b4cf-6e70825a82c9 tempest-AttachVolumeShelveTestJSON-385853788 tempest-AttachVolumeShelveTestJSON-385853788-project] Acquiring lock "1daf4f4c-0e4a-4779-b53a-78c48397ea2f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120741) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 18:06:57.242013 dv-cinder-852009-8-iscsi devstack@n-api.service[120741]: DEBUG oslo_concurrency.lockutils [None req-3e248aa8-fdd5-498f-b4cf-6e70825a82c9 tempest-AttachVolumeShelveTestJSON-385853788 tempest-AttachVolumeShelveTestJSON-385853788-project] Lock "1daf4f4c-0e4a-4779-b53a-78c48397ea2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120741) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 18:06:57.242434 dv-cinder-852009-8-iscsi devstack@n-api.service[120741]: DEBUG oslo_concurrency.lockutils [None req-3e248aa8-fdd5-498f-b4cf-6e70825a82c9 tempest-AttachVolumeShelveTestJSON-385853788 tempest-AttachVolumeShelveTestJSON-385853788-project] Lock "1daf4f4c-0e4a-4779-b53a-78c48397ea2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120741) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 18:06:57.258959 dv-cinder-852009-8-iscsi devstack@n-api.service[120740]: DEBUG nova.api.openstack.wsgi [None req-648737a1-66fd-4c1a-8cbc-a4a2a44f5ecb tempest-VolumesTestJSON-1311478007 tempest-VolumesTestJSON-1311478007-project] Calling method '.version_select at 0x7fa626b1a310>' {{(pid=120740) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 18:06:57.306516 dv-cinder-852009-8-iscsi devstack@n-api.service[120740]: INFO nova.api.openstack.requestlog [None req-648737a1-66fd-4c1a-8cbc-a4a2a44f5ecb tempest-VolumesTestJSON-1311478007 tempest-VolumesTestJSON-1311478007-project] 10.222.0.43 "GET /compute/v2.1/os-volumes/6b82306d-72fb-4ad1-8e76-3d601eabe21c" status: 200 len: 350 microversion: 2.1 time: 0.051423 Sep 13 18:06:57.307410 dv-cinder-852009-8-iscsi devstack@n-api.service[120740]: [pid: 120740|app: 0|req: 290/569] 10.222.0.43 () {58 vars in 1245 bytes} [Tue Sep 13 18:06:57 2022] GET /compute/v2.1/os-volumes/6b82306d-72fb-4ad1-8e76-3d601eabe21c => generated 350 bytes in 53 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 13 18:06:57.382292 dv-cinder-852009-8-iscsi devstack@n-api.service[120741]: DEBUG nova.policy [None req-3e248aa8-fdd5-498f-b4cf-6e70825a82c9 tempest-AttachVolumeShelveTestJSON-385853788 tempest-AttachVolumeShelveTestJSON-385853788-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e68ecd9b3ca643539b109f75bb242d6f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '75e14fd88bfb4cd896fa7b070a0fac47', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120741) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 18:06:57.390472 dv-cinder-852009-8-iscsi devstack@n-api.service[120741]: DEBUG nova.policy [None req-3e248aa8-fdd5-498f-b4cf-6e70825a82c9 tempest-AttachVolumeShelveTestJSON-385853788 tempest-AttachVolumeShelveTestJSON-385853788-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'e68ecd9b3ca643539b109f75bb242d6f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '75e14fd88bfb4cd896fa7b070a0fac47', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120741) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 18:06:57.392115 dv-cinder-852009-8-iscsi devstack@n-api.service[120741]: DEBUG nova.policy [None req-3e248aa8-fdd5-498f-b4cf-6e70825a82c9 tempest-AttachVolumeShelveTestJSON-385853788 tempest-AttachVolumeShelveTestJSON-385853788-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'e68ecd9b3ca643539b109f75bb242d6f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '75e14fd88bfb4cd896fa7b070a0fac47', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120741) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 18:06:57.393293 dv-cinder-852009-8-iscsi devstack@n-api.service[120741]: INFO nova.api.openstack.requestlog [None req-3e248aa8-fdd5-498f-b4cf-6e70825a82c9 tempest-AttachVolumeShelveTestJSON-385853788 tempest-AttachVolumeShelveTestJSON-385853788-project] 10.222.0.43 "GET /compute/v2.1/servers/8cecf08e-bea8-4cef-9439-0eaa242bfed1" status: 200 len: 1722 microversion: 2.20 time: 0.165191 Sep 13 18:06:57.393848 dv-cinder-852009-8-iscsi devstack@n-api.service[120741]: [pid: 120741|app: 0|req: 280/570] 10.222.0.43 () {60 vars in 1277 bytes} [Tue Sep 13 18:06:57 2022] GET /compute/v2.1/servers/8cecf08e-bea8-4cef-9439-0eaa242bfed1 => generated 1722 bytes in 166 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 13 18:06:58.143008 dv-cinder-852009-8-iscsi devstack@n-api.service[120740]: DEBUG nova.api.openstack.wsgi [None req-bee4da5b-62df-4dd5-82a8-11e9b0278c5a tempest-TestShelveInstance-6258502 tempest-TestShelveInstance-6258502-project] Calling method '>' {{(pid=120740) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 18:06:58.143999 dv-cinder-852009-8-iscsi devstack@n-api.service[120740]: DEBUG nova.compute.api [None req-bee4da5b-62df-4dd5-82a8-11e9b0278c5a tempest-TestShelveInstance-6258502 tempest-TestShelveInstance-6258502-project] [instance: 2d60cc6d-a699-417d-aa20-fe3e1bfc351e] Fetching instance by UUID {{(pid=120740) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 18:06:58.154312 dv-cinder-852009-8-iscsi devstack@n-api.service[120740]: DEBUG oslo_concurrency.lockutils [None req-bee4da5b-62df-4dd5-82a8-11e9b0278c5a tempest-TestShelveInstance-6258502 tempest-TestShelveInstance-6258502-project] Acquiring lock "1daf4f4c-0e4a-4779-b53a-78c48397ea2f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120740) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 18:06:58.155111 dv-cinder-852009-8-iscsi devstack@n-api.service[120740]: DEBUG oslo_concurrency.lockutils [None req-bee4da5b-62df-4dd5-82a8-11e9b0278c5a tempest-TestShelveInstance-6258502 tempest-TestShelveInstance-6258502-project] Lock "1daf4f4c-0e4a-4779-b53a-78c48397ea2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120740) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 18:06:58.155824 dv-cinder-852009-8-iscsi devstack@n-api.service[120740]: DEBUG oslo_concurrency.lockutils [None req-bee4da5b-62df-4dd5-82a8-11e9b0278c5a tempest-TestShelveInstance-6258502 tempest-TestShelveInstance-6258502-project] Lock "1daf4f4c-0e4a-4779-b53a-78c48397ea2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120740) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 18:06:58.157019 dv-cinder-852009-8-iscsi devstack@n-api.service[120740]: DEBUG oslo_concurrency.lockutils [None req-bee4da5b-62df-4dd5-82a8-11e9b0278c5a tempest-TestShelveInstance-6258502 tempest-TestShelveInstance-6258502-project] Acquiring lock "1daf4f4c-0e4a-4779-b53a-78c48397ea2f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120740) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 18:06:58.157765 dv-cinder-852009-8-iscsi devstack@n-api.service[120740]: DEBUG oslo_concurrency.lockutils [None req-bee4da5b-62df-4dd5-82a8-11e9b0278c5a tempest-TestShelveInstance-6258502 tempest-TestShelveInstance-6258502-project] Lock "1daf4f4c-0e4a-4779-b53a-78c48397ea2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120740) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 18:06:58.158458 dv-cinder-852009-8-iscsi devstack@n-api.service[120740]: DEBUG oslo_concurrency.lockutils [None req-bee4da5b-62df-4dd5-82a8-11e9b0278c5a tempest-TestShelveInstance-6258502 tempest-TestShelveInstance-6258502-project] Lock "1daf4f4c-0e4a-4779-b53a-78c48397ea2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120740) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 18:06:58.298424 dv-cinder-852009-8-iscsi devstack@n-api.service[120740]: DEBUG nova.policy [None req-bee4da5b-62df-4dd5-82a8-11e9b0278c5a tempest-TestShelveInstance-6258502 tempest-TestShelveInstance-6258502-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2ab9930d6ce54cacbb3d4fd6313294d5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5eafd54351bd4049b87ad308a3638f80', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120740) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 18:06:58.318120 dv-cinder-852009-8-iscsi devstack@n-api.service[120740]: INFO nova.api.openstack.requestlog [None req-bee4da5b-62df-4dd5-82a8-11e9b0278c5a tempest-TestShelveInstance-6258502 tempest-TestShelveInstance-6258502-project] 10.222.0.43 "GET /compute/v2.1/servers/2d60cc6d-a699-417d-aa20-fe3e1bfc351e" status: 200 len: 1570 microversion: 2.1 time: 0.182186 Sep 13 18:06:58.319027 dv-cinder-852009-8-iscsi devstack@n-api.service[120740]: [pid: 120740|app: 0|req: 291/571] 10.222.0.43 () {58 vars in 1236 bytes} [Tue Sep 13 18:06:58 2022] GET /compute/v2.1/servers/2d60cc6d-a699-417d-aa20-fe3e1bfc351e => generated 1570 bytes in 184 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 13 18:06:58.418847 dv-cinder-852009-8-iscsi devstack@n-api.service[120741]: DEBUG nova.api.openstack.wsgi [None req-ce79d2cc-63c8-483d-8337-1fc20e6199b0 tempest-AttachVolumeShelveTestJSON-385853788 tempest-AttachVolumeShelveTestJSON-385853788-project] Calling method '>' {{(pid=120741) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 18:06:58.419444 dv-cinder-852009-8-iscsi devstack@n-api.service[120741]: DEBUG nova.compute.api [None req-ce79d2cc-63c8-483d-8337-1fc20e6199b0 tempest-AttachVolumeShelveTestJSON-385853788 tempest-AttachVolumeShelveTestJSON-385853788-project] [instance: 8cecf08e-bea8-4cef-9439-0eaa242bfed1] Fetching instance by UUID {{(pid=120741) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 18:06:58.426314 dv-cinder-852009-8-iscsi devstack@n-api.service[120741]: DEBUG oslo_concurrency.lockutils [None req-ce79d2cc-63c8-483d-8337-1fc20e6199b0 tempest-AttachVolumeShelveTestJSON-385853788 tempest-AttachVolumeShelveTestJSON-385853788-project] Acquiring lock "1daf4f4c-0e4a-4779-b53a-78c48397ea2f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120741) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 18:06:58.426792 dv-cinder-852009-8-iscsi devstack@n-api.service[120741]: DEBUG oslo_concurrency.lockutils [None req-ce79d2cc-63c8-483d-8337-1fc20e6199b0 tempest-AttachVolumeShelveTestJSON-385853788 tempest-AttachVolumeShelveTestJSON-385853788-project] Lock "1daf4f4c-0e4a-4779-b53a-78c48397ea2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120741) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 18:06:58.427215 dv-cinder-852009-8-iscsi devstack@n-api.service[120741]: DEBUG oslo_concurrency.lockutils [None req-ce79d2cc-63c8-483d-8337-1fc20e6199b0 tempest-AttachVolumeShelveTestJSON-385853788 tempest-AttachVolumeShelveTestJSON-385853788-project] Lock "1daf4f4c-0e4a-4779-b53a-78c48397ea2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120741) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 18:06:58.427897 dv-cinder-852009-8-iscsi devstack@n-api.service[120741]: DEBUG oslo_concurrency.lockutils [None req-ce79d2cc-63c8-483d-8337-1fc20e6199b0 tempest-AttachVolumeShelveTestJSON-385853788 tempest-AttachVolumeShelveTestJSON-385853788-project] Acquiring lock "1daf4f4c-0e4a-4779-b53a-78c48397ea2f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120741) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 18:06:58.428335 dv-cinder-852009-8-iscsi devstack@n-api.service[120741]: DEBUG oslo_concurrency.lockutils [None req-ce79d2cc-63c8-483d-8337-1fc20e6199b0 tempest-AttachVolumeShelveTestJSON-385853788 tempest-AttachVolumeShelveTestJSON-385853788-project] Lock "1daf4f4c-0e4a-4779-b53a-78c48397ea2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120741) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 18:06:58.428884 dv-cinder-852009-8-iscsi devstack@n-api.service[120741]: DEBUG oslo_concurrency.lockutils [None req-ce79d2cc-63c8-483d-8337-1fc20e6199b0 tempest-AttachVolumeShelveTestJSON-385853788 tempest-AttachVolumeShelveTestJSON-385853788-project] Lock "1daf4f4c-0e4a-4779-b53a-78c48397ea2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120741) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 18:06:58.564107 dv-cinder-852009-8-iscsi devstack@n-api.service[120741]: DEBUG nova.policy [None req-ce79d2cc-63c8-483d-8337-1fc20e6199b0 tempest-AttachVolumeShelveTestJSON-385853788 tempest-AttachVolumeShelveTestJSON-385853788-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e68ecd9b3ca643539b109f75bb242d6f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '75e14fd88bfb4cd896fa7b070a0fac47', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120741) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 18:06:58.572204 dv-cinder-852009-8-iscsi devstack@n-api.service[120741]: DEBUG nova.policy [None req-ce79d2cc-63c8-483d-8337-1fc20e6199b0 tempest-AttachVolumeShelveTestJSON-385853788 tempest-AttachVolumeShelveTestJSON-385853788-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'e68ecd9b3ca643539b109f75bb242d6f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '75e14fd88bfb4cd896fa7b070a0fac47', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120741) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 18:06:58.573654 dv-cinder-852009-8-iscsi devstack@n-api.service[120741]: DEBUG nova.policy [None req-ce79d2cc-63c8-483d-8337-1fc20e6199b0 tempest-AttachVolumeShelveTestJSON-385853788 tempest-AttachVolumeShelveTestJSON-385853788-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'e68ecd9b3ca643539b109f75bb242d6f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '75e14fd88bfb4cd896fa7b070a0fac47', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120741) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 18:06:58.574802 dv-cinder-852009-8-iscsi devstack@n-api.service[120741]: INFO nova.api.openstack.requestlog [None req-ce79d2cc-63c8-483d-8337-1fc20e6199b0 tempest-AttachVolumeShelveTestJSON-385853788 tempest-AttachVolumeShelveTestJSON-385853788-project] 10.222.0.43 "GET /compute/v2.1/servers/8cecf08e-bea8-4cef-9439-0eaa242bfed1" status: 200 len: 1722 microversion: 2.20 time: 0.159986 Sep 13 18:06:58.575328 dv-cinder-852009-8-iscsi devstack@n-api.service[120741]: [pid: 120741|app: 0|req: 281/572] 10.222.0.43 () {60 vars in 1277 bytes} [Tue Sep 13 18:06:58 2022] GET /compute/v2.1/servers/8cecf08e-bea8-4cef-9439-0eaa242bfed1 => generated 1722 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 13 18:06:58.657287 dv-cinder-852009-8-iscsi devstack@n-api.service[120740]: DEBUG nova.api.openstack.wsgi [None req-e59717ef-e602-43e4-ae3b-f382c42355bb tempest-VolumesTestJSON-1311478007 tempest-VolumesTestJSON-1311478007-project] Calling method '.version_select at 0x7fa626abfb80>' {{(pid=120740) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 18:06:58.709137 dv-cinder-852009-8-iscsi devstack@n-api.service[120740]: INFO nova.api.openstack.requestlog [None req-e59717ef-e602-43e4-ae3b-f382c42355bb tempest-VolumesTestJSON-1311478007 tempest-VolumesTestJSON-1311478007-project] 10.222.0.43 "GET /compute/v2.1/os-volumes/8b129166-19bc-4c85-a46a-920c6cb3e9a2" status: 200 len: 351 microversion: 2.1 time: 0.055996 Sep 13 18:06:58.709782 dv-cinder-852009-8-iscsi devstack@n-api.service[120740]: [pid: 120740|app: 0|req: 292/573] 10.222.0.43 () {58 vars in 1245 bytes} [Tue Sep 13 18:06:58 2022] GET /compute/v2.1/os-volumes/8b129166-19bc-4c85-a46a-920c6cb3e9a2 => generated 351 bytes in 57 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 13 18:06:59.347249 dv-cinder-852009-8-iscsi devstack@n-api.service[120741]: DEBUG nova.api.openstack.wsgi [None req-8c564a97-9851-4903-b414-4db6537c9493 tempest-TestShelveInstance-6258502 tempest-TestShelveInstance-6258502-project] Calling method '>' {{(pid=120741) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 18:06:59.348348 dv-cinder-852009-8-iscsi devstack@n-api.service[120741]: DEBUG nova.compute.api [None req-8c564a97-9851-4903-b414-4db6537c9493 tempest-TestShelveInstance-6258502 tempest-TestShelveInstance-6258502-project] [instance: 2d60cc6d-a699-417d-aa20-fe3e1bfc351e] Fetching instance by UUID {{(pid=120741) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 18:06:59.358864 dv-cinder-852009-8-iscsi devstack@n-api.service[120741]: DEBUG oslo_concurrency.lockutils [None req-8c564a97-9851-4903-b414-4db6537c9493 tempest-TestShelveInstance-6258502 tempest-TestShelveInstance-6258502-project] Acquiring lock "1daf4f4c-0e4a-4779-b53a-78c48397ea2f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120741) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 18:06:59.359711 dv-cinder-852009-8-iscsi devstack@n-api.service[120741]: DEBUG oslo_concurrency.lockutils [None req-8c564a97-9851-4903-b414-4db6537c9493 tempest-TestShelveInstance-6258502 tempest-TestShelveInstance-6258502-project] Lock "1daf4f4c-0e4a-4779-b53a-78c48397ea2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120741) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 18:06:59.360469 dv-cinder-852009-8-iscsi devstack@n-api.service[120741]: DEBUG oslo_concurrency.lockutils [None req-8c564a97-9851-4903-b414-4db6537c9493 tempest-TestShelveInstance-6258502 tempest-TestShelveInstance-6258502-project] Lock "1daf4f4c-0e4a-4779-b53a-78c48397ea2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120741) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 18:06:59.361709 dv-cinder-852009-8-iscsi devstack@n-api.service[120741]: DEBUG oslo_concurrency.lockutils [None req-8c564a97-9851-4903-b414-4db6537c9493 tempest-TestShelveInstance-6258502 tempest-TestShelveInstance-6258502-project] Acquiring lock "1daf4f4c-0e4a-4779-b53a-78c48397ea2f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120741) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 18:06:59.362461 dv-cinder-852009-8-iscsi devstack@n-api.service[120741]: DEBUG oslo_concurrency.lockutils [None req-8c564a97-9851-4903-b414-4db6537c9493 tempest-TestShelveInstance-6258502 tempest-TestShelveInstance-6258502-project] Lock "1daf4f4c-0e4a-4779-b53a-78c48397ea2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120741) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 18:06:59.363156 dv-cinder-852009-8-iscsi devstack@n-api.service[120741]: DEBUG oslo_concurrency.lockutils [None req-8c564a97-9851-4903-b414-4db6537c9493 tempest-TestShelveInstance-6258502 tempest-TestShelveInstance-6258502-project] Lock "1daf4f4c-0e4a-4779-b53a-78c48397ea2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120741) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 18:06:59.496022 dv-cinder-852009-8-iscsi devstack@n-api.service[120741]: DEBUG nova.policy [None req-8c564a97-9851-4903-b414-4db6537c9493 tempest-TestShelveInstance-6258502 tempest-TestShelveInstance-6258502-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2ab9930d6ce54cacbb3d4fd6313294d5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5eafd54351bd4049b87ad308a3638f80', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120741) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 18:06:59.504651 dv-cinder-852009-8-iscsi devstack@n-api.service[120741]: INFO nova.api.openstack.requestlog [None req-8c564a97-9851-4903-b414-4db6537c9493 tempest-TestShelveInstance-6258502 tempest-TestShelveInstance-6258502-project] 10.222.0.43 "GET /compute/v2.1/servers/2d60cc6d-a699-417d-aa20-fe3e1bfc351e" status: 200 len: 1570 microversion: 2.1 time: 0.164780 Sep 13 18:06:59.505221 dv-cinder-852009-8-iscsi devstack@n-api.service[120741]: [pid: 120741|app: 0|req: 282/574] 10.222.0.43 () {58 vars in 1236 bytes} [Tue Sep 13 18:06:59 2022] GET /compute/v2.1/servers/2d60cc6d-a699-417d-aa20-fe3e1bfc351e => generated 1570 bytes in 166 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 13 18:06:59.610157 dv-cinder-852009-8-iscsi devstack@n-api.service[120740]: DEBUG nova.api.openstack.wsgi [None req-cb5e4ef2-8a95-42d2-aed5-2bfec46058cf tempest-AttachVolumeShelveTestJSON-385853788 tempest-AttachVolumeShelveTestJSON-385853788-project] Calling method '>' {{(pid=120740) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 18:06:59.611189 dv-cinder-852009-8-iscsi devstack@n-api.service[120740]: DEBUG nova.compute.api [None req-cb5e4ef2-8a95-42d2-aed5-2bfec46058cf tempest-AttachVolumeShelveTestJSON-385853788 tempest-AttachVolumeShelveTestJSON-385853788-project] [instance: 8cecf08e-bea8-4cef-9439-0eaa242bfed1] Fetching instance by UUID {{(pid=120740) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 18:06:59.621867 dv-cinder-852009-8-iscsi devstack@n-api.service[120740]: DEBUG oslo_concurrency.lockutils [None req-cb5e4ef2-8a95-42d2-aed5-2bfec46058cf tempest-AttachVolumeShelveTestJSON-385853788 tempest-AttachVolumeShelveTestJSON-385853788-project] Acquiring lock "1daf4f4c-0e4a-4779-b53a-78c48397ea2f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120740) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 18:06:59.622676 dv-cinder-852009-8-iscsi devstack@n-api.service[120740]: DEBUG oslo_concurrency.lockutils [None req-cb5e4ef2-8a95-42d2-aed5-2bfec46058cf tempest-AttachVolumeShelveTestJSON-385853788 tempest-AttachVolumeShelveTestJSON-385853788-project] Lock "1daf4f4c-0e4a-4779-b53a-78c48397ea2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120740) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 18:06:59.623396 dv-cinder-852009-8-iscsi devstack@n-api.service[120740]: DEBUG oslo_concurrency.lockutils [None req-cb5e4ef2-8a95-42d2-aed5-2bfec46058cf tempest-AttachVolumeShelveTestJSON-385853788 tempest-AttachVolumeShelveTestJSON-385853788-project] Lock "1daf4f4c-0e4a-4779-b53a-78c48397ea2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120740) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 18:06:59.624574 dv-cinder-852009-8-iscsi devstack@n-api.service[120740]: DEBUG oslo_concurrency.lockutils [None req-cb5e4ef2-8a95-42d2-aed5-2bfec46058cf tempest-AttachVolumeShelveTestJSON-385853788 tempest-AttachVolumeShelveTestJSON-385853788-project] Acquiring lock "1daf4f4c-0e4a-4779-b53a-78c48397ea2f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120740) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 18:06:59.625328 dv-cinder-852009-8-iscsi devstack@n-api.service[120740]: DEBUG oslo_concurrency.lockutils [None req-cb5e4ef2-8a95-42d2-aed5-2bfec46058cf tempest-AttachVolumeShelveTestJSON-385853788 tempest-AttachVolumeShelveTestJSON-385853788-project] Lock "1daf4f4c-0e4a-4779-b53a-78c48397ea2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120740) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 18:06:59.626034 dv-cinder-852009-8-iscsi devstack@n-api.service[120740]: DEBUG oslo_concurrency.lockutils [None req-cb5e4ef2-8a95-42d2-aed5-2bfec46058cf tempest-AttachVolumeShelveTestJSON-385853788 tempest-AttachVolumeShelveTestJSON-385853788-project] Lock "1daf4f4c-0e4a-4779-b53a-78c48397ea2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120740) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 18:06:59.764104 dv-cinder-852009-8-iscsi devstack@n-api.service[120740]: DEBUG nova.policy [None req-cb5e4ef2-8a95-42d2-aed5-2bfec46058cf tempest-AttachVolumeShelveTestJSON-385853788 tempest-AttachVolumeShelveTestJSON-385853788-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e68ecd9b3ca643539b109f75bb242d6f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '75e14fd88bfb4cd896fa7b070a0fac47', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120740) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 18:06:59.774379 dv-cinder-852009-8-iscsi devstack@n-api.service[120740]: DEBUG nova.policy [None req-cb5e4ef2-8a95-42d2-aed5-2bfec46058cf tempest-AttachVolumeShelveTestJSON-385853788 tempest-AttachVolumeShelveTestJSON-385853788-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'e68ecd9b3ca643539b109f75bb242d6f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '75e14fd88bfb4cd896fa7b070a0fac47', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120740) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 18:06:59.775827 dv-cinder-852009-8-iscsi devstack@n-api.service[120740]: DEBUG nova.policy [None req-cb5e4ef2-8a95-42d2-aed5-2bfec46058cf tempest-AttachVolumeShelveTestJSON-385853788 tempest-AttachVolumeShelveTestJSON-385853788-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'e68ecd9b3ca643539b109f75bb242d6f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '75e14fd88bfb4cd896fa7b070a0fac47', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120740) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 18:06:59.777041 dv-cinder-852009-8-iscsi devstack@n-api.service[120740]: INFO nova.api.openstack.requestlog [None req-cb5e4ef2-8a95-42d2-aed5-2bfec46058cf tempest-AttachVolumeShelveTestJSON-385853788 tempest-AttachVolumeShelveTestJSON-385853788-project] 10.222.0.43 "GET /compute/v2.1/servers/8cecf08e-bea8-4cef-9439-0eaa242bfed1" status: 200 len: 1722 microversion: 2.20 time: 0.175245 Sep 13 18:06:59.777569 dv-cinder-852009-8-iscsi devstack@n-api.service[120740]: [pid: 120740|app: 0|req: 293/575] 10.222.0.43 () {60 vars in 1277 bytes} [Tue Sep 13 18:06:59 2022] GET /compute/v2.1/servers/8cecf08e-bea8-4cef-9439-0eaa242bfed1 => generated 1722 bytes in 177 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 13 18:07:00.072442 dv-cinder-852009-8-iscsi devstack@n-api.service[120741]: DEBUG nova.api.openstack.wsgi [None req-89d5f8c2-bc7a-43ed-bfdc-b719c07ce679 tempest-VolumesTestJSON-1311478007 tempest-VolumesTestJSON-1311478007-project] Calling method '.version_select at 0x7fa626b5e3a0>' {{(pid=120741) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 18:07:00.125083 dv-cinder-852009-8-iscsi devstack@n-api.service[120741]: INFO nova.api.openstack.requestlog [None req-89d5f8c2-bc7a-43ed-bfdc-b719c07ce679 tempest-VolumesTestJSON-1311478007 tempest-VolumesTestJSON-1311478007-project] 10.222.0.43 "GET /compute/v2.1/os-volumes/638eaa0a-ed13-493e-aeb8-34b01218ebb3" status: 200 len: 350 microversion: 2.1 time: 0.056410 Sep 13 18:07:00.125675 dv-cinder-852009-8-iscsi devstack@n-api.service[120741]: [pid: 120741|app: 0|req: 283/576] 10.222.0.43 () {58 vars in 1245 bytes} [Tue Sep 13 18:07:00 2022] GET /compute/v2.1/os-volumes/638eaa0a-ed13-493e-aeb8-34b01218ebb3 => generated 350 bytes in 58 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 13 18:07:00.139272 dv-cinder-852009-8-iscsi devstack@n-api.service[120740]: DEBUG nova.api.openstack.wsgi [None req-6ec0f71f-b507-44b2-80c9-4b1f7edfbe0e tempest-VolumesTestJSON-1311478007 tempest-VolumesTestJSON-1311478007-project] Calling method '.version_select at 0x7fa626f1a3a0>' {{(pid=120740) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 18:07:00.219166 dv-cinder-852009-8-iscsi devstack@n-api.service[120740]: INFO nova.api.openstack.requestlog [None req-6ec0f71f-b507-44b2-80c9-4b1f7edfbe0e tempest-VolumesTestJSON-1311478007 tempest-VolumesTestJSON-1311478007-project] 10.222.0.43 "GET /compute/v2.1/os-volumes" status: 200 len: 1034 microversion: 2.1 time: 0.083678 Sep 13 18:07:00.219722 dv-cinder-852009-8-iscsi devstack@n-api.service[120740]: [pid: 120740|app: 0|req: 294/577] 10.222.0.43 () {58 vars in 1134 bytes} [Tue Sep 13 18:07:00 2022] GET /compute/v2.1/os-volumes => generated 1034 bytes in 85 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 13 18:07:00.236669 dv-cinder-852009-8-iscsi devstack@n-api.service[120741]: DEBUG nova.api.openstack.wsgi [None req-1900ebea-37c7-4454-b1af-b2a23a01459f tempest-VolumesTestJSON-1311478007 tempest-VolumesTestJSON-1311478007-project] Calling method '.version_select at 0x7fa626a00e50>' {{(pid=120741) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 18:07:00.323375 dv-cinder-852009-8-iscsi devstack@n-api.service[120741]: INFO nova.api.openstack.requestlog [None req-1900ebea-37c7-4454-b1af-b2a23a01459f tempest-VolumesTestJSON-1311478007 tempest-VolumesTestJSON-1311478007-project] 10.222.0.43 "GET /compute/v2.1/os-volumes?limit=2" status: 200 len: 694 microversion: 2.1 time: 0.090854 Sep 13 18:07:00.323957 dv-cinder-852009-8-iscsi devstack@n-api.service[120741]: [pid: 120741|app: 0|req: 284/578] 10.222.0.43 () {58 vars in 1149 bytes} [Tue Sep 13 18:07:00 2022] GET /compute/v2.1/os-volumes?limit=2 => generated 694 bytes in 92 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 13 18:07:00.341428 dv-cinder-852009-8-iscsi devstack@n-api.service[120740]: DEBUG nova.api.openstack.wsgi [None req-b67a6fc1-596a-4cbd-9791-1eaca3cc37fe tempest-VolumesTestJSON-1311478007 tempest-VolumesTestJSON-1311478007-project] Calling method '.version_select at 0x7fa626b1a0d0>' {{(pid=120740) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 18:07:00.427219 dv-cinder-852009-8-iscsi devstack@n-api.service[120740]: INFO nova.api.openstack.requestlog [None req-b67a6fc1-596a-4cbd-9791-1eaca3cc37fe tempest-VolumesTestJSON-1311478007 tempest-VolumesTestJSON-1311478007-project] 10.222.0.43 "GET /compute/v2.1/os-volumes" status: 200 len: 1034 microversion: 2.1 time: 0.089211 Sep 13 18:07:00.428098 dv-cinder-852009-8-iscsi devstack@n-api.service[120740]: [pid: 120740|app: 0|req: 295/579] 10.222.0.43 () {58 vars in 1134 bytes} [Tue Sep 13 18:07:00 2022] GET /compute/v2.1/os-volumes => generated 1034 bytes in 91 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 13 18:07:00.443637 dv-cinder-852009-8-iscsi devstack@n-api.service[120741]: DEBUG nova.api.openstack.wsgi [None req-193d0d96-1212-4adc-bf65-b34fcdfbcbf9 tempest-VolumesTestJSON-1311478007 tempest-VolumesTestJSON-1311478007-project] Calling method '.version_select at 0x7fa626974040>' {{(pid=120741) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 18:07:00.528127 dv-cinder-852009-8-iscsi devstack@n-api.service[120740]: DEBUG nova.api.openstack.wsgi [None req-29ea1c71-b3dd-4aeb-abd3-cd7f28815aaf tempest-TestShelveInstance-6258502 tempest-TestShelveInstance-6258502-project] Calling method '>' {{(pid=120740) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 18:07:00.528721 dv-cinder-852009-8-iscsi devstack@n-api.service[120740]: DEBUG nova.compute.api [None req-29ea1c71-b3dd-4aeb-abd3-cd7f28815aaf tempest-TestShelveInstance-6258502 tempest-TestShelveInstance-6258502-project] [instance: 2d60cc6d-a699-417d-aa20-fe3e1bfc351e] Fetching instance by UUID {{(pid=120740) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 18:07:00.532592 dv-cinder-852009-8-iscsi devstack@n-api.service[120741]: INFO nova.api.openstack.requestlog [None req-193d0d96-1212-4adc-bf65-b34fcdfbcbf9 tempest-VolumesTestJSON-1311478007 tempest-VolumesTestJSON-1311478007-project] 10.222.0.43 "GET /compute/v2.1/os-volumes?offset=1&limit=1" status: 200 len: 354 microversion: 2.1 time: 0.094584 Sep 13 18:07:00.533294 dv-cinder-852009-8-iscsi devstack@n-api.service[120741]: [pid: 120741|app: 0|req: 285/580] 10.222.0.43 () {58 vars in 1167 bytes} [Tue Sep 13 18:07:00 2022] GET /compute/v2.1/os-volumes?offset=1&limit=1 => generated 354 bytes in 96 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 13 18:07:00.535754 dv-cinder-852009-8-iscsi devstack@n-api.service[120740]: DEBUG oslo_concurrency.lockutils [None req-29ea1c71-b3dd-4aeb-abd3-cd7f28815aaf tempest-TestShelveInstance-6258502 tempest-TestShelveInstance-6258502-project] Acquiring lock "1daf4f4c-0e4a-4779-b53a-78c48397ea2f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120740) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 18:07:00.536235 dv-cinder-852009-8-iscsi devstack@n-api.service[120740]: DEBUG oslo_concurrency.lockutils [None req-29ea1c71-b3dd-4aeb-abd3-cd7f28815aaf tempest-TestShelveInstance-6258502 tempest-TestShelveInstance-6258502-project] Lock "1daf4f4c-0e4a-4779-b53a-78c48397ea2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120740) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 18:07:00.536698 dv-cinder-852009-8-iscsi devstack@n-api.service[120740]: DEBUG oslo_concurrency.lockutils [None req-29ea1c71-b3dd-4aeb-abd3-cd7f28815aaf tempest-TestShelveInstance-6258502 tempest-TestShelveInstance-6258502-project] Lock "1daf4f4c-0e4a-4779-b53a-78c48397ea2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120740) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 18:07:00.537391 dv-cinder-852009-8-iscsi devstack@n-api.service[120740]: DEBUG oslo_concurrency.lockutils [None req-29ea1c71-b3dd-4aeb-abd3-cd7f28815aaf tempest-TestShelveInstance-6258502 tempest-TestShelveInstance-6258502-project] Acquiring lock "1daf4f4c-0e4a-4779-b53a-78c48397ea2f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120740) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 18:07:00.537849 dv-cinder-852009-8-iscsi devstack@n-api.service[120740]: DEBUG oslo_concurrency.lockutils [None req-29ea1c71-b3dd-4aeb-abd3-cd7f28815aaf tempest-TestShelveInstance-6258502 tempest-TestShelveInstance-6258502-project] Lock "1daf4f4c-0e4a-4779-b53a-78c48397ea2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120740) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 18:07:00.538269 dv-cinder-852009-8-iscsi devstack@n-api.service[120740]: DEBUG oslo_concurrency.lockutils [None req-29ea1c71-b3dd-4aeb-abd3-cd7f28815aaf tempest-TestShelveInstance-6258502 tempest-TestShelveInstance-6258502-project] Lock "1daf4f4c-0e4a-4779-b53a-78c48397ea2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120740) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 18:07:00.546967 dv-cinder-852009-8-iscsi devstack@n-api.service[120741]: DEBUG nova.api.openstack.wsgi [None req-e3cb9a48-d3f2-401b-8eed-792d99c976ea tempest-VolumesTestJSON-1311478007 tempest-VolumesTestJSON-1311478007-project] Calling method '.version_select at 0x7fa626b5e1f0>' {{(pid=120741) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 18:07:00.628777 dv-cinder-852009-8-iscsi devstack@n-api.service[120741]: INFO nova.api.openstack.requestlog [None req-e3cb9a48-d3f2-401b-8eed-792d99c976ea tempest-VolumesTestJSON-1311478007 tempest-VolumesTestJSON-1311478007-project] 10.222.0.43 "GET /compute/v2.1/os-volumes/detail?limit=2" status: 200 len: 694 microversion: 2.1 time: 0.085377 Sep 13 18:07:00.629353 dv-cinder-852009-8-iscsi devstack@n-api.service[120741]: [pid: 120741|app: 0|req: 286/581] 10.222.0.43 () {58 vars in 1170 bytes} [Tue Sep 13 18:07:00 2022] GET /compute/v2.1/os-volumes/detail?limit=2 => generated 694 bytes in 87 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Sep 13 18:07:00.643025 dv-cinder-852009-8-iscsi devstack@n-api.service[120741]: DEBUG nova.api.openstack.wsgi [None req-72d1b792-99a6-4ece-ac57-3014acde7687 tempest-VolumesTestJSON-1311478007 tempest-VolumesTestJSON-1311478007-project] Calling method '.version_select at 0x7fa6269d3a60>' {{(pid=120741) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 18:07:00.672020 dv-cinder-852009-8-iscsi devstack@n-api.service[120740]: DEBUG nova.policy [None req-29ea1c71-b3dd-4aeb-abd3-cd7f28815aaf tempest-TestShelveInstance-6258502 tempest-TestShelveInstance-6258502-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2ab9930d6ce54cacbb3d4fd6313294d5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5eafd54351bd4049b87ad308a3638f80', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120740) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 18:07:00.680054 dv-cinder-852009-8-iscsi devstack@n-api.service[120740]: INFO nova.api.openstack.requestlog [None req-29ea1c71-b3dd-4aeb-abd3-cd7f28815aaf tempest-TestShelveInstance-6258502 tempest-TestShelveInstance-6258502-project] 10.222.0.43 "GET /compute/v2.1/servers/2d60cc6d-a699-417d-aa20-fe3e1bfc351e" status: 200 len: 1570 microversion: 2.1 time: 0.155717 Sep 13 18:07:00.684481 dv-cinder-852009-8-iscsi devstack@n-api.service[120740]: [pid: 120740|app: 0|req: 296/582] 10.222.0.43 () {58 vars in 1236 bytes} [Tue Sep 13 18:07:00 2022] GET /compute/v2.1/servers/2d60cc6d-a699-417d-aa20-fe3e1bfc351e => generated 1570 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 13 18:07:00.725534 dv-cinder-852009-8-iscsi devstack@n-api.service[120741]: INFO nova.api.openstack.requestlog [None req-72d1b792-99a6-4ece-ac57-3014acde7687 tempest-VolumesTestJSON-1311478007 tempest-VolumesTestJSON-1311478007-project] 10.222.0.43 "GET /compute/v2.1/os-volumes/detail" status: 200 len: 1034 microversion: 2.1 time: 0.086344 Sep 13 18:07:00.726107 dv-cinder-852009-8-iscsi devstack@n-api.service[120741]: [pid: 120741|app: 0|req: 287/583] 10.222.0.43 () {58 vars in 1155 bytes} [Tue Sep 13 18:07:00 2022] GET /compute/v2.1/os-volumes/detail => generated 1034 bytes in 88 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 13 18:07:00.739515 dv-cinder-852009-8-iscsi devstack@n-api.service[120740]: DEBUG nova.api.openstack.wsgi [None req-336253bf-c58d-4181-b2cd-c449369fc8dd tempest-VolumesTestJSON-1311478007 tempest-VolumesTestJSON-1311478007-project] Calling method '.version_select at 0x7fa626b9a310>' {{(pid=120740) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 18:07:00.803342 dv-cinder-852009-8-iscsi devstack@n-api.service[120741]: DEBUG nova.api.openstack.wsgi [None req-e5945d7d-7ebf-4aef-a00d-14e7de0d2aa2 tempest-AttachVolumeShelveTestJSON-385853788 tempest-AttachVolumeShelveTestJSON-385853788-project] Calling method '>' {{(pid=120741) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 18:07:00.804204 dv-cinder-852009-8-iscsi devstack@n-api.service[120741]: DEBUG nova.compute.api [None req-e5945d7d-7ebf-4aef-a00d-14e7de0d2aa2 tempest-AttachVolumeShelveTestJSON-385853788 tempest-AttachVolumeShelveTestJSON-385853788-project] [instance: 8cecf08e-bea8-4cef-9439-0eaa242bfed1] Fetching instance by UUID {{(pid=120741) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 18:07:00.810993 dv-cinder-852009-8-iscsi devstack@n-api.service[120741]: DEBUG oslo_concurrency.lockutils [None req-e5945d7d-7ebf-4aef-a00d-14e7de0d2aa2 tempest-AttachVolumeShelveTestJSON-385853788 tempest-AttachVolumeShelveTestJSON-385853788-project] Acquiring lock "1daf4f4c-0e4a-4779-b53a-78c48397ea2f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120741) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 18:07:00.811481 dv-cinder-852009-8-iscsi devstack@n-api.service[120741]: DEBUG oslo_concurrency.lockutils [None req-e5945d7d-7ebf-4aef-a00d-14e7de0d2aa2 tempest-AttachVolumeShelveTestJSON-385853788 tempest-AttachVolumeShelveTestJSON-385853788-project] Lock "1daf4f4c-0e4a-4779-b53a-78c48397ea2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120741) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 18:07:00.811936 dv-cinder-852009-8-iscsi devstack@n-api.service[120741]: DEBUG oslo_concurrency.lockutils [None req-e5945d7d-7ebf-4aef-a00d-14e7de0d2aa2 tempest-AttachVolumeShelveTestJSON-385853788 tempest-AttachVolumeShelveTestJSON-385853788-project] Lock "1daf4f4c-0e4a-4779-b53a-78c48397ea2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120741) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 18:07:00.812672 dv-cinder-852009-8-iscsi devstack@n-api.service[120741]: DEBUG oslo_concurrency.lockutils [None req-e5945d7d-7ebf-4aef-a00d-14e7de0d2aa2 tempest-AttachVolumeShelveTestJSON-385853788 tempest-AttachVolumeShelveTestJSON-385853788-project] Acquiring lock "1daf4f4c-0e4a-4779-b53a-78c48397ea2f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120741) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 18:07:00.813171 dv-cinder-852009-8-iscsi devstack@n-api.service[120741]: DEBUG oslo_concurrency.lockutils [None req-e5945d7d-7ebf-4aef-a00d-14e7de0d2aa2 tempest-AttachVolumeShelveTestJSON-385853788 tempest-AttachVolumeShelveTestJSON-385853788-project] Lock "1daf4f4c-0e4a-4779-b53a-78c48397ea2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120741) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 18:07:00.813636 dv-cinder-852009-8-iscsi devstack@n-api.service[120741]: DEBUG oslo_concurrency.lockutils [None req-e5945d7d-7ebf-4aef-a00d-14e7de0d2aa2 tempest-AttachVolumeShelveTestJSON-385853788 tempest-AttachVolumeShelveTestJSON-385853788-project] Lock "1daf4f4c-0e4a-4779-b53a-78c48397ea2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120741) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 18:07:00.822181 dv-cinder-852009-8-iscsi devstack@n-api.service[120740]: INFO nova.api.openstack.requestlog [None req-336253bf-c58d-4181-b2cd-c449369fc8dd tempest-VolumesTestJSON-1311478007 tempest-VolumesTestJSON-1311478007-project] 10.222.0.43 "GET /compute/v2.1/os-volumes/detail?offset=1&limit=1" status: 200 len: 354 microversion: 2.1 time: 0.086511 Sep 13 18:07:00.822767 dv-cinder-852009-8-iscsi devstack@n-api.service[120740]: [pid: 120740|app: 0|req: 297/584] 10.222.0.43 () {58 vars in 1188 bytes} [Tue Sep 13 18:07:00 2022] GET /compute/v2.1/os-volumes/detail?offset=1&limit=1 => generated 354 bytes in 88 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 13 18:07:00.837451 dv-cinder-852009-8-iscsi devstack@n-api.service[120740]: DEBUG nova.api.openstack.wsgi [None req-21e6cec2-5ec7-4b61-844e-74095be54582 tempest-VolumesTestJSON-1311478007 tempest-VolumesTestJSON-1311478007-project] Calling method '.version_select at 0x7fa626af0e50>' {{(pid=120740) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 18:07:00.926069 dv-cinder-852009-8-iscsi devstack@n-api.service[120740]: INFO nova.api.openstack.requestlog [None req-21e6cec2-5ec7-4b61-844e-74095be54582 tempest-VolumesTestJSON-1311478007 tempest-VolumesTestJSON-1311478007-project] 10.222.0.43 "GET /compute/v2.1/os-volumes/detail" status: 200 len: 1034 microversion: 2.1 time: 0.092644 Sep 13 18:07:00.926652 dv-cinder-852009-8-iscsi devstack@n-api.service[120740]: [pid: 120740|app: 0|req: 298/585] 10.222.0.43 () {58 vars in 1155 bytes} [Tue Sep 13 18:07:00 2022] GET /compute/v2.1/os-volumes/detail => generated 1034 bytes in 94 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 13 18:07:00.963000 dv-cinder-852009-8-iscsi devstack@n-api.service[120741]: DEBUG nova.policy [None req-e5945d7d-7ebf-4aef-a00d-14e7de0d2aa2 tempest-AttachVolumeShelveTestJSON-385853788 tempest-AttachVolumeShelveTestJSON-385853788-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e68ecd9b3ca643539b109f75bb242d6f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '75e14fd88bfb4cd896fa7b070a0fac47', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120741) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 18:07:00.971142 dv-cinder-852009-8-iscsi devstack@n-api.service[120741]: DEBUG nova.policy [None req-e5945d7d-7ebf-4aef-a00d-14e7de0d2aa2 tempest-AttachVolumeShelveTestJSON-385853788 tempest-AttachVolumeShelveTestJSON-385853788-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'e68ecd9b3ca643539b109f75bb242d6f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '75e14fd88bfb4cd896fa7b070a0fac47', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120741) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 18:07:00.972585 dv-cinder-852009-8-iscsi devstack@n-api.service[120741]: DEBUG nova.policy [None req-e5945d7d-7ebf-4aef-a00d-14e7de0d2aa2 tempest-AttachVolumeShelveTestJSON-385853788 tempest-AttachVolumeShelveTestJSON-385853788-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'e68ecd9b3ca643539b109f75bb242d6f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '75e14fd88bfb4cd896fa7b070a0fac47', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120741) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 18:07:00.973736 dv-cinder-852009-8-iscsi devstack@n-api.service[120741]: INFO nova.api.openstack.requestlog [None req-e5945d7d-7ebf-4aef-a00d-14e7de0d2aa2 tempest-AttachVolumeShelveTestJSON-385853788 tempest-AttachVolumeShelveTestJSON-385853788-project] 10.222.0.43 "GET /compute/v2.1/servers/8cecf08e-bea8-4cef-9439-0eaa242bfed1" status: 200 len: 1722 microversion: 2.20 time: 0.174378 Sep 13 18:07:00.974463 dv-cinder-852009-8-iscsi devstack@n-api.service[120741]: [pid: 120741|app: 0|req: 288/586] 10.222.0.43 () {60 vars in 1277 bytes} [Tue Sep 13 18:07:00 2022] GET /compute/v2.1/servers/8cecf08e-bea8-4cef-9439-0eaa242bfed1 => generated 1722 bytes in 176 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 13 18:07:01.706611 dv-cinder-852009-8-iscsi devstack@n-api.service[120740]: DEBUG nova.api.openstack.wsgi [None req-68e18184-9700-4ab2-993f-66bf0e74ab34 tempest-TestShelveInstance-6258502 tempest-TestShelveInstance-6258502-project] Calling method '>' {{(pid=120740) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 18:07:01.707154 dv-cinder-852009-8-iscsi devstack@n-api.service[120740]: DEBUG nova.compute.api [None req-68e18184-9700-4ab2-993f-66bf0e74ab34 tempest-TestShelveInstance-6258502 tempest-TestShelveInstance-6258502-project] [instance: 2d60cc6d-a699-417d-aa20-fe3e1bfc351e] Fetching instance by UUID {{(pid=120740) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 18:07:01.714816 dv-cinder-852009-8-iscsi devstack@n-api.service[120740]: DEBUG oslo_concurrency.lockutils [None req-68e18184-9700-4ab2-993f-66bf0e74ab34 tempest-TestShelveInstance-6258502 tempest-TestShelveInstance-6258502-project] Acquiring lock "1daf4f4c-0e4a-4779-b53a-78c48397ea2f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120740) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 18:07:01.715299 dv-cinder-852009-8-iscsi devstack@n-api.service[120740]: DEBUG oslo_concurrency.lockutils [None req-68e18184-9700-4ab2-993f-66bf0e74ab34 tempest-TestShelveInstance-6258502 tempest-TestShelveInstance-6258502-project] Lock "1daf4f4c-0e4a-4779-b53a-78c48397ea2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120740) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 18:07:01.715719 dv-cinder-852009-8-iscsi devstack@n-api.service[120740]: DEBUG oslo_concurrency.lockutils [None req-68e18184-9700-4ab2-993f-66bf0e74ab34 tempest-TestShelveInstance-6258502 tempest-TestShelveInstance-6258502-project] Lock "1daf4f4c-0e4a-4779-b53a-78c48397ea2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120740) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 18:07:01.716399 dv-cinder-852009-8-iscsi devstack@n-api.service[120740]: DEBUG oslo_concurrency.lockutils [None req-68e18184-9700-4ab2-993f-66bf0e74ab34 tempest-TestShelveInstance-6258502 tempest-TestShelveInstance-6258502-project] Acquiring lock "1daf4f4c-0e4a-4779-b53a-78c48397ea2f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120740) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 18:07:01.716874 dv-cinder-852009-8-iscsi devstack@n-api.service[120740]: DEBUG oslo_concurrency.lockutils [None req-68e18184-9700-4ab2-993f-66bf0e74ab34 tempest-TestShelveInstance-6258502 tempest-TestShelveInstance-6258502-project] Lock "1daf4f4c-0e4a-4779-b53a-78c48397ea2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120740) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 18:07:01.717290 dv-cinder-852009-8-iscsi devstack@n-api.service[120740]: DEBUG oslo_concurrency.lockutils [None req-68e18184-9700-4ab2-993f-66bf0e74ab34 tempest-TestShelveInstance-6258502 tempest-TestShelveInstance-6258502-project] Lock "1daf4f4c-0e4a-4779-b53a-78c48397ea2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120740) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 18:07:01.862355 dv-cinder-852009-8-iscsi devstack@n-api.service[120740]: DEBUG nova.policy [None req-68e18184-9700-4ab2-993f-66bf0e74ab34 tempest-TestShelveInstance-6258502 tempest-TestShelveInstance-6258502-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2ab9930d6ce54cacbb3d4fd6313294d5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5eafd54351bd4049b87ad308a3638f80', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120740) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 18:07:01.872627 dv-cinder-852009-8-iscsi devstack@n-api.service[120740]: INFO nova.api.openstack.requestlog [None req-68e18184-9700-4ab2-993f-66bf0e74ab34 tempest-TestShelveInstance-6258502 tempest-TestShelveInstance-6258502-project] 10.222.0.43 "GET /compute/v2.1/servers/2d60cc6d-a699-417d-aa20-fe3e1bfc351e" status: 200 len: 1511 microversion: 2.1 time: 0.172462 Sep 13 18:07:01.873467 dv-cinder-852009-8-iscsi devstack@n-api.service[120740]: [pid: 120740|app: 0|req: 299/587] 10.222.0.43 () {58 vars in 1236 bytes} [Tue Sep 13 18:07:01 2022] GET /compute/v2.1/servers/2d60cc6d-a699-417d-aa20-fe3e1bfc351e => generated 1511 bytes in 175 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 13 18:07:01.902776 dv-cinder-852009-8-iscsi devstack@n-api.service[120741]: DEBUG nova.api.openstack.wsgi [None req-267af9f9-42c1-423b-bec5-8899a783082f tempest-TestShelveInstance-6258502 tempest-TestShelveInstance-6258502-project] Action: 'action', calling method: >, body: {"unshelve": null} {{(pid=120741) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 13 18:07:01.903446 dv-cinder-852009-8-iscsi devstack@n-api.service[120741]: DEBUG nova.compute.api [None req-267af9f9-42c1-423b-bec5-8899a783082f tempest-TestShelveInstance-6258502 tempest-TestShelveInstance-6258502-project] [instance: 2d60cc6d-a699-417d-aa20-fe3e1bfc351e] Fetching instance by UUID {{(pid=120741) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 18:07:01.913035 dv-cinder-852009-8-iscsi devstack@n-api.service[120741]: DEBUG oslo_concurrency.lockutils [None req-267af9f9-42c1-423b-bec5-8899a783082f tempest-TestShelveInstance-6258502 tempest-TestShelveInstance-6258502-project] Acquiring lock "1daf4f4c-0e4a-4779-b53a-78c48397ea2f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120741) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 18:07:01.913744 dv-cinder-852009-8-iscsi devstack@n-api.service[120741]: DEBUG oslo_concurrency.lockutils [None req-267af9f9-42c1-423b-bec5-8899a783082f tempest-TestShelveInstance-6258502 tempest-TestShelveInstance-6258502-project] Lock "1daf4f4c-0e4a-4779-b53a-78c48397ea2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120741) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 18:07:01.914491 dv-cinder-852009-8-iscsi devstack@n-api.service[120741]: DEBUG oslo_concurrency.lockutils [None req-267af9f9-42c1-423b-bec5-8899a783082f tempest-TestShelveInstance-6258502 tempest-TestShelveInstance-6258502-project] Lock "1daf4f4c-0e4a-4779-b53a-78c48397ea2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120741) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 18:07:01.915193 dv-cinder-852009-8-iscsi devstack@n-api.service[120741]: DEBUG oslo_concurrency.lockutils [None req-267af9f9-42c1-423b-bec5-8899a783082f tempest-TestShelveInstance-6258502 tempest-TestShelveInstance-6258502-project] Acquiring lock "1daf4f4c-0e4a-4779-b53a-78c48397ea2f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120741) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 18:07:01.915647 dv-cinder-852009-8-iscsi devstack@n-api.service[120741]: DEBUG oslo_concurrency.lockutils [None req-267af9f9-42c1-423b-bec5-8899a783082f tempest-TestShelveInstance-6258502 tempest-TestShelveInstance-6258502-project] Lock "1daf4f4c-0e4a-4779-b53a-78c48397ea2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120741) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 18:07:01.916066 dv-cinder-852009-8-iscsi devstack@n-api.service[120741]: DEBUG oslo_concurrency.lockutils [None req-267af9f9-42c1-423b-bec5-8899a783082f tempest-TestShelveInstance-6258502 tempest-TestShelveInstance-6258502-project] Lock "1daf4f4c-0e4a-4779-b53a-78c48397ea2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120741) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 18:07:01.944579 dv-cinder-852009-8-iscsi devstack@n-api.service[120741]: DEBUG nova.compute.api [None req-267af9f9-42c1-423b-bec5-8899a783082f tempest-TestShelveInstance-6258502 tempest-TestShelveInstance-6258502-project] [instance: 2d60cc6d-a699-417d-aa20-fe3e1bfc351e] Unshelving instance with old availability_zone "None" to new availability_zone "not provided" and host "None". {{(pid=120741) unshelve /opt/stack/nova/nova/compute/api.py:4593}} Sep 13 18:07:02.005228 dv-cinder-852009-8-iscsi devstack@n-api.service[120740]: DEBUG nova.api.openstack.wsgi [None req-41f2c881-5a7d-4bb0-a23a-c433421fc091 tempest-AttachVolumeShelveTestJSON-385853788 tempest-AttachVolumeShelveTestJSON-385853788-project] Calling method '>' {{(pid=120740) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 18:07:02.005915 dv-cinder-852009-8-iscsi devstack@n-api.service[120740]: DEBUG nova.compute.api [None req-41f2c881-5a7d-4bb0-a23a-c433421fc091 tempest-AttachVolumeShelveTestJSON-385853788 tempest-AttachVolumeShelveTestJSON-385853788-project] [instance: 8cecf08e-bea8-4cef-9439-0eaa242bfed1] Fetching instance by UUID {{(pid=120740) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 18:07:02.012564 dv-cinder-852009-8-iscsi devstack@n-api.service[120740]: DEBUG oslo_concurrency.lockutils [None req-41f2c881-5a7d-4bb0-a23a-c433421fc091 tempest-AttachVolumeShelveTestJSON-385853788 tempest-AttachVolumeShelveTestJSON-385853788-project] Acquiring lock "1daf4f4c-0e4a-4779-b53a-78c48397ea2f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120740) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 18:07:02.013059 dv-cinder-852009-8-iscsi devstack@n-api.service[120740]: DEBUG oslo_concurrency.lockutils [None req-41f2c881-5a7d-4bb0-a23a-c433421fc091 tempest-AttachVolumeShelveTestJSON-385853788 tempest-AttachVolumeShelveTestJSON-385853788-project] Lock "1daf4f4c-0e4a-4779-b53a-78c48397ea2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120740) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 18:07:02.013494 dv-cinder-852009-8-iscsi devstack@n-api.service[120740]: DEBUG oslo_concurrency.lockutils [None req-41f2c881-5a7d-4bb0-a23a-c433421fc091 tempest-AttachVolumeShelveTestJSON-385853788 tempest-AttachVolumeShelveTestJSON-385853788-project] Lock "1daf4f4c-0e4a-4779-b53a-78c48397ea2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120740) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 18:07:02.014191 dv-cinder-852009-8-iscsi devstack@n-api.service[120740]: DEBUG oslo_concurrency.lockutils [None req-41f2c881-5a7d-4bb0-a23a-c433421fc091 tempest-AttachVolumeShelveTestJSON-385853788 tempest-AttachVolumeShelveTestJSON-385853788-project] Acquiring lock "1daf4f4c-0e4a-4779-b53a-78c48397ea2f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120740) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 18:07:02.014646 dv-cinder-852009-8-iscsi devstack@n-api.service[120740]: DEBUG oslo_concurrency.lockutils [None req-41f2c881-5a7d-4bb0-a23a-c433421fc091 tempest-AttachVolumeShelveTestJSON-385853788 tempest-AttachVolumeShelveTestJSON-385853788-project] Lock "1daf4f4c-0e4a-4779-b53a-78c48397ea2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120740) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 18:07:02.015065 dv-cinder-852009-8-iscsi devstack@n-api.service[120740]: DEBUG oslo_concurrency.lockutils [None req-41f2c881-5a7d-4bb0-a23a-c433421fc091 tempest-AttachVolumeShelveTestJSON-385853788 tempest-AttachVolumeShelveTestJSON-385853788-project] Lock "1daf4f4c-0e4a-4779-b53a-78c48397ea2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120740) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 18:07:02.017831 dv-cinder-852009-8-iscsi devstack@n-api.service[120741]: INFO nova.api.openstack.requestlog [None req-267af9f9-42c1-423b-bec5-8899a783082f tempest-TestShelveInstance-6258502 tempest-TestShelveInstance-6258502-project] 10.222.0.43 "POST /compute/v2.1/servers/2d60cc6d-a699-417d-aa20-fe3e1bfc351e/action" status: 202 len: 0 microversion: 2.1 time: 0.120906 Sep 13 18:07:02.018718 dv-cinder-852009-8-iscsi devstack@n-api.service[120741]: [pid: 120741|app: 0|req: 289/588] 10.222.0.43 () {60 vars in 1278 bytes} [Tue Sep 13 18:07:01 2022] POST /compute/v2.1/servers/2d60cc6d-a699-417d-aa20-fe3e1bfc351e/action => generated 0 bytes in 123 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Sep 13 18:07:02.027338 dv-cinder-852009-8-iscsi devstack@n-api.service[120741]: DEBUG nova.api.openstack.wsgi [None req-eb659f2c-8090-4770-ac95-8ed76873174c tempest-TestShelveInstance-6258502 tempest-TestShelveInstance-6258502-project] Calling method '>' {{(pid=120741) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 18:07:02.027824 dv-cinder-852009-8-iscsi devstack@n-api.service[120741]: DEBUG nova.compute.api [None req-eb659f2c-8090-4770-ac95-8ed76873174c tempest-TestShelveInstance-6258502 tempest-TestShelveInstance-6258502-project] [instance: 2d60cc6d-a699-417d-aa20-fe3e1bfc351e] Fetching instance by UUID {{(pid=120741) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 18:07:02.034497 dv-cinder-852009-8-iscsi devstack@n-api.service[120741]: DEBUG oslo_concurrency.lockutils [None req-eb659f2c-8090-4770-ac95-8ed76873174c tempest-TestShelveInstance-6258502 tempest-TestShelveInstance-6258502-project] Acquiring lock "1daf4f4c-0e4a-4779-b53a-78c48397ea2f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120741) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 18:07:02.035157 dv-cinder-852009-8-iscsi devstack@n-api.service[120741]: DEBUG oslo_concurrency.lockutils [None req-eb659f2c-8090-4770-ac95-8ed76873174c tempest-TestShelveInstance-6258502 tempest-TestShelveInstance-6258502-project] Lock "1daf4f4c-0e4a-4779-b53a-78c48397ea2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120741) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 18:07:02.035431 dv-cinder-852009-8-iscsi devstack@n-api.service[120741]: DEBUG oslo_concurrency.lockutils [None req-eb659f2c-8090-4770-ac95-8ed76873174c tempest-TestShelveInstance-6258502 tempest-TestShelveInstance-6258502-project] Lock "1daf4f4c-0e4a-4779-b53a-78c48397ea2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120741) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 18:07:02.036155 dv-cinder-852009-8-iscsi devstack@n-api.service[120741]: DEBUG oslo_concurrency.lockutils [None req-eb659f2c-8090-4770-ac95-8ed76873174c tempest-TestShelveInstance-6258502 tempest-TestShelveInstance-6258502-project] Acquiring lock "1daf4f4c-0e4a-4779-b53a-78c48397ea2f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120741) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 18:07:02.036716 dv-cinder-852009-8-iscsi devstack@n-api.service[120741]: DEBUG oslo_concurrency.lockutils [None req-eb659f2c-8090-4770-ac95-8ed76873174c tempest-TestShelveInstance-6258502 tempest-TestShelveInstance-6258502-project] Lock "1daf4f4c-0e4a-4779-b53a-78c48397ea2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120741) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 18:07:02.037170 dv-cinder-852009-8-iscsi devstack@n-api.service[120741]: DEBUG oslo_concurrency.lockutils [None req-eb659f2c-8090-4770-ac95-8ed76873174c tempest-TestShelveInstance-6258502 tempest-TestShelveInstance-6258502-project] Lock "1daf4f4c-0e4a-4779-b53a-78c48397ea2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120741) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 18:07:02.510711 dv-cinder-852009-8-iscsi devstack@n-api.service[120740]: DEBUG nova.policy [None req-41f2c881-5a7d-4bb0-a23a-c433421fc091 tempest-AttachVolumeShelveTestJSON-385853788 tempest-AttachVolumeShelveTestJSON-385853788-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e68ecd9b3ca643539b109f75bb242d6f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '75e14fd88bfb4cd896fa7b070a0fac47', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120740) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 18:07:02.515169 dv-cinder-852009-8-iscsi devstack@n-api.service[120741]: DEBUG nova.policy [None req-eb659f2c-8090-4770-ac95-8ed76873174c tempest-TestShelveInstance-6258502 tempest-TestShelveInstance-6258502-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2ab9930d6ce54cacbb3d4fd6313294d5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5eafd54351bd4049b87ad308a3638f80', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120741) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 18:07:02.519127 dv-cinder-852009-8-iscsi devstack@n-api.service[120740]: DEBUG nova.policy [None req-41f2c881-5a7d-4bb0-a23a-c433421fc091 tempest-AttachVolumeShelveTestJSON-385853788 tempest-AttachVolumeShelveTestJSON-385853788-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'e68ecd9b3ca643539b109f75bb242d6f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '75e14fd88bfb4cd896fa7b070a0fac47', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120740) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 18:07:02.520587 dv-cinder-852009-8-iscsi devstack@n-api.service[120740]: DEBUG nova.policy [None req-41f2c881-5a7d-4bb0-a23a-c433421fc091 tempest-AttachVolumeShelveTestJSON-385853788 tempest-AttachVolumeShelveTestJSON-385853788-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'e68ecd9b3ca643539b109f75bb242d6f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '75e14fd88bfb4cd896fa7b070a0fac47', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120740) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 18:07:02.522095 dv-cinder-852009-8-iscsi devstack@n-api.service[120740]: INFO nova.api.openstack.requestlog [None req-41f2c881-5a7d-4bb0-a23a-c433421fc091 tempest-AttachVolumeShelveTestJSON-385853788 tempest-AttachVolumeShelveTestJSON-385853788-project] 10.222.0.43 "GET /compute/v2.1/servers/8cecf08e-bea8-4cef-9439-0eaa242bfed1" status: 200 len: 1722 microversion: 2.20 time: 0.521372 Sep 13 18:07:02.522653 dv-cinder-852009-8-iscsi devstack@n-api.service[120740]: [pid: 120740|app: 0|req: 300/589] 10.222.0.43 () {60 vars in 1277 bytes} [Tue Sep 13 18:07:01 2022] GET /compute/v2.1/servers/8cecf08e-bea8-4cef-9439-0eaa242bfed1 => generated 1722 bytes in 523 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Sep 13 18:07:02.523038 dv-cinder-852009-8-iscsi devstack@n-api.service[120741]: INFO nova.api.openstack.requestlog [None req-eb659f2c-8090-4770-ac95-8ed76873174c tempest-TestShelveInstance-6258502 tempest-TestShelveInstance-6258502-project] 10.222.0.43 "GET /compute/v2.1/servers/2d60cc6d-a699-417d-aa20-fe3e1bfc351e" status: 200 len: 1519 microversion: 2.1 time: 0.500349 Sep 13 18:07:02.523595 dv-cinder-852009-8-iscsi devstack@n-api.service[120741]: [pid: 120741|app: 0|req: 290/590] 10.222.0.43 () {58 vars in 1236 bytes} [Tue Sep 13 18:07:02 2022] GET /compute/v2.1/servers/2d60cc6d-a699-417d-aa20-fe3e1bfc351e => generated 1519 bytes in 501 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 13 18:07:03.351118 dv-cinder-852009-8-iscsi devstack@n-api.service[120740]: DEBUG nova.api.openstack.wsgi [req-6311879a-6a72-456f-9127-849ea8f063ee req-23f51127-4398-4cb8-b024-3ba6b6c13b04 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "2d60cc6d-a699-417d-aa20-fe3e1bfc351e", "name": "network-vif-unplugged", "status": "completed", "tag": "fa199ada-f924-4f1a-9116-5daf985f618d"}]} {{(pid=120740) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 13 18:07:03.364026 dv-cinder-852009-8-iscsi devstack@n-api.service[120740]: DEBUG oslo_concurrency.lockutils [req-6311879a-6a72-456f-9127-849ea8f063ee req-23f51127-4398-4cb8-b024-3ba6b6c13b04 service nova] Acquiring lock "1daf4f4c-0e4a-4779-b53a-78c48397ea2f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120740) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 18:07:03.364825 dv-cinder-852009-8-iscsi devstack@n-api.service[120740]: DEBUG oslo_concurrency.lockutils [req-6311879a-6a72-456f-9127-849ea8f063ee req-23f51127-4398-4cb8-b024-3ba6b6c13b04 service nova] Lock "1daf4f4c-0e4a-4779-b53a-78c48397ea2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120740) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 18:07:03.365415 dv-cinder-852009-8-iscsi devstack@n-api.service[120740]: DEBUG oslo_concurrency.lockutils [req-6311879a-6a72-456f-9127-849ea8f063ee req-23f51127-4398-4cb8-b024-3ba6b6c13b04 service nova] Lock "1daf4f4c-0e4a-4779-b53a-78c48397ea2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120740) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 18:07:03.379758 dv-cinder-852009-8-iscsi devstack@n-api.service[120740]: INFO nova.api.openstack.compute.server_external_events [req-6311879a-6a72-456f-9127-849ea8f063ee req-23f51127-4398-4cb8-b024-3ba6b6c13b04 service nova] Creating event network-vif-unplugged:fa199ada-f924-4f1a-9116-5daf985f618d for instance 2d60cc6d-a699-417d-aa20-fe3e1bfc351e on hv-cinder-85200 Sep 13 18:07:03.385333 dv-cinder-852009-8-iscsi devstack@n-api.service[120740]: INFO nova.api.openstack.requestlog [req-6311879a-6a72-456f-9127-849ea8f063ee req-23f51127-4398-4cb8-b024-3ba6b6c13b04 service nova] 10.222.0.43 "POST /compute/v2.1/os-server-external-events" status: 200 len: 185 microversion: 2.1 time: 0.053017 Sep 13 18:07:03.386088 dv-cinder-852009-8-iscsi devstack@n-api.service[120740]: [pid: 120740|app: 0|req: 301/591] 10.222.0.43 () {64 vars in 1317 bytes} [Tue Sep 13 18:07:03 2022] POST /compute/v2.1/os-server-external-events => generated 185 bytes in 55 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 13 18:07:03.546048 dv-cinder-852009-8-iscsi devstack@n-api.service[120741]: DEBUG nova.api.openstack.wsgi [None req-80921231-ef85-4a62-84a6-9248d934c81a tempest-TestShelveInstance-6258502 tempest-TestShelveInstance-6258502-project] Calling method '>' {{(pid=120741) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 18:07:03.547263 dv-cinder-852009-8-iscsi devstack@n-api.service[120741]: DEBUG nova.compute.api [None req-80921231-ef85-4a62-84a6-9248d934c81a tempest-TestShelveInstance-6258502 tempest-TestShelveInstance-6258502-project] [instance: 2d60cc6d-a699-417d-aa20-fe3e1bfc351e] Fetching instance by UUID {{(pid=120741) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 18:07:03.548159 dv-cinder-852009-8-iscsi devstack@n-api.service[120740]: DEBUG nova.api.openstack.wsgi [None req-3193c0c4-09ef-4d01-8d92-4a882e422d2b tempest-AttachVolumeShelveTestJSON-385853788 tempest-AttachVolumeShelveTestJSON-385853788-project] Calling method '>' {{(pid=120740) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 18:07:03.548904 dv-cinder-852009-8-iscsi devstack@n-api.service[120740]: DEBUG nova.compute.api [None req-3193c0c4-09ef-4d01-8d92-4a882e422d2b tempest-AttachVolumeShelveTestJSON-385853788 tempest-AttachVolumeShelveTestJSON-385853788-project] [instance: 8cecf08e-bea8-4cef-9439-0eaa242bfed1] Fetching instance by UUID {{(pid=120740) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 18:07:03.554087 dv-cinder-852009-8-iscsi devstack@n-api.service[120741]: DEBUG oslo_concurrency.lockutils [None req-80921231-ef85-4a62-84a6-9248d934c81a tempest-TestShelveInstance-6258502 tempest-TestShelveInstance-6258502-project] Acquiring lock "1daf4f4c-0e4a-4779-b53a-78c48397ea2f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120741) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 18:07:03.554565 dv-cinder-852009-8-iscsi devstack@n-api.service[120741]: DEBUG oslo_concurrency.lockutils [None req-80921231-ef85-4a62-84a6-9248d934c81a tempest-TestShelveInstance-6258502 tempest-TestShelveInstance-6258502-project] Lock "1daf4f4c-0e4a-4779-b53a-78c48397ea2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120741) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 18:07:03.554988 dv-cinder-852009-8-iscsi devstack@n-api.service[120741]: DEBUG oslo_concurrency.lockutils [None req-80921231-ef85-4a62-84a6-9248d934c81a tempest-TestShelveInstance-6258502 tempest-TestShelveInstance-6258502-project] Lock "1daf4f4c-0e4a-4779-b53a-78c48397ea2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120741) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 18:07:03.555499 dv-cinder-852009-8-iscsi devstack@n-api.service[120740]: DEBUG oslo_concurrency.lockutils [None req-3193c0c4-09ef-4d01-8d92-4a882e422d2b tempest-AttachVolumeShelveTestJSON-385853788 tempest-AttachVolumeShelveTestJSON-385853788-project] Acquiring lock "1daf4f4c-0e4a-4779-b53a-78c48397ea2f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120740) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 18:07:03.555667 dv-cinder-852009-8-iscsi devstack@n-api.service[120741]: DEBUG oslo_concurrency.lockutils [None req-80921231-ef85-4a62-84a6-9248d934c81a tempest-TestShelveInstance-6258502 tempest-TestShelveInstance-6258502-project] Acquiring lock "1daf4f4c-0e4a-4779-b53a-78c48397ea2f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120741) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 18:07:03.555995 dv-cinder-852009-8-iscsi devstack@n-api.service[120740]: DEBUG oslo_concurrency.lockutils [None req-3193c0c4-09ef-4d01-8d92-4a882e422d2b tempest-AttachVolumeShelveTestJSON-385853788 tempest-AttachVolumeShelveTestJSON-385853788-project] Lock "1daf4f4c-0e4a-4779-b53a-78c48397ea2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120740) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 18:07:03.556096 dv-cinder-852009-8-iscsi devstack@n-api.service[120741]: DEBUG oslo_concurrency.lockutils [None req-80921231-ef85-4a62-84a6-9248d934c81a tempest-TestShelveInstance-6258502 tempest-TestShelveInstance-6258502-project] Lock "1daf4f4c-0e4a-4779-b53a-78c48397ea2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120741) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 18:07:03.556453 dv-cinder-852009-8-iscsi devstack@n-api.service[120740]: DEBUG oslo_concurrency.lockutils [None req-3193c0c4-09ef-4d01-8d92-4a882e422d2b tempest-AttachVolumeShelveTestJSON-385853788 tempest-AttachVolumeShelveTestJSON-385853788-project] Lock "1daf4f4c-0e4a-4779-b53a-78c48397ea2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120740) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 18:07:03.556555 dv-cinder-852009-8-iscsi devstack@n-api.service[120741]: DEBUG oslo_concurrency.lockutils [None req-80921231-ef85-4a62-84a6-9248d934c81a tempest-TestShelveInstance-6258502 tempest-TestShelveInstance-6258502-project] Lock "1daf4f4c-0e4a-4779-b53a-78c48397ea2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120741) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 18:07:03.557151 dv-cinder-852009-8-iscsi devstack@n-api.service[120740]: DEBUG oslo_concurrency.lockutils [None req-3193c0c4-09ef-4d01-8d92-4a882e422d2b tempest-AttachVolumeShelveTestJSON-385853788 tempest-AttachVolumeShelveTestJSON-385853788-project] Acquiring lock "1daf4f4c-0e4a-4779-b53a-78c48397ea2f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120740) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 18:07:03.557608 dv-cinder-852009-8-iscsi devstack@n-api.service[120740]: DEBUG oslo_concurrency.lockutils [None req-3193c0c4-09ef-4d01-8d92-4a882e422d2b tempest-AttachVolumeShelveTestJSON-385853788 tempest-AttachVolumeShelveTestJSON-385853788-project] Lock "1daf4f4c-0e4a-4779-b53a-78c48397ea2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120740) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 18:07:03.558048 dv-cinder-852009-8-iscsi devstack@n-api.service[120740]: DEBUG oslo_concurrency.lockutils [None req-3193c0c4-09ef-4d01-8d92-4a882e422d2b tempest-AttachVolumeShelveTestJSON-385853788 tempest-AttachVolumeShelveTestJSON-385853788-project] Lock "1daf4f4c-0e4a-4779-b53a-78c48397ea2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120740) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 18:07:03.758184 dv-cinder-852009-8-iscsi devstack@n-api.service[120741]: DEBUG nova.policy [None req-80921231-ef85-4a62-84a6-9248d934c81a tempest-TestShelveInstance-6258502 tempest-TestShelveInstance-6258502-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2ab9930d6ce54cacbb3d4fd6313294d5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5eafd54351bd4049b87ad308a3638f80', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120741) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 18:07:03.761163 dv-cinder-852009-8-iscsi devstack@n-api.service[120740]: DEBUG nova.policy [None req-3193c0c4-09ef-4d01-8d92-4a882e422d2b tempest-AttachVolumeShelveTestJSON-385853788 tempest-AttachVolumeShelveTestJSON-385853788-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e68ecd9b3ca643539b109f75bb242d6f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '75e14fd88bfb4cd896fa7b070a0fac47', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120740) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 18:07:03.767041 dv-cinder-852009-8-iscsi devstack@n-api.service[120741]: INFO nova.api.openstack.requestlog [None req-80921231-ef85-4a62-84a6-9248d934c81a tempest-TestShelveInstance-6258502 tempest-TestShelveInstance-6258502-project] 10.222.0.43 "GET /compute/v2.1/servers/2d60cc6d-a699-417d-aa20-fe3e1bfc351e" status: 200 len: 1577 microversion: 2.1 time: 0.225199 Sep 13 18:07:03.768074 dv-cinder-852009-8-iscsi devstack@n-api.service[120741]: [pid: 120741|app: 0|req: 291/592] 10.222.0.43 () {58 vars in 1236 bytes} [Tue Sep 13 18:07:03 2022] GET /compute/v2.1/servers/2d60cc6d-a699-417d-aa20-fe3e1bfc351e => generated 1577 bytes in 227 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 13 18:07:03.770315 dv-cinder-852009-8-iscsi devstack@n-api.service[120740]: DEBUG nova.policy [None req-3193c0c4-09ef-4d01-8d92-4a882e422d2b tempest-AttachVolumeShelveTestJSON-385853788 tempest-AttachVolumeShelveTestJSON-385853788-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'e68ecd9b3ca643539b109f75bb242d6f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '75e14fd88bfb4cd896fa7b070a0fac47', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120740) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 18:07:03.771788 dv-cinder-852009-8-iscsi devstack@n-api.service[120740]: DEBUG nova.policy [None req-3193c0c4-09ef-4d01-8d92-4a882e422d2b tempest-AttachVolumeShelveTestJSON-385853788 tempest-AttachVolumeShelveTestJSON-385853788-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'e68ecd9b3ca643539b109f75bb242d6f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '75e14fd88bfb4cd896fa7b070a0fac47', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120740) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 18:07:03.773004 dv-cinder-852009-8-iscsi devstack@n-api.service[120740]: INFO nova.api.openstack.requestlog [None req-3193c0c4-09ef-4d01-8d92-4a882e422d2b tempest-AttachVolumeShelveTestJSON-385853788 tempest-AttachVolumeShelveTestJSON-385853788-project] 10.222.0.43 "GET /compute/v2.1/servers/8cecf08e-bea8-4cef-9439-0eaa242bfed1" status: 200 len: 1722 microversion: 2.20 time: 0.229379 Sep 13 18:07:03.773566 dv-cinder-852009-8-iscsi devstack@n-api.service[120740]: [pid: 120740|app: 0|req: 302/593] 10.222.0.43 () {60 vars in 1277 bytes} [Tue Sep 13 18:07:03 2022] GET /compute/v2.1/servers/8cecf08e-bea8-4cef-9439-0eaa242bfed1 => generated 1722 bytes in 231 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 13 18:07:04.791392 dv-cinder-852009-8-iscsi devstack@n-api.service[120741]: DEBUG nova.api.openstack.wsgi [None req-4b613b98-1882-4d14-bac3-d1afc347516a tempest-TestShelveInstance-6258502 tempest-TestShelveInstance-6258502-project] Calling method '>' {{(pid=120741) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 18:07:04.793763 dv-cinder-852009-8-iscsi devstack@n-api.service[120741]: DEBUG nova.compute.api [None req-4b613b98-1882-4d14-bac3-d1afc347516a tempest-TestShelveInstance-6258502 tempest-TestShelveInstance-6258502-project] [instance: 2d60cc6d-a699-417d-aa20-fe3e1bfc351e] Fetching instance by UUID {{(pid=120741) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 18:07:04.800382 dv-cinder-852009-8-iscsi devstack@n-api.service[120740]: DEBUG nova.api.openstack.wsgi [None req-bf41b74f-c3be-4360-8a54-f8514e302de8 tempest-AttachVolumeShelveTestJSON-385853788 tempest-AttachVolumeShelveTestJSON-385853788-project] Calling method '>' {{(pid=120740) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 18:07:04.800998 dv-cinder-852009-8-iscsi devstack@n-api.service[120741]: DEBUG oslo_concurrency.lockutils [None req-4b613b98-1882-4d14-bac3-d1afc347516a tempest-TestShelveInstance-6258502 tempest-TestShelveInstance-6258502-project] Acquiring lock "1daf4f4c-0e4a-4779-b53a-78c48397ea2f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120741) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 18:07:04.801481 dv-cinder-852009-8-iscsi devstack@n-api.service[120741]: DEBUG oslo_concurrency.lockutils [None req-4b613b98-1882-4d14-bac3-d1afc347516a tempest-TestShelveInstance-6258502 tempest-TestShelveInstance-6258502-project] Lock "1daf4f4c-0e4a-4779-b53a-78c48397ea2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120741) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 18:07:04.801914 dv-cinder-852009-8-iscsi devstack@n-api.service[120741]: DEBUG oslo_concurrency.lockutils [None req-4b613b98-1882-4d14-bac3-d1afc347516a tempest-TestShelveInstance-6258502 tempest-TestShelveInstance-6258502-project] Lock "1daf4f4c-0e4a-4779-b53a-78c48397ea2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120741) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 18:07:04.802315 dv-cinder-852009-8-iscsi devstack@n-api.service[120740]: DEBUG nova.compute.api [None req-bf41b74f-c3be-4360-8a54-f8514e302de8 tempest-AttachVolumeShelveTestJSON-385853788 tempest-AttachVolumeShelveTestJSON-385853788-project] [instance: 8cecf08e-bea8-4cef-9439-0eaa242bfed1] Fetching instance by UUID {{(pid=120740) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 18:07:04.802649 dv-cinder-852009-8-iscsi devstack@n-api.service[120741]: DEBUG oslo_concurrency.lockutils [None req-4b613b98-1882-4d14-bac3-d1afc347516a tempest-TestShelveInstance-6258502 tempest-TestShelveInstance-6258502-project] Acquiring lock "1daf4f4c-0e4a-4779-b53a-78c48397ea2f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120741) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 18:07:04.803102 dv-cinder-852009-8-iscsi devstack@n-api.service[120741]: DEBUG oslo_concurrency.lockutils [None req-4b613b98-1882-4d14-bac3-d1afc347516a tempest-TestShelveInstance-6258502 tempest-TestShelveInstance-6258502-project] Lock "1daf4f4c-0e4a-4779-b53a-78c48397ea2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120741) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 18:07:04.803523 dv-cinder-852009-8-iscsi devstack@n-api.service[120741]: DEBUG oslo_concurrency.lockutils [None req-4b613b98-1882-4d14-bac3-d1afc347516a tempest-TestShelveInstance-6258502 tempest-TestShelveInstance-6258502-project] Lock "1daf4f4c-0e4a-4779-b53a-78c48397ea2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120741) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 18:07:04.811382 dv-cinder-852009-8-iscsi devstack@n-api.service[120740]: DEBUG oslo_concurrency.lockutils [None req-bf41b74f-c3be-4360-8a54-f8514e302de8 tempest-AttachVolumeShelveTestJSON-385853788 tempest-AttachVolumeShelveTestJSON-385853788-project] Acquiring lock "1daf4f4c-0e4a-4779-b53a-78c48397ea2f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120740) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 18:07:04.811948 dv-cinder-852009-8-iscsi devstack@n-api.service[120740]: DEBUG oslo_concurrency.lockutils [None req-bf41b74f-c3be-4360-8a54-f8514e302de8 tempest-AttachVolumeShelveTestJSON-385853788 tempest-AttachVolumeShelveTestJSON-385853788-project] Lock "1daf4f4c-0e4a-4779-b53a-78c48397ea2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120740) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 18:07:04.812598 dv-cinder-852009-8-iscsi devstack@n-api.service[120740]: DEBUG oslo_concurrency.lockutils [None req-bf41b74f-c3be-4360-8a54-f8514e302de8 tempest-AttachVolumeShelveTestJSON-385853788 tempest-AttachVolumeShelveTestJSON-385853788-project] Lock "1daf4f4c-0e4a-4779-b53a-78c48397ea2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120740) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 18:07:04.813344 dv-cinder-852009-8-iscsi devstack@n-api.service[120740]: DEBUG oslo_concurrency.lockutils [None req-bf41b74f-c3be-4360-8a54-f8514e302de8 tempest-AttachVolumeShelveTestJSON-385853788 tempest-AttachVolumeShelveTestJSON-385853788-project] Acquiring lock "1daf4f4c-0e4a-4779-b53a-78c48397ea2f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120740) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 18:07:04.813890 dv-cinder-852009-8-iscsi devstack@n-api.service[120740]: DEBUG oslo_concurrency.lockutils [None req-bf41b74f-c3be-4360-8a54-f8514e302de8 tempest-AttachVolumeShelveTestJSON-385853788 tempest-AttachVolumeShelveTestJSON-385853788-project] Lock "1daf4f4c-0e4a-4779-b53a-78c48397ea2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120740) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 18:07:04.814395 dv-cinder-852009-8-iscsi devstack@n-api.service[120740]: DEBUG oslo_concurrency.lockutils [None req-bf41b74f-c3be-4360-8a54-f8514e302de8 tempest-AttachVolumeShelveTestJSON-385853788 tempest-AttachVolumeShelveTestJSON-385853788-project] Lock "1daf4f4c-0e4a-4779-b53a-78c48397ea2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120740) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 18:07:05.042453 dv-cinder-852009-8-iscsi devstack@n-api.service[120741]: DEBUG nova.policy [None req-4b613b98-1882-4d14-bac3-d1afc347516a tempest-TestShelveInstance-6258502 tempest-TestShelveInstance-6258502-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2ab9930d6ce54cacbb3d4fd6313294d5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5eafd54351bd4049b87ad308a3638f80', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120741) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 18:07:05.048846 dv-cinder-852009-8-iscsi devstack@n-api.service[120740]: DEBUG nova.policy [None req-bf41b74f-c3be-4360-8a54-f8514e302de8 tempest-AttachVolumeShelveTestJSON-385853788 tempest-AttachVolumeShelveTestJSON-385853788-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e68ecd9b3ca643539b109f75bb242d6f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '75e14fd88bfb4cd896fa7b070a0fac47', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120740) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 18:07:05.052736 dv-cinder-852009-8-iscsi devstack@n-api.service[120741]: INFO nova.api.openstack.requestlog [None req-4b613b98-1882-4d14-bac3-d1afc347516a tempest-TestShelveInstance-6258502 tempest-TestShelveInstance-6258502-project] 10.222.0.43 "GET /compute/v2.1/servers/2d60cc6d-a699-417d-aa20-fe3e1bfc351e" status: 200 len: 1577 microversion: 2.1 time: 0.265423 Sep 13 18:07:05.053322 dv-cinder-852009-8-iscsi devstack@n-api.service[120741]: [pid: 120741|app: 0|req: 292/594] 10.222.0.43 () {58 vars in 1236 bytes} [Tue Sep 13 18:07:04 2022] GET /compute/v2.1/servers/2d60cc6d-a699-417d-aa20-fe3e1bfc351e => generated 1577 bytes in 267 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 13 18:07:05.055345 dv-cinder-852009-8-iscsi devstack@n-api.service[120740]: DEBUG dbcounter [-] [120740] Writing DB stats nova_cell1:SELECT=100 {{(pid=120740) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 18:07:05.059069 dv-cinder-852009-8-iscsi devstack@n-api.service[120740]: DEBUG nova.policy [None req-bf41b74f-c3be-4360-8a54-f8514e302de8 tempest-AttachVolumeShelveTestJSON-385853788 tempest-AttachVolumeShelveTestJSON-385853788-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'e68ecd9b3ca643539b109f75bb242d6f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '75e14fd88bfb4cd896fa7b070a0fac47', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120740) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 18:07:05.060512 dv-cinder-852009-8-iscsi devstack@n-api.service[120740]: DEBUG nova.policy [None req-bf41b74f-c3be-4360-8a54-f8514e302de8 tempest-AttachVolumeShelveTestJSON-385853788 tempest-AttachVolumeShelveTestJSON-385853788-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'e68ecd9b3ca643539b109f75bb242d6f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '75e14fd88bfb4cd896fa7b070a0fac47', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120740) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 18:07:05.061700 dv-cinder-852009-8-iscsi devstack@n-api.service[120740]: INFO nova.api.openstack.requestlog [None req-bf41b74f-c3be-4360-8a54-f8514e302de8 tempest-AttachVolumeShelveTestJSON-385853788 tempest-AttachVolumeShelveTestJSON-385853788-project] 10.222.0.43 "GET /compute/v2.1/servers/8cecf08e-bea8-4cef-9439-0eaa242bfed1" status: 200 len: 1743 microversion: 2.20 time: 0.266929 Sep 13 18:07:05.062224 dv-cinder-852009-8-iscsi devstack@n-api.service[120740]: [pid: 120740|app: 0|req: 303/595] 10.222.0.43 () {60 vars in 1277 bytes} [Tue Sep 13 18:07:04 2022] GET /compute/v2.1/servers/8cecf08e-bea8-4cef-9439-0eaa242bfed1 => generated 1743 bytes in 268 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Sep 13 18:07:06.099472 dv-cinder-852009-8-iscsi devstack@n-api.service[120741]: DEBUG nova.api.openstack.wsgi [None req-6d6c2cf2-c139-44cc-9b6e-899514402d7e tempest-TestShelveInstance-6258502 tempest-TestShelveInstance-6258502-project] Calling method '>' {{(pid=120741) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 18:07:06.100624 dv-cinder-852009-8-iscsi devstack@n-api.service[120740]: DEBUG nova.api.openstack.wsgi [None req-0dd6f8f4-1ee1-4c33-8aea-5c24cd5af124 tempest-AttachVolumeShelveTestJSON-385853788 tempest-AttachVolumeShelveTestJSON-385853788-project] Calling method '>' {{(pid=120740) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 18:07:06.101281 dv-cinder-852009-8-iscsi devstack@n-api.service[120740]: DEBUG nova.compute.api [None req-0dd6f8f4-1ee1-4c33-8aea-5c24cd5af124 tempest-AttachVolumeShelveTestJSON-385853788 tempest-AttachVolumeShelveTestJSON-385853788-project] [instance: 8cecf08e-bea8-4cef-9439-0eaa242bfed1] Fetching instance by UUID {{(pid=120740) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 18:07:06.101824 dv-cinder-852009-8-iscsi devstack@n-api.service[120741]: DEBUG nova.compute.api [None req-6d6c2cf2-c139-44cc-9b6e-899514402d7e tempest-TestShelveInstance-6258502 tempest-TestShelveInstance-6258502-project] [instance: 2d60cc6d-a699-417d-aa20-fe3e1bfc351e] Fetching instance by UUID {{(pid=120741) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 18:07:06.108560 dv-cinder-852009-8-iscsi devstack@n-api.service[120741]: DEBUG oslo_concurrency.lockutils [None req-6d6c2cf2-c139-44cc-9b6e-899514402d7e tempest-TestShelveInstance-6258502 tempest-TestShelveInstance-6258502-project] Acquiring lock "1daf4f4c-0e4a-4779-b53a-78c48397ea2f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120741) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 18:07:06.109436 dv-cinder-852009-8-iscsi devstack@n-api.service[120741]: DEBUG oslo_concurrency.lockutils [None req-6d6c2cf2-c139-44cc-9b6e-899514402d7e tempest-TestShelveInstance-6258502 tempest-TestShelveInstance-6258502-project] Lock "1daf4f4c-0e4a-4779-b53a-78c48397ea2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120741) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 18:07:06.109891 dv-cinder-852009-8-iscsi devstack@n-api.service[120741]: DEBUG oslo_concurrency.lockutils [None req-6d6c2cf2-c139-44cc-9b6e-899514402d7e tempest-TestShelveInstance-6258502 tempest-TestShelveInstance-6258502-project] Lock "1daf4f4c-0e4a-4779-b53a-78c48397ea2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120741) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 18:07:06.110600 dv-cinder-852009-8-iscsi devstack@n-api.service[120741]: DEBUG oslo_concurrency.lockutils [None req-6d6c2cf2-c139-44cc-9b6e-899514402d7e tempest-TestShelveInstance-6258502 tempest-TestShelveInstance-6258502-project] Acquiring lock "1daf4f4c-0e4a-4779-b53a-78c48397ea2f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120741) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 18:07:06.111057 dv-cinder-852009-8-iscsi devstack@n-api.service[120741]: DEBUG oslo_concurrency.lockutils [None req-6d6c2cf2-c139-44cc-9b6e-899514402d7e tempest-TestShelveInstance-6258502 tempest-TestShelveInstance-6258502-project] Lock "1daf4f4c-0e4a-4779-b53a-78c48397ea2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120741) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 18:07:06.111865 dv-cinder-852009-8-iscsi devstack@n-api.service[120741]: DEBUG oslo_concurrency.lockutils [None req-6d6c2cf2-c139-44cc-9b6e-899514402d7e tempest-TestShelveInstance-6258502 tempest-TestShelveInstance-6258502-project] Lock "1daf4f4c-0e4a-4779-b53a-78c48397ea2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120741) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 18:07:06.119001 dv-cinder-852009-8-iscsi devstack@n-api.service[120740]: DEBUG oslo_concurrency.lockutils [None req-0dd6f8f4-1ee1-4c33-8aea-5c24cd5af124 tempest-AttachVolumeShelveTestJSON-385853788 tempest-AttachVolumeShelveTestJSON-385853788-project] Acquiring lock "1daf4f4c-0e4a-4779-b53a-78c48397ea2f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120740) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 18:07:06.119507 dv-cinder-852009-8-iscsi devstack@n-api.service[120740]: DEBUG oslo_concurrency.lockutils [None req-0dd6f8f4-1ee1-4c33-8aea-5c24cd5af124 tempest-AttachVolumeShelveTestJSON-385853788 tempest-AttachVolumeShelveTestJSON-385853788-project] Lock "1daf4f4c-0e4a-4779-b53a-78c48397ea2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120740) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 18:07:06.119910 dv-cinder-852009-8-iscsi devstack@n-api.service[120740]: DEBUG oslo_concurrency.lockutils [None req-0dd6f8f4-1ee1-4c33-8aea-5c24cd5af124 tempest-AttachVolumeShelveTestJSON-385853788 tempest-AttachVolumeShelveTestJSON-385853788-project] Lock "1daf4f4c-0e4a-4779-b53a-78c48397ea2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120740) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 18:07:06.120649 dv-cinder-852009-8-iscsi devstack@n-api.service[120740]: DEBUG oslo_concurrency.lockutils [None req-0dd6f8f4-1ee1-4c33-8aea-5c24cd5af124 tempest-AttachVolumeShelveTestJSON-385853788 tempest-AttachVolumeShelveTestJSON-385853788-project] Acquiring lock "1daf4f4c-0e4a-4779-b53a-78c48397ea2f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120740) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 18:07:06.121094 dv-cinder-852009-8-iscsi devstack@n-api.service[120740]: DEBUG oslo_concurrency.lockutils [None req-0dd6f8f4-1ee1-4c33-8aea-5c24cd5af124 tempest-AttachVolumeShelveTestJSON-385853788 tempest-AttachVolumeShelveTestJSON-385853788-project] Lock "1daf4f4c-0e4a-4779-b53a-78c48397ea2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120740) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 18:07:06.121508 dv-cinder-852009-8-iscsi devstack@n-api.service[120740]: DEBUG oslo_concurrency.lockutils [None req-0dd6f8f4-1ee1-4c33-8aea-5c24cd5af124 tempest-AttachVolumeShelveTestJSON-385853788 tempest-AttachVolumeShelveTestJSON-385853788-project] Lock "1daf4f4c-0e4a-4779-b53a-78c48397ea2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120740) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 18:07:06.319111 dv-cinder-852009-8-iscsi devstack@n-api.service[120740]: DEBUG nova.policy [None req-0dd6f8f4-1ee1-4c33-8aea-5c24cd5af124 tempest-AttachVolumeShelveTestJSON-385853788 tempest-AttachVolumeShelveTestJSON-385853788-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e68ecd9b3ca643539b109f75bb242d6f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '75e14fd88bfb4cd896fa7b070a0fac47', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120740) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 18:07:06.324704 dv-cinder-852009-8-iscsi devstack@n-api.service[120741]: DEBUG nova.policy [None req-6d6c2cf2-c139-44cc-9b6e-899514402d7e tempest-TestShelveInstance-6258502 tempest-TestShelveInstance-6258502-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2ab9930d6ce54cacbb3d4fd6313294d5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5eafd54351bd4049b87ad308a3638f80', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120741) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 18:07:06.328367 dv-cinder-852009-8-iscsi devstack@n-api.service[120740]: DEBUG nova.policy [None req-0dd6f8f4-1ee1-4c33-8aea-5c24cd5af124 tempest-AttachVolumeShelveTestJSON-385853788 tempest-AttachVolumeShelveTestJSON-385853788-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'e68ecd9b3ca643539b109f75bb242d6f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '75e14fd88bfb4cd896fa7b070a0fac47', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120740) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 18:07:06.330000 dv-cinder-852009-8-iscsi devstack@n-api.service[120740]: DEBUG nova.policy [None req-0dd6f8f4-1ee1-4c33-8aea-5c24cd5af124 tempest-AttachVolumeShelveTestJSON-385853788 tempest-AttachVolumeShelveTestJSON-385853788-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'e68ecd9b3ca643539b109f75bb242d6f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '75e14fd88bfb4cd896fa7b070a0fac47', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120740) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 18:07:06.331159 dv-cinder-852009-8-iscsi devstack@n-api.service[120740]: INFO nova.api.openstack.requestlog [None req-0dd6f8f4-1ee1-4c33-8aea-5c24cd5af124 tempest-AttachVolumeShelveTestJSON-385853788 tempest-AttachVolumeShelveTestJSON-385853788-project] 10.222.0.43 "GET /compute/v2.1/servers/8cecf08e-bea8-4cef-9439-0eaa242bfed1" status: 200 len: 1743 microversion: 2.20 time: 0.234788 Sep 13 18:07:06.331709 dv-cinder-852009-8-iscsi devstack@n-api.service[120740]: [pid: 120740|app: 0|req: 304/596] 10.222.0.43 () {60 vars in 1277 bytes} [Tue Sep 13 18:07:06 2022] GET /compute/v2.1/servers/8cecf08e-bea8-4cef-9439-0eaa242bfed1 => generated 1743 bytes in 236 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 13 18:07:06.333644 dv-cinder-852009-8-iscsi devstack@n-api.service[120741]: INFO nova.api.openstack.requestlog [None req-6d6c2cf2-c139-44cc-9b6e-899514402d7e tempest-TestShelveInstance-6258502 tempest-TestShelveInstance-6258502-project] 10.222.0.43 "GET /compute/v2.1/servers/2d60cc6d-a699-417d-aa20-fe3e1bfc351e" status: 200 len: 1577 microversion: 2.1 time: 0.244145 Sep 13 18:07:06.334493 dv-cinder-852009-8-iscsi devstack@n-api.service[120741]: [pid: 120741|app: 0|req: 293/597] 10.222.0.43 () {58 vars in 1236 bytes} [Tue Sep 13 18:07:06 2022] GET /compute/v2.1/servers/2d60cc6d-a699-417d-aa20-fe3e1bfc351e => generated 1577 bytes in 246 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 13 18:07:07.359734 dv-cinder-852009-8-iscsi devstack@n-api.service[120740]: DEBUG nova.api.openstack.wsgi [None req-b105b26a-c0e0-4531-bd93-c3a7c8e4621f tempest-TestShelveInstance-6258502 tempest-TestShelveInstance-6258502-project] Calling method '>' {{(pid=120740) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 18:07:07.365928 dv-cinder-852009-8-iscsi devstack@n-api.service[120741]: DEBUG nova.api.openstack.wsgi [None req-eb365bd4-1808-46b3-b9e9-58502f8bc59e tempest-AttachVolumeShelveTestJSON-385853788 tempest-AttachVolumeShelveTestJSON-385853788-project] Calling method '>' {{(pid=120741) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 18:07:07.367261 dv-cinder-852009-8-iscsi devstack@n-api.service[120741]: DEBUG nova.compute.api [None req-eb365bd4-1808-46b3-b9e9-58502f8bc59e tempest-AttachVolumeShelveTestJSON-385853788 tempest-AttachVolumeShelveTestJSON-385853788-project] [instance: 8cecf08e-bea8-4cef-9439-0eaa242bfed1] Fetching instance by UUID {{(pid=120741) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 18:07:07.368383 dv-cinder-852009-8-iscsi devstack@n-api.service[120740]: DEBUG nova.compute.api [None req-b105b26a-c0e0-4531-bd93-c3a7c8e4621f tempest-TestShelveInstance-6258502 tempest-TestShelveInstance-6258502-project] [instance: 2d60cc6d-a699-417d-aa20-fe3e1bfc351e] Fetching instance by UUID {{(pid=120740) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 18:07:07.382868 dv-cinder-852009-8-iscsi devstack@n-api.service[120740]: DEBUG oslo_concurrency.lockutils [None req-b105b26a-c0e0-4531-bd93-c3a7c8e4621f tempest-TestShelveInstance-6258502 tempest-TestShelveInstance-6258502-project] Acquiring lock "1daf4f4c-0e4a-4779-b53a-78c48397ea2f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120740) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 18:07:07.383433 dv-cinder-852009-8-iscsi devstack@n-api.service[120741]: DEBUG oslo_concurrency.lockutils [None req-eb365bd4-1808-46b3-b9e9-58502f8bc59e tempest-AttachVolumeShelveTestJSON-385853788 tempest-AttachVolumeShelveTestJSON-385853788-project] Acquiring lock "1daf4f4c-0e4a-4779-b53a-78c48397ea2f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120741) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 18:07:07.384236 dv-cinder-852009-8-iscsi devstack@n-api.service[120741]: DEBUG oslo_concurrency.lockutils [None req-eb365bd4-1808-46b3-b9e9-58502f8bc59e tempest-AttachVolumeShelveTestJSON-385853788 tempest-AttachVolumeShelveTestJSON-385853788-project] Lock "1daf4f4c-0e4a-4779-b53a-78c48397ea2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=120741) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 18:07:07.384992 dv-cinder-852009-8-iscsi devstack@n-api.service[120740]: DEBUG oslo_concurrency.lockutils [None req-b105b26a-c0e0-4531-bd93-c3a7c8e4621f tempest-TestShelveInstance-6258502 tempest-TestShelveInstance-6258502-project] Lock "1daf4f4c-0e4a-4779-b53a-78c48397ea2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120740) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 18:07:07.385800 dv-cinder-852009-8-iscsi devstack@n-api.service[120741]: DEBUG oslo_concurrency.lockutils [None req-eb365bd4-1808-46b3-b9e9-58502f8bc59e tempest-AttachVolumeShelveTestJSON-385853788 tempest-AttachVolumeShelveTestJSON-385853788-project] Lock "1daf4f4c-0e4a-4779-b53a-78c48397ea2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120741) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 18:07:07.386609 dv-cinder-852009-8-iscsi devstack@n-api.service[120740]: DEBUG oslo_concurrency.lockutils [None req-b105b26a-c0e0-4531-bd93-c3a7c8e4621f tempest-TestShelveInstance-6258502 tempest-TestShelveInstance-6258502-project] Lock "1daf4f4c-0e4a-4779-b53a-78c48397ea2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120740) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 18:07:07.388323 dv-cinder-852009-8-iscsi devstack@n-api.service[120740]: DEBUG oslo_concurrency.lockutils [None req-b105b26a-c0e0-4531-bd93-c3a7c8e4621f tempest-TestShelveInstance-6258502 tempest-TestShelveInstance-6258502-project] Acquiring lock "1daf4f4c-0e4a-4779-b53a-78c48397ea2f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120740) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 18:07:07.388805 dv-cinder-852009-8-iscsi devstack@n-api.service[120741]: DEBUG oslo_concurrency.lockutils [None req-eb365bd4-1808-46b3-b9e9-58502f8bc59e tempest-AttachVolumeShelveTestJSON-385853788 tempest-AttachVolumeShelveTestJSON-385853788-project] Acquiring lock "1daf4f4c-0e4a-4779-b53a-78c48397ea2f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120741) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 18:07:07.389487 dv-cinder-852009-8-iscsi devstack@n-api.service[120741]: DEBUG oslo_concurrency.lockutils [None req-eb365bd4-1808-46b3-b9e9-58502f8bc59e tempest-AttachVolumeShelveTestJSON-385853788 tempest-AttachVolumeShelveTestJSON-385853788-project] Lock "1daf4f4c-0e4a-4779-b53a-78c48397ea2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120741) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 18:07:07.390173 dv-cinder-852009-8-iscsi devstack@n-api.service[120740]: DEBUG oslo_concurrency.lockutils [None req-b105b26a-c0e0-4531-bd93-c3a7c8e4621f tempest-TestShelveInstance-6258502 tempest-TestShelveInstance-6258502-project] Lock "1daf4f4c-0e4a-4779-b53a-78c48397ea2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120740) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 18:07:07.390798 dv-cinder-852009-8-iscsi devstack@n-api.service[120741]: DEBUG oslo_concurrency.lockutils [None req-eb365bd4-1808-46b3-b9e9-58502f8bc59e tempest-AttachVolumeShelveTestJSON-385853788 tempest-AttachVolumeShelveTestJSON-385853788-project] Lock "1daf4f4c-0e4a-4779-b53a-78c48397ea2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120741) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 18:07:07.391418 dv-cinder-852009-8-iscsi devstack@n-api.service[120740]: DEBUG oslo_concurrency.lockutils [None req-b105b26a-c0e0-4531-bd93-c3a7c8e4621f tempest-TestShelveInstance-6258502 tempest-TestShelveInstance-6258502-project] Lock "1daf4f4c-0e4a-4779-b53a-78c48397ea2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120740) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 18:07:07.658380 dv-cinder-852009-8-iscsi devstack@n-api.service[120740]: DEBUG nova.policy [None req-b105b26a-c0e0-4531-bd93-c3a7c8e4621f tempest-TestShelveInstance-6258502 tempest-TestShelveInstance-6258502-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2ab9930d6ce54cacbb3d4fd6313294d5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5eafd54351bd4049b87ad308a3638f80', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120740) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 18:07:07.671452 dv-cinder-852009-8-iscsi devstack@n-api.service[120740]: INFO nova.api.openstack.requestlog [None req-b105b26a-c0e0-4531-bd93-c3a7c8e4621f tempest-TestShelveInstance-6258502 tempest-TestShelveInstance-6258502-project] 10.222.0.43 "GET /compute/v2.1/servers/2d60cc6d-a699-417d-aa20-fe3e1bfc351e" status: 200 len: 1577 microversion: 2.1 time: 0.316905 Sep 13 18:07:07.673806 dv-cinder-852009-8-iscsi devstack@n-api.service[120740]: [pid: 120740|app: 0|req: 305/598] 10.222.0.43 () {58 vars in 1236 bytes} [Tue Sep 13 18:07:07 2022] GET /compute/v2.1/servers/2d60cc6d-a699-417d-aa20-fe3e1bfc351e => generated 1577 bytes in 320 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 13 18:07:07.685963 dv-cinder-852009-8-iscsi devstack@n-api.service[120740]: DEBUG nova.api.openstack.wsgi [req-3846e67b-3cd0-4cdb-a947-8ee7eb905f6b req-eeea6743-5561-4163-a979-d9e67524c849 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "8cecf08e-bea8-4cef-9439-0eaa242bfed1", "name": "network-vif-plugged", "status": "completed", "tag": "cf75920d-98e9-4700-bdad-ac46b7b3f022"}]} {{(pid=120740) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 13 18:07:07.700767 dv-cinder-852009-8-iscsi devstack@n-api.service[120741]: DEBUG nova.policy [None req-eb365bd4-1808-46b3-b9e9-58502f8bc59e tempest-AttachVolumeShelveTestJSON-385853788 tempest-AttachVolumeShelveTestJSON-385853788-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e68ecd9b3ca643539b109f75bb242d6f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '75e14fd88bfb4cd896fa7b070a0fac47', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120741) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 18:07:07.701771 dv-cinder-852009-8-iscsi devstack@n-api.service[120740]: DEBUG oslo_concurrency.lockutils [req-3846e67b-3cd0-4cdb-a947-8ee7eb905f6b req-eeea6743-5561-4163-a979-d9e67524c849 service nova] Acquiring lock "1daf4f4c-0e4a-4779-b53a-78c48397ea2f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120740) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 18:07:07.702471 dv-cinder-852009-8-iscsi devstack@n-api.service[120740]: DEBUG oslo_concurrency.lockutils [req-3846e67b-3cd0-4cdb-a947-8ee7eb905f6b req-eeea6743-5561-4163-a979-d9e67524c849 service nova] Lock "1daf4f4c-0e4a-4779-b53a-78c48397ea2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120740) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 18:07:07.703300 dv-cinder-852009-8-iscsi devstack@n-api.service[120740]: DEBUG oslo_concurrency.lockutils [req-3846e67b-3cd0-4cdb-a947-8ee7eb905f6b req-eeea6743-5561-4163-a979-d9e67524c849 service nova] Lock "1daf4f4c-0e4a-4779-b53a-78c48397ea2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120740) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 18:07:07.712652 dv-cinder-852009-8-iscsi devstack@n-api.service[120741]: DEBUG nova.policy [None req-eb365bd4-1808-46b3-b9e9-58502f8bc59e tempest-AttachVolumeShelveTestJSON-385853788 tempest-AttachVolumeShelveTestJSON-385853788-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'e68ecd9b3ca643539b109f75bb242d6f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '75e14fd88bfb4cd896fa7b070a0fac47', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120741) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 18:07:07.715042 dv-cinder-852009-8-iscsi devstack@n-api.service[120741]: DEBUG nova.policy [None req-eb365bd4-1808-46b3-b9e9-58502f8bc59e tempest-AttachVolumeShelveTestJSON-385853788 tempest-AttachVolumeShelveTestJSON-385853788-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'e68ecd9b3ca643539b109f75bb242d6f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '75e14fd88bfb4cd896fa7b070a0fac47', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120741) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 18:07:07.716237 dv-cinder-852009-8-iscsi devstack@n-api.service[120741]: INFO nova.api.openstack.requestlog [None req-eb365bd4-1808-46b3-b9e9-58502f8bc59e tempest-AttachVolumeShelveTestJSON-385853788 tempest-AttachVolumeShelveTestJSON-385853788-project] 10.222.0.43 "GET /compute/v2.1/servers/8cecf08e-bea8-4cef-9439-0eaa242bfed1" status: 200 len: 1738 microversion: 2.20 time: 0.354665 Sep 13 18:07:07.716839 dv-cinder-852009-8-iscsi devstack@n-api.service[120741]: [pid: 120741|app: 0|req: 294/599] 10.222.0.43 () {60 vars in 1277 bytes} [Tue Sep 13 18:07:07 2022] GET /compute/v2.1/servers/8cecf08e-bea8-4cef-9439-0eaa242bfed1 => generated 1738 bytes in 356 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 13 18:07:07.726396 dv-cinder-852009-8-iscsi devstack@n-api.service[120740]: INFO nova.api.openstack.compute.server_external_events [req-3846e67b-3cd0-4cdb-a947-8ee7eb905f6b req-eeea6743-5561-4163-a979-d9e67524c849 service nova] Creating event network-vif-plugged:cf75920d-98e9-4700-bdad-ac46b7b3f022 for instance 8cecf08e-bea8-4cef-9439-0eaa242bfed1 on hv-cinder-85200 Sep 13 18:07:07.737420 dv-cinder-852009-8-iscsi devstack@n-api.service[120740]: INFO nova.api.openstack.requestlog [req-3846e67b-3cd0-4cdb-a947-8ee7eb905f6b req-eeea6743-5561-4163-a979-d9e67524c849 service nova] 10.222.0.43 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.062187 Sep 13 18:07:07.738197 dv-cinder-852009-8-iscsi devstack@n-api.service[120740]: [pid: 120740|app: 0|req: 306/600] 10.222.0.43 () {64 vars in 1317 bytes} [Tue Sep 13 18:07:07 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 63 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 13 18:07:08.698670 dv-cinder-852009-8-iscsi devstack@n-api.service[120741]: DEBUG nova.api.openstack.wsgi [None req-8c1572e9-b0d3-4e2b-864e-ce7c5d0b10c2 tempest-TestShelveInstance-6258502 tempest-TestShelveInstance-6258502-project] Calling method '>' {{(pid=120741) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 18:07:08.699439 dv-cinder-852009-8-iscsi devstack@n-api.service[120741]: DEBUG nova.compute.api [None req-8c1572e9-b0d3-4e2b-864e-ce7c5d0b10c2 tempest-TestShelveInstance-6258502 tempest-TestShelveInstance-6258502-project] [instance: 2d60cc6d-a699-417d-aa20-fe3e1bfc351e] Fetching instance by UUID {{(pid=120741) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 18:07:08.706178 dv-cinder-852009-8-iscsi devstack@n-api.service[120741]: DEBUG oslo_concurrency.lockutils [None req-8c1572e9-b0d3-4e2b-864e-ce7c5d0b10c2 tempest-TestShelveInstance-6258502 tempest-TestShelveInstance-6258502-project] Acquiring lock "1daf4f4c-0e4a-4779-b53a-78c48397ea2f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120741) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 18:07:08.706668 dv-cinder-852009-8-iscsi devstack@n-api.service[120741]: DEBUG oslo_concurrency.lockutils [None req-8c1572e9-b0d3-4e2b-864e-ce7c5d0b10c2 tempest-TestShelveInstance-6258502 tempest-TestShelveInstance-6258502-project] Lock "1daf4f4c-0e4a-4779-b53a-78c48397ea2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120741) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 18:07:08.707094 dv-cinder-852009-8-iscsi devstack@n-api.service[120741]: DEBUG oslo_concurrency.lockutils [None req-8c1572e9-b0d3-4e2b-864e-ce7c5d0b10c2 tempest-TestShelveInstance-6258502 tempest-TestShelveInstance-6258502-project] Lock "1daf4f4c-0e4a-4779-b53a-78c48397ea2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120741) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 18:07:08.707789 dv-cinder-852009-8-iscsi devstack@n-api.service[120741]: DEBUG oslo_concurrency.lockutils [None req-8c1572e9-b0d3-4e2b-864e-ce7c5d0b10c2 tempest-TestShelveInstance-6258502 tempest-TestShelveInstance-6258502-project] Acquiring lock "1daf4f4c-0e4a-4779-b53a-78c48397ea2f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120741) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 18:07:08.708233 dv-cinder-852009-8-iscsi devstack@n-api.service[120741]: DEBUG oslo_concurrency.lockutils [None req-8c1572e9-b0d3-4e2b-864e-ce7c5d0b10c2 tempest-TestShelveInstance-6258502 tempest-TestShelveInstance-6258502-project] Lock "1daf4f4c-0e4a-4779-b53a-78c48397ea2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120741) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 18:07:08.708688 dv-cinder-852009-8-iscsi devstack@n-api.service[120741]: DEBUG oslo_concurrency.lockutils [None req-8c1572e9-b0d3-4e2b-864e-ce7c5d0b10c2 tempest-TestShelveInstance-6258502 tempest-TestShelveInstance-6258502-project] Lock "1daf4f4c-0e4a-4779-b53a-78c48397ea2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120741) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 18:07:08.744414 dv-cinder-852009-8-iscsi devstack@n-api.service[120740]: DEBUG nova.api.openstack.wsgi [None req-a7321fc0-87a0-4ffc-bba2-9da6795c1443 tempest-AttachVolumeShelveTestJSON-385853788 tempest-AttachVolumeShelveTestJSON-385853788-project] Calling method '>' {{(pid=120740) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 18:07:08.745136 dv-cinder-852009-8-iscsi devstack@n-api.service[120740]: DEBUG nova.compute.api [None req-a7321fc0-87a0-4ffc-bba2-9da6795c1443 tempest-AttachVolumeShelveTestJSON-385853788 tempest-AttachVolumeShelveTestJSON-385853788-project] [instance: 8cecf08e-bea8-4cef-9439-0eaa242bfed1] Fetching instance by UUID {{(pid=120740) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 18:07:08.765712 dv-cinder-852009-8-iscsi devstack@n-api.service[120740]: DEBUG oslo_concurrency.lockutils [None req-a7321fc0-87a0-4ffc-bba2-9da6795c1443 tempest-AttachVolumeShelveTestJSON-385853788 tempest-AttachVolumeShelveTestJSON-385853788-project] Acquiring lock "1daf4f4c-0e4a-4779-b53a-78c48397ea2f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120740) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 18:07:08.766207 dv-cinder-852009-8-iscsi devstack@n-api.service[120740]: DEBUG oslo_concurrency.lockutils [None req-a7321fc0-87a0-4ffc-bba2-9da6795c1443 tempest-AttachVolumeShelveTestJSON-385853788 tempest-AttachVolumeShelveTestJSON-385853788-project] Lock "1daf4f4c-0e4a-4779-b53a-78c48397ea2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120740) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 18:07:08.766636 dv-cinder-852009-8-iscsi devstack@n-api.service[120740]: DEBUG oslo_concurrency.lockutils [None req-a7321fc0-87a0-4ffc-bba2-9da6795c1443 tempest-AttachVolumeShelveTestJSON-385853788 tempest-AttachVolumeShelveTestJSON-385853788-project] Lock "1daf4f4c-0e4a-4779-b53a-78c48397ea2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120740) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 18:07:08.767374 dv-cinder-852009-8-iscsi devstack@n-api.service[120740]: DEBUG oslo_concurrency.lockutils [None req-a7321fc0-87a0-4ffc-bba2-9da6795c1443 tempest-AttachVolumeShelveTestJSON-385853788 tempest-AttachVolumeShelveTestJSON-385853788-project] Acquiring lock "1daf4f4c-0e4a-4779-b53a-78c48397ea2f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120740) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 18:07:08.767825 dv-cinder-852009-8-iscsi devstack@n-api.service[120740]: DEBUG oslo_concurrency.lockutils [None req-a7321fc0-87a0-4ffc-bba2-9da6795c1443 tempest-AttachVolumeShelveTestJSON-385853788 tempest-AttachVolumeShelveTestJSON-385853788-project] Lock "1daf4f4c-0e4a-4779-b53a-78c48397ea2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120740) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 18:07:08.768460 dv-cinder-852009-8-iscsi devstack@n-api.service[120740]: DEBUG oslo_concurrency.lockutils [None req-a7321fc0-87a0-4ffc-bba2-9da6795c1443 tempest-AttachVolumeShelveTestJSON-385853788 tempest-AttachVolumeShelveTestJSON-385853788-project] Lock "1daf4f4c-0e4a-4779-b53a-78c48397ea2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120740) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 18:07:08.985396 dv-cinder-852009-8-iscsi devstack@n-api.service[120741]: DEBUG nova.policy [None req-8c1572e9-b0d3-4e2b-864e-ce7c5d0b10c2 tempest-TestShelveInstance-6258502 tempest-TestShelveInstance-6258502-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2ab9930d6ce54cacbb3d4fd6313294d5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5eafd54351bd4049b87ad308a3638f80', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120741) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 18:07:08.989270 dv-cinder-852009-8-iscsi devstack@n-api.service[120740]: DEBUG nova.policy [None req-a7321fc0-87a0-4ffc-bba2-9da6795c1443 tempest-AttachVolumeShelveTestJSON-385853788 tempest-AttachVolumeShelveTestJSON-385853788-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e68ecd9b3ca643539b109f75bb242d6f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '75e14fd88bfb4cd896fa7b070a0fac47', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120740) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 18:07:08.995553 dv-cinder-852009-8-iscsi devstack@n-api.service[120741]: INFO nova.api.openstack.requestlog [None req-8c1572e9-b0d3-4e2b-864e-ce7c5d0b10c2 tempest-TestShelveInstance-6258502 tempest-TestShelveInstance-6258502-project] 10.222.0.43 "GET /compute/v2.1/servers/2d60cc6d-a699-417d-aa20-fe3e1bfc351e" status: 200 len: 1577 microversion: 2.1 time: 0.303058 Sep 13 18:07:08.996592 dv-cinder-852009-8-iscsi devstack@n-api.service[120741]: [pid: 120741|app: 0|req: 295/601] 10.222.0.43 () {58 vars in 1236 bytes} [Tue Sep 13 18:07:08 2022] GET /compute/v2.1/servers/2d60cc6d-a699-417d-aa20-fe3e1bfc351e => generated 1577 bytes in 305 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 13 18:07:09.007927 dv-cinder-852009-8-iscsi devstack@n-api.service[120740]: DEBUG nova.policy [None req-a7321fc0-87a0-4ffc-bba2-9da6795c1443 tempest-AttachVolumeShelveTestJSON-385853788 tempest-AttachVolumeShelveTestJSON-385853788-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'e68ecd9b3ca643539b109f75bb242d6f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '75e14fd88bfb4cd896fa7b070a0fac47', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120740) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 18:07:09.007927 dv-cinder-852009-8-iscsi devstack@n-api.service[120740]: DEBUG nova.policy [None req-a7321fc0-87a0-4ffc-bba2-9da6795c1443 tempest-AttachVolumeShelveTestJSON-385853788 tempest-AttachVolumeShelveTestJSON-385853788-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'e68ecd9b3ca643539b109f75bb242d6f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '75e14fd88bfb4cd896fa7b070a0fac47', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120740) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 18:07:09.007927 dv-cinder-852009-8-iscsi devstack@n-api.service[120740]: INFO nova.api.openstack.requestlog [None req-a7321fc0-87a0-4ffc-bba2-9da6795c1443 tempest-AttachVolumeShelveTestJSON-385853788 tempest-AttachVolumeShelveTestJSON-385853788-project] 10.222.0.43 "GET /compute/v2.1/servers/8cecf08e-bea8-4cef-9439-0eaa242bfed1" status: 200 len: 1738 microversion: 2.20 time: 0.261177 Sep 13 18:07:09.008357 dv-cinder-852009-8-iscsi devstack@n-api.service[120740]: [pid: 120740|app: 0|req: 307/602] 10.222.0.43 () {60 vars in 1277 bytes} [Tue Sep 13 18:07:08 2022] GET /compute/v2.1/servers/8cecf08e-bea8-4cef-9439-0eaa242bfed1 => generated 1738 bytes in 262 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 13 18:07:10.023182 dv-cinder-852009-8-iscsi devstack@n-api.service[120740]: DEBUG nova.api.openstack.wsgi [None req-e9f6e393-b42c-45a9-8228-b9b307f49852 tempest-TestShelveInstance-6258502 tempest-TestShelveInstance-6258502-project] Calling method '>' {{(pid=120740) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 18:07:10.024658 dv-cinder-852009-8-iscsi devstack@n-api.service[120740]: DEBUG nova.compute.api [None req-e9f6e393-b42c-45a9-8228-b9b307f49852 tempest-TestShelveInstance-6258502 tempest-TestShelveInstance-6258502-project] [instance: 2d60cc6d-a699-417d-aa20-fe3e1bfc351e] Fetching instance by UUID {{(pid=120740) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 18:07:10.031341 dv-cinder-852009-8-iscsi devstack@n-api.service[120740]: DEBUG oslo_concurrency.lockutils [None req-e9f6e393-b42c-45a9-8228-b9b307f49852 tempest-TestShelveInstance-6258502 tempest-TestShelveInstance-6258502-project] Acquiring lock "1daf4f4c-0e4a-4779-b53a-78c48397ea2f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120740) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 18:07:10.032185 dv-cinder-852009-8-iscsi devstack@n-api.service[120740]: DEBUG oslo_concurrency.lockutils [None req-e9f6e393-b42c-45a9-8228-b9b307f49852 tempest-TestShelveInstance-6258502 tempest-TestShelveInstance-6258502-project] Lock "1daf4f4c-0e4a-4779-b53a-78c48397ea2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120740) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 18:07:10.032803 dv-cinder-852009-8-iscsi devstack@n-api.service[120740]: DEBUG oslo_concurrency.lockutils [None req-e9f6e393-b42c-45a9-8228-b9b307f49852 tempest-TestShelveInstance-6258502 tempest-TestShelveInstance-6258502-project] Lock "1daf4f4c-0e4a-4779-b53a-78c48397ea2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120740) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 18:07:10.033718 dv-cinder-852009-8-iscsi devstack@n-api.service[120740]: DEBUG oslo_concurrency.lockutils [None req-e9f6e393-b42c-45a9-8228-b9b307f49852 tempest-TestShelveInstance-6258502 tempest-TestShelveInstance-6258502-project] Acquiring lock "1daf4f4c-0e4a-4779-b53a-78c48397ea2f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120740) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 18:07:10.034208 dv-cinder-852009-8-iscsi devstack@n-api.service[120740]: DEBUG oslo_concurrency.lockutils [None req-e9f6e393-b42c-45a9-8228-b9b307f49852 tempest-TestShelveInstance-6258502 tempest-TestShelveInstance-6258502-project] Lock "1daf4f4c-0e4a-4779-b53a-78c48397ea2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120740) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 18:07:10.034611 dv-cinder-852009-8-iscsi devstack@n-api.service[120740]: DEBUG oslo_concurrency.lockutils [None req-e9f6e393-b42c-45a9-8228-b9b307f49852 tempest-TestShelveInstance-6258502 tempest-TestShelveInstance-6258502-project] Lock "1daf4f4c-0e4a-4779-b53a-78c48397ea2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120740) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 18:07:10.037526 dv-cinder-852009-8-iscsi devstack@n-api.service[120741]: DEBUG nova.api.openstack.wsgi [None req-64092946-65ed-47f5-b35c-c836bd8c3c28 tempest-AttachVolumeShelveTestJSON-385853788 tempest-AttachVolumeShelveTestJSON-385853788-project] Calling method '>' {{(pid=120741) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 18:07:10.038851 dv-cinder-852009-8-iscsi devstack@n-api.service[120741]: DEBUG nova.compute.api [None req-64092946-65ed-47f5-b35c-c836bd8c3c28 tempest-AttachVolumeShelveTestJSON-385853788 tempest-AttachVolumeShelveTestJSON-385853788-project] [instance: 8cecf08e-bea8-4cef-9439-0eaa242bfed1] Fetching instance by UUID {{(pid=120741) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 18:07:10.046518 dv-cinder-852009-8-iscsi devstack@n-api.service[120741]: DEBUG oslo_concurrency.lockutils [None req-64092946-65ed-47f5-b35c-c836bd8c3c28 tempest-AttachVolumeShelveTestJSON-385853788 tempest-AttachVolumeShelveTestJSON-385853788-project] Acquiring lock "1daf4f4c-0e4a-4779-b53a-78c48397ea2f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120741) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 18:07:10.047263 dv-cinder-852009-8-iscsi devstack@n-api.service[120741]: DEBUG oslo_concurrency.lockutils [None req-64092946-65ed-47f5-b35c-c836bd8c3c28 tempest-AttachVolumeShelveTestJSON-385853788 tempest-AttachVolumeShelveTestJSON-385853788-project] Lock "1daf4f4c-0e4a-4779-b53a-78c48397ea2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120741) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 18:07:10.047858 dv-cinder-852009-8-iscsi devstack@n-api.service[120741]: DEBUG oslo_concurrency.lockutils [None req-64092946-65ed-47f5-b35c-c836bd8c3c28 tempest-AttachVolumeShelveTestJSON-385853788 tempest-AttachVolumeShelveTestJSON-385853788-project] Lock "1daf4f4c-0e4a-4779-b53a-78c48397ea2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120741) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 18:07:10.048952 dv-cinder-852009-8-iscsi devstack@n-api.service[120741]: DEBUG oslo_concurrency.lockutils [None req-64092946-65ed-47f5-b35c-c836bd8c3c28 tempest-AttachVolumeShelveTestJSON-385853788 tempest-AttachVolumeShelveTestJSON-385853788-project] Acquiring lock "1daf4f4c-0e4a-4779-b53a-78c48397ea2f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120741) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 18:07:10.049615 dv-cinder-852009-8-iscsi devstack@n-api.service[120741]: DEBUG oslo_concurrency.lockutils [None req-64092946-65ed-47f5-b35c-c836bd8c3c28 tempest-AttachVolumeShelveTestJSON-385853788 tempest-AttachVolumeShelveTestJSON-385853788-project] Lock "1daf4f4c-0e4a-4779-b53a-78c48397ea2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120741) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 18:07:10.050189 dv-cinder-852009-8-iscsi devstack@n-api.service[120741]: DEBUG oslo_concurrency.lockutils [None req-64092946-65ed-47f5-b35c-c836bd8c3c28 tempest-AttachVolumeShelveTestJSON-385853788 tempest-AttachVolumeShelveTestJSON-385853788-project] Lock "1daf4f4c-0e4a-4779-b53a-78c48397ea2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120741) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 18:07:10.258454 dv-cinder-852009-8-iscsi devstack@n-api.service[120740]: DEBUG nova.policy [None req-e9f6e393-b42c-45a9-8228-b9b307f49852 tempest-TestShelveInstance-6258502 tempest-TestShelveInstance-6258502-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2ab9930d6ce54cacbb3d4fd6313294d5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5eafd54351bd4049b87ad308a3638f80', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120740) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 18:07:10.263296 dv-cinder-852009-8-iscsi devstack@n-api.service[120741]: DEBUG nova.policy [None req-64092946-65ed-47f5-b35c-c836bd8c3c28 tempest-AttachVolumeShelveTestJSON-385853788 tempest-AttachVolumeShelveTestJSON-385853788-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e68ecd9b3ca643539b109f75bb242d6f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '75e14fd88bfb4cd896fa7b070a0fac47', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120741) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 18:07:10.266458 dv-cinder-852009-8-iscsi devstack@n-api.service[120740]: INFO nova.api.openstack.requestlog [None req-e9f6e393-b42c-45a9-8228-b9b307f49852 tempest-TestShelveInstance-6258502 tempest-TestShelveInstance-6258502-project] 10.222.0.43 "GET /compute/v2.1/servers/2d60cc6d-a699-417d-aa20-fe3e1bfc351e" status: 200 len: 1577 microversion: 2.1 time: 0.247141 Sep 13 18:07:10.267236 dv-cinder-852009-8-iscsi devstack@n-api.service[120740]: [pid: 120740|app: 0|req: 308/603] 10.222.0.43 () {58 vars in 1236 bytes} [Tue Sep 13 18:07:10 2022] GET /compute/v2.1/servers/2d60cc6d-a699-417d-aa20-fe3e1bfc351e => generated 1577 bytes in 249 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 13 18:07:10.277207 dv-cinder-852009-8-iscsi devstack@n-api.service[120741]: DEBUG nova.policy [None req-64092946-65ed-47f5-b35c-c836bd8c3c28 tempest-AttachVolumeShelveTestJSON-385853788 tempest-AttachVolumeShelveTestJSON-385853788-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'e68ecd9b3ca643539b109f75bb242d6f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '75e14fd88bfb4cd896fa7b070a0fac47', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120741) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 18:07:10.278651 dv-cinder-852009-8-iscsi devstack@n-api.service[120741]: DEBUG nova.policy [None req-64092946-65ed-47f5-b35c-c836bd8c3c28 tempest-AttachVolumeShelveTestJSON-385853788 tempest-AttachVolumeShelveTestJSON-385853788-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'e68ecd9b3ca643539b109f75bb242d6f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '75e14fd88bfb4cd896fa7b070a0fac47', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120741) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 18:07:10.279877 dv-cinder-852009-8-iscsi devstack@n-api.service[120741]: INFO nova.api.openstack.requestlog [None req-64092946-65ed-47f5-b35c-c836bd8c3c28 tempest-AttachVolumeShelveTestJSON-385853788 tempest-AttachVolumeShelveTestJSON-385853788-project] 10.222.0.43 "GET /compute/v2.1/servers/8cecf08e-bea8-4cef-9439-0eaa242bfed1" status: 200 len: 1738 microversion: 2.20 time: 0.246596 Sep 13 18:07:10.280456 dv-cinder-852009-8-iscsi devstack@n-api.service[120741]: [pid: 120741|app: 0|req: 296/604] 10.222.0.43 () {60 vars in 1277 bytes} [Tue Sep 13 18:07:10 2022] GET /compute/v2.1/servers/8cecf08e-bea8-4cef-9439-0eaa242bfed1 => generated 1738 bytes in 248 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Sep 13 18:07:10.715909 dv-cinder-852009-8-iscsi devstack@n-api.service[120740]: DEBUG nova.api.openstack.wsgi [None req-b1ef0a8e-ebc7-47d8-924d-32e721abb9a9 tempest-AttachVolumeTestJSON-555093534 tempest-AttachVolumeTestJSON-555093534-project] Calling method '>' {{(pid=120740) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 18:07:10.716404 dv-cinder-852009-8-iscsi devstack@n-api.service[120740]: DEBUG nova.compute.api [None req-b1ef0a8e-ebc7-47d8-924d-32e721abb9a9 tempest-AttachVolumeTestJSON-555093534 tempest-AttachVolumeTestJSON-555093534-project] [instance: d0983ec1-bb82-4a7d-9dba-ace1e3eb383a] Fetching instance by UUID {{(pid=120740) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 18:07:10.723519 dv-cinder-852009-8-iscsi devstack@n-api.service[120740]: DEBUG oslo_concurrency.lockutils [None req-b1ef0a8e-ebc7-47d8-924d-32e721abb9a9 tempest-AttachVolumeTestJSON-555093534 tempest-AttachVolumeTestJSON-555093534-project] Acquiring lock "1daf4f4c-0e4a-4779-b53a-78c48397ea2f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120740) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 18:07:10.724044 dv-cinder-852009-8-iscsi devstack@n-api.service[120740]: DEBUG oslo_concurrency.lockutils [None req-b1ef0a8e-ebc7-47d8-924d-32e721abb9a9 tempest-AttachVolumeTestJSON-555093534 tempest-AttachVolumeTestJSON-555093534-project] Lock "1daf4f4c-0e4a-4779-b53a-78c48397ea2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120740) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 18:07:10.724505 dv-cinder-852009-8-iscsi devstack@n-api.service[120740]: DEBUG oslo_concurrency.lockutils [None req-b1ef0a8e-ebc7-47d8-924d-32e721abb9a9 tempest-AttachVolumeTestJSON-555093534 tempest-AttachVolumeTestJSON-555093534-project] Lock "1daf4f4c-0e4a-4779-b53a-78c48397ea2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120740) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 18:07:10.725211 dv-cinder-852009-8-iscsi devstack@n-api.service[120740]: DEBUG oslo_concurrency.lockutils [None req-b1ef0a8e-ebc7-47d8-924d-32e721abb9a9 tempest-AttachVolumeTestJSON-555093534 tempest-AttachVolumeTestJSON-555093534-project] Acquiring lock "1daf4f4c-0e4a-4779-b53a-78c48397ea2f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120740) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 18:07:10.725695 dv-cinder-852009-8-iscsi devstack@n-api.service[120740]: DEBUG oslo_concurrency.lockutils [None req-b1ef0a8e-ebc7-47d8-924d-32e721abb9a9 tempest-AttachVolumeTestJSON-555093534 tempest-AttachVolumeTestJSON-555093534-project] Lock "1daf4f4c-0e4a-4779-b53a-78c48397ea2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120740) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 18:07:10.726296 dv-cinder-852009-8-iscsi devstack@n-api.service[120740]: DEBUG oslo_concurrency.lockutils [None req-b1ef0a8e-ebc7-47d8-924d-32e721abb9a9 tempest-AttachVolumeTestJSON-555093534 tempest-AttachVolumeTestJSON-555093534-project] Lock "1daf4f4c-0e4a-4779-b53a-78c48397ea2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120740) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 18:07:10.754917 dv-cinder-852009-8-iscsi devstack@n-api.service[120740]: INFO nova.api.openstack.requestlog [None req-b1ef0a8e-ebc7-47d8-924d-32e721abb9a9 tempest-AttachVolumeTestJSON-555093534 tempest-AttachVolumeTestJSON-555093534-project] 10.222.0.43 "GET /compute/v2.1/servers/d0983ec1-bb82-4a7d-9dba-ace1e3eb383a/ips" status: 200 len: 147 microversion: 2.1 time: 0.240876 Sep 13 18:07:10.755645 dv-cinder-852009-8-iscsi devstack@n-api.service[120740]: [pid: 120740|app: 0|req: 309/605] 10.222.0.43 () {58 vars in 1248 bytes} [Tue Sep 13 18:07:10 2022] GET /compute/v2.1/servers/d0983ec1-bb82-4a7d-9dba-ace1e3eb383a/ips => generated 147 bytes in 242 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 13 18:07:11.290423 dv-cinder-852009-8-iscsi devstack@n-api.service[120741]: DEBUG nova.api.openstack.wsgi [None req-43c1f886-c456-45e3-931c-ffd2499ad5e5 tempest-TestShelveInstance-6258502 tempest-TestShelveInstance-6258502-project] Calling method '>' {{(pid=120741) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 18:07:11.291701 dv-cinder-852009-8-iscsi devstack@n-api.service[120741]: DEBUG nova.compute.api [None req-43c1f886-c456-45e3-931c-ffd2499ad5e5 tempest-TestShelveInstance-6258502 tempest-TestShelveInstance-6258502-project] [instance: 2d60cc6d-a699-417d-aa20-fe3e1bfc351e] Fetching instance by UUID {{(pid=120741) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 18:07:11.298505 dv-cinder-852009-8-iscsi devstack@n-api.service[120741]: DEBUG oslo_concurrency.lockutils [None req-43c1f886-c456-45e3-931c-ffd2499ad5e5 tempest-TestShelveInstance-6258502 tempest-TestShelveInstance-6258502-project] Acquiring lock "1daf4f4c-0e4a-4779-b53a-78c48397ea2f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120741) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 18:07:11.300266 dv-cinder-852009-8-iscsi devstack@n-api.service[120741]: DEBUG oslo_concurrency.lockutils [None req-43c1f886-c456-45e3-931c-ffd2499ad5e5 tempest-TestShelveInstance-6258502 tempest-TestShelveInstance-6258502-project] Lock "1daf4f4c-0e4a-4779-b53a-78c48397ea2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120741) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 18:07:11.300266 dv-cinder-852009-8-iscsi devstack@n-api.service[120741]: DEBUG oslo_concurrency.lockutils [None req-43c1f886-c456-45e3-931c-ffd2499ad5e5 tempest-TestShelveInstance-6258502 tempest-TestShelveInstance-6258502-project] Lock "1daf4f4c-0e4a-4779-b53a-78c48397ea2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120741) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 18:07:11.300266 dv-cinder-852009-8-iscsi devstack@n-api.service[120741]: DEBUG oslo_concurrency.lockutils [None req-43c1f886-c456-45e3-931c-ffd2499ad5e5 tempest-TestShelveInstance-6258502 tempest-TestShelveInstance-6258502-project] Acquiring lock "1daf4f4c-0e4a-4779-b53a-78c48397ea2f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120741) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 18:07:11.305399 dv-cinder-852009-8-iscsi devstack@n-api.service[120740]: DEBUG nova.api.openstack.wsgi [None req-0fffedfe-4a05-4553-a7e0-70e969e8135f tempest-AttachVolumeShelveTestJSON-385853788 tempest-AttachVolumeShelveTestJSON-385853788-project] Calling method '>' {{(pid=120740) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 18:07:11.306540 dv-cinder-852009-8-iscsi devstack@n-api.service[120740]: DEBUG nova.compute.api [None req-0fffedfe-4a05-4553-a7e0-70e969e8135f tempest-AttachVolumeShelveTestJSON-385853788 tempest-AttachVolumeShelveTestJSON-385853788-project] [instance: 8cecf08e-bea8-4cef-9439-0eaa242bfed1] Fetching instance by UUID {{(pid=120740) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 18:07:11.310619 dv-cinder-852009-8-iscsi devstack@n-api.service[120741]: DEBUG oslo_concurrency.lockutils [None req-43c1f886-c456-45e3-931c-ffd2499ad5e5 tempest-TestShelveInstance-6258502 tempest-TestShelveInstance-6258502-project] Lock "1daf4f4c-0e4a-4779-b53a-78c48397ea2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.010s {{(pid=120741) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 18:07:11.312953 dv-cinder-852009-8-iscsi devstack@n-api.service[120741]: DEBUG oslo_concurrency.lockutils [None req-43c1f886-c456-45e3-931c-ffd2499ad5e5 tempest-TestShelveInstance-6258502 tempest-TestShelveInstance-6258502-project] Lock "1daf4f4c-0e4a-4779-b53a-78c48397ea2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120741) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 18:07:11.316353 dv-cinder-852009-8-iscsi devstack@n-api.service[120740]: DEBUG oslo_concurrency.lockutils [None req-0fffedfe-4a05-4553-a7e0-70e969e8135f tempest-AttachVolumeShelveTestJSON-385853788 tempest-AttachVolumeShelveTestJSON-385853788-project] Acquiring lock "1daf4f4c-0e4a-4779-b53a-78c48397ea2f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120740) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 18:07:11.319801 dv-cinder-852009-8-iscsi devstack@n-api.service[120740]: DEBUG oslo_concurrency.lockutils [None req-0fffedfe-4a05-4553-a7e0-70e969e8135f tempest-AttachVolumeShelveTestJSON-385853788 tempest-AttachVolumeShelveTestJSON-385853788-project] Lock "1daf4f4c-0e4a-4779-b53a-78c48397ea2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=120740) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 18:07:11.320233 dv-cinder-852009-8-iscsi devstack@n-api.service[120740]: DEBUG oslo_concurrency.lockutils [None req-0fffedfe-4a05-4553-a7e0-70e969e8135f tempest-AttachVolumeShelveTestJSON-385853788 tempest-AttachVolumeShelveTestJSON-385853788-project] Lock "1daf4f4c-0e4a-4779-b53a-78c48397ea2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120740) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 18:07:11.321003 dv-cinder-852009-8-iscsi devstack@n-api.service[120740]: DEBUG oslo_concurrency.lockutils [None req-0fffedfe-4a05-4553-a7e0-70e969e8135f tempest-AttachVolumeShelveTestJSON-385853788 tempest-AttachVolumeShelveTestJSON-385853788-project] Acquiring lock "1daf4f4c-0e4a-4779-b53a-78c48397ea2f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120740) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 18:07:11.321608 dv-cinder-852009-8-iscsi devstack@n-api.service[120740]: DEBUG oslo_concurrency.lockutils [None req-0fffedfe-4a05-4553-a7e0-70e969e8135f tempest-AttachVolumeShelveTestJSON-385853788 tempest-AttachVolumeShelveTestJSON-385853788-project] Lock "1daf4f4c-0e4a-4779-b53a-78c48397ea2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120740) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 18:07:11.322221 dv-cinder-852009-8-iscsi devstack@n-api.service[120740]: DEBUG oslo_concurrency.lockutils [None req-0fffedfe-4a05-4553-a7e0-70e969e8135f tempest-AttachVolumeShelveTestJSON-385853788 tempest-AttachVolumeShelveTestJSON-385853788-project] Lock "1daf4f4c-0e4a-4779-b53a-78c48397ea2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120740) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 18:07:11.563294 dv-cinder-852009-8-iscsi devstack@n-api.service[120740]: DEBUG nova.policy [None req-0fffedfe-4a05-4553-a7e0-70e969e8135f tempest-AttachVolumeShelveTestJSON-385853788 tempest-AttachVolumeShelveTestJSON-385853788-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e68ecd9b3ca643539b109f75bb242d6f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '75e14fd88bfb4cd896fa7b070a0fac47', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120740) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 18:07:11.568952 dv-cinder-852009-8-iscsi devstack@n-api.service[120741]: DEBUG nova.policy [None req-43c1f886-c456-45e3-931c-ffd2499ad5e5 tempest-TestShelveInstance-6258502 tempest-TestShelveInstance-6258502-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2ab9930d6ce54cacbb3d4fd6313294d5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5eafd54351bd4049b87ad308a3638f80', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120741) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 18:07:11.580655 dv-cinder-852009-8-iscsi devstack@n-api.service[120741]: INFO nova.api.openstack.requestlog [None req-43c1f886-c456-45e3-931c-ffd2499ad5e5 tempest-TestShelveInstance-6258502 tempest-TestShelveInstance-6258502-project] 10.222.0.43 "GET /compute/v2.1/servers/2d60cc6d-a699-417d-aa20-fe3e1bfc351e" status: 200 len: 1577 microversion: 2.1 time: 0.294138 Sep 13 18:07:11.581475 dv-cinder-852009-8-iscsi devstack@n-api.service[120741]: [pid: 120741|app: 0|req: 297/606] 10.222.0.43 () {58 vars in 1236 bytes} [Tue Sep 13 18:07:11 2022] GET /compute/v2.1/servers/2d60cc6d-a699-417d-aa20-fe3e1bfc351e => generated 1577 bytes in 296 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 13 18:07:11.584784 dv-cinder-852009-8-iscsi devstack@n-api.service[120740]: DEBUG nova.policy [None req-0fffedfe-4a05-4553-a7e0-70e969e8135f tempest-AttachVolumeShelveTestJSON-385853788 tempest-AttachVolumeShelveTestJSON-385853788-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'e68ecd9b3ca643539b109f75bb242d6f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '75e14fd88bfb4cd896fa7b070a0fac47', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120740) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 18:07:11.586542 dv-cinder-852009-8-iscsi devstack@n-api.service[120740]: DEBUG nova.policy [None req-0fffedfe-4a05-4553-a7e0-70e969e8135f tempest-AttachVolumeShelveTestJSON-385853788 tempest-AttachVolumeShelveTestJSON-385853788-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'e68ecd9b3ca643539b109f75bb242d6f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '75e14fd88bfb4cd896fa7b070a0fac47', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120740) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 18:07:11.588262 dv-cinder-852009-8-iscsi devstack@n-api.service[120740]: INFO nova.api.openstack.requestlog [None req-0fffedfe-4a05-4553-a7e0-70e969e8135f tempest-AttachVolumeShelveTestJSON-385853788 tempest-AttachVolumeShelveTestJSON-385853788-project] 10.222.0.43 "GET /compute/v2.1/servers/8cecf08e-bea8-4cef-9439-0eaa242bfed1" status: 200 len: 1738 microversion: 2.20 time: 0.286786 Sep 13 18:07:11.589581 dv-cinder-852009-8-iscsi devstack@n-api.service[120740]: [pid: 120740|app: 0|req: 310/607] 10.222.0.43 () {60 vars in 1277 bytes} [Tue Sep 13 18:07:11 2022] GET /compute/v2.1/servers/8cecf08e-bea8-4cef-9439-0eaa242bfed1 => generated 1738 bytes in 289 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 13 18:07:12.605287 dv-cinder-852009-8-iscsi devstack@n-api.service[120741]: DEBUG nova.api.openstack.wsgi [None req-eec3bb6e-b5b1-4690-b182-d4607f36f6cb tempest-TestShelveInstance-6258502 tempest-TestShelveInstance-6258502-project] Calling method '>' {{(pid=120741) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 18:07:12.605876 dv-cinder-852009-8-iscsi devstack@n-api.service[120741]: DEBUG nova.compute.api [None req-eec3bb6e-b5b1-4690-b182-d4607f36f6cb tempest-TestShelveInstance-6258502 tempest-TestShelveInstance-6258502-project] [instance: 2d60cc6d-a699-417d-aa20-fe3e1bfc351e] Fetching instance by UUID {{(pid=120741) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 18:07:12.613326 dv-cinder-852009-8-iscsi devstack@n-api.service[120741]: DEBUG oslo_concurrency.lockutils [None req-eec3bb6e-b5b1-4690-b182-d4607f36f6cb tempest-TestShelveInstance-6258502 tempest-TestShelveInstance-6258502-project] Acquiring lock "1daf4f4c-0e4a-4779-b53a-78c48397ea2f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120741) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 18:07:12.616041 dv-cinder-852009-8-iscsi devstack@n-api.service[120741]: DEBUG oslo_concurrency.lockutils [None req-eec3bb6e-b5b1-4690-b182-d4607f36f6cb tempest-TestShelveInstance-6258502 tempest-TestShelveInstance-6258502-project] Lock "1daf4f4c-0e4a-4779-b53a-78c48397ea2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120741) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 18:07:12.616041 dv-cinder-852009-8-iscsi devstack@n-api.service[120741]: DEBUG oslo_concurrency.lockutils [None req-eec3bb6e-b5b1-4690-b182-d4607f36f6cb tempest-TestShelveInstance-6258502 tempest-TestShelveInstance-6258502-project] Lock "1daf4f4c-0e4a-4779-b53a-78c48397ea2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120741) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 18:07:12.616041 dv-cinder-852009-8-iscsi devstack@n-api.service[120741]: DEBUG oslo_concurrency.lockutils [None req-eec3bb6e-b5b1-4690-b182-d4607f36f6cb tempest-TestShelveInstance-6258502 tempest-TestShelveInstance-6258502-project] Acquiring lock "1daf4f4c-0e4a-4779-b53a-78c48397ea2f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120741) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 18:07:12.616041 dv-cinder-852009-8-iscsi devstack@n-api.service[120741]: DEBUG oslo_concurrency.lockutils [None req-eec3bb6e-b5b1-4690-b182-d4607f36f6cb tempest-TestShelveInstance-6258502 tempest-TestShelveInstance-6258502-project] Lock "1daf4f4c-0e4a-4779-b53a-78c48397ea2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120741) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 18:07:12.616593 dv-cinder-852009-8-iscsi devstack@n-api.service[120741]: DEBUG oslo_concurrency.lockutils [None req-eec3bb6e-b5b1-4690-b182-d4607f36f6cb tempest-TestShelveInstance-6258502 tempest-TestShelveInstance-6258502-project] Lock "1daf4f4c-0e4a-4779-b53a-78c48397ea2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120741) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 18:07:12.624149 dv-cinder-852009-8-iscsi devstack@n-api.service[120740]: DEBUG nova.api.openstack.wsgi [None req-71a5e835-1f95-4104-8add-847099b277a6 tempest-AttachVolumeShelveTestJSON-385853788 tempest-AttachVolumeShelveTestJSON-385853788-project] Calling method '>' {{(pid=120740) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 18:07:12.629312 dv-cinder-852009-8-iscsi devstack@n-api.service[120740]: DEBUG nova.compute.api [None req-71a5e835-1f95-4104-8add-847099b277a6 tempest-AttachVolumeShelveTestJSON-385853788 tempest-AttachVolumeShelveTestJSON-385853788-project] [instance: 8cecf08e-bea8-4cef-9439-0eaa242bfed1] Fetching instance by UUID {{(pid=120740) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 18:07:12.647104 dv-cinder-852009-8-iscsi devstack@n-api.service[120740]: DEBUG oslo_concurrency.lockutils [None req-71a5e835-1f95-4104-8add-847099b277a6 tempest-AttachVolumeShelveTestJSON-385853788 tempest-AttachVolumeShelveTestJSON-385853788-project] Acquiring lock "1daf4f4c-0e4a-4779-b53a-78c48397ea2f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120740) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 18:07:12.649630 dv-cinder-852009-8-iscsi devstack@n-api.service[120740]: DEBUG oslo_concurrency.lockutils [None req-71a5e835-1f95-4104-8add-847099b277a6 tempest-AttachVolumeShelveTestJSON-385853788 tempest-AttachVolumeShelveTestJSON-385853788-project] Lock "1daf4f4c-0e4a-4779-b53a-78c48397ea2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120740) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 18:07:12.652573 dv-cinder-852009-8-iscsi devstack@n-api.service[120740]: DEBUG oslo_concurrency.lockutils [None req-71a5e835-1f95-4104-8add-847099b277a6 tempest-AttachVolumeShelveTestJSON-385853788 tempest-AttachVolumeShelveTestJSON-385853788-project] Lock "1daf4f4c-0e4a-4779-b53a-78c48397ea2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120740) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 18:07:12.653674 dv-cinder-852009-8-iscsi devstack@n-api.service[120740]: DEBUG oslo_concurrency.lockutils [None req-71a5e835-1f95-4104-8add-847099b277a6 tempest-AttachVolumeShelveTestJSON-385853788 tempest-AttachVolumeShelveTestJSON-385853788-project] Acquiring lock "1daf4f4c-0e4a-4779-b53a-78c48397ea2f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120740) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 18:07:12.654313 dv-cinder-852009-8-iscsi devstack@n-api.service[120740]: DEBUG oslo_concurrency.lockutils [None req-71a5e835-1f95-4104-8add-847099b277a6 tempest-AttachVolumeShelveTestJSON-385853788 tempest-AttachVolumeShelveTestJSON-385853788-project] Lock "1daf4f4c-0e4a-4779-b53a-78c48397ea2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120740) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 18:07:12.656051 dv-cinder-852009-8-iscsi devstack@n-api.service[120740]: DEBUG oslo_concurrency.lockutils [None req-71a5e835-1f95-4104-8add-847099b277a6 tempest-AttachVolumeShelveTestJSON-385853788 tempest-AttachVolumeShelveTestJSON-385853788-project] Lock "1daf4f4c-0e4a-4779-b53a-78c48397ea2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120740) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 18:07:12.838309 dv-cinder-852009-8-iscsi devstack@n-api.service[120741]: DEBUG nova.policy [None req-eec3bb6e-b5b1-4690-b182-d4607f36f6cb tempest-TestShelveInstance-6258502 tempest-TestShelveInstance-6258502-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2ab9930d6ce54cacbb3d4fd6313294d5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5eafd54351bd4049b87ad308a3638f80', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120741) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 18:07:12.841690 dv-cinder-852009-8-iscsi devstack@n-api.service[120741]: DEBUG dbcounter [-] [120741] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=120741) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 18:07:12.847142 dv-cinder-852009-8-iscsi devstack@n-api.service[120741]: INFO nova.api.openstack.requestlog [None req-eec3bb6e-b5b1-4690-b182-d4607f36f6cb tempest-TestShelveInstance-6258502 tempest-TestShelveInstance-6258502-project] 10.222.0.43 "GET /compute/v2.1/servers/2d60cc6d-a699-417d-aa20-fe3e1bfc351e" status: 200 len: 1577 microversion: 2.1 time: 0.246198 Sep 13 18:07:12.851200 dv-cinder-852009-8-iscsi devstack@n-api.service[120741]: [pid: 120741|app: 0|req: 298/608] 10.222.0.43 () {58 vars in 1236 bytes} [Tue Sep 13 18:07:12 2022] GET /compute/v2.1/servers/2d60cc6d-a699-417d-aa20-fe3e1bfc351e => generated 1577 bytes in 251 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 13 18:07:12.907547 dv-cinder-852009-8-iscsi devstack@n-api.service[120740]: DEBUG nova.policy [None req-71a5e835-1f95-4104-8add-847099b277a6 tempest-AttachVolumeShelveTestJSON-385853788 tempest-AttachVolumeShelveTestJSON-385853788-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e68ecd9b3ca643539b109f75bb242d6f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '75e14fd88bfb4cd896fa7b070a0fac47', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120740) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 18:07:12.916127 dv-cinder-852009-8-iscsi devstack@n-api.service[120740]: DEBUG nova.policy [None req-71a5e835-1f95-4104-8add-847099b277a6 tempest-AttachVolumeShelveTestJSON-385853788 tempest-AttachVolumeShelveTestJSON-385853788-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'e68ecd9b3ca643539b109f75bb242d6f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '75e14fd88bfb4cd896fa7b070a0fac47', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120740) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 18:07:12.917802 dv-cinder-852009-8-iscsi devstack@n-api.service[120740]: DEBUG nova.policy [None req-71a5e835-1f95-4104-8add-847099b277a6 tempest-AttachVolumeShelveTestJSON-385853788 tempest-AttachVolumeShelveTestJSON-385853788-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'e68ecd9b3ca643539b109f75bb242d6f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '75e14fd88bfb4cd896fa7b070a0fac47', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120740) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 18:07:12.919139 dv-cinder-852009-8-iscsi devstack@n-api.service[120740]: INFO nova.api.openstack.requestlog [None req-71a5e835-1f95-4104-8add-847099b277a6 tempest-AttachVolumeShelveTestJSON-385853788 tempest-AttachVolumeShelveTestJSON-385853788-project] 10.222.0.43 "GET /compute/v2.1/servers/8cecf08e-bea8-4cef-9439-0eaa242bfed1" status: 200 len: 1738 microversion: 2.20 time: 0.305695 Sep 13 18:07:12.920486 dv-cinder-852009-8-iscsi devstack@n-api.service[120740]: [pid: 120740|app: 0|req: 311/609] 10.222.0.43 () {60 vars in 1277 bytes} [Tue Sep 13 18:07:12 2022] GET /compute/v2.1/servers/8cecf08e-bea8-4cef-9439-0eaa242bfed1 => generated 1738 bytes in 308 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 13 18:07:13.238041 dv-cinder-852009-8-iscsi devstack@n-api.service[120741]: DEBUG nova.api.openstack.wsgi [None req-10435735-bd61-419f-964c-41e43e012073 tempest-AttachVolumeTestJSON-555093534 tempest-AttachVolumeTestJSON-555093534-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "167cdb89-8f77-41eb-81a5-1a7af5798e0d"}} {{(pid=120741) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 13 18:07:13.241499 dv-cinder-852009-8-iscsi devstack@n-api.service[120741]: DEBUG nova.compute.api [None req-10435735-bd61-419f-964c-41e43e012073 tempest-AttachVolumeTestJSON-555093534 tempest-AttachVolumeTestJSON-555093534-project] [instance: d0983ec1-bb82-4a7d-9dba-ace1e3eb383a] Fetching instance by UUID {{(pid=120741) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 18:07:13.258991 dv-cinder-852009-8-iscsi devstack@n-api.service[120741]: DEBUG oslo_concurrency.lockutils [None req-10435735-bd61-419f-964c-41e43e012073 tempest-AttachVolumeTestJSON-555093534 tempest-AttachVolumeTestJSON-555093534-project] Acquiring lock "1daf4f4c-0e4a-4779-b53a-78c48397ea2f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120741) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 18:07:13.260305 dv-cinder-852009-8-iscsi devstack@n-api.service[120741]: DEBUG oslo_concurrency.lockutils [None req-10435735-bd61-419f-964c-41e43e012073 tempest-AttachVolumeTestJSON-555093534 tempest-AttachVolumeTestJSON-555093534-project] Lock "1daf4f4c-0e4a-4779-b53a-78c48397ea2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120741) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 18:07:13.260305 dv-cinder-852009-8-iscsi devstack@n-api.service[120741]: DEBUG oslo_concurrency.lockutils [None req-10435735-bd61-419f-964c-41e43e012073 tempest-AttachVolumeTestJSON-555093534 tempest-AttachVolumeTestJSON-555093534-project] Lock "1daf4f4c-0e4a-4779-b53a-78c48397ea2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120741) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 18:07:13.263186 dv-cinder-852009-8-iscsi devstack@n-api.service[120741]: DEBUG oslo_concurrency.lockutils [None req-10435735-bd61-419f-964c-41e43e012073 tempest-AttachVolumeTestJSON-555093534 tempest-AttachVolumeTestJSON-555093534-project] Acquiring lock "1daf4f4c-0e4a-4779-b53a-78c48397ea2f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120741) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 18:07:13.264899 dv-cinder-852009-8-iscsi devstack@n-api.service[120741]: DEBUG oslo_concurrency.lockutils [None req-10435735-bd61-419f-964c-41e43e012073 tempest-AttachVolumeTestJSON-555093534 tempest-AttachVolumeTestJSON-555093534-project] Lock "1daf4f4c-0e4a-4779-b53a-78c48397ea2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120741) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 18:07:13.266600 dv-cinder-852009-8-iscsi devstack@n-api.service[120741]: DEBUG oslo_concurrency.lockutils [None req-10435735-bd61-419f-964c-41e43e012073 tempest-AttachVolumeTestJSON-555093534 tempest-AttachVolumeTestJSON-555093534-project] Lock "1daf4f4c-0e4a-4779-b53a-78c48397ea2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120741) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 18:07:13.651055 dv-cinder-852009-8-iscsi devstack@n-api.service[120741]: INFO nova.api.openstack.requestlog [None req-10435735-bd61-419f-964c-41e43e012073 tempest-AttachVolumeTestJSON-555093534 tempest-AttachVolumeTestJSON-555093534-project] 10.222.0.43 "POST /compute/v2.1/servers/d0983ec1-bb82-4a7d-9dba-ace1e3eb383a/os-volume_attachments" status: 200 len: 194 microversion: 2.1 time: 0.417684 Sep 13 18:07:13.651993 dv-cinder-852009-8-iscsi devstack@n-api.service[120741]: [pid: 120741|app: 0|req: 299/610] 10.222.0.43 () {60 vars in 1323 bytes} [Tue Sep 13 18:07:13 2022] POST /compute/v2.1/servers/d0983ec1-bb82-4a7d-9dba-ace1e3eb383a/os-volume_attachments => generated 194 bytes in 420 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 13 18:07:13.876015 dv-cinder-852009-8-iscsi devstack@n-api.service[120740]: DEBUG nova.api.openstack.wsgi [None req-78b91476-5082-4c0c-b825-4d7d14cea3ca tempest-TestShelveInstance-6258502 tempest-TestShelveInstance-6258502-project] Calling method '>' {{(pid=120740) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 18:07:13.876705 dv-cinder-852009-8-iscsi devstack@n-api.service[120740]: DEBUG nova.compute.api [None req-78b91476-5082-4c0c-b825-4d7d14cea3ca tempest-TestShelveInstance-6258502 tempest-TestShelveInstance-6258502-project] [instance: 2d60cc6d-a699-417d-aa20-fe3e1bfc351e] Fetching instance by UUID {{(pid=120740) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 18:07:13.884017 dv-cinder-852009-8-iscsi devstack@n-api.service[120740]: DEBUG oslo_concurrency.lockutils [None req-78b91476-5082-4c0c-b825-4d7d14cea3ca tempest-TestShelveInstance-6258502 tempest-TestShelveInstance-6258502-project] Acquiring lock "1daf4f4c-0e4a-4779-b53a-78c48397ea2f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120740) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 18:07:13.884582 dv-cinder-852009-8-iscsi devstack@n-api.service[120740]: DEBUG oslo_concurrency.lockutils [None req-78b91476-5082-4c0c-b825-4d7d14cea3ca tempest-TestShelveInstance-6258502 tempest-TestShelveInstance-6258502-project] Lock "1daf4f4c-0e4a-4779-b53a-78c48397ea2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120740) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 18:07:13.885215 dv-cinder-852009-8-iscsi devstack@n-api.service[120740]: DEBUG oslo_concurrency.lockutils [None req-78b91476-5082-4c0c-b825-4d7d14cea3ca tempest-TestShelveInstance-6258502 tempest-TestShelveInstance-6258502-project] Lock "1daf4f4c-0e4a-4779-b53a-78c48397ea2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120740) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 18:07:13.886081 dv-cinder-852009-8-iscsi devstack@n-api.service[120740]: DEBUG oslo_concurrency.lockutils [None req-78b91476-5082-4c0c-b825-4d7d14cea3ca tempest-TestShelveInstance-6258502 tempest-TestShelveInstance-6258502-project] Acquiring lock "1daf4f4c-0e4a-4779-b53a-78c48397ea2f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120740) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 18:07:13.886689 dv-cinder-852009-8-iscsi devstack@n-api.service[120740]: DEBUG oslo_concurrency.lockutils [None req-78b91476-5082-4c0c-b825-4d7d14cea3ca tempest-TestShelveInstance-6258502 tempest-TestShelveInstance-6258502-project] Lock "1daf4f4c-0e4a-4779-b53a-78c48397ea2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120740) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 18:07:13.887280 dv-cinder-852009-8-iscsi devstack@n-api.service[120740]: DEBUG oslo_concurrency.lockutils [None req-78b91476-5082-4c0c-b825-4d7d14cea3ca tempest-TestShelveInstance-6258502 tempest-TestShelveInstance-6258502-project] Lock "1daf4f4c-0e4a-4779-b53a-78c48397ea2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120740) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 18:07:13.952819 dv-cinder-852009-8-iscsi devstack@n-api.service[120741]: DEBUG nova.api.openstack.wsgi [None req-8af33af2-3310-4c53-8219-300243a0926b tempest-AttachVolumeShelveTestJSON-385853788 tempest-AttachVolumeShelveTestJSON-385853788-project] Calling method '>' {{(pid=120741) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 18:07:13.953824 dv-cinder-852009-8-iscsi devstack@n-api.service[120741]: DEBUG nova.compute.api [None req-8af33af2-3310-4c53-8219-300243a0926b tempest-AttachVolumeShelveTestJSON-385853788 tempest-AttachVolumeShelveTestJSON-385853788-project] [instance: 8cecf08e-bea8-4cef-9439-0eaa242bfed1] Fetching instance by UUID {{(pid=120741) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 18:07:13.964325 dv-cinder-852009-8-iscsi devstack@n-api.service[120741]: DEBUG oslo_concurrency.lockutils [None req-8af33af2-3310-4c53-8219-300243a0926b tempest-AttachVolumeShelveTestJSON-385853788 tempest-AttachVolumeShelveTestJSON-385853788-project] Acquiring lock "1daf4f4c-0e4a-4779-b53a-78c48397ea2f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120741) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 18:07:13.966840 dv-cinder-852009-8-iscsi devstack@n-api.service[120741]: DEBUG oslo_concurrency.lockutils [None req-8af33af2-3310-4c53-8219-300243a0926b tempest-AttachVolumeShelveTestJSON-385853788 tempest-AttachVolumeShelveTestJSON-385853788-project] Lock "1daf4f4c-0e4a-4779-b53a-78c48397ea2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120741) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 18:07:13.967442 dv-cinder-852009-8-iscsi devstack@n-api.service[120741]: DEBUG oslo_concurrency.lockutils [None req-8af33af2-3310-4c53-8219-300243a0926b tempest-AttachVolumeShelveTestJSON-385853788 tempest-AttachVolumeShelveTestJSON-385853788-project] Lock "1daf4f4c-0e4a-4779-b53a-78c48397ea2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120741) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 18:07:13.968982 dv-cinder-852009-8-iscsi devstack@n-api.service[120741]: DEBUG oslo_concurrency.lockutils [None req-8af33af2-3310-4c53-8219-300243a0926b tempest-AttachVolumeShelveTestJSON-385853788 tempest-AttachVolumeShelveTestJSON-385853788-project] Acquiring lock "1daf4f4c-0e4a-4779-b53a-78c48397ea2f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120741) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 18:07:13.971300 dv-cinder-852009-8-iscsi devstack@n-api.service[120741]: DEBUG oslo_concurrency.lockutils [None req-8af33af2-3310-4c53-8219-300243a0926b tempest-AttachVolumeShelveTestJSON-385853788 tempest-AttachVolumeShelveTestJSON-385853788-project] Lock "1daf4f4c-0e4a-4779-b53a-78c48397ea2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120741) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 18:07:13.973100 dv-cinder-852009-8-iscsi devstack@n-api.service[120741]: DEBUG oslo_concurrency.lockutils [None req-8af33af2-3310-4c53-8219-300243a0926b tempest-AttachVolumeShelveTestJSON-385853788 tempest-AttachVolumeShelveTestJSON-385853788-project] Lock "1daf4f4c-0e4a-4779-b53a-78c48397ea2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120741) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 18:07:14.183796 dv-cinder-852009-8-iscsi devstack@n-api.service[120740]: DEBUG nova.policy [None req-78b91476-5082-4c0c-b825-4d7d14cea3ca tempest-TestShelveInstance-6258502 tempest-TestShelveInstance-6258502-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2ab9930d6ce54cacbb3d4fd6313294d5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5eafd54351bd4049b87ad308a3638f80', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120740) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 18:07:14.196740 dv-cinder-852009-8-iscsi devstack@n-api.service[120740]: INFO nova.api.openstack.requestlog [None req-78b91476-5082-4c0c-b825-4d7d14cea3ca tempest-TestShelveInstance-6258502 tempest-TestShelveInstance-6258502-project] 10.222.0.43 "GET /compute/v2.1/servers/2d60cc6d-a699-417d-aa20-fe3e1bfc351e" status: 200 len: 1577 microversion: 2.1 time: 0.324943 Sep 13 18:07:14.197608 dv-cinder-852009-8-iscsi devstack@n-api.service[120740]: [pid: 120740|app: 0|req: 312/611] 10.222.0.43 () {58 vars in 1236 bytes} [Tue Sep 13 18:07:13 2022] GET /compute/v2.1/servers/2d60cc6d-a699-417d-aa20-fe3e1bfc351e => generated 1577 bytes in 327 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 13 18:07:14.215911 dv-cinder-852009-8-iscsi devstack@n-api.service[120741]: DEBUG nova.policy [None req-8af33af2-3310-4c53-8219-300243a0926b tempest-AttachVolumeShelveTestJSON-385853788 tempest-AttachVolumeShelveTestJSON-385853788-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e68ecd9b3ca643539b109f75bb242d6f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '75e14fd88bfb4cd896fa7b070a0fac47', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120741) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 18:07:14.224409 dv-cinder-852009-8-iscsi devstack@n-api.service[120741]: DEBUG nova.policy [None req-8af33af2-3310-4c53-8219-300243a0926b tempest-AttachVolumeShelveTestJSON-385853788 tempest-AttachVolumeShelveTestJSON-385853788-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'e68ecd9b3ca643539b109f75bb242d6f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '75e14fd88bfb4cd896fa7b070a0fac47', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120741) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 18:07:14.225999 dv-cinder-852009-8-iscsi devstack@n-api.service[120741]: DEBUG nova.policy [None req-8af33af2-3310-4c53-8219-300243a0926b tempest-AttachVolumeShelveTestJSON-385853788 tempest-AttachVolumeShelveTestJSON-385853788-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'e68ecd9b3ca643539b109f75bb242d6f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '75e14fd88bfb4cd896fa7b070a0fac47', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120741) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 18:07:14.227572 dv-cinder-852009-8-iscsi devstack@n-api.service[120741]: INFO nova.api.openstack.requestlog [None req-8af33af2-3310-4c53-8219-300243a0926b tempest-AttachVolumeShelveTestJSON-385853788 tempest-AttachVolumeShelveTestJSON-385853788-project] 10.222.0.43 "GET /compute/v2.1/servers/8cecf08e-bea8-4cef-9439-0eaa242bfed1" status: 200 len: 1738 microversion: 2.20 time: 0.280181 Sep 13 18:07:14.228239 dv-cinder-852009-8-iscsi devstack@n-api.service[120741]: [pid: 120741|app: 0|req: 300/612] 10.222.0.43 () {60 vars in 1277 bytes} [Tue Sep 13 18:07:13 2022] GET /compute/v2.1/servers/8cecf08e-bea8-4cef-9439-0eaa242bfed1 => generated 1738 bytes in 282 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 13 18:07:15.221245 dv-cinder-852009-8-iscsi devstack@n-api.service[120740]: DEBUG nova.api.openstack.wsgi [None req-9de7f297-9331-4fac-bcca-ccdbf062ced4 tempest-TestShelveInstance-6258502 tempest-TestShelveInstance-6258502-project] Calling method '>' {{(pid=120740) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 18:07:15.222722 dv-cinder-852009-8-iscsi devstack@n-api.service[120740]: DEBUG nova.compute.api [None req-9de7f297-9331-4fac-bcca-ccdbf062ced4 tempest-TestShelveInstance-6258502 tempest-TestShelveInstance-6258502-project] [instance: 2d60cc6d-a699-417d-aa20-fe3e1bfc351e] Fetching instance by UUID {{(pid=120740) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 18:07:15.233563 dv-cinder-852009-8-iscsi devstack@n-api.service[120740]: DEBUG oslo_concurrency.lockutils [None req-9de7f297-9331-4fac-bcca-ccdbf062ced4 tempest-TestShelveInstance-6258502 tempest-TestShelveInstance-6258502-project] Acquiring lock "1daf4f4c-0e4a-4779-b53a-78c48397ea2f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120740) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 18:07:15.233980 dv-cinder-852009-8-iscsi devstack@n-api.service[120740]: DEBUG oslo_concurrency.lockutils [None req-9de7f297-9331-4fac-bcca-ccdbf062ced4 tempest-TestShelveInstance-6258502 tempest-TestShelveInstance-6258502-project] Lock "1daf4f4c-0e4a-4779-b53a-78c48397ea2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120740) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 18:07:15.234384 dv-cinder-852009-8-iscsi devstack@n-api.service[120740]: DEBUG oslo_concurrency.lockutils [None req-9de7f297-9331-4fac-bcca-ccdbf062ced4 tempest-TestShelveInstance-6258502 tempest-TestShelveInstance-6258502-project] Lock "1daf4f4c-0e4a-4779-b53a-78c48397ea2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120740) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 18:07:15.235060 dv-cinder-852009-8-iscsi devstack@n-api.service[120740]: DEBUG oslo_concurrency.lockutils [None req-9de7f297-9331-4fac-bcca-ccdbf062ced4 tempest-TestShelveInstance-6258502 tempest-TestShelveInstance-6258502-project] Acquiring lock "1daf4f4c-0e4a-4779-b53a-78c48397ea2f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120740) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 18:07:15.235518 dv-cinder-852009-8-iscsi devstack@n-api.service[120740]: DEBUG oslo_concurrency.lockutils [None req-9de7f297-9331-4fac-bcca-ccdbf062ced4 tempest-TestShelveInstance-6258502 tempest-TestShelveInstance-6258502-project] Lock "1daf4f4c-0e4a-4779-b53a-78c48397ea2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120740) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 18:07:15.235985 dv-cinder-852009-8-iscsi devstack@n-api.service[120740]: DEBUG oslo_concurrency.lockutils [None req-9de7f297-9331-4fac-bcca-ccdbf062ced4 tempest-TestShelveInstance-6258502 tempest-TestShelveInstance-6258502-project] Lock "1daf4f4c-0e4a-4779-b53a-78c48397ea2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120740) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 18:07:15.255091 dv-cinder-852009-8-iscsi devstack@n-api.service[120741]: DEBUG nova.api.openstack.wsgi [None req-a13082e5-18f4-41a5-bb9b-9aa30ac22907 tempest-AttachVolumeShelveTestJSON-385853788 tempest-AttachVolumeShelveTestJSON-385853788-project] Calling method '>' {{(pid=120741) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 18:07:15.256510 dv-cinder-852009-8-iscsi devstack@n-api.service[120741]: DEBUG nova.compute.api [None req-a13082e5-18f4-41a5-bb9b-9aa30ac22907 tempest-AttachVolumeShelveTestJSON-385853788 tempest-AttachVolumeShelveTestJSON-385853788-project] [instance: 8cecf08e-bea8-4cef-9439-0eaa242bfed1] Fetching instance by UUID {{(pid=120741) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 18:07:15.263003 dv-cinder-852009-8-iscsi devstack@n-api.service[120741]: DEBUG dbcounter [-] [120741] Writing DB stats nova_api:SELECT=70,nova_api:UPDATE=1 {{(pid=120741) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 18:07:15.265534 dv-cinder-852009-8-iscsi devstack@n-api.service[120741]: DEBUG oslo_concurrency.lockutils [None req-a13082e5-18f4-41a5-bb9b-9aa30ac22907 tempest-AttachVolumeShelveTestJSON-385853788 tempest-AttachVolumeShelveTestJSON-385853788-project] Acquiring lock "1daf4f4c-0e4a-4779-b53a-78c48397ea2f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120741) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 18:07:15.266312 dv-cinder-852009-8-iscsi devstack@n-api.service[120741]: DEBUG oslo_concurrency.lockutils [None req-a13082e5-18f4-41a5-bb9b-9aa30ac22907 tempest-AttachVolumeShelveTestJSON-385853788 tempest-AttachVolumeShelveTestJSON-385853788-project] Lock "1daf4f4c-0e4a-4779-b53a-78c48397ea2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120741) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 18:07:15.266991 dv-cinder-852009-8-iscsi devstack@n-api.service[120741]: DEBUG oslo_concurrency.lockutils [None req-a13082e5-18f4-41a5-bb9b-9aa30ac22907 tempest-AttachVolumeShelveTestJSON-385853788 tempest-AttachVolumeShelveTestJSON-385853788-project] Lock "1daf4f4c-0e4a-4779-b53a-78c48397ea2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120741) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 18:07:15.268234 dv-cinder-852009-8-iscsi devstack@n-api.service[120741]: DEBUG oslo_concurrency.lockutils [None req-a13082e5-18f4-41a5-bb9b-9aa30ac22907 tempest-AttachVolumeShelveTestJSON-385853788 tempest-AttachVolumeShelveTestJSON-385853788-project] Acquiring lock "1daf4f4c-0e4a-4779-b53a-78c48397ea2f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120741) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 18:07:15.268996 dv-cinder-852009-8-iscsi devstack@n-api.service[120741]: DEBUG oslo_concurrency.lockutils [None req-a13082e5-18f4-41a5-bb9b-9aa30ac22907 tempest-AttachVolumeShelveTestJSON-385853788 tempest-AttachVolumeShelveTestJSON-385853788-project] Lock "1daf4f4c-0e4a-4779-b53a-78c48397ea2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120741) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 18:07:15.269728 dv-cinder-852009-8-iscsi devstack@n-api.service[120741]: DEBUG oslo_concurrency.lockutils [None req-a13082e5-18f4-41a5-bb9b-9aa30ac22907 tempest-AttachVolumeShelveTestJSON-385853788 tempest-AttachVolumeShelveTestJSON-385853788-project] Lock "1daf4f4c-0e4a-4779-b53a-78c48397ea2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120741) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 18:07:15.447849 dv-cinder-852009-8-iscsi devstack@n-api.service[120740]: DEBUG nova.policy [None req-9de7f297-9331-4fac-bcca-ccdbf062ced4 tempest-TestShelveInstance-6258502 tempest-TestShelveInstance-6258502-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2ab9930d6ce54cacbb3d4fd6313294d5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5eafd54351bd4049b87ad308a3638f80', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120740) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 18:07:15.458364 dv-cinder-852009-8-iscsi devstack@n-api.service[120740]: INFO nova.api.openstack.requestlog [None req-9de7f297-9331-4fac-bcca-ccdbf062ced4 tempest-TestShelveInstance-6258502 tempest-TestShelveInstance-6258502-project] 10.222.0.43 "GET /compute/v2.1/servers/2d60cc6d-a699-417d-aa20-fe3e1bfc351e" status: 200 len: 1577 microversion: 2.1 time: 0.241486 Sep 13 18:07:15.478292 dv-cinder-852009-8-iscsi devstack@n-api.service[120740]: [pid: 120740|app: 0|req: 313/613] 10.222.0.43 () {58 vars in 1236 bytes} [Tue Sep 13 18:07:15 2022] GET /compute/v2.1/servers/2d60cc6d-a699-417d-aa20-fe3e1bfc351e => generated 1577 bytes in 262 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 13 18:07:15.551534 dv-cinder-852009-8-iscsi devstack@n-api.service[120741]: DEBUG nova.policy [None req-a13082e5-18f4-41a5-bb9b-9aa30ac22907 tempest-AttachVolumeShelveTestJSON-385853788 tempest-AttachVolumeShelveTestJSON-385853788-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e68ecd9b3ca643539b109f75bb242d6f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '75e14fd88bfb4cd896fa7b070a0fac47', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120741) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 18:07:15.573280 dv-cinder-852009-8-iscsi devstack@n-api.service[120740]: DEBUG nova.api.openstack.wsgi [req-6eee17a8-5774-49e9-b544-85e9a684a9cc req-9e7a783a-c5e1-400b-ba24-a36fa301747b service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "2d60cc6d-a699-417d-aa20-fe3e1bfc351e", "name": "network-vif-plugged", "status": "completed", "tag": "fa199ada-f924-4f1a-9116-5daf985f618d"}]} {{(pid=120740) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 13 18:07:15.576189 dv-cinder-852009-8-iscsi devstack@n-api.service[120741]: DEBUG nova.policy [None req-a13082e5-18f4-41a5-bb9b-9aa30ac22907 tempest-AttachVolumeShelveTestJSON-385853788 tempest-AttachVolumeShelveTestJSON-385853788-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'e68ecd9b3ca643539b109f75bb242d6f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '75e14fd88bfb4cd896fa7b070a0fac47', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120741) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 18:07:15.579067 dv-cinder-852009-8-iscsi devstack@n-api.service[120741]: DEBUG nova.policy [None req-a13082e5-18f4-41a5-bb9b-9aa30ac22907 tempest-AttachVolumeShelveTestJSON-385853788 tempest-AttachVolumeShelveTestJSON-385853788-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'e68ecd9b3ca643539b109f75bb242d6f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '75e14fd88bfb4cd896fa7b070a0fac47', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120741) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 18:07:15.579816 dv-cinder-852009-8-iscsi devstack@n-api.service[120741]: INFO nova.api.openstack.requestlog [None req-a13082e5-18f4-41a5-bb9b-9aa30ac22907 tempest-AttachVolumeShelveTestJSON-385853788 tempest-AttachVolumeShelveTestJSON-385853788-project] 10.222.0.43 "GET /compute/v2.1/servers/8cecf08e-bea8-4cef-9439-0eaa242bfed1" status: 200 len: 1738 microversion: 2.20 time: 0.329422 Sep 13 18:07:15.596784 dv-cinder-852009-8-iscsi devstack@n-api.service[120741]: [pid: 120741|app: 0|req: 301/614] 10.222.0.43 () {60 vars in 1277 bytes} [Tue Sep 13 18:07:15 2022] GET /compute/v2.1/servers/8cecf08e-bea8-4cef-9439-0eaa242bfed1 => generated 1738 bytes in 347 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Sep 13 18:07:15.601220 dv-cinder-852009-8-iscsi devstack@n-api.service[120740]: DEBUG oslo_concurrency.lockutils [req-6eee17a8-5774-49e9-b544-85e9a684a9cc req-9e7a783a-c5e1-400b-ba24-a36fa301747b service nova] Acquiring lock "1daf4f4c-0e4a-4779-b53a-78c48397ea2f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120740) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 18:07:15.601717 dv-cinder-852009-8-iscsi devstack@n-api.service[120740]: DEBUG oslo_concurrency.lockutils [req-6eee17a8-5774-49e9-b544-85e9a684a9cc req-9e7a783a-c5e1-400b-ba24-a36fa301747b service nova] Lock "1daf4f4c-0e4a-4779-b53a-78c48397ea2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120740) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 18:07:15.602205 dv-cinder-852009-8-iscsi devstack@n-api.service[120740]: DEBUG oslo_concurrency.lockutils [req-6eee17a8-5774-49e9-b544-85e9a684a9cc req-9e7a783a-c5e1-400b-ba24-a36fa301747b service nova] Lock "1daf4f4c-0e4a-4779-b53a-78c48397ea2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120740) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 18:07:15.615733 dv-cinder-852009-8-iscsi devstack@n-api.service[120740]: INFO nova.api.openstack.compute.server_external_events [req-6eee17a8-5774-49e9-b544-85e9a684a9cc req-9e7a783a-c5e1-400b-ba24-a36fa301747b service nova] Creating event network-vif-plugged:fa199ada-f924-4f1a-9116-5daf985f618d for instance 2d60cc6d-a699-417d-aa20-fe3e1bfc351e on hv-cinder-85200 Sep 13 18:07:15.620934 dv-cinder-852009-8-iscsi devstack@n-api.service[120740]: INFO nova.api.openstack.requestlog [req-6eee17a8-5774-49e9-b544-85e9a684a9cc req-9e7a783a-c5e1-400b-ba24-a36fa301747b service nova] 10.222.0.43 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.075062 Sep 13 18:07:15.621537 dv-cinder-852009-8-iscsi devstack@n-api.service[120740]: [pid: 120740|app: 0|req: 314/615] 10.222.0.43 () {64 vars in 1317 bytes} [Tue Sep 13 18:07:15 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 78 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 13 18:07:16.486048 dv-cinder-852009-8-iscsi devstack@n-api.service[120741]: DEBUG nova.api.openstack.wsgi [None req-a6876011-4aae-4c4c-86c5-166f17e3eb51 tempest-TestShelveInstance-6258502 tempest-TestShelveInstance-6258502-project] Calling method '>' {{(pid=120741) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 18:07:16.486803 dv-cinder-852009-8-iscsi devstack@n-api.service[120741]: DEBUG nova.compute.api [None req-a6876011-4aae-4c4c-86c5-166f17e3eb51 tempest-TestShelveInstance-6258502 tempest-TestShelveInstance-6258502-project] [instance: 2d60cc6d-a699-417d-aa20-fe3e1bfc351e] Fetching instance by UUID {{(pid=120741) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 18:07:16.493510 dv-cinder-852009-8-iscsi devstack@n-api.service[120741]: DEBUG oslo_concurrency.lockutils [None req-a6876011-4aae-4c4c-86c5-166f17e3eb51 tempest-TestShelveInstance-6258502 tempest-TestShelveInstance-6258502-project] Acquiring lock "1daf4f4c-0e4a-4779-b53a-78c48397ea2f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120741) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 18:07:16.494128 dv-cinder-852009-8-iscsi devstack@n-api.service[120741]: DEBUG oslo_concurrency.lockutils [None req-a6876011-4aae-4c4c-86c5-166f17e3eb51 tempest-TestShelveInstance-6258502 tempest-TestShelveInstance-6258502-project] Lock "1daf4f4c-0e4a-4779-b53a-78c48397ea2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120741) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 18:07:16.494662 dv-cinder-852009-8-iscsi devstack@n-api.service[120741]: DEBUG oslo_concurrency.lockutils [None req-a6876011-4aae-4c4c-86c5-166f17e3eb51 tempest-TestShelveInstance-6258502 tempest-TestShelveInstance-6258502-project] Lock "1daf4f4c-0e4a-4779-b53a-78c48397ea2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120741) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 18:07:16.495539 dv-cinder-852009-8-iscsi devstack@n-api.service[120741]: DEBUG oslo_concurrency.lockutils [None req-a6876011-4aae-4c4c-86c5-166f17e3eb51 tempest-TestShelveInstance-6258502 tempest-TestShelveInstance-6258502-project] Acquiring lock "1daf4f4c-0e4a-4779-b53a-78c48397ea2f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120741) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 18:07:16.496082 dv-cinder-852009-8-iscsi devstack@n-api.service[120741]: DEBUG oslo_concurrency.lockutils [None req-a6876011-4aae-4c4c-86c5-166f17e3eb51 tempest-TestShelveInstance-6258502 tempest-TestShelveInstance-6258502-project] Lock "1daf4f4c-0e4a-4779-b53a-78c48397ea2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120741) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 18:07:16.496695 dv-cinder-852009-8-iscsi devstack@n-api.service[120741]: DEBUG oslo_concurrency.lockutils [None req-a6876011-4aae-4c4c-86c5-166f17e3eb51 tempest-TestShelveInstance-6258502 tempest-TestShelveInstance-6258502-project] Lock "1daf4f4c-0e4a-4779-b53a-78c48397ea2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120741) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 18:07:16.608581 dv-cinder-852009-8-iscsi devstack@n-api.service[120740]: DEBUG nova.api.openstack.wsgi [None req-0e3d70d4-d223-4c7d-8322-5a0b498d3243 tempest-AttachVolumeShelveTestJSON-385853788 tempest-AttachVolumeShelveTestJSON-385853788-project] Calling method '>' {{(pid=120740) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 18:07:16.609361 dv-cinder-852009-8-iscsi devstack@n-api.service[120740]: DEBUG nova.compute.api [None req-0e3d70d4-d223-4c7d-8322-5a0b498d3243 tempest-AttachVolumeShelveTestJSON-385853788 tempest-AttachVolumeShelveTestJSON-385853788-project] [instance: 8cecf08e-bea8-4cef-9439-0eaa242bfed1] Fetching instance by UUID {{(pid=120740) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 18:07:16.615640 dv-cinder-852009-8-iscsi devstack@n-api.service[120740]: DEBUG oslo_concurrency.lockutils [None req-0e3d70d4-d223-4c7d-8322-5a0b498d3243 tempest-AttachVolumeShelveTestJSON-385853788 tempest-AttachVolumeShelveTestJSON-385853788-project] Acquiring lock "1daf4f4c-0e4a-4779-b53a-78c48397ea2f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120740) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 18:07:16.616055 dv-cinder-852009-8-iscsi devstack@n-api.service[120740]: DEBUG oslo_concurrency.lockutils [None req-0e3d70d4-d223-4c7d-8322-5a0b498d3243 tempest-AttachVolumeShelveTestJSON-385853788 tempest-AttachVolumeShelveTestJSON-385853788-project] Lock "1daf4f4c-0e4a-4779-b53a-78c48397ea2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120740) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 18:07:16.616525 dv-cinder-852009-8-iscsi devstack@n-api.service[120740]: DEBUG oslo_concurrency.lockutils [None req-0e3d70d4-d223-4c7d-8322-5a0b498d3243 tempest-AttachVolumeShelveTestJSON-385853788 tempest-AttachVolumeShelveTestJSON-385853788-project] Lock "1daf4f4c-0e4a-4779-b53a-78c48397ea2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120740) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 18:07:16.617636 dv-cinder-852009-8-iscsi devstack@n-api.service[120740]: DEBUG oslo_concurrency.lockutils [None req-0e3d70d4-d223-4c7d-8322-5a0b498d3243 tempest-AttachVolumeShelveTestJSON-385853788 tempest-AttachVolumeShelveTestJSON-385853788-project] Acquiring lock "1daf4f4c-0e4a-4779-b53a-78c48397ea2f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120740) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 18:07:16.618131 dv-cinder-852009-8-iscsi devstack@n-api.service[120740]: DEBUG oslo_concurrency.lockutils [None req-0e3d70d4-d223-4c7d-8322-5a0b498d3243 tempest-AttachVolumeShelveTestJSON-385853788 tempest-AttachVolumeShelveTestJSON-385853788-project] Lock "1daf4f4c-0e4a-4779-b53a-78c48397ea2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120740) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 18:07:16.618548 dv-cinder-852009-8-iscsi devstack@n-api.service[120740]: DEBUG oslo_concurrency.lockutils [None req-0e3d70d4-d223-4c7d-8322-5a0b498d3243 tempest-AttachVolumeShelveTestJSON-385853788 tempest-AttachVolumeShelveTestJSON-385853788-project] Lock "1daf4f4c-0e4a-4779-b53a-78c48397ea2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120740) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 18:07:16.633356 dv-cinder-852009-8-iscsi devstack@n-api.service[120741]: DEBUG nova.policy [None req-a6876011-4aae-4c4c-86c5-166f17e3eb51 tempest-TestShelveInstance-6258502 tempest-TestShelveInstance-6258502-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2ab9930d6ce54cacbb3d4fd6313294d5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5eafd54351bd4049b87ad308a3638f80', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120741) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 18:07:16.645460 dv-cinder-852009-8-iscsi devstack@n-api.service[120741]: INFO nova.api.openstack.requestlog [None req-a6876011-4aae-4c4c-86c5-166f17e3eb51 tempest-TestShelveInstance-6258502 tempest-TestShelveInstance-6258502-project] 10.222.0.43 "GET /compute/v2.1/servers/2d60cc6d-a699-417d-aa20-fe3e1bfc351e" status: 200 len: 1577 microversion: 2.1 time: 0.163307 Sep 13 18:07:16.646182 dv-cinder-852009-8-iscsi devstack@n-api.service[120741]: [pid: 120741|app: 0|req: 302/616] 10.222.0.43 () {58 vars in 1236 bytes} [Tue Sep 13 18:07:16 2022] GET /compute/v2.1/servers/2d60cc6d-a699-417d-aa20-fe3e1bfc351e => generated 1577 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 13 18:07:16.763709 dv-cinder-852009-8-iscsi devstack@n-api.service[120740]: DEBUG nova.policy [None req-0e3d70d4-d223-4c7d-8322-5a0b498d3243 tempest-AttachVolumeShelveTestJSON-385853788 tempest-AttachVolumeShelveTestJSON-385853788-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e68ecd9b3ca643539b109f75bb242d6f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '75e14fd88bfb4cd896fa7b070a0fac47', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120740) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 18:07:16.772141 dv-cinder-852009-8-iscsi devstack@n-api.service[120740]: DEBUG nova.policy [None req-0e3d70d4-d223-4c7d-8322-5a0b498d3243 tempest-AttachVolumeShelveTestJSON-385853788 tempest-AttachVolumeShelveTestJSON-385853788-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'e68ecd9b3ca643539b109f75bb242d6f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '75e14fd88bfb4cd896fa7b070a0fac47', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120740) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 18:07:16.773601 dv-cinder-852009-8-iscsi devstack@n-api.service[120740]: DEBUG nova.policy [None req-0e3d70d4-d223-4c7d-8322-5a0b498d3243 tempest-AttachVolumeShelveTestJSON-385853788 tempest-AttachVolumeShelveTestJSON-385853788-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'e68ecd9b3ca643539b109f75bb242d6f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '75e14fd88bfb4cd896fa7b070a0fac47', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120740) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 18:07:16.774778 dv-cinder-852009-8-iscsi devstack@n-api.service[120740]: INFO nova.api.openstack.requestlog [None req-0e3d70d4-d223-4c7d-8322-5a0b498d3243 tempest-AttachVolumeShelveTestJSON-385853788 tempest-AttachVolumeShelveTestJSON-385853788-project] 10.222.0.43 "GET /compute/v2.1/servers/8cecf08e-bea8-4cef-9439-0eaa242bfed1" status: 200 len: 1738 microversion: 2.20 time: 0.171234 Sep 13 18:07:16.775339 dv-cinder-852009-8-iscsi devstack@n-api.service[120740]: [pid: 120740|app: 0|req: 315/617] 10.222.0.43 () {60 vars in 1277 bytes} [Tue Sep 13 18:07:16 2022] GET /compute/v2.1/servers/8cecf08e-bea8-4cef-9439-0eaa242bfed1 => generated 1738 bytes in 173 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Sep 13 18:07:17.669167 dv-cinder-852009-8-iscsi devstack@n-api.service[120741]: DEBUG nova.api.openstack.wsgi [None req-a7f81641-cae8-4dc7-8c50-aa00fb71794f tempest-TestShelveInstance-6258502 tempest-TestShelveInstance-6258502-project] Calling method '>' {{(pid=120741) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 18:07:17.670185 dv-cinder-852009-8-iscsi devstack@n-api.service[120741]: DEBUG nova.compute.api [None req-a7f81641-cae8-4dc7-8c50-aa00fb71794f tempest-TestShelveInstance-6258502 tempest-TestShelveInstance-6258502-project] [instance: 2d60cc6d-a699-417d-aa20-fe3e1bfc351e] Fetching instance by UUID {{(pid=120741) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 18:07:17.678323 dv-cinder-852009-8-iscsi devstack@n-api.service[120741]: DEBUG oslo_concurrency.lockutils [None req-a7f81641-cae8-4dc7-8c50-aa00fb71794f tempest-TestShelveInstance-6258502 tempest-TestShelveInstance-6258502-project] Acquiring lock "1daf4f4c-0e4a-4779-b53a-78c48397ea2f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120741) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 18:07:17.679165 dv-cinder-852009-8-iscsi devstack@n-api.service[120741]: DEBUG oslo_concurrency.lockutils [None req-a7f81641-cae8-4dc7-8c50-aa00fb71794f tempest-TestShelveInstance-6258502 tempest-TestShelveInstance-6258502-project] Lock "1daf4f4c-0e4a-4779-b53a-78c48397ea2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120741) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 18:07:17.679987 dv-cinder-852009-8-iscsi devstack@n-api.service[120741]: DEBUG oslo_concurrency.lockutils [None req-a7f81641-cae8-4dc7-8c50-aa00fb71794f tempest-TestShelveInstance-6258502 tempest-TestShelveInstance-6258502-project] Lock "1daf4f4c-0e4a-4779-b53a-78c48397ea2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120741) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 18:07:17.680949 dv-cinder-852009-8-iscsi devstack@n-api.service[120741]: DEBUG oslo_concurrency.lockutils [None req-a7f81641-cae8-4dc7-8c50-aa00fb71794f tempest-TestShelveInstance-6258502 tempest-TestShelveInstance-6258502-project] Acquiring lock "1daf4f4c-0e4a-4779-b53a-78c48397ea2f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120741) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 18:07:17.682472 dv-cinder-852009-8-iscsi devstack@n-api.service[120741]: DEBUG oslo_concurrency.lockutils [None req-a7f81641-cae8-4dc7-8c50-aa00fb71794f tempest-TestShelveInstance-6258502 tempest-TestShelveInstance-6258502-project] Lock "1daf4f4c-0e4a-4779-b53a-78c48397ea2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120741) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 18:07:17.683272 dv-cinder-852009-8-iscsi devstack@n-api.service[120741]: DEBUG oslo_concurrency.lockutils [None req-a7f81641-cae8-4dc7-8c50-aa00fb71794f tempest-TestShelveInstance-6258502 tempest-TestShelveInstance-6258502-project] Lock "1daf4f4c-0e4a-4779-b53a-78c48397ea2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120741) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 18:07:17.800506 dv-cinder-852009-8-iscsi devstack@n-api.service[120740]: DEBUG nova.api.openstack.wsgi [None req-23624aa8-ecb6-4227-bbaf-b21edd0aca5d tempest-AttachVolumeShelveTestJSON-385853788 tempest-AttachVolumeShelveTestJSON-385853788-project] Calling method '>' {{(pid=120740) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 18:07:17.801697 dv-cinder-852009-8-iscsi devstack@n-api.service[120740]: DEBUG nova.compute.api [None req-23624aa8-ecb6-4227-bbaf-b21edd0aca5d tempest-AttachVolumeShelveTestJSON-385853788 tempest-AttachVolumeShelveTestJSON-385853788-project] [instance: 8cecf08e-bea8-4cef-9439-0eaa242bfed1] Fetching instance by UUID {{(pid=120740) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 18:07:17.809812 dv-cinder-852009-8-iscsi devstack@n-api.service[120740]: DEBUG oslo_concurrency.lockutils [None req-23624aa8-ecb6-4227-bbaf-b21edd0aca5d tempest-AttachVolumeShelveTestJSON-385853788 tempest-AttachVolumeShelveTestJSON-385853788-project] Acquiring lock "1daf4f4c-0e4a-4779-b53a-78c48397ea2f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120740) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 18:07:17.810480 dv-cinder-852009-8-iscsi devstack@n-api.service[120740]: DEBUG oslo_concurrency.lockutils [None req-23624aa8-ecb6-4227-bbaf-b21edd0aca5d tempest-AttachVolumeShelveTestJSON-385853788 tempest-AttachVolumeShelveTestJSON-385853788-project] Lock "1daf4f4c-0e4a-4779-b53a-78c48397ea2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120740) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 18:07:17.811066 dv-cinder-852009-8-iscsi devstack@n-api.service[120740]: DEBUG oslo_concurrency.lockutils [None req-23624aa8-ecb6-4227-bbaf-b21edd0aca5d tempest-AttachVolumeShelveTestJSON-385853788 tempest-AttachVolumeShelveTestJSON-385853788-project] Lock "1daf4f4c-0e4a-4779-b53a-78c48397ea2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120740) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 18:07:17.812045 dv-cinder-852009-8-iscsi devstack@n-api.service[120740]: DEBUG oslo_concurrency.lockutils [None req-23624aa8-ecb6-4227-bbaf-b21edd0aca5d tempest-AttachVolumeShelveTestJSON-385853788 tempest-AttachVolumeShelveTestJSON-385853788-project] Acquiring lock "1daf4f4c-0e4a-4779-b53a-78c48397ea2f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120740) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 18:07:17.812673 dv-cinder-852009-8-iscsi devstack@n-api.service[120740]: DEBUG oslo_concurrency.lockutils [None req-23624aa8-ecb6-4227-bbaf-b21edd0aca5d tempest-AttachVolumeShelveTestJSON-385853788 tempest-AttachVolumeShelveTestJSON-385853788-project] Lock "1daf4f4c-0e4a-4779-b53a-78c48397ea2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120740) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 18:07:17.813387 dv-cinder-852009-8-iscsi devstack@n-api.service[120740]: DEBUG oslo_concurrency.lockutils [None req-23624aa8-ecb6-4227-bbaf-b21edd0aca5d tempest-AttachVolumeShelveTestJSON-385853788 tempest-AttachVolumeShelveTestJSON-385853788-project] Lock "1daf4f4c-0e4a-4779-b53a-78c48397ea2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120740) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 18:07:17.840930 dv-cinder-852009-8-iscsi devstack@n-api.service[120741]: DEBUG nova.policy [None req-a7f81641-cae8-4dc7-8c50-aa00fb71794f tempest-TestShelveInstance-6258502 tempest-TestShelveInstance-6258502-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2ab9930d6ce54cacbb3d4fd6313294d5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5eafd54351bd4049b87ad308a3638f80', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120741) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 18:07:17.851426 dv-cinder-852009-8-iscsi devstack@n-api.service[120741]: INFO nova.api.openstack.requestlog [None req-a7f81641-cae8-4dc7-8c50-aa00fb71794f tempest-TestShelveInstance-6258502 tempest-TestShelveInstance-6258502-project] 10.222.0.43 "GET /compute/v2.1/servers/2d60cc6d-a699-417d-aa20-fe3e1bfc351e" status: 200 len: 1564 microversion: 2.1 time: 0.185928 Sep 13 18:07:17.852142 dv-cinder-852009-8-iscsi devstack@n-api.service[120741]: [pid: 120741|app: 0|req: 303/618] 10.222.0.43 () {58 vars in 1236 bytes} [Tue Sep 13 18:07:17 2022] GET /compute/v2.1/servers/2d60cc6d-a699-417d-aa20-fe3e1bfc351e => generated 1564 bytes in 188 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 13 18:07:17.963863 dv-cinder-852009-8-iscsi devstack@n-api.service[120740]: DEBUG nova.policy [None req-23624aa8-ecb6-4227-bbaf-b21edd0aca5d tempest-AttachVolumeShelveTestJSON-385853788 tempest-AttachVolumeShelveTestJSON-385853788-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e68ecd9b3ca643539b109f75bb242d6f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '75e14fd88bfb4cd896fa7b070a0fac47', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120740) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 18:07:17.972382 dv-cinder-852009-8-iscsi devstack@n-api.service[120740]: DEBUG nova.policy [None req-23624aa8-ecb6-4227-bbaf-b21edd0aca5d tempest-AttachVolumeShelveTestJSON-385853788 tempest-AttachVolumeShelveTestJSON-385853788-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'e68ecd9b3ca643539b109f75bb242d6f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '75e14fd88bfb4cd896fa7b070a0fac47', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120740) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 18:07:17.973872 dv-cinder-852009-8-iscsi devstack@n-api.service[120740]: DEBUG nova.policy [None req-23624aa8-ecb6-4227-bbaf-b21edd0aca5d tempest-AttachVolumeShelveTestJSON-385853788 tempest-AttachVolumeShelveTestJSON-385853788-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'e68ecd9b3ca643539b109f75bb242d6f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '75e14fd88bfb4cd896fa7b070a0fac47', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120740) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 18:07:17.975122 dv-cinder-852009-8-iscsi devstack@n-api.service[120740]: INFO nova.api.openstack.requestlog [None req-23624aa8-ecb6-4227-bbaf-b21edd0aca5d tempest-AttachVolumeShelveTestJSON-385853788 tempest-AttachVolumeShelveTestJSON-385853788-project] 10.222.0.43 "GET /compute/v2.1/servers/8cecf08e-bea8-4cef-9439-0eaa242bfed1" status: 200 len: 1720 microversion: 2.20 time: 0.178591 Sep 13 18:07:17.975674 dv-cinder-852009-8-iscsi devstack@n-api.service[120740]: [pid: 120740|app: 0|req: 316/619] 10.222.0.43 () {60 vars in 1277 bytes} [Tue Sep 13 18:07:17 2022] GET /compute/v2.1/servers/8cecf08e-bea8-4cef-9439-0eaa242bfed1 => generated 1720 bytes in 180 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Sep 13 18:07:19.001729 dv-cinder-852009-8-iscsi devstack@n-api.service[120741]: DEBUG nova.api.openstack.wsgi [None req-3d3d66c9-2d11-471c-88d5-cd8a23fffbe2 tempest-AttachVolumeShelveTestJSON-385853788 tempest-AttachVolumeShelveTestJSON-385853788-project] Calling method '>' {{(pid=120741) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 18:07:19.002875 dv-cinder-852009-8-iscsi devstack@n-api.service[120741]: DEBUG nova.compute.api [None req-3d3d66c9-2d11-471c-88d5-cd8a23fffbe2 tempest-AttachVolumeShelveTestJSON-385853788 tempest-AttachVolumeShelveTestJSON-385853788-project] [instance: 8cecf08e-bea8-4cef-9439-0eaa242bfed1] Fetching instance by UUID {{(pid=120741) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 18:07:19.009294 dv-cinder-852009-8-iscsi devstack@n-api.service[120741]: DEBUG oslo_concurrency.lockutils [None req-3d3d66c9-2d11-471c-88d5-cd8a23fffbe2 tempest-AttachVolumeShelveTestJSON-385853788 tempest-AttachVolumeShelveTestJSON-385853788-project] Acquiring lock "1daf4f4c-0e4a-4779-b53a-78c48397ea2f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120741) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 18:07:19.009764 dv-cinder-852009-8-iscsi devstack@n-api.service[120741]: DEBUG oslo_concurrency.lockutils [None req-3d3d66c9-2d11-471c-88d5-cd8a23fffbe2 tempest-AttachVolumeShelveTestJSON-385853788 tempest-AttachVolumeShelveTestJSON-385853788-project] Lock "1daf4f4c-0e4a-4779-b53a-78c48397ea2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120741) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 18:07:19.010188 dv-cinder-852009-8-iscsi devstack@n-api.service[120741]: DEBUG oslo_concurrency.lockutils [None req-3d3d66c9-2d11-471c-88d5-cd8a23fffbe2 tempest-AttachVolumeShelveTestJSON-385853788 tempest-AttachVolumeShelveTestJSON-385853788-project] Lock "1daf4f4c-0e4a-4779-b53a-78c48397ea2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120741) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 18:07:19.010864 dv-cinder-852009-8-iscsi devstack@n-api.service[120741]: DEBUG oslo_concurrency.lockutils [None req-3d3d66c9-2d11-471c-88d5-cd8a23fffbe2 tempest-AttachVolumeShelveTestJSON-385853788 tempest-AttachVolumeShelveTestJSON-385853788-project] Acquiring lock "1daf4f4c-0e4a-4779-b53a-78c48397ea2f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120741) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 18:07:19.011307 dv-cinder-852009-8-iscsi devstack@n-api.service[120741]: DEBUG oslo_concurrency.lockutils [None req-3d3d66c9-2d11-471c-88d5-cd8a23fffbe2 tempest-AttachVolumeShelveTestJSON-385853788 tempest-AttachVolumeShelveTestJSON-385853788-project] Lock "1daf4f4c-0e4a-4779-b53a-78c48397ea2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120741) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 18:07:19.011725 dv-cinder-852009-8-iscsi devstack@n-api.service[120741]: DEBUG oslo_concurrency.lockutils [None req-3d3d66c9-2d11-471c-88d5-cd8a23fffbe2 tempest-AttachVolumeShelveTestJSON-385853788 tempest-AttachVolumeShelveTestJSON-385853788-project] Lock "1daf4f4c-0e4a-4779-b53a-78c48397ea2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120741) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 18:07:19.152813 dv-cinder-852009-8-iscsi devstack@n-api.service[120741]: DEBUG nova.policy [None req-3d3d66c9-2d11-471c-88d5-cd8a23fffbe2 tempest-AttachVolumeShelveTestJSON-385853788 tempest-AttachVolumeShelveTestJSON-385853788-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e68ecd9b3ca643539b109f75bb242d6f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '75e14fd88bfb4cd896fa7b070a0fac47', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120741) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 18:07:19.161421 dv-cinder-852009-8-iscsi devstack@n-api.service[120741]: DEBUG nova.policy [None req-3d3d66c9-2d11-471c-88d5-cd8a23fffbe2 tempest-AttachVolumeShelveTestJSON-385853788 tempest-AttachVolumeShelveTestJSON-385853788-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'e68ecd9b3ca643539b109f75bb242d6f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '75e14fd88bfb4cd896fa7b070a0fac47', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120741) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 18:07:19.162837 dv-cinder-852009-8-iscsi devstack@n-api.service[120741]: DEBUG nova.policy [None req-3d3d66c9-2d11-471c-88d5-cd8a23fffbe2 tempest-AttachVolumeShelveTestJSON-385853788 tempest-AttachVolumeShelveTestJSON-385853788-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'e68ecd9b3ca643539b109f75bb242d6f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '75e14fd88bfb4cd896fa7b070a0fac47', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120741) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 18:07:19.164005 dv-cinder-852009-8-iscsi devstack@n-api.service[120741]: INFO nova.api.openstack.requestlog [None req-3d3d66c9-2d11-471c-88d5-cd8a23fffbe2 tempest-AttachVolumeShelveTestJSON-385853788 tempest-AttachVolumeShelveTestJSON-385853788-project] 10.222.0.43 "GET /compute/v2.1/servers/8cecf08e-bea8-4cef-9439-0eaa242bfed1" status: 200 len: 1720 microversion: 2.20 time: 0.166321 Sep 13 18:07:19.164672 dv-cinder-852009-8-iscsi devstack@n-api.service[120741]: [pid: 120741|app: 0|req: 304/620] 10.222.0.43 () {60 vars in 1277 bytes} [Tue Sep 13 18:07:18 2022] GET /compute/v2.1/servers/8cecf08e-bea8-4cef-9439-0eaa242bfed1 => generated 1720 bytes in 167 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 13 18:07:19.423178 dv-cinder-852009-8-iscsi devstack@n-api.service[120740]: DEBUG nova.api.openstack.wsgi [req-7b4b9328-9e1c-4423-9cf3-5cd4b86ded49 req-358ee790-b541-4303-aa60-1cc18b5dcb22 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "8cecf08e-bea8-4cef-9439-0eaa242bfed1", "name": "network-vif-unplugged", "status": "completed", "tag": "cf75920d-98e9-4700-bdad-ac46b7b3f022"}]} {{(pid=120740) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 13 18:07:19.430133 dv-cinder-852009-8-iscsi devstack@n-api.service[120740]: DEBUG dbcounter [-] [120740] Writing DB stats nova_api:SELECT=72 {{(pid=120740) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 18:07:19.435610 dv-cinder-852009-8-iscsi devstack@n-api.service[120740]: DEBUG oslo_concurrency.lockutils [req-7b4b9328-9e1c-4423-9cf3-5cd4b86ded49 req-358ee790-b541-4303-aa60-1cc18b5dcb22 service nova] Acquiring lock "1daf4f4c-0e4a-4779-b53a-78c48397ea2f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120740) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 18:07:19.436469 dv-cinder-852009-8-iscsi devstack@n-api.service[120740]: DEBUG oslo_concurrency.lockutils [req-7b4b9328-9e1c-4423-9cf3-5cd4b86ded49 req-358ee790-b541-4303-aa60-1cc18b5dcb22 service nova] Lock "1daf4f4c-0e4a-4779-b53a-78c48397ea2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120740) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 18:07:19.437194 dv-cinder-852009-8-iscsi devstack@n-api.service[120740]: DEBUG oslo_concurrency.lockutils [req-7b4b9328-9e1c-4423-9cf3-5cd4b86ded49 req-358ee790-b541-4303-aa60-1cc18b5dcb22 service nova] Lock "1daf4f4c-0e4a-4779-b53a-78c48397ea2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120740) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 18:07:19.450539 dv-cinder-852009-8-iscsi devstack@n-api.service[120740]: INFO nova.api.openstack.compute.server_external_events [req-7b4b9328-9e1c-4423-9cf3-5cd4b86ded49 req-358ee790-b541-4303-aa60-1cc18b5dcb22 service nova] Creating event network-vif-unplugged:cf75920d-98e9-4700-bdad-ac46b7b3f022 for instance 8cecf08e-bea8-4cef-9439-0eaa242bfed1 on hv-cinder-85200 Sep 13 18:07:19.456122 dv-cinder-852009-8-iscsi devstack@n-api.service[120740]: INFO nova.api.openstack.requestlog [req-7b4b9328-9e1c-4423-9cf3-5cd4b86ded49 req-358ee790-b541-4303-aa60-1cc18b5dcb22 service nova] 10.222.0.43 "POST /compute/v2.1/os-server-external-events" status: 200 len: 185 microversion: 2.1 time: 0.037464 Sep 13 18:07:19.456925 dv-cinder-852009-8-iscsi devstack@n-api.service[120740]: [pid: 120740|app: 0|req: 317/621] 10.222.0.43 () {64 vars in 1317 bytes} [Tue Sep 13 18:07:19 2022] POST /compute/v2.1/os-server-external-events => generated 185 bytes in 39 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 13 18:07:20.193738 dv-cinder-852009-8-iscsi devstack@n-api.service[120741]: DEBUG nova.api.openstack.wsgi [None req-edb84451-4929-44f6-83e3-3e7661fdeee0 tempest-AttachVolumeShelveTestJSON-385853788 tempest-AttachVolumeShelveTestJSON-385853788-project] Calling method '>' {{(pid=120741) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 18:07:20.194716 dv-cinder-852009-8-iscsi devstack@n-api.service[120741]: DEBUG nova.compute.api [None req-edb84451-4929-44f6-83e3-3e7661fdeee0 tempest-AttachVolumeShelveTestJSON-385853788 tempest-AttachVolumeShelveTestJSON-385853788-project] [instance: 8cecf08e-bea8-4cef-9439-0eaa242bfed1] Fetching instance by UUID {{(pid=120741) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 18:07:20.205785 dv-cinder-852009-8-iscsi devstack@n-api.service[120741]: DEBUG oslo_concurrency.lockutils [None req-edb84451-4929-44f6-83e3-3e7661fdeee0 tempest-AttachVolumeShelveTestJSON-385853788 tempest-AttachVolumeShelveTestJSON-385853788-project] Acquiring lock "1daf4f4c-0e4a-4779-b53a-78c48397ea2f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120741) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 18:07:20.206097 dv-cinder-852009-8-iscsi devstack@n-api.service[120741]: DEBUG oslo_concurrency.lockutils [None req-edb84451-4929-44f6-83e3-3e7661fdeee0 tempest-AttachVolumeShelveTestJSON-385853788 tempest-AttachVolumeShelveTestJSON-385853788-project] Lock "1daf4f4c-0e4a-4779-b53a-78c48397ea2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120741) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 18:07:20.206800 dv-cinder-852009-8-iscsi devstack@n-api.service[120741]: DEBUG oslo_concurrency.lockutils [None req-edb84451-4929-44f6-83e3-3e7661fdeee0 tempest-AttachVolumeShelveTestJSON-385853788 tempest-AttachVolumeShelveTestJSON-385853788-project] Lock "1daf4f4c-0e4a-4779-b53a-78c48397ea2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120741) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 18:07:20.207942 dv-cinder-852009-8-iscsi devstack@n-api.service[120741]: DEBUG oslo_concurrency.lockutils [None req-edb84451-4929-44f6-83e3-3e7661fdeee0 tempest-AttachVolumeShelveTestJSON-385853788 tempest-AttachVolumeShelveTestJSON-385853788-project] Acquiring lock "1daf4f4c-0e4a-4779-b53a-78c48397ea2f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120741) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 18:07:20.208719 dv-cinder-852009-8-iscsi devstack@n-api.service[120741]: DEBUG oslo_concurrency.lockutils [None req-edb84451-4929-44f6-83e3-3e7661fdeee0 tempest-AttachVolumeShelveTestJSON-385853788 tempest-AttachVolumeShelveTestJSON-385853788-project] Lock "1daf4f4c-0e4a-4779-b53a-78c48397ea2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120741) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 18:07:20.209398 dv-cinder-852009-8-iscsi devstack@n-api.service[120741]: DEBUG oslo_concurrency.lockutils [None req-edb84451-4929-44f6-83e3-3e7661fdeee0 tempest-AttachVolumeShelveTestJSON-385853788 tempest-AttachVolumeShelveTestJSON-385853788-project] Lock "1daf4f4c-0e4a-4779-b53a-78c48397ea2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120741) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 18:07:20.345178 dv-cinder-852009-8-iscsi devstack@n-api.service[120741]: DEBUG nova.policy [None req-edb84451-4929-44f6-83e3-3e7661fdeee0 tempest-AttachVolumeShelveTestJSON-385853788 tempest-AttachVolumeShelveTestJSON-385853788-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e68ecd9b3ca643539b109f75bb242d6f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '75e14fd88bfb4cd896fa7b070a0fac47', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120741) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 18:07:20.357716 dv-cinder-852009-8-iscsi devstack@n-api.service[120741]: DEBUG nova.policy [None req-edb84451-4929-44f6-83e3-3e7661fdeee0 tempest-AttachVolumeShelveTestJSON-385853788 tempest-AttachVolumeShelveTestJSON-385853788-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'e68ecd9b3ca643539b109f75bb242d6f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '75e14fd88bfb4cd896fa7b070a0fac47', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120741) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 18:07:20.360260 dv-cinder-852009-8-iscsi devstack@n-api.service[120741]: DEBUG nova.policy [None req-edb84451-4929-44f6-83e3-3e7661fdeee0 tempest-AttachVolumeShelveTestJSON-385853788 tempest-AttachVolumeShelveTestJSON-385853788-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'e68ecd9b3ca643539b109f75bb242d6f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '75e14fd88bfb4cd896fa7b070a0fac47', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120741) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 18:07:20.361840 dv-cinder-852009-8-iscsi devstack@n-api.service[120741]: INFO nova.api.openstack.requestlog [None req-edb84451-4929-44f6-83e3-3e7661fdeee0 tempest-AttachVolumeShelveTestJSON-385853788 tempest-AttachVolumeShelveTestJSON-385853788-project] 10.222.0.43 "GET /compute/v2.1/servers/8cecf08e-bea8-4cef-9439-0eaa242bfed1" status: 200 len: 1723 microversion: 2.20 time: 0.174534 Sep 13 18:07:20.362597 dv-cinder-852009-8-iscsi devstack@n-api.service[120741]: [pid: 120741|app: 0|req: 305/622] 10.222.0.43 () {60 vars in 1277 bytes} [Tue Sep 13 18:07:20 2022] GET /compute/v2.1/servers/8cecf08e-bea8-4cef-9439-0eaa242bfed1 => generated 1723 bytes in 176 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 13 18:07:20.394094 dv-cinder-852009-8-iscsi devstack@n-api.service[120740]: DEBUG nova.api.openstack.wsgi [None req-a72af951-d2c3-4bce-b52d-46def432cb57 tempest-AttachVolumeShelveTestJSON-385853788 tempest-AttachVolumeShelveTestJSON-385853788-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "c2165d0c-70e0-4780-b427-d15b390c4408"}} {{(pid=120740) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 13 18:07:20.396580 dv-cinder-852009-8-iscsi devstack@n-api.service[120740]: DEBUG nova.compute.api [None req-a72af951-d2c3-4bce-b52d-46def432cb57 tempest-AttachVolumeShelveTestJSON-385853788 tempest-AttachVolumeShelveTestJSON-385853788-project] [instance: 8cecf08e-bea8-4cef-9439-0eaa242bfed1] Fetching instance by UUID {{(pid=120740) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 18:07:20.403193 dv-cinder-852009-8-iscsi devstack@n-api.service[120740]: DEBUG oslo_concurrency.lockutils [None req-a72af951-d2c3-4bce-b52d-46def432cb57 tempest-AttachVolumeShelveTestJSON-385853788 tempest-AttachVolumeShelveTestJSON-385853788-project] Acquiring lock "1daf4f4c-0e4a-4779-b53a-78c48397ea2f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120740) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 18:07:20.403685 dv-cinder-852009-8-iscsi devstack@n-api.service[120740]: DEBUG oslo_concurrency.lockutils [None req-a72af951-d2c3-4bce-b52d-46def432cb57 tempest-AttachVolumeShelveTestJSON-385853788 tempest-AttachVolumeShelveTestJSON-385853788-project] Lock "1daf4f4c-0e4a-4779-b53a-78c48397ea2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120740) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 18:07:20.404130 dv-cinder-852009-8-iscsi devstack@n-api.service[120740]: DEBUG oslo_concurrency.lockutils [None req-a72af951-d2c3-4bce-b52d-46def432cb57 tempest-AttachVolumeShelveTestJSON-385853788 tempest-AttachVolumeShelveTestJSON-385853788-project] Lock "1daf4f4c-0e4a-4779-b53a-78c48397ea2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120740) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 18:07:20.404854 dv-cinder-852009-8-iscsi devstack@n-api.service[120740]: DEBUG oslo_concurrency.lockutils [None req-a72af951-d2c3-4bce-b52d-46def432cb57 tempest-AttachVolumeShelveTestJSON-385853788 tempest-AttachVolumeShelveTestJSON-385853788-project] Acquiring lock "1daf4f4c-0e4a-4779-b53a-78c48397ea2f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120740) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 18:07:20.405304 dv-cinder-852009-8-iscsi devstack@n-api.service[120740]: DEBUG oslo_concurrency.lockutils [None req-a72af951-d2c3-4bce-b52d-46def432cb57 tempest-AttachVolumeShelveTestJSON-385853788 tempest-AttachVolumeShelveTestJSON-385853788-project] Lock "1daf4f4c-0e4a-4779-b53a-78c48397ea2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120740) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 18:07:20.405966 dv-cinder-852009-8-iscsi devstack@n-api.service[120740]: DEBUG oslo_concurrency.lockutils [None req-a72af951-d2c3-4bce-b52d-46def432cb57 tempest-AttachVolumeShelveTestJSON-385853788 tempest-AttachVolumeShelveTestJSON-385853788-project] Lock "1daf4f4c-0e4a-4779-b53a-78c48397ea2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120740) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 18:07:20.718436 dv-cinder-852009-8-iscsi devstack@n-api.service[120740]: INFO nova.api.openstack.requestlog [None req-a72af951-d2c3-4bce-b52d-46def432cb57 tempest-AttachVolumeShelveTestJSON-385853788 tempest-AttachVolumeShelveTestJSON-385853788-project] 10.222.0.43 "POST /compute/v2.1/servers/8cecf08e-bea8-4cef-9439-0eaa242bfed1/os-volume_attachments" status: 200 len: 188 microversion: 2.20 time: 0.328795 Sep 13 18:07:20.725781 dv-cinder-852009-8-iscsi devstack@n-api.service[120740]: [pid: 120740|app: 0|req: 318/623] 10.222.0.43 () {62 vars in 1364 bytes} [Tue Sep 13 18:07:20 2022] POST /compute/v2.1/servers/8cecf08e-bea8-4cef-9439-0eaa242bfed1/os-volume_attachments => generated 188 bytes in 337 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Sep 13 18:07:20.853457 dv-cinder-852009-8-iscsi devstack@n-api.service[120741]: DEBUG nova.api.openstack.wsgi [None req-3358784c-054b-40fb-bfb6-5553137847e0 tempest-AttachVolumeShelveTestJSON-385853788 tempest-AttachVolumeShelveTestJSON-385853788-project] Calling method '>' {{(pid=120741) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 18:07:20.853879 dv-cinder-852009-8-iscsi devstack@n-api.service[120741]: DEBUG nova.compute.api [None req-3358784c-054b-40fb-bfb6-5553137847e0 tempest-AttachVolumeShelveTestJSON-385853788 tempest-AttachVolumeShelveTestJSON-385853788-project] [instance: 8cecf08e-bea8-4cef-9439-0eaa242bfed1] Fetching instance by UUID {{(pid=120741) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 18:07:20.860817 dv-cinder-852009-8-iscsi devstack@n-api.service[120741]: DEBUG oslo_concurrency.lockutils [None req-3358784c-054b-40fb-bfb6-5553137847e0 tempest-AttachVolumeShelveTestJSON-385853788 tempest-AttachVolumeShelveTestJSON-385853788-project] Acquiring lock "1daf4f4c-0e4a-4779-b53a-78c48397ea2f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120741) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 18:07:20.861319 dv-cinder-852009-8-iscsi devstack@n-api.service[120741]: DEBUG oslo_concurrency.lockutils [None req-3358784c-054b-40fb-bfb6-5553137847e0 tempest-AttachVolumeShelveTestJSON-385853788 tempest-AttachVolumeShelveTestJSON-385853788-project] Lock "1daf4f4c-0e4a-4779-b53a-78c48397ea2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120741) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 18:07:20.861750 dv-cinder-852009-8-iscsi devstack@n-api.service[120741]: DEBUG oslo_concurrency.lockutils [None req-3358784c-054b-40fb-bfb6-5553137847e0 tempest-AttachVolumeShelveTestJSON-385853788 tempest-AttachVolumeShelveTestJSON-385853788-project] Lock "1daf4f4c-0e4a-4779-b53a-78c48397ea2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120741) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 18:07:20.862436 dv-cinder-852009-8-iscsi devstack@n-api.service[120741]: DEBUG oslo_concurrency.lockutils [None req-3358784c-054b-40fb-bfb6-5553137847e0 tempest-AttachVolumeShelveTestJSON-385853788 tempest-AttachVolumeShelveTestJSON-385853788-project] Acquiring lock "1daf4f4c-0e4a-4779-b53a-78c48397ea2f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120741) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 18:07:20.862888 dv-cinder-852009-8-iscsi devstack@n-api.service[120741]: DEBUG oslo_concurrency.lockutils [None req-3358784c-054b-40fb-bfb6-5553137847e0 tempest-AttachVolumeShelveTestJSON-385853788 tempest-AttachVolumeShelveTestJSON-385853788-project] Lock "1daf4f4c-0e4a-4779-b53a-78c48397ea2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120741) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 18:07:20.863306 dv-cinder-852009-8-iscsi devstack@n-api.service[120741]: DEBUG oslo_concurrency.lockutils [None req-3358784c-054b-40fb-bfb6-5553137847e0 tempest-AttachVolumeShelveTestJSON-385853788 tempest-AttachVolumeShelveTestJSON-385853788-project] Lock "1daf4f4c-0e4a-4779-b53a-78c48397ea2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120741) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 18:07:21.117288 dv-cinder-852009-8-iscsi devstack@n-api.service[120741]: INFO nova.api.openstack.requestlog [None req-3358784c-054b-40fb-bfb6-5553137847e0 tempest-AttachVolumeShelveTestJSON-385853788 tempest-AttachVolumeShelveTestJSON-385853788-project] 10.222.0.43 "DELETE /compute/v2.1/servers/8cecf08e-bea8-4cef-9439-0eaa242bfed1/os-volume_attachments/c2165d0c-70e0-4780-b427-d15b390c4408" status: 202 len: 0 microversion: 2.20 time: 0.267759 Sep 13 18:07:21.117834 dv-cinder-852009-8-iscsi devstack@n-api.service[120741]: [pid: 120741|app: 0|req: 306/624] 10.222.0.43 () {60 vars in 1457 bytes} [Tue Sep 13 18:07:20 2022] DELETE /compute/v2.1/servers/8cecf08e-bea8-4cef-9439-0eaa242bfed1/os-volume_attachments/c2165d0c-70e0-4780-b427-d15b390c4408 => generated 0 bytes in 269 msecs (HTTP/1.1 202) 9 headers in 363 bytes (1 switches on core 0) Sep 13 18:07:21.179070 dv-cinder-852009-8-iscsi devstack@n-api.service[120740]: DEBUG nova.api.openstack.wsgi [None req-372e6e87-ba13-47d8-b115-e72d7c72302f tempest-AttachVolumeShelveTestJSON-385853788 tempest-AttachVolumeShelveTestJSON-385853788-project] Action: 'action', calling method: >, body: {"unshelve": null} {{(pid=120740) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 13 18:07:21.179785 dv-cinder-852009-8-iscsi devstack@n-api.service[120740]: DEBUG nova.compute.api [None req-372e6e87-ba13-47d8-b115-e72d7c72302f tempest-AttachVolumeShelveTestJSON-385853788 tempest-AttachVolumeShelveTestJSON-385853788-project] [instance: 8cecf08e-bea8-4cef-9439-0eaa242bfed1] Fetching instance by UUID {{(pid=120740) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 18:07:21.185949 dv-cinder-852009-8-iscsi devstack@n-api.service[120740]: DEBUG oslo_concurrency.lockutils [None req-372e6e87-ba13-47d8-b115-e72d7c72302f tempest-AttachVolumeShelveTestJSON-385853788 tempest-AttachVolumeShelveTestJSON-385853788-project] Acquiring lock "1daf4f4c-0e4a-4779-b53a-78c48397ea2f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120740) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 18:07:21.186407 dv-cinder-852009-8-iscsi devstack@n-api.service[120740]: DEBUG oslo_concurrency.lockutils [None req-372e6e87-ba13-47d8-b115-e72d7c72302f tempest-AttachVolumeShelveTestJSON-385853788 tempest-AttachVolumeShelveTestJSON-385853788-project] Lock "1daf4f4c-0e4a-4779-b53a-78c48397ea2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120740) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 18:07:21.186841 dv-cinder-852009-8-iscsi devstack@n-api.service[120740]: DEBUG oslo_concurrency.lockutils [None req-372e6e87-ba13-47d8-b115-e72d7c72302f tempest-AttachVolumeShelveTestJSON-385853788 tempest-AttachVolumeShelveTestJSON-385853788-project] Lock "1daf4f4c-0e4a-4779-b53a-78c48397ea2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120740) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 18:07:21.187533 dv-cinder-852009-8-iscsi devstack@n-api.service[120740]: DEBUG oslo_concurrency.lockutils [None req-372e6e87-ba13-47d8-b115-e72d7c72302f tempest-AttachVolumeShelveTestJSON-385853788 tempest-AttachVolumeShelveTestJSON-385853788-project] Acquiring lock "1daf4f4c-0e4a-4779-b53a-78c48397ea2f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120740) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 18:07:21.187985 dv-cinder-852009-8-iscsi devstack@n-api.service[120740]: DEBUG oslo_concurrency.lockutils [None req-372e6e87-ba13-47d8-b115-e72d7c72302f tempest-AttachVolumeShelveTestJSON-385853788 tempest-AttachVolumeShelveTestJSON-385853788-project] Lock "1daf4f4c-0e4a-4779-b53a-78c48397ea2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120740) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 18:07:21.188394 dv-cinder-852009-8-iscsi devstack@n-api.service[120740]: DEBUG oslo_concurrency.lockutils [None req-372e6e87-ba13-47d8-b115-e72d7c72302f tempest-AttachVolumeShelveTestJSON-385853788 tempest-AttachVolumeShelveTestJSON-385853788-project] Lock "1daf4f4c-0e4a-4779-b53a-78c48397ea2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120740) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 18:07:21.279278 dv-cinder-852009-8-iscsi devstack@n-api.service[120741]: DEBUG nova.api.openstack.wsgi [None req-fe214507-8f51-4278-a078-1f6ede4214a1 tempest-AttachVolumeTestJSON-555093534 tempest-AttachVolumeTestJSON-555093534-project] Calling method '>' {{(pid=120741) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 18:07:21.281589 dv-cinder-852009-8-iscsi devstack@n-api.service[120741]: DEBUG nova.compute.api [None req-fe214507-8f51-4278-a078-1f6ede4214a1 tempest-AttachVolumeTestJSON-555093534 tempest-AttachVolumeTestJSON-555093534-project] [instance: d0983ec1-bb82-4a7d-9dba-ace1e3eb383a] Fetching instance by UUID {{(pid=120741) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 18:07:21.288584 dv-cinder-852009-8-iscsi devstack@n-api.service[120741]: DEBUG oslo_concurrency.lockutils [None req-fe214507-8f51-4278-a078-1f6ede4214a1 tempest-AttachVolumeTestJSON-555093534 tempest-AttachVolumeTestJSON-555093534-project] Acquiring lock "1daf4f4c-0e4a-4779-b53a-78c48397ea2f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120741) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 18:07:21.289040 dv-cinder-852009-8-iscsi devstack@n-api.service[120741]: DEBUG oslo_concurrency.lockutils [None req-fe214507-8f51-4278-a078-1f6ede4214a1 tempest-AttachVolumeTestJSON-555093534 tempest-AttachVolumeTestJSON-555093534-project] Lock "1daf4f4c-0e4a-4779-b53a-78c48397ea2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120741) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 18:07:21.289471 dv-cinder-852009-8-iscsi devstack@n-api.service[120741]: DEBUG oslo_concurrency.lockutils [None req-fe214507-8f51-4278-a078-1f6ede4214a1 tempest-AttachVolumeTestJSON-555093534 tempest-AttachVolumeTestJSON-555093534-project] Lock "1daf4f4c-0e4a-4779-b53a-78c48397ea2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120741) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 18:07:21.290138 dv-cinder-852009-8-iscsi devstack@n-api.service[120741]: DEBUG oslo_concurrency.lockutils [None req-fe214507-8f51-4278-a078-1f6ede4214a1 tempest-AttachVolumeTestJSON-555093534 tempest-AttachVolumeTestJSON-555093534-project] Acquiring lock "1daf4f4c-0e4a-4779-b53a-78c48397ea2f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120741) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 18:07:21.290583 dv-cinder-852009-8-iscsi devstack@n-api.service[120741]: DEBUG oslo_concurrency.lockutils [None req-fe214507-8f51-4278-a078-1f6ede4214a1 tempest-AttachVolumeTestJSON-555093534 tempest-AttachVolumeTestJSON-555093534-project] Lock "1daf4f4c-0e4a-4779-b53a-78c48397ea2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120741) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 18:07:21.290997 dv-cinder-852009-8-iscsi devstack@n-api.service[120741]: DEBUG oslo_concurrency.lockutils [None req-fe214507-8f51-4278-a078-1f6ede4214a1 tempest-AttachVolumeTestJSON-555093534 tempest-AttachVolumeTestJSON-555093534-project] Lock "1daf4f4c-0e4a-4779-b53a-78c48397ea2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120741) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 18:07:21.322070 dv-cinder-852009-8-iscsi devstack@n-api.service[120741]: INFO nova.api.openstack.requestlog [None req-fe214507-8f51-4278-a078-1f6ede4214a1 tempest-AttachVolumeTestJSON-555093534 tempest-AttachVolumeTestJSON-555093534-project] 10.222.0.43 "GET /compute/v2.1/servers/d0983ec1-bb82-4a7d-9dba-ace1e3eb383a/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.046738 Sep 13 18:07:21.322633 dv-cinder-852009-8-iscsi devstack@n-api.service[120741]: [pid: 120741|app: 0|req: 307/625] 10.222.0.43 () {58 vars in 1302 bytes} [Tue Sep 13 18:07:21 2022] GET /compute/v2.1/servers/d0983ec1-bb82-4a7d-9dba-ace1e3eb383a/os-volume_attachments => generated 197 bytes in 48 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Sep 13 18:07:21.331945 dv-cinder-852009-8-iscsi devstack@n-api.service[120740]: DEBUG nova.compute.api [None req-372e6e87-ba13-47d8-b115-e72d7c72302f tempest-AttachVolumeShelveTestJSON-385853788 tempest-AttachVolumeShelveTestJSON-385853788-project] [instance: 8cecf08e-bea8-4cef-9439-0eaa242bfed1] Unshelving instance with old availability_zone "None" to new availability_zone "not provided" and host "None". {{(pid=120740) unshelve /opt/stack/nova/nova/compute/api.py:4593}} Sep 13 18:07:21.333449 dv-cinder-852009-8-iscsi devstack@n-api.service[120741]: DEBUG nova.api.openstack.wsgi [None req-8c2c7a19-8fb9-47cf-9a81-670b8f7143bc tempest-AttachVolumeTestJSON-555093534 tempest-AttachVolumeTestJSON-555093534-project] Calling method '>' {{(pid=120741) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 18:07:21.334017 dv-cinder-852009-8-iscsi devstack@n-api.service[120741]: DEBUG nova.compute.api [None req-8c2c7a19-8fb9-47cf-9a81-670b8f7143bc tempest-AttachVolumeTestJSON-555093534 tempest-AttachVolumeTestJSON-555093534-project] [instance: d0983ec1-bb82-4a7d-9dba-ace1e3eb383a] Fetching instance by UUID {{(pid=120741) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 18:07:21.340171 dv-cinder-852009-8-iscsi devstack@n-api.service[120741]: DEBUG oslo_concurrency.lockutils [None req-8c2c7a19-8fb9-47cf-9a81-670b8f7143bc tempest-AttachVolumeTestJSON-555093534 tempest-AttachVolumeTestJSON-555093534-project] Acquiring lock "1daf4f4c-0e4a-4779-b53a-78c48397ea2f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120741) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 18:07:21.340790 dv-cinder-852009-8-iscsi devstack@n-api.service[120741]: DEBUG oslo_concurrency.lockutils [None req-8c2c7a19-8fb9-47cf-9a81-670b8f7143bc tempest-AttachVolumeTestJSON-555093534 tempest-AttachVolumeTestJSON-555093534-project] Lock "1daf4f4c-0e4a-4779-b53a-78c48397ea2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120741) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 18:07:21.341290 dv-cinder-852009-8-iscsi devstack@n-api.service[120741]: DEBUG oslo_concurrency.lockutils [None req-8c2c7a19-8fb9-47cf-9a81-670b8f7143bc tempest-AttachVolumeTestJSON-555093534 tempest-AttachVolumeTestJSON-555093534-project] Lock "1daf4f4c-0e4a-4779-b53a-78c48397ea2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120741) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 18:07:21.341995 dv-cinder-852009-8-iscsi devstack@n-api.service[120741]: DEBUG oslo_concurrency.lockutils [None req-8c2c7a19-8fb9-47cf-9a81-670b8f7143bc tempest-AttachVolumeTestJSON-555093534 tempest-AttachVolumeTestJSON-555093534-project] Acquiring lock "1daf4f4c-0e4a-4779-b53a-78c48397ea2f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120741) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 18:07:21.342605 dv-cinder-852009-8-iscsi devstack@n-api.service[120741]: DEBUG oslo_concurrency.lockutils [None req-8c2c7a19-8fb9-47cf-9a81-670b8f7143bc tempest-AttachVolumeTestJSON-555093534 tempest-AttachVolumeTestJSON-555093534-project] Lock "1daf4f4c-0e4a-4779-b53a-78c48397ea2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120741) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 18:07:21.343206 dv-cinder-852009-8-iscsi devstack@n-api.service[120741]: DEBUG oslo_concurrency.lockutils [None req-8c2c7a19-8fb9-47cf-9a81-670b8f7143bc tempest-AttachVolumeTestJSON-555093534 tempest-AttachVolumeTestJSON-555093534-project] Lock "1daf4f4c-0e4a-4779-b53a-78c48397ea2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120741) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 18:07:21.373824 dv-cinder-852009-8-iscsi devstack@n-api.service[120741]: INFO nova.api.openstack.requestlog [None req-8c2c7a19-8fb9-47cf-9a81-670b8f7143bc tempest-AttachVolumeTestJSON-555093534 tempest-AttachVolumeTestJSON-555093534-project] 10.222.0.43 "GET /compute/v2.1/servers/d0983ec1-bb82-4a7d-9dba-ace1e3eb383a/os-volume_attachments/167cdb89-8f77-41eb-81a5-1a7af5798e0d" status: 200 len: 194 microversion: 2.1 time: 0.044026 Sep 13 18:07:21.374406 dv-cinder-852009-8-iscsi devstack@n-api.service[120741]: [pid: 120741|app: 0|req: 308/626] 10.222.0.43 () {58 vars in 1413 bytes} [Tue Sep 13 18:07:21 2022] GET /compute/v2.1/servers/d0983ec1-bb82-4a7d-9dba-ace1e3eb383a/os-volume_attachments/167cdb89-8f77-41eb-81a5-1a7af5798e0d => generated 194 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Sep 13 18:07:21.380067 dv-cinder-852009-8-iscsi devstack@n-api.service[120740]: DEBUG dbcounter [-] [120740] Writing DB stats nova_cell1:SELECT=93,nova_cell1:INSERT=3,nova_cell1:UPDATE=4 {{(pid=120740) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 18:07:21.435858 dv-cinder-852009-8-iscsi devstack@n-api.service[120740]: INFO nova.api.openstack.requestlog [None req-372e6e87-ba13-47d8-b115-e72d7c72302f tempest-AttachVolumeShelveTestJSON-385853788 tempest-AttachVolumeShelveTestJSON-385853788-project] 10.222.0.43 "POST /compute/v2.1/servers/8cecf08e-bea8-4cef-9439-0eaa242bfed1/action" status: 202 len: 0 microversion: 2.20 time: 0.260777 Sep 13 18:07:21.436827 dv-cinder-852009-8-iscsi devstack@n-api.service[120740]: [pid: 120740|app: 0|req: 319/627] 10.222.0.43 () {62 vars in 1319 bytes} [Tue Sep 13 18:07:21 2022] POST /compute/v2.1/servers/8cecf08e-bea8-4cef-9439-0eaa242bfed1/action => generated 0 bytes in 262 msecs (HTTP/1.1 202) 9 headers in 363 bytes (1 switches on core 0) Sep 13 18:07:21.445329 dv-cinder-852009-8-iscsi devstack@n-api.service[120741]: DEBUG nova.api.openstack.wsgi [None req-df99bcb9-9256-4eb0-b3d3-c171a06fe919 tempest-AttachVolumeShelveTestJSON-385853788 tempest-AttachVolumeShelveTestJSON-385853788-project] Calling method '>' {{(pid=120741) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 18:07:21.446261 dv-cinder-852009-8-iscsi devstack@n-api.service[120741]: DEBUG nova.compute.api [None req-df99bcb9-9256-4eb0-b3d3-c171a06fe919 tempest-AttachVolumeShelveTestJSON-385853788 tempest-AttachVolumeShelveTestJSON-385853788-project] [instance: 8cecf08e-bea8-4cef-9439-0eaa242bfed1] Fetching instance by UUID {{(pid=120741) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 18:07:21.453441 dv-cinder-852009-8-iscsi devstack@n-api.service[120741]: DEBUG oslo_concurrency.lockutils [None req-df99bcb9-9256-4eb0-b3d3-c171a06fe919 tempest-AttachVolumeShelveTestJSON-385853788 tempest-AttachVolumeShelveTestJSON-385853788-project] Acquiring lock "1daf4f4c-0e4a-4779-b53a-78c48397ea2f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120741) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 18:07:21.454564 dv-cinder-852009-8-iscsi devstack@n-api.service[120741]: DEBUG oslo_concurrency.lockutils [None req-df99bcb9-9256-4eb0-b3d3-c171a06fe919 tempest-AttachVolumeShelveTestJSON-385853788 tempest-AttachVolumeShelveTestJSON-385853788-project] Lock "1daf4f4c-0e4a-4779-b53a-78c48397ea2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120741) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 18:07:21.455196 dv-cinder-852009-8-iscsi devstack@n-api.service[120741]: DEBUG oslo_concurrency.lockutils [None req-df99bcb9-9256-4eb0-b3d3-c171a06fe919 tempest-AttachVolumeShelveTestJSON-385853788 tempest-AttachVolumeShelveTestJSON-385853788-project] Lock "1daf4f4c-0e4a-4779-b53a-78c48397ea2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120741) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 18:07:21.456098 dv-cinder-852009-8-iscsi devstack@n-api.service[120741]: DEBUG oslo_concurrency.lockutils [None req-df99bcb9-9256-4eb0-b3d3-c171a06fe919 tempest-AttachVolumeShelveTestJSON-385853788 tempest-AttachVolumeShelveTestJSON-385853788-project] Acquiring lock "1daf4f4c-0e4a-4779-b53a-78c48397ea2f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120741) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 18:07:21.456783 dv-cinder-852009-8-iscsi devstack@n-api.service[120741]: DEBUG oslo_concurrency.lockutils [None req-df99bcb9-9256-4eb0-b3d3-c171a06fe919 tempest-AttachVolumeShelveTestJSON-385853788 tempest-AttachVolumeShelveTestJSON-385853788-project] Lock "1daf4f4c-0e4a-4779-b53a-78c48397ea2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120741) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 18:07:21.457392 dv-cinder-852009-8-iscsi devstack@n-api.service[120741]: DEBUG oslo_concurrency.lockutils [None req-df99bcb9-9256-4eb0-b3d3-c171a06fe919 tempest-AttachVolumeShelveTestJSON-385853788 tempest-AttachVolumeShelveTestJSON-385853788-project] Lock "1daf4f4c-0e4a-4779-b53a-78c48397ea2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120741) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 18:07:21.616547 dv-cinder-852009-8-iscsi devstack@n-api.service[120741]: DEBUG nova.policy [None req-df99bcb9-9256-4eb0-b3d3-c171a06fe919 tempest-AttachVolumeShelveTestJSON-385853788 tempest-AttachVolumeShelveTestJSON-385853788-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e68ecd9b3ca643539b109f75bb242d6f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '75e14fd88bfb4cd896fa7b070a0fac47', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120741) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 18:07:21.631214 dv-cinder-852009-8-iscsi devstack@n-api.service[120741]: DEBUG nova.policy [None req-df99bcb9-9256-4eb0-b3d3-c171a06fe919 tempest-AttachVolumeShelveTestJSON-385853788 tempest-AttachVolumeShelveTestJSON-385853788-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'e68ecd9b3ca643539b109f75bb242d6f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '75e14fd88bfb4cd896fa7b070a0fac47', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120741) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 18:07:21.633839 dv-cinder-852009-8-iscsi devstack@n-api.service[120741]: DEBUG nova.policy [None req-df99bcb9-9256-4eb0-b3d3-c171a06fe919 tempest-AttachVolumeShelveTestJSON-385853788 tempest-AttachVolumeShelveTestJSON-385853788-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'e68ecd9b3ca643539b109f75bb242d6f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '75e14fd88bfb4cd896fa7b070a0fac47', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120741) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 18:07:21.635455 dv-cinder-852009-8-iscsi devstack@n-api.service[120741]: INFO nova.api.openstack.requestlog [None req-df99bcb9-9256-4eb0-b3d3-c171a06fe919 tempest-AttachVolumeShelveTestJSON-385853788 tempest-AttachVolumeShelveTestJSON-385853788-project] 10.222.0.43 "GET /compute/v2.1/servers/8cecf08e-bea8-4cef-9439-0eaa242bfed1" status: 200 len: 1671 microversion: 2.20 time: 0.194728 Sep 13 18:07:21.638783 dv-cinder-852009-8-iscsi devstack@n-api.service[120741]: [pid: 120741|app: 0|req: 309/628] 10.222.0.43 () {60 vars in 1277 bytes} [Tue Sep 13 18:07:21 2022] GET /compute/v2.1/servers/8cecf08e-bea8-4cef-9439-0eaa242bfed1 => generated 1671 bytes in 199 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Sep 13 18:07:22.665451 dv-cinder-852009-8-iscsi devstack@n-api.service[120740]: DEBUG nova.api.openstack.wsgi [None req-f3ee48e8-11a5-4e76-a44b-114f02b4c7a4 tempest-AttachVolumeShelveTestJSON-385853788 tempest-AttachVolumeShelveTestJSON-385853788-project] Calling method '>' {{(pid=120740) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 18:07:22.666167 dv-cinder-852009-8-iscsi devstack@n-api.service[120740]: DEBUG nova.compute.api [None req-f3ee48e8-11a5-4e76-a44b-114f02b4c7a4 tempest-AttachVolumeShelveTestJSON-385853788 tempest-AttachVolumeShelveTestJSON-385853788-project] [instance: 8cecf08e-bea8-4cef-9439-0eaa242bfed1] Fetching instance by UUID {{(pid=120740) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 18:07:22.673519 dv-cinder-852009-8-iscsi devstack@n-api.service[120740]: DEBUG oslo_concurrency.lockutils [None req-f3ee48e8-11a5-4e76-a44b-114f02b4c7a4 tempest-AttachVolumeShelveTestJSON-385853788 tempest-AttachVolumeShelveTestJSON-385853788-project] Acquiring lock "1daf4f4c-0e4a-4779-b53a-78c48397ea2f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120740) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 18:07:22.673901 dv-cinder-852009-8-iscsi devstack@n-api.service[120740]: DEBUG oslo_concurrency.lockutils [None req-f3ee48e8-11a5-4e76-a44b-114f02b4c7a4 tempest-AttachVolumeShelveTestJSON-385853788 tempest-AttachVolumeShelveTestJSON-385853788-project] Lock "1daf4f4c-0e4a-4779-b53a-78c48397ea2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120740) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 18:07:22.674524 dv-cinder-852009-8-iscsi devstack@n-api.service[120740]: DEBUG oslo_concurrency.lockutils [None req-f3ee48e8-11a5-4e76-a44b-114f02b4c7a4 tempest-AttachVolumeShelveTestJSON-385853788 tempest-AttachVolumeShelveTestJSON-385853788-project] Lock "1daf4f4c-0e4a-4779-b53a-78c48397ea2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120740) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 18:07:22.675235 dv-cinder-852009-8-iscsi devstack@n-api.service[120740]: DEBUG oslo_concurrency.lockutils [None req-f3ee48e8-11a5-4e76-a44b-114f02b4c7a4 tempest-AttachVolumeShelveTestJSON-385853788 tempest-AttachVolumeShelveTestJSON-385853788-project] Acquiring lock "1daf4f4c-0e4a-4779-b53a-78c48397ea2f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120740) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 18:07:22.675690 dv-cinder-852009-8-iscsi devstack@n-api.service[120740]: DEBUG oslo_concurrency.lockutils [None req-f3ee48e8-11a5-4e76-a44b-114f02b4c7a4 tempest-AttachVolumeShelveTestJSON-385853788 tempest-AttachVolumeShelveTestJSON-385853788-project] Lock "1daf4f4c-0e4a-4779-b53a-78c48397ea2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120740) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 18:07:22.676268 dv-cinder-852009-8-iscsi devstack@n-api.service[120740]: DEBUG oslo_concurrency.lockutils [None req-f3ee48e8-11a5-4e76-a44b-114f02b4c7a4 tempest-AttachVolumeShelveTestJSON-385853788 tempest-AttachVolumeShelveTestJSON-385853788-project] Lock "1daf4f4c-0e4a-4779-b53a-78c48397ea2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120740) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 18:07:22.858489 dv-cinder-852009-8-iscsi devstack@n-api.service[120740]: DEBUG nova.policy [None req-f3ee48e8-11a5-4e76-a44b-114f02b4c7a4 tempest-AttachVolumeShelveTestJSON-385853788 tempest-AttachVolumeShelveTestJSON-385853788-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e68ecd9b3ca643539b109f75bb242d6f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '75e14fd88bfb4cd896fa7b070a0fac47', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120740) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 18:07:22.860332 dv-cinder-852009-8-iscsi devstack@n-api.service[120741]: DEBUG nova.api.openstack.wsgi [None req-79c2203f-b03a-4dd3-9a17-678327d10243 tempest-AttachVolumeTestJSON-555093534 tempest-AttachVolumeTestJSON-555093534-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "e0d075e8-2581-47b4-9063-a1a6d51a268c"}} {{(pid=120741) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 13 18:07:22.864027 dv-cinder-852009-8-iscsi devstack@n-api.service[120741]: DEBUG nova.compute.api [None req-79c2203f-b03a-4dd3-9a17-678327d10243 tempest-AttachVolumeTestJSON-555093534 tempest-AttachVolumeTestJSON-555093534-project] [instance: d0983ec1-bb82-4a7d-9dba-ace1e3eb383a] Fetching instance by UUID {{(pid=120741) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 18:07:22.867126 dv-cinder-852009-8-iscsi devstack@n-api.service[120740]: DEBUG nova.policy [None req-f3ee48e8-11a5-4e76-a44b-114f02b4c7a4 tempest-AttachVolumeShelveTestJSON-385853788 tempest-AttachVolumeShelveTestJSON-385853788-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'e68ecd9b3ca643539b109f75bb242d6f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '75e14fd88bfb4cd896fa7b070a0fac47', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120740) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 18:07:22.869430 dv-cinder-852009-8-iscsi devstack@n-api.service[120740]: DEBUG nova.policy [None req-f3ee48e8-11a5-4e76-a44b-114f02b4c7a4 tempest-AttachVolumeShelveTestJSON-385853788 tempest-AttachVolumeShelveTestJSON-385853788-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'e68ecd9b3ca643539b109f75bb242d6f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '75e14fd88bfb4cd896fa7b070a0fac47', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120740) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 18:07:22.870959 dv-cinder-852009-8-iscsi devstack@n-api.service[120740]: INFO nova.api.openstack.requestlog [None req-f3ee48e8-11a5-4e76-a44b-114f02b4c7a4 tempest-AttachVolumeShelveTestJSON-385853788 tempest-AttachVolumeShelveTestJSON-385853788-project] 10.222.0.43 "GET /compute/v2.1/servers/8cecf08e-bea8-4cef-9439-0eaa242bfed1" status: 200 len: 1671 microversion: 2.20 time: 0.210408 Sep 13 18:07:22.872010 dv-cinder-852009-8-iscsi devstack@n-api.service[120740]: [pid: 120740|app: 0|req: 320/629] 10.222.0.43 () {60 vars in 1277 bytes} [Tue Sep 13 18:07:22 2022] GET /compute/v2.1/servers/8cecf08e-bea8-4cef-9439-0eaa242bfed1 => generated 1671 bytes in 212 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 13 18:07:22.873363 dv-cinder-852009-8-iscsi devstack@n-api.service[120741]: DEBUG oslo_concurrency.lockutils [None req-79c2203f-b03a-4dd3-9a17-678327d10243 tempest-AttachVolumeTestJSON-555093534 tempest-AttachVolumeTestJSON-555093534-project] Acquiring lock "1daf4f4c-0e4a-4779-b53a-78c48397ea2f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120741) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 18:07:22.874319 dv-cinder-852009-8-iscsi devstack@n-api.service[120741]: DEBUG oslo_concurrency.lockutils [None req-79c2203f-b03a-4dd3-9a17-678327d10243 tempest-AttachVolumeTestJSON-555093534 tempest-AttachVolumeTestJSON-555093534-project] Lock "1daf4f4c-0e4a-4779-b53a-78c48397ea2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120741) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 18:07:22.874750 dv-cinder-852009-8-iscsi devstack@n-api.service[120741]: DEBUG oslo_concurrency.lockutils [None req-79c2203f-b03a-4dd3-9a17-678327d10243 tempest-AttachVolumeTestJSON-555093534 tempest-AttachVolumeTestJSON-555093534-project] Lock "1daf4f4c-0e4a-4779-b53a-78c48397ea2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120741) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 18:07:22.875456 dv-cinder-852009-8-iscsi devstack@n-api.service[120741]: DEBUG oslo_concurrency.lockutils [None req-79c2203f-b03a-4dd3-9a17-678327d10243 tempest-AttachVolumeTestJSON-555093534 tempest-AttachVolumeTestJSON-555093534-project] Acquiring lock "1daf4f4c-0e4a-4779-b53a-78c48397ea2f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120741) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 18:07:22.875903 dv-cinder-852009-8-iscsi devstack@n-api.service[120741]: DEBUG oslo_concurrency.lockutils [None req-79c2203f-b03a-4dd3-9a17-678327d10243 tempest-AttachVolumeTestJSON-555093534 tempest-AttachVolumeTestJSON-555093534-project] Lock "1daf4f4c-0e4a-4779-b53a-78c48397ea2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120741) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 18:07:22.876320 dv-cinder-852009-8-iscsi devstack@n-api.service[120741]: DEBUG oslo_concurrency.lockutils [None req-79c2203f-b03a-4dd3-9a17-678327d10243 tempest-AttachVolumeTestJSON-555093534 tempest-AttachVolumeTestJSON-555093534-project] Lock "1daf4f4c-0e4a-4779-b53a-78c48397ea2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120741) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 18:07:23.131971 dv-cinder-852009-8-iscsi devstack@n-api.service[120741]: DEBUG dbcounter [-] [120741] Writing DB stats nova_cell1:SELECT=89,nova_cell1:UPDATE=8,nova_cell1:INSERT=3 {{(pid=120741) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 18:07:23.153314 dv-cinder-852009-8-iscsi devstack@n-api.service[120741]: INFO nova.api.openstack.requestlog [None req-79c2203f-b03a-4dd3-9a17-678327d10243 tempest-AttachVolumeTestJSON-555093534 tempest-AttachVolumeTestJSON-555093534-project] 10.222.0.43 "POST /compute/v2.1/servers/d0983ec1-bb82-4a7d-9dba-ace1e3eb383a/os-volume_attachments" status: 200 len: 194 microversion: 2.1 time: 0.297483 Sep 13 18:07:23.153926 dv-cinder-852009-8-iscsi devstack@n-api.service[120741]: [pid: 120741|app: 0|req: 310/630] 10.222.0.43 () {60 vars in 1323 bytes} [Tue Sep 13 18:07:22 2022] POST /compute/v2.1/servers/d0983ec1-bb82-4a7d-9dba-ace1e3eb383a/os-volume_attachments => generated 194 bytes in 299 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Sep 13 18:07:23.900105 dv-cinder-852009-8-iscsi devstack@n-api.service[120740]: DEBUG nova.api.openstack.wsgi [None req-658f83dd-3d11-47d7-9af3-0b1bfb311d27 tempest-AttachVolumeShelveTestJSON-385853788 tempest-AttachVolumeShelveTestJSON-385853788-project] Calling method '>' {{(pid=120740) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 18:07:23.901551 dv-cinder-852009-8-iscsi devstack@n-api.service[120740]: DEBUG nova.compute.api [None req-658f83dd-3d11-47d7-9af3-0b1bfb311d27 tempest-AttachVolumeShelveTestJSON-385853788 tempest-AttachVolumeShelveTestJSON-385853788-project] [instance: 8cecf08e-bea8-4cef-9439-0eaa242bfed1] Fetching instance by UUID {{(pid=120740) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 18:07:23.908624 dv-cinder-852009-8-iscsi devstack@n-api.service[120740]: DEBUG oslo_concurrency.lockutils [None req-658f83dd-3d11-47d7-9af3-0b1bfb311d27 tempest-AttachVolumeShelveTestJSON-385853788 tempest-AttachVolumeShelveTestJSON-385853788-project] Acquiring lock "1daf4f4c-0e4a-4779-b53a-78c48397ea2f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120740) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 18:07:23.909154 dv-cinder-852009-8-iscsi devstack@n-api.service[120740]: DEBUG oslo_concurrency.lockutils [None req-658f83dd-3d11-47d7-9af3-0b1bfb311d27 tempest-AttachVolumeShelveTestJSON-385853788 tempest-AttachVolumeShelveTestJSON-385853788-project] Lock "1daf4f4c-0e4a-4779-b53a-78c48397ea2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120740) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 18:07:23.909556 dv-cinder-852009-8-iscsi devstack@n-api.service[120740]: DEBUG oslo_concurrency.lockutils [None req-658f83dd-3d11-47d7-9af3-0b1bfb311d27 tempest-AttachVolumeShelveTestJSON-385853788 tempest-AttachVolumeShelveTestJSON-385853788-project] Lock "1daf4f4c-0e4a-4779-b53a-78c48397ea2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120740) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 18:07:23.910280 dv-cinder-852009-8-iscsi devstack@n-api.service[120740]: DEBUG oslo_concurrency.lockutils [None req-658f83dd-3d11-47d7-9af3-0b1bfb311d27 tempest-AttachVolumeShelveTestJSON-385853788 tempest-AttachVolumeShelveTestJSON-385853788-project] Acquiring lock "1daf4f4c-0e4a-4779-b53a-78c48397ea2f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120740) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 18:07:23.910732 dv-cinder-852009-8-iscsi devstack@n-api.service[120740]: DEBUG oslo_concurrency.lockutils [None req-658f83dd-3d11-47d7-9af3-0b1bfb311d27 tempest-AttachVolumeShelveTestJSON-385853788 tempest-AttachVolumeShelveTestJSON-385853788-project] Lock "1daf4f4c-0e4a-4779-b53a-78c48397ea2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120740) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 18:07:23.911129 dv-cinder-852009-8-iscsi devstack@n-api.service[120740]: DEBUG oslo_concurrency.lockutils [None req-658f83dd-3d11-47d7-9af3-0b1bfb311d27 tempest-AttachVolumeShelveTestJSON-385853788 tempest-AttachVolumeShelveTestJSON-385853788-project] Lock "1daf4f4c-0e4a-4779-b53a-78c48397ea2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120740) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 18:07:24.069967 dv-cinder-852009-8-iscsi devstack@n-api.service[120740]: DEBUG nova.policy [None req-658f83dd-3d11-47d7-9af3-0b1bfb311d27 tempest-AttachVolumeShelveTestJSON-385853788 tempest-AttachVolumeShelveTestJSON-385853788-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e68ecd9b3ca643539b109f75bb242d6f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '75e14fd88bfb4cd896fa7b070a0fac47', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120740) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 18:07:24.078623 dv-cinder-852009-8-iscsi devstack@n-api.service[120740]: DEBUG nova.policy [None req-658f83dd-3d11-47d7-9af3-0b1bfb311d27 tempest-AttachVolumeShelveTestJSON-385853788 tempest-AttachVolumeShelveTestJSON-385853788-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'e68ecd9b3ca643539b109f75bb242d6f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '75e14fd88bfb4cd896fa7b070a0fac47', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120740) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 18:07:24.080281 dv-cinder-852009-8-iscsi devstack@n-api.service[120740]: DEBUG nova.policy [None req-658f83dd-3d11-47d7-9af3-0b1bfb311d27 tempest-AttachVolumeShelveTestJSON-385853788 tempest-AttachVolumeShelveTestJSON-385853788-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'e68ecd9b3ca643539b109f75bb242d6f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '75e14fd88bfb4cd896fa7b070a0fac47', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120740) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 18:07:24.081593 dv-cinder-852009-8-iscsi devstack@n-api.service[120740]: INFO nova.api.openstack.requestlog [None req-658f83dd-3d11-47d7-9af3-0b1bfb311d27 tempest-AttachVolumeShelveTestJSON-385853788 tempest-AttachVolumeShelveTestJSON-385853788-project] 10.222.0.43 "GET /compute/v2.1/servers/8cecf08e-bea8-4cef-9439-0eaa242bfed1" status: 200 len: 1729 microversion: 2.20 time: 0.187700 Sep 13 18:07:24.082315 dv-cinder-852009-8-iscsi devstack@n-api.service[120740]: [pid: 120740|app: 0|req: 321/631] 10.222.0.43 () {60 vars in 1277 bytes} [Tue Sep 13 18:07:23 2022] GET /compute/v2.1/servers/8cecf08e-bea8-4cef-9439-0eaa242bfed1 => generated 1729 bytes in 189 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 13 18:07:25.109943 dv-cinder-852009-8-iscsi devstack@n-api.service[120741]: DEBUG nova.api.openstack.wsgi [None req-6a3fd3d4-1e58-4409-a2ff-6dc8c2e379d4 tempest-AttachVolumeShelveTestJSON-385853788 tempest-AttachVolumeShelveTestJSON-385853788-project] Calling method '>' {{(pid=120741) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 18:07:25.111698 dv-cinder-852009-8-iscsi devstack@n-api.service[120741]: DEBUG nova.compute.api [None req-6a3fd3d4-1e58-4409-a2ff-6dc8c2e379d4 tempest-AttachVolumeShelveTestJSON-385853788 tempest-AttachVolumeShelveTestJSON-385853788-project] [instance: 8cecf08e-bea8-4cef-9439-0eaa242bfed1] Fetching instance by UUID {{(pid=120741) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 18:07:25.118917 dv-cinder-852009-8-iscsi devstack@n-api.service[120741]: DEBUG oslo_concurrency.lockutils [None req-6a3fd3d4-1e58-4409-a2ff-6dc8c2e379d4 tempest-AttachVolumeShelveTestJSON-385853788 tempest-AttachVolumeShelveTestJSON-385853788-project] Acquiring lock "1daf4f4c-0e4a-4779-b53a-78c48397ea2f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120741) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 18:07:25.119639 dv-cinder-852009-8-iscsi devstack@n-api.service[120741]: DEBUG oslo_concurrency.lockutils [None req-6a3fd3d4-1e58-4409-a2ff-6dc8c2e379d4 tempest-AttachVolumeShelveTestJSON-385853788 tempest-AttachVolumeShelveTestJSON-385853788-project] Lock "1daf4f4c-0e4a-4779-b53a-78c48397ea2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120741) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 18:07:25.120259 dv-cinder-852009-8-iscsi devstack@n-api.service[120741]: DEBUG oslo_concurrency.lockutils [None req-6a3fd3d4-1e58-4409-a2ff-6dc8c2e379d4 tempest-AttachVolumeShelveTestJSON-385853788 tempest-AttachVolumeShelveTestJSON-385853788-project] Lock "1daf4f4c-0e4a-4779-b53a-78c48397ea2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120741) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 18:07:25.121360 dv-cinder-852009-8-iscsi devstack@n-api.service[120741]: DEBUG oslo_concurrency.lockutils [None req-6a3fd3d4-1e58-4409-a2ff-6dc8c2e379d4 tempest-AttachVolumeShelveTestJSON-385853788 tempest-AttachVolumeShelveTestJSON-385853788-project] Acquiring lock "1daf4f4c-0e4a-4779-b53a-78c48397ea2f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120741) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 18:07:25.121991 dv-cinder-852009-8-iscsi devstack@n-api.service[120741]: DEBUG oslo_concurrency.lockutils [None req-6a3fd3d4-1e58-4409-a2ff-6dc8c2e379d4 tempest-AttachVolumeShelveTestJSON-385853788 tempest-AttachVolumeShelveTestJSON-385853788-project] Lock "1daf4f4c-0e4a-4779-b53a-78c48397ea2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120741) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 18:07:25.122678 dv-cinder-852009-8-iscsi devstack@n-api.service[120741]: DEBUG oslo_concurrency.lockutils [None req-6a3fd3d4-1e58-4409-a2ff-6dc8c2e379d4 tempest-AttachVolumeShelveTestJSON-385853788 tempest-AttachVolumeShelveTestJSON-385853788-project] Lock "1daf4f4c-0e4a-4779-b53a-78c48397ea2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120741) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 18:07:25.309396 dv-cinder-852009-8-iscsi devstack@n-api.service[120741]: DEBUG nova.policy [None req-6a3fd3d4-1e58-4409-a2ff-6dc8c2e379d4 tempest-AttachVolumeShelveTestJSON-385853788 tempest-AttachVolumeShelveTestJSON-385853788-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e68ecd9b3ca643539b109f75bb242d6f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '75e14fd88bfb4cd896fa7b070a0fac47', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120741) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 18:07:25.319340 dv-cinder-852009-8-iscsi devstack@n-api.service[120741]: DEBUG nova.policy [None req-6a3fd3d4-1e58-4409-a2ff-6dc8c2e379d4 tempest-AttachVolumeShelveTestJSON-385853788 tempest-AttachVolumeShelveTestJSON-385853788-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'e68ecd9b3ca643539b109f75bb242d6f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '75e14fd88bfb4cd896fa7b070a0fac47', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120741) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 18:07:25.320843 dv-cinder-852009-8-iscsi devstack@n-api.service[120741]: DEBUG nova.policy [None req-6a3fd3d4-1e58-4409-a2ff-6dc8c2e379d4 tempest-AttachVolumeShelveTestJSON-385853788 tempest-AttachVolumeShelveTestJSON-385853788-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'e68ecd9b3ca643539b109f75bb242d6f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '75e14fd88bfb4cd896fa7b070a0fac47', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120741) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 18:07:25.322386 dv-cinder-852009-8-iscsi devstack@n-api.service[120741]: INFO nova.api.openstack.requestlog [None req-6a3fd3d4-1e58-4409-a2ff-6dc8c2e379d4 tempest-AttachVolumeShelveTestJSON-385853788 tempest-AttachVolumeShelveTestJSON-385853788-project] 10.222.0.43 "GET /compute/v2.1/servers/8cecf08e-bea8-4cef-9439-0eaa242bfed1" status: 200 len: 1729 microversion: 2.20 time: 0.216893 Sep 13 18:07:25.323746 dv-cinder-852009-8-iscsi devstack@n-api.service[120741]: [pid: 120741|app: 0|req: 311/632] 10.222.0.43 () {60 vars in 1277 bytes} [Tue Sep 13 18:07:25 2022] GET /compute/v2.1/servers/8cecf08e-bea8-4cef-9439-0eaa242bfed1 => generated 1729 bytes in 219 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 13 18:07:26.360066 dv-cinder-852009-8-iscsi devstack@n-api.service[120740]: DEBUG nova.api.openstack.wsgi [None req-052ee373-453e-4be9-8ea2-e16edd3e414d tempest-AttachVolumeShelveTestJSON-385853788 tempest-AttachVolumeShelveTestJSON-385853788-project] Calling method '>' {{(pid=120740) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 18:07:26.360698 dv-cinder-852009-8-iscsi devstack@n-api.service[120740]: DEBUG nova.compute.api [None req-052ee373-453e-4be9-8ea2-e16edd3e414d tempest-AttachVolumeShelveTestJSON-385853788 tempest-AttachVolumeShelveTestJSON-385853788-project] [instance: 8cecf08e-bea8-4cef-9439-0eaa242bfed1] Fetching instance by UUID {{(pid=120740) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 18:07:26.367279 dv-cinder-852009-8-iscsi devstack@n-api.service[120740]: DEBUG oslo_concurrency.lockutils [None req-052ee373-453e-4be9-8ea2-e16edd3e414d tempest-AttachVolumeShelveTestJSON-385853788 tempest-AttachVolumeShelveTestJSON-385853788-project] Acquiring lock "1daf4f4c-0e4a-4779-b53a-78c48397ea2f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120740) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 18:07:26.368588 dv-cinder-852009-8-iscsi devstack@n-api.service[120740]: DEBUG oslo_concurrency.lockutils [None req-052ee373-453e-4be9-8ea2-e16edd3e414d tempest-AttachVolumeShelveTestJSON-385853788 tempest-AttachVolumeShelveTestJSON-385853788-project] Lock "1daf4f4c-0e4a-4779-b53a-78c48397ea2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120740) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 18:07:26.369280 dv-cinder-852009-8-iscsi devstack@n-api.service[120740]: DEBUG oslo_concurrency.lockutils [None req-052ee373-453e-4be9-8ea2-e16edd3e414d tempest-AttachVolumeShelveTestJSON-385853788 tempest-AttachVolumeShelveTestJSON-385853788-project] Lock "1daf4f4c-0e4a-4779-b53a-78c48397ea2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120740) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 18:07:26.370511 dv-cinder-852009-8-iscsi devstack@n-api.service[120740]: DEBUG oslo_concurrency.lockutils [None req-052ee373-453e-4be9-8ea2-e16edd3e414d tempest-AttachVolumeShelveTestJSON-385853788 tempest-AttachVolumeShelveTestJSON-385853788-project] Acquiring lock "1daf4f4c-0e4a-4779-b53a-78c48397ea2f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120740) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 18:07:26.371159 dv-cinder-852009-8-iscsi devstack@n-api.service[120740]: DEBUG oslo_concurrency.lockutils [None req-052ee373-453e-4be9-8ea2-e16edd3e414d tempest-AttachVolumeShelveTestJSON-385853788 tempest-AttachVolumeShelveTestJSON-385853788-project] Lock "1daf4f4c-0e4a-4779-b53a-78c48397ea2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120740) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 18:07:26.371940 dv-cinder-852009-8-iscsi devstack@n-api.service[120740]: DEBUG oslo_concurrency.lockutils [None req-052ee373-453e-4be9-8ea2-e16edd3e414d tempest-AttachVolumeShelveTestJSON-385853788 tempest-AttachVolumeShelveTestJSON-385853788-project] Lock "1daf4f4c-0e4a-4779-b53a-78c48397ea2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120740) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 18:07:26.602347 dv-cinder-852009-8-iscsi devstack@n-api.service[120740]: DEBUG nova.policy [None req-052ee373-453e-4be9-8ea2-e16edd3e414d tempest-AttachVolumeShelveTestJSON-385853788 tempest-AttachVolumeShelveTestJSON-385853788-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e68ecd9b3ca643539b109f75bb242d6f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '75e14fd88bfb4cd896fa7b070a0fac47', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120740) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 18:07:26.611744 dv-cinder-852009-8-iscsi devstack@n-api.service[120740]: DEBUG nova.policy [None req-052ee373-453e-4be9-8ea2-e16edd3e414d tempest-AttachVolumeShelveTestJSON-385853788 tempest-AttachVolumeShelveTestJSON-385853788-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'e68ecd9b3ca643539b109f75bb242d6f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '75e14fd88bfb4cd896fa7b070a0fac47', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120740) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 18:07:26.613782 dv-cinder-852009-8-iscsi devstack@n-api.service[120740]: DEBUG nova.policy [None req-052ee373-453e-4be9-8ea2-e16edd3e414d tempest-AttachVolumeShelveTestJSON-385853788 tempest-AttachVolumeShelveTestJSON-385853788-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'e68ecd9b3ca643539b109f75bb242d6f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '75e14fd88bfb4cd896fa7b070a0fac47', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120740) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 18:07:26.615280 dv-cinder-852009-8-iscsi devstack@n-api.service[120740]: INFO nova.api.openstack.requestlog [None req-052ee373-453e-4be9-8ea2-e16edd3e414d tempest-AttachVolumeShelveTestJSON-385853788 tempest-AttachVolumeShelveTestJSON-385853788-project] 10.222.0.43 "GET /compute/v2.1/servers/8cecf08e-bea8-4cef-9439-0eaa242bfed1" status: 200 len: 1729 microversion: 2.20 time: 0.259272 Sep 13 18:07:26.616448 dv-cinder-852009-8-iscsi devstack@n-api.service[120740]: [pid: 120740|app: 0|req: 322/633] 10.222.0.43 () {60 vars in 1277 bytes} [Tue Sep 13 18:07:26 2022] GET /compute/v2.1/servers/8cecf08e-bea8-4cef-9439-0eaa242bfed1 => generated 1729 bytes in 261 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 13 18:07:27.660876 dv-cinder-852009-8-iscsi devstack@n-api.service[120741]: DEBUG nova.api.openstack.wsgi [None req-da9a208d-63f8-4003-917d-7381afca3973 tempest-AttachVolumeShelveTestJSON-385853788 tempest-AttachVolumeShelveTestJSON-385853788-project] Calling method '>' {{(pid=120741) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 18:07:27.661492 dv-cinder-852009-8-iscsi devstack@n-api.service[120741]: DEBUG nova.compute.api [None req-da9a208d-63f8-4003-917d-7381afca3973 tempest-AttachVolumeShelveTestJSON-385853788 tempest-AttachVolumeShelveTestJSON-385853788-project] [instance: 8cecf08e-bea8-4cef-9439-0eaa242bfed1] Fetching instance by UUID {{(pid=120741) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 18:07:27.669308 dv-cinder-852009-8-iscsi devstack@n-api.service[120741]: DEBUG oslo_concurrency.lockutils [None req-da9a208d-63f8-4003-917d-7381afca3973 tempest-AttachVolumeShelveTestJSON-385853788 tempest-AttachVolumeShelveTestJSON-385853788-project] Acquiring lock "1daf4f4c-0e4a-4779-b53a-78c48397ea2f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120741) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 18:07:27.669721 dv-cinder-852009-8-iscsi devstack@n-api.service[120741]: DEBUG oslo_concurrency.lockutils [None req-da9a208d-63f8-4003-917d-7381afca3973 tempest-AttachVolumeShelveTestJSON-385853788 tempest-AttachVolumeShelveTestJSON-385853788-project] Lock "1daf4f4c-0e4a-4779-b53a-78c48397ea2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120741) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 18:07:27.670159 dv-cinder-852009-8-iscsi devstack@n-api.service[120741]: DEBUG oslo_concurrency.lockutils [None req-da9a208d-63f8-4003-917d-7381afca3973 tempest-AttachVolumeShelveTestJSON-385853788 tempest-AttachVolumeShelveTestJSON-385853788-project] Lock "1daf4f4c-0e4a-4779-b53a-78c48397ea2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120741) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 18:07:27.670861 dv-cinder-852009-8-iscsi devstack@n-api.service[120741]: DEBUG oslo_concurrency.lockutils [None req-da9a208d-63f8-4003-917d-7381afca3973 tempest-AttachVolumeShelveTestJSON-385853788 tempest-AttachVolumeShelveTestJSON-385853788-project] Acquiring lock "1daf4f4c-0e4a-4779-b53a-78c48397ea2f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120741) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 18:07:27.671494 dv-cinder-852009-8-iscsi devstack@n-api.service[120741]: DEBUG oslo_concurrency.lockutils [None req-da9a208d-63f8-4003-917d-7381afca3973 tempest-AttachVolumeShelveTestJSON-385853788 tempest-AttachVolumeShelveTestJSON-385853788-project] Lock "1daf4f4c-0e4a-4779-b53a-78c48397ea2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120741) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 18:07:27.671917 dv-cinder-852009-8-iscsi devstack@n-api.service[120741]: DEBUG oslo_concurrency.lockutils [None req-da9a208d-63f8-4003-917d-7381afca3973 tempest-AttachVolumeShelveTestJSON-385853788 tempest-AttachVolumeShelveTestJSON-385853788-project] Lock "1daf4f4c-0e4a-4779-b53a-78c48397ea2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120741) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 18:07:27.843790 dv-cinder-852009-8-iscsi devstack@n-api.service[120741]: DEBUG nova.policy [None req-da9a208d-63f8-4003-917d-7381afca3973 tempest-AttachVolumeShelveTestJSON-385853788 tempest-AttachVolumeShelveTestJSON-385853788-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e68ecd9b3ca643539b109f75bb242d6f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '75e14fd88bfb4cd896fa7b070a0fac47', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120741) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 18:07:27.853019 dv-cinder-852009-8-iscsi devstack@n-api.service[120741]: DEBUG nova.policy [None req-da9a208d-63f8-4003-917d-7381afca3973 tempest-AttachVolumeShelveTestJSON-385853788 tempest-AttachVolumeShelveTestJSON-385853788-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'e68ecd9b3ca643539b109f75bb242d6f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '75e14fd88bfb4cd896fa7b070a0fac47', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120741) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 18:07:27.854972 dv-cinder-852009-8-iscsi devstack@n-api.service[120741]: DEBUG nova.policy [None req-da9a208d-63f8-4003-917d-7381afca3973 tempest-AttachVolumeShelveTestJSON-385853788 tempest-AttachVolumeShelveTestJSON-385853788-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'e68ecd9b3ca643539b109f75bb242d6f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '75e14fd88bfb4cd896fa7b070a0fac47', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120741) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 18:07:27.856739 dv-cinder-852009-8-iscsi devstack@n-api.service[120741]: INFO nova.api.openstack.requestlog [None req-da9a208d-63f8-4003-917d-7381afca3973 tempest-AttachVolumeShelveTestJSON-385853788 tempest-AttachVolumeShelveTestJSON-385853788-project] 10.222.0.43 "GET /compute/v2.1/servers/8cecf08e-bea8-4cef-9439-0eaa242bfed1" status: 200 len: 1729 microversion: 2.20 time: 0.201416 Sep 13 18:07:27.857926 dv-cinder-852009-8-iscsi devstack@n-api.service[120741]: [pid: 120741|app: 0|req: 312/634] 10.222.0.43 () {60 vars in 1277 bytes} [Tue Sep 13 18:07:27 2022] GET /compute/v2.1/servers/8cecf08e-bea8-4cef-9439-0eaa242bfed1 => generated 1729 bytes in 204 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 13 18:07:28.883717 dv-cinder-852009-8-iscsi devstack@n-api.service[120740]: DEBUG nova.api.openstack.wsgi [None req-3bc1ec14-f3bb-4499-830c-900640f1fb94 tempest-AttachVolumeShelveTestJSON-385853788 tempest-AttachVolumeShelveTestJSON-385853788-project] Calling method '>' {{(pid=120740) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 18:07:28.884372 dv-cinder-852009-8-iscsi devstack@n-api.service[120740]: DEBUG nova.compute.api [None req-3bc1ec14-f3bb-4499-830c-900640f1fb94 tempest-AttachVolumeShelveTestJSON-385853788 tempest-AttachVolumeShelveTestJSON-385853788-project] [instance: 8cecf08e-bea8-4cef-9439-0eaa242bfed1] Fetching instance by UUID {{(pid=120740) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 18:07:28.892217 dv-cinder-852009-8-iscsi devstack@n-api.service[120740]: DEBUG oslo_concurrency.lockutils [None req-3bc1ec14-f3bb-4499-830c-900640f1fb94 tempest-AttachVolumeShelveTestJSON-385853788 tempest-AttachVolumeShelveTestJSON-385853788-project] Acquiring lock "1daf4f4c-0e4a-4779-b53a-78c48397ea2f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120740) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 18:07:28.893336 dv-cinder-852009-8-iscsi devstack@n-api.service[120740]: DEBUG oslo_concurrency.lockutils [None req-3bc1ec14-f3bb-4499-830c-900640f1fb94 tempest-AttachVolumeShelveTestJSON-385853788 tempest-AttachVolumeShelveTestJSON-385853788-project] Lock "1daf4f4c-0e4a-4779-b53a-78c48397ea2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120740) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 18:07:28.893917 dv-cinder-852009-8-iscsi devstack@n-api.service[120740]: DEBUG oslo_concurrency.lockutils [None req-3bc1ec14-f3bb-4499-830c-900640f1fb94 tempest-AttachVolumeShelveTestJSON-385853788 tempest-AttachVolumeShelveTestJSON-385853788-project] Lock "1daf4f4c-0e4a-4779-b53a-78c48397ea2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120740) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 18:07:28.895090 dv-cinder-852009-8-iscsi devstack@n-api.service[120740]: DEBUG oslo_concurrency.lockutils [None req-3bc1ec14-f3bb-4499-830c-900640f1fb94 tempest-AttachVolumeShelveTestJSON-385853788 tempest-AttachVolumeShelveTestJSON-385853788-project] Acquiring lock "1daf4f4c-0e4a-4779-b53a-78c48397ea2f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120740) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 18:07:28.895658 dv-cinder-852009-8-iscsi devstack@n-api.service[120740]: DEBUG oslo_concurrency.lockutils [None req-3bc1ec14-f3bb-4499-830c-900640f1fb94 tempest-AttachVolumeShelveTestJSON-385853788 tempest-AttachVolumeShelveTestJSON-385853788-project] Lock "1daf4f4c-0e4a-4779-b53a-78c48397ea2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120740) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 18:07:28.895969 dv-cinder-852009-8-iscsi devstack@n-api.service[120740]: DEBUG oslo_concurrency.lockutils [None req-3bc1ec14-f3bb-4499-830c-900640f1fb94 tempest-AttachVolumeShelveTestJSON-385853788 tempest-AttachVolumeShelveTestJSON-385853788-project] Lock "1daf4f4c-0e4a-4779-b53a-78c48397ea2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120740) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 18:07:29.059825 dv-cinder-852009-8-iscsi devstack@n-api.service[120740]: DEBUG nova.policy [None req-3bc1ec14-f3bb-4499-830c-900640f1fb94 tempest-AttachVolumeShelveTestJSON-385853788 tempest-AttachVolumeShelveTestJSON-385853788-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e68ecd9b3ca643539b109f75bb242d6f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '75e14fd88bfb4cd896fa7b070a0fac47', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120740) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 18:07:29.068670 dv-cinder-852009-8-iscsi devstack@n-api.service[120740]: DEBUG nova.policy [None req-3bc1ec14-f3bb-4499-830c-900640f1fb94 tempest-AttachVolumeShelveTestJSON-385853788 tempest-AttachVolumeShelveTestJSON-385853788-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'e68ecd9b3ca643539b109f75bb242d6f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '75e14fd88bfb4cd896fa7b070a0fac47', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120740) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 18:07:29.070160 dv-cinder-852009-8-iscsi devstack@n-api.service[120740]: DEBUG nova.policy [None req-3bc1ec14-f3bb-4499-830c-900640f1fb94 tempest-AttachVolumeShelveTestJSON-385853788 tempest-AttachVolumeShelveTestJSON-385853788-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'e68ecd9b3ca643539b109f75bb242d6f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '75e14fd88bfb4cd896fa7b070a0fac47', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120740) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 18:07:29.071353 dv-cinder-852009-8-iscsi devstack@n-api.service[120740]: INFO nova.api.openstack.requestlog [None req-3bc1ec14-f3bb-4499-830c-900640f1fb94 tempest-AttachVolumeShelveTestJSON-385853788 tempest-AttachVolumeShelveTestJSON-385853788-project] 10.222.0.43 "GET /compute/v2.1/servers/8cecf08e-bea8-4cef-9439-0eaa242bfed1" status: 200 len: 1729 microversion: 2.20 time: 0.191556 Sep 13 18:07:29.071914 dv-cinder-852009-8-iscsi devstack@n-api.service[120740]: [pid: 120740|app: 0|req: 323/635] 10.222.0.43 () {60 vars in 1277 bytes} [Tue Sep 13 18:07:28 2022] GET /compute/v2.1/servers/8cecf08e-bea8-4cef-9439-0eaa242bfed1 => generated 1729 bytes in 193 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 13 18:07:30.097390 dv-cinder-852009-8-iscsi devstack@n-api.service[120741]: DEBUG nova.api.openstack.wsgi [None req-e9413c4a-b49d-4581-9ad8-c1fd7da8c4e5 tempest-AttachVolumeShelveTestJSON-385853788 tempest-AttachVolumeShelveTestJSON-385853788-project] Calling method '>' {{(pid=120741) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 18:07:30.098079 dv-cinder-852009-8-iscsi devstack@n-api.service[120741]: DEBUG nova.compute.api [None req-e9413c4a-b49d-4581-9ad8-c1fd7da8c4e5 tempest-AttachVolumeShelveTestJSON-385853788 tempest-AttachVolumeShelveTestJSON-385853788-project] [instance: 8cecf08e-bea8-4cef-9439-0eaa242bfed1] Fetching instance by UUID {{(pid=120741) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 18:07:30.104680 dv-cinder-852009-8-iscsi devstack@n-api.service[120741]: DEBUG oslo_concurrency.lockutils [None req-e9413c4a-b49d-4581-9ad8-c1fd7da8c4e5 tempest-AttachVolumeShelveTestJSON-385853788 tempest-AttachVolumeShelveTestJSON-385853788-project] Acquiring lock "1daf4f4c-0e4a-4779-b53a-78c48397ea2f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120741) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 18:07:30.105502 dv-cinder-852009-8-iscsi devstack@n-api.service[120741]: DEBUG oslo_concurrency.lockutils [None req-e9413c4a-b49d-4581-9ad8-c1fd7da8c4e5 tempest-AttachVolumeShelveTestJSON-385853788 tempest-AttachVolumeShelveTestJSON-385853788-project] Lock "1daf4f4c-0e4a-4779-b53a-78c48397ea2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120741) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 18:07:30.106670 dv-cinder-852009-8-iscsi devstack@n-api.service[120741]: DEBUG oslo_concurrency.lockutils [None req-e9413c4a-b49d-4581-9ad8-c1fd7da8c4e5 tempest-AttachVolumeShelveTestJSON-385853788 tempest-AttachVolumeShelveTestJSON-385853788-project] Lock "1daf4f4c-0e4a-4779-b53a-78c48397ea2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120741) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 18:07:30.107857 dv-cinder-852009-8-iscsi devstack@n-api.service[120741]: DEBUG oslo_concurrency.lockutils [None req-e9413c4a-b49d-4581-9ad8-c1fd7da8c4e5 tempest-AttachVolumeShelveTestJSON-385853788 tempest-AttachVolumeShelveTestJSON-385853788-project] Acquiring lock "1daf4f4c-0e4a-4779-b53a-78c48397ea2f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120741) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 18:07:30.108494 dv-cinder-852009-8-iscsi devstack@n-api.service[120741]: DEBUG oslo_concurrency.lockutils [None req-e9413c4a-b49d-4581-9ad8-c1fd7da8c4e5 tempest-AttachVolumeShelveTestJSON-385853788 tempest-AttachVolumeShelveTestJSON-385853788-project] Lock "1daf4f4c-0e4a-4779-b53a-78c48397ea2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120741) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 18:07:30.109069 dv-cinder-852009-8-iscsi devstack@n-api.service[120741]: DEBUG oslo_concurrency.lockutils [None req-e9413c4a-b49d-4581-9ad8-c1fd7da8c4e5 tempest-AttachVolumeShelveTestJSON-385853788 tempest-AttachVolumeShelveTestJSON-385853788-project] Lock "1daf4f4c-0e4a-4779-b53a-78c48397ea2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120741) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 18:07:30.276923 dv-cinder-852009-8-iscsi devstack@n-api.service[120741]: DEBUG nova.policy [None req-e9413c4a-b49d-4581-9ad8-c1fd7da8c4e5 tempest-AttachVolumeShelveTestJSON-385853788 tempest-AttachVolumeShelveTestJSON-385853788-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e68ecd9b3ca643539b109f75bb242d6f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '75e14fd88bfb4cd896fa7b070a0fac47', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120741) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 18:07:30.293557 dv-cinder-852009-8-iscsi devstack@n-api.service[120741]: DEBUG nova.policy [None req-e9413c4a-b49d-4581-9ad8-c1fd7da8c4e5 tempest-AttachVolumeShelveTestJSON-385853788 tempest-AttachVolumeShelveTestJSON-385853788-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'e68ecd9b3ca643539b109f75bb242d6f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '75e14fd88bfb4cd896fa7b070a0fac47', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120741) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 18:07:30.295306 dv-cinder-852009-8-iscsi devstack@n-api.service[120741]: DEBUG nova.policy [None req-e9413c4a-b49d-4581-9ad8-c1fd7da8c4e5 tempest-AttachVolumeShelveTestJSON-385853788 tempest-AttachVolumeShelveTestJSON-385853788-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'e68ecd9b3ca643539b109f75bb242d6f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '75e14fd88bfb4cd896fa7b070a0fac47', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120741) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 18:07:30.296569 dv-cinder-852009-8-iscsi devstack@n-api.service[120741]: INFO nova.api.openstack.requestlog [None req-e9413c4a-b49d-4581-9ad8-c1fd7da8c4e5 tempest-AttachVolumeShelveTestJSON-385853788 tempest-AttachVolumeShelveTestJSON-385853788-project] 10.222.0.43 "GET /compute/v2.1/servers/8cecf08e-bea8-4cef-9439-0eaa242bfed1" status: 200 len: 1729 microversion: 2.20 time: 0.203823 Sep 13 18:07:30.297084 dv-cinder-852009-8-iscsi devstack@n-api.service[120741]: [pid: 120741|app: 0|req: 313/636] 10.222.0.43 () {60 vars in 1277 bytes} [Tue Sep 13 18:07:30 2022] GET /compute/v2.1/servers/8cecf08e-bea8-4cef-9439-0eaa242bfed1 => generated 1729 bytes in 205 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 13 18:07:31.324050 dv-cinder-852009-8-iscsi devstack@n-api.service[120740]: DEBUG nova.api.openstack.wsgi [None req-ac2d5e75-e36e-4c55-8b9f-5d1a4e7712c9 tempest-AttachVolumeShelveTestJSON-385853788 tempest-AttachVolumeShelveTestJSON-385853788-project] Calling method '>' {{(pid=120740) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 18:07:31.325344 dv-cinder-852009-8-iscsi devstack@n-api.service[120740]: DEBUG nova.compute.api [None req-ac2d5e75-e36e-4c55-8b9f-5d1a4e7712c9 tempest-AttachVolumeShelveTestJSON-385853788 tempest-AttachVolumeShelveTestJSON-385853788-project] [instance: 8cecf08e-bea8-4cef-9439-0eaa242bfed1] Fetching instance by UUID {{(pid=120740) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 18:07:31.331999 dv-cinder-852009-8-iscsi devstack@n-api.service[120740]: DEBUG oslo_concurrency.lockutils [None req-ac2d5e75-e36e-4c55-8b9f-5d1a4e7712c9 tempest-AttachVolumeShelveTestJSON-385853788 tempest-AttachVolumeShelveTestJSON-385853788-project] Acquiring lock "1daf4f4c-0e4a-4779-b53a-78c48397ea2f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120740) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 18:07:31.332498 dv-cinder-852009-8-iscsi devstack@n-api.service[120740]: DEBUG oslo_concurrency.lockutils [None req-ac2d5e75-e36e-4c55-8b9f-5d1a4e7712c9 tempest-AttachVolumeShelveTestJSON-385853788 tempest-AttachVolumeShelveTestJSON-385853788-project] Lock "1daf4f4c-0e4a-4779-b53a-78c48397ea2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120740) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 18:07:31.332957 dv-cinder-852009-8-iscsi devstack@n-api.service[120740]: DEBUG oslo_concurrency.lockutils [None req-ac2d5e75-e36e-4c55-8b9f-5d1a4e7712c9 tempest-AttachVolumeShelveTestJSON-385853788 tempest-AttachVolumeShelveTestJSON-385853788-project] Lock "1daf4f4c-0e4a-4779-b53a-78c48397ea2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120740) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 18:07:31.333661 dv-cinder-852009-8-iscsi devstack@n-api.service[120740]: DEBUG oslo_concurrency.lockutils [None req-ac2d5e75-e36e-4c55-8b9f-5d1a4e7712c9 tempest-AttachVolumeShelveTestJSON-385853788 tempest-AttachVolumeShelveTestJSON-385853788-project] Acquiring lock "1daf4f4c-0e4a-4779-b53a-78c48397ea2f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120740) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 18:07:31.334106 dv-cinder-852009-8-iscsi devstack@n-api.service[120740]: DEBUG oslo_concurrency.lockutils [None req-ac2d5e75-e36e-4c55-8b9f-5d1a4e7712c9 tempest-AttachVolumeShelveTestJSON-385853788 tempest-AttachVolumeShelveTestJSON-385853788-project] Lock "1daf4f4c-0e4a-4779-b53a-78c48397ea2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120740) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 18:07:31.334529 dv-cinder-852009-8-iscsi devstack@n-api.service[120740]: DEBUG oslo_concurrency.lockutils [None req-ac2d5e75-e36e-4c55-8b9f-5d1a4e7712c9 tempest-AttachVolumeShelveTestJSON-385853788 tempest-AttachVolumeShelveTestJSON-385853788-project] Lock "1daf4f4c-0e4a-4779-b53a-78c48397ea2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120740) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 18:07:31.489047 dv-cinder-852009-8-iscsi devstack@n-api.service[120740]: DEBUG nova.policy [None req-ac2d5e75-e36e-4c55-8b9f-5d1a4e7712c9 tempest-AttachVolumeShelveTestJSON-385853788 tempest-AttachVolumeShelveTestJSON-385853788-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e68ecd9b3ca643539b109f75bb242d6f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '75e14fd88bfb4cd896fa7b070a0fac47', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120740) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 18:07:31.501792 dv-cinder-852009-8-iscsi devstack@n-api.service[120740]: DEBUG nova.policy [None req-ac2d5e75-e36e-4c55-8b9f-5d1a4e7712c9 tempest-AttachVolumeShelveTestJSON-385853788 tempest-AttachVolumeShelveTestJSON-385853788-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'e68ecd9b3ca643539b109f75bb242d6f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '75e14fd88bfb4cd896fa7b070a0fac47', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120740) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 18:07:31.504091 dv-cinder-852009-8-iscsi devstack@n-api.service[120740]: DEBUG nova.policy [None req-ac2d5e75-e36e-4c55-8b9f-5d1a4e7712c9 tempest-AttachVolumeShelveTestJSON-385853788 tempest-AttachVolumeShelveTestJSON-385853788-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'e68ecd9b3ca643539b109f75bb242d6f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '75e14fd88bfb4cd896fa7b070a0fac47', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120740) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 18:07:31.505561 dv-cinder-852009-8-iscsi devstack@n-api.service[120740]: INFO nova.api.openstack.requestlog [None req-ac2d5e75-e36e-4c55-8b9f-5d1a4e7712c9 tempest-AttachVolumeShelveTestJSON-385853788 tempest-AttachVolumeShelveTestJSON-385853788-project] 10.222.0.43 "GET /compute/v2.1/servers/8cecf08e-bea8-4cef-9439-0eaa242bfed1" status: 200 len: 1729 microversion: 2.20 time: 0.185563 Sep 13 18:07:31.506523 dv-cinder-852009-8-iscsi devstack@n-api.service[120740]: [pid: 120740|app: 0|req: 324/637] 10.222.0.43 () {60 vars in 1277 bytes} [Tue Sep 13 18:07:31 2022] GET /compute/v2.1/servers/8cecf08e-bea8-4cef-9439-0eaa242bfed1 => generated 1729 bytes in 187 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 13 18:07:32.532176 dv-cinder-852009-8-iscsi devstack@n-api.service[120741]: DEBUG nova.api.openstack.wsgi [None req-22256ef2-67b0-4cc2-b8be-b96f06d0d523 tempest-AttachVolumeShelveTestJSON-385853788 tempest-AttachVolumeShelveTestJSON-385853788-project] Calling method '>' {{(pid=120741) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 18:07:32.533101 dv-cinder-852009-8-iscsi devstack@n-api.service[120741]: DEBUG nova.compute.api [None req-22256ef2-67b0-4cc2-b8be-b96f06d0d523 tempest-AttachVolumeShelveTestJSON-385853788 tempest-AttachVolumeShelveTestJSON-385853788-project] [instance: 8cecf08e-bea8-4cef-9439-0eaa242bfed1] Fetching instance by UUID {{(pid=120741) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 18:07:32.548376 dv-cinder-852009-8-iscsi devstack@n-api.service[120741]: DEBUG oslo_concurrency.lockutils [None req-22256ef2-67b0-4cc2-b8be-b96f06d0d523 tempest-AttachVolumeShelveTestJSON-385853788 tempest-AttachVolumeShelveTestJSON-385853788-project] Acquiring lock "1daf4f4c-0e4a-4779-b53a-78c48397ea2f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120741) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 18:07:32.548988 dv-cinder-852009-8-iscsi devstack@n-api.service[120741]: DEBUG oslo_concurrency.lockutils [None req-22256ef2-67b0-4cc2-b8be-b96f06d0d523 tempest-AttachVolumeShelveTestJSON-385853788 tempest-AttachVolumeShelveTestJSON-385853788-project] Lock "1daf4f4c-0e4a-4779-b53a-78c48397ea2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120741) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 18:07:32.549550 dv-cinder-852009-8-iscsi devstack@n-api.service[120741]: DEBUG oslo_concurrency.lockutils [None req-22256ef2-67b0-4cc2-b8be-b96f06d0d523 tempest-AttachVolumeShelveTestJSON-385853788 tempest-AttachVolumeShelveTestJSON-385853788-project] Lock "1daf4f4c-0e4a-4779-b53a-78c48397ea2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120741) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 18:07:32.550363 dv-cinder-852009-8-iscsi devstack@n-api.service[120741]: DEBUG oslo_concurrency.lockutils [None req-22256ef2-67b0-4cc2-b8be-b96f06d0d523 tempest-AttachVolumeShelveTestJSON-385853788 tempest-AttachVolumeShelveTestJSON-385853788-project] Acquiring lock "1daf4f4c-0e4a-4779-b53a-78c48397ea2f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120741) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 18:07:32.552982 dv-cinder-852009-8-iscsi devstack@n-api.service[120741]: DEBUG oslo_concurrency.lockutils [None req-22256ef2-67b0-4cc2-b8be-b96f06d0d523 tempest-AttachVolumeShelveTestJSON-385853788 tempest-AttachVolumeShelveTestJSON-385853788-project] Lock "1daf4f4c-0e4a-4779-b53a-78c48397ea2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120741) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 18:07:32.553697 dv-cinder-852009-8-iscsi devstack@n-api.service[120741]: DEBUG oslo_concurrency.lockutils [None req-22256ef2-67b0-4cc2-b8be-b96f06d0d523 tempest-AttachVolumeShelveTestJSON-385853788 tempest-AttachVolumeShelveTestJSON-385853788-project] Lock "1daf4f4c-0e4a-4779-b53a-78c48397ea2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120741) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 18:07:32.721870 dv-cinder-852009-8-iscsi devstack@n-api.service[120741]: DEBUG nova.policy [None req-22256ef2-67b0-4cc2-b8be-b96f06d0d523 tempest-AttachVolumeShelveTestJSON-385853788 tempest-AttachVolumeShelveTestJSON-385853788-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e68ecd9b3ca643539b109f75bb242d6f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '75e14fd88bfb4cd896fa7b070a0fac47', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120741) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 18:07:32.739887 dv-cinder-852009-8-iscsi devstack@n-api.service[120741]: DEBUG nova.policy [None req-22256ef2-67b0-4cc2-b8be-b96f06d0d523 tempest-AttachVolumeShelveTestJSON-385853788 tempest-AttachVolumeShelveTestJSON-385853788-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'e68ecd9b3ca643539b109f75bb242d6f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '75e14fd88bfb4cd896fa7b070a0fac47', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120741) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 18:07:32.741410 dv-cinder-852009-8-iscsi devstack@n-api.service[120741]: DEBUG nova.policy [None req-22256ef2-67b0-4cc2-b8be-b96f06d0d523 tempest-AttachVolumeShelveTestJSON-385853788 tempest-AttachVolumeShelveTestJSON-385853788-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'e68ecd9b3ca643539b109f75bb242d6f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '75e14fd88bfb4cd896fa7b070a0fac47', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120741) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 18:07:32.742961 dv-cinder-852009-8-iscsi devstack@n-api.service[120741]: INFO nova.api.openstack.requestlog [None req-22256ef2-67b0-4cc2-b8be-b96f06d0d523 tempest-AttachVolumeShelveTestJSON-385853788 tempest-AttachVolumeShelveTestJSON-385853788-project] 10.222.0.43 "GET /compute/v2.1/servers/8cecf08e-bea8-4cef-9439-0eaa242bfed1" status: 200 len: 1729 microversion: 2.20 time: 0.215369 Sep 13 18:07:32.743534 dv-cinder-852009-8-iscsi devstack@n-api.service[120741]: [pid: 120741|app: 0|req: 314/638] 10.222.0.43 () {60 vars in 1277 bytes} [Tue Sep 13 18:07:32 2022] GET /compute/v2.1/servers/8cecf08e-bea8-4cef-9439-0eaa242bfed1 => generated 1729 bytes in 217 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 13 18:07:33.771906 dv-cinder-852009-8-iscsi devstack@n-api.service[120740]: DEBUG nova.api.openstack.wsgi [None req-89819b23-b92f-445b-88a4-48cbf36b6f73 tempest-AttachVolumeShelveTestJSON-385853788 tempest-AttachVolumeShelveTestJSON-385853788-project] Calling method '>' {{(pid=120740) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 18:07:33.772554 dv-cinder-852009-8-iscsi devstack@n-api.service[120740]: DEBUG nova.compute.api [None req-89819b23-b92f-445b-88a4-48cbf36b6f73 tempest-AttachVolumeShelveTestJSON-385853788 tempest-AttachVolumeShelveTestJSON-385853788-project] [instance: 8cecf08e-bea8-4cef-9439-0eaa242bfed1] Fetching instance by UUID {{(pid=120740) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 18:07:33.779708 dv-cinder-852009-8-iscsi devstack@n-api.service[120740]: DEBUG oslo_concurrency.lockutils [None req-89819b23-b92f-445b-88a4-48cbf36b6f73 tempest-AttachVolumeShelveTestJSON-385853788 tempest-AttachVolumeShelveTestJSON-385853788-project] Acquiring lock "1daf4f4c-0e4a-4779-b53a-78c48397ea2f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120740) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 18:07:33.780187 dv-cinder-852009-8-iscsi devstack@n-api.service[120740]: DEBUG oslo_concurrency.lockutils [None req-89819b23-b92f-445b-88a4-48cbf36b6f73 tempest-AttachVolumeShelveTestJSON-385853788 tempest-AttachVolumeShelveTestJSON-385853788-project] Lock "1daf4f4c-0e4a-4779-b53a-78c48397ea2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120740) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 18:07:33.780653 dv-cinder-852009-8-iscsi devstack@n-api.service[120740]: DEBUG oslo_concurrency.lockutils [None req-89819b23-b92f-445b-88a4-48cbf36b6f73 tempest-AttachVolumeShelveTestJSON-385853788 tempest-AttachVolumeShelveTestJSON-385853788-project] Lock "1daf4f4c-0e4a-4779-b53a-78c48397ea2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120740) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 18:07:33.781333 dv-cinder-852009-8-iscsi devstack@n-api.service[120740]: DEBUG oslo_concurrency.lockutils [None req-89819b23-b92f-445b-88a4-48cbf36b6f73 tempest-AttachVolumeShelveTestJSON-385853788 tempest-AttachVolumeShelveTestJSON-385853788-project] Acquiring lock "1daf4f4c-0e4a-4779-b53a-78c48397ea2f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120740) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 18:07:33.781774 dv-cinder-852009-8-iscsi devstack@n-api.service[120740]: DEBUG oslo_concurrency.lockutils [None req-89819b23-b92f-445b-88a4-48cbf36b6f73 tempest-AttachVolumeShelveTestJSON-385853788 tempest-AttachVolumeShelveTestJSON-385853788-project] Lock "1daf4f4c-0e4a-4779-b53a-78c48397ea2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120740) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 18:07:33.782188 dv-cinder-852009-8-iscsi devstack@n-api.service[120740]: DEBUG oslo_concurrency.lockutils [None req-89819b23-b92f-445b-88a4-48cbf36b6f73 tempest-AttachVolumeShelveTestJSON-385853788 tempest-AttachVolumeShelveTestJSON-385853788-project] Lock "1daf4f4c-0e4a-4779-b53a-78c48397ea2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120740) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 18:07:33.913207 dv-cinder-852009-8-iscsi devstack@n-api.service[120740]: DEBUG nova.policy [None req-89819b23-b92f-445b-88a4-48cbf36b6f73 tempest-AttachVolumeShelveTestJSON-385853788 tempest-AttachVolumeShelveTestJSON-385853788-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e68ecd9b3ca643539b109f75bb242d6f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '75e14fd88bfb4cd896fa7b070a0fac47', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120740) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 18:07:33.921590 dv-cinder-852009-8-iscsi devstack@n-api.service[120740]: DEBUG nova.policy [None req-89819b23-b92f-445b-88a4-48cbf36b6f73 tempest-AttachVolumeShelveTestJSON-385853788 tempest-AttachVolumeShelveTestJSON-385853788-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'e68ecd9b3ca643539b109f75bb242d6f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '75e14fd88bfb4cd896fa7b070a0fac47', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120740) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 18:07:33.923041 dv-cinder-852009-8-iscsi devstack@n-api.service[120740]: DEBUG nova.policy [None req-89819b23-b92f-445b-88a4-48cbf36b6f73 tempest-AttachVolumeShelveTestJSON-385853788 tempest-AttachVolumeShelveTestJSON-385853788-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'e68ecd9b3ca643539b109f75bb242d6f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '75e14fd88bfb4cd896fa7b070a0fac47', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120740) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 18:07:33.924197 dv-cinder-852009-8-iscsi devstack@n-api.service[120740]: INFO nova.api.openstack.requestlog [None req-89819b23-b92f-445b-88a4-48cbf36b6f73 tempest-AttachVolumeShelveTestJSON-385853788 tempest-AttachVolumeShelveTestJSON-385853788-project] 10.222.0.43 "GET /compute/v2.1/servers/8cecf08e-bea8-4cef-9439-0eaa242bfed1" status: 200 len: 1729 microversion: 2.20 time: 0.156434 Sep 13 18:07:33.924782 dv-cinder-852009-8-iscsi devstack@n-api.service[120740]: [pid: 120740|app: 0|req: 325/639] 10.222.0.43 () {60 vars in 1277 bytes} [Tue Sep 13 18:07:33 2022] GET /compute/v2.1/servers/8cecf08e-bea8-4cef-9439-0eaa242bfed1 => generated 1729 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 13 18:07:34.537489 dv-cinder-852009-8-iscsi devstack@n-api.service[120741]: DEBUG nova.api.openstack.wsgi [None req-5172746c-3fe8-4a0e-84b9-4a346a52b85d tempest-TestMinimumBasicScenario-820002800 tempest-TestMinimumBasicScenario-820002800-project] Action: 'action', calling method: >, body: {"removeSecurityGroup": {"name": "tempest-secgroup-smoke-1096237766"}} {{(pid=120741) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 13 18:07:34.538084 dv-cinder-852009-8-iscsi devstack@n-api.service[120741]: DEBUG nova.compute.api [None req-5172746c-3fe8-4a0e-84b9-4a346a52b85d tempest-TestMinimumBasicScenario-820002800 tempest-TestMinimumBasicScenario-820002800-project] [instance: f8247a13-94cd-45b2-acc8-8717e1260f37] Fetching instance by UUID {{(pid=120741) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 18:07:34.544952 dv-cinder-852009-8-iscsi devstack@n-api.service[120741]: DEBUG oslo_concurrency.lockutils [None req-5172746c-3fe8-4a0e-84b9-4a346a52b85d tempest-TestMinimumBasicScenario-820002800 tempest-TestMinimumBasicScenario-820002800-project] Acquiring lock "1daf4f4c-0e4a-4779-b53a-78c48397ea2f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120741) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 18:07:34.545456 dv-cinder-852009-8-iscsi devstack@n-api.service[120741]: DEBUG oslo_concurrency.lockutils [None req-5172746c-3fe8-4a0e-84b9-4a346a52b85d tempest-TestMinimumBasicScenario-820002800 tempest-TestMinimumBasicScenario-820002800-project] Lock "1daf4f4c-0e4a-4779-b53a-78c48397ea2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120741) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 18:07:34.545881 dv-cinder-852009-8-iscsi devstack@n-api.service[120741]: DEBUG oslo_concurrency.lockutils [None req-5172746c-3fe8-4a0e-84b9-4a346a52b85d tempest-TestMinimumBasicScenario-820002800 tempest-TestMinimumBasicScenario-820002800-project] Lock "1daf4f4c-0e4a-4779-b53a-78c48397ea2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120741) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 18:07:34.546679 dv-cinder-852009-8-iscsi devstack@n-api.service[120741]: DEBUG oslo_concurrency.lockutils [None req-5172746c-3fe8-4a0e-84b9-4a346a52b85d tempest-TestMinimumBasicScenario-820002800 tempest-TestMinimumBasicScenario-820002800-project] Acquiring lock "1daf4f4c-0e4a-4779-b53a-78c48397ea2f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120741) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 18:07:34.547158 dv-cinder-852009-8-iscsi devstack@n-api.service[120741]: DEBUG oslo_concurrency.lockutils [None req-5172746c-3fe8-4a0e-84b9-4a346a52b85d tempest-TestMinimumBasicScenario-820002800 tempest-TestMinimumBasicScenario-820002800-project] Lock "1daf4f4c-0e4a-4779-b53a-78c48397ea2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120741) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 18:07:34.547600 dv-cinder-852009-8-iscsi devstack@n-api.service[120741]: DEBUG oslo_concurrency.lockutils [None req-5172746c-3fe8-4a0e-84b9-4a346a52b85d tempest-TestMinimumBasicScenario-820002800 tempest-TestMinimumBasicScenario-820002800-project] Lock "1daf4f4c-0e4a-4779-b53a-78c48397ea2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120741) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 18:07:34.677135 dv-cinder-852009-8-iscsi devstack@n-api.service[120741]: INFO nova.network.security_group_api [None req-5172746c-3fe8-4a0e-84b9-4a346a52b85d tempest-TestMinimumBasicScenario-820002800 tempest-TestMinimumBasicScenario-820002800-project] Removing security group 2de44b30-da7f-4ad5-bd73-1890ce641417 from port 9f86cf72-e29e-4f23-8c9d-afea192c2916 Sep 13 18:07:34.950005 dv-cinder-852009-8-iscsi devstack@n-api.service[120740]: DEBUG nova.api.openstack.wsgi [None req-86ba957e-8863-4462-b25a-2e9db12fb8ff tempest-AttachVolumeShelveTestJSON-385853788 tempest-AttachVolumeShelveTestJSON-385853788-project] Calling method '>' {{(pid=120740) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 18:07:34.950780 dv-cinder-852009-8-iscsi devstack@n-api.service[120740]: DEBUG nova.compute.api [None req-86ba957e-8863-4462-b25a-2e9db12fb8ff tempest-AttachVolumeShelveTestJSON-385853788 tempest-AttachVolumeShelveTestJSON-385853788-project] [instance: 8cecf08e-bea8-4cef-9439-0eaa242bfed1] Fetching instance by UUID {{(pid=120740) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 18:07:34.958055 dv-cinder-852009-8-iscsi devstack@n-api.service[120740]: DEBUG oslo_concurrency.lockutils [None req-86ba957e-8863-4462-b25a-2e9db12fb8ff tempest-AttachVolumeShelveTestJSON-385853788 tempest-AttachVolumeShelveTestJSON-385853788-project] Acquiring lock "1daf4f4c-0e4a-4779-b53a-78c48397ea2f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120740) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 18:07:34.958542 dv-cinder-852009-8-iscsi devstack@n-api.service[120740]: DEBUG oslo_concurrency.lockutils [None req-86ba957e-8863-4462-b25a-2e9db12fb8ff tempest-AttachVolumeShelveTestJSON-385853788 tempest-AttachVolumeShelveTestJSON-385853788-project] Lock "1daf4f4c-0e4a-4779-b53a-78c48397ea2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120740) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 18:07:34.958972 dv-cinder-852009-8-iscsi devstack@n-api.service[120740]: DEBUG oslo_concurrency.lockutils [None req-86ba957e-8863-4462-b25a-2e9db12fb8ff tempest-AttachVolumeShelveTestJSON-385853788 tempest-AttachVolumeShelveTestJSON-385853788-project] Lock "1daf4f4c-0e4a-4779-b53a-78c48397ea2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120740) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 18:07:34.959674 dv-cinder-852009-8-iscsi devstack@n-api.service[120740]: DEBUG oslo_concurrency.lockutils [None req-86ba957e-8863-4462-b25a-2e9db12fb8ff tempest-AttachVolumeShelveTestJSON-385853788 tempest-AttachVolumeShelveTestJSON-385853788-project] Acquiring lock "1daf4f4c-0e4a-4779-b53a-78c48397ea2f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120740) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 18:07:34.960102 dv-cinder-852009-8-iscsi devstack@n-api.service[120740]: DEBUG oslo_concurrency.lockutils [None req-86ba957e-8863-4462-b25a-2e9db12fb8ff tempest-AttachVolumeShelveTestJSON-385853788 tempest-AttachVolumeShelveTestJSON-385853788-project] Lock "1daf4f4c-0e4a-4779-b53a-78c48397ea2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120740) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 18:07:34.960550 dv-cinder-852009-8-iscsi devstack@n-api.service[120740]: DEBUG oslo_concurrency.lockutils [None req-86ba957e-8863-4462-b25a-2e9db12fb8ff tempest-AttachVolumeShelveTestJSON-385853788 tempest-AttachVolumeShelveTestJSON-385853788-project] Lock "1daf4f4c-0e4a-4779-b53a-78c48397ea2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120740) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 18:07:34.995578 dv-cinder-852009-8-iscsi devstack@n-api.service[120741]: INFO nova.api.openstack.requestlog [None req-5172746c-3fe8-4a0e-84b9-4a346a52b85d tempest-TestMinimumBasicScenario-820002800 tempest-TestMinimumBasicScenario-820002800-project] 10.222.0.43 "POST /compute/v2.1/servers/f8247a13-94cd-45b2-acc8-8717e1260f37/action" status: 202 len: 0 microversion: 2.1 time: 0.462023 Sep 13 18:07:34.996188 dv-cinder-852009-8-iscsi devstack@n-api.service[120741]: [pid: 120741|app: 0|req: 315/640] 10.222.0.43 () {60 vars in 1278 bytes} [Tue Sep 13 18:07:34 2022] POST /compute/v2.1/servers/f8247a13-94cd-45b2-acc8-8717e1260f37/action => generated 0 bytes in 463 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Sep 13 18:07:35.153885 dv-cinder-852009-8-iscsi devstack@n-api.service[120740]: DEBUG nova.policy [None req-86ba957e-8863-4462-b25a-2e9db12fb8ff tempest-AttachVolumeShelveTestJSON-385853788 tempest-AttachVolumeShelveTestJSON-385853788-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e68ecd9b3ca643539b109f75bb242d6f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '75e14fd88bfb4cd896fa7b070a0fac47', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120740) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 18:07:35.162635 dv-cinder-852009-8-iscsi devstack@n-api.service[120740]: DEBUG nova.policy [None req-86ba957e-8863-4462-b25a-2e9db12fb8ff tempest-AttachVolumeShelveTestJSON-385853788 tempest-AttachVolumeShelveTestJSON-385853788-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'e68ecd9b3ca643539b109f75bb242d6f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '75e14fd88bfb4cd896fa7b070a0fac47', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120740) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 18:07:35.164072 dv-cinder-852009-8-iscsi devstack@n-api.service[120740]: DEBUG nova.policy [None req-86ba957e-8863-4462-b25a-2e9db12fb8ff tempest-AttachVolumeShelveTestJSON-385853788 tempest-AttachVolumeShelveTestJSON-385853788-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'e68ecd9b3ca643539b109f75bb242d6f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '75e14fd88bfb4cd896fa7b070a0fac47', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120740) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 18:07:35.165251 dv-cinder-852009-8-iscsi devstack@n-api.service[120740]: INFO nova.api.openstack.requestlog [None req-86ba957e-8863-4462-b25a-2e9db12fb8ff tempest-AttachVolumeShelveTestJSON-385853788 tempest-AttachVolumeShelveTestJSON-385853788-project] 10.222.0.43 "GET /compute/v2.1/servers/8cecf08e-bea8-4cef-9439-0eaa242bfed1" status: 200 len: 1729 microversion: 2.20 time: 0.219315 Sep 13 18:07:35.166183 dv-cinder-852009-8-iscsi devstack@n-api.service[120740]: [pid: 120740|app: 0|req: 326/641] 10.222.0.43 () {60 vars in 1277 bytes} [Tue Sep 13 18:07:34 2022] GET /compute/v2.1/servers/8cecf08e-bea8-4cef-9439-0eaa242bfed1 => generated 1729 bytes in 221 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 13 18:07:35.208475 dv-cinder-852009-8-iscsi devstack@n-api.service[120741]: DEBUG nova.api.openstack.wsgi [req-0621b67a-77eb-4134-9add-aad9252516a7 req-b7b4f84e-6635-410c-a070-b3b30acea115 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "f8247a13-94cd-45b2-acc8-8717e1260f37", "tag": "9f86cf72-e29e-4f23-8c9d-afea192c2916"}]} {{(pid=120741) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 13 18:07:35.218143 dv-cinder-852009-8-iscsi devstack@n-api.service[120741]: DEBUG oslo_concurrency.lockutils [req-0621b67a-77eb-4134-9add-aad9252516a7 req-b7b4f84e-6635-410c-a070-b3b30acea115 service nova] Acquiring lock "1daf4f4c-0e4a-4779-b53a-78c48397ea2f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120741) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 18:07:35.218966 dv-cinder-852009-8-iscsi devstack@n-api.service[120741]: DEBUG oslo_concurrency.lockutils [req-0621b67a-77eb-4134-9add-aad9252516a7 req-b7b4f84e-6635-410c-a070-b3b30acea115 service nova] Lock "1daf4f4c-0e4a-4779-b53a-78c48397ea2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120741) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 18:07:35.219622 dv-cinder-852009-8-iscsi devstack@n-api.service[120741]: DEBUG oslo_concurrency.lockutils [req-0621b67a-77eb-4134-9add-aad9252516a7 req-b7b4f84e-6635-410c-a070-b3b30acea115 service nova] Lock "1daf4f4c-0e4a-4779-b53a-78c48397ea2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120741) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 18:07:35.238304 dv-cinder-852009-8-iscsi devstack@n-api.service[120741]: INFO nova.api.openstack.compute.server_external_events [req-0621b67a-77eb-4134-9add-aad9252516a7 req-b7b4f84e-6635-410c-a070-b3b30acea115 service nova] Creating event network-changed:9f86cf72-e29e-4f23-8c9d-afea192c2916 for instance f8247a13-94cd-45b2-acc8-8717e1260f37 on hv-cinder-85200 Sep 13 18:07:35.244870 dv-cinder-852009-8-iscsi devstack@n-api.service[120741]: INFO nova.api.openstack.requestlog [req-0621b67a-77eb-4134-9add-aad9252516a7 req-b7b4f84e-6635-410c-a070-b3b30acea115 service nova] 10.222.0.43 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.241887 Sep 13 18:07:35.245926 dv-cinder-852009-8-iscsi devstack@n-api.service[120741]: [pid: 120741|app: 0|req: 316/642] 10.222.0.43 () {64 vars in 1317 bytes} [Tue Sep 13 18:07:35 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 244 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 13 18:07:36.192808 dv-cinder-852009-8-iscsi devstack@n-api.service[120740]: DEBUG nova.api.openstack.wsgi [None req-05f41162-36e4-4e66-94a4-cfeac5d0a911 tempest-AttachVolumeShelveTestJSON-385853788 tempest-AttachVolumeShelveTestJSON-385853788-project] Calling method '>' {{(pid=120740) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 18:07:36.194119 dv-cinder-852009-8-iscsi devstack@n-api.service[120740]: DEBUG nova.compute.api [None req-05f41162-36e4-4e66-94a4-cfeac5d0a911 tempest-AttachVolumeShelveTestJSON-385853788 tempest-AttachVolumeShelveTestJSON-385853788-project] [instance: 8cecf08e-bea8-4cef-9439-0eaa242bfed1] Fetching instance by UUID {{(pid=120740) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 18:07:36.201603 dv-cinder-852009-8-iscsi devstack@n-api.service[120740]: DEBUG oslo_concurrency.lockutils [None req-05f41162-36e4-4e66-94a4-cfeac5d0a911 tempest-AttachVolumeShelveTestJSON-385853788 tempest-AttachVolumeShelveTestJSON-385853788-project] Acquiring lock "1daf4f4c-0e4a-4779-b53a-78c48397ea2f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120740) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 18:07:36.202183 dv-cinder-852009-8-iscsi devstack@n-api.service[120740]: DEBUG oslo_concurrency.lockutils [None req-05f41162-36e4-4e66-94a4-cfeac5d0a911 tempest-AttachVolumeShelveTestJSON-385853788 tempest-AttachVolumeShelveTestJSON-385853788-project] Lock "1daf4f4c-0e4a-4779-b53a-78c48397ea2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120740) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 18:07:36.202917 dv-cinder-852009-8-iscsi devstack@n-api.service[120740]: DEBUG oslo_concurrency.lockutils [None req-05f41162-36e4-4e66-94a4-cfeac5d0a911 tempest-AttachVolumeShelveTestJSON-385853788 tempest-AttachVolumeShelveTestJSON-385853788-project] Lock "1daf4f4c-0e4a-4779-b53a-78c48397ea2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120740) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 18:07:36.203701 dv-cinder-852009-8-iscsi devstack@n-api.service[120740]: DEBUG oslo_concurrency.lockutils [None req-05f41162-36e4-4e66-94a4-cfeac5d0a911 tempest-AttachVolumeShelveTestJSON-385853788 tempest-AttachVolumeShelveTestJSON-385853788-project] Acquiring lock "1daf4f4c-0e4a-4779-b53a-78c48397ea2f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120740) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 18:07:36.204529 dv-cinder-852009-8-iscsi devstack@n-api.service[120740]: DEBUG oslo_concurrency.lockutils [None req-05f41162-36e4-4e66-94a4-cfeac5d0a911 tempest-AttachVolumeShelveTestJSON-385853788 tempest-AttachVolumeShelveTestJSON-385853788-project] Lock "1daf4f4c-0e4a-4779-b53a-78c48397ea2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120740) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 18:07:36.204864 dv-cinder-852009-8-iscsi devstack@n-api.service[120740]: DEBUG oslo_concurrency.lockutils [None req-05f41162-36e4-4e66-94a4-cfeac5d0a911 tempest-AttachVolumeShelveTestJSON-385853788 tempest-AttachVolumeShelveTestJSON-385853788-project] Lock "1daf4f4c-0e4a-4779-b53a-78c48397ea2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120740) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 18:07:36.225973 dv-cinder-852009-8-iscsi devstack@n-api.service[120741]: DEBUG nova.api.openstack.wsgi [None req-a39235c3-2fd5-466b-bb17-4860d93df97b tempest-AttachVolumeTestJSON-555093534 tempest-AttachVolumeTestJSON-555093534-project] Calling method '>' {{(pid=120741) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 18:07:36.228233 dv-cinder-852009-8-iscsi devstack@n-api.service[120741]: DEBUG nova.compute.api [None req-a39235c3-2fd5-466b-bb17-4860d93df97b tempest-AttachVolumeTestJSON-555093534 tempest-AttachVolumeTestJSON-555093534-project] [instance: d0983ec1-bb82-4a7d-9dba-ace1e3eb383a] Fetching instance by UUID {{(pid=120741) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 18:07:36.236108 dv-cinder-852009-8-iscsi devstack@n-api.service[120741]: DEBUG oslo_concurrency.lockutils [None req-a39235c3-2fd5-466b-bb17-4860d93df97b tempest-AttachVolumeTestJSON-555093534 tempest-AttachVolumeTestJSON-555093534-project] Acquiring lock "1daf4f4c-0e4a-4779-b53a-78c48397ea2f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120741) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 18:07:36.236636 dv-cinder-852009-8-iscsi devstack@n-api.service[120741]: DEBUG oslo_concurrency.lockutils [None req-a39235c3-2fd5-466b-bb17-4860d93df97b tempest-AttachVolumeTestJSON-555093534 tempest-AttachVolumeTestJSON-555093534-project] Lock "1daf4f4c-0e4a-4779-b53a-78c48397ea2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120741) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 18:07:36.237067 dv-cinder-852009-8-iscsi devstack@n-api.service[120741]: DEBUG oslo_concurrency.lockutils [None req-a39235c3-2fd5-466b-bb17-4860d93df97b tempest-AttachVolumeTestJSON-555093534 tempest-AttachVolumeTestJSON-555093534-project] Lock "1daf4f4c-0e4a-4779-b53a-78c48397ea2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120741) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 18:07:36.237771 dv-cinder-852009-8-iscsi devstack@n-api.service[120741]: DEBUG oslo_concurrency.lockutils [None req-a39235c3-2fd5-466b-bb17-4860d93df97b tempest-AttachVolumeTestJSON-555093534 tempest-AttachVolumeTestJSON-555093534-project] Acquiring lock "1daf4f4c-0e4a-4779-b53a-78c48397ea2f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120741) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 18:07:36.238394 dv-cinder-852009-8-iscsi devstack@n-api.service[120741]: DEBUG oslo_concurrency.lockutils [None req-a39235c3-2fd5-466b-bb17-4860d93df97b tempest-AttachVolumeTestJSON-555093534 tempest-AttachVolumeTestJSON-555093534-project] Lock "1daf4f4c-0e4a-4779-b53a-78c48397ea2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120741) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 18:07:36.239174 dv-cinder-852009-8-iscsi devstack@n-api.service[120741]: DEBUG oslo_concurrency.lockutils [None req-a39235c3-2fd5-466b-bb17-4860d93df97b tempest-AttachVolumeTestJSON-555093534 tempest-AttachVolumeTestJSON-555093534-project] Lock "1daf4f4c-0e4a-4779-b53a-78c48397ea2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120741) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 18:07:36.271665 dv-cinder-852009-8-iscsi devstack@n-api.service[120741]: INFO nova.api.openstack.requestlog [None req-a39235c3-2fd5-466b-bb17-4860d93df97b tempest-AttachVolumeTestJSON-555093534 tempest-AttachVolumeTestJSON-555093534-project] 10.222.0.43 "GET /compute/v2.1/servers/d0983ec1-bb82-4a7d-9dba-ace1e3eb383a/os-volume_attachments" status: 200 len: 371 microversion: 2.1 time: 0.050890 Sep 13 18:07:36.272466 dv-cinder-852009-8-iscsi devstack@n-api.service[120741]: [pid: 120741|app: 0|req: 317/643] 10.222.0.43 () {58 vars in 1302 bytes} [Tue Sep 13 18:07:36 2022] GET /compute/v2.1/servers/d0983ec1-bb82-4a7d-9dba-ace1e3eb383a/os-volume_attachments => generated 371 bytes in 52 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 13 18:07:36.424135 dv-cinder-852009-8-iscsi devstack@n-api.service[120741]: DEBUG nova.api.openstack.wsgi [None req-9ef8b4a7-b790-407a-8de0-907ea5103e52 tempest-AttachVolumeTestJSON-555093534 tempest-AttachVolumeTestJSON-555093534-project] Calling method '>' {{(pid=120741) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 18:07:36.424682 dv-cinder-852009-8-iscsi devstack@n-api.service[120741]: DEBUG nova.compute.api [None req-9ef8b4a7-b790-407a-8de0-907ea5103e52 tempest-AttachVolumeTestJSON-555093534 tempest-AttachVolumeTestJSON-555093534-project] [instance: d0983ec1-bb82-4a7d-9dba-ace1e3eb383a] Fetching instance by UUID {{(pid=120741) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 18:07:36.431064 dv-cinder-852009-8-iscsi devstack@n-api.service[120741]: DEBUG oslo_concurrency.lockutils [None req-9ef8b4a7-b790-407a-8de0-907ea5103e52 tempest-AttachVolumeTestJSON-555093534 tempest-AttachVolumeTestJSON-555093534-project] Acquiring lock "1daf4f4c-0e4a-4779-b53a-78c48397ea2f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120741) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 18:07:36.431603 dv-cinder-852009-8-iscsi devstack@n-api.service[120741]: DEBUG oslo_concurrency.lockutils [None req-9ef8b4a7-b790-407a-8de0-907ea5103e52 tempest-AttachVolumeTestJSON-555093534 tempest-AttachVolumeTestJSON-555093534-project] Lock "1daf4f4c-0e4a-4779-b53a-78c48397ea2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120741) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 18:07:36.432039 dv-cinder-852009-8-iscsi devstack@n-api.service[120741]: DEBUG oslo_concurrency.lockutils [None req-9ef8b4a7-b790-407a-8de0-907ea5103e52 tempest-AttachVolumeTestJSON-555093534 tempest-AttachVolumeTestJSON-555093534-project] Lock "1daf4f4c-0e4a-4779-b53a-78c48397ea2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120741) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 18:07:36.432897 dv-cinder-852009-8-iscsi devstack@n-api.service[120741]: DEBUG oslo_concurrency.lockutils [None req-9ef8b4a7-b790-407a-8de0-907ea5103e52 tempest-AttachVolumeTestJSON-555093534 tempest-AttachVolumeTestJSON-555093534-project] Acquiring lock "1daf4f4c-0e4a-4779-b53a-78c48397ea2f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120741) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 18:07:36.433350 dv-cinder-852009-8-iscsi devstack@n-api.service[120741]: DEBUG oslo_concurrency.lockutils [None req-9ef8b4a7-b790-407a-8de0-907ea5103e52 tempest-AttachVolumeTestJSON-555093534 tempest-AttachVolumeTestJSON-555093534-project] Lock "1daf4f4c-0e4a-4779-b53a-78c48397ea2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120741) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 18:07:36.433764 dv-cinder-852009-8-iscsi devstack@n-api.service[120741]: DEBUG oslo_concurrency.lockutils [None req-9ef8b4a7-b790-407a-8de0-907ea5103e52 tempest-AttachVolumeTestJSON-555093534 tempest-AttachVolumeTestJSON-555093534-project] Lock "1daf4f4c-0e4a-4779-b53a-78c48397ea2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120741) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 18:07:36.440783 dv-cinder-852009-8-iscsi devstack@n-api.service[120740]: DEBUG nova.policy [None req-05f41162-36e4-4e66-94a4-cfeac5d0a911 tempest-AttachVolumeShelveTestJSON-385853788 tempest-AttachVolumeShelveTestJSON-385853788-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e68ecd9b3ca643539b109f75bb242d6f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '75e14fd88bfb4cd896fa7b070a0fac47', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120740) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 18:07:36.451308 dv-cinder-852009-8-iscsi devstack@n-api.service[120740]: DEBUG nova.policy [None req-05f41162-36e4-4e66-94a4-cfeac5d0a911 tempest-AttachVolumeShelveTestJSON-385853788 tempest-AttachVolumeShelveTestJSON-385853788-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'e68ecd9b3ca643539b109f75bb242d6f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '75e14fd88bfb4cd896fa7b070a0fac47', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120740) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 18:07:36.453973 dv-cinder-852009-8-iscsi devstack@n-api.service[120740]: DEBUG nova.policy [None req-05f41162-36e4-4e66-94a4-cfeac5d0a911 tempest-AttachVolumeShelveTestJSON-385853788 tempest-AttachVolumeShelveTestJSON-385853788-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'e68ecd9b3ca643539b109f75bb242d6f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '75e14fd88bfb4cd896fa7b070a0fac47', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120740) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 18:07:36.456195 dv-cinder-852009-8-iscsi devstack@n-api.service[120740]: INFO nova.api.openstack.requestlog [None req-05f41162-36e4-4e66-94a4-cfeac5d0a911 tempest-AttachVolumeShelveTestJSON-385853788 tempest-AttachVolumeShelveTestJSON-385853788-project] 10.222.0.43 "GET /compute/v2.1/servers/8cecf08e-bea8-4cef-9439-0eaa242bfed1" status: 200 len: 1729 microversion: 2.20 time: 0.267699 Sep 13 18:07:36.457279 dv-cinder-852009-8-iscsi devstack@n-api.service[120740]: [pid: 120740|app: 0|req: 327/644] 10.222.0.43 () {60 vars in 1277 bytes} [Tue Sep 13 18:07:36 2022] GET /compute/v2.1/servers/8cecf08e-bea8-4cef-9439-0eaa242bfed1 => generated 1729 bytes in 270 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 13 18:07:36.462574 dv-cinder-852009-8-iscsi devstack@n-api.service[120740]: DEBUG nova.api.openstack.wsgi [None req-c1e82213-a287-41f9-a877-b2e0e478e101 tempest-TestMinimumBasicScenario-820002800 tempest-TestMinimumBasicScenario-820002800-project] Calling method '>' {{(pid=120740) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 18:07:36.464496 dv-cinder-852009-8-iscsi devstack@n-api.service[120740]: DEBUG nova.compute.api [None req-c1e82213-a287-41f9-a877-b2e0e478e101 tempest-TestMinimumBasicScenario-820002800 tempest-TestMinimumBasicScenario-820002800-project] [instance: f8247a13-94cd-45b2-acc8-8717e1260f37] Fetching instance by UUID {{(pid=120740) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 18:07:36.471580 dv-cinder-852009-8-iscsi devstack@n-api.service[120741]: INFO nova.api.openstack.requestlog [None req-9ef8b4a7-b790-407a-8de0-907ea5103e52 tempest-AttachVolumeTestJSON-555093534 tempest-AttachVolumeTestJSON-555093534-project] 10.222.0.43 "GET /compute/v2.1/servers/d0983ec1-bb82-4a7d-9dba-ace1e3eb383a/os-volume_attachments/167cdb89-8f77-41eb-81a5-1a7af5798e0d" status: 200 len: 194 microversion: 2.1 time: 0.052124 Sep 13 18:07:36.474258 dv-cinder-852009-8-iscsi devstack@n-api.service[120740]: DEBUG oslo_concurrency.lockutils [None req-c1e82213-a287-41f9-a877-b2e0e478e101 tempest-TestMinimumBasicScenario-820002800 tempest-TestMinimumBasicScenario-820002800-project] Acquiring lock "1daf4f4c-0e4a-4779-b53a-78c48397ea2f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120740) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 18:07:36.475007 dv-cinder-852009-8-iscsi devstack@n-api.service[120740]: DEBUG oslo_concurrency.lockutils [None req-c1e82213-a287-41f9-a877-b2e0e478e101 tempest-TestMinimumBasicScenario-820002800 tempest-TestMinimumBasicScenario-820002800-project] Lock "1daf4f4c-0e4a-4779-b53a-78c48397ea2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120740) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 18:07:36.476262 dv-cinder-852009-8-iscsi devstack@n-api.service[120740]: DEBUG oslo_concurrency.lockutils [None req-c1e82213-a287-41f9-a877-b2e0e478e101 tempest-TestMinimumBasicScenario-820002800 tempest-TestMinimumBasicScenario-820002800-project] Lock "1daf4f4c-0e4a-4779-b53a-78c48397ea2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120740) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 18:07:36.477261 dv-cinder-852009-8-iscsi devstack@n-api.service[120740]: DEBUG oslo_concurrency.lockutils [None req-c1e82213-a287-41f9-a877-b2e0e478e101 tempest-TestMinimumBasicScenario-820002800 tempest-TestMinimumBasicScenario-820002800-project] Acquiring lock "1daf4f4c-0e4a-4779-b53a-78c48397ea2f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120740) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 18:07:36.477813 dv-cinder-852009-8-iscsi devstack@n-api.service[120741]: [pid: 120741|app: 0|req: 318/645] 10.222.0.43 () {58 vars in 1413 bytes} [Tue Sep 13 18:07:36 2022] GET /compute/v2.1/servers/d0983ec1-bb82-4a7d-9dba-ace1e3eb383a/os-volume_attachments/167cdb89-8f77-41eb-81a5-1a7af5798e0d => generated 194 bytes in 59 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 13 18:07:36.477922 dv-cinder-852009-8-iscsi devstack@n-api.service[120740]: DEBUG oslo_concurrency.lockutils [None req-c1e82213-a287-41f9-a877-b2e0e478e101 tempest-TestMinimumBasicScenario-820002800 tempest-TestMinimumBasicScenario-820002800-project] Lock "1daf4f4c-0e4a-4779-b53a-78c48397ea2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120740) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 18:07:36.478434 dv-cinder-852009-8-iscsi devstack@n-api.service[120740]: DEBUG oslo_concurrency.lockutils [None req-c1e82213-a287-41f9-a877-b2e0e478e101 tempest-TestMinimumBasicScenario-820002800 tempest-TestMinimumBasicScenario-820002800-project] Lock "1daf4f4c-0e4a-4779-b53a-78c48397ea2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120740) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 18:07:36.483221 dv-cinder-852009-8-iscsi devstack@n-api.service[120741]: DEBUG nova.api.openstack.wsgi [None req-2a5272aa-9508-4112-850a-cc72b5ac74ad tempest-AttachVolumeTestJSON-555093534 tempest-AttachVolumeTestJSON-555093534-project] Calling method '>' {{(pid=120741) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 18:07:36.483709 dv-cinder-852009-8-iscsi devstack@n-api.service[120741]: DEBUG nova.compute.api [None req-2a5272aa-9508-4112-850a-cc72b5ac74ad tempest-AttachVolumeTestJSON-555093534 tempest-AttachVolumeTestJSON-555093534-project] [instance: d0983ec1-bb82-4a7d-9dba-ace1e3eb383a] Fetching instance by UUID {{(pid=120741) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 18:07:36.489732 dv-cinder-852009-8-iscsi devstack@n-api.service[120741]: DEBUG oslo_concurrency.lockutils [None req-2a5272aa-9508-4112-850a-cc72b5ac74ad tempest-AttachVolumeTestJSON-555093534 tempest-AttachVolumeTestJSON-555093534-project] Acquiring lock "1daf4f4c-0e4a-4779-b53a-78c48397ea2f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120741) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 18:07:36.490569 dv-cinder-852009-8-iscsi devstack@n-api.service[120741]: DEBUG oslo_concurrency.lockutils [None req-2a5272aa-9508-4112-850a-cc72b5ac74ad tempest-AttachVolumeTestJSON-555093534 tempest-AttachVolumeTestJSON-555093534-project] Lock "1daf4f4c-0e4a-4779-b53a-78c48397ea2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120741) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 18:07:36.491154 dv-cinder-852009-8-iscsi devstack@n-api.service[120741]: DEBUG oslo_concurrency.lockutils [None req-2a5272aa-9508-4112-850a-cc72b5ac74ad tempest-AttachVolumeTestJSON-555093534 tempest-AttachVolumeTestJSON-555093534-project] Lock "1daf4f4c-0e4a-4779-b53a-78c48397ea2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120741) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 18:07:36.492045 dv-cinder-852009-8-iscsi devstack@n-api.service[120741]: DEBUG oslo_concurrency.lockutils [None req-2a5272aa-9508-4112-850a-cc72b5ac74ad tempest-AttachVolumeTestJSON-555093534 tempest-AttachVolumeTestJSON-555093534-project] Acquiring lock "1daf4f4c-0e4a-4779-b53a-78c48397ea2f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120741) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 18:07:36.492678 dv-cinder-852009-8-iscsi devstack@n-api.service[120741]: DEBUG oslo_concurrency.lockutils [None req-2a5272aa-9508-4112-850a-cc72b5ac74ad tempest-AttachVolumeTestJSON-555093534 tempest-AttachVolumeTestJSON-555093534-project] Lock "1daf4f4c-0e4a-4779-b53a-78c48397ea2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120741) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 18:07:36.493248 dv-cinder-852009-8-iscsi devstack@n-api.service[120741]: DEBUG oslo_concurrency.lockutils [None req-2a5272aa-9508-4112-850a-cc72b5ac74ad tempest-AttachVolumeTestJSON-555093534 tempest-AttachVolumeTestJSON-555093534-project] Lock "1daf4f4c-0e4a-4779-b53a-78c48397ea2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120741) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 18:07:36.566403 dv-cinder-852009-8-iscsi devstack@n-api.service[120740]: DEBUG nova.objects.instance [None req-c1e82213-a287-41f9-a877-b2e0e478e101 tempest-TestMinimumBasicScenario-820002800 tempest-TestMinimumBasicScenario-820002800-project] Lazy-loading 'services' on Instance uuid f8247a13-94cd-45b2-acc8-8717e1260f37 {{(pid=120740) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Sep 13 18:07:36.578417 dv-cinder-852009-8-iscsi devstack@n-api.service[120741]: DEBUG nova.objects.instance [None req-2a5272aa-9508-4112-850a-cc72b5ac74ad tempest-AttachVolumeTestJSON-555093534 tempest-AttachVolumeTestJSON-555093534-project] Lazy-loading 'services' on Instance uuid d0983ec1-bb82-4a7d-9dba-ace1e3eb383a {{(pid=120741) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Sep 13 18:07:36.649278 dv-cinder-852009-8-iscsi devstack@n-api.service[120740]: INFO nova.api.openstack.requestlog [None req-c1e82213-a287-41f9-a877-b2e0e478e101 tempest-TestMinimumBasicScenario-820002800 tempest-TestMinimumBasicScenario-820002800-project] 10.222.0.43 "DELETE /compute/v2.1/servers/f8247a13-94cd-45b2-acc8-8717e1260f37/os-volume_attachments/27d8cacb-8af0-4c38-83c5-31a4d3abe7c1" status: 202 len: 0 microversion: 2.1 time: 0.190480 Sep 13 18:07:36.649999 dv-cinder-852009-8-iscsi devstack@n-api.service[120740]: [pid: 120740|app: 0|req: 328/646] 10.222.0.43 () {58 vars in 1416 bytes} [Tue Sep 13 18:07:36 2022] DELETE /compute/v2.1/servers/f8247a13-94cd-45b2-acc8-8717e1260f37/os-volume_attachments/27d8cacb-8af0-4c38-83c5-31a4d3abe7c1 => generated 0 bytes in 192 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Sep 13 18:07:36.659862 dv-cinder-852009-8-iscsi devstack@n-api.service[120740]: DEBUG nova.api.openstack.wsgi [None req-7bad60c6-44bb-4ab4-8612-87f33e7a24d5 tempest-TestMinimumBasicScenario-820002800 tempest-TestMinimumBasicScenario-820002800-project] Calling method '>' {{(pid=120740) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 18:07:36.662777 dv-cinder-852009-8-iscsi devstack@n-api.service[120740]: DEBUG nova.compute.api [None req-7bad60c6-44bb-4ab4-8612-87f33e7a24d5 tempest-TestMinimumBasicScenario-820002800 tempest-TestMinimumBasicScenario-820002800-project] [instance: f8247a13-94cd-45b2-acc8-8717e1260f37] Fetching instance by UUID {{(pid=120740) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 18:07:36.669854 dv-cinder-852009-8-iscsi devstack@n-api.service[120740]: DEBUG oslo_concurrency.lockutils [None req-7bad60c6-44bb-4ab4-8612-87f33e7a24d5 tempest-TestMinimumBasicScenario-820002800 tempest-TestMinimumBasicScenario-820002800-project] Acquiring lock "1daf4f4c-0e4a-4779-b53a-78c48397ea2f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120740) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 18:07:36.670789 dv-cinder-852009-8-iscsi devstack@n-api.service[120740]: DEBUG oslo_concurrency.lockutils [None req-7bad60c6-44bb-4ab4-8612-87f33e7a24d5 tempest-TestMinimumBasicScenario-820002800 tempest-TestMinimumBasicScenario-820002800-project] Lock "1daf4f4c-0e4a-4779-b53a-78c48397ea2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120740) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 18:07:36.671291 dv-cinder-852009-8-iscsi devstack@n-api.service[120740]: DEBUG oslo_concurrency.lockutils [None req-7bad60c6-44bb-4ab4-8612-87f33e7a24d5 tempest-TestMinimumBasicScenario-820002800 tempest-TestMinimumBasicScenario-820002800-project] Lock "1daf4f4c-0e4a-4779-b53a-78c48397ea2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120740) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 18:07:36.672092 dv-cinder-852009-8-iscsi devstack@n-api.service[120740]: DEBUG oslo_concurrency.lockutils [None req-7bad60c6-44bb-4ab4-8612-87f33e7a24d5 tempest-TestMinimumBasicScenario-820002800 tempest-TestMinimumBasicScenario-820002800-project] Acquiring lock "1daf4f4c-0e4a-4779-b53a-78c48397ea2f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120740) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 18:07:36.672728 dv-cinder-852009-8-iscsi devstack@n-api.service[120740]: DEBUG oslo_concurrency.lockutils [None req-7bad60c6-44bb-4ab4-8612-87f33e7a24d5 tempest-TestMinimumBasicScenario-820002800 tempest-TestMinimumBasicScenario-820002800-project] Lock "1daf4f4c-0e4a-4779-b53a-78c48397ea2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120740) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 18:07:36.672946 dv-cinder-852009-8-iscsi devstack@n-api.service[120741]: INFO nova.api.openstack.requestlog [None req-2a5272aa-9508-4112-850a-cc72b5ac74ad tempest-AttachVolumeTestJSON-555093534 tempest-AttachVolumeTestJSON-555093534-project] 10.222.0.43 "DELETE /compute/v2.1/servers/d0983ec1-bb82-4a7d-9dba-ace1e3eb383a/os-volume_attachments/167cdb89-8f77-41eb-81a5-1a7af5798e0d" status: 202 len: 0 microversion: 2.1 time: 0.193240 Sep 13 18:07:36.673274 dv-cinder-852009-8-iscsi devstack@n-api.service[120740]: DEBUG oslo_concurrency.lockutils [None req-7bad60c6-44bb-4ab4-8612-87f33e7a24d5 tempest-TestMinimumBasicScenario-820002800 tempest-TestMinimumBasicScenario-820002800-project] Lock "1daf4f4c-0e4a-4779-b53a-78c48397ea2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120740) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 18:07:36.696997 dv-cinder-852009-8-iscsi devstack@n-api.service[120741]: [pid: 120741|app: 0|req: 319/647] 10.222.0.43 () {58 vars in 1416 bytes} [Tue Sep 13 18:07:36 2022] DELETE /compute/v2.1/servers/d0983ec1-bb82-4a7d-9dba-ace1e3eb383a/os-volume_attachments/167cdb89-8f77-41eb-81a5-1a7af5798e0d => generated 0 bytes in 219 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Sep 13 18:07:36.714110 dv-cinder-852009-8-iscsi devstack@n-api.service[120740]: INFO nova.api.openstack.requestlog [None req-7bad60c6-44bb-4ab4-8612-87f33e7a24d5 tempest-TestMinimumBasicScenario-820002800 tempest-TestMinimumBasicScenario-820002800-project] 10.222.0.43 "GET /compute/v2.1/servers/f8247a13-94cd-45b2-acc8-8717e1260f37/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.058934 Sep 13 18:07:36.719632 dv-cinder-852009-8-iscsi devstack@n-api.service[120740]: [pid: 120740|app: 0|req: 329/648] 10.222.0.43 () {58 vars in 1302 bytes} [Tue Sep 13 18:07:36 2022] GET /compute/v2.1/servers/f8247a13-94cd-45b2-acc8-8717e1260f37/os-volume_attachments => generated 197 bytes in 65 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Sep 13 18:07:37.267433 dv-cinder-852009-8-iscsi devstack@n-api.service[120741]: DEBUG nova.api.openstack.wsgi [req-3b34b666-9fdc-4e81-b3ec-3fa36d32a1ad req-18ef6025-66a9-4c9c-9c40-88bdad76a25a service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "f8247a13-94cd-45b2-acc8-8717e1260f37", "tag": "9f86cf72-e29e-4f23-8c9d-afea192c2916"}]} {{(pid=120741) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 13 18:07:37.278727 dv-cinder-852009-8-iscsi devstack@n-api.service[120741]: DEBUG oslo_concurrency.lockutils [req-3b34b666-9fdc-4e81-b3ec-3fa36d32a1ad req-18ef6025-66a9-4c9c-9c40-88bdad76a25a service nova] Acquiring lock "1daf4f4c-0e4a-4779-b53a-78c48397ea2f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120741) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 18:07:37.279233 dv-cinder-852009-8-iscsi devstack@n-api.service[120741]: DEBUG oslo_concurrency.lockutils [req-3b34b666-9fdc-4e81-b3ec-3fa36d32a1ad req-18ef6025-66a9-4c9c-9c40-88bdad76a25a service nova] Lock "1daf4f4c-0e4a-4779-b53a-78c48397ea2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120741) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 18:07:37.279683 dv-cinder-852009-8-iscsi devstack@n-api.service[120741]: DEBUG oslo_concurrency.lockutils [req-3b34b666-9fdc-4e81-b3ec-3fa36d32a1ad req-18ef6025-66a9-4c9c-9c40-88bdad76a25a service nova] Lock "1daf4f4c-0e4a-4779-b53a-78c48397ea2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120741) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 18:07:37.292285 dv-cinder-852009-8-iscsi devstack@n-api.service[120741]: INFO nova.api.openstack.compute.server_external_events [req-3b34b666-9fdc-4e81-b3ec-3fa36d32a1ad req-18ef6025-66a9-4c9c-9c40-88bdad76a25a service nova] Creating event network-changed:9f86cf72-e29e-4f23-8c9d-afea192c2916 for instance f8247a13-94cd-45b2-acc8-8717e1260f37 on hv-cinder-85200 Sep 13 18:07:37.297655 dv-cinder-852009-8-iscsi devstack@n-api.service[120741]: INFO nova.api.openstack.requestlog [req-3b34b666-9fdc-4e81-b3ec-3fa36d32a1ad req-18ef6025-66a9-4c9c-9c40-88bdad76a25a service nova] 10.222.0.43 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.034698 Sep 13 18:07:37.299763 dv-cinder-852009-8-iscsi devstack@n-api.service[120741]: [pid: 120741|app: 0|req: 320/649] 10.222.0.43 () {64 vars in 1317 bytes} [Tue Sep 13 18:07:37 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 38 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Sep 13 18:07:37.483647 dv-cinder-852009-8-iscsi devstack@n-api.service[120740]: DEBUG nova.api.openstack.wsgi [None req-eeefda07-d31a-4078-a02b-72d46df9fd4c tempest-AttachVolumeShelveTestJSON-385853788 tempest-AttachVolumeShelveTestJSON-385853788-project] Calling method '>' {{(pid=120740) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 18:07:37.484724 dv-cinder-852009-8-iscsi devstack@n-api.service[120740]: DEBUG nova.compute.api [None req-eeefda07-d31a-4078-a02b-72d46df9fd4c tempest-AttachVolumeShelveTestJSON-385853788 tempest-AttachVolumeShelveTestJSON-385853788-project] [instance: 8cecf08e-bea8-4cef-9439-0eaa242bfed1] Fetching instance by UUID {{(pid=120740) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 18:07:37.492827 dv-cinder-852009-8-iscsi devstack@n-api.service[120740]: DEBUG oslo_concurrency.lockutils [None req-eeefda07-d31a-4078-a02b-72d46df9fd4c tempest-AttachVolumeShelveTestJSON-385853788 tempest-AttachVolumeShelveTestJSON-385853788-project] Acquiring lock "1daf4f4c-0e4a-4779-b53a-78c48397ea2f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120740) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 18:07:37.493643 dv-cinder-852009-8-iscsi devstack@n-api.service[120740]: DEBUG oslo_concurrency.lockutils [None req-eeefda07-d31a-4078-a02b-72d46df9fd4c tempest-AttachVolumeShelveTestJSON-385853788 tempest-AttachVolumeShelveTestJSON-385853788-project] Lock "1daf4f4c-0e4a-4779-b53a-78c48397ea2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120740) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 18:07:37.494504 dv-cinder-852009-8-iscsi devstack@n-api.service[120740]: DEBUG oslo_concurrency.lockutils [None req-eeefda07-d31a-4078-a02b-72d46df9fd4c tempest-AttachVolumeShelveTestJSON-385853788 tempest-AttachVolumeShelveTestJSON-385853788-project] Lock "1daf4f4c-0e4a-4779-b53a-78c48397ea2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120740) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 18:07:37.495300 dv-cinder-852009-8-iscsi devstack@n-api.service[120740]: DEBUG oslo_concurrency.lockutils [None req-eeefda07-d31a-4078-a02b-72d46df9fd4c tempest-AttachVolumeShelveTestJSON-385853788 tempest-AttachVolumeShelveTestJSON-385853788-project] Acquiring lock "1daf4f4c-0e4a-4779-b53a-78c48397ea2f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120740) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 18:07:37.496375 dv-cinder-852009-8-iscsi devstack@n-api.service[120740]: DEBUG oslo_concurrency.lockutils [None req-eeefda07-d31a-4078-a02b-72d46df9fd4c tempest-AttachVolumeShelveTestJSON-385853788 tempest-AttachVolumeShelveTestJSON-385853788-project] Lock "1daf4f4c-0e4a-4779-b53a-78c48397ea2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120740) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 18:07:37.497008 dv-cinder-852009-8-iscsi devstack@n-api.service[120740]: DEBUG oslo_concurrency.lockutils [None req-eeefda07-d31a-4078-a02b-72d46df9fd4c tempest-AttachVolumeShelveTestJSON-385853788 tempest-AttachVolumeShelveTestJSON-385853788-project] Lock "1daf4f4c-0e4a-4779-b53a-78c48397ea2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120740) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 18:07:37.658198 dv-cinder-852009-8-iscsi devstack@n-api.service[120740]: DEBUG nova.policy [None req-eeefda07-d31a-4078-a02b-72d46df9fd4c tempest-AttachVolumeShelveTestJSON-385853788 tempest-AttachVolumeShelveTestJSON-385853788-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e68ecd9b3ca643539b109f75bb242d6f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '75e14fd88bfb4cd896fa7b070a0fac47', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120740) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 18:07:37.669294 dv-cinder-852009-8-iscsi devstack@n-api.service[120740]: DEBUG nova.policy [None req-eeefda07-d31a-4078-a02b-72d46df9fd4c tempest-AttachVolumeShelveTestJSON-385853788 tempest-AttachVolumeShelveTestJSON-385853788-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'e68ecd9b3ca643539b109f75bb242d6f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '75e14fd88bfb4cd896fa7b070a0fac47', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120740) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 18:07:37.671464 dv-cinder-852009-8-iscsi devstack@n-api.service[120740]: DEBUG nova.policy [None req-eeefda07-d31a-4078-a02b-72d46df9fd4c tempest-AttachVolumeShelveTestJSON-385853788 tempest-AttachVolumeShelveTestJSON-385853788-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'e68ecd9b3ca643539b109f75bb242d6f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '75e14fd88bfb4cd896fa7b070a0fac47', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120740) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 18:07:37.673568 dv-cinder-852009-8-iscsi devstack@n-api.service[120740]: INFO nova.api.openstack.requestlog [None req-eeefda07-d31a-4078-a02b-72d46df9fd4c tempest-AttachVolumeShelveTestJSON-385853788 tempest-AttachVolumeShelveTestJSON-385853788-project] 10.222.0.43 "GET /compute/v2.1/servers/8cecf08e-bea8-4cef-9439-0eaa242bfed1" status: 200 len: 1729 microversion: 2.20 time: 0.194627 Sep 13 18:07:37.674753 dv-cinder-852009-8-iscsi devstack@n-api.service[120740]: [pid: 120740|app: 0|req: 330/650] 10.222.0.43 () {60 vars in 1277 bytes} [Tue Sep 13 18:07:37 2022] GET /compute/v2.1/servers/8cecf08e-bea8-4cef-9439-0eaa242bfed1 => generated 1729 bytes in 196 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 13 18:07:37.728568 dv-cinder-852009-8-iscsi devstack@n-api.service[120741]: DEBUG nova.api.openstack.wsgi [None req-10729da8-da92-41e8-b2af-daafe46849e3 tempest-TestMinimumBasicScenario-820002800 tempest-TestMinimumBasicScenario-820002800-project] Calling method '>' {{(pid=120741) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 18:07:37.732125 dv-cinder-852009-8-iscsi devstack@n-api.service[120741]: DEBUG nova.compute.api [None req-10729da8-da92-41e8-b2af-daafe46849e3 tempest-TestMinimumBasicScenario-820002800 tempest-TestMinimumBasicScenario-820002800-project] [instance: f8247a13-94cd-45b2-acc8-8717e1260f37] Fetching instance by UUID {{(pid=120741) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 18:07:37.741725 dv-cinder-852009-8-iscsi devstack@n-api.service[120741]: DEBUG oslo_concurrency.lockutils [None req-10729da8-da92-41e8-b2af-daafe46849e3 tempest-TestMinimumBasicScenario-820002800 tempest-TestMinimumBasicScenario-820002800-project] Acquiring lock "1daf4f4c-0e4a-4779-b53a-78c48397ea2f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120741) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 18:07:37.743292 dv-cinder-852009-8-iscsi devstack@n-api.service[120741]: DEBUG oslo_concurrency.lockutils [None req-10729da8-da92-41e8-b2af-daafe46849e3 tempest-TestMinimumBasicScenario-820002800 tempest-TestMinimumBasicScenario-820002800-project] Lock "1daf4f4c-0e4a-4779-b53a-78c48397ea2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120741) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 18:07:37.745414 dv-cinder-852009-8-iscsi devstack@n-api.service[120741]: DEBUG oslo_concurrency.lockutils [None req-10729da8-da92-41e8-b2af-daafe46849e3 tempest-TestMinimumBasicScenario-820002800 tempest-TestMinimumBasicScenario-820002800-project] Lock "1daf4f4c-0e4a-4779-b53a-78c48397ea2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120741) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 18:07:37.746643 dv-cinder-852009-8-iscsi devstack@n-api.service[120741]: DEBUG oslo_concurrency.lockutils [None req-10729da8-da92-41e8-b2af-daafe46849e3 tempest-TestMinimumBasicScenario-820002800 tempest-TestMinimumBasicScenario-820002800-project] Acquiring lock "1daf4f4c-0e4a-4779-b53a-78c48397ea2f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120741) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 18:07:37.747414 dv-cinder-852009-8-iscsi devstack@n-api.service[120741]: DEBUG oslo_concurrency.lockutils [None req-10729da8-da92-41e8-b2af-daafe46849e3 tempest-TestMinimumBasicScenario-820002800 tempest-TestMinimumBasicScenario-820002800-project] Lock "1daf4f4c-0e4a-4779-b53a-78c48397ea2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120741) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 18:07:37.747993 dv-cinder-852009-8-iscsi devstack@n-api.service[120741]: DEBUG oslo_concurrency.lockutils [None req-10729da8-da92-41e8-b2af-daafe46849e3 tempest-TestMinimumBasicScenario-820002800 tempest-TestMinimumBasicScenario-820002800-project] Lock "1daf4f4c-0e4a-4779-b53a-78c48397ea2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120741) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 18:07:37.811390 dv-cinder-852009-8-iscsi devstack@n-api.service[120741]: INFO nova.api.openstack.requestlog [None req-10729da8-da92-41e8-b2af-daafe46849e3 tempest-TestMinimumBasicScenario-820002800 tempest-TestMinimumBasicScenario-820002800-project] 10.222.0.43 "GET /compute/v2.1/servers/f8247a13-94cd-45b2-acc8-8717e1260f37/os-volume_attachments" status: 200 len: 25 microversion: 2.1 time: 0.087905 Sep 13 18:07:37.811874 dv-cinder-852009-8-iscsi devstack@n-api.service[120741]: [pid: 120741|app: 0|req: 321/651] 10.222.0.43 () {58 vars in 1302 bytes} [Tue Sep 13 18:07:37 2022] GET /compute/v2.1/servers/f8247a13-94cd-45b2-acc8-8717e1260f37/os-volume_attachments => generated 25 bytes in 89 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Sep 13 18:07:37.822940 dv-cinder-852009-8-iscsi devstack@n-api.service[120740]: DEBUG nova.api.openstack.wsgi [None req-3553b295-3825-4422-b242-0ca6b77ab15b tempest-TestMinimumBasicScenario-820002800 tempest-TestMinimumBasicScenario-820002800-project] Calling method '>' {{(pid=120740) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 18:07:37.823687 dv-cinder-852009-8-iscsi devstack@n-api.service[120740]: DEBUG nova.compute.api [None req-3553b295-3825-4422-b242-0ca6b77ab15b tempest-TestMinimumBasicScenario-820002800 tempest-TestMinimumBasicScenario-820002800-project] [instance: f8247a13-94cd-45b2-acc8-8717e1260f37] Fetching instance by UUID {{(pid=120740) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 18:07:37.831976 dv-cinder-852009-8-iscsi devstack@n-api.service[120740]: DEBUG oslo_concurrency.lockutils [None req-3553b295-3825-4422-b242-0ca6b77ab15b tempest-TestMinimumBasicScenario-820002800 tempest-TestMinimumBasicScenario-820002800-project] Acquiring lock "1daf4f4c-0e4a-4779-b53a-78c48397ea2f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120740) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 18:07:37.832772 dv-cinder-852009-8-iscsi devstack@n-api.service[120740]: DEBUG oslo_concurrency.lockutils [None req-3553b295-3825-4422-b242-0ca6b77ab15b tempest-TestMinimumBasicScenario-820002800 tempest-TestMinimumBasicScenario-820002800-project] Lock "1daf4f4c-0e4a-4779-b53a-78c48397ea2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120740) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 18:07:37.833459 dv-cinder-852009-8-iscsi devstack@n-api.service[120740]: DEBUG oslo_concurrency.lockutils [None req-3553b295-3825-4422-b242-0ca6b77ab15b tempest-TestMinimumBasicScenario-820002800 tempest-TestMinimumBasicScenario-820002800-project] Lock "1daf4f4c-0e4a-4779-b53a-78c48397ea2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120740) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 18:07:37.834352 dv-cinder-852009-8-iscsi devstack@n-api.service[120740]: DEBUG oslo_concurrency.lockutils [None req-3553b295-3825-4422-b242-0ca6b77ab15b tempest-TestMinimumBasicScenario-820002800 tempest-TestMinimumBasicScenario-820002800-project] Acquiring lock "1daf4f4c-0e4a-4779-b53a-78c48397ea2f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120740) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 18:07:37.834889 dv-cinder-852009-8-iscsi devstack@n-api.service[120740]: DEBUG oslo_concurrency.lockutils [None req-3553b295-3825-4422-b242-0ca6b77ab15b tempest-TestMinimumBasicScenario-820002800 tempest-TestMinimumBasicScenario-820002800-project] Lock "1daf4f4c-0e4a-4779-b53a-78c48397ea2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120740) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 18:07:37.835491 dv-cinder-852009-8-iscsi devstack@n-api.service[120740]: DEBUG oslo_concurrency.lockutils [None req-3553b295-3825-4422-b242-0ca6b77ab15b tempest-TestMinimumBasicScenario-820002800 tempest-TestMinimumBasicScenario-820002800-project] Lock "1daf4f4c-0e4a-4779-b53a-78c48397ea2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120740) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 18:07:37.923630 dv-cinder-852009-8-iscsi devstack@n-api.service[120740]: INFO nova.api.openstack.wsgi [None req-3553b295-3825-4422-b242-0ca6b77ab15b tempest-TestMinimumBasicScenario-820002800 tempest-TestMinimumBasicScenario-820002800-project] HTTP exception thrown: Instance f8247a13-94cd-45b2-acc8-8717e1260f37 is not attached to volume 27d8cacb-8af0-4c38-83c5-31a4d3abe7c1 Sep 13 18:07:37.926111 dv-cinder-852009-8-iscsi devstack@n-api.service[120740]: DEBUG nova.api.openstack.wsgi [None req-3553b295-3825-4422-b242-0ca6b77ab15b tempest-TestMinimumBasicScenario-820002800 tempest-TestMinimumBasicScenario-820002800-project] Request method failure captured: Sep 13 18:07:37.926111 dv-cinder-852009-8-iscsi devstack@n-api.service[120740]: request: DELETE /compute/v2.1/servers/f8247a13-94cd-45b2-acc8-8717e1260f37/os-volume_attachments/27d8cacb-8af0-4c38-83c5-31a4d3abe7c1 HTTP/1.1 Sep 13 18:07:37.926111 dv-cinder-852009-8-iscsi devstack@n-api.service[120740]: Accept: application/json Sep 13 18:07:37.926111 dv-cinder-852009-8-iscsi devstack@n-api.service[120740]: Accept-Encoding: identity Sep 13 18:07:37.926111 dv-cinder-852009-8-iscsi devstack@n-api.service[120740]: Connection: close Sep 13 18:07:37.926111 dv-cinder-852009-8-iscsi devstack@n-api.service[120740]: Content-Length: 0 Sep 13 18:07:37.926111 dv-cinder-852009-8-iscsi devstack@n-api.service[120740]: Content-Type: application/json Sep 13 18:07:37.926111 dv-cinder-852009-8-iscsi devstack@n-api.service[120740]: Host: 10.222.0.43 Sep 13 18:07:37.926111 dv-cinder-852009-8-iscsi devstack@n-api.service[120740]: Openstack-System-Scope: None Sep 13 18:07:37.926111 dv-cinder-852009-8-iscsi devstack@n-api.service[120740]: User-Agent: python-urllib3/1.26.12 Sep 13 18:07:37.926111 dv-cinder-852009-8-iscsi devstack@n-api.service[120740]: X-Auth-Token: gAAAAABjIMZadF0dlmM7-pOrJCi6KZ1R2J5t7RWmkyOx1ISCyVGcZ6-t5-ax8PAEdQ9tuN2_iUBvm3gwqND0VKUw0calBK8gblKa_EhDMpy57PQ-7FPc495iTWotYL-xXghbLvov2k0ou8JcuRtXPpD5X5kCTLg2QLakKWwSsq_-uB6LW07Jpac Sep 13 18:07:37.926111 dv-cinder-852009-8-iscsi devstack@n-api.service[120740]: X-Domain-Id: None Sep 13 18:07:37.926111 dv-cinder-852009-8-iscsi devstack@n-api.service[120740]: X-Domain-Name: None Sep 13 18:07:37.926111 dv-cinder-852009-8-iscsi devstack@n-api.service[120740]: X-Identity-Status: Confirmed Sep 13 18:07:37.926111 dv-cinder-852009-8-iscsi devstack@n-api.service[120740]: X-Is-Admin-Project: True Sep 13 18:07:37.926111 dv-cinder-852009-8-iscsi devstack@n-api.service[120740]: X-Project-Domain-Id: default Sep 13 18:07:37.926111 dv-cinder-852009-8-iscsi devstack@n-api.service[120740]: X-Project-Domain-Name: Default Sep 13 18:07:37.926111 dv-cinder-852009-8-iscsi devstack@n-api.service[120740]: X-Project-Id: 2f6832936c824066a4370cc45c5b0282 Sep 13 18:07:37.926111 dv-cinder-852009-8-iscsi devstack@n-api.service[120740]: X-Project-Name: tempest-TestMinimumBasicScenario-820002800 Sep 13 18:07:37.926111 dv-cinder-852009-8-iscsi devstack@n-api.service[120740]: X-Role: reader,member Sep 13 18:07:37.926111 dv-cinder-852009-8-iscsi devstack@n-api.service[120740]: X-Roles: reader,member Sep 13 18:07:37.927712 dv-cinder-852009-8-iscsi devstack@n-api.service[120740]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/identity"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/compute/v2/2f6832936c824066a4370cc45c5b0282"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.43:8080", "publicURL": "http://10.222.0.43:8080/v1/AUTH_2f6832936c824066a4370cc45c5b0282"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43:9696/networking"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/volume/v3/2f6832936c824066a4370cc45c5b0282"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/compute/v2.1"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/placement"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/volume/v3/2f6832936c824066a4370cc45c5b0282"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/image"}]}] Sep 13 18:07:37.927712 dv-cinder-852009-8-iscsi devstack@n-api.service[120740]: X-Tenant: tempest-TestMinimumBasicScenario-820002800 Sep 13 18:07:37.927712 dv-cinder-852009-8-iscsi devstack@n-api.service[120740]: X-Tenant-Id: 2f6832936c824066a4370cc45c5b0282 Sep 13 18:07:37.927712 dv-cinder-852009-8-iscsi devstack@n-api.service[120740]: X-Tenant-Name: tempest-TestMinimumBasicScenario-820002800 Sep 13 18:07:37.927712 dv-cinder-852009-8-iscsi devstack@n-api.service[120740]: X-User: tempest-TestMinimumBasicScenario-820002800-project Sep 13 18:07:37.927712 dv-cinder-852009-8-iscsi devstack@n-api.service[120740]: X-User-Domain-Id: default Sep 13 18:07:37.927712 dv-cinder-852009-8-iscsi devstack@n-api.service[120740]: X-User-Domain-Name: Default Sep 13 18:07:37.927712 dv-cinder-852009-8-iscsi devstack@n-api.service[120740]: X-User-Id: 7880064ff0aa448d9c367c89eba145ff Sep 13 18:07:37.927712 dv-cinder-852009-8-iscsi devstack@n-api.service[120740]: X-User-Name: tempest-TestMinimumBasicScenario-820002800-project Sep 13 18:07:37.927712 dv-cinder-852009-8-iscsi devstack@n-api.service[120740]: method: > Sep 13 18:07:37.927712 dv-cinder-852009-8-iscsi devstack@n-api.service[120740]: exception: Instance f8247a13-94cd-45b2-acc8-8717e1260f37 is not attached to volume 27d8cacb-8af0-4c38-83c5-31a4d3abe7c1 Sep 13 18:07:37.928574 dv-cinder-852009-8-iscsi devstack@n-api.service[120740]: action_args: {'server_id': 'f8247a13-94cd-45b2-acc8-8717e1260f37', 'id': '27d8cacb-8af0-4c38-83c5-31a4d3abe7c1'} Sep 13 18:07:37.928574 dv-cinder-852009-8-iscsi devstack@n-api.service[120740]: {{(pid=120740) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 13 18:07:37.928574 dv-cinder-852009-8-iscsi devstack@n-api.service[120740]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 13 18:07:37.928574 dv-cinder-852009-8-iscsi devstack@n-api.service[120740]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 552, in delete Sep 13 18:07:37.928574 dv-cinder-852009-8-iscsi devstack@n-api.service[120740]: ERROR nova.api.openstack.wsgi bdm = objects.BlockDeviceMapping.get_by_volume_and_instance( Sep 13 18:07:37.928574 dv-cinder-852009-8-iscsi devstack@n-api.service[120740]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_versionedobjects/base.py", line 184, in wrapper Sep 13 18:07:37.928574 dv-cinder-852009-8-iscsi devstack@n-api.service[120740]: ERROR nova.api.openstack.wsgi result = fn(cls, context, *args, **kwargs) Sep 13 18:07:37.928574 dv-cinder-852009-8-iscsi devstack@n-api.service[120740]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/block_device.py", line 293, in get_by_volume_and_instance Sep 13 18:07:37.928574 dv-cinder-852009-8-iscsi devstack@n-api.service[120740]: ERROR nova.api.openstack.wsgi raise exception.VolumeBDMNotFound(volume_id=volume_id) Sep 13 18:07:37.928574 dv-cinder-852009-8-iscsi devstack@n-api.service[120740]: ERROR nova.api.openstack.wsgi nova.exception.VolumeBDMNotFound: No volume Block Device Mapping with id 27d8cacb-8af0-4c38-83c5-31a4d3abe7c1. Sep 13 18:07:37.928574 dv-cinder-852009-8-iscsi devstack@n-api.service[120740]: ERROR nova.api.openstack.wsgi Sep 13 18:07:37.928574 dv-cinder-852009-8-iscsi devstack@n-api.service[120740]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 13 18:07:37.928574 dv-cinder-852009-8-iscsi devstack@n-api.service[120740]: ERROR nova.api.openstack.wsgi Sep 13 18:07:37.928574 dv-cinder-852009-8-iscsi devstack@n-api.service[120740]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 13 18:07:37.928574 dv-cinder-852009-8-iscsi devstack@n-api.service[120740]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 13 18:07:37.928574 dv-cinder-852009-8-iscsi devstack@n-api.service[120740]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 13 18:07:37.928574 dv-cinder-852009-8-iscsi devstack@n-api.service[120740]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 13 18:07:37.928574 dv-cinder-852009-8-iscsi devstack@n-api.service[120740]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 13 18:07:37.928574 dv-cinder-852009-8-iscsi devstack@n-api.service[120740]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 13 18:07:37.929968 dv-cinder-852009-8-iscsi devstack@n-api.service[120740]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 13 18:07:37.929968 dv-cinder-852009-8-iscsi devstack@n-api.service[120740]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 558, in delete Sep 13 18:07:37.929968 dv-cinder-852009-8-iscsi devstack@n-api.service[120740]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=msg) Sep 13 18:07:37.929968 dv-cinder-852009-8-iscsi devstack@n-api.service[120740]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance f8247a13-94cd-45b2-acc8-8717e1260f37 is not attached to volume 27d8cacb-8af0-4c38-83c5-31a4d3abe7c1 Sep 13 18:07:37.929968 dv-cinder-852009-8-iscsi devstack@n-api.service[120740]: ERROR nova.api.openstack.wsgi Sep 13 18:07:37.929968 dv-cinder-852009-8-iscsi devstack@n-api.service[120740]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 13 18:07:37.929968 dv-cinder-852009-8-iscsi devstack@n-api.service[120740]: ERROR nova.api.openstack.wsgi Sep 13 18:07:37.929968 dv-cinder-852009-8-iscsi devstack@n-api.service[120740]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 13 18:07:37.929968 dv-cinder-852009-8-iscsi devstack@n-api.service[120740]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 13 18:07:37.929968 dv-cinder-852009-8-iscsi devstack@n-api.service[120740]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 13 18:07:37.929968 dv-cinder-852009-8-iscsi devstack@n-api.service[120740]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 13 18:07:37.929968 dv-cinder-852009-8-iscsi devstack@n-api.service[120740]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 13 18:07:37.929968 dv-cinder-852009-8-iscsi devstack@n-api.service[120740]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance f8247a13-94cd-45b2-acc8-8717e1260f37 is not attached to volume 27d8cacb-8af0-4c38-83c5-31a4d3abe7c1 Sep 13 18:07:37.929968 dv-cinder-852009-8-iscsi devstack@n-api.service[120740]: ERROR nova.api.openstack.wsgi Sep 13 18:07:37.929968 dv-cinder-852009-8-iscsi devstack@n-api.service[120740]: DEBUG nova.api.openstack.wsgi [None req-3553b295-3825-4422-b242-0ca6b77ab15b tempest-TestMinimumBasicScenario-820002800 tempest-TestMinimumBasicScenario-820002800-project] Returning 404 to user: Instance f8247a13-94cd-45b2-acc8-8717e1260f37 is not attached to volume 27d8cacb-8af0-4c38-83c5-31a4d3abe7c1 {{(pid=120740) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 13 18:07:37.931068 dv-cinder-852009-8-iscsi devstack@n-api.service[120740]: INFO nova.api.openstack.requestlog [None req-3553b295-3825-4422-b242-0ca6b77ab15b tempest-TestMinimumBasicScenario-820002800 tempest-TestMinimumBasicScenario-820002800-project] 10.222.0.43 "DELETE /compute/v2.1/servers/f8247a13-94cd-45b2-acc8-8717e1260f37/os-volume_attachments/27d8cacb-8af0-4c38-83c5-31a4d3abe7c1" status: 404 len: 154 microversion: 2.1 time: 0.108623 Sep 13 18:07:37.931068 dv-cinder-852009-8-iscsi devstack@n-api.service[120740]: [pid: 120740|app: 0|req: 331/652] 10.222.0.43 () {58 vars in 1416 bytes} [Tue Sep 13 18:07:37 2022] DELETE /compute/v2.1/servers/f8247a13-94cd-45b2-acc8-8717e1260f37/os-volume_attachments/27d8cacb-8af0-4c38-83c5-31a4d3abe7c1 => generated 154 bytes in 110 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Sep 13 18:07:38.699489 dv-cinder-852009-8-iscsi devstack@n-api.service[120741]: DEBUG nova.api.openstack.wsgi [None req-6afa9aae-7f3c-4d89-88c3-3bb579514435 tempest-AttachVolumeShelveTestJSON-385853788 tempest-AttachVolumeShelveTestJSON-385853788-project] Calling method '>' {{(pid=120741) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 18:07:38.700221 dv-cinder-852009-8-iscsi devstack@n-api.service[120741]: DEBUG nova.compute.api [None req-6afa9aae-7f3c-4d89-88c3-3bb579514435 tempest-AttachVolumeShelveTestJSON-385853788 tempest-AttachVolumeShelveTestJSON-385853788-project] [instance: 8cecf08e-bea8-4cef-9439-0eaa242bfed1] Fetching instance by UUID {{(pid=120741) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 18:07:38.707177 dv-cinder-852009-8-iscsi devstack@n-api.service[120741]: DEBUG oslo_concurrency.lockutils [None req-6afa9aae-7f3c-4d89-88c3-3bb579514435 tempest-AttachVolumeShelveTestJSON-385853788 tempest-AttachVolumeShelveTestJSON-385853788-project] Acquiring lock "1daf4f4c-0e4a-4779-b53a-78c48397ea2f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120741) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 18:07:38.707672 dv-cinder-852009-8-iscsi devstack@n-api.service[120741]: DEBUG oslo_concurrency.lockutils [None req-6afa9aae-7f3c-4d89-88c3-3bb579514435 tempest-AttachVolumeShelveTestJSON-385853788 tempest-AttachVolumeShelveTestJSON-385853788-project] Lock "1daf4f4c-0e4a-4779-b53a-78c48397ea2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120741) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 18:07:38.708188 dv-cinder-852009-8-iscsi devstack@n-api.service[120741]: DEBUG oslo_concurrency.lockutils [None req-6afa9aae-7f3c-4d89-88c3-3bb579514435 tempest-AttachVolumeShelveTestJSON-385853788 tempest-AttachVolumeShelveTestJSON-385853788-project] Lock "1daf4f4c-0e4a-4779-b53a-78c48397ea2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120741) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 18:07:38.708872 dv-cinder-852009-8-iscsi devstack@n-api.service[120741]: DEBUG oslo_concurrency.lockutils [None req-6afa9aae-7f3c-4d89-88c3-3bb579514435 tempest-AttachVolumeShelveTestJSON-385853788 tempest-AttachVolumeShelveTestJSON-385853788-project] Acquiring lock "1daf4f4c-0e4a-4779-b53a-78c48397ea2f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120741) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 18:07:38.709375 dv-cinder-852009-8-iscsi devstack@n-api.service[120741]: DEBUG oslo_concurrency.lockutils [None req-6afa9aae-7f3c-4d89-88c3-3bb579514435 tempest-AttachVolumeShelveTestJSON-385853788 tempest-AttachVolumeShelveTestJSON-385853788-project] Lock "1daf4f4c-0e4a-4779-b53a-78c48397ea2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120741) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 18:07:38.709859 dv-cinder-852009-8-iscsi devstack@n-api.service[120741]: DEBUG oslo_concurrency.lockutils [None req-6afa9aae-7f3c-4d89-88c3-3bb579514435 tempest-AttachVolumeShelveTestJSON-385853788 tempest-AttachVolumeShelveTestJSON-385853788-project] Lock "1daf4f4c-0e4a-4779-b53a-78c48397ea2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120741) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 18:07:38.848406 dv-cinder-852009-8-iscsi devstack@n-api.service[120741]: DEBUG nova.policy [None req-6afa9aae-7f3c-4d89-88c3-3bb579514435 tempest-AttachVolumeShelveTestJSON-385853788 tempest-AttachVolumeShelveTestJSON-385853788-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e68ecd9b3ca643539b109f75bb242d6f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '75e14fd88bfb4cd896fa7b070a0fac47', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120741) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 18:07:38.857046 dv-cinder-852009-8-iscsi devstack@n-api.service[120741]: DEBUG nova.policy [None req-6afa9aae-7f3c-4d89-88c3-3bb579514435 tempest-AttachVolumeShelveTestJSON-385853788 tempest-AttachVolumeShelveTestJSON-385853788-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'e68ecd9b3ca643539b109f75bb242d6f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '75e14fd88bfb4cd896fa7b070a0fac47', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120741) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 18:07:38.858534 dv-cinder-852009-8-iscsi devstack@n-api.service[120741]: DEBUG nova.policy [None req-6afa9aae-7f3c-4d89-88c3-3bb579514435 tempest-AttachVolumeShelveTestJSON-385853788 tempest-AttachVolumeShelveTestJSON-385853788-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'e68ecd9b3ca643539b109f75bb242d6f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '75e14fd88bfb4cd896fa7b070a0fac47', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120741) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 18:07:38.859679 dv-cinder-852009-8-iscsi devstack@n-api.service[120741]: INFO nova.api.openstack.requestlog [None req-6afa9aae-7f3c-4d89-88c3-3bb579514435 tempest-AttachVolumeShelveTestJSON-385853788 tempest-AttachVolumeShelveTestJSON-385853788-project] 10.222.0.43 "GET /compute/v2.1/servers/8cecf08e-bea8-4cef-9439-0eaa242bfed1" status: 200 len: 1729 microversion: 2.20 time: 0.164276 Sep 13 18:07:38.860243 dv-cinder-852009-8-iscsi devstack@n-api.service[120741]: [pid: 120741|app: 0|req: 322/653] 10.222.0.43 () {60 vars in 1277 bytes} [Tue Sep 13 18:07:38 2022] GET /compute/v2.1/servers/8cecf08e-bea8-4cef-9439-0eaa242bfed1 => generated 1729 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 13 18:07:38.929634 dv-cinder-852009-8-iscsi devstack@n-api.service[120740]: DEBUG nova.api.openstack.wsgi [None req-fff367ea-9e44-4eb1-8e5d-49cafa284408 tempest-AttachVolumeTestJSON-555093534 tempest-AttachVolumeTestJSON-555093534-project] Calling method '>' {{(pid=120740) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 18:07:38.930149 dv-cinder-852009-8-iscsi devstack@n-api.service[120740]: DEBUG nova.compute.api [None req-fff367ea-9e44-4eb1-8e5d-49cafa284408 tempest-AttachVolumeTestJSON-555093534 tempest-AttachVolumeTestJSON-555093534-project] [instance: d0983ec1-bb82-4a7d-9dba-ace1e3eb383a] Fetching instance by UUID {{(pid=120740) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 18:07:38.937101 dv-cinder-852009-8-iscsi devstack@n-api.service[120740]: DEBUG oslo_concurrency.lockutils [None req-fff367ea-9e44-4eb1-8e5d-49cafa284408 tempest-AttachVolumeTestJSON-555093534 tempest-AttachVolumeTestJSON-555093534-project] Acquiring lock "1daf4f4c-0e4a-4779-b53a-78c48397ea2f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120740) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 18:07:38.937578 dv-cinder-852009-8-iscsi devstack@n-api.service[120740]: DEBUG oslo_concurrency.lockutils [None req-fff367ea-9e44-4eb1-8e5d-49cafa284408 tempest-AttachVolumeTestJSON-555093534 tempest-AttachVolumeTestJSON-555093534-project] Lock "1daf4f4c-0e4a-4779-b53a-78c48397ea2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120740) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 18:07:38.938007 dv-cinder-852009-8-iscsi devstack@n-api.service[120740]: DEBUG oslo_concurrency.lockutils [None req-fff367ea-9e44-4eb1-8e5d-49cafa284408 tempest-AttachVolumeTestJSON-555093534 tempest-AttachVolumeTestJSON-555093534-project] Lock "1daf4f4c-0e4a-4779-b53a-78c48397ea2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120740) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 18:07:38.938799 dv-cinder-852009-8-iscsi devstack@n-api.service[120740]: DEBUG oslo_concurrency.lockutils [None req-fff367ea-9e44-4eb1-8e5d-49cafa284408 tempest-AttachVolumeTestJSON-555093534 tempest-AttachVolumeTestJSON-555093534-project] Acquiring lock "1daf4f4c-0e4a-4779-b53a-78c48397ea2f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120740) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 18:07:38.939295 dv-cinder-852009-8-iscsi devstack@n-api.service[120740]: DEBUG oslo_concurrency.lockutils [None req-fff367ea-9e44-4eb1-8e5d-49cafa284408 tempest-AttachVolumeTestJSON-555093534 tempest-AttachVolumeTestJSON-555093534-project] Lock "1daf4f4c-0e4a-4779-b53a-78c48397ea2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120740) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 18:07:38.939807 dv-cinder-852009-8-iscsi devstack@n-api.service[120740]: DEBUG oslo_concurrency.lockutils [None req-fff367ea-9e44-4eb1-8e5d-49cafa284408 tempest-AttachVolumeTestJSON-555093534 tempest-AttachVolumeTestJSON-555093534-project] Lock "1daf4f4c-0e4a-4779-b53a-78c48397ea2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120740) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 18:07:38.975165 dv-cinder-852009-8-iscsi devstack@n-api.service[120740]: INFO nova.api.openstack.requestlog [None req-fff367ea-9e44-4eb1-8e5d-49cafa284408 tempest-AttachVolumeTestJSON-555093534 tempest-AttachVolumeTestJSON-555093534-project] 10.222.0.43 "GET /compute/v2.1/servers/d0983ec1-bb82-4a7d-9dba-ace1e3eb383a/os-volume_attachments/e0d075e8-2581-47b4-9063-a1a6d51a268c" status: 200 len: 194 microversion: 2.1 time: 0.049455 Sep 13 18:07:38.975934 dv-cinder-852009-8-iscsi devstack@n-api.service[120740]: [pid: 120740|app: 0|req: 332/654] 10.222.0.43 () {58 vars in 1413 bytes} [Tue Sep 13 18:07:38 2022] GET /compute/v2.1/servers/d0983ec1-bb82-4a7d-9dba-ace1e3eb383a/os-volume_attachments/e0d075e8-2581-47b4-9063-a1a6d51a268c => generated 194 bytes in 52 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 13 18:07:38.986573 dv-cinder-852009-8-iscsi devstack@n-api.service[120741]: DEBUG nova.api.openstack.wsgi [None req-20499a40-33ac-40de-b358-d18adbc4ef17 tempest-AttachVolumeTestJSON-555093534 tempest-AttachVolumeTestJSON-555093534-project] Calling method '>' {{(pid=120741) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 18:07:38.987066 dv-cinder-852009-8-iscsi devstack@n-api.service[120741]: DEBUG nova.compute.api [None req-20499a40-33ac-40de-b358-d18adbc4ef17 tempest-AttachVolumeTestJSON-555093534 tempest-AttachVolumeTestJSON-555093534-project] [instance: d0983ec1-bb82-4a7d-9dba-ace1e3eb383a] Fetching instance by UUID {{(pid=120741) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 18:07:38.994120 dv-cinder-852009-8-iscsi devstack@n-api.service[120741]: DEBUG oslo_concurrency.lockutils [None req-20499a40-33ac-40de-b358-d18adbc4ef17 tempest-AttachVolumeTestJSON-555093534 tempest-AttachVolumeTestJSON-555093534-project] Acquiring lock "1daf4f4c-0e4a-4779-b53a-78c48397ea2f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120741) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 18:07:38.994771 dv-cinder-852009-8-iscsi devstack@n-api.service[120741]: DEBUG oslo_concurrency.lockutils [None req-20499a40-33ac-40de-b358-d18adbc4ef17 tempest-AttachVolumeTestJSON-555093534 tempest-AttachVolumeTestJSON-555093534-project] Lock "1daf4f4c-0e4a-4779-b53a-78c48397ea2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120741) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 18:07:38.995444 dv-cinder-852009-8-iscsi devstack@n-api.service[120741]: DEBUG oslo_concurrency.lockutils [None req-20499a40-33ac-40de-b358-d18adbc4ef17 tempest-AttachVolumeTestJSON-555093534 tempest-AttachVolumeTestJSON-555093534-project] Lock "1daf4f4c-0e4a-4779-b53a-78c48397ea2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120741) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 18:07:38.996387 dv-cinder-852009-8-iscsi devstack@n-api.service[120741]: DEBUG oslo_concurrency.lockutils [None req-20499a40-33ac-40de-b358-d18adbc4ef17 tempest-AttachVolumeTestJSON-555093534 tempest-AttachVolumeTestJSON-555093534-project] Acquiring lock "1daf4f4c-0e4a-4779-b53a-78c48397ea2f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120741) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 18:07:38.996976 dv-cinder-852009-8-iscsi devstack@n-api.service[120741]: DEBUG oslo_concurrency.lockutils [None req-20499a40-33ac-40de-b358-d18adbc4ef17 tempest-AttachVolumeTestJSON-555093534 tempest-AttachVolumeTestJSON-555093534-project] Lock "1daf4f4c-0e4a-4779-b53a-78c48397ea2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120741) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 18:07:38.997501 dv-cinder-852009-8-iscsi devstack@n-api.service[120741]: DEBUG oslo_concurrency.lockutils [None req-20499a40-33ac-40de-b358-d18adbc4ef17 tempest-AttachVolumeTestJSON-555093534 tempest-AttachVolumeTestJSON-555093534-project] Lock "1daf4f4c-0e4a-4779-b53a-78c48397ea2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120741) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 18:07:39.080964 dv-cinder-852009-8-iscsi devstack@n-api.service[120740]: DEBUG nova.api.openstack.wsgi [None req-896bebc1-c999-4819-aa7c-11c91ce282ba tempest-TestMinimumBasicScenario-820002800 tempest-TestMinimumBasicScenario-820002800-project] Calling method '>' {{(pid=120740) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 18:07:39.081708 dv-cinder-852009-8-iscsi devstack@n-api.service[120740]: DEBUG nova.compute.api [None req-896bebc1-c999-4819-aa7c-11c91ce282ba tempest-TestMinimumBasicScenario-820002800 tempest-TestMinimumBasicScenario-820002800-project] [instance: f8247a13-94cd-45b2-acc8-8717e1260f37] Fetching instance by UUID {{(pid=120740) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 18:07:39.082697 dv-cinder-852009-8-iscsi devstack@n-api.service[120741]: DEBUG nova.objects.instance [None req-20499a40-33ac-40de-b358-d18adbc4ef17 tempest-AttachVolumeTestJSON-555093534 tempest-AttachVolumeTestJSON-555093534-project] Lazy-loading 'services' on Instance uuid d0983ec1-bb82-4a7d-9dba-ace1e3eb383a {{(pid=120741) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Sep 13 18:07:39.088635 dv-cinder-852009-8-iscsi devstack@n-api.service[120740]: DEBUG oslo_concurrency.lockutils [None req-896bebc1-c999-4819-aa7c-11c91ce282ba tempest-TestMinimumBasicScenario-820002800 tempest-TestMinimumBasicScenario-820002800-project] Acquiring lock "1daf4f4c-0e4a-4779-b53a-78c48397ea2f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120740) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 18:07:39.089366 dv-cinder-852009-8-iscsi devstack@n-api.service[120740]: DEBUG oslo_concurrency.lockutils [None req-896bebc1-c999-4819-aa7c-11c91ce282ba tempest-TestMinimumBasicScenario-820002800 tempest-TestMinimumBasicScenario-820002800-project] Lock "1daf4f4c-0e4a-4779-b53a-78c48397ea2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120740) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 18:07:39.089802 dv-cinder-852009-8-iscsi devstack@n-api.service[120740]: DEBUG oslo_concurrency.lockutils [None req-896bebc1-c999-4819-aa7c-11c91ce282ba tempest-TestMinimumBasicScenario-820002800 tempest-TestMinimumBasicScenario-820002800-project] Lock "1daf4f4c-0e4a-4779-b53a-78c48397ea2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120740) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 18:07:39.090518 dv-cinder-852009-8-iscsi devstack@n-api.service[120740]: DEBUG oslo_concurrency.lockutils [None req-896bebc1-c999-4819-aa7c-11c91ce282ba tempest-TestMinimumBasicScenario-820002800 tempest-TestMinimumBasicScenario-820002800-project] Acquiring lock "1daf4f4c-0e4a-4779-b53a-78c48397ea2f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120740) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 18:07:39.090949 dv-cinder-852009-8-iscsi devstack@n-api.service[120740]: DEBUG oslo_concurrency.lockutils [None req-896bebc1-c999-4819-aa7c-11c91ce282ba tempest-TestMinimumBasicScenario-820002800 tempest-TestMinimumBasicScenario-820002800-project] Lock "1daf4f4c-0e4a-4779-b53a-78c48397ea2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120740) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 18:07:39.091567 dv-cinder-852009-8-iscsi devstack@n-api.service[120740]: DEBUG oslo_concurrency.lockutils [None req-896bebc1-c999-4819-aa7c-11c91ce282ba tempest-TestMinimumBasicScenario-820002800 tempest-TestMinimumBasicScenario-820002800-project] Lock "1daf4f4c-0e4a-4779-b53a-78c48397ea2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120740) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 18:07:39.118082 dv-cinder-852009-8-iscsi devstack@n-api.service[120740]: DEBUG nova.compute.api [None req-896bebc1-c999-4819-aa7c-11c91ce282ba tempest-TestMinimumBasicScenario-820002800 tempest-TestMinimumBasicScenario-820002800-project] [instance: f8247a13-94cd-45b2-acc8-8717e1260f37] Going to try to terminate instance {{(pid=120740) delete /opt/stack/nova/nova/compute/api.py:2719}} Sep 13 18:07:39.164836 dv-cinder-852009-8-iscsi devstack@n-api.service[120741]: INFO nova.api.openstack.requestlog [None req-20499a40-33ac-40de-b358-d18adbc4ef17 tempest-AttachVolumeTestJSON-555093534 tempest-AttachVolumeTestJSON-555093534-project] 10.222.0.43 "DELETE /compute/v2.1/servers/d0983ec1-bb82-4a7d-9dba-ace1e3eb383a/os-volume_attachments/e0d075e8-2581-47b4-9063-a1a6d51a268c" status: 202 len: 0 microversion: 2.1 time: 0.181985 Sep 13 18:07:39.168800 dv-cinder-852009-8-iscsi devstack@n-api.service[120741]: [pid: 120741|app: 0|req: 323/655] 10.222.0.43 () {58 vars in 1416 bytes} [Tue Sep 13 18:07:38 2022] DELETE /compute/v2.1/servers/d0983ec1-bb82-4a7d-9dba-ace1e3eb383a/os-volume_attachments/e0d075e8-2581-47b4-9063-a1a6d51a268c => generated 0 bytes in 183 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Sep 13 18:07:39.168951 dv-cinder-852009-8-iscsi devstack@n-api.service[120740]: DEBUG dbcounter [-] [120740] Writing DB stats nova_cell1:SELECT=96,nova_cell1:UPDATE=2,nova_cell1:INSERT=2 {{(pid=120740) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 18:07:39.216079 dv-cinder-852009-8-iscsi devstack@n-api.service[120740]: INFO nova.api.openstack.requestlog [None req-896bebc1-c999-4819-aa7c-11c91ce282ba tempest-TestMinimumBasicScenario-820002800 tempest-TestMinimumBasicScenario-820002800-project] 10.222.0.43 "DELETE /compute/v2.1/servers/f8247a13-94cd-45b2-acc8-8717e1260f37" status: 204 len: 0 microversion: 2.1 time: 0.138884 Sep 13 18:07:39.216964 dv-cinder-852009-8-iscsi devstack@n-api.service[120740]: [pid: 120740|app: 0|req: 333/656] 10.222.0.43 () {58 vars in 1239 bytes} [Tue Sep 13 18:07:39 2022] DELETE /compute/v2.1/servers/f8247a13-94cd-45b2-acc8-8717e1260f37 => generated 0 bytes in 141 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Sep 13 18:07:39.225782 dv-cinder-852009-8-iscsi devstack@n-api.service[120741]: DEBUG nova.api.openstack.wsgi [None req-7134711c-3aa8-4b6b-b633-ce51f6be4b8b tempest-TestMinimumBasicScenario-820002800 tempest-TestMinimumBasicScenario-820002800-project] Calling method '>' {{(pid=120741) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 18:07:39.226475 dv-cinder-852009-8-iscsi devstack@n-api.service[120741]: DEBUG nova.compute.api [None req-7134711c-3aa8-4b6b-b633-ce51f6be4b8b tempest-TestMinimumBasicScenario-820002800 tempest-TestMinimumBasicScenario-820002800-project] [instance: f8247a13-94cd-45b2-acc8-8717e1260f37] Fetching instance by UUID {{(pid=120741) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 18:07:39.234458 dv-cinder-852009-8-iscsi devstack@n-api.service[120741]: DEBUG oslo_concurrency.lockutils [None req-7134711c-3aa8-4b6b-b633-ce51f6be4b8b tempest-TestMinimumBasicScenario-820002800 tempest-TestMinimumBasicScenario-820002800-project] Acquiring lock "1daf4f4c-0e4a-4779-b53a-78c48397ea2f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120741) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 18:07:39.235438 dv-cinder-852009-8-iscsi devstack@n-api.service[120741]: DEBUG oslo_concurrency.lockutils [None req-7134711c-3aa8-4b6b-b633-ce51f6be4b8b tempest-TestMinimumBasicScenario-820002800 tempest-TestMinimumBasicScenario-820002800-project] Lock "1daf4f4c-0e4a-4779-b53a-78c48397ea2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120741) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 18:07:39.235950 dv-cinder-852009-8-iscsi devstack@n-api.service[120741]: DEBUG oslo_concurrency.lockutils [None req-7134711c-3aa8-4b6b-b633-ce51f6be4b8b tempest-TestMinimumBasicScenario-820002800 tempest-TestMinimumBasicScenario-820002800-project] Lock "1daf4f4c-0e4a-4779-b53a-78c48397ea2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120741) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 18:07:39.236910 dv-cinder-852009-8-iscsi devstack@n-api.service[120741]: DEBUG oslo_concurrency.lockutils [None req-7134711c-3aa8-4b6b-b633-ce51f6be4b8b tempest-TestMinimumBasicScenario-820002800 tempest-TestMinimumBasicScenario-820002800-project] Acquiring lock "1daf4f4c-0e4a-4779-b53a-78c48397ea2f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120741) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 18:07:39.237601 dv-cinder-852009-8-iscsi devstack@n-api.service[120741]: DEBUG oslo_concurrency.lockutils [None req-7134711c-3aa8-4b6b-b633-ce51f6be4b8b tempest-TestMinimumBasicScenario-820002800 tempest-TestMinimumBasicScenario-820002800-project] Lock "1daf4f4c-0e4a-4779-b53a-78c48397ea2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120741) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 18:07:39.237998 dv-cinder-852009-8-iscsi devstack@n-api.service[120741]: DEBUG oslo_concurrency.lockutils [None req-7134711c-3aa8-4b6b-b633-ce51f6be4b8b tempest-TestMinimumBasicScenario-820002800 tempest-TestMinimumBasicScenario-820002800-project] Lock "1daf4f4c-0e4a-4779-b53a-78c48397ea2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120741) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 18:07:39.367306 dv-cinder-852009-8-iscsi devstack@n-api.service[120741]: DEBUG nova.policy [None req-7134711c-3aa8-4b6b-b633-ce51f6be4b8b tempest-TestMinimumBasicScenario-820002800 tempest-TestMinimumBasicScenario-820002800-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7880064ff0aa448d9c367c89eba145ff', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2f6832936c824066a4370cc45c5b0282', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120741) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 18:07:39.375364 dv-cinder-852009-8-iscsi devstack@n-api.service[120741]: INFO nova.api.openstack.requestlog [None req-7134711c-3aa8-4b6b-b633-ce51f6be4b8b tempest-TestMinimumBasicScenario-820002800 tempest-TestMinimumBasicScenario-820002800-project] 10.222.0.43 "GET /compute/v2.1/servers/f8247a13-94cd-45b2-acc8-8717e1260f37" status: 200 len: 1555 microversion: 2.1 time: 0.153731 Sep 13 18:07:39.375972 dv-cinder-852009-8-iscsi devstack@n-api.service[120741]: [pid: 120741|app: 0|req: 324/657] 10.222.0.43 () {58 vars in 1236 bytes} [Tue Sep 13 18:07:39 2022] GET /compute/v2.1/servers/f8247a13-94cd-45b2-acc8-8717e1260f37 => generated 1555 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 13 18:07:39.777570 dv-cinder-852009-8-iscsi devstack@n-api.service[120740]: DEBUG nova.api.openstack.wsgi [req-2518b9cf-3beb-4aa1-8c3d-ae809362c6c5 req-bd661809-cf92-475d-94b4-acd1ea6dd885 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "8cecf08e-bea8-4cef-9439-0eaa242bfed1", "name": "network-vif-plugged", "status": "completed", "tag": "cf75920d-98e9-4700-bdad-ac46b7b3f022"}]} {{(pid=120740) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 13 18:07:39.786872 dv-cinder-852009-8-iscsi devstack@n-api.service[120740]: DEBUG oslo_concurrency.lockutils [req-2518b9cf-3beb-4aa1-8c3d-ae809362c6c5 req-bd661809-cf92-475d-94b4-acd1ea6dd885 service nova] Acquiring lock "1daf4f4c-0e4a-4779-b53a-78c48397ea2f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120740) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 18:07:39.787337 dv-cinder-852009-8-iscsi devstack@n-api.service[120740]: DEBUG oslo_concurrency.lockutils [req-2518b9cf-3beb-4aa1-8c3d-ae809362c6c5 req-bd661809-cf92-475d-94b4-acd1ea6dd885 service nova] Lock "1daf4f4c-0e4a-4779-b53a-78c48397ea2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120740) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 18:07:39.787809 dv-cinder-852009-8-iscsi devstack@n-api.service[120740]: DEBUG oslo_concurrency.lockutils [req-2518b9cf-3beb-4aa1-8c3d-ae809362c6c5 req-bd661809-cf92-475d-94b4-acd1ea6dd885 service nova] Lock "1daf4f4c-0e4a-4779-b53a-78c48397ea2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120740) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 18:07:39.798654 dv-cinder-852009-8-iscsi devstack@n-api.service[120740]: INFO nova.api.openstack.compute.server_external_events [req-2518b9cf-3beb-4aa1-8c3d-ae809362c6c5 req-bd661809-cf92-475d-94b4-acd1ea6dd885 service nova] Creating event network-vif-plugged:cf75920d-98e9-4700-bdad-ac46b7b3f022 for instance 8cecf08e-bea8-4cef-9439-0eaa242bfed1 on hv-cinder-85200 Sep 13 18:07:39.803487 dv-cinder-852009-8-iscsi devstack@n-api.service[120740]: INFO nova.api.openstack.requestlog [req-2518b9cf-3beb-4aa1-8c3d-ae809362c6c5 req-bd661809-cf92-475d-94b4-acd1ea6dd885 service nova] 10.222.0.43 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.168686 Sep 13 18:07:39.804059 dv-cinder-852009-8-iscsi devstack@n-api.service[120740]: [pid: 120740|app: 0|req: 334/658] 10.222.0.43 () {64 vars in 1317 bytes} [Tue Sep 13 18:07:39 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 170 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 13 18:07:39.890014 dv-cinder-852009-8-iscsi devstack@n-api.service[120741]: DEBUG nova.api.openstack.wsgi [None req-39178ca8-3298-4260-96e7-3042b426bd78 tempest-AttachVolumeShelveTestJSON-385853788 tempest-AttachVolumeShelveTestJSON-385853788-project] Calling method '>' {{(pid=120741) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 18:07:39.890842 dv-cinder-852009-8-iscsi devstack@n-api.service[120741]: DEBUG nova.compute.api [None req-39178ca8-3298-4260-96e7-3042b426bd78 tempest-AttachVolumeShelveTestJSON-385853788 tempest-AttachVolumeShelveTestJSON-385853788-project] [instance: 8cecf08e-bea8-4cef-9439-0eaa242bfed1] Fetching instance by UUID {{(pid=120741) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 18:07:39.900914 dv-cinder-852009-8-iscsi devstack@n-api.service[120741]: DEBUG oslo_concurrency.lockutils [None req-39178ca8-3298-4260-96e7-3042b426bd78 tempest-AttachVolumeShelveTestJSON-385853788 tempest-AttachVolumeShelveTestJSON-385853788-project] Acquiring lock "1daf4f4c-0e4a-4779-b53a-78c48397ea2f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120741) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 18:07:39.901640 dv-cinder-852009-8-iscsi devstack@n-api.service[120741]: DEBUG oslo_concurrency.lockutils [None req-39178ca8-3298-4260-96e7-3042b426bd78 tempest-AttachVolumeShelveTestJSON-385853788 tempest-AttachVolumeShelveTestJSON-385853788-project] Lock "1daf4f4c-0e4a-4779-b53a-78c48397ea2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120741) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 18:07:39.902073 dv-cinder-852009-8-iscsi devstack@n-api.service[120741]: DEBUG oslo_concurrency.lockutils [None req-39178ca8-3298-4260-96e7-3042b426bd78 tempest-AttachVolumeShelveTestJSON-385853788 tempest-AttachVolumeShelveTestJSON-385853788-project] Lock "1daf4f4c-0e4a-4779-b53a-78c48397ea2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120741) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 18:07:39.902768 dv-cinder-852009-8-iscsi devstack@n-api.service[120741]: DEBUG oslo_concurrency.lockutils [None req-39178ca8-3298-4260-96e7-3042b426bd78 tempest-AttachVolumeShelveTestJSON-385853788 tempest-AttachVolumeShelveTestJSON-385853788-project] Acquiring lock "1daf4f4c-0e4a-4779-b53a-78c48397ea2f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120741) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 18:07:39.903221 dv-cinder-852009-8-iscsi devstack@n-api.service[120741]: DEBUG oslo_concurrency.lockutils [None req-39178ca8-3298-4260-96e7-3042b426bd78 tempest-AttachVolumeShelveTestJSON-385853788 tempest-AttachVolumeShelveTestJSON-385853788-project] Lock "1daf4f4c-0e4a-4779-b53a-78c48397ea2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120741) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 18:07:39.903641 dv-cinder-852009-8-iscsi devstack@n-api.service[120741]: DEBUG oslo_concurrency.lockutils [None req-39178ca8-3298-4260-96e7-3042b426bd78 tempest-AttachVolumeShelveTestJSON-385853788 tempest-AttachVolumeShelveTestJSON-385853788-project] Lock "1daf4f4c-0e4a-4779-b53a-78c48397ea2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120741) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 18:07:40.048927 dv-cinder-852009-8-iscsi devstack@n-api.service[120741]: DEBUG nova.policy [None req-39178ca8-3298-4260-96e7-3042b426bd78 tempest-AttachVolumeShelveTestJSON-385853788 tempest-AttachVolumeShelveTestJSON-385853788-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e68ecd9b3ca643539b109f75bb242d6f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '75e14fd88bfb4cd896fa7b070a0fac47', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120741) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 18:07:40.058233 dv-cinder-852009-8-iscsi devstack@n-api.service[120741]: DEBUG nova.policy [None req-39178ca8-3298-4260-96e7-3042b426bd78 tempest-AttachVolumeShelveTestJSON-385853788 tempest-AttachVolumeShelveTestJSON-385853788-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'e68ecd9b3ca643539b109f75bb242d6f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '75e14fd88bfb4cd896fa7b070a0fac47', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120741) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 18:07:40.059663 dv-cinder-852009-8-iscsi devstack@n-api.service[120741]: DEBUG nova.policy [None req-39178ca8-3298-4260-96e7-3042b426bd78 tempest-AttachVolumeShelveTestJSON-385853788 tempest-AttachVolumeShelveTestJSON-385853788-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'e68ecd9b3ca643539b109f75bb242d6f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '75e14fd88bfb4cd896fa7b070a0fac47', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120741) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 18:07:40.061341 dv-cinder-852009-8-iscsi devstack@n-api.service[120741]: INFO nova.api.openstack.requestlog [None req-39178ca8-3298-4260-96e7-3042b426bd78 tempest-AttachVolumeShelveTestJSON-385853788 tempest-AttachVolumeShelveTestJSON-385853788-project] 10.222.0.43 "GET /compute/v2.1/servers/8cecf08e-bea8-4cef-9439-0eaa242bfed1" status: 200 len: 1729 microversion: 2.20 time: 0.177231 Sep 13 18:07:40.061931 dv-cinder-852009-8-iscsi devstack@n-api.service[120741]: [pid: 120741|app: 0|req: 325/659] 10.222.0.43 () {60 vars in 1277 bytes} [Tue Sep 13 18:07:39 2022] GET /compute/v2.1/servers/8cecf08e-bea8-4cef-9439-0eaa242bfed1 => generated 1729 bytes in 179 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 13 18:07:40.404031 dv-cinder-852009-8-iscsi devstack@n-api.service[120740]: DEBUG nova.api.openstack.wsgi [None req-4b6c0e03-f63c-4557-a1de-64973fc8e500 tempest-TestMinimumBasicScenario-820002800 tempest-TestMinimumBasicScenario-820002800-project] Calling method '>' {{(pid=120740) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 18:07:40.404745 dv-cinder-852009-8-iscsi devstack@n-api.service[120740]: DEBUG nova.compute.api [None req-4b6c0e03-f63c-4557-a1de-64973fc8e500 tempest-TestMinimumBasicScenario-820002800 tempest-TestMinimumBasicScenario-820002800-project] [instance: f8247a13-94cd-45b2-acc8-8717e1260f37] Fetching instance by UUID {{(pid=120740) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 18:07:40.411058 dv-cinder-852009-8-iscsi devstack@n-api.service[120740]: DEBUG oslo_concurrency.lockutils [None req-4b6c0e03-f63c-4557-a1de-64973fc8e500 tempest-TestMinimumBasicScenario-820002800 tempest-TestMinimumBasicScenario-820002800-project] Acquiring lock "1daf4f4c-0e4a-4779-b53a-78c48397ea2f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120740) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 18:07:40.411553 dv-cinder-852009-8-iscsi devstack@n-api.service[120740]: DEBUG oslo_concurrency.lockutils [None req-4b6c0e03-f63c-4557-a1de-64973fc8e500 tempest-TestMinimumBasicScenario-820002800 tempest-TestMinimumBasicScenario-820002800-project] Lock "1daf4f4c-0e4a-4779-b53a-78c48397ea2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120740) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 18:07:40.411996 dv-cinder-852009-8-iscsi devstack@n-api.service[120740]: DEBUG oslo_concurrency.lockutils [None req-4b6c0e03-f63c-4557-a1de-64973fc8e500 tempest-TestMinimumBasicScenario-820002800 tempest-TestMinimumBasicScenario-820002800-project] Lock "1daf4f4c-0e4a-4779-b53a-78c48397ea2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120740) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 18:07:40.412725 dv-cinder-852009-8-iscsi devstack@n-api.service[120740]: DEBUG oslo_concurrency.lockutils [None req-4b6c0e03-f63c-4557-a1de-64973fc8e500 tempest-TestMinimumBasicScenario-820002800 tempest-TestMinimumBasicScenario-820002800-project] Acquiring lock "1daf4f4c-0e4a-4779-b53a-78c48397ea2f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120740) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 18:07:40.413169 dv-cinder-852009-8-iscsi devstack@n-api.service[120740]: DEBUG oslo_concurrency.lockutils [None req-4b6c0e03-f63c-4557-a1de-64973fc8e500 tempest-TestMinimumBasicScenario-820002800 tempest-TestMinimumBasicScenario-820002800-project] Lock "1daf4f4c-0e4a-4779-b53a-78c48397ea2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120740) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 18:07:40.413596 dv-cinder-852009-8-iscsi devstack@n-api.service[120740]: DEBUG oslo_concurrency.lockutils [None req-4b6c0e03-f63c-4557-a1de-64973fc8e500 tempest-TestMinimumBasicScenario-820002800 tempest-TestMinimumBasicScenario-820002800-project] Lock "1daf4f4c-0e4a-4779-b53a-78c48397ea2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120740) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 18:07:40.545349 dv-cinder-852009-8-iscsi devstack@n-api.service[120740]: DEBUG nova.policy [None req-4b6c0e03-f63c-4557-a1de-64973fc8e500 tempest-TestMinimumBasicScenario-820002800 tempest-TestMinimumBasicScenario-820002800-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7880064ff0aa448d9c367c89eba145ff', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2f6832936c824066a4370cc45c5b0282', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120740) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 18:07:40.553350 dv-cinder-852009-8-iscsi devstack@n-api.service[120740]: INFO nova.api.openstack.requestlog [None req-4b6c0e03-f63c-4557-a1de-64973fc8e500 tempest-TestMinimumBasicScenario-820002800 tempest-TestMinimumBasicScenario-820002800-project] 10.222.0.43 "GET /compute/v2.1/servers/f8247a13-94cd-45b2-acc8-8717e1260f37" status: 200 len: 1555 microversion: 2.1 time: 0.155665 Sep 13 18:07:40.553852 dv-cinder-852009-8-iscsi devstack@n-api.service[120740]: [pid: 120740|app: 0|req: 335/660] 10.222.0.43 () {58 vars in 1236 bytes} [Tue Sep 13 18:07:40 2022] GET /compute/v2.1/servers/f8247a13-94cd-45b2-acc8-8717e1260f37 => generated 1555 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 13 18:07:41.091962 dv-cinder-852009-8-iscsi devstack@n-api.service[120741]: DEBUG nova.api.openstack.wsgi [None req-b47554de-7a3c-4227-bd20-37b246f16a94 tempest-AttachVolumeShelveTestJSON-385853788 tempest-AttachVolumeShelveTestJSON-385853788-project] Calling method '>' {{(pid=120741) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 18:07:41.092575 dv-cinder-852009-8-iscsi devstack@n-api.service[120741]: DEBUG nova.compute.api [None req-b47554de-7a3c-4227-bd20-37b246f16a94 tempest-AttachVolumeShelveTestJSON-385853788 tempest-AttachVolumeShelveTestJSON-385853788-project] [instance: 8cecf08e-bea8-4cef-9439-0eaa242bfed1] Fetching instance by UUID {{(pid=120741) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 18:07:41.099035 dv-cinder-852009-8-iscsi devstack@n-api.service[120741]: DEBUG oslo_concurrency.lockutils [None req-b47554de-7a3c-4227-bd20-37b246f16a94 tempest-AttachVolumeShelveTestJSON-385853788 tempest-AttachVolumeShelveTestJSON-385853788-project] Acquiring lock "1daf4f4c-0e4a-4779-b53a-78c48397ea2f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120741) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 18:07:41.100069 dv-cinder-852009-8-iscsi devstack@n-api.service[120741]: DEBUG oslo_concurrency.lockutils [None req-b47554de-7a3c-4227-bd20-37b246f16a94 tempest-AttachVolumeShelveTestJSON-385853788 tempest-AttachVolumeShelveTestJSON-385853788-project] Lock "1daf4f4c-0e4a-4779-b53a-78c48397ea2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120741) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 18:07:41.100536 dv-cinder-852009-8-iscsi devstack@n-api.service[120741]: DEBUG oslo_concurrency.lockutils [None req-b47554de-7a3c-4227-bd20-37b246f16a94 tempest-AttachVolumeShelveTestJSON-385853788 tempest-AttachVolumeShelveTestJSON-385853788-project] Lock "1daf4f4c-0e4a-4779-b53a-78c48397ea2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120741) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 18:07:41.101435 dv-cinder-852009-8-iscsi devstack@n-api.service[120741]: DEBUG oslo_concurrency.lockutils [None req-b47554de-7a3c-4227-bd20-37b246f16a94 tempest-AttachVolumeShelveTestJSON-385853788 tempest-AttachVolumeShelveTestJSON-385853788-project] Acquiring lock "1daf4f4c-0e4a-4779-b53a-78c48397ea2f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120741) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 18:07:41.101912 dv-cinder-852009-8-iscsi devstack@n-api.service[120741]: DEBUG oslo_concurrency.lockutils [None req-b47554de-7a3c-4227-bd20-37b246f16a94 tempest-AttachVolumeShelveTestJSON-385853788 tempest-AttachVolumeShelveTestJSON-385853788-project] Lock "1daf4f4c-0e4a-4779-b53a-78c48397ea2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120741) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 18:07:41.102306 dv-cinder-852009-8-iscsi devstack@n-api.service[120741]: DEBUG oslo_concurrency.lockutils [None req-b47554de-7a3c-4227-bd20-37b246f16a94 tempest-AttachVolumeShelveTestJSON-385853788 tempest-AttachVolumeShelveTestJSON-385853788-project] Lock "1daf4f4c-0e4a-4779-b53a-78c48397ea2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120741) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 18:07:41.243944 dv-cinder-852009-8-iscsi devstack@n-api.service[120741]: DEBUG nova.policy [None req-b47554de-7a3c-4227-bd20-37b246f16a94 tempest-AttachVolumeShelveTestJSON-385853788 tempest-AttachVolumeShelveTestJSON-385853788-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e68ecd9b3ca643539b109f75bb242d6f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '75e14fd88bfb4cd896fa7b070a0fac47', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120741) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 18:07:41.258585 dv-cinder-852009-8-iscsi devstack@n-api.service[120741]: DEBUG nova.policy [None req-b47554de-7a3c-4227-bd20-37b246f16a94 tempest-AttachVolumeShelveTestJSON-385853788 tempest-AttachVolumeShelveTestJSON-385853788-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'e68ecd9b3ca643539b109f75bb242d6f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '75e14fd88bfb4cd896fa7b070a0fac47', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120741) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 18:07:41.260761 dv-cinder-852009-8-iscsi devstack@n-api.service[120741]: DEBUG nova.policy [None req-b47554de-7a3c-4227-bd20-37b246f16a94 tempest-AttachVolumeShelveTestJSON-385853788 tempest-AttachVolumeShelveTestJSON-385853788-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'e68ecd9b3ca643539b109f75bb242d6f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '75e14fd88bfb4cd896fa7b070a0fac47', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120741) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 18:07:41.262022 dv-cinder-852009-8-iscsi devstack@n-api.service[120741]: INFO nova.api.openstack.requestlog [None req-b47554de-7a3c-4227-bd20-37b246f16a94 tempest-AttachVolumeShelveTestJSON-385853788 tempest-AttachVolumeShelveTestJSON-385853788-project] 10.222.0.43 "GET /compute/v2.1/servers/8cecf08e-bea8-4cef-9439-0eaa242bfed1" status: 200 len: 1729 microversion: 2.20 time: 0.177212 Sep 13 18:07:41.262588 dv-cinder-852009-8-iscsi devstack@n-api.service[120741]: [pid: 120741|app: 0|req: 326/661] 10.222.0.43 () {60 vars in 1277 bytes} [Tue Sep 13 18:07:41 2022] GET /compute/v2.1/servers/8cecf08e-bea8-4cef-9439-0eaa242bfed1 => generated 1729 bytes in 179 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 13 18:07:41.577089 dv-cinder-852009-8-iscsi devstack@n-api.service[120740]: DEBUG nova.api.openstack.wsgi [None req-68b57072-d7fb-4ece-b95d-7b729a79c9f8 tempest-TestMinimumBasicScenario-820002800 tempest-TestMinimumBasicScenario-820002800-project] Calling method '>' {{(pid=120740) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 18:07:41.577702 dv-cinder-852009-8-iscsi devstack@n-api.service[120740]: DEBUG nova.compute.api [None req-68b57072-d7fb-4ece-b95d-7b729a79c9f8 tempest-TestMinimumBasicScenario-820002800 tempest-TestMinimumBasicScenario-820002800-project] [instance: f8247a13-94cd-45b2-acc8-8717e1260f37] Fetching instance by UUID {{(pid=120740) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 18:07:41.584277 dv-cinder-852009-8-iscsi devstack@n-api.service[120740]: DEBUG oslo_concurrency.lockutils [None req-68b57072-d7fb-4ece-b95d-7b729a79c9f8 tempest-TestMinimumBasicScenario-820002800 tempest-TestMinimumBasicScenario-820002800-project] Acquiring lock "1daf4f4c-0e4a-4779-b53a-78c48397ea2f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120740) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 18:07:41.584788 dv-cinder-852009-8-iscsi devstack@n-api.service[120740]: DEBUG oslo_concurrency.lockutils [None req-68b57072-d7fb-4ece-b95d-7b729a79c9f8 tempest-TestMinimumBasicScenario-820002800 tempest-TestMinimumBasicScenario-820002800-project] Lock "1daf4f4c-0e4a-4779-b53a-78c48397ea2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120740) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 18:07:41.585213 dv-cinder-852009-8-iscsi devstack@n-api.service[120740]: DEBUG oslo_concurrency.lockutils [None req-68b57072-d7fb-4ece-b95d-7b729a79c9f8 tempest-TestMinimumBasicScenario-820002800 tempest-TestMinimumBasicScenario-820002800-project] Lock "1daf4f4c-0e4a-4779-b53a-78c48397ea2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120740) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 18:07:41.585893 dv-cinder-852009-8-iscsi devstack@n-api.service[120740]: DEBUG oslo_concurrency.lockutils [None req-68b57072-d7fb-4ece-b95d-7b729a79c9f8 tempest-TestMinimumBasicScenario-820002800 tempest-TestMinimumBasicScenario-820002800-project] Acquiring lock "1daf4f4c-0e4a-4779-b53a-78c48397ea2f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120740) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 18:07:41.586520 dv-cinder-852009-8-iscsi devstack@n-api.service[120740]: DEBUG oslo_concurrency.lockutils [None req-68b57072-d7fb-4ece-b95d-7b729a79c9f8 tempest-TestMinimumBasicScenario-820002800 tempest-TestMinimumBasicScenario-820002800-project] Lock "1daf4f4c-0e4a-4779-b53a-78c48397ea2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120740) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 18:07:41.586934 dv-cinder-852009-8-iscsi devstack@n-api.service[120740]: DEBUG oslo_concurrency.lockutils [None req-68b57072-d7fb-4ece-b95d-7b729a79c9f8 tempest-TestMinimumBasicScenario-820002800 tempest-TestMinimumBasicScenario-820002800-project] Lock "1daf4f4c-0e4a-4779-b53a-78c48397ea2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120740) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 18:07:41.722343 dv-cinder-852009-8-iscsi devstack@n-api.service[120740]: DEBUG nova.policy [None req-68b57072-d7fb-4ece-b95d-7b729a79c9f8 tempest-TestMinimumBasicScenario-820002800 tempest-TestMinimumBasicScenario-820002800-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7880064ff0aa448d9c367c89eba145ff', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2f6832936c824066a4370cc45c5b0282', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120740) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 18:07:41.730887 dv-cinder-852009-8-iscsi devstack@n-api.service[120740]: INFO nova.api.openstack.requestlog [None req-68b57072-d7fb-4ece-b95d-7b729a79c9f8 tempest-TestMinimumBasicScenario-820002800 tempest-TestMinimumBasicScenario-820002800-project] 10.222.0.43 "GET /compute/v2.1/servers/f8247a13-94cd-45b2-acc8-8717e1260f37" status: 200 len: 1555 microversion: 2.1 time: 0.157878 Sep 13 18:07:41.731473 dv-cinder-852009-8-iscsi devstack@n-api.service[120740]: [pid: 120740|app: 0|req: 336/662] 10.222.0.43 () {58 vars in 1236 bytes} [Tue Sep 13 18:07:41 2022] GET /compute/v2.1/servers/f8247a13-94cd-45b2-acc8-8717e1260f37 => generated 1555 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 13 18:07:41.834711 dv-cinder-852009-8-iscsi devstack@n-api.service[120741]: DEBUG nova.api.openstack.wsgi [req-149c5814-6257-4fc9-a808-eb1522cc0c4e req-b5eb563b-f48f-4c99-a7dc-7aff42fdd78e service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "f8247a13-94cd-45b2-acc8-8717e1260f37", "name": "network-vif-deleted", "tag": "9f86cf72-e29e-4f23-8c9d-afea192c2916"}]} {{(pid=120741) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 13 18:07:41.844409 dv-cinder-852009-8-iscsi devstack@n-api.service[120741]: DEBUG oslo_concurrency.lockutils [req-149c5814-6257-4fc9-a808-eb1522cc0c4e req-b5eb563b-f48f-4c99-a7dc-7aff42fdd78e service nova] Acquiring lock "1daf4f4c-0e4a-4779-b53a-78c48397ea2f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120741) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 18:07:41.844912 dv-cinder-852009-8-iscsi devstack@n-api.service[120741]: DEBUG oslo_concurrency.lockutils [req-149c5814-6257-4fc9-a808-eb1522cc0c4e req-b5eb563b-f48f-4c99-a7dc-7aff42fdd78e service nova] Lock "1daf4f4c-0e4a-4779-b53a-78c48397ea2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120741) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 18:07:41.845314 dv-cinder-852009-8-iscsi devstack@n-api.service[120741]: DEBUG oslo_concurrency.lockutils [req-149c5814-6257-4fc9-a808-eb1522cc0c4e req-b5eb563b-f48f-4c99-a7dc-7aff42fdd78e service nova] Lock "1daf4f4c-0e4a-4779-b53a-78c48397ea2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120741) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 18:07:41.856788 dv-cinder-852009-8-iscsi devstack@n-api.service[120741]: INFO nova.api.openstack.compute.server_external_events [req-149c5814-6257-4fc9-a808-eb1522cc0c4e req-b5eb563b-f48f-4c99-a7dc-7aff42fdd78e service nova] Creating event network-vif-deleted:9f86cf72-e29e-4f23-8c9d-afea192c2916 for instance f8247a13-94cd-45b2-acc8-8717e1260f37 on hv-cinder-85200 Sep 13 18:07:41.861837 dv-cinder-852009-8-iscsi devstack@n-api.service[120741]: INFO nova.api.openstack.requestlog [req-149c5814-6257-4fc9-a808-eb1522cc0c4e req-b5eb563b-f48f-4c99-a7dc-7aff42fdd78e service nova] 10.222.0.43 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.085648 Sep 13 18:07:41.862413 dv-cinder-852009-8-iscsi devstack@n-api.service[120741]: [pid: 120741|app: 0|req: 327/663] 10.222.0.43 () {64 vars in 1317 bytes} [Tue Sep 13 18:07:41 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 87 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 13 18:07:42.288642 dv-cinder-852009-8-iscsi devstack@n-api.service[120740]: DEBUG nova.api.openstack.wsgi [None req-33ee8d9a-284f-44e4-bbf1-a08c41cb7529 tempest-AttachVolumeShelveTestJSON-385853788 tempest-AttachVolumeShelveTestJSON-385853788-project] Calling method '>' {{(pid=120740) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 18:07:42.289240 dv-cinder-852009-8-iscsi devstack@n-api.service[120740]: DEBUG nova.compute.api [None req-33ee8d9a-284f-44e4-bbf1-a08c41cb7529 tempest-AttachVolumeShelveTestJSON-385853788 tempest-AttachVolumeShelveTestJSON-385853788-project] [instance: 8cecf08e-bea8-4cef-9439-0eaa242bfed1] Fetching instance by UUID {{(pid=120740) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 18:07:42.295695 dv-cinder-852009-8-iscsi devstack@n-api.service[120740]: DEBUG oslo_concurrency.lockutils [None req-33ee8d9a-284f-44e4-bbf1-a08c41cb7529 tempest-AttachVolumeShelveTestJSON-385853788 tempest-AttachVolumeShelveTestJSON-385853788-project] Acquiring lock "1daf4f4c-0e4a-4779-b53a-78c48397ea2f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120740) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 18:07:42.296181 dv-cinder-852009-8-iscsi devstack@n-api.service[120740]: DEBUG oslo_concurrency.lockutils [None req-33ee8d9a-284f-44e4-bbf1-a08c41cb7529 tempest-AttachVolumeShelveTestJSON-385853788 tempest-AttachVolumeShelveTestJSON-385853788-project] Lock "1daf4f4c-0e4a-4779-b53a-78c48397ea2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120740) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 18:07:42.296662 dv-cinder-852009-8-iscsi devstack@n-api.service[120740]: DEBUG oslo_concurrency.lockutils [None req-33ee8d9a-284f-44e4-bbf1-a08c41cb7529 tempest-AttachVolumeShelveTestJSON-385853788 tempest-AttachVolumeShelveTestJSON-385853788-project] Lock "1daf4f4c-0e4a-4779-b53a-78c48397ea2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120740) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 18:07:42.297360 dv-cinder-852009-8-iscsi devstack@n-api.service[120740]: DEBUG oslo_concurrency.lockutils [None req-33ee8d9a-284f-44e4-bbf1-a08c41cb7529 tempest-AttachVolumeShelveTestJSON-385853788 tempest-AttachVolumeShelveTestJSON-385853788-project] Acquiring lock "1daf4f4c-0e4a-4779-b53a-78c48397ea2f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120740) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 18:07:42.297805 dv-cinder-852009-8-iscsi devstack@n-api.service[120740]: DEBUG oslo_concurrency.lockutils [None req-33ee8d9a-284f-44e4-bbf1-a08c41cb7529 tempest-AttachVolumeShelveTestJSON-385853788 tempest-AttachVolumeShelveTestJSON-385853788-project] Lock "1daf4f4c-0e4a-4779-b53a-78c48397ea2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120740) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 18:07:42.298223 dv-cinder-852009-8-iscsi devstack@n-api.service[120740]: DEBUG oslo_concurrency.lockutils [None req-33ee8d9a-284f-44e4-bbf1-a08c41cb7529 tempest-AttachVolumeShelveTestJSON-385853788 tempest-AttachVolumeShelveTestJSON-385853788-project] Lock "1daf4f4c-0e4a-4779-b53a-78c48397ea2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120740) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 18:07:42.429681 dv-cinder-852009-8-iscsi devstack@n-api.service[120740]: DEBUG nova.policy [None req-33ee8d9a-284f-44e4-bbf1-a08c41cb7529 tempest-AttachVolumeShelveTestJSON-385853788 tempest-AttachVolumeShelveTestJSON-385853788-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e68ecd9b3ca643539b109f75bb242d6f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '75e14fd88bfb4cd896fa7b070a0fac47', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120740) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 18:07:42.438704 dv-cinder-852009-8-iscsi devstack@n-api.service[120740]: DEBUG nova.policy [None req-33ee8d9a-284f-44e4-bbf1-a08c41cb7529 tempest-AttachVolumeShelveTestJSON-385853788 tempest-AttachVolumeShelveTestJSON-385853788-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'e68ecd9b3ca643539b109f75bb242d6f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '75e14fd88bfb4cd896fa7b070a0fac47', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120740) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 18:07:42.440487 dv-cinder-852009-8-iscsi devstack@n-api.service[120740]: DEBUG nova.policy [None req-33ee8d9a-284f-44e4-bbf1-a08c41cb7529 tempest-AttachVolumeShelveTestJSON-385853788 tempest-AttachVolumeShelveTestJSON-385853788-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'e68ecd9b3ca643539b109f75bb242d6f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '75e14fd88bfb4cd896fa7b070a0fac47', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120740) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 18:07:42.442021 dv-cinder-852009-8-iscsi devstack@n-api.service[120740]: INFO nova.api.openstack.requestlog [None req-33ee8d9a-284f-44e4-bbf1-a08c41cb7529 tempest-AttachVolumeShelveTestJSON-385853788 tempest-AttachVolumeShelveTestJSON-385853788-project] 10.222.0.43 "GET /compute/v2.1/servers/8cecf08e-bea8-4cef-9439-0eaa242bfed1" status: 200 len: 1729 microversion: 2.20 time: 0.157402 Sep 13 18:07:42.442578 dv-cinder-852009-8-iscsi devstack@n-api.service[120740]: [pid: 120740|app: 0|req: 337/664] 10.222.0.43 () {60 vars in 1277 bytes} [Tue Sep 13 18:07:42 2022] GET /compute/v2.1/servers/8cecf08e-bea8-4cef-9439-0eaa242bfed1 => generated 1729 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 13 18:07:42.548304 dv-cinder-852009-8-iscsi devstack@n-api.service[120741]: DEBUG nova.api.openstack.wsgi [None req-f7e0bf41-a96f-4a3c-b438-a6b1defad659 tempest-AttachVolumeTestJSON-555093534 tempest-AttachVolumeTestJSON-555093534-project] Calling method '>' {{(pid=120741) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 18:07:42.550597 dv-cinder-852009-8-iscsi devstack@n-api.service[120741]: DEBUG nova.compute.api [None req-f7e0bf41-a96f-4a3c-b438-a6b1defad659 tempest-AttachVolumeTestJSON-555093534 tempest-AttachVolumeTestJSON-555093534-project] [instance: d0983ec1-bb82-4a7d-9dba-ace1e3eb383a] Fetching instance by UUID {{(pid=120741) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 18:07:42.556949 dv-cinder-852009-8-iscsi devstack@n-api.service[120741]: DEBUG oslo_concurrency.lockutils [None req-f7e0bf41-a96f-4a3c-b438-a6b1defad659 tempest-AttachVolumeTestJSON-555093534 tempest-AttachVolumeTestJSON-555093534-project] Acquiring lock "1daf4f4c-0e4a-4779-b53a-78c48397ea2f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120741) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 18:07:42.557434 dv-cinder-852009-8-iscsi devstack@n-api.service[120741]: DEBUG oslo_concurrency.lockutils [None req-f7e0bf41-a96f-4a3c-b438-a6b1defad659 tempest-AttachVolumeTestJSON-555093534 tempest-AttachVolumeTestJSON-555093534-project] Lock "1daf4f4c-0e4a-4779-b53a-78c48397ea2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120741) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 18:07:42.557875 dv-cinder-852009-8-iscsi devstack@n-api.service[120741]: DEBUG oslo_concurrency.lockutils [None req-f7e0bf41-a96f-4a3c-b438-a6b1defad659 tempest-AttachVolumeTestJSON-555093534 tempest-AttachVolumeTestJSON-555093534-project] Lock "1daf4f4c-0e4a-4779-b53a-78c48397ea2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120741) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 18:07:42.558611 dv-cinder-852009-8-iscsi devstack@n-api.service[120741]: DEBUG oslo_concurrency.lockutils [None req-f7e0bf41-a96f-4a3c-b438-a6b1defad659 tempest-AttachVolumeTestJSON-555093534 tempest-AttachVolumeTestJSON-555093534-project] Acquiring lock "1daf4f4c-0e4a-4779-b53a-78c48397ea2f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120741) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 18:07:42.559058 dv-cinder-852009-8-iscsi devstack@n-api.service[120741]: DEBUG oslo_concurrency.lockutils [None req-f7e0bf41-a96f-4a3c-b438-a6b1defad659 tempest-AttachVolumeTestJSON-555093534 tempest-AttachVolumeTestJSON-555093534-project] Lock "1daf4f4c-0e4a-4779-b53a-78c48397ea2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120741) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 18:07:42.559482 dv-cinder-852009-8-iscsi devstack@n-api.service[120741]: DEBUG oslo_concurrency.lockutils [None req-f7e0bf41-a96f-4a3c-b438-a6b1defad659 tempest-AttachVolumeTestJSON-555093534 tempest-AttachVolumeTestJSON-555093534-project] Lock "1daf4f4c-0e4a-4779-b53a-78c48397ea2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120741) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 18:07:42.561922 dv-cinder-852009-8-iscsi devstack@n-api.service[120741]: DEBUG dbcounter [-] [120741] Writing DB stats nova_cell1:SELECT=97,nova_cell1:INSERT=3 {{(pid=120741) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 18:07:42.597336 dv-cinder-852009-8-iscsi devstack@n-api.service[120741]: INFO nova.api.openstack.requestlog [None req-f7e0bf41-a96f-4a3c-b438-a6b1defad659 tempest-AttachVolumeTestJSON-555093534 tempest-AttachVolumeTestJSON-555093534-project] 10.222.0.43 "GET /compute/v2.1/servers/d0983ec1-bb82-4a7d-9dba-ace1e3eb383a/os-volume_attachments" status: 200 len: 25 microversion: 2.1 time: 0.053836 Sep 13 18:07:42.597901 dv-cinder-852009-8-iscsi devstack@n-api.service[120741]: [pid: 120741|app: 0|req: 328/665] 10.222.0.43 () {58 vars in 1302 bytes} [Tue Sep 13 18:07:42 2022] GET /compute/v2.1/servers/d0983ec1-bb82-4a7d-9dba-ace1e3eb383a/os-volume_attachments => generated 25 bytes in 55 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Sep 13 18:07:42.719493 dv-cinder-852009-8-iscsi devstack@n-api.service[120740]: DEBUG nova.api.openstack.wsgi [None req-58624899-e466-4e3b-9041-b645d1ee1d83 tempest-AttachVolumeTestJSON-555093534 tempest-AttachVolumeTestJSON-555093534-project] Calling method '>' {{(pid=120740) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 18:07:42.721844 dv-cinder-852009-8-iscsi devstack@n-api.service[120740]: DEBUG nova.compute.api [None req-58624899-e466-4e3b-9041-b645d1ee1d83 tempest-AttachVolumeTestJSON-555093534 tempest-AttachVolumeTestJSON-555093534-project] [instance: d0983ec1-bb82-4a7d-9dba-ace1e3eb383a] Fetching instance by UUID {{(pid=120740) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 18:07:42.728734 dv-cinder-852009-8-iscsi devstack@n-api.service[120740]: DEBUG oslo_concurrency.lockutils [None req-58624899-e466-4e3b-9041-b645d1ee1d83 tempest-AttachVolumeTestJSON-555093534 tempest-AttachVolumeTestJSON-555093534-project] Acquiring lock "1daf4f4c-0e4a-4779-b53a-78c48397ea2f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120740) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 18:07:42.729227 dv-cinder-852009-8-iscsi devstack@n-api.service[120740]: DEBUG oslo_concurrency.lockutils [None req-58624899-e466-4e3b-9041-b645d1ee1d83 tempest-AttachVolumeTestJSON-555093534 tempest-AttachVolumeTestJSON-555093534-project] Lock "1daf4f4c-0e4a-4779-b53a-78c48397ea2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120740) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 18:07:42.729651 dv-cinder-852009-8-iscsi devstack@n-api.service[120740]: DEBUG oslo_concurrency.lockutils [None req-58624899-e466-4e3b-9041-b645d1ee1d83 tempest-AttachVolumeTestJSON-555093534 tempest-AttachVolumeTestJSON-555093534-project] Lock "1daf4f4c-0e4a-4779-b53a-78c48397ea2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120740) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 18:07:42.730374 dv-cinder-852009-8-iscsi devstack@n-api.service[120740]: DEBUG oslo_concurrency.lockutils [None req-58624899-e466-4e3b-9041-b645d1ee1d83 tempest-AttachVolumeTestJSON-555093534 tempest-AttachVolumeTestJSON-555093534-project] Acquiring lock "1daf4f4c-0e4a-4779-b53a-78c48397ea2f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120740) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 18:07:42.730822 dv-cinder-852009-8-iscsi devstack@n-api.service[120740]: DEBUG oslo_concurrency.lockutils [None req-58624899-e466-4e3b-9041-b645d1ee1d83 tempest-AttachVolumeTestJSON-555093534 tempest-AttachVolumeTestJSON-555093534-project] Lock "1daf4f4c-0e4a-4779-b53a-78c48397ea2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120740) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 18:07:42.731239 dv-cinder-852009-8-iscsi devstack@n-api.service[120740]: DEBUG oslo_concurrency.lockutils [None req-58624899-e466-4e3b-9041-b645d1ee1d83 tempest-AttachVolumeTestJSON-555093534 tempest-AttachVolumeTestJSON-555093534-project] Lock "1daf4f4c-0e4a-4779-b53a-78c48397ea2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120740) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 18:07:42.757127 dv-cinder-852009-8-iscsi devstack@n-api.service[120741]: DEBUG nova.api.openstack.wsgi [None req-93512708-1cb5-4f01-872d-6e923f48ad7e tempest-TestMinimumBasicScenario-820002800 tempest-TestMinimumBasicScenario-820002800-project] Calling method '>' {{(pid=120741) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 18:07:42.757722 dv-cinder-852009-8-iscsi devstack@n-api.service[120741]: DEBUG nova.compute.api [None req-93512708-1cb5-4f01-872d-6e923f48ad7e tempest-TestMinimumBasicScenario-820002800 tempest-TestMinimumBasicScenario-820002800-project] [instance: f8247a13-94cd-45b2-acc8-8717e1260f37] Fetching instance by UUID {{(pid=120741) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 18:07:42.761897 dv-cinder-852009-8-iscsi devstack@n-api.service[120740]: INFO nova.api.openstack.requestlog [None req-58624899-e466-4e3b-9041-b645d1ee1d83 tempest-AttachVolumeTestJSON-555093534 tempest-AttachVolumeTestJSON-555093534-project] 10.222.0.43 "GET /compute/v2.1/servers/d0983ec1-bb82-4a7d-9dba-ace1e3eb383a/os-volume_attachments" status: 200 len: 25 microversion: 2.1 time: 0.046456 Sep 13 18:07:42.762500 dv-cinder-852009-8-iscsi devstack@n-api.service[120740]: [pid: 120740|app: 0|req: 338/666] 10.222.0.43 () {58 vars in 1302 bytes} [Tue Sep 13 18:07:42 2022] GET /compute/v2.1/servers/d0983ec1-bb82-4a7d-9dba-ace1e3eb383a/os-volume_attachments => generated 25 bytes in 48 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Sep 13 18:07:42.763788 dv-cinder-852009-8-iscsi devstack@n-api.service[120741]: DEBUG oslo_concurrency.lockutils [None req-93512708-1cb5-4f01-872d-6e923f48ad7e tempest-TestMinimumBasicScenario-820002800 tempest-TestMinimumBasicScenario-820002800-project] Acquiring lock "1daf4f4c-0e4a-4779-b53a-78c48397ea2f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120741) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 18:07:42.764284 dv-cinder-852009-8-iscsi devstack@n-api.service[120741]: DEBUG oslo_concurrency.lockutils [None req-93512708-1cb5-4f01-872d-6e923f48ad7e tempest-TestMinimumBasicScenario-820002800 tempest-TestMinimumBasicScenario-820002800-project] Lock "1daf4f4c-0e4a-4779-b53a-78c48397ea2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120741) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 18:07:42.764733 dv-cinder-852009-8-iscsi devstack@n-api.service[120741]: DEBUG oslo_concurrency.lockutils [None req-93512708-1cb5-4f01-872d-6e923f48ad7e tempest-TestMinimumBasicScenario-820002800 tempest-TestMinimumBasicScenario-820002800-project] Lock "1daf4f4c-0e4a-4779-b53a-78c48397ea2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120741) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 18:07:42.765414 dv-cinder-852009-8-iscsi devstack@n-api.service[120741]: DEBUG oslo_concurrency.lockutils [None req-93512708-1cb5-4f01-872d-6e923f48ad7e tempest-TestMinimumBasicScenario-820002800 tempest-TestMinimumBasicScenario-820002800-project] Acquiring lock "1daf4f4c-0e4a-4779-b53a-78c48397ea2f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120741) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 18:07:42.765883 dv-cinder-852009-8-iscsi devstack@n-api.service[120741]: DEBUG oslo_concurrency.lockutils [None req-93512708-1cb5-4f01-872d-6e923f48ad7e tempest-TestMinimumBasicScenario-820002800 tempest-TestMinimumBasicScenario-820002800-project] Lock "1daf4f4c-0e4a-4779-b53a-78c48397ea2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120741) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 18:07:42.766291 dv-cinder-852009-8-iscsi devstack@n-api.service[120741]: DEBUG oslo_concurrency.lockutils [None req-93512708-1cb5-4f01-872d-6e923f48ad7e tempest-TestMinimumBasicScenario-820002800 tempest-TestMinimumBasicScenario-820002800-project] Lock "1daf4f4c-0e4a-4779-b53a-78c48397ea2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120741) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 18:07:42.826218 dv-cinder-852009-8-iscsi devstack@n-api.service[120740]: DEBUG nova.api.openstack.wsgi [None req-641169f6-95ad-4af8-88ea-7d9b3a43bbde tempest-AttachVolumeTestJSON-555093534 tempest-AttachVolumeTestJSON-555093534-project] Calling method '>' {{(pid=120740) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 18:07:42.826711 dv-cinder-852009-8-iscsi devstack@n-api.service[120740]: DEBUG nova.compute.api [None req-641169f6-95ad-4af8-88ea-7d9b3a43bbde tempest-AttachVolumeTestJSON-555093534 tempest-AttachVolumeTestJSON-555093534-project] [instance: d0983ec1-bb82-4a7d-9dba-ace1e3eb383a] Fetching instance by UUID {{(pid=120740) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 18:07:42.832196 dv-cinder-852009-8-iscsi devstack@n-api.service[120741]: DEBUG nova.policy [None req-93512708-1cb5-4f01-872d-6e923f48ad7e tempest-TestMinimumBasicScenario-820002800 tempest-TestMinimumBasicScenario-820002800-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7880064ff0aa448d9c367c89eba145ff', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2f6832936c824066a4370cc45c5b0282', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120741) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 18:07:42.832723 dv-cinder-852009-8-iscsi devstack@n-api.service[120740]: DEBUG oslo_concurrency.lockutils [None req-641169f6-95ad-4af8-88ea-7d9b3a43bbde tempest-AttachVolumeTestJSON-555093534 tempest-AttachVolumeTestJSON-555093534-project] Acquiring lock "1daf4f4c-0e4a-4779-b53a-78c48397ea2f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120740) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 18:07:42.833224 dv-cinder-852009-8-iscsi devstack@n-api.service[120740]: DEBUG oslo_concurrency.lockutils [None req-641169f6-95ad-4af8-88ea-7d9b3a43bbde tempest-AttachVolumeTestJSON-555093534 tempest-AttachVolumeTestJSON-555093534-project] Lock "1daf4f4c-0e4a-4779-b53a-78c48397ea2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120740) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 18:07:42.833652 dv-cinder-852009-8-iscsi devstack@n-api.service[120740]: DEBUG oslo_concurrency.lockutils [None req-641169f6-95ad-4af8-88ea-7d9b3a43bbde tempest-AttachVolumeTestJSON-555093534 tempest-AttachVolumeTestJSON-555093534-project] Lock "1daf4f4c-0e4a-4779-b53a-78c48397ea2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120740) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 18:07:42.834346 dv-cinder-852009-8-iscsi devstack@n-api.service[120740]: DEBUG oslo_concurrency.lockutils [None req-641169f6-95ad-4af8-88ea-7d9b3a43bbde tempest-AttachVolumeTestJSON-555093534 tempest-AttachVolumeTestJSON-555093534-project] Acquiring lock "1daf4f4c-0e4a-4779-b53a-78c48397ea2f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120740) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 18:07:42.834797 dv-cinder-852009-8-iscsi devstack@n-api.service[120740]: DEBUG oslo_concurrency.lockutils [None req-641169f6-95ad-4af8-88ea-7d9b3a43bbde tempest-AttachVolumeTestJSON-555093534 tempest-AttachVolumeTestJSON-555093534-project] Lock "1daf4f4c-0e4a-4779-b53a-78c48397ea2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120740) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 18:07:42.835215 dv-cinder-852009-8-iscsi devstack@n-api.service[120740]: DEBUG oslo_concurrency.lockutils [None req-641169f6-95ad-4af8-88ea-7d9b3a43bbde tempest-AttachVolumeTestJSON-555093534 tempest-AttachVolumeTestJSON-555093534-project] Lock "1daf4f4c-0e4a-4779-b53a-78c48397ea2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120740) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 18:07:42.840178 dv-cinder-852009-8-iscsi devstack@n-api.service[120741]: INFO nova.api.openstack.requestlog [None req-93512708-1cb5-4f01-872d-6e923f48ad7e tempest-TestMinimumBasicScenario-820002800 tempest-TestMinimumBasicScenario-820002800-project] 10.222.0.43 "GET /compute/v2.1/servers/f8247a13-94cd-45b2-acc8-8717e1260f37" status: 200 len: 1344 microversion: 2.1 time: 0.087045 Sep 13 18:07:42.840778 dv-cinder-852009-8-iscsi devstack@n-api.service[120741]: [pid: 120741|app: 0|req: 329/667] 10.222.0.43 () {58 vars in 1236 bytes} [Tue Sep 13 18:07:42 2022] GET /compute/v2.1/servers/f8247a13-94cd-45b2-acc8-8717e1260f37 => generated 1344 bytes in 90 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 13 18:07:42.860343 dv-cinder-852009-8-iscsi devstack@n-api.service[120740]: DEBUG nova.compute.api [None req-641169f6-95ad-4af8-88ea-7d9b3a43bbde tempest-AttachVolumeTestJSON-555093534 tempest-AttachVolumeTestJSON-555093534-project] [instance: d0983ec1-bb82-4a7d-9dba-ace1e3eb383a] Going to try to terminate instance {{(pid=120740) delete /opt/stack/nova/nova/compute/api.py:2719}} Sep 13 18:07:42.944681 dv-cinder-852009-8-iscsi devstack@n-api.service[120740]: INFO nova.api.openstack.requestlog [None req-641169f6-95ad-4af8-88ea-7d9b3a43bbde tempest-AttachVolumeTestJSON-555093534 tempest-AttachVolumeTestJSON-555093534-project] 10.222.0.43 "DELETE /compute/v2.1/servers/d0983ec1-bb82-4a7d-9dba-ace1e3eb383a" status: 204 len: 0 microversion: 2.1 time: 0.121718 Sep 13 18:07:42.945180 dv-cinder-852009-8-iscsi devstack@n-api.service[120740]: [pid: 120740|app: 0|req: 339/668] 10.222.0.43 () {58 vars in 1239 bytes} [Tue Sep 13 18:07:42 2022] DELETE /compute/v2.1/servers/d0983ec1-bb82-4a7d-9dba-ace1e3eb383a => generated 0 bytes in 124 msecs (HTTP/1.1 204) 9 headers in 363 bytes (2 switches on core 0) Sep 13 18:07:42.954200 dv-cinder-852009-8-iscsi devstack@n-api.service[120741]: DEBUG nova.api.openstack.wsgi [None req-e7cb8fe5-11a3-4ff4-bc08-1d3fa3bf1230 tempest-AttachVolumeTestJSON-555093534 tempest-AttachVolumeTestJSON-555093534-project] Calling method '>' {{(pid=120741) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 18:07:42.954823 dv-cinder-852009-8-iscsi devstack@n-api.service[120741]: DEBUG nova.compute.api [None req-e7cb8fe5-11a3-4ff4-bc08-1d3fa3bf1230 tempest-AttachVolumeTestJSON-555093534 tempest-AttachVolumeTestJSON-555093534-project] [instance: d0983ec1-bb82-4a7d-9dba-ace1e3eb383a] Fetching instance by UUID {{(pid=120741) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 18:07:42.961024 dv-cinder-852009-8-iscsi devstack@n-api.service[120741]: DEBUG oslo_concurrency.lockutils [None req-e7cb8fe5-11a3-4ff4-bc08-1d3fa3bf1230 tempest-AttachVolumeTestJSON-555093534 tempest-AttachVolumeTestJSON-555093534-project] Acquiring lock "1daf4f4c-0e4a-4779-b53a-78c48397ea2f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120741) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 18:07:42.961393 dv-cinder-852009-8-iscsi devstack@n-api.service[120741]: DEBUG oslo_concurrency.lockutils [None req-e7cb8fe5-11a3-4ff4-bc08-1d3fa3bf1230 tempest-AttachVolumeTestJSON-555093534 tempest-AttachVolumeTestJSON-555093534-project] Lock "1daf4f4c-0e4a-4779-b53a-78c48397ea2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120741) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 18:07:42.961826 dv-cinder-852009-8-iscsi devstack@n-api.service[120741]: DEBUG oslo_concurrency.lockutils [None req-e7cb8fe5-11a3-4ff4-bc08-1d3fa3bf1230 tempest-AttachVolumeTestJSON-555093534 tempest-AttachVolumeTestJSON-555093534-project] Lock "1daf4f4c-0e4a-4779-b53a-78c48397ea2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120741) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 18:07:42.962509 dv-cinder-852009-8-iscsi devstack@n-api.service[120741]: DEBUG oslo_concurrency.lockutils [None req-e7cb8fe5-11a3-4ff4-bc08-1d3fa3bf1230 tempest-AttachVolumeTestJSON-555093534 tempest-AttachVolumeTestJSON-555093534-project] Acquiring lock "1daf4f4c-0e4a-4779-b53a-78c48397ea2f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120741) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 18:07:42.962968 dv-cinder-852009-8-iscsi devstack@n-api.service[120741]: DEBUG oslo_concurrency.lockutils [None req-e7cb8fe5-11a3-4ff4-bc08-1d3fa3bf1230 tempest-AttachVolumeTestJSON-555093534 tempest-AttachVolumeTestJSON-555093534-project] Lock "1daf4f4c-0e4a-4779-b53a-78c48397ea2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120741) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 18:07:42.963386 dv-cinder-852009-8-iscsi devstack@n-api.service[120741]: DEBUG oslo_concurrency.lockutils [None req-e7cb8fe5-11a3-4ff4-bc08-1d3fa3bf1230 tempest-AttachVolumeTestJSON-555093534 tempest-AttachVolumeTestJSON-555093534-project] Lock "1daf4f4c-0e4a-4779-b53a-78c48397ea2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120741) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 18:07:43.101095 dv-cinder-852009-8-iscsi devstack@n-api.service[120741]: DEBUG nova.policy [None req-e7cb8fe5-11a3-4ff4-bc08-1d3fa3bf1230 tempest-AttachVolumeTestJSON-555093534 tempest-AttachVolumeTestJSON-555093534-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0625b3113ce044bbac4f6142eaade11c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a279fcbf274c4704a31a2b95061e1469', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120741) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 18:07:43.109403 dv-cinder-852009-8-iscsi devstack@n-api.service[120741]: INFO nova.api.openstack.requestlog [None req-e7cb8fe5-11a3-4ff4-bc08-1d3fa3bf1230 tempest-AttachVolumeTestJSON-555093534 tempest-AttachVolumeTestJSON-555093534-project] 10.222.0.43 "GET /compute/v2.1/servers/d0983ec1-bb82-4a7d-9dba-ace1e3eb383a" status: 200 len: 1675 microversion: 2.1 time: 0.159362 Sep 13 18:07:43.110006 dv-cinder-852009-8-iscsi devstack@n-api.service[120741]: [pid: 120741|app: 0|req: 330/669] 10.222.0.43 () {58 vars in 1236 bytes} [Tue Sep 13 18:07:42 2022] GET /compute/v2.1/servers/d0983ec1-bb82-4a7d-9dba-ace1e3eb383a => generated 1675 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 13 18:07:43.472322 dv-cinder-852009-8-iscsi devstack@n-api.service[120740]: DEBUG nova.api.openstack.wsgi [None req-30555650-c2c7-4aed-a7de-b8b2e703610f tempest-AttachVolumeShelveTestJSON-385853788 tempest-AttachVolumeShelveTestJSON-385853788-project] Calling method '>' {{(pid=120740) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 18:07:43.473516 dv-cinder-852009-8-iscsi devstack@n-api.service[120740]: DEBUG nova.compute.api [None req-30555650-c2c7-4aed-a7de-b8b2e703610f tempest-AttachVolumeShelveTestJSON-385853788 tempest-AttachVolumeShelveTestJSON-385853788-project] [instance: 8cecf08e-bea8-4cef-9439-0eaa242bfed1] Fetching instance by UUID {{(pid=120740) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 18:07:43.483567 dv-cinder-852009-8-iscsi devstack@n-api.service[120740]: DEBUG oslo_concurrency.lockutils [None req-30555650-c2c7-4aed-a7de-b8b2e703610f tempest-AttachVolumeShelveTestJSON-385853788 tempest-AttachVolumeShelveTestJSON-385853788-project] Acquiring lock "1daf4f4c-0e4a-4779-b53a-78c48397ea2f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120740) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 18:07:43.484366 dv-cinder-852009-8-iscsi devstack@n-api.service[120740]: DEBUG oslo_concurrency.lockutils [None req-30555650-c2c7-4aed-a7de-b8b2e703610f tempest-AttachVolumeShelveTestJSON-385853788 tempest-AttachVolumeShelveTestJSON-385853788-project] Lock "1daf4f4c-0e4a-4779-b53a-78c48397ea2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120740) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 18:07:43.485122 dv-cinder-852009-8-iscsi devstack@n-api.service[120740]: DEBUG oslo_concurrency.lockutils [None req-30555650-c2c7-4aed-a7de-b8b2e703610f tempest-AttachVolumeShelveTestJSON-385853788 tempest-AttachVolumeShelveTestJSON-385853788-project] Lock "1daf4f4c-0e4a-4779-b53a-78c48397ea2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120740) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 18:07:43.486611 dv-cinder-852009-8-iscsi devstack@n-api.service[120740]: DEBUG oslo_concurrency.lockutils [None req-30555650-c2c7-4aed-a7de-b8b2e703610f tempest-AttachVolumeShelveTestJSON-385853788 tempest-AttachVolumeShelveTestJSON-385853788-project] Acquiring lock "1daf4f4c-0e4a-4779-b53a-78c48397ea2f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120740) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 18:07:43.487352 dv-cinder-852009-8-iscsi devstack@n-api.service[120740]: DEBUG oslo_concurrency.lockutils [None req-30555650-c2c7-4aed-a7de-b8b2e703610f tempest-AttachVolumeShelveTestJSON-385853788 tempest-AttachVolumeShelveTestJSON-385853788-project] Lock "1daf4f4c-0e4a-4779-b53a-78c48397ea2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120740) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 18:07:43.488040 dv-cinder-852009-8-iscsi devstack@n-api.service[120740]: DEBUG oslo_concurrency.lockutils [None req-30555650-c2c7-4aed-a7de-b8b2e703610f tempest-AttachVolumeShelveTestJSON-385853788 tempest-AttachVolumeShelveTestJSON-385853788-project] Lock "1daf4f4c-0e4a-4779-b53a-78c48397ea2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120740) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 18:07:43.629191 dv-cinder-852009-8-iscsi devstack@n-api.service[120740]: DEBUG nova.policy [None req-30555650-c2c7-4aed-a7de-b8b2e703610f tempest-AttachVolumeShelveTestJSON-385853788 tempest-AttachVolumeShelveTestJSON-385853788-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e68ecd9b3ca643539b109f75bb242d6f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '75e14fd88bfb4cd896fa7b070a0fac47', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120740) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 18:07:43.640254 dv-cinder-852009-8-iscsi devstack@n-api.service[120740]: DEBUG nova.policy [None req-30555650-c2c7-4aed-a7de-b8b2e703610f tempest-AttachVolumeShelveTestJSON-385853788 tempest-AttachVolumeShelveTestJSON-385853788-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'e68ecd9b3ca643539b109f75bb242d6f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '75e14fd88bfb4cd896fa7b070a0fac47', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120740) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 18:07:43.641749 dv-cinder-852009-8-iscsi devstack@n-api.service[120740]: DEBUG nova.policy [None req-30555650-c2c7-4aed-a7de-b8b2e703610f tempest-AttachVolumeShelveTestJSON-385853788 tempest-AttachVolumeShelveTestJSON-385853788-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'e68ecd9b3ca643539b109f75bb242d6f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '75e14fd88bfb4cd896fa7b070a0fac47', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120740) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 18:07:43.642902 dv-cinder-852009-8-iscsi devstack@n-api.service[120740]: INFO nova.api.openstack.requestlog [None req-30555650-c2c7-4aed-a7de-b8b2e703610f tempest-AttachVolumeShelveTestJSON-385853788 tempest-AttachVolumeShelveTestJSON-385853788-project] 10.222.0.43 "GET /compute/v2.1/servers/8cecf08e-bea8-4cef-9439-0eaa242bfed1" status: 200 len: 1729 microversion: 2.20 time: 0.177795 Sep 13 18:07:43.643462 dv-cinder-852009-8-iscsi devstack@n-api.service[120740]: [pid: 120740|app: 0|req: 340/670] 10.222.0.43 () {60 vars in 1277 bytes} [Tue Sep 13 18:07:43 2022] GET /compute/v2.1/servers/8cecf08e-bea8-4cef-9439-0eaa242bfed1 => generated 1729 bytes in 180 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 13 18:07:43.868155 dv-cinder-852009-8-iscsi devstack@n-api.service[120741]: DEBUG nova.api.openstack.wsgi [None req-20b84e9b-2c15-4495-8686-7a510888f4ed tempest-TestMinimumBasicScenario-820002800 tempest-TestMinimumBasicScenario-820002800-project] Calling method '>' {{(pid=120741) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 18:07:43.869383 dv-cinder-852009-8-iscsi devstack@n-api.service[120741]: DEBUG nova.compute.api [None req-20b84e9b-2c15-4495-8686-7a510888f4ed tempest-TestMinimumBasicScenario-820002800 tempest-TestMinimumBasicScenario-820002800-project] [instance: f8247a13-94cd-45b2-acc8-8717e1260f37] Fetching instance by UUID {{(pid=120741) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 18:07:43.880885 dv-cinder-852009-8-iscsi devstack@n-api.service[120741]: DEBUG oslo_concurrency.lockutils [None req-20b84e9b-2c15-4495-8686-7a510888f4ed tempest-TestMinimumBasicScenario-820002800 tempest-TestMinimumBasicScenario-820002800-project] Acquiring lock "1daf4f4c-0e4a-4779-b53a-78c48397ea2f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120741) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 18:07:43.881640 dv-cinder-852009-8-iscsi devstack@n-api.service[120741]: DEBUG oslo_concurrency.lockutils [None req-20b84e9b-2c15-4495-8686-7a510888f4ed tempest-TestMinimumBasicScenario-820002800 tempest-TestMinimumBasicScenario-820002800-project] Lock "1daf4f4c-0e4a-4779-b53a-78c48397ea2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120741) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 18:07:43.882401 dv-cinder-852009-8-iscsi devstack@n-api.service[120741]: DEBUG oslo_concurrency.lockutils [None req-20b84e9b-2c15-4495-8686-7a510888f4ed tempest-TestMinimumBasicScenario-820002800 tempest-TestMinimumBasicScenario-820002800-project] Lock "1daf4f4c-0e4a-4779-b53a-78c48397ea2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120741) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 18:07:43.883554 dv-cinder-852009-8-iscsi devstack@n-api.service[120741]: DEBUG oslo_concurrency.lockutils [None req-20b84e9b-2c15-4495-8686-7a510888f4ed tempest-TestMinimumBasicScenario-820002800 tempest-TestMinimumBasicScenario-820002800-project] Acquiring lock "1daf4f4c-0e4a-4779-b53a-78c48397ea2f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120741) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 18:07:43.884380 dv-cinder-852009-8-iscsi devstack@n-api.service[120741]: DEBUG oslo_concurrency.lockutils [None req-20b84e9b-2c15-4495-8686-7a510888f4ed tempest-TestMinimumBasicScenario-820002800 tempest-TestMinimumBasicScenario-820002800-project] Lock "1daf4f4c-0e4a-4779-b53a-78c48397ea2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120741) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 18:07:43.885151 dv-cinder-852009-8-iscsi devstack@n-api.service[120741]: DEBUG oslo_concurrency.lockutils [None req-20b84e9b-2c15-4495-8686-7a510888f4ed tempest-TestMinimumBasicScenario-820002800 tempest-TestMinimumBasicScenario-820002800-project] Lock "1daf4f4c-0e4a-4779-b53a-78c48397ea2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120741) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 18:07:43.952209 dv-cinder-852009-8-iscsi devstack@n-api.service[120741]: DEBUG nova.policy [None req-20b84e9b-2c15-4495-8686-7a510888f4ed tempest-TestMinimumBasicScenario-820002800 tempest-TestMinimumBasicScenario-820002800-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7880064ff0aa448d9c367c89eba145ff', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2f6832936c824066a4370cc45c5b0282', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120741) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 18:07:43.964176 dv-cinder-852009-8-iscsi devstack@n-api.service[120741]: INFO nova.api.openstack.requestlog [None req-20b84e9b-2c15-4495-8686-7a510888f4ed tempest-TestMinimumBasicScenario-820002800 tempest-TestMinimumBasicScenario-820002800-project] 10.222.0.43 "GET /compute/v2.1/servers/f8247a13-94cd-45b2-acc8-8717e1260f37" status: 200 len: 1344 microversion: 2.1 time: 0.102273 Sep 13 18:07:43.965003 dv-cinder-852009-8-iscsi devstack@n-api.service[120741]: [pid: 120741|app: 0|req: 331/671] 10.222.0.43 () {58 vars in 1236 bytes} [Tue Sep 13 18:07:43 2022] GET /compute/v2.1/servers/f8247a13-94cd-45b2-acc8-8717e1260f37 => generated 1344 bytes in 104 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 13 18:07:44.137883 dv-cinder-852009-8-iscsi devstack@n-api.service[120740]: DEBUG nova.api.openstack.wsgi [None req-2a45b977-0ae8-4b48-8846-581157455e58 tempest-AttachVolumeTestJSON-555093534 tempest-AttachVolumeTestJSON-555093534-project] Calling method '>' {{(pid=120740) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 18:07:44.138853 dv-cinder-852009-8-iscsi devstack@n-api.service[120740]: DEBUG nova.compute.api [None req-2a45b977-0ae8-4b48-8846-581157455e58 tempest-AttachVolumeTestJSON-555093534 tempest-AttachVolumeTestJSON-555093534-project] [instance: d0983ec1-bb82-4a7d-9dba-ace1e3eb383a] Fetching instance by UUID {{(pid=120740) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 18:07:44.149910 dv-cinder-852009-8-iscsi devstack@n-api.service[120740]: DEBUG oslo_concurrency.lockutils [None req-2a45b977-0ae8-4b48-8846-581157455e58 tempest-AttachVolumeTestJSON-555093534 tempest-AttachVolumeTestJSON-555093534-project] Acquiring lock "1daf4f4c-0e4a-4779-b53a-78c48397ea2f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120740) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 18:07:44.150702 dv-cinder-852009-8-iscsi devstack@n-api.service[120740]: DEBUG oslo_concurrency.lockutils [None req-2a45b977-0ae8-4b48-8846-581157455e58 tempest-AttachVolumeTestJSON-555093534 tempest-AttachVolumeTestJSON-555093534-project] Lock "1daf4f4c-0e4a-4779-b53a-78c48397ea2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120740) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 18:07:44.151433 dv-cinder-852009-8-iscsi devstack@n-api.service[120740]: DEBUG oslo_concurrency.lockutils [None req-2a45b977-0ae8-4b48-8846-581157455e58 tempest-AttachVolumeTestJSON-555093534 tempest-AttachVolumeTestJSON-555093534-project] Lock "1daf4f4c-0e4a-4779-b53a-78c48397ea2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120740) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 18:07:44.152608 dv-cinder-852009-8-iscsi devstack@n-api.service[120740]: DEBUG oslo_concurrency.lockutils [None req-2a45b977-0ae8-4b48-8846-581157455e58 tempest-AttachVolumeTestJSON-555093534 tempest-AttachVolumeTestJSON-555093534-project] Acquiring lock "1daf4f4c-0e4a-4779-b53a-78c48397ea2f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120740) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 18:07:44.153055 dv-cinder-852009-8-iscsi devstack@n-api.service[120740]: DEBUG oslo_concurrency.lockutils [None req-2a45b977-0ae8-4b48-8846-581157455e58 tempest-AttachVolumeTestJSON-555093534 tempest-AttachVolumeTestJSON-555093534-project] Lock "1daf4f4c-0e4a-4779-b53a-78c48397ea2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120740) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 18:07:44.153477 dv-cinder-852009-8-iscsi devstack@n-api.service[120740]: DEBUG oslo_concurrency.lockutils [None req-2a45b977-0ae8-4b48-8846-581157455e58 tempest-AttachVolumeTestJSON-555093534 tempest-AttachVolumeTestJSON-555093534-project] Lock "1daf4f4c-0e4a-4779-b53a-78c48397ea2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120740) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 18:07:44.289455 dv-cinder-852009-8-iscsi devstack@n-api.service[120740]: DEBUG nova.policy [None req-2a45b977-0ae8-4b48-8846-581157455e58 tempest-AttachVolumeTestJSON-555093534 tempest-AttachVolumeTestJSON-555093534-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0625b3113ce044bbac4f6142eaade11c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a279fcbf274c4704a31a2b95061e1469', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120740) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 18:07:44.299943 dv-cinder-852009-8-iscsi devstack@n-api.service[120740]: INFO nova.api.openstack.requestlog [None req-2a45b977-0ae8-4b48-8846-581157455e58 tempest-AttachVolumeTestJSON-555093534 tempest-AttachVolumeTestJSON-555093534-project] 10.222.0.43 "GET /compute/v2.1/servers/d0983ec1-bb82-4a7d-9dba-ace1e3eb383a" status: 200 len: 1675 microversion: 2.1 time: 0.168422 Sep 13 18:07:44.300663 dv-cinder-852009-8-iscsi devstack@n-api.service[120740]: [pid: 120740|app: 0|req: 341/672] 10.222.0.43 () {58 vars in 1236 bytes} [Tue Sep 13 18:07:44 2022] GET /compute/v2.1/servers/d0983ec1-bb82-4a7d-9dba-ace1e3eb383a => generated 1675 bytes in 170 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 13 18:07:44.674951 dv-cinder-852009-8-iscsi devstack@n-api.service[120741]: DEBUG nova.api.openstack.wsgi [None req-7b81c400-359c-47b0-b9b7-03e1e2eb3e80 tempest-AttachVolumeShelveTestJSON-385853788 tempest-AttachVolumeShelveTestJSON-385853788-project] Calling method '>' {{(pid=120741) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 18:07:44.675204 dv-cinder-852009-8-iscsi devstack@n-api.service[120741]: DEBUG nova.compute.api [None req-7b81c400-359c-47b0-b9b7-03e1e2eb3e80 tempest-AttachVolumeShelveTestJSON-385853788 tempest-AttachVolumeShelveTestJSON-385853788-project] [instance: 8cecf08e-bea8-4cef-9439-0eaa242bfed1] Fetching instance by UUID {{(pid=120741) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 18:07:44.681560 dv-cinder-852009-8-iscsi devstack@n-api.service[120741]: DEBUG oslo_concurrency.lockutils [None req-7b81c400-359c-47b0-b9b7-03e1e2eb3e80 tempest-AttachVolumeShelveTestJSON-385853788 tempest-AttachVolumeShelveTestJSON-385853788-project] Acquiring lock "1daf4f4c-0e4a-4779-b53a-78c48397ea2f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120741) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 18:07:44.682058 dv-cinder-852009-8-iscsi devstack@n-api.service[120741]: DEBUG oslo_concurrency.lockutils [None req-7b81c400-359c-47b0-b9b7-03e1e2eb3e80 tempest-AttachVolumeShelveTestJSON-385853788 tempest-AttachVolumeShelveTestJSON-385853788-project] Lock "1daf4f4c-0e4a-4779-b53a-78c48397ea2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120741) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 18:07:44.682499 dv-cinder-852009-8-iscsi devstack@n-api.service[120741]: DEBUG oslo_concurrency.lockutils [None req-7b81c400-359c-47b0-b9b7-03e1e2eb3e80 tempest-AttachVolumeShelveTestJSON-385853788 tempest-AttachVolumeShelveTestJSON-385853788-project] Lock "1daf4f4c-0e4a-4779-b53a-78c48397ea2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120741) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 18:07:44.695241 dv-cinder-852009-8-iscsi devstack@n-api.service[120741]: DEBUG oslo_concurrency.lockutils [None req-7b81c400-359c-47b0-b9b7-03e1e2eb3e80 tempest-AttachVolumeShelveTestJSON-385853788 tempest-AttachVolumeShelveTestJSON-385853788-project] Acquiring lock "1daf4f4c-0e4a-4779-b53a-78c48397ea2f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120741) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 18:07:44.695793 dv-cinder-852009-8-iscsi devstack@n-api.service[120741]: DEBUG oslo_concurrency.lockutils [None req-7b81c400-359c-47b0-b9b7-03e1e2eb3e80 tempest-AttachVolumeShelveTestJSON-385853788 tempest-AttachVolumeShelveTestJSON-385853788-project] Lock "1daf4f4c-0e4a-4779-b53a-78c48397ea2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.010s {{(pid=120741) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 18:07:44.696402 dv-cinder-852009-8-iscsi devstack@n-api.service[120741]: DEBUG oslo_concurrency.lockutils [None req-7b81c400-359c-47b0-b9b7-03e1e2eb3e80 tempest-AttachVolumeShelveTestJSON-385853788 tempest-AttachVolumeShelveTestJSON-385853788-project] Lock "1daf4f4c-0e4a-4779-b53a-78c48397ea2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120741) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 18:07:44.835909 dv-cinder-852009-8-iscsi devstack@n-api.service[120741]: DEBUG nova.policy [None req-7b81c400-359c-47b0-b9b7-03e1e2eb3e80 tempest-AttachVolumeShelveTestJSON-385853788 tempest-AttachVolumeShelveTestJSON-385853788-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e68ecd9b3ca643539b109f75bb242d6f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '75e14fd88bfb4cd896fa7b070a0fac47', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120741) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 18:07:44.844144 dv-cinder-852009-8-iscsi devstack@n-api.service[120741]: DEBUG nova.policy [None req-7b81c400-359c-47b0-b9b7-03e1e2eb3e80 tempest-AttachVolumeShelveTestJSON-385853788 tempest-AttachVolumeShelveTestJSON-385853788-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'e68ecd9b3ca643539b109f75bb242d6f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '75e14fd88bfb4cd896fa7b070a0fac47', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120741) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 18:07:44.845629 dv-cinder-852009-8-iscsi devstack@n-api.service[120741]: DEBUG nova.policy [None req-7b81c400-359c-47b0-b9b7-03e1e2eb3e80 tempest-AttachVolumeShelveTestJSON-385853788 tempest-AttachVolumeShelveTestJSON-385853788-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'e68ecd9b3ca643539b109f75bb242d6f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '75e14fd88bfb4cd896fa7b070a0fac47', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120741) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 18:07:44.846795 dv-cinder-852009-8-iscsi devstack@n-api.service[120741]: INFO nova.api.openstack.requestlog [None req-7b81c400-359c-47b0-b9b7-03e1e2eb3e80 tempest-AttachVolumeShelveTestJSON-385853788 tempest-AttachVolumeShelveTestJSON-385853788-project] 10.222.0.43 "GET /compute/v2.1/servers/8cecf08e-bea8-4cef-9439-0eaa242bfed1" status: 200 len: 1729 microversion: 2.20 time: 0.181635 Sep 13 18:07:44.847365 dv-cinder-852009-8-iscsi devstack@n-api.service[120741]: [pid: 120741|app: 0|req: 332/673] 10.222.0.43 () {60 vars in 1277 bytes} [Tue Sep 13 18:07:44 2022] GET /compute/v2.1/servers/8cecf08e-bea8-4cef-9439-0eaa242bfed1 => generated 1729 bytes in 183 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 13 18:07:44.996861 dv-cinder-852009-8-iscsi devstack@n-api.service[120740]: DEBUG nova.api.openstack.wsgi [None req-d1f8a38d-14e9-4125-9b05-a93792d085a3 tempest-TestMinimumBasicScenario-820002800 tempest-TestMinimumBasicScenario-820002800-project] Calling method '>' {{(pid=120740) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 18:07:44.997564 dv-cinder-852009-8-iscsi devstack@n-api.service[120740]: DEBUG nova.compute.api [None req-d1f8a38d-14e9-4125-9b05-a93792d085a3 tempest-TestMinimumBasicScenario-820002800 tempest-TestMinimumBasicScenario-820002800-project] [instance: f8247a13-94cd-45b2-acc8-8717e1260f37] Fetching instance by UUID {{(pid=120740) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 18:07:45.005226 dv-cinder-852009-8-iscsi devstack@n-api.service[120740]: DEBUG oslo_concurrency.lockutils [None req-d1f8a38d-14e9-4125-9b05-a93792d085a3 tempest-TestMinimumBasicScenario-820002800 tempest-TestMinimumBasicScenario-820002800-project] Acquiring lock "1daf4f4c-0e4a-4779-b53a-78c48397ea2f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120740) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 18:07:45.005797 dv-cinder-852009-8-iscsi devstack@n-api.service[120740]: DEBUG oslo_concurrency.lockutils [None req-d1f8a38d-14e9-4125-9b05-a93792d085a3 tempest-TestMinimumBasicScenario-820002800 tempest-TestMinimumBasicScenario-820002800-project] Lock "1daf4f4c-0e4a-4779-b53a-78c48397ea2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120740) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 18:07:45.006305 dv-cinder-852009-8-iscsi devstack@n-api.service[120740]: DEBUG oslo_concurrency.lockutils [None req-d1f8a38d-14e9-4125-9b05-a93792d085a3 tempest-TestMinimumBasicScenario-820002800 tempest-TestMinimumBasicScenario-820002800-project] Lock "1daf4f4c-0e4a-4779-b53a-78c48397ea2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120740) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 18:07:45.007118 dv-cinder-852009-8-iscsi devstack@n-api.service[120740]: DEBUG oslo_concurrency.lockutils [None req-d1f8a38d-14e9-4125-9b05-a93792d085a3 tempest-TestMinimumBasicScenario-820002800 tempest-TestMinimumBasicScenario-820002800-project] Acquiring lock "1daf4f4c-0e4a-4779-b53a-78c48397ea2f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120740) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 18:07:45.007645 dv-cinder-852009-8-iscsi devstack@n-api.service[120740]: DEBUG oslo_concurrency.lockutils [None req-d1f8a38d-14e9-4125-9b05-a93792d085a3 tempest-TestMinimumBasicScenario-820002800 tempest-TestMinimumBasicScenario-820002800-project] Lock "1daf4f4c-0e4a-4779-b53a-78c48397ea2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120740) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 18:07:45.008142 dv-cinder-852009-8-iscsi devstack@n-api.service[120740]: DEBUG oslo_concurrency.lockutils [None req-d1f8a38d-14e9-4125-9b05-a93792d085a3 tempest-TestMinimumBasicScenario-820002800 tempest-TestMinimumBasicScenario-820002800-project] Lock "1daf4f4c-0e4a-4779-b53a-78c48397ea2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120740) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 18:07:45.055735 dv-cinder-852009-8-iscsi devstack@n-api.service[120740]: DEBUG oslo_concurrency.lockutils [None req-d1f8a38d-14e9-4125-9b05-a93792d085a3 tempest-TestMinimumBasicScenario-820002800 tempest-TestMinimumBasicScenario-820002800-project] Acquiring lock "1daf4f4c-0e4a-4779-b53a-78c48397ea2f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120740) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 18:07:45.056127 dv-cinder-852009-8-iscsi devstack@n-api.service[120740]: DEBUG oslo_concurrency.lockutils [None req-d1f8a38d-14e9-4125-9b05-a93792d085a3 tempest-TestMinimumBasicScenario-820002800 tempest-TestMinimumBasicScenario-820002800-project] Lock "1daf4f4c-0e4a-4779-b53a-78c48397ea2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120740) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 18:07:45.056598 dv-cinder-852009-8-iscsi devstack@n-api.service[120740]: DEBUG oslo_concurrency.lockutils [None req-d1f8a38d-14e9-4125-9b05-a93792d085a3 tempest-TestMinimumBasicScenario-820002800 tempest-TestMinimumBasicScenario-820002800-project] Lock "1daf4f4c-0e4a-4779-b53a-78c48397ea2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120740) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 18:07:45.057045 dv-cinder-852009-8-iscsi devstack@n-api.service[120740]: DEBUG nova.objects.instance [None req-d1f8a38d-14e9-4125-9b05-a93792d085a3 tempest-TestMinimumBasicScenario-820002800 tempest-TestMinimumBasicScenario-820002800-project] Lazy-loading 'fault' on Instance uuid f8247a13-94cd-45b2-acc8-8717e1260f37 {{(pid=120740) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Sep 13 18:07:45.111055 dv-cinder-852009-8-iscsi devstack@n-api.service[120740]: DEBUG nova.policy [None req-d1f8a38d-14e9-4125-9b05-a93792d085a3 tempest-TestMinimumBasicScenario-820002800 tempest-TestMinimumBasicScenario-820002800-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7880064ff0aa448d9c367c89eba145ff', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2f6832936c824066a4370cc45c5b0282', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120740) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 18:07:45.119618 dv-cinder-852009-8-iscsi devstack@n-api.service[120740]: INFO nova.api.openstack.requestlog [None req-d1f8a38d-14e9-4125-9b05-a93792d085a3 tempest-TestMinimumBasicScenario-820002800 tempest-TestMinimumBasicScenario-820002800-project] 10.222.0.43 "GET /compute/v2.1/servers/f8247a13-94cd-45b2-acc8-8717e1260f37" status: 200 len: 1349 microversion: 2.1 time: 0.129081 Sep 13 18:07:45.120188 dv-cinder-852009-8-iscsi devstack@n-api.service[120740]: [pid: 120740|app: 0|req: 342/674] 10.222.0.43 () {58 vars in 1236 bytes} [Tue Sep 13 18:07:44 2022] GET /compute/v2.1/servers/f8247a13-94cd-45b2-acc8-8717e1260f37 => generated 1349 bytes in 131 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 13 18:07:45.326708 dv-cinder-852009-8-iscsi devstack@n-api.service[120741]: DEBUG nova.api.openstack.wsgi [None req-f8801f7d-ec35-48ab-a59e-0180a7fbfafc tempest-AttachVolumeTestJSON-555093534 tempest-AttachVolumeTestJSON-555093534-project] Calling method '>' {{(pid=120741) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 18:07:45.327251 dv-cinder-852009-8-iscsi devstack@n-api.service[120741]: DEBUG nova.compute.api [None req-f8801f7d-ec35-48ab-a59e-0180a7fbfafc tempest-AttachVolumeTestJSON-555093534 tempest-AttachVolumeTestJSON-555093534-project] [instance: d0983ec1-bb82-4a7d-9dba-ace1e3eb383a] Fetching instance by UUID {{(pid=120741) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 18:07:45.329572 dv-cinder-852009-8-iscsi devstack@n-api.service[120741]: DEBUG dbcounter [-] [120741] Writing DB stats nova_api:SELECT=64 {{(pid=120741) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 18:07:45.334909 dv-cinder-852009-8-iscsi devstack@n-api.service[120741]: DEBUG oslo_concurrency.lockutils [None req-f8801f7d-ec35-48ab-a59e-0180a7fbfafc tempest-AttachVolumeTestJSON-555093534 tempest-AttachVolumeTestJSON-555093534-project] Acquiring lock "1daf4f4c-0e4a-4779-b53a-78c48397ea2f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120741) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 18:07:45.335383 dv-cinder-852009-8-iscsi devstack@n-api.service[120741]: DEBUG oslo_concurrency.lockutils [None req-f8801f7d-ec35-48ab-a59e-0180a7fbfafc tempest-AttachVolumeTestJSON-555093534 tempest-AttachVolumeTestJSON-555093534-project] Lock "1daf4f4c-0e4a-4779-b53a-78c48397ea2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120741) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 18:07:45.335804 dv-cinder-852009-8-iscsi devstack@n-api.service[120741]: DEBUG oslo_concurrency.lockutils [None req-f8801f7d-ec35-48ab-a59e-0180a7fbfafc tempest-AttachVolumeTestJSON-555093534 tempest-AttachVolumeTestJSON-555093534-project] Lock "1daf4f4c-0e4a-4779-b53a-78c48397ea2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120741) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 18:07:45.336525 dv-cinder-852009-8-iscsi devstack@n-api.service[120741]: DEBUG oslo_concurrency.lockutils [None req-f8801f7d-ec35-48ab-a59e-0180a7fbfafc tempest-AttachVolumeTestJSON-555093534 tempest-AttachVolumeTestJSON-555093534-project] Acquiring lock "1daf4f4c-0e4a-4779-b53a-78c48397ea2f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120741) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 18:07:45.336967 dv-cinder-852009-8-iscsi devstack@n-api.service[120741]: DEBUG oslo_concurrency.lockutils [None req-f8801f7d-ec35-48ab-a59e-0180a7fbfafc tempest-AttachVolumeTestJSON-555093534 tempest-AttachVolumeTestJSON-555093534-project] Lock "1daf4f4c-0e4a-4779-b53a-78c48397ea2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120741) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 18:07:45.337382 dv-cinder-852009-8-iscsi devstack@n-api.service[120741]: DEBUG oslo_concurrency.lockutils [None req-f8801f7d-ec35-48ab-a59e-0180a7fbfafc tempest-AttachVolumeTestJSON-555093534 tempest-AttachVolumeTestJSON-555093534-project] Lock "1daf4f4c-0e4a-4779-b53a-78c48397ea2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120741) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 18:07:45.475698 dv-cinder-852009-8-iscsi devstack@n-api.service[120741]: DEBUG nova.policy [None req-f8801f7d-ec35-48ab-a59e-0180a7fbfafc tempest-AttachVolumeTestJSON-555093534 tempest-AttachVolumeTestJSON-555093534-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0625b3113ce044bbac4f6142eaade11c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a279fcbf274c4704a31a2b95061e1469', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120741) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 18:07:45.484049 dv-cinder-852009-8-iscsi devstack@n-api.service[120741]: INFO nova.api.openstack.requestlog [None req-f8801f7d-ec35-48ab-a59e-0180a7fbfafc tempest-AttachVolumeTestJSON-555093534 tempest-AttachVolumeTestJSON-555093534-project] 10.222.0.43 "GET /compute/v2.1/servers/d0983ec1-bb82-4a7d-9dba-ace1e3eb383a" status: 200 len: 1675 microversion: 2.1 time: 0.163012 Sep 13 18:07:45.484644 dv-cinder-852009-8-iscsi devstack@n-api.service[120741]: [pid: 120741|app: 0|req: 333/675] 10.222.0.43 () {58 vars in 1236 bytes} [Tue Sep 13 18:07:45 2022] GET /compute/v2.1/servers/d0983ec1-bb82-4a7d-9dba-ace1e3eb383a => generated 1675 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 13 18:07:45.875832 dv-cinder-852009-8-iscsi devstack@n-api.service[120740]: DEBUG nova.api.openstack.wsgi [None req-30a378e1-abc8-4ce8-ab8a-d96ac9e0cd59 tempest-AttachVolumeShelveTestJSON-385853788 tempest-AttachVolumeShelveTestJSON-385853788-project] Calling method '>' {{(pid=120740) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 18:07:45.877273 dv-cinder-852009-8-iscsi devstack@n-api.service[120740]: DEBUG nova.compute.api [None req-30a378e1-abc8-4ce8-ab8a-d96ac9e0cd59 tempest-AttachVolumeShelveTestJSON-385853788 tempest-AttachVolumeShelveTestJSON-385853788-project] [instance: 8cecf08e-bea8-4cef-9439-0eaa242bfed1] Fetching instance by UUID {{(pid=120740) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 18:07:45.888223 dv-cinder-852009-8-iscsi devstack@n-api.service[120740]: DEBUG oslo_concurrency.lockutils [None req-30a378e1-abc8-4ce8-ab8a-d96ac9e0cd59 tempest-AttachVolumeShelveTestJSON-385853788 tempest-AttachVolumeShelveTestJSON-385853788-project] Acquiring lock "1daf4f4c-0e4a-4779-b53a-78c48397ea2f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120740) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 18:07:45.888740 dv-cinder-852009-8-iscsi devstack@n-api.service[120740]: DEBUG oslo_concurrency.lockutils [None req-30a378e1-abc8-4ce8-ab8a-d96ac9e0cd59 tempest-AttachVolumeShelveTestJSON-385853788 tempest-AttachVolumeShelveTestJSON-385853788-project] Lock "1daf4f4c-0e4a-4779-b53a-78c48397ea2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120740) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 18:07:45.889175 dv-cinder-852009-8-iscsi devstack@n-api.service[120740]: DEBUG oslo_concurrency.lockutils [None req-30a378e1-abc8-4ce8-ab8a-d96ac9e0cd59 tempest-AttachVolumeShelveTestJSON-385853788 tempest-AttachVolumeShelveTestJSON-385853788-project] Lock "1daf4f4c-0e4a-4779-b53a-78c48397ea2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120740) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 18:07:45.889897 dv-cinder-852009-8-iscsi devstack@n-api.service[120740]: DEBUG oslo_concurrency.lockutils [None req-30a378e1-abc8-4ce8-ab8a-d96ac9e0cd59 tempest-AttachVolumeShelveTestJSON-385853788 tempest-AttachVolumeShelveTestJSON-385853788-project] Acquiring lock "1daf4f4c-0e4a-4779-b53a-78c48397ea2f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120740) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 18:07:45.890344 dv-cinder-852009-8-iscsi devstack@n-api.service[120740]: DEBUG oslo_concurrency.lockutils [None req-30a378e1-abc8-4ce8-ab8a-d96ac9e0cd59 tempest-AttachVolumeShelveTestJSON-385853788 tempest-AttachVolumeShelveTestJSON-385853788-project] Lock "1daf4f4c-0e4a-4779-b53a-78c48397ea2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120740) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 18:07:45.890761 dv-cinder-852009-8-iscsi devstack@n-api.service[120740]: DEBUG oslo_concurrency.lockutils [None req-30a378e1-abc8-4ce8-ab8a-d96ac9e0cd59 tempest-AttachVolumeShelveTestJSON-385853788 tempest-AttachVolumeShelveTestJSON-385853788-project] Lock "1daf4f4c-0e4a-4779-b53a-78c48397ea2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120740) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 18:07:46.028968 dv-cinder-852009-8-iscsi devstack@n-api.service[120740]: DEBUG nova.policy [None req-30a378e1-abc8-4ce8-ab8a-d96ac9e0cd59 tempest-AttachVolumeShelveTestJSON-385853788 tempest-AttachVolumeShelveTestJSON-385853788-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e68ecd9b3ca643539b109f75bb242d6f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '75e14fd88bfb4cd896fa7b070a0fac47', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120740) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 18:07:46.037115 dv-cinder-852009-8-iscsi devstack@n-api.service[120740]: DEBUG nova.policy [None req-30a378e1-abc8-4ce8-ab8a-d96ac9e0cd59 tempest-AttachVolumeShelveTestJSON-385853788 tempest-AttachVolumeShelveTestJSON-385853788-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'e68ecd9b3ca643539b109f75bb242d6f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '75e14fd88bfb4cd896fa7b070a0fac47', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120740) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 18:07:46.038559 dv-cinder-852009-8-iscsi devstack@n-api.service[120740]: DEBUG nova.policy [None req-30a378e1-abc8-4ce8-ab8a-d96ac9e0cd59 tempest-AttachVolumeShelveTestJSON-385853788 tempest-AttachVolumeShelveTestJSON-385853788-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'e68ecd9b3ca643539b109f75bb242d6f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '75e14fd88bfb4cd896fa7b070a0fac47', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120740) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 18:07:46.039720 dv-cinder-852009-8-iscsi devstack@n-api.service[120740]: INFO nova.api.openstack.requestlog [None req-30a378e1-abc8-4ce8-ab8a-d96ac9e0cd59 tempest-AttachVolumeShelveTestJSON-385853788 tempest-AttachVolumeShelveTestJSON-385853788-project] 10.222.0.43 "GET /compute/v2.1/servers/8cecf08e-bea8-4cef-9439-0eaa242bfed1" status: 200 len: 1729 microversion: 2.20 time: 0.170654 Sep 13 18:07:46.040285 dv-cinder-852009-8-iscsi devstack@n-api.service[120740]: [pid: 120740|app: 0|req: 343/676] 10.222.0.43 () {60 vars in 1277 bytes} [Tue Sep 13 18:07:45 2022] GET /compute/v2.1/servers/8cecf08e-bea8-4cef-9439-0eaa242bfed1 => generated 1729 bytes in 172 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 13 18:07:46.144634 dv-cinder-852009-8-iscsi devstack@n-api.service[120741]: DEBUG nova.api.openstack.wsgi [None req-2a601b24-c7ed-480d-94a1-9611af39ca4c tempest-TestMinimumBasicScenario-820002800 tempest-TestMinimumBasicScenario-820002800-project] Calling method '>' {{(pid=120741) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 18:07:46.145309 dv-cinder-852009-8-iscsi devstack@n-api.service[120741]: DEBUG nova.compute.api [None req-2a601b24-c7ed-480d-94a1-9611af39ca4c tempest-TestMinimumBasicScenario-820002800 tempest-TestMinimumBasicScenario-820002800-project] [instance: f8247a13-94cd-45b2-acc8-8717e1260f37] Fetching instance by UUID {{(pid=120741) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 18:07:46.152369 dv-cinder-852009-8-iscsi devstack@n-api.service[120741]: DEBUG oslo_concurrency.lockutils [None req-2a601b24-c7ed-480d-94a1-9611af39ca4c tempest-TestMinimumBasicScenario-820002800 tempest-TestMinimumBasicScenario-820002800-project] Acquiring lock "1daf4f4c-0e4a-4779-b53a-78c48397ea2f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120741) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 18:07:46.152938 dv-cinder-852009-8-iscsi devstack@n-api.service[120741]: DEBUG oslo_concurrency.lockutils [None req-2a601b24-c7ed-480d-94a1-9611af39ca4c tempest-TestMinimumBasicScenario-820002800 tempest-TestMinimumBasicScenario-820002800-project] Lock "1daf4f4c-0e4a-4779-b53a-78c48397ea2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120741) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 18:07:46.153415 dv-cinder-852009-8-iscsi devstack@n-api.service[120741]: DEBUG oslo_concurrency.lockutils [None req-2a601b24-c7ed-480d-94a1-9611af39ca4c tempest-TestMinimumBasicScenario-820002800 tempest-TestMinimumBasicScenario-820002800-project] Lock "1daf4f4c-0e4a-4779-b53a-78c48397ea2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120741) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 18:07:46.154186 dv-cinder-852009-8-iscsi devstack@n-api.service[120741]: DEBUG oslo_concurrency.lockutils [None req-2a601b24-c7ed-480d-94a1-9611af39ca4c tempest-TestMinimumBasicScenario-820002800 tempest-TestMinimumBasicScenario-820002800-project] Acquiring lock "1daf4f4c-0e4a-4779-b53a-78c48397ea2f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120741) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 18:07:46.154688 dv-cinder-852009-8-iscsi devstack@n-api.service[120741]: DEBUG oslo_concurrency.lockutils [None req-2a601b24-c7ed-480d-94a1-9611af39ca4c tempest-TestMinimumBasicScenario-820002800 tempest-TestMinimumBasicScenario-820002800-project] Lock "1daf4f4c-0e4a-4779-b53a-78c48397ea2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120741) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 18:07:46.155147 dv-cinder-852009-8-iscsi devstack@n-api.service[120741]: DEBUG oslo_concurrency.lockutils [None req-2a601b24-c7ed-480d-94a1-9611af39ca4c tempest-TestMinimumBasicScenario-820002800 tempest-TestMinimumBasicScenario-820002800-project] Lock "1daf4f4c-0e4a-4779-b53a-78c48397ea2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120741) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 18:07:46.187361 dv-cinder-852009-8-iscsi devstack@n-api.service[120741]: DEBUG oslo_concurrency.lockutils [None req-2a601b24-c7ed-480d-94a1-9611af39ca4c tempest-TestMinimumBasicScenario-820002800 tempest-TestMinimumBasicScenario-820002800-project] Acquiring lock "1daf4f4c-0e4a-4779-b53a-78c48397ea2f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120741) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 18:07:46.187828 dv-cinder-852009-8-iscsi devstack@n-api.service[120741]: DEBUG oslo_concurrency.lockutils [None req-2a601b24-c7ed-480d-94a1-9611af39ca4c tempest-TestMinimumBasicScenario-820002800 tempest-TestMinimumBasicScenario-820002800-project] Lock "1daf4f4c-0e4a-4779-b53a-78c48397ea2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120741) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 18:07:46.188259 dv-cinder-852009-8-iscsi devstack@n-api.service[120741]: DEBUG oslo_concurrency.lockutils [None req-2a601b24-c7ed-480d-94a1-9611af39ca4c tempest-TestMinimumBasicScenario-820002800 tempest-TestMinimumBasicScenario-820002800-project] Lock "1daf4f4c-0e4a-4779-b53a-78c48397ea2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120741) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 18:07:46.188728 dv-cinder-852009-8-iscsi devstack@n-api.service[120741]: DEBUG nova.objects.instance [None req-2a601b24-c7ed-480d-94a1-9611af39ca4c tempest-TestMinimumBasicScenario-820002800 tempest-TestMinimumBasicScenario-820002800-project] Lazy-loading 'fault' on Instance uuid f8247a13-94cd-45b2-acc8-8717e1260f37 {{(pid=120741) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Sep 13 18:07:46.232416 dv-cinder-852009-8-iscsi devstack@n-api.service[120741]: DEBUG nova.policy [None req-2a601b24-c7ed-480d-94a1-9611af39ca4c tempest-TestMinimumBasicScenario-820002800 tempest-TestMinimumBasicScenario-820002800-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7880064ff0aa448d9c367c89eba145ff', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2f6832936c824066a4370cc45c5b0282', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120741) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 18:07:46.241120 dv-cinder-852009-8-iscsi devstack@n-api.service[120741]: INFO nova.api.openstack.requestlog [None req-2a601b24-c7ed-480d-94a1-9611af39ca4c tempest-TestMinimumBasicScenario-820002800 tempest-TestMinimumBasicScenario-820002800-project] 10.222.0.43 "GET /compute/v2.1/servers/f8247a13-94cd-45b2-acc8-8717e1260f37" status: 200 len: 1349 microversion: 2.1 time: 0.100913 Sep 13 18:07:46.241694 dv-cinder-852009-8-iscsi devstack@n-api.service[120741]: [pid: 120741|app: 0|req: 334/677] 10.222.0.43 () {58 vars in 1236 bytes} [Tue Sep 13 18:07:46 2022] GET /compute/v2.1/servers/f8247a13-94cd-45b2-acc8-8717e1260f37 => generated 1349 bytes in 102 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 13 18:07:46.510648 dv-cinder-852009-8-iscsi devstack@n-api.service[120740]: DEBUG nova.api.openstack.wsgi [None req-329ac9b0-55cb-4aa6-ba83-5263d96b09da tempest-AttachVolumeTestJSON-555093534 tempest-AttachVolumeTestJSON-555093534-project] Calling method '>' {{(pid=120740) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 18:07:46.511516 dv-cinder-852009-8-iscsi devstack@n-api.service[120740]: DEBUG nova.compute.api [None req-329ac9b0-55cb-4aa6-ba83-5263d96b09da tempest-AttachVolumeTestJSON-555093534 tempest-AttachVolumeTestJSON-555093534-project] [instance: d0983ec1-bb82-4a7d-9dba-ace1e3eb383a] Fetching instance by UUID {{(pid=120740) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 18:07:46.521090 dv-cinder-852009-8-iscsi devstack@n-api.service[120740]: DEBUG oslo_concurrency.lockutils [None req-329ac9b0-55cb-4aa6-ba83-5263d96b09da tempest-AttachVolumeTestJSON-555093534 tempest-AttachVolumeTestJSON-555093534-project] Acquiring lock "1daf4f4c-0e4a-4779-b53a-78c48397ea2f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120740) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 18:07:46.521737 dv-cinder-852009-8-iscsi devstack@n-api.service[120740]: DEBUG oslo_concurrency.lockutils [None req-329ac9b0-55cb-4aa6-ba83-5263d96b09da tempest-AttachVolumeTestJSON-555093534 tempest-AttachVolumeTestJSON-555093534-project] Lock "1daf4f4c-0e4a-4779-b53a-78c48397ea2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120740) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 18:07:46.522350 dv-cinder-852009-8-iscsi devstack@n-api.service[120740]: DEBUG oslo_concurrency.lockutils [None req-329ac9b0-55cb-4aa6-ba83-5263d96b09da tempest-AttachVolumeTestJSON-555093534 tempest-AttachVolumeTestJSON-555093534-project] Lock "1daf4f4c-0e4a-4779-b53a-78c48397ea2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120740) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 18:07:46.523391 dv-cinder-852009-8-iscsi devstack@n-api.service[120740]: DEBUG oslo_concurrency.lockutils [None req-329ac9b0-55cb-4aa6-ba83-5263d96b09da tempest-AttachVolumeTestJSON-555093534 tempest-AttachVolumeTestJSON-555093534-project] Acquiring lock "1daf4f4c-0e4a-4779-b53a-78c48397ea2f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120740) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 18:07:46.523985 dv-cinder-852009-8-iscsi devstack@n-api.service[120740]: DEBUG oslo_concurrency.lockutils [None req-329ac9b0-55cb-4aa6-ba83-5263d96b09da tempest-AttachVolumeTestJSON-555093534 tempest-AttachVolumeTestJSON-555093534-project] Lock "1daf4f4c-0e4a-4779-b53a-78c48397ea2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120740) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 18:07:46.524664 dv-cinder-852009-8-iscsi devstack@n-api.service[120740]: DEBUG oslo_concurrency.lockutils [None req-329ac9b0-55cb-4aa6-ba83-5263d96b09da tempest-AttachVolumeTestJSON-555093534 tempest-AttachVolumeTestJSON-555093534-project] Lock "1daf4f4c-0e4a-4779-b53a-78c48397ea2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120740) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 18:07:46.659464 dv-cinder-852009-8-iscsi devstack@n-api.service[120740]: DEBUG nova.policy [None req-329ac9b0-55cb-4aa6-ba83-5263d96b09da tempest-AttachVolumeTestJSON-555093534 tempest-AttachVolumeTestJSON-555093534-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0625b3113ce044bbac4f6142eaade11c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a279fcbf274c4704a31a2b95061e1469', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120740) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 18:07:46.667958 dv-cinder-852009-8-iscsi devstack@n-api.service[120740]: INFO nova.api.openstack.requestlog [None req-329ac9b0-55cb-4aa6-ba83-5263d96b09da tempest-AttachVolumeTestJSON-555093534 tempest-AttachVolumeTestJSON-555093534-project] 10.222.0.43 "GET /compute/v2.1/servers/d0983ec1-bb82-4a7d-9dba-ace1e3eb383a" status: 200 len: 1675 microversion: 2.1 time: 0.162930 Sep 13 18:07:46.668573 dv-cinder-852009-8-iscsi devstack@n-api.service[120740]: [pid: 120740|app: 0|req: 344/678] 10.222.0.43 () {58 vars in 1236 bytes} [Tue Sep 13 18:07:46 2022] GET /compute/v2.1/servers/d0983ec1-bb82-4a7d-9dba-ace1e3eb383a => generated 1675 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 13 18:07:47.070063 dv-cinder-852009-8-iscsi devstack@n-api.service[120741]: DEBUG nova.api.openstack.wsgi [None req-77a19ed1-366d-47a8-8712-0ecf18849b15 tempest-AttachVolumeShelveTestJSON-385853788 tempest-AttachVolumeShelveTestJSON-385853788-project] Calling method '>' {{(pid=120741) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 18:07:47.071045 dv-cinder-852009-8-iscsi devstack@n-api.service[120741]: DEBUG nova.compute.api [None req-77a19ed1-366d-47a8-8712-0ecf18849b15 tempest-AttachVolumeShelveTestJSON-385853788 tempest-AttachVolumeShelveTestJSON-385853788-project] [instance: 8cecf08e-bea8-4cef-9439-0eaa242bfed1] Fetching instance by UUID {{(pid=120741) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 18:07:47.082016 dv-cinder-852009-8-iscsi devstack@n-api.service[120741]: DEBUG oslo_concurrency.lockutils [None req-77a19ed1-366d-47a8-8712-0ecf18849b15 tempest-AttachVolumeShelveTestJSON-385853788 tempest-AttachVolumeShelveTestJSON-385853788-project] Acquiring lock "1daf4f4c-0e4a-4779-b53a-78c48397ea2f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120741) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 18:07:47.082819 dv-cinder-852009-8-iscsi devstack@n-api.service[120741]: DEBUG oslo_concurrency.lockutils [None req-77a19ed1-366d-47a8-8712-0ecf18849b15 tempest-AttachVolumeShelveTestJSON-385853788 tempest-AttachVolumeShelveTestJSON-385853788-project] Lock "1daf4f4c-0e4a-4779-b53a-78c48397ea2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120741) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 18:07:47.083541 dv-cinder-852009-8-iscsi devstack@n-api.service[120741]: DEBUG oslo_concurrency.lockutils [None req-77a19ed1-366d-47a8-8712-0ecf18849b15 tempest-AttachVolumeShelveTestJSON-385853788 tempest-AttachVolumeShelveTestJSON-385853788-project] Lock "1daf4f4c-0e4a-4779-b53a-78c48397ea2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120741) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 18:07:47.084762 dv-cinder-852009-8-iscsi devstack@n-api.service[120741]: DEBUG oslo_concurrency.lockutils [None req-77a19ed1-366d-47a8-8712-0ecf18849b15 tempest-AttachVolumeShelveTestJSON-385853788 tempest-AttachVolumeShelveTestJSON-385853788-project] Acquiring lock "1daf4f4c-0e4a-4779-b53a-78c48397ea2f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120741) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 18:07:47.085532 dv-cinder-852009-8-iscsi devstack@n-api.service[120741]: DEBUG oslo_concurrency.lockutils [None req-77a19ed1-366d-47a8-8712-0ecf18849b15 tempest-AttachVolumeShelveTestJSON-385853788 tempest-AttachVolumeShelveTestJSON-385853788-project] Lock "1daf4f4c-0e4a-4779-b53a-78c48397ea2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120741) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 18:07:47.086222 dv-cinder-852009-8-iscsi devstack@n-api.service[120741]: DEBUG oslo_concurrency.lockutils [None req-77a19ed1-366d-47a8-8712-0ecf18849b15 tempest-AttachVolumeShelveTestJSON-385853788 tempest-AttachVolumeShelveTestJSON-385853788-project] Lock "1daf4f4c-0e4a-4779-b53a-78c48397ea2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120741) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 18:07:47.225884 dv-cinder-852009-8-iscsi devstack@n-api.service[120741]: DEBUG nova.policy [None req-77a19ed1-366d-47a8-8712-0ecf18849b15 tempest-AttachVolumeShelveTestJSON-385853788 tempest-AttachVolumeShelveTestJSON-385853788-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e68ecd9b3ca643539b109f75bb242d6f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '75e14fd88bfb4cd896fa7b070a0fac47', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120741) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 18:07:47.234592 dv-cinder-852009-8-iscsi devstack@n-api.service[120741]: DEBUG nova.policy [None req-77a19ed1-366d-47a8-8712-0ecf18849b15 tempest-AttachVolumeShelveTestJSON-385853788 tempest-AttachVolumeShelveTestJSON-385853788-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'e68ecd9b3ca643539b109f75bb242d6f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '75e14fd88bfb4cd896fa7b070a0fac47', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120741) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 18:07:47.236216 dv-cinder-852009-8-iscsi devstack@n-api.service[120741]: DEBUG nova.policy [None req-77a19ed1-366d-47a8-8712-0ecf18849b15 tempest-AttachVolumeShelveTestJSON-385853788 tempest-AttachVolumeShelveTestJSON-385853788-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'e68ecd9b3ca643539b109f75bb242d6f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '75e14fd88bfb4cd896fa7b070a0fac47', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120741) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 18:07:47.237571 dv-cinder-852009-8-iscsi devstack@n-api.service[120741]: INFO nova.api.openstack.requestlog [None req-77a19ed1-366d-47a8-8712-0ecf18849b15 tempest-AttachVolumeShelveTestJSON-385853788 tempest-AttachVolumeShelveTestJSON-385853788-project] 10.222.0.43 "GET /compute/v2.1/servers/8cecf08e-bea8-4cef-9439-0eaa242bfed1" status: 200 len: 1729 microversion: 2.20 time: 0.174134 Sep 13 18:07:47.238392 dv-cinder-852009-8-iscsi devstack@n-api.service[120741]: [pid: 120741|app: 0|req: 335/679] 10.222.0.43 () {60 vars in 1277 bytes} [Tue Sep 13 18:07:47 2022] GET /compute/v2.1/servers/8cecf08e-bea8-4cef-9439-0eaa242bfed1 => generated 1729 bytes in 176 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 13 18:07:47.264320 dv-cinder-852009-8-iscsi devstack@n-api.service[120740]: DEBUG nova.api.openstack.wsgi [None req-21c3ca8f-a080-402a-bbc5-9fe3397a2475 tempest-TestMinimumBasicScenario-820002800 tempest-TestMinimumBasicScenario-820002800-project] Calling method '>' {{(pid=120740) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 18:07:47.264966 dv-cinder-852009-8-iscsi devstack@n-api.service[120740]: DEBUG nova.compute.api [None req-21c3ca8f-a080-402a-bbc5-9fe3397a2475 tempest-TestMinimumBasicScenario-820002800 tempest-TestMinimumBasicScenario-820002800-project] [instance: f8247a13-94cd-45b2-acc8-8717e1260f37] Fetching instance by UUID {{(pid=120740) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 18:07:47.271525 dv-cinder-852009-8-iscsi devstack@n-api.service[120740]: DEBUG oslo_concurrency.lockutils [None req-21c3ca8f-a080-402a-bbc5-9fe3397a2475 tempest-TestMinimumBasicScenario-820002800 tempest-TestMinimumBasicScenario-820002800-project] Acquiring lock "1daf4f4c-0e4a-4779-b53a-78c48397ea2f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120740) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 18:07:47.272012 dv-cinder-852009-8-iscsi devstack@n-api.service[120740]: DEBUG oslo_concurrency.lockutils [None req-21c3ca8f-a080-402a-bbc5-9fe3397a2475 tempest-TestMinimumBasicScenario-820002800 tempest-TestMinimumBasicScenario-820002800-project] Lock "1daf4f4c-0e4a-4779-b53a-78c48397ea2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120740) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 18:07:47.272465 dv-cinder-852009-8-iscsi devstack@n-api.service[120740]: DEBUG oslo_concurrency.lockutils [None req-21c3ca8f-a080-402a-bbc5-9fe3397a2475 tempest-TestMinimumBasicScenario-820002800 tempest-TestMinimumBasicScenario-820002800-project] Lock "1daf4f4c-0e4a-4779-b53a-78c48397ea2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120740) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 18:07:47.273157 dv-cinder-852009-8-iscsi devstack@n-api.service[120740]: DEBUG oslo_concurrency.lockutils [None req-21c3ca8f-a080-402a-bbc5-9fe3397a2475 tempest-TestMinimumBasicScenario-820002800 tempest-TestMinimumBasicScenario-820002800-project] Acquiring lock "1daf4f4c-0e4a-4779-b53a-78c48397ea2f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120740) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 18:07:47.273637 dv-cinder-852009-8-iscsi devstack@n-api.service[120740]: DEBUG oslo_concurrency.lockutils [None req-21c3ca8f-a080-402a-bbc5-9fe3397a2475 tempest-TestMinimumBasicScenario-820002800 tempest-TestMinimumBasicScenario-820002800-project] Lock "1daf4f4c-0e4a-4779-b53a-78c48397ea2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120740) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 18:07:47.274045 dv-cinder-852009-8-iscsi devstack@n-api.service[120740]: DEBUG oslo_concurrency.lockutils [None req-21c3ca8f-a080-402a-bbc5-9fe3397a2475 tempest-TestMinimumBasicScenario-820002800 tempest-TestMinimumBasicScenario-820002800-project] Lock "1daf4f4c-0e4a-4779-b53a-78c48397ea2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120740) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 18:07:47.304737 dv-cinder-852009-8-iscsi devstack@n-api.service[120740]: DEBUG oslo_concurrency.lockutils [None req-21c3ca8f-a080-402a-bbc5-9fe3397a2475 tempest-TestMinimumBasicScenario-820002800 tempest-TestMinimumBasicScenario-820002800-project] Acquiring lock "1daf4f4c-0e4a-4779-b53a-78c48397ea2f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120740) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 18:07:47.305206 dv-cinder-852009-8-iscsi devstack@n-api.service[120740]: DEBUG oslo_concurrency.lockutils [None req-21c3ca8f-a080-402a-bbc5-9fe3397a2475 tempest-TestMinimumBasicScenario-820002800 tempest-TestMinimumBasicScenario-820002800-project] Lock "1daf4f4c-0e4a-4779-b53a-78c48397ea2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120740) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 18:07:47.305638 dv-cinder-852009-8-iscsi devstack@n-api.service[120740]: DEBUG oslo_concurrency.lockutils [None req-21c3ca8f-a080-402a-bbc5-9fe3397a2475 tempest-TestMinimumBasicScenario-820002800 tempest-TestMinimumBasicScenario-820002800-project] Lock "1daf4f4c-0e4a-4779-b53a-78c48397ea2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120740) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 18:07:47.306074 dv-cinder-852009-8-iscsi devstack@n-api.service[120740]: DEBUG nova.objects.instance [None req-21c3ca8f-a080-402a-bbc5-9fe3397a2475 tempest-TestMinimumBasicScenario-820002800 tempest-TestMinimumBasicScenario-820002800-project] Lazy-loading 'fault' on Instance uuid f8247a13-94cd-45b2-acc8-8717e1260f37 {{(pid=120740) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Sep 13 18:07:47.357549 dv-cinder-852009-8-iscsi devstack@n-api.service[120740]: DEBUG nova.policy [None req-21c3ca8f-a080-402a-bbc5-9fe3397a2475 tempest-TestMinimumBasicScenario-820002800 tempest-TestMinimumBasicScenario-820002800-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7880064ff0aa448d9c367c89eba145ff', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2f6832936c824066a4370cc45c5b0282', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120740) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 18:07:47.365529 dv-cinder-852009-8-iscsi devstack@n-api.service[120740]: INFO nova.api.openstack.requestlog [None req-21c3ca8f-a080-402a-bbc5-9fe3397a2475 tempest-TestMinimumBasicScenario-820002800 tempest-TestMinimumBasicScenario-820002800-project] 10.222.0.43 "GET /compute/v2.1/servers/f8247a13-94cd-45b2-acc8-8717e1260f37" status: 200 len: 1349 microversion: 2.1 time: 0.105172 Sep 13 18:07:47.366099 dv-cinder-852009-8-iscsi devstack@n-api.service[120740]: [pid: 120740|app: 0|req: 345/680] 10.222.0.43 () {58 vars in 1236 bytes} [Tue Sep 13 18:07:47 2022] GET /compute/v2.1/servers/f8247a13-94cd-45b2-acc8-8717e1260f37 => generated 1349 bytes in 106 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 13 18:07:47.695611 dv-cinder-852009-8-iscsi devstack@n-api.service[120741]: DEBUG nova.api.openstack.wsgi [None req-340c8042-83b0-4b86-ac09-ccece9f264db tempest-AttachVolumeTestJSON-555093534 tempest-AttachVolumeTestJSON-555093534-project] Calling method '>' {{(pid=120741) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 18:07:47.696833 dv-cinder-852009-8-iscsi devstack@n-api.service[120741]: DEBUG nova.compute.api [None req-340c8042-83b0-4b86-ac09-ccece9f264db tempest-AttachVolumeTestJSON-555093534 tempest-AttachVolumeTestJSON-555093534-project] [instance: d0983ec1-bb82-4a7d-9dba-ace1e3eb383a] Fetching instance by UUID {{(pid=120741) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 18:07:47.704569 dv-cinder-852009-8-iscsi devstack@n-api.service[120741]: DEBUG oslo_concurrency.lockutils [None req-340c8042-83b0-4b86-ac09-ccece9f264db tempest-AttachVolumeTestJSON-555093534 tempest-AttachVolumeTestJSON-555093534-project] Acquiring lock "1daf4f4c-0e4a-4779-b53a-78c48397ea2f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120741) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 18:07:47.705092 dv-cinder-852009-8-iscsi devstack@n-api.service[120741]: DEBUG oslo_concurrency.lockutils [None req-340c8042-83b0-4b86-ac09-ccece9f264db tempest-AttachVolumeTestJSON-555093534 tempest-AttachVolumeTestJSON-555093534-project] Lock "1daf4f4c-0e4a-4779-b53a-78c48397ea2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120741) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 18:07:47.705508 dv-cinder-852009-8-iscsi devstack@n-api.service[120741]: DEBUG oslo_concurrency.lockutils [None req-340c8042-83b0-4b86-ac09-ccece9f264db tempest-AttachVolumeTestJSON-555093534 tempest-AttachVolumeTestJSON-555093534-project] Lock "1daf4f4c-0e4a-4779-b53a-78c48397ea2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120741) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 18:07:47.706228 dv-cinder-852009-8-iscsi devstack@n-api.service[120741]: DEBUG oslo_concurrency.lockutils [None req-340c8042-83b0-4b86-ac09-ccece9f264db tempest-AttachVolumeTestJSON-555093534 tempest-AttachVolumeTestJSON-555093534-project] Acquiring lock "1daf4f4c-0e4a-4779-b53a-78c48397ea2f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120741) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 18:07:47.706773 dv-cinder-852009-8-iscsi devstack@n-api.service[120741]: DEBUG oslo_concurrency.lockutils [None req-340c8042-83b0-4b86-ac09-ccece9f264db tempest-AttachVolumeTestJSON-555093534 tempest-AttachVolumeTestJSON-555093534-project] Lock "1daf4f4c-0e4a-4779-b53a-78c48397ea2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120741) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 18:07:47.707233 dv-cinder-852009-8-iscsi devstack@n-api.service[120741]: DEBUG oslo_concurrency.lockutils [None req-340c8042-83b0-4b86-ac09-ccece9f264db tempest-AttachVolumeTestJSON-555093534 tempest-AttachVolumeTestJSON-555093534-project] Lock "1daf4f4c-0e4a-4779-b53a-78c48397ea2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120741) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 18:07:47.845387 dv-cinder-852009-8-iscsi devstack@n-api.service[120741]: DEBUG nova.policy [None req-340c8042-83b0-4b86-ac09-ccece9f264db tempest-AttachVolumeTestJSON-555093534 tempest-AttachVolumeTestJSON-555093534-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0625b3113ce044bbac4f6142eaade11c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a279fcbf274c4704a31a2b95061e1469', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120741) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 18:07:47.853260 dv-cinder-852009-8-iscsi devstack@n-api.service[120741]: INFO nova.api.openstack.requestlog [None req-340c8042-83b0-4b86-ac09-ccece9f264db tempest-AttachVolumeTestJSON-555093534 tempest-AttachVolumeTestJSON-555093534-project] 10.222.0.43 "GET /compute/v2.1/servers/d0983ec1-bb82-4a7d-9dba-ace1e3eb383a" status: 200 len: 1675 microversion: 2.1 time: 0.164204 Sep 13 18:07:47.853822 dv-cinder-852009-8-iscsi devstack@n-api.service[120741]: [pid: 120741|app: 0|req: 336/681] 10.222.0.43 () {58 vars in 1236 bytes} [Tue Sep 13 18:07:47 2022] GET /compute/v2.1/servers/d0983ec1-bb82-4a7d-9dba-ace1e3eb383a => generated 1675 bytes in 166 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 13 18:07:48.263436 dv-cinder-852009-8-iscsi devstack@n-api.service[120740]: DEBUG nova.api.openstack.wsgi [None req-fc8ae4f8-c3de-4361-87ab-d998f25cda0c tempest-AttachVolumeShelveTestJSON-385853788 tempest-AttachVolumeShelveTestJSON-385853788-project] Calling method '>' {{(pid=120740) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 18:07:48.264165 dv-cinder-852009-8-iscsi devstack@n-api.service[120740]: DEBUG nova.compute.api [None req-fc8ae4f8-c3de-4361-87ab-d998f25cda0c tempest-AttachVolumeShelveTestJSON-385853788 tempest-AttachVolumeShelveTestJSON-385853788-project] [instance: 8cecf08e-bea8-4cef-9439-0eaa242bfed1] Fetching instance by UUID {{(pid=120740) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 18:07:48.271018 dv-cinder-852009-8-iscsi devstack@n-api.service[120740]: DEBUG oslo_concurrency.lockutils [None req-fc8ae4f8-c3de-4361-87ab-d998f25cda0c tempest-AttachVolumeShelveTestJSON-385853788 tempest-AttachVolumeShelveTestJSON-385853788-project] Acquiring lock "1daf4f4c-0e4a-4779-b53a-78c48397ea2f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120740) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 18:07:48.271646 dv-cinder-852009-8-iscsi devstack@n-api.service[120740]: DEBUG oslo_concurrency.lockutils [None req-fc8ae4f8-c3de-4361-87ab-d998f25cda0c tempest-AttachVolumeShelveTestJSON-385853788 tempest-AttachVolumeShelveTestJSON-385853788-project] Lock "1daf4f4c-0e4a-4779-b53a-78c48397ea2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120740) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 18:07:48.271927 dv-cinder-852009-8-iscsi devstack@n-api.service[120740]: DEBUG oslo_concurrency.lockutils [None req-fc8ae4f8-c3de-4361-87ab-d998f25cda0c tempest-AttachVolumeShelveTestJSON-385853788 tempest-AttachVolumeShelveTestJSON-385853788-project] Lock "1daf4f4c-0e4a-4779-b53a-78c48397ea2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120740) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 18:07:48.272679 dv-cinder-852009-8-iscsi devstack@n-api.service[120740]: DEBUG oslo_concurrency.lockutils [None req-fc8ae4f8-c3de-4361-87ab-d998f25cda0c tempest-AttachVolumeShelveTestJSON-385853788 tempest-AttachVolumeShelveTestJSON-385853788-project] Acquiring lock "1daf4f4c-0e4a-4779-b53a-78c48397ea2f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120740) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 18:07:48.273135 dv-cinder-852009-8-iscsi devstack@n-api.service[120740]: DEBUG oslo_concurrency.lockutils [None req-fc8ae4f8-c3de-4361-87ab-d998f25cda0c tempest-AttachVolumeShelveTestJSON-385853788 tempest-AttachVolumeShelveTestJSON-385853788-project] Lock "1daf4f4c-0e4a-4779-b53a-78c48397ea2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120740) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 18:07:48.273561 dv-cinder-852009-8-iscsi devstack@n-api.service[120740]: DEBUG oslo_concurrency.lockutils [None req-fc8ae4f8-c3de-4361-87ab-d998f25cda0c tempest-AttachVolumeShelveTestJSON-385853788 tempest-AttachVolumeShelveTestJSON-385853788-project] Lock "1daf4f4c-0e4a-4779-b53a-78c48397ea2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120740) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 18:07:48.390297 dv-cinder-852009-8-iscsi devstack@n-api.service[120741]: DEBUG nova.api.openstack.wsgi [None req-afc16161-81c6-4049-87c6-97142bac4941 tempest-TestMinimumBasicScenario-820002800 tempest-TestMinimumBasicScenario-820002800-project] Calling method '>' {{(pid=120741) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 18:07:48.391555 dv-cinder-852009-8-iscsi devstack@n-api.service[120741]: DEBUG nova.compute.api [None req-afc16161-81c6-4049-87c6-97142bac4941 tempest-TestMinimumBasicScenario-820002800 tempest-TestMinimumBasicScenario-820002800-project] [instance: f8247a13-94cd-45b2-acc8-8717e1260f37] Fetching instance by UUID {{(pid=120741) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 18:07:48.398715 dv-cinder-852009-8-iscsi devstack@n-api.service[120741]: DEBUG oslo_concurrency.lockutils [None req-afc16161-81c6-4049-87c6-97142bac4941 tempest-TestMinimumBasicScenario-820002800 tempest-TestMinimumBasicScenario-820002800-project] Acquiring lock "1daf4f4c-0e4a-4779-b53a-78c48397ea2f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120741) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 18:07:48.399242 dv-cinder-852009-8-iscsi devstack@n-api.service[120741]: DEBUG oslo_concurrency.lockutils [None req-afc16161-81c6-4049-87c6-97142bac4941 tempest-TestMinimumBasicScenario-820002800 tempest-TestMinimumBasicScenario-820002800-project] Lock "1daf4f4c-0e4a-4779-b53a-78c48397ea2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120741) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 18:07:48.399716 dv-cinder-852009-8-iscsi devstack@n-api.service[120741]: DEBUG oslo_concurrency.lockutils [None req-afc16161-81c6-4049-87c6-97142bac4941 tempest-TestMinimumBasicScenario-820002800 tempest-TestMinimumBasicScenario-820002800-project] Lock "1daf4f4c-0e4a-4779-b53a-78c48397ea2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120741) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 18:07:48.400719 dv-cinder-852009-8-iscsi devstack@n-api.service[120741]: DEBUG oslo_concurrency.lockutils [None req-afc16161-81c6-4049-87c6-97142bac4941 tempest-TestMinimumBasicScenario-820002800 tempest-TestMinimumBasicScenario-820002800-project] Acquiring lock "1daf4f4c-0e4a-4779-b53a-78c48397ea2f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120741) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 18:07:48.401195 dv-cinder-852009-8-iscsi devstack@n-api.service[120741]: DEBUG oslo_concurrency.lockutils [None req-afc16161-81c6-4049-87c6-97142bac4941 tempest-TestMinimumBasicScenario-820002800 tempest-TestMinimumBasicScenario-820002800-project] Lock "1daf4f4c-0e4a-4779-b53a-78c48397ea2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120741) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 18:07:48.401608 dv-cinder-852009-8-iscsi devstack@n-api.service[120741]: DEBUG oslo_concurrency.lockutils [None req-afc16161-81c6-4049-87c6-97142bac4941 tempest-TestMinimumBasicScenario-820002800 tempest-TestMinimumBasicScenario-820002800-project] Lock "1daf4f4c-0e4a-4779-b53a-78c48397ea2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120741) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 18:07:48.404131 dv-cinder-852009-8-iscsi devstack@n-api.service[120740]: DEBUG nova.policy [None req-fc8ae4f8-c3de-4361-87ab-d998f25cda0c tempest-AttachVolumeShelveTestJSON-385853788 tempest-AttachVolumeShelveTestJSON-385853788-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e68ecd9b3ca643539b109f75bb242d6f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '75e14fd88bfb4cd896fa7b070a0fac47', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120740) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 18:07:48.412656 dv-cinder-852009-8-iscsi devstack@n-api.service[120740]: DEBUG nova.policy [None req-fc8ae4f8-c3de-4361-87ab-d998f25cda0c tempest-AttachVolumeShelveTestJSON-385853788 tempest-AttachVolumeShelveTestJSON-385853788-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'e68ecd9b3ca643539b109f75bb242d6f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '75e14fd88bfb4cd896fa7b070a0fac47', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120740) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 18:07:48.414087 dv-cinder-852009-8-iscsi devstack@n-api.service[120740]: DEBUG nova.policy [None req-fc8ae4f8-c3de-4361-87ab-d998f25cda0c tempest-AttachVolumeShelveTestJSON-385853788 tempest-AttachVolumeShelveTestJSON-385853788-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'e68ecd9b3ca643539b109f75bb242d6f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '75e14fd88bfb4cd896fa7b070a0fac47', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120740) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 18:07:48.415232 dv-cinder-852009-8-iscsi devstack@n-api.service[120740]: INFO nova.api.openstack.requestlog [None req-fc8ae4f8-c3de-4361-87ab-d998f25cda0c tempest-AttachVolumeShelveTestJSON-385853788 tempest-AttachVolumeShelveTestJSON-385853788-project] 10.222.0.43 "GET /compute/v2.1/servers/8cecf08e-bea8-4cef-9439-0eaa242bfed1" status: 200 len: 1729 microversion: 2.20 time: 0.155851 Sep 13 18:07:48.415780 dv-cinder-852009-8-iscsi devstack@n-api.service[120740]: [pid: 120740|app: 0|req: 346/682] 10.222.0.43 () {60 vars in 1277 bytes} [Tue Sep 13 18:07:48 2022] GET /compute/v2.1/servers/8cecf08e-bea8-4cef-9439-0eaa242bfed1 => generated 1729 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 13 18:07:48.433885 dv-cinder-852009-8-iscsi devstack@n-api.service[120741]: DEBUG oslo_concurrency.lockutils [None req-afc16161-81c6-4049-87c6-97142bac4941 tempest-TestMinimumBasicScenario-820002800 tempest-TestMinimumBasicScenario-820002800-project] Acquiring lock "1daf4f4c-0e4a-4779-b53a-78c48397ea2f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120741) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 18:07:48.434424 dv-cinder-852009-8-iscsi devstack@n-api.service[120741]: DEBUG oslo_concurrency.lockutils [None req-afc16161-81c6-4049-87c6-97142bac4941 tempest-TestMinimumBasicScenario-820002800 tempest-TestMinimumBasicScenario-820002800-project] Lock "1daf4f4c-0e4a-4779-b53a-78c48397ea2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120741) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 18:07:48.434851 dv-cinder-852009-8-iscsi devstack@n-api.service[120741]: DEBUG oslo_concurrency.lockutils [None req-afc16161-81c6-4049-87c6-97142bac4941 tempest-TestMinimumBasicScenario-820002800 tempest-TestMinimumBasicScenario-820002800-project] Lock "1daf4f4c-0e4a-4779-b53a-78c48397ea2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120741) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 18:07:48.435295 dv-cinder-852009-8-iscsi devstack@n-api.service[120741]: DEBUG nova.objects.instance [None req-afc16161-81c6-4049-87c6-97142bac4941 tempest-TestMinimumBasicScenario-820002800 tempest-TestMinimumBasicScenario-820002800-project] Lazy-loading 'fault' on Instance uuid f8247a13-94cd-45b2-acc8-8717e1260f37 {{(pid=120741) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Sep 13 18:07:48.478778 dv-cinder-852009-8-iscsi devstack@n-api.service[120741]: DEBUG nova.policy [None req-afc16161-81c6-4049-87c6-97142bac4941 tempest-TestMinimumBasicScenario-820002800 tempest-TestMinimumBasicScenario-820002800-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7880064ff0aa448d9c367c89eba145ff', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2f6832936c824066a4370cc45c5b0282', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120741) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 18:07:48.486850 dv-cinder-852009-8-iscsi devstack@n-api.service[120741]: INFO nova.api.openstack.requestlog [None req-afc16161-81c6-4049-87c6-97142bac4941 tempest-TestMinimumBasicScenario-820002800 tempest-TestMinimumBasicScenario-820002800-project] 10.222.0.43 "GET /compute/v2.1/servers/f8247a13-94cd-45b2-acc8-8717e1260f37" status: 200 len: 1349 microversion: 2.1 time: 0.101827 Sep 13 18:07:48.487399 dv-cinder-852009-8-iscsi devstack@n-api.service[120741]: [pid: 120741|app: 0|req: 337/683] 10.222.0.43 () {58 vars in 1236 bytes} [Tue Sep 13 18:07:48 2022] GET /compute/v2.1/servers/f8247a13-94cd-45b2-acc8-8717e1260f37 => generated 1349 bytes in 103 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 13 18:07:48.878984 dv-cinder-852009-8-iscsi devstack@n-api.service[120740]: DEBUG nova.api.openstack.wsgi [None req-05b965d3-d2a4-4b43-bc2a-aaffd0f4fbbf tempest-AttachVolumeTestJSON-555093534 tempest-AttachVolumeTestJSON-555093534-project] Calling method '>' {{(pid=120740) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 18:07:48.879595 dv-cinder-852009-8-iscsi devstack@n-api.service[120740]: DEBUG nova.compute.api [None req-05b965d3-d2a4-4b43-bc2a-aaffd0f4fbbf tempest-AttachVolumeTestJSON-555093534 tempest-AttachVolumeTestJSON-555093534-project] [instance: d0983ec1-bb82-4a7d-9dba-ace1e3eb383a] Fetching instance by UUID {{(pid=120740) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 18:07:48.886144 dv-cinder-852009-8-iscsi devstack@n-api.service[120740]: DEBUG oslo_concurrency.lockutils [None req-05b965d3-d2a4-4b43-bc2a-aaffd0f4fbbf tempest-AttachVolumeTestJSON-555093534 tempest-AttachVolumeTestJSON-555093534-project] Acquiring lock "1daf4f4c-0e4a-4779-b53a-78c48397ea2f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120740) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 18:07:48.886809 dv-cinder-852009-8-iscsi devstack@n-api.service[120740]: DEBUG oslo_concurrency.lockutils [None req-05b965d3-d2a4-4b43-bc2a-aaffd0f4fbbf tempest-AttachVolumeTestJSON-555093534 tempest-AttachVolumeTestJSON-555093534-project] Lock "1daf4f4c-0e4a-4779-b53a-78c48397ea2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120740) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 18:07:48.887238 dv-cinder-852009-8-iscsi devstack@n-api.service[120740]: DEBUG oslo_concurrency.lockutils [None req-05b965d3-d2a4-4b43-bc2a-aaffd0f4fbbf tempest-AttachVolumeTestJSON-555093534 tempest-AttachVolumeTestJSON-555093534-project] Lock "1daf4f4c-0e4a-4779-b53a-78c48397ea2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120740) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 18:07:48.887936 dv-cinder-852009-8-iscsi devstack@n-api.service[120740]: DEBUG oslo_concurrency.lockutils [None req-05b965d3-d2a4-4b43-bc2a-aaffd0f4fbbf tempest-AttachVolumeTestJSON-555093534 tempest-AttachVolumeTestJSON-555093534-project] Acquiring lock "1daf4f4c-0e4a-4779-b53a-78c48397ea2f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120740) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 18:07:48.888381 dv-cinder-852009-8-iscsi devstack@n-api.service[120740]: DEBUG oslo_concurrency.lockutils [None req-05b965d3-d2a4-4b43-bc2a-aaffd0f4fbbf tempest-AttachVolumeTestJSON-555093534 tempest-AttachVolumeTestJSON-555093534-project] Lock "1daf4f4c-0e4a-4779-b53a-78c48397ea2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120740) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 18:07:48.888824 dv-cinder-852009-8-iscsi devstack@n-api.service[120740]: DEBUG oslo_concurrency.lockutils [None req-05b965d3-d2a4-4b43-bc2a-aaffd0f4fbbf tempest-AttachVolumeTestJSON-555093534 tempest-AttachVolumeTestJSON-555093534-project] Lock "1daf4f4c-0e4a-4779-b53a-78c48397ea2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120740) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 18:07:49.061279 dv-cinder-852009-8-iscsi devstack@n-api.service[120740]: DEBUG nova.policy [None req-05b965d3-d2a4-4b43-bc2a-aaffd0f4fbbf tempest-AttachVolumeTestJSON-555093534 tempest-AttachVolumeTestJSON-555093534-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0625b3113ce044bbac4f6142eaade11c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a279fcbf274c4704a31a2b95061e1469', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120740) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 18:07:49.069099 dv-cinder-852009-8-iscsi devstack@n-api.service[120740]: INFO nova.api.openstack.requestlog [None req-05b965d3-d2a4-4b43-bc2a-aaffd0f4fbbf tempest-AttachVolumeTestJSON-555093534 tempest-AttachVolumeTestJSON-555093534-project] 10.222.0.43 "GET /compute/v2.1/servers/d0983ec1-bb82-4a7d-9dba-ace1e3eb383a" status: 200 len: 1675 microversion: 2.1 time: 0.196886 Sep 13 18:07:49.081543 dv-cinder-852009-8-iscsi devstack@n-api.service[120740]: [pid: 120740|app: 0|req: 347/684] 10.222.0.43 () {58 vars in 1236 bytes} [Tue Sep 13 18:07:48 2022] GET /compute/v2.1/servers/d0983ec1-bb82-4a7d-9dba-ace1e3eb383a => generated 1675 bytes in 210 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 13 18:07:49.377446 dv-cinder-852009-8-iscsi devstack@n-api.service[120741]: DEBUG nova.api.openstack.wsgi [req-34cd1603-272e-4e38-b540-aa24a722d71c req-0fc7a640-62dc-4ef0-bdf1-dd7eabbe8889 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "d0983ec1-bb82-4a7d-9dba-ace1e3eb383a", "name": "network-vif-deleted", "tag": "074897ee-2ee0-4645-801c-17076daefc87"}]} {{(pid=120741) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 13 18:07:49.387218 dv-cinder-852009-8-iscsi devstack@n-api.service[120741]: DEBUG oslo_concurrency.lockutils [req-34cd1603-272e-4e38-b540-aa24a722d71c req-0fc7a640-62dc-4ef0-bdf1-dd7eabbe8889 service nova] Acquiring lock "1daf4f4c-0e4a-4779-b53a-78c48397ea2f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120741) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 18:07:49.387692 dv-cinder-852009-8-iscsi devstack@n-api.service[120741]: DEBUG oslo_concurrency.lockutils [req-34cd1603-272e-4e38-b540-aa24a722d71c req-0fc7a640-62dc-4ef0-bdf1-dd7eabbe8889 service nova] Lock "1daf4f4c-0e4a-4779-b53a-78c48397ea2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120741) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 18:07:49.388149 dv-cinder-852009-8-iscsi devstack@n-api.service[120741]: DEBUG oslo_concurrency.lockutils [req-34cd1603-272e-4e38-b540-aa24a722d71c req-0fc7a640-62dc-4ef0-bdf1-dd7eabbe8889 service nova] Lock "1daf4f4c-0e4a-4779-b53a-78c48397ea2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120741) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 18:07:49.400031 dv-cinder-852009-8-iscsi devstack@n-api.service[120741]: INFO nova.api.openstack.compute.server_external_events [req-34cd1603-272e-4e38-b540-aa24a722d71c req-0fc7a640-62dc-4ef0-bdf1-dd7eabbe8889 service nova] Creating event network-vif-deleted:074897ee-2ee0-4645-801c-17076daefc87 for instance d0983ec1-bb82-4a7d-9dba-ace1e3eb383a on hv-cinder-85200 Sep 13 18:07:49.405090 dv-cinder-852009-8-iscsi devstack@n-api.service[120741]: INFO nova.api.openstack.requestlog [req-34cd1603-272e-4e38-b540-aa24a722d71c req-0fc7a640-62dc-4ef0-bdf1-dd7eabbe8889 service nova] 10.222.0.43 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.031992 Sep 13 18:07:49.405704 dv-cinder-852009-8-iscsi devstack@n-api.service[120741]: [pid: 120741|app: 0|req: 338/685] 10.222.0.43 () {64 vars in 1317 bytes} [Tue Sep 13 18:07:49 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 33 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 13 18:07:49.441262 dv-cinder-852009-8-iscsi devstack@n-api.service[120740]: DEBUG nova.api.openstack.wsgi [None req-1db6eb87-0097-470b-a276-0b28b85dbe2f tempest-AttachVolumeShelveTestJSON-385853788 tempest-AttachVolumeShelveTestJSON-385853788-project] Calling method '>' {{(pid=120740) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 18:07:49.441971 dv-cinder-852009-8-iscsi devstack@n-api.service[120740]: DEBUG nova.compute.api [None req-1db6eb87-0097-470b-a276-0b28b85dbe2f tempest-AttachVolumeShelveTestJSON-385853788 tempest-AttachVolumeShelveTestJSON-385853788-project] [instance: 8cecf08e-bea8-4cef-9439-0eaa242bfed1] Fetching instance by UUID {{(pid=120740) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 18:07:49.445834 dv-cinder-852009-8-iscsi devstack@n-api.service[120740]: DEBUG dbcounter [-] [120740] Writing DB stats nova_api:SELECT=80,nova_api:UPDATE=3 {{(pid=120740) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 18:07:49.450869 dv-cinder-852009-8-iscsi devstack@n-api.service[120740]: DEBUG oslo_concurrency.lockutils [None req-1db6eb87-0097-470b-a276-0b28b85dbe2f tempest-AttachVolumeShelveTestJSON-385853788 tempest-AttachVolumeShelveTestJSON-385853788-project] Acquiring lock "1daf4f4c-0e4a-4779-b53a-78c48397ea2f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120740) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 18:07:49.451570 dv-cinder-852009-8-iscsi devstack@n-api.service[120740]: DEBUG oslo_concurrency.lockutils [None req-1db6eb87-0097-470b-a276-0b28b85dbe2f tempest-AttachVolumeShelveTestJSON-385853788 tempest-AttachVolumeShelveTestJSON-385853788-project] Lock "1daf4f4c-0e4a-4779-b53a-78c48397ea2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120740) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 18:07:49.452171 dv-cinder-852009-8-iscsi devstack@n-api.service[120740]: DEBUG oslo_concurrency.lockutils [None req-1db6eb87-0097-470b-a276-0b28b85dbe2f tempest-AttachVolumeShelveTestJSON-385853788 tempest-AttachVolumeShelveTestJSON-385853788-project] Lock "1daf4f4c-0e4a-4779-b53a-78c48397ea2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120740) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 18:07:49.453079 dv-cinder-852009-8-iscsi devstack@n-api.service[120740]: DEBUG oslo_concurrency.lockutils [None req-1db6eb87-0097-470b-a276-0b28b85dbe2f tempest-AttachVolumeShelveTestJSON-385853788 tempest-AttachVolumeShelveTestJSON-385853788-project] Acquiring lock "1daf4f4c-0e4a-4779-b53a-78c48397ea2f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120740) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 18:07:49.453531 dv-cinder-852009-8-iscsi devstack@n-api.service[120740]: DEBUG oslo_concurrency.lockutils [None req-1db6eb87-0097-470b-a276-0b28b85dbe2f tempest-AttachVolumeShelveTestJSON-385853788 tempest-AttachVolumeShelveTestJSON-385853788-project] Lock "1daf4f4c-0e4a-4779-b53a-78c48397ea2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120740) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 18:07:49.453950 dv-cinder-852009-8-iscsi devstack@n-api.service[120740]: DEBUG oslo_concurrency.lockutils [None req-1db6eb87-0097-470b-a276-0b28b85dbe2f tempest-AttachVolumeShelveTestJSON-385853788 tempest-AttachVolumeShelveTestJSON-385853788-project] Lock "1daf4f4c-0e4a-4779-b53a-78c48397ea2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120740) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 18:07:49.473122 dv-cinder-852009-8-iscsi devstack@n-api.service[120740]: DEBUG dbcounter [-] [120740] Writing DB stats nova_cell1:SELECT=97,nova_cell1:INSERT=2,nova_cell1:UPDATE=1 {{(pid=120740) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 18:07:49.511792 dv-cinder-852009-8-iscsi devstack@n-api.service[120741]: DEBUG nova.api.openstack.wsgi [None req-e9d85112-1d7e-41fc-944b-1b75a99553c4 tempest-TestMinimumBasicScenario-820002800 tempest-TestMinimumBasicScenario-820002800-project] Calling method '>' {{(pid=120741) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 18:07:49.512905 dv-cinder-852009-8-iscsi devstack@n-api.service[120741]: DEBUG nova.compute.api [None req-e9d85112-1d7e-41fc-944b-1b75a99553c4 tempest-TestMinimumBasicScenario-820002800 tempest-TestMinimumBasicScenario-820002800-project] [instance: f8247a13-94cd-45b2-acc8-8717e1260f37] Fetching instance by UUID {{(pid=120741) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 18:07:49.519918 dv-cinder-852009-8-iscsi devstack@n-api.service[120741]: DEBUG oslo_concurrency.lockutils [None req-e9d85112-1d7e-41fc-944b-1b75a99553c4 tempest-TestMinimumBasicScenario-820002800 tempest-TestMinimumBasicScenario-820002800-project] Acquiring lock "1daf4f4c-0e4a-4779-b53a-78c48397ea2f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120741) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 18:07:49.520935 dv-cinder-852009-8-iscsi devstack@n-api.service[120741]: DEBUG oslo_concurrency.lockutils [None req-e9d85112-1d7e-41fc-944b-1b75a99553c4 tempest-TestMinimumBasicScenario-820002800 tempest-TestMinimumBasicScenario-820002800-project] Lock "1daf4f4c-0e4a-4779-b53a-78c48397ea2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120741) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 18:07:49.521546 dv-cinder-852009-8-iscsi devstack@n-api.service[120741]: DEBUG oslo_concurrency.lockutils [None req-e9d85112-1d7e-41fc-944b-1b75a99553c4 tempest-TestMinimumBasicScenario-820002800 tempest-TestMinimumBasicScenario-820002800-project] Lock "1daf4f4c-0e4a-4779-b53a-78c48397ea2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120741) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 18:07:49.522514 dv-cinder-852009-8-iscsi devstack@n-api.service[120741]: DEBUG oslo_concurrency.lockutils [None req-e9d85112-1d7e-41fc-944b-1b75a99553c4 tempest-TestMinimumBasicScenario-820002800 tempest-TestMinimumBasicScenario-820002800-project] Acquiring lock "1daf4f4c-0e4a-4779-b53a-78c48397ea2f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120741) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 18:07:49.523274 dv-cinder-852009-8-iscsi devstack@n-api.service[120741]: DEBUG oslo_concurrency.lockutils [None req-e9d85112-1d7e-41fc-944b-1b75a99553c4 tempest-TestMinimumBasicScenario-820002800 tempest-TestMinimumBasicScenario-820002800-project] Lock "1daf4f4c-0e4a-4779-b53a-78c48397ea2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120741) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 18:07:49.523877 dv-cinder-852009-8-iscsi devstack@n-api.service[120741]: DEBUG oslo_concurrency.lockutils [None req-e9d85112-1d7e-41fc-944b-1b75a99553c4 tempest-TestMinimumBasicScenario-820002800 tempest-TestMinimumBasicScenario-820002800-project] Lock "1daf4f4c-0e4a-4779-b53a-78c48397ea2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120741) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 18:07:49.565996 dv-cinder-852009-8-iscsi devstack@n-api.service[120741]: DEBUG oslo_concurrency.lockutils [None req-e9d85112-1d7e-41fc-944b-1b75a99553c4 tempest-TestMinimumBasicScenario-820002800 tempest-TestMinimumBasicScenario-820002800-project] Acquiring lock "1daf4f4c-0e4a-4779-b53a-78c48397ea2f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120741) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 18:07:49.566502 dv-cinder-852009-8-iscsi devstack@n-api.service[120741]: DEBUG oslo_concurrency.lockutils [None req-e9d85112-1d7e-41fc-944b-1b75a99553c4 tempest-TestMinimumBasicScenario-820002800 tempest-TestMinimumBasicScenario-820002800-project] Lock "1daf4f4c-0e4a-4779-b53a-78c48397ea2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120741) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 18:07:49.566944 dv-cinder-852009-8-iscsi devstack@n-api.service[120741]: DEBUG oslo_concurrency.lockutils [None req-e9d85112-1d7e-41fc-944b-1b75a99553c4 tempest-TestMinimumBasicScenario-820002800 tempest-TestMinimumBasicScenario-820002800-project] Lock "1daf4f4c-0e4a-4779-b53a-78c48397ea2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120741) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 18:07:49.567374 dv-cinder-852009-8-iscsi devstack@n-api.service[120741]: DEBUG nova.objects.instance [None req-e9d85112-1d7e-41fc-944b-1b75a99553c4 tempest-TestMinimumBasicScenario-820002800 tempest-TestMinimumBasicScenario-820002800-project] Lazy-loading 'fault' on Instance uuid f8247a13-94cd-45b2-acc8-8717e1260f37 {{(pid=120741) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Sep 13 18:07:49.624974 dv-cinder-852009-8-iscsi devstack@n-api.service[120741]: DEBUG nova.policy [None req-e9d85112-1d7e-41fc-944b-1b75a99553c4 tempest-TestMinimumBasicScenario-820002800 tempest-TestMinimumBasicScenario-820002800-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7880064ff0aa448d9c367c89eba145ff', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2f6832936c824066a4370cc45c5b0282', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120741) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 18:07:49.628933 dv-cinder-852009-8-iscsi devstack@n-api.service[120740]: DEBUG nova.policy [None req-1db6eb87-0097-470b-a276-0b28b85dbe2f tempest-AttachVolumeShelveTestJSON-385853788 tempest-AttachVolumeShelveTestJSON-385853788-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e68ecd9b3ca643539b109f75bb242d6f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '75e14fd88bfb4cd896fa7b070a0fac47', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120740) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 18:07:49.633509 dv-cinder-852009-8-iscsi devstack@n-api.service[120741]: INFO nova.api.openstack.requestlog [None req-e9d85112-1d7e-41fc-944b-1b75a99553c4 tempest-TestMinimumBasicScenario-820002800 tempest-TestMinimumBasicScenario-820002800-project] 10.222.0.43 "GET /compute/v2.1/servers/f8247a13-94cd-45b2-acc8-8717e1260f37" status: 200 len: 1349 microversion: 2.1 time: 0.126529 Sep 13 18:07:49.641650 dv-cinder-852009-8-iscsi devstack@n-api.service[120741]: [pid: 120741|app: 0|req: 339/686] 10.222.0.43 () {58 vars in 1236 bytes} [Tue Sep 13 18:07:49 2022] GET /compute/v2.1/servers/f8247a13-94cd-45b2-acc8-8717e1260f37 => generated 1349 bytes in 128 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 13 18:07:49.641809 dv-cinder-852009-8-iscsi devstack@n-api.service[120740]: DEBUG nova.policy [None req-1db6eb87-0097-470b-a276-0b28b85dbe2f tempest-AttachVolumeShelveTestJSON-385853788 tempest-AttachVolumeShelveTestJSON-385853788-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'e68ecd9b3ca643539b109f75bb242d6f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '75e14fd88bfb4cd896fa7b070a0fac47', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120740) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 18:07:49.641809 dv-cinder-852009-8-iscsi devstack@n-api.service[120740]: DEBUG nova.policy [None req-1db6eb87-0097-470b-a276-0b28b85dbe2f tempest-AttachVolumeShelveTestJSON-385853788 tempest-AttachVolumeShelveTestJSON-385853788-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'e68ecd9b3ca643539b109f75bb242d6f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '75e14fd88bfb4cd896fa7b070a0fac47', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120740) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 18:07:49.641809 dv-cinder-852009-8-iscsi devstack@n-api.service[120740]: INFO nova.api.openstack.requestlog [None req-1db6eb87-0097-470b-a276-0b28b85dbe2f tempest-AttachVolumeShelveTestJSON-385853788 tempest-AttachVolumeShelveTestJSON-385853788-project] 10.222.0.43 "GET /compute/v2.1/servers/8cecf08e-bea8-4cef-9439-0eaa242bfed1" status: 200 len: 1729 microversion: 2.20 time: 0.203862 Sep 13 18:07:49.642093 dv-cinder-852009-8-iscsi devstack@n-api.service[120740]: [pid: 120740|app: 0|req: 348/687] 10.222.0.43 () {60 vars in 1277 bytes} [Tue Sep 13 18:07:49 2022] GET /compute/v2.1/servers/8cecf08e-bea8-4cef-9439-0eaa242bfed1 => generated 1729 bytes in 205 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 13 18:07:50.093829 dv-cinder-852009-8-iscsi devstack@n-api.service[120741]: DEBUG nova.api.openstack.wsgi [None req-0488c7c7-ebd9-4b08-9a5a-bcbd8f8fe885 tempest-AttachVolumeTestJSON-555093534 tempest-AttachVolumeTestJSON-555093534-project] Calling method '>' {{(pid=120741) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 18:07:50.094446 dv-cinder-852009-8-iscsi devstack@n-api.service[120741]: DEBUG nova.compute.api [None req-0488c7c7-ebd9-4b08-9a5a-bcbd8f8fe885 tempest-AttachVolumeTestJSON-555093534 tempest-AttachVolumeTestJSON-555093534-project] [instance: d0983ec1-bb82-4a7d-9dba-ace1e3eb383a] Fetching instance by UUID {{(pid=120741) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 18:07:50.101126 dv-cinder-852009-8-iscsi devstack@n-api.service[120741]: DEBUG oslo_concurrency.lockutils [None req-0488c7c7-ebd9-4b08-9a5a-bcbd8f8fe885 tempest-AttachVolumeTestJSON-555093534 tempest-AttachVolumeTestJSON-555093534-project] Acquiring lock "1daf4f4c-0e4a-4779-b53a-78c48397ea2f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120741) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 18:07:50.101594 dv-cinder-852009-8-iscsi devstack@n-api.service[120741]: DEBUG oslo_concurrency.lockutils [None req-0488c7c7-ebd9-4b08-9a5a-bcbd8f8fe885 tempest-AttachVolumeTestJSON-555093534 tempest-AttachVolumeTestJSON-555093534-project] Lock "1daf4f4c-0e4a-4779-b53a-78c48397ea2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120741) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 18:07:50.102043 dv-cinder-852009-8-iscsi devstack@n-api.service[120741]: DEBUG oslo_concurrency.lockutils [None req-0488c7c7-ebd9-4b08-9a5a-bcbd8f8fe885 tempest-AttachVolumeTestJSON-555093534 tempest-AttachVolumeTestJSON-555093534-project] Lock "1daf4f4c-0e4a-4779-b53a-78c48397ea2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120741) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 18:07:50.102796 dv-cinder-852009-8-iscsi devstack@n-api.service[120741]: DEBUG oslo_concurrency.lockutils [None req-0488c7c7-ebd9-4b08-9a5a-bcbd8f8fe885 tempest-AttachVolumeTestJSON-555093534 tempest-AttachVolumeTestJSON-555093534-project] Acquiring lock "1daf4f4c-0e4a-4779-b53a-78c48397ea2f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120741) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 18:07:50.103215 dv-cinder-852009-8-iscsi devstack@n-api.service[120741]: DEBUG oslo_concurrency.lockutils [None req-0488c7c7-ebd9-4b08-9a5a-bcbd8f8fe885 tempest-AttachVolumeTestJSON-555093534 tempest-AttachVolumeTestJSON-555093534-project] Lock "1daf4f4c-0e4a-4779-b53a-78c48397ea2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120741) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 18:07:50.103846 dv-cinder-852009-8-iscsi devstack@n-api.service[120741]: DEBUG oslo_concurrency.lockutils [None req-0488c7c7-ebd9-4b08-9a5a-bcbd8f8fe885 tempest-AttachVolumeTestJSON-555093534 tempest-AttachVolumeTestJSON-555093534-project] Lock "1daf4f4c-0e4a-4779-b53a-78c48397ea2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120741) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 18:07:50.166757 dv-cinder-852009-8-iscsi devstack@n-api.service[120741]: DEBUG nova.policy [None req-0488c7c7-ebd9-4b08-9a5a-bcbd8f8fe885 tempest-AttachVolumeTestJSON-555093534 tempest-AttachVolumeTestJSON-555093534-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0625b3113ce044bbac4f6142eaade11c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a279fcbf274c4704a31a2b95061e1469', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120741) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 18:07:50.175012 dv-cinder-852009-8-iscsi devstack@n-api.service[120741]: INFO nova.api.openstack.requestlog [None req-0488c7c7-ebd9-4b08-9a5a-bcbd8f8fe885 tempest-AttachVolumeTestJSON-555093534 tempest-AttachVolumeTestJSON-555093534-project] 10.222.0.43 "GET /compute/v2.1/servers/d0983ec1-bb82-4a7d-9dba-ace1e3eb383a" status: 200 len: 1607 microversion: 2.1 time: 0.085136 Sep 13 18:07:50.175616 dv-cinder-852009-8-iscsi devstack@n-api.service[120741]: [pid: 120741|app: 0|req: 340/688] 10.222.0.43 () {58 vars in 1236 bytes} [Tue Sep 13 18:07:50 2022] GET /compute/v2.1/servers/d0983ec1-bb82-4a7d-9dba-ace1e3eb383a => generated 1607 bytes in 86 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 13 18:07:50.661144 dv-cinder-852009-8-iscsi devstack@n-api.service[120740]: DEBUG nova.api.openstack.wsgi [None req-a02853f2-1d25-491f-a972-f8df4bfdabc6 tempest-TestMinimumBasicScenario-820002800 tempest-TestMinimumBasicScenario-820002800-project] Calling method '>' {{(pid=120740) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 18:07:50.662098 dv-cinder-852009-8-iscsi devstack@n-api.service[120740]: DEBUG nova.compute.api [None req-a02853f2-1d25-491f-a972-f8df4bfdabc6 tempest-TestMinimumBasicScenario-820002800 tempest-TestMinimumBasicScenario-820002800-project] [instance: f8247a13-94cd-45b2-acc8-8717e1260f37] Fetching instance by UUID {{(pid=120740) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 18:07:50.669989 dv-cinder-852009-8-iscsi devstack@n-api.service[120741]: DEBUG nova.api.openstack.wsgi [None req-1f1154ba-d99e-4e29-8445-82d31a079b70 tempest-AttachVolumeShelveTestJSON-385853788 tempest-AttachVolumeShelveTestJSON-385853788-project] Calling method '>' {{(pid=120741) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 18:07:50.670901 dv-cinder-852009-8-iscsi devstack@n-api.service[120741]: DEBUG nova.compute.api [None req-1f1154ba-d99e-4e29-8445-82d31a079b70 tempest-AttachVolumeShelveTestJSON-385853788 tempest-AttachVolumeShelveTestJSON-385853788-project] [instance: 8cecf08e-bea8-4cef-9439-0eaa242bfed1] Fetching instance by UUID {{(pid=120741) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 18:07:50.671978 dv-cinder-852009-8-iscsi devstack@n-api.service[120740]: DEBUG oslo_concurrency.lockutils [None req-a02853f2-1d25-491f-a972-f8df4bfdabc6 tempest-TestMinimumBasicScenario-820002800 tempest-TestMinimumBasicScenario-820002800-project] Acquiring lock "1daf4f4c-0e4a-4779-b53a-78c48397ea2f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120740) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 18:07:50.672467 dv-cinder-852009-8-iscsi devstack@n-api.service[120740]: DEBUG oslo_concurrency.lockutils [None req-a02853f2-1d25-491f-a972-f8df4bfdabc6 tempest-TestMinimumBasicScenario-820002800 tempest-TestMinimumBasicScenario-820002800-project] Lock "1daf4f4c-0e4a-4779-b53a-78c48397ea2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120740) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 18:07:50.672908 dv-cinder-852009-8-iscsi devstack@n-api.service[120740]: DEBUG oslo_concurrency.lockutils [None req-a02853f2-1d25-491f-a972-f8df4bfdabc6 tempest-TestMinimumBasicScenario-820002800 tempest-TestMinimumBasicScenario-820002800-project] Lock "1daf4f4c-0e4a-4779-b53a-78c48397ea2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120740) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 18:07:50.673590 dv-cinder-852009-8-iscsi devstack@n-api.service[120740]: DEBUG oslo_concurrency.lockutils [None req-a02853f2-1d25-491f-a972-f8df4bfdabc6 tempest-TestMinimumBasicScenario-820002800 tempest-TestMinimumBasicScenario-820002800-project] Acquiring lock "1daf4f4c-0e4a-4779-b53a-78c48397ea2f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120740) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 18:07:50.674030 dv-cinder-852009-8-iscsi devstack@n-api.service[120740]: DEBUG oslo_concurrency.lockutils [None req-a02853f2-1d25-491f-a972-f8df4bfdabc6 tempest-TestMinimumBasicScenario-820002800 tempest-TestMinimumBasicScenario-820002800-project] Lock "1daf4f4c-0e4a-4779-b53a-78c48397ea2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120740) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 18:07:50.674442 dv-cinder-852009-8-iscsi devstack@n-api.service[120740]: DEBUG oslo_concurrency.lockutils [None req-a02853f2-1d25-491f-a972-f8df4bfdabc6 tempest-TestMinimumBasicScenario-820002800 tempest-TestMinimumBasicScenario-820002800-project] Lock "1daf4f4c-0e4a-4779-b53a-78c48397ea2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120740) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 18:07:50.677608 dv-cinder-852009-8-iscsi devstack@n-api.service[120741]: DEBUG oslo_concurrency.lockutils [None req-1f1154ba-d99e-4e29-8445-82d31a079b70 tempest-AttachVolumeShelveTestJSON-385853788 tempest-AttachVolumeShelveTestJSON-385853788-project] Acquiring lock "1daf4f4c-0e4a-4779-b53a-78c48397ea2f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120741) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 18:07:50.678097 dv-cinder-852009-8-iscsi devstack@n-api.service[120741]: DEBUG oslo_concurrency.lockutils [None req-1f1154ba-d99e-4e29-8445-82d31a079b70 tempest-AttachVolumeShelveTestJSON-385853788 tempest-AttachVolumeShelveTestJSON-385853788-project] Lock "1daf4f4c-0e4a-4779-b53a-78c48397ea2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120741) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 18:07:50.678556 dv-cinder-852009-8-iscsi devstack@n-api.service[120741]: DEBUG oslo_concurrency.lockutils [None req-1f1154ba-d99e-4e29-8445-82d31a079b70 tempest-AttachVolumeShelveTestJSON-385853788 tempest-AttachVolumeShelveTestJSON-385853788-project] Lock "1daf4f4c-0e4a-4779-b53a-78c48397ea2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120741) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 18:07:50.679427 dv-cinder-852009-8-iscsi devstack@n-api.service[120741]: DEBUG oslo_concurrency.lockutils [None req-1f1154ba-d99e-4e29-8445-82d31a079b70 tempest-AttachVolumeShelveTestJSON-385853788 tempest-AttachVolumeShelveTestJSON-385853788-project] Acquiring lock "1daf4f4c-0e4a-4779-b53a-78c48397ea2f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120741) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 18:07:50.679883 dv-cinder-852009-8-iscsi devstack@n-api.service[120741]: DEBUG oslo_concurrency.lockutils [None req-1f1154ba-d99e-4e29-8445-82d31a079b70 tempest-AttachVolumeShelveTestJSON-385853788 tempest-AttachVolumeShelveTestJSON-385853788-project] Lock "1daf4f4c-0e4a-4779-b53a-78c48397ea2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120741) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 18:07:50.680305 dv-cinder-852009-8-iscsi devstack@n-api.service[120741]: DEBUG oslo_concurrency.lockutils [None req-1f1154ba-d99e-4e29-8445-82d31a079b70 tempest-AttachVolumeShelveTestJSON-385853788 tempest-AttachVolumeShelveTestJSON-385853788-project] Lock "1daf4f4c-0e4a-4779-b53a-78c48397ea2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120741) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 18:07:50.705986 dv-cinder-852009-8-iscsi devstack@n-api.service[120740]: DEBUG oslo_concurrency.lockutils [None req-a02853f2-1d25-491f-a972-f8df4bfdabc6 tempest-TestMinimumBasicScenario-820002800 tempest-TestMinimumBasicScenario-820002800-project] Acquiring lock "1daf4f4c-0e4a-4779-b53a-78c48397ea2f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120740) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 18:07:50.706445 dv-cinder-852009-8-iscsi devstack@n-api.service[120740]: DEBUG oslo_concurrency.lockutils [None req-a02853f2-1d25-491f-a972-f8df4bfdabc6 tempest-TestMinimumBasicScenario-820002800 tempest-TestMinimumBasicScenario-820002800-project] Lock "1daf4f4c-0e4a-4779-b53a-78c48397ea2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120740) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 18:07:50.706874 dv-cinder-852009-8-iscsi devstack@n-api.service[120740]: DEBUG oslo_concurrency.lockutils [None req-a02853f2-1d25-491f-a972-f8df4bfdabc6 tempest-TestMinimumBasicScenario-820002800 tempest-TestMinimumBasicScenario-820002800-project] Lock "1daf4f4c-0e4a-4779-b53a-78c48397ea2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120740) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 18:07:50.707314 dv-cinder-852009-8-iscsi devstack@n-api.service[120740]: DEBUG nova.objects.instance [None req-a02853f2-1d25-491f-a972-f8df4bfdabc6 tempest-TestMinimumBasicScenario-820002800 tempest-TestMinimumBasicScenario-820002800-project] Lazy-loading 'fault' on Instance uuid f8247a13-94cd-45b2-acc8-8717e1260f37 {{(pid=120740) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Sep 13 18:07:50.771021 dv-cinder-852009-8-iscsi devstack@n-api.service[120740]: DEBUG nova.policy [None req-a02853f2-1d25-491f-a972-f8df4bfdabc6 tempest-TestMinimumBasicScenario-820002800 tempest-TestMinimumBasicScenario-820002800-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7880064ff0aa448d9c367c89eba145ff', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2f6832936c824066a4370cc45c5b0282', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120740) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 18:07:50.778782 dv-cinder-852009-8-iscsi devstack@n-api.service[120740]: INFO nova.api.openstack.requestlog [None req-a02853f2-1d25-491f-a972-f8df4bfdabc6 tempest-TestMinimumBasicScenario-820002800 tempest-TestMinimumBasicScenario-820002800-project] 10.222.0.43 "GET /compute/v2.1/servers/f8247a13-94cd-45b2-acc8-8717e1260f37" status: 200 len: 1349 microversion: 2.1 time: 0.124293 Sep 13 18:07:50.779372 dv-cinder-852009-8-iscsi devstack@n-api.service[120740]: [pid: 120740|app: 0|req: 349/689] 10.222.0.43 () {58 vars in 1236 bytes} [Tue Sep 13 18:07:50 2022] GET /compute/v2.1/servers/f8247a13-94cd-45b2-acc8-8717e1260f37 => generated 1349 bytes in 126 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 13 18:07:50.834680 dv-cinder-852009-8-iscsi devstack@n-api.service[120741]: DEBUG nova.policy [None req-1f1154ba-d99e-4e29-8445-82d31a079b70 tempest-AttachVolumeShelveTestJSON-385853788 tempest-AttachVolumeShelveTestJSON-385853788-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e68ecd9b3ca643539b109f75bb242d6f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '75e14fd88bfb4cd896fa7b070a0fac47', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120741) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 18:07:50.843434 dv-cinder-852009-8-iscsi devstack@n-api.service[120741]: DEBUG nova.policy [None req-1f1154ba-d99e-4e29-8445-82d31a079b70 tempest-AttachVolumeShelveTestJSON-385853788 tempest-AttachVolumeShelveTestJSON-385853788-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'e68ecd9b3ca643539b109f75bb242d6f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '75e14fd88bfb4cd896fa7b070a0fac47', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120741) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 18:07:50.844905 dv-cinder-852009-8-iscsi devstack@n-api.service[120741]: DEBUG nova.policy [None req-1f1154ba-d99e-4e29-8445-82d31a079b70 tempest-AttachVolumeShelveTestJSON-385853788 tempest-AttachVolumeShelveTestJSON-385853788-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'e68ecd9b3ca643539b109f75bb242d6f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '75e14fd88bfb4cd896fa7b070a0fac47', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120741) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 18:07:50.846075 dv-cinder-852009-8-iscsi devstack@n-api.service[120741]: INFO nova.api.openstack.requestlog [None req-1f1154ba-d99e-4e29-8445-82d31a079b70 tempest-AttachVolumeShelveTestJSON-385853788 tempest-AttachVolumeShelveTestJSON-385853788-project] 10.222.0.43 "GET /compute/v2.1/servers/8cecf08e-bea8-4cef-9439-0eaa242bfed1" status: 200 len: 1729 microversion: 2.20 time: 0.182605 Sep 13 18:07:50.846639 dv-cinder-852009-8-iscsi devstack@n-api.service[120741]: [pid: 120741|app: 0|req: 341/690] 10.222.0.43 () {60 vars in 1277 bytes} [Tue Sep 13 18:07:50 2022] GET /compute/v2.1/servers/8cecf08e-bea8-4cef-9439-0eaa242bfed1 => generated 1729 bytes in 184 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 13 18:07:51.198860 dv-cinder-852009-8-iscsi devstack@n-api.service[120740]: DEBUG nova.api.openstack.wsgi [None req-a4d2b3f6-f6ba-4f18-8362-220d3f06085f tempest-AttachVolumeTestJSON-555093534 tempest-AttachVolumeTestJSON-555093534-project] Calling method '>' {{(pid=120740) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 18:07:51.199398 dv-cinder-852009-8-iscsi devstack@n-api.service[120740]: DEBUG nova.compute.api [None req-a4d2b3f6-f6ba-4f18-8362-220d3f06085f tempest-AttachVolumeTestJSON-555093534 tempest-AttachVolumeTestJSON-555093534-project] [instance: d0983ec1-bb82-4a7d-9dba-ace1e3eb383a] Fetching instance by UUID {{(pid=120740) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 18:07:51.205834 dv-cinder-852009-8-iscsi devstack@n-api.service[120740]: DEBUG oslo_concurrency.lockutils [None req-a4d2b3f6-f6ba-4f18-8362-220d3f06085f tempest-AttachVolumeTestJSON-555093534 tempest-AttachVolumeTestJSON-555093534-project] Acquiring lock "1daf4f4c-0e4a-4779-b53a-78c48397ea2f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120740) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 18:07:51.206353 dv-cinder-852009-8-iscsi devstack@n-api.service[120740]: DEBUG oslo_concurrency.lockutils [None req-a4d2b3f6-f6ba-4f18-8362-220d3f06085f tempest-AttachVolumeTestJSON-555093534 tempest-AttachVolumeTestJSON-555093534-project] Lock "1daf4f4c-0e4a-4779-b53a-78c48397ea2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120740) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 18:07:51.206781 dv-cinder-852009-8-iscsi devstack@n-api.service[120740]: DEBUG oslo_concurrency.lockutils [None req-a4d2b3f6-f6ba-4f18-8362-220d3f06085f tempest-AttachVolumeTestJSON-555093534 tempest-AttachVolumeTestJSON-555093534-project] Lock "1daf4f4c-0e4a-4779-b53a-78c48397ea2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120740) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 18:07:51.207468 dv-cinder-852009-8-iscsi devstack@n-api.service[120740]: DEBUG oslo_concurrency.lockutils [None req-a4d2b3f6-f6ba-4f18-8362-220d3f06085f tempest-AttachVolumeTestJSON-555093534 tempest-AttachVolumeTestJSON-555093534-project] Acquiring lock "1daf4f4c-0e4a-4779-b53a-78c48397ea2f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120740) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 18:07:51.207918 dv-cinder-852009-8-iscsi devstack@n-api.service[120740]: DEBUG oslo_concurrency.lockutils [None req-a4d2b3f6-f6ba-4f18-8362-220d3f06085f tempest-AttachVolumeTestJSON-555093534 tempest-AttachVolumeTestJSON-555093534-project] Lock "1daf4f4c-0e4a-4779-b53a-78c48397ea2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120740) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 18:07:51.208337 dv-cinder-852009-8-iscsi devstack@n-api.service[120740]: DEBUG oslo_concurrency.lockutils [None req-a4d2b3f6-f6ba-4f18-8362-220d3f06085f tempest-AttachVolumeTestJSON-555093534 tempest-AttachVolumeTestJSON-555093534-project] Lock "1daf4f4c-0e4a-4779-b53a-78c48397ea2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120740) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 18:07:51.274992 dv-cinder-852009-8-iscsi devstack@n-api.service[120740]: DEBUG nova.policy [None req-a4d2b3f6-f6ba-4f18-8362-220d3f06085f tempest-AttachVolumeTestJSON-555093534 tempest-AttachVolumeTestJSON-555093534-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0625b3113ce044bbac4f6142eaade11c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a279fcbf274c4704a31a2b95061e1469', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120740) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 18:07:51.282955 dv-cinder-852009-8-iscsi devstack@n-api.service[120740]: INFO nova.api.openstack.requestlog [None req-a4d2b3f6-f6ba-4f18-8362-220d3f06085f tempest-AttachVolumeTestJSON-555093534 tempest-AttachVolumeTestJSON-555093534-project] 10.222.0.43 "GET /compute/v2.1/servers/d0983ec1-bb82-4a7d-9dba-ace1e3eb383a" status: 200 len: 1607 microversion: 2.1 time: 0.088243 Sep 13 18:07:51.283531 dv-cinder-852009-8-iscsi devstack@n-api.service[120740]: [pid: 120740|app: 0|req: 350/691] 10.222.0.43 () {58 vars in 1236 bytes} [Tue Sep 13 18:07:51 2022] GET /compute/v2.1/servers/d0983ec1-bb82-4a7d-9dba-ace1e3eb383a => generated 1607 bytes in 89 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 13 18:07:51.807444 dv-cinder-852009-8-iscsi devstack@n-api.service[120741]: DEBUG nova.api.openstack.wsgi [None req-58aca4fe-3665-4d20-be7a-6f988824ad86 tempest-TestMinimumBasicScenario-820002800 tempest-TestMinimumBasicScenario-820002800-project] Calling method '>' {{(pid=120741) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 18:07:51.808704 dv-cinder-852009-8-iscsi devstack@n-api.service[120741]: DEBUG nova.compute.api [None req-58aca4fe-3665-4d20-be7a-6f988824ad86 tempest-TestMinimumBasicScenario-820002800 tempest-TestMinimumBasicScenario-820002800-project] [instance: f8247a13-94cd-45b2-acc8-8717e1260f37] Fetching instance by UUID {{(pid=120741) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 18:07:51.816601 dv-cinder-852009-8-iscsi devstack@n-api.service[120741]: DEBUG oslo_concurrency.lockutils [None req-58aca4fe-3665-4d20-be7a-6f988824ad86 tempest-TestMinimumBasicScenario-820002800 tempest-TestMinimumBasicScenario-820002800-project] Acquiring lock "1daf4f4c-0e4a-4779-b53a-78c48397ea2f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120741) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 18:07:51.817086 dv-cinder-852009-8-iscsi devstack@n-api.service[120741]: DEBUG oslo_concurrency.lockutils [None req-58aca4fe-3665-4d20-be7a-6f988824ad86 tempest-TestMinimumBasicScenario-820002800 tempest-TestMinimumBasicScenario-820002800-project] Lock "1daf4f4c-0e4a-4779-b53a-78c48397ea2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120741) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 18:07:51.817508 dv-cinder-852009-8-iscsi devstack@n-api.service[120741]: DEBUG oslo_concurrency.lockutils [None req-58aca4fe-3665-4d20-be7a-6f988824ad86 tempest-TestMinimumBasicScenario-820002800 tempest-TestMinimumBasicScenario-820002800-project] Lock "1daf4f4c-0e4a-4779-b53a-78c48397ea2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120741) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 18:07:51.818190 dv-cinder-852009-8-iscsi devstack@n-api.service[120741]: DEBUG oslo_concurrency.lockutils [None req-58aca4fe-3665-4d20-be7a-6f988824ad86 tempest-TestMinimumBasicScenario-820002800 tempest-TestMinimumBasicScenario-820002800-project] Acquiring lock "1daf4f4c-0e4a-4779-b53a-78c48397ea2f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120741) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 18:07:51.818630 dv-cinder-852009-8-iscsi devstack@n-api.service[120741]: DEBUG oslo_concurrency.lockutils [None req-58aca4fe-3665-4d20-be7a-6f988824ad86 tempest-TestMinimumBasicScenario-820002800 tempest-TestMinimumBasicScenario-820002800-project] Lock "1daf4f4c-0e4a-4779-b53a-78c48397ea2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120741) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 18:07:51.819131 dv-cinder-852009-8-iscsi devstack@n-api.service[120741]: DEBUG oslo_concurrency.lockutils [None req-58aca4fe-3665-4d20-be7a-6f988824ad86 tempest-TestMinimumBasicScenario-820002800 tempest-TestMinimumBasicScenario-820002800-project] Lock "1daf4f4c-0e4a-4779-b53a-78c48397ea2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120741) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 18:07:51.851366 dv-cinder-852009-8-iscsi devstack@n-api.service[120741]: DEBUG oslo_concurrency.lockutils [None req-58aca4fe-3665-4d20-be7a-6f988824ad86 tempest-TestMinimumBasicScenario-820002800 tempest-TestMinimumBasicScenario-820002800-project] Acquiring lock "1daf4f4c-0e4a-4779-b53a-78c48397ea2f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120741) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 18:07:51.851848 dv-cinder-852009-8-iscsi devstack@n-api.service[120741]: DEBUG oslo_concurrency.lockutils [None req-58aca4fe-3665-4d20-be7a-6f988824ad86 tempest-TestMinimumBasicScenario-820002800 tempest-TestMinimumBasicScenario-820002800-project] Lock "1daf4f4c-0e4a-4779-b53a-78c48397ea2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120741) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 18:07:51.852281 dv-cinder-852009-8-iscsi devstack@n-api.service[120741]: DEBUG oslo_concurrency.lockutils [None req-58aca4fe-3665-4d20-be7a-6f988824ad86 tempest-TestMinimumBasicScenario-820002800 tempest-TestMinimumBasicScenario-820002800-project] Lock "1daf4f4c-0e4a-4779-b53a-78c48397ea2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120741) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 18:07:51.852759 dv-cinder-852009-8-iscsi devstack@n-api.service[120741]: DEBUG nova.objects.instance [None req-58aca4fe-3665-4d20-be7a-6f988824ad86 tempest-TestMinimumBasicScenario-820002800 tempest-TestMinimumBasicScenario-820002800-project] Lazy-loading 'fault' on Instance uuid f8247a13-94cd-45b2-acc8-8717e1260f37 {{(pid=120741) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Sep 13 18:07:51.873275 dv-cinder-852009-8-iscsi devstack@n-api.service[120740]: DEBUG nova.api.openstack.wsgi [None req-97833d9e-66c0-4cfb-8dc5-090015b23cfe tempest-AttachVolumeShelveTestJSON-385853788 tempest-AttachVolumeShelveTestJSON-385853788-project] Calling method '>' {{(pid=120740) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 18:07:51.873831 dv-cinder-852009-8-iscsi devstack@n-api.service[120740]: DEBUG nova.compute.api [None req-97833d9e-66c0-4cfb-8dc5-090015b23cfe tempest-AttachVolumeShelveTestJSON-385853788 tempest-AttachVolumeShelveTestJSON-385853788-project] [instance: 8cecf08e-bea8-4cef-9439-0eaa242bfed1] Fetching instance by UUID {{(pid=120740) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 18:07:51.881077 dv-cinder-852009-8-iscsi devstack@n-api.service[120740]: DEBUG oslo_concurrency.lockutils [None req-97833d9e-66c0-4cfb-8dc5-090015b23cfe tempest-AttachVolumeShelveTestJSON-385853788 tempest-AttachVolumeShelveTestJSON-385853788-project] Acquiring lock "1daf4f4c-0e4a-4779-b53a-78c48397ea2f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120740) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 18:07:51.881565 dv-cinder-852009-8-iscsi devstack@n-api.service[120740]: DEBUG oslo_concurrency.lockutils [None req-97833d9e-66c0-4cfb-8dc5-090015b23cfe tempest-AttachVolumeShelveTestJSON-385853788 tempest-AttachVolumeShelveTestJSON-385853788-project] Lock "1daf4f4c-0e4a-4779-b53a-78c48397ea2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120740) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 18:07:51.881992 dv-cinder-852009-8-iscsi devstack@n-api.service[120740]: DEBUG oslo_concurrency.lockutils [None req-97833d9e-66c0-4cfb-8dc5-090015b23cfe tempest-AttachVolumeShelveTestJSON-385853788 tempest-AttachVolumeShelveTestJSON-385853788-project] Lock "1daf4f4c-0e4a-4779-b53a-78c48397ea2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120740) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 18:07:51.882686 dv-cinder-852009-8-iscsi devstack@n-api.service[120740]: DEBUG oslo_concurrency.lockutils [None req-97833d9e-66c0-4cfb-8dc5-090015b23cfe tempest-AttachVolumeShelveTestJSON-385853788 tempest-AttachVolumeShelveTestJSON-385853788-project] Acquiring lock "1daf4f4c-0e4a-4779-b53a-78c48397ea2f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120740) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 18:07:51.883134 dv-cinder-852009-8-iscsi devstack@n-api.service[120740]: DEBUG oslo_concurrency.lockutils [None req-97833d9e-66c0-4cfb-8dc5-090015b23cfe tempest-AttachVolumeShelveTestJSON-385853788 tempest-AttachVolumeShelveTestJSON-385853788-project] Lock "1daf4f4c-0e4a-4779-b53a-78c48397ea2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120740) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 18:07:51.883551 dv-cinder-852009-8-iscsi devstack@n-api.service[120740]: DEBUG oslo_concurrency.lockutils [None req-97833d9e-66c0-4cfb-8dc5-090015b23cfe tempest-AttachVolumeShelveTestJSON-385853788 tempest-AttachVolumeShelveTestJSON-385853788-project] Lock "1daf4f4c-0e4a-4779-b53a-78c48397ea2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120740) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 18:07:51.894371 dv-cinder-852009-8-iscsi devstack@n-api.service[120741]: DEBUG nova.policy [None req-58aca4fe-3665-4d20-be7a-6f988824ad86 tempest-TestMinimumBasicScenario-820002800 tempest-TestMinimumBasicScenario-820002800-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7880064ff0aa448d9c367c89eba145ff', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2f6832936c824066a4370cc45c5b0282', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120741) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 18:07:51.902214 dv-cinder-852009-8-iscsi devstack@n-api.service[120741]: INFO nova.api.openstack.requestlog [None req-58aca4fe-3665-4d20-be7a-6f988824ad86 tempest-TestMinimumBasicScenario-820002800 tempest-TestMinimumBasicScenario-820002800-project] 10.222.0.43 "GET /compute/v2.1/servers/f8247a13-94cd-45b2-acc8-8717e1260f37" status: 200 len: 1349 microversion: 2.1 time: 0.102612 Sep 13 18:07:51.902760 dv-cinder-852009-8-iscsi devstack@n-api.service[120741]: [pid: 120741|app: 0|req: 342/692] 10.222.0.43 () {58 vars in 1236 bytes} [Tue Sep 13 18:07:51 2022] GET /compute/v2.1/servers/f8247a13-94cd-45b2-acc8-8717e1260f37 => generated 1349 bytes in 104 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 13 18:07:52.013632 dv-cinder-852009-8-iscsi devstack@n-api.service[120740]: DEBUG nova.policy [None req-97833d9e-66c0-4cfb-8dc5-090015b23cfe tempest-AttachVolumeShelveTestJSON-385853788 tempest-AttachVolumeShelveTestJSON-385853788-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e68ecd9b3ca643539b109f75bb242d6f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '75e14fd88bfb4cd896fa7b070a0fac47', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120740) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 18:07:52.022814 dv-cinder-852009-8-iscsi devstack@n-api.service[120740]: DEBUG nova.policy [None req-97833d9e-66c0-4cfb-8dc5-090015b23cfe tempest-AttachVolumeShelveTestJSON-385853788 tempest-AttachVolumeShelveTestJSON-385853788-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'e68ecd9b3ca643539b109f75bb242d6f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '75e14fd88bfb4cd896fa7b070a0fac47', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120740) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 18:07:52.024265 dv-cinder-852009-8-iscsi devstack@n-api.service[120740]: DEBUG nova.policy [None req-97833d9e-66c0-4cfb-8dc5-090015b23cfe tempest-AttachVolumeShelveTestJSON-385853788 tempest-AttachVolumeShelveTestJSON-385853788-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'e68ecd9b3ca643539b109f75bb242d6f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '75e14fd88bfb4cd896fa7b070a0fac47', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120740) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 18:07:52.025462 dv-cinder-852009-8-iscsi devstack@n-api.service[120740]: INFO nova.api.openstack.requestlog [None req-97833d9e-66c0-4cfb-8dc5-090015b23cfe tempest-AttachVolumeShelveTestJSON-385853788 tempest-AttachVolumeShelveTestJSON-385853788-project] 10.222.0.43 "GET /compute/v2.1/servers/8cecf08e-bea8-4cef-9439-0eaa242bfed1" status: 200 len: 1729 microversion: 2.20 time: 0.156131 Sep 13 18:07:52.025998 dv-cinder-852009-8-iscsi devstack@n-api.service[120740]: [pid: 120740|app: 0|req: 351/693] 10.222.0.43 () {60 vars in 1277 bytes} [Tue Sep 13 18:07:51 2022] GET /compute/v2.1/servers/8cecf08e-bea8-4cef-9439-0eaa242bfed1 => generated 1729 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 13 18:07:52.306596 dv-cinder-852009-8-iscsi devstack@n-api.service[120741]: DEBUG nova.api.openstack.wsgi [None req-6ea063eb-1363-4b56-9b34-6a552f6ffdf8 tempest-AttachVolumeTestJSON-555093534 tempest-AttachVolumeTestJSON-555093534-project] Calling method '>' {{(pid=120741) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 18:07:52.307210 dv-cinder-852009-8-iscsi devstack@n-api.service[120741]: DEBUG nova.compute.api [None req-6ea063eb-1363-4b56-9b34-6a552f6ffdf8 tempest-AttachVolumeTestJSON-555093534 tempest-AttachVolumeTestJSON-555093534-project] [instance: d0983ec1-bb82-4a7d-9dba-ace1e3eb383a] Fetching instance by UUID {{(pid=120741) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 18:07:52.313479 dv-cinder-852009-8-iscsi devstack@n-api.service[120741]: DEBUG oslo_concurrency.lockutils [None req-6ea063eb-1363-4b56-9b34-6a552f6ffdf8 tempest-AttachVolumeTestJSON-555093534 tempest-AttachVolumeTestJSON-555093534-project] Acquiring lock "1daf4f4c-0e4a-4779-b53a-78c48397ea2f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120741) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 18:07:52.313966 dv-cinder-852009-8-iscsi devstack@n-api.service[120741]: DEBUG oslo_concurrency.lockutils [None req-6ea063eb-1363-4b56-9b34-6a552f6ffdf8 tempest-AttachVolumeTestJSON-555093534 tempest-AttachVolumeTestJSON-555093534-project] Lock "1daf4f4c-0e4a-4779-b53a-78c48397ea2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120741) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 18:07:52.314401 dv-cinder-852009-8-iscsi devstack@n-api.service[120741]: DEBUG oslo_concurrency.lockutils [None req-6ea063eb-1363-4b56-9b34-6a552f6ffdf8 tempest-AttachVolumeTestJSON-555093534 tempest-AttachVolumeTestJSON-555093534-project] Lock "1daf4f4c-0e4a-4779-b53a-78c48397ea2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120741) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 18:07:52.315099 dv-cinder-852009-8-iscsi devstack@n-api.service[120741]: DEBUG oslo_concurrency.lockutils [None req-6ea063eb-1363-4b56-9b34-6a552f6ffdf8 tempest-AttachVolumeTestJSON-555093534 tempest-AttachVolumeTestJSON-555093534-project] Acquiring lock "1daf4f4c-0e4a-4779-b53a-78c48397ea2f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120741) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 18:07:52.315554 dv-cinder-852009-8-iscsi devstack@n-api.service[120741]: DEBUG oslo_concurrency.lockutils [None req-6ea063eb-1363-4b56-9b34-6a552f6ffdf8 tempest-AttachVolumeTestJSON-555093534 tempest-AttachVolumeTestJSON-555093534-project] Lock "1daf4f4c-0e4a-4779-b53a-78c48397ea2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120741) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 18:07:52.315973 dv-cinder-852009-8-iscsi devstack@n-api.service[120741]: DEBUG oslo_concurrency.lockutils [None req-6ea063eb-1363-4b56-9b34-6a552f6ffdf8 tempest-AttachVolumeTestJSON-555093534 tempest-AttachVolumeTestJSON-555093534-project] Lock "1daf4f4c-0e4a-4779-b53a-78c48397ea2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120741) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 18:07:52.349163 dv-cinder-852009-8-iscsi devstack@n-api.service[120741]: DEBUG oslo_concurrency.lockutils [None req-6ea063eb-1363-4b56-9b34-6a552f6ffdf8 tempest-AttachVolumeTestJSON-555093534 tempest-AttachVolumeTestJSON-555093534-project] Acquiring lock "1daf4f4c-0e4a-4779-b53a-78c48397ea2f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120741) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 18:07:52.349649 dv-cinder-852009-8-iscsi devstack@n-api.service[120741]: DEBUG oslo_concurrency.lockutils [None req-6ea063eb-1363-4b56-9b34-6a552f6ffdf8 tempest-AttachVolumeTestJSON-555093534 tempest-AttachVolumeTestJSON-555093534-project] Lock "1daf4f4c-0e4a-4779-b53a-78c48397ea2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120741) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 18:07:52.350071 dv-cinder-852009-8-iscsi devstack@n-api.service[120741]: DEBUG oslo_concurrency.lockutils [None req-6ea063eb-1363-4b56-9b34-6a552f6ffdf8 tempest-AttachVolumeTestJSON-555093534 tempest-AttachVolumeTestJSON-555093534-project] Lock "1daf4f4c-0e4a-4779-b53a-78c48397ea2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120741) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 18:07:52.350691 dv-cinder-852009-8-iscsi devstack@n-api.service[120741]: DEBUG nova.objects.instance [None req-6ea063eb-1363-4b56-9b34-6a552f6ffdf8 tempest-AttachVolumeTestJSON-555093534 tempest-AttachVolumeTestJSON-555093534-project] Lazy-loading 'fault' on Instance uuid d0983ec1-bb82-4a7d-9dba-ace1e3eb383a {{(pid=120741) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Sep 13 18:07:52.391685 dv-cinder-852009-8-iscsi devstack@n-api.service[120741]: DEBUG nova.policy [None req-6ea063eb-1363-4b56-9b34-6a552f6ffdf8 tempest-AttachVolumeTestJSON-555093534 tempest-AttachVolumeTestJSON-555093534-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0625b3113ce044bbac4f6142eaade11c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a279fcbf274c4704a31a2b95061e1469', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120741) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 18:07:52.394074 dv-cinder-852009-8-iscsi devstack@n-api.service[120741]: DEBUG dbcounter [-] [120741] Writing DB stats nova_cell1:SELECT=100 {{(pid=120741) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 18:07:52.400773 dv-cinder-852009-8-iscsi devstack@n-api.service[120741]: INFO nova.api.openstack.requestlog [None req-6ea063eb-1363-4b56-9b34-6a552f6ffdf8 tempest-AttachVolumeTestJSON-555093534 tempest-AttachVolumeTestJSON-555093534-project] 10.222.0.43 "GET /compute/v2.1/servers/d0983ec1-bb82-4a7d-9dba-ace1e3eb383a" status: 200 len: 1327 microversion: 2.1 time: 0.098052 Sep 13 18:07:52.401333 dv-cinder-852009-8-iscsi devstack@n-api.service[120741]: [pid: 120741|app: 0|req: 343/694] 10.222.0.43 () {58 vars in 1236 bytes} [Tue Sep 13 18:07:52 2022] GET /compute/v2.1/servers/d0983ec1-bb82-4a7d-9dba-ace1e3eb383a => generated 1327 bytes in 99 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 13 18:07:52.929934 dv-cinder-852009-8-iscsi devstack@n-api.service[120740]: DEBUG nova.api.openstack.wsgi [None req-e0bf7c40-97ac-4ecf-9180-7c2cfea6348f tempest-TestMinimumBasicScenario-820002800 tempest-TestMinimumBasicScenario-820002800-project] Calling method '>' {{(pid=120740) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 18:07:52.930821 dv-cinder-852009-8-iscsi devstack@n-api.service[120740]: DEBUG nova.compute.api [None req-e0bf7c40-97ac-4ecf-9180-7c2cfea6348f tempest-TestMinimumBasicScenario-820002800 tempest-TestMinimumBasicScenario-820002800-project] [instance: f8247a13-94cd-45b2-acc8-8717e1260f37] Fetching instance by UUID {{(pid=120740) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 18:07:52.941851 dv-cinder-852009-8-iscsi devstack@n-api.service[120740]: DEBUG oslo_concurrency.lockutils [None req-e0bf7c40-97ac-4ecf-9180-7c2cfea6348f tempest-TestMinimumBasicScenario-820002800 tempest-TestMinimumBasicScenario-820002800-project] Acquiring lock "1daf4f4c-0e4a-4779-b53a-78c48397ea2f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120740) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 18:07:52.942655 dv-cinder-852009-8-iscsi devstack@n-api.service[120740]: DEBUG oslo_concurrency.lockutils [None req-e0bf7c40-97ac-4ecf-9180-7c2cfea6348f tempest-TestMinimumBasicScenario-820002800 tempest-TestMinimumBasicScenario-820002800-project] Lock "1daf4f4c-0e4a-4779-b53a-78c48397ea2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120740) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 18:07:52.943364 dv-cinder-852009-8-iscsi devstack@n-api.service[120740]: DEBUG oslo_concurrency.lockutils [None req-e0bf7c40-97ac-4ecf-9180-7c2cfea6348f tempest-TestMinimumBasicScenario-820002800 tempest-TestMinimumBasicScenario-820002800-project] Lock "1daf4f4c-0e4a-4779-b53a-78c48397ea2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120740) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 18:07:52.944512 dv-cinder-852009-8-iscsi devstack@n-api.service[120740]: DEBUG oslo_concurrency.lockutils [None req-e0bf7c40-97ac-4ecf-9180-7c2cfea6348f tempest-TestMinimumBasicScenario-820002800 tempest-TestMinimumBasicScenario-820002800-project] Acquiring lock "1daf4f4c-0e4a-4779-b53a-78c48397ea2f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120740) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 18:07:52.945289 dv-cinder-852009-8-iscsi devstack@n-api.service[120740]: DEBUG oslo_concurrency.lockutils [None req-e0bf7c40-97ac-4ecf-9180-7c2cfea6348f tempest-TestMinimumBasicScenario-820002800 tempest-TestMinimumBasicScenario-820002800-project] Lock "1daf4f4c-0e4a-4779-b53a-78c48397ea2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120740) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 18:07:52.945989 dv-cinder-852009-8-iscsi devstack@n-api.service[120740]: DEBUG oslo_concurrency.lockutils [None req-e0bf7c40-97ac-4ecf-9180-7c2cfea6348f tempest-TestMinimumBasicScenario-820002800 tempest-TestMinimumBasicScenario-820002800-project] Lock "1daf4f4c-0e4a-4779-b53a-78c48397ea2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120740) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 18:07:52.962888 dv-cinder-852009-8-iscsi devstack@n-api.service[120740]: INFO nova.api.openstack.wsgi [None req-e0bf7c40-97ac-4ecf-9180-7c2cfea6348f tempest-TestMinimumBasicScenario-820002800 tempest-TestMinimumBasicScenario-820002800-project] HTTP exception thrown: Instance f8247a13-94cd-45b2-acc8-8717e1260f37 could not be found. Sep 13 18:07:52.964600 dv-cinder-852009-8-iscsi devstack@n-api.service[120740]: DEBUG nova.api.openstack.wsgi [None req-e0bf7c40-97ac-4ecf-9180-7c2cfea6348f tempest-TestMinimumBasicScenario-820002800 tempest-TestMinimumBasicScenario-820002800-project] Request method failure captured: Sep 13 18:07:52.964600 dv-cinder-852009-8-iscsi devstack@n-api.service[120740]: request: GET /compute/v2.1/servers/f8247a13-94cd-45b2-acc8-8717e1260f37 HTTP/1.1 Sep 13 18:07:52.964600 dv-cinder-852009-8-iscsi devstack@n-api.service[120740]: Accept: application/json Sep 13 18:07:52.964600 dv-cinder-852009-8-iscsi devstack@n-api.service[120740]: Accept-Encoding: identity Sep 13 18:07:52.964600 dv-cinder-852009-8-iscsi devstack@n-api.service[120740]: Connection: close Sep 13 18:07:52.964600 dv-cinder-852009-8-iscsi devstack@n-api.service[120740]: Content-Length: 0 Sep 13 18:07:52.964600 dv-cinder-852009-8-iscsi devstack@n-api.service[120740]: Content-Type: application/json Sep 13 18:07:52.964600 dv-cinder-852009-8-iscsi devstack@n-api.service[120740]: Host: 10.222.0.43 Sep 13 18:07:52.964600 dv-cinder-852009-8-iscsi devstack@n-api.service[120740]: Openstack-System-Scope: None Sep 13 18:07:52.964600 dv-cinder-852009-8-iscsi devstack@n-api.service[120740]: User-Agent: python-urllib3/1.26.12 Sep 13 18:07:52.964600 dv-cinder-852009-8-iscsi devstack@n-api.service[120740]: X-Auth-Token: gAAAAABjIMZadF0dlmM7-pOrJCi6KZ1R2J5t7RWmkyOx1ISCyVGcZ6-t5-ax8PAEdQ9tuN2_iUBvm3gwqND0VKUw0calBK8gblKa_EhDMpy57PQ-7FPc495iTWotYL-xXghbLvov2k0ou8JcuRtXPpD5X5kCTLg2QLakKWwSsq_-uB6LW07Jpac Sep 13 18:07:52.964600 dv-cinder-852009-8-iscsi devstack@n-api.service[120740]: X-Domain-Id: None Sep 13 18:07:52.964600 dv-cinder-852009-8-iscsi devstack@n-api.service[120740]: X-Domain-Name: None Sep 13 18:07:52.964600 dv-cinder-852009-8-iscsi devstack@n-api.service[120740]: X-Identity-Status: Confirmed Sep 13 18:07:52.964600 dv-cinder-852009-8-iscsi devstack@n-api.service[120740]: X-Is-Admin-Project: True Sep 13 18:07:52.964600 dv-cinder-852009-8-iscsi devstack@n-api.service[120740]: X-Project-Domain-Id: default Sep 13 18:07:52.964600 dv-cinder-852009-8-iscsi devstack@n-api.service[120740]: X-Project-Domain-Name: Default Sep 13 18:07:52.964600 dv-cinder-852009-8-iscsi devstack@n-api.service[120740]: X-Project-Id: 2f6832936c824066a4370cc45c5b0282 Sep 13 18:07:52.964600 dv-cinder-852009-8-iscsi devstack@n-api.service[120740]: X-Project-Name: tempest-TestMinimumBasicScenario-820002800 Sep 13 18:07:52.964600 dv-cinder-852009-8-iscsi devstack@n-api.service[120740]: X-Role: reader,member Sep 13 18:07:52.964600 dv-cinder-852009-8-iscsi devstack@n-api.service[120740]: X-Roles: reader,member Sep 13 18:07:52.966133 dv-cinder-852009-8-iscsi devstack@n-api.service[120740]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/identity"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/compute/v2/2f6832936c824066a4370cc45c5b0282"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.43:8080", "publicURL": "http://10.222.0.43:8080/v1/AUTH_2f6832936c824066a4370cc45c5b0282"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43:9696/networking"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/volume/v3/2f6832936c824066a4370cc45c5b0282"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/compute/v2.1"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/placement"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/volume/v3/2f6832936c824066a4370cc45c5b0282"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/image"}]}] Sep 13 18:07:52.966133 dv-cinder-852009-8-iscsi devstack@n-api.service[120740]: X-Tenant: tempest-TestMinimumBasicScenario-820002800 Sep 13 18:07:52.966133 dv-cinder-852009-8-iscsi devstack@n-api.service[120740]: X-Tenant-Id: 2f6832936c824066a4370cc45c5b0282 Sep 13 18:07:52.966133 dv-cinder-852009-8-iscsi devstack@n-api.service[120740]: X-Tenant-Name: tempest-TestMinimumBasicScenario-820002800 Sep 13 18:07:52.966133 dv-cinder-852009-8-iscsi devstack@n-api.service[120740]: X-User: tempest-TestMinimumBasicScenario-820002800-project Sep 13 18:07:52.966133 dv-cinder-852009-8-iscsi devstack@n-api.service[120740]: X-User-Domain-Id: default Sep 13 18:07:52.966133 dv-cinder-852009-8-iscsi devstack@n-api.service[120740]: X-User-Domain-Name: Default Sep 13 18:07:52.966133 dv-cinder-852009-8-iscsi devstack@n-api.service[120740]: X-User-Id: 7880064ff0aa448d9c367c89eba145ff Sep 13 18:07:52.966133 dv-cinder-852009-8-iscsi devstack@n-api.service[120740]: X-User-Name: tempest-TestMinimumBasicScenario-820002800-project Sep 13 18:07:52.966133 dv-cinder-852009-8-iscsi devstack@n-api.service[120740]: method: > Sep 13 18:07:52.966133 dv-cinder-852009-8-iscsi devstack@n-api.service[120740]: exception: Instance f8247a13-94cd-45b2-acc8-8717e1260f37 could not be found. Sep 13 18:07:52.966133 dv-cinder-852009-8-iscsi devstack@n-api.service[120740]: action_args: {'id': 'f8247a13-94cd-45b2-acc8-8717e1260f37'} Sep 13 18:07:52.967019 dv-cinder-852009-8-iscsi devstack@n-api.service[120740]: {{(pid=120740) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 13 18:07:52.967019 dv-cinder-852009-8-iscsi devstack@n-api.service[120740]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 13 18:07:52.967019 dv-cinder-852009-8-iscsi devstack@n-api.service[120740]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Sep 13 18:07:52.967019 dv-cinder-852009-8-iscsi devstack@n-api.service[120740]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Sep 13 18:07:52.967019 dv-cinder-852009-8-iscsi devstack@n-api.service[120740]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Sep 13 18:07:52.967019 dv-cinder-852009-8-iscsi devstack@n-api.service[120740]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Sep 13 18:07:52.967019 dv-cinder-852009-8-iscsi devstack@n-api.service[120740]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Sep 13 18:07:52.967019 dv-cinder-852009-8-iscsi devstack@n-api.service[120740]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Sep 13 18:07:52.967019 dv-cinder-852009-8-iscsi devstack@n-api.service[120740]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Sep 13 18:07:52.967019 dv-cinder-852009-8-iscsi devstack@n-api.service[120740]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Sep 13 18:07:52.967019 dv-cinder-852009-8-iscsi devstack@n-api.service[120740]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance f8247a13-94cd-45b2-acc8-8717e1260f37 could not be found. Sep 13 18:07:52.967019 dv-cinder-852009-8-iscsi devstack@n-api.service[120740]: ERROR nova.api.openstack.wsgi Sep 13 18:07:52.967019 dv-cinder-852009-8-iscsi devstack@n-api.service[120740]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 13 18:07:52.967019 dv-cinder-852009-8-iscsi devstack@n-api.service[120740]: ERROR nova.api.openstack.wsgi Sep 13 18:07:52.967019 dv-cinder-852009-8-iscsi devstack@n-api.service[120740]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 13 18:07:52.967019 dv-cinder-852009-8-iscsi devstack@n-api.service[120740]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 13 18:07:52.967019 dv-cinder-852009-8-iscsi devstack@n-api.service[120740]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 13 18:07:52.967019 dv-cinder-852009-8-iscsi devstack@n-api.service[120740]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 13 18:07:52.967019 dv-cinder-852009-8-iscsi devstack@n-api.service[120740]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 13 18:07:52.967019 dv-cinder-852009-8-iscsi devstack@n-api.service[120740]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 13 18:07:52.968537 dv-cinder-852009-8-iscsi devstack@n-api.service[120740]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 13 18:07:52.968537 dv-cinder-852009-8-iscsi devstack@n-api.service[120740]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Sep 13 18:07:52.968537 dv-cinder-852009-8-iscsi devstack@n-api.service[120740]: ERROR nova.api.openstack.wsgi instance = self._get_server( Sep 13 18:07:52.968537 dv-cinder-852009-8-iscsi devstack@n-api.service[120740]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Sep 13 18:07:52.968537 dv-cinder-852009-8-iscsi devstack@n-api.service[120740]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Sep 13 18:07:52.968537 dv-cinder-852009-8-iscsi devstack@n-api.service[120740]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Sep 13 18:07:52.968537 dv-cinder-852009-8-iscsi devstack@n-api.service[120740]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Sep 13 18:07:52.968537 dv-cinder-852009-8-iscsi devstack@n-api.service[120740]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance f8247a13-94cd-45b2-acc8-8717e1260f37 could not be found. Sep 13 18:07:52.968537 dv-cinder-852009-8-iscsi devstack@n-api.service[120740]: ERROR nova.api.openstack.wsgi Sep 13 18:07:52.968537 dv-cinder-852009-8-iscsi devstack@n-api.service[120740]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 13 18:07:52.968537 dv-cinder-852009-8-iscsi devstack@n-api.service[120740]: ERROR nova.api.openstack.wsgi Sep 13 18:07:52.968537 dv-cinder-852009-8-iscsi devstack@n-api.service[120740]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 13 18:07:52.968537 dv-cinder-852009-8-iscsi devstack@n-api.service[120740]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 13 18:07:52.968537 dv-cinder-852009-8-iscsi devstack@n-api.service[120740]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 13 18:07:52.968537 dv-cinder-852009-8-iscsi devstack@n-api.service[120740]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 13 18:07:52.968537 dv-cinder-852009-8-iscsi devstack@n-api.service[120740]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 13 18:07:52.968537 dv-cinder-852009-8-iscsi devstack@n-api.service[120740]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance f8247a13-94cd-45b2-acc8-8717e1260f37 could not be found. Sep 13 18:07:52.968537 dv-cinder-852009-8-iscsi devstack@n-api.service[120740]: ERROR nova.api.openstack.wsgi Sep 13 18:07:52.969877 dv-cinder-852009-8-iscsi devstack@n-api.service[120740]: DEBUG nova.api.openstack.wsgi [None req-e0bf7c40-97ac-4ecf-9180-7c2cfea6348f tempest-TestMinimumBasicScenario-820002800 tempest-TestMinimumBasicScenario-820002800-project] Returning 404 to user: Instance f8247a13-94cd-45b2-acc8-8717e1260f37 could not be found. {{(pid=120740) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 13 18:07:52.969877 dv-cinder-852009-8-iscsi devstack@n-api.service[120740]: INFO nova.api.openstack.requestlog [None req-e0bf7c40-97ac-4ecf-9180-7c2cfea6348f tempest-TestMinimumBasicScenario-820002800 tempest-TestMinimumBasicScenario-820002800-project] 10.222.0.43 "GET /compute/v2.1/servers/f8247a13-94cd-45b2-acc8-8717e1260f37" status: 404 len: 111 microversion: 2.1 time: 0.042927 Sep 13 18:07:52.969877 dv-cinder-852009-8-iscsi devstack@n-api.service[120740]: [pid: 120740|app: 0|req: 352/695] 10.222.0.43 () {58 vars in 1236 bytes} [Tue Sep 13 18:07:52 2022] GET /compute/v2.1/servers/f8247a13-94cd-45b2-acc8-8717e1260f37 => generated 111 bytes in 44 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Sep 13 18:07:52.975474 dv-cinder-852009-8-iscsi devstack@n-api.service[120741]: DEBUG nova.api.openstack.wsgi [None req-75c7c23b-2802-44af-ab81-f32687ec5570 tempest-TestMinimumBasicScenario-820002800 tempest-TestMinimumBasicScenario-820002800-project] Calling method '.version_select at 0x7fa62693b9d0>' {{(pid=120741) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 18:07:52.996936 dv-cinder-852009-8-iscsi devstack@n-api.service[120741]: INFO nova.api.openstack.requestlog [None req-75c7c23b-2802-44af-ab81-f32687ec5570 tempest-TestMinimumBasicScenario-820002800 tempest-TestMinimumBasicScenario-820002800-project] 10.222.0.43 "DELETE /compute/v2.1/os-keypairs/tempest-TestMinimumBasicScenario-1481895359" status: 202 len: 0 microversion: 2.1 time: 0.025740 Sep 13 18:07:52.997509 dv-cinder-852009-8-iscsi devstack@n-api.service[120741]: [pid: 120741|app: 0|req: 344/696] 10.222.0.43 () {58 vars in 1272 bytes} [Tue Sep 13 18:07:52 2022] DELETE /compute/v2.1/os-keypairs/tempest-TestMinimumBasicScenario-1481895359 => generated 0 bytes in 27 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Sep 13 18:07:53.050848 dv-cinder-852009-8-iscsi devstack@n-api.service[120740]: DEBUG nova.api.openstack.wsgi [None req-15f38536-0933-4994-8fd2-3e3a257c37ee tempest-AttachVolumeShelveTestJSON-385853788 tempest-AttachVolumeShelveTestJSON-385853788-project] Calling method '>' {{(pid=120740) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 18:07:53.051745 dv-cinder-852009-8-iscsi devstack@n-api.service[120740]: DEBUG nova.compute.api [None req-15f38536-0933-4994-8fd2-3e3a257c37ee tempest-AttachVolumeShelveTestJSON-385853788 tempest-AttachVolumeShelveTestJSON-385853788-project] [instance: 8cecf08e-bea8-4cef-9439-0eaa242bfed1] Fetching instance by UUID {{(pid=120740) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 18:07:53.058298 dv-cinder-852009-8-iscsi devstack@n-api.service[120740]: DEBUG oslo_concurrency.lockutils [None req-15f38536-0933-4994-8fd2-3e3a257c37ee tempest-AttachVolumeShelveTestJSON-385853788 tempest-AttachVolumeShelveTestJSON-385853788-project] Acquiring lock "1daf4f4c-0e4a-4779-b53a-78c48397ea2f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120740) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 18:07:53.058994 dv-cinder-852009-8-iscsi devstack@n-api.service[120740]: DEBUG oslo_concurrency.lockutils [None req-15f38536-0933-4994-8fd2-3e3a257c37ee tempest-AttachVolumeShelveTestJSON-385853788 tempest-AttachVolumeShelveTestJSON-385853788-project] Lock "1daf4f4c-0e4a-4779-b53a-78c48397ea2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120740) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 18:07:53.059420 dv-cinder-852009-8-iscsi devstack@n-api.service[120740]: DEBUG oslo_concurrency.lockutils [None req-15f38536-0933-4994-8fd2-3e3a257c37ee tempest-AttachVolumeShelveTestJSON-385853788 tempest-AttachVolumeShelveTestJSON-385853788-project] Lock "1daf4f4c-0e4a-4779-b53a-78c48397ea2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120740) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 18:07:53.060388 dv-cinder-852009-8-iscsi devstack@n-api.service[120740]: DEBUG oslo_concurrency.lockutils [None req-15f38536-0933-4994-8fd2-3e3a257c37ee tempest-AttachVolumeShelveTestJSON-385853788 tempest-AttachVolumeShelveTestJSON-385853788-project] Acquiring lock "1daf4f4c-0e4a-4779-b53a-78c48397ea2f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120740) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 18:07:53.060773 dv-cinder-852009-8-iscsi devstack@n-api.service[120740]: DEBUG oslo_concurrency.lockutils [None req-15f38536-0933-4994-8fd2-3e3a257c37ee tempest-AttachVolumeShelveTestJSON-385853788 tempest-AttachVolumeShelveTestJSON-385853788-project] Lock "1daf4f4c-0e4a-4779-b53a-78c48397ea2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120740) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 18:07:53.061308 dv-cinder-852009-8-iscsi devstack@n-api.service[120740]: DEBUG oslo_concurrency.lockutils [None req-15f38536-0933-4994-8fd2-3e3a257c37ee tempest-AttachVolumeShelveTestJSON-385853788 tempest-AttachVolumeShelveTestJSON-385853788-project] Lock "1daf4f4c-0e4a-4779-b53a-78c48397ea2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120740) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 18:07:53.205836 dv-cinder-852009-8-iscsi devstack@n-api.service[120740]: DEBUG nova.policy [None req-15f38536-0933-4994-8fd2-3e3a257c37ee tempest-AttachVolumeShelveTestJSON-385853788 tempest-AttachVolumeShelveTestJSON-385853788-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e68ecd9b3ca643539b109f75bb242d6f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '75e14fd88bfb4cd896fa7b070a0fac47', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120740) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 18:07:53.218709 dv-cinder-852009-8-iscsi devstack@n-api.service[120740]: DEBUG nova.policy [None req-15f38536-0933-4994-8fd2-3e3a257c37ee tempest-AttachVolumeShelveTestJSON-385853788 tempest-AttachVolumeShelveTestJSON-385853788-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'e68ecd9b3ca643539b109f75bb242d6f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '75e14fd88bfb4cd896fa7b070a0fac47', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120740) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 18:07:53.220235 dv-cinder-852009-8-iscsi devstack@n-api.service[120740]: DEBUG nova.policy [None req-15f38536-0933-4994-8fd2-3e3a257c37ee tempest-AttachVolumeShelveTestJSON-385853788 tempest-AttachVolumeShelveTestJSON-385853788-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'e68ecd9b3ca643539b109f75bb242d6f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '75e14fd88bfb4cd896fa7b070a0fac47', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120740) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 18:07:53.221435 dv-cinder-852009-8-iscsi devstack@n-api.service[120740]: INFO nova.api.openstack.requestlog [None req-15f38536-0933-4994-8fd2-3e3a257c37ee tempest-AttachVolumeShelveTestJSON-385853788 tempest-AttachVolumeShelveTestJSON-385853788-project] 10.222.0.43 "GET /compute/v2.1/servers/8cecf08e-bea8-4cef-9439-0eaa242bfed1" status: 200 len: 1716 microversion: 2.20 time: 0.174650 Sep 13 18:07:53.221985 dv-cinder-852009-8-iscsi devstack@n-api.service[120740]: [pid: 120740|app: 0|req: 353/697] 10.222.0.43 () {60 vars in 1277 bytes} [Tue Sep 13 18:07:53 2022] GET /compute/v2.1/servers/8cecf08e-bea8-4cef-9439-0eaa242bfed1 => generated 1716 bytes in 176 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 13 18:07:53.425234 dv-cinder-852009-8-iscsi devstack@n-api.service[120741]: DEBUG nova.api.openstack.wsgi [None req-572a8ac5-ba9c-4e1b-93a5-761b22bd748f tempest-AttachVolumeTestJSON-555093534 tempest-AttachVolumeTestJSON-555093534-project] Calling method '>' {{(pid=120741) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 18:07:53.426276 dv-cinder-852009-8-iscsi devstack@n-api.service[120741]: DEBUG nova.compute.api [None req-572a8ac5-ba9c-4e1b-93a5-761b22bd748f tempest-AttachVolumeTestJSON-555093534 tempest-AttachVolumeTestJSON-555093534-project] [instance: d0983ec1-bb82-4a7d-9dba-ace1e3eb383a] Fetching instance by UUID {{(pid=120741) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 18:07:53.432513 dv-cinder-852009-8-iscsi devstack@n-api.service[120741]: DEBUG oslo_concurrency.lockutils [None req-572a8ac5-ba9c-4e1b-93a5-761b22bd748f tempest-AttachVolumeTestJSON-555093534 tempest-AttachVolumeTestJSON-555093534-project] Acquiring lock "1daf4f4c-0e4a-4779-b53a-78c48397ea2f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120741) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 18:07:53.433072 dv-cinder-852009-8-iscsi devstack@n-api.service[120741]: DEBUG oslo_concurrency.lockutils [None req-572a8ac5-ba9c-4e1b-93a5-761b22bd748f tempest-AttachVolumeTestJSON-555093534 tempest-AttachVolumeTestJSON-555093534-project] Lock "1daf4f4c-0e4a-4779-b53a-78c48397ea2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120741) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 18:07:53.433594 dv-cinder-852009-8-iscsi devstack@n-api.service[120741]: DEBUG oslo_concurrency.lockutils [None req-572a8ac5-ba9c-4e1b-93a5-761b22bd748f tempest-AttachVolumeTestJSON-555093534 tempest-AttachVolumeTestJSON-555093534-project] Lock "1daf4f4c-0e4a-4779-b53a-78c48397ea2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120741) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 18:07:53.434418 dv-cinder-852009-8-iscsi devstack@n-api.service[120741]: DEBUG oslo_concurrency.lockutils [None req-572a8ac5-ba9c-4e1b-93a5-761b22bd748f tempest-AttachVolumeTestJSON-555093534 tempest-AttachVolumeTestJSON-555093534-project] Acquiring lock "1daf4f4c-0e4a-4779-b53a-78c48397ea2f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120741) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 18:07:53.435029 dv-cinder-852009-8-iscsi devstack@n-api.service[120741]: DEBUG oslo_concurrency.lockutils [None req-572a8ac5-ba9c-4e1b-93a5-761b22bd748f tempest-AttachVolumeTestJSON-555093534 tempest-AttachVolumeTestJSON-555093534-project] Lock "1daf4f4c-0e4a-4779-b53a-78c48397ea2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120741) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 18:07:53.435489 dv-cinder-852009-8-iscsi devstack@n-api.service[120741]: DEBUG oslo_concurrency.lockutils [None req-572a8ac5-ba9c-4e1b-93a5-761b22bd748f tempest-AttachVolumeTestJSON-555093534 tempest-AttachVolumeTestJSON-555093534-project] Lock "1daf4f4c-0e4a-4779-b53a-78c48397ea2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120741) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 18:07:53.450605 dv-cinder-852009-8-iscsi devstack@n-api.service[120741]: INFO nova.api.openstack.wsgi [None req-572a8ac5-ba9c-4e1b-93a5-761b22bd748f tempest-AttachVolumeTestJSON-555093534 tempest-AttachVolumeTestJSON-555093534-project] HTTP exception thrown: Instance d0983ec1-bb82-4a7d-9dba-ace1e3eb383a could not be found. Sep 13 18:07:53.452450 dv-cinder-852009-8-iscsi devstack@n-api.service[120741]: DEBUG nova.api.openstack.wsgi [None req-572a8ac5-ba9c-4e1b-93a5-761b22bd748f tempest-AttachVolumeTestJSON-555093534 tempest-AttachVolumeTestJSON-555093534-project] Request method failure captured: Sep 13 18:07:53.452450 dv-cinder-852009-8-iscsi devstack@n-api.service[120741]: request: GET /compute/v2.1/servers/d0983ec1-bb82-4a7d-9dba-ace1e3eb383a HTTP/1.1 Sep 13 18:07:53.452450 dv-cinder-852009-8-iscsi devstack@n-api.service[120741]: Accept: application/json Sep 13 18:07:53.452450 dv-cinder-852009-8-iscsi devstack@n-api.service[120741]: Accept-Encoding: identity Sep 13 18:07:53.452450 dv-cinder-852009-8-iscsi devstack@n-api.service[120741]: Connection: close Sep 13 18:07:53.452450 dv-cinder-852009-8-iscsi devstack@n-api.service[120741]: Content-Length: 0 Sep 13 18:07:53.452450 dv-cinder-852009-8-iscsi devstack@n-api.service[120741]: Content-Type: application/json Sep 13 18:07:53.452450 dv-cinder-852009-8-iscsi devstack@n-api.service[120741]: Host: 10.222.0.43 Sep 13 18:07:53.452450 dv-cinder-852009-8-iscsi devstack@n-api.service[120741]: Openstack-System-Scope: None Sep 13 18:07:53.452450 dv-cinder-852009-8-iscsi devstack@n-api.service[120741]: User-Agent: python-urllib3/1.26.12 Sep 13 18:07:53.452450 dv-cinder-852009-8-iscsi devstack@n-api.service[120741]: X-Auth-Token: gAAAAABjIMWRpvfFxseo-bDVg1fnd5kZdHkOwDthdyuSjyLDBDaGBd0tRNAcWyUQSN99QlQGzPKdIVzTAWNjmk4wTGD41N0QFzkZdw8xrHL4a_XEHs7QZTJgaqv9b_MZ7RjwVfYtFh2UsHqvKyEbteoXm1QxW-OO9FPnECIQbldvbAikLpdkEmw Sep 13 18:07:53.452450 dv-cinder-852009-8-iscsi devstack@n-api.service[120741]: X-Domain-Id: None Sep 13 18:07:53.452450 dv-cinder-852009-8-iscsi devstack@n-api.service[120741]: X-Domain-Name: None Sep 13 18:07:53.452450 dv-cinder-852009-8-iscsi devstack@n-api.service[120741]: X-Identity-Status: Confirmed Sep 13 18:07:53.452450 dv-cinder-852009-8-iscsi devstack@n-api.service[120741]: X-Is-Admin-Project: True Sep 13 18:07:53.452450 dv-cinder-852009-8-iscsi devstack@n-api.service[120741]: X-Project-Domain-Id: default Sep 13 18:07:53.452450 dv-cinder-852009-8-iscsi devstack@n-api.service[120741]: X-Project-Domain-Name: Default Sep 13 18:07:53.452450 dv-cinder-852009-8-iscsi devstack@n-api.service[120741]: X-Project-Id: a279fcbf274c4704a31a2b95061e1469 Sep 13 18:07:53.452450 dv-cinder-852009-8-iscsi devstack@n-api.service[120741]: X-Project-Name: tempest-AttachVolumeTestJSON-555093534 Sep 13 18:07:53.452450 dv-cinder-852009-8-iscsi devstack@n-api.service[120741]: X-Role: reader,member Sep 13 18:07:53.452450 dv-cinder-852009-8-iscsi devstack@n-api.service[120741]: X-Roles: reader,member Sep 13 18:07:53.453767 dv-cinder-852009-8-iscsi devstack@n-api.service[120741]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/identity"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/compute/v2/a279fcbf274c4704a31a2b95061e1469"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.43:8080", "publicURL": "http://10.222.0.43:8080/v1/AUTH_a279fcbf274c4704a31a2b95061e1469"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43:9696/networking"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/volume/v3/a279fcbf274c4704a31a2b95061e1469"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/compute/v2.1"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/placement"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/volume/v3/a279fcbf274c4704a31a2b95061e1469"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/image"}]}] Sep 13 18:07:53.453767 dv-cinder-852009-8-iscsi devstack@n-api.service[120741]: X-Tenant: tempest-AttachVolumeTestJSON-555093534 Sep 13 18:07:53.453767 dv-cinder-852009-8-iscsi devstack@n-api.service[120741]: X-Tenant-Id: a279fcbf274c4704a31a2b95061e1469 Sep 13 18:07:53.453767 dv-cinder-852009-8-iscsi devstack@n-api.service[120741]: X-Tenant-Name: tempest-AttachVolumeTestJSON-555093534 Sep 13 18:07:53.453767 dv-cinder-852009-8-iscsi devstack@n-api.service[120741]: X-User: tempest-AttachVolumeTestJSON-555093534-project Sep 13 18:07:53.453767 dv-cinder-852009-8-iscsi devstack@n-api.service[120741]: X-User-Domain-Id: default Sep 13 18:07:53.453767 dv-cinder-852009-8-iscsi devstack@n-api.service[120741]: X-User-Domain-Name: Default Sep 13 18:07:53.453767 dv-cinder-852009-8-iscsi devstack@n-api.service[120741]: X-User-Id: 0625b3113ce044bbac4f6142eaade11c Sep 13 18:07:53.453767 dv-cinder-852009-8-iscsi devstack@n-api.service[120741]: X-User-Name: tempest-AttachVolumeTestJSON-555093534-project Sep 13 18:07:53.453767 dv-cinder-852009-8-iscsi devstack@n-api.service[120741]: method: > Sep 13 18:07:53.453767 dv-cinder-852009-8-iscsi devstack@n-api.service[120741]: exception: Instance d0983ec1-bb82-4a7d-9dba-ace1e3eb383a could not be found. Sep 13 18:07:53.453767 dv-cinder-852009-8-iscsi devstack@n-api.service[120741]: action_args: {'id': 'd0983ec1-bb82-4a7d-9dba-ace1e3eb383a'} Sep 13 18:07:53.454742 dv-cinder-852009-8-iscsi devstack@n-api.service[120741]: {{(pid=120741) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 13 18:07:53.454742 dv-cinder-852009-8-iscsi devstack@n-api.service[120741]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 13 18:07:53.454742 dv-cinder-852009-8-iscsi devstack@n-api.service[120741]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Sep 13 18:07:53.454742 dv-cinder-852009-8-iscsi devstack@n-api.service[120741]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Sep 13 18:07:53.454742 dv-cinder-852009-8-iscsi devstack@n-api.service[120741]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Sep 13 18:07:53.454742 dv-cinder-852009-8-iscsi devstack@n-api.service[120741]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Sep 13 18:07:53.454742 dv-cinder-852009-8-iscsi devstack@n-api.service[120741]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Sep 13 18:07:53.454742 dv-cinder-852009-8-iscsi devstack@n-api.service[120741]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Sep 13 18:07:53.454742 dv-cinder-852009-8-iscsi devstack@n-api.service[120741]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Sep 13 18:07:53.454742 dv-cinder-852009-8-iscsi devstack@n-api.service[120741]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Sep 13 18:07:53.454742 dv-cinder-852009-8-iscsi devstack@n-api.service[120741]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance d0983ec1-bb82-4a7d-9dba-ace1e3eb383a could not be found. Sep 13 18:07:53.454742 dv-cinder-852009-8-iscsi devstack@n-api.service[120741]: ERROR nova.api.openstack.wsgi Sep 13 18:07:53.454742 dv-cinder-852009-8-iscsi devstack@n-api.service[120741]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 13 18:07:53.454742 dv-cinder-852009-8-iscsi devstack@n-api.service[120741]: ERROR nova.api.openstack.wsgi Sep 13 18:07:53.454742 dv-cinder-852009-8-iscsi devstack@n-api.service[120741]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 13 18:07:53.454742 dv-cinder-852009-8-iscsi devstack@n-api.service[120741]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 13 18:07:53.454742 dv-cinder-852009-8-iscsi devstack@n-api.service[120741]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 13 18:07:53.454742 dv-cinder-852009-8-iscsi devstack@n-api.service[120741]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 13 18:07:53.454742 dv-cinder-852009-8-iscsi devstack@n-api.service[120741]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 13 18:07:53.454742 dv-cinder-852009-8-iscsi devstack@n-api.service[120741]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 13 18:07:53.456838 dv-cinder-852009-8-iscsi devstack@n-api.service[120741]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 13 18:07:53.456838 dv-cinder-852009-8-iscsi devstack@n-api.service[120741]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Sep 13 18:07:53.456838 dv-cinder-852009-8-iscsi devstack@n-api.service[120741]: ERROR nova.api.openstack.wsgi instance = self._get_server( Sep 13 18:07:53.456838 dv-cinder-852009-8-iscsi devstack@n-api.service[120741]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Sep 13 18:07:53.456838 dv-cinder-852009-8-iscsi devstack@n-api.service[120741]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Sep 13 18:07:53.456838 dv-cinder-852009-8-iscsi devstack@n-api.service[120741]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Sep 13 18:07:53.456838 dv-cinder-852009-8-iscsi devstack@n-api.service[120741]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Sep 13 18:07:53.456838 dv-cinder-852009-8-iscsi devstack@n-api.service[120741]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance d0983ec1-bb82-4a7d-9dba-ace1e3eb383a could not be found. Sep 13 18:07:53.456838 dv-cinder-852009-8-iscsi devstack@n-api.service[120741]: ERROR nova.api.openstack.wsgi Sep 13 18:07:53.456838 dv-cinder-852009-8-iscsi devstack@n-api.service[120741]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 13 18:07:53.456838 dv-cinder-852009-8-iscsi devstack@n-api.service[120741]: ERROR nova.api.openstack.wsgi Sep 13 18:07:53.456838 dv-cinder-852009-8-iscsi devstack@n-api.service[120741]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 13 18:07:53.456838 dv-cinder-852009-8-iscsi devstack@n-api.service[120741]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 13 18:07:53.456838 dv-cinder-852009-8-iscsi devstack@n-api.service[120741]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 13 18:07:53.456838 dv-cinder-852009-8-iscsi devstack@n-api.service[120741]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 13 18:07:53.456838 dv-cinder-852009-8-iscsi devstack@n-api.service[120741]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 13 18:07:53.456838 dv-cinder-852009-8-iscsi devstack@n-api.service[120741]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance d0983ec1-bb82-4a7d-9dba-ace1e3eb383a could not be found. Sep 13 18:07:53.456838 dv-cinder-852009-8-iscsi devstack@n-api.service[120741]: ERROR nova.api.openstack.wsgi Sep 13 18:07:53.458631 dv-cinder-852009-8-iscsi devstack@n-api.service[120741]: DEBUG nova.api.openstack.wsgi [None req-572a8ac5-ba9c-4e1b-93a5-761b22bd748f tempest-AttachVolumeTestJSON-555093534 tempest-AttachVolumeTestJSON-555093534-project] Returning 404 to user: Instance d0983ec1-bb82-4a7d-9dba-ace1e3eb383a could not be found. {{(pid=120741) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 13 18:07:53.458631 dv-cinder-852009-8-iscsi devstack@n-api.service[120741]: INFO nova.api.openstack.requestlog [None req-572a8ac5-ba9c-4e1b-93a5-761b22bd748f tempest-AttachVolumeTestJSON-555093534 tempest-AttachVolumeTestJSON-555093534-project] 10.222.0.43 "GET /compute/v2.1/servers/d0983ec1-bb82-4a7d-9dba-ace1e3eb383a" status: 404 len: 111 microversion: 2.1 time: 0.033773 Sep 13 18:07:53.458631 dv-cinder-852009-8-iscsi devstack@n-api.service[120741]: [pid: 120741|app: 0|req: 345/698] 10.222.0.43 () {58 vars in 1236 bytes} [Tue Sep 13 18:07:53 2022] GET /compute/v2.1/servers/d0983ec1-bb82-4a7d-9dba-ace1e3eb383a => generated 111 bytes in 38 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Sep 13 18:07:53.462769 dv-cinder-852009-8-iscsi devstack@n-api.service[120740]: DEBUG nova.api.openstack.wsgi [None req-dbe138f3-4f82-49d4-b503-c34c59c59271 tempest-AttachVolumeTestJSON-555093534 tempest-AttachVolumeTestJSON-555093534-project] Calling method '.version_select at 0x7fa626a24e50>' {{(pid=120740) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 18:07:53.485171 dv-cinder-852009-8-iscsi devstack@n-api.service[120740]: INFO nova.api.openstack.requestlog [None req-dbe138f3-4f82-49d4-b503-c34c59c59271 tempest-AttachVolumeTestJSON-555093534 tempest-AttachVolumeTestJSON-555093534-project] 10.222.0.43 "DELETE /compute/v2.1/os-keypairs/tempest-keypair-1705096806" status: 202 len: 0 microversion: 2.1 time: 0.026102 Sep 13 18:07:53.486224 dv-cinder-852009-8-iscsi devstack@n-api.service[120740]: [pid: 120740|app: 0|req: 354/699] 10.222.0.43 () {58 vars in 1221 bytes} [Tue Sep 13 18:07:53 2022] DELETE /compute/v2.1/os-keypairs/tempest-keypair-1705096806 => generated 0 bytes in 28 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Sep 13 18:07:56.905607 dv-cinder-852009-8-iscsi devstack@n-api.service[120741]: DEBUG nova.api.openstack.wsgi [None req-2d04f2d0-ee5f-469f-ae79-730bb6fc1840 tempest-AttachVolumeTestJSON-555093534 tempest-AttachVolumeTestJSON-555093534-project] Calling method '>' {{(pid=120741) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 18:07:56.906680 dv-cinder-852009-8-iscsi devstack@n-api.service[120741]: DEBUG nova.compute.api [None req-2d04f2d0-ee5f-469f-ae79-730bb6fc1840 tempest-AttachVolumeTestJSON-555093534 tempest-AttachVolumeTestJSON-555093534-project] [instance: d0983ec1-bb82-4a7d-9dba-ace1e3eb383a] Fetching instance by UUID {{(pid=120741) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 18:07:56.913543 dv-cinder-852009-8-iscsi devstack@n-api.service[120741]: DEBUG oslo_concurrency.lockutils [None req-2d04f2d0-ee5f-469f-ae79-730bb6fc1840 tempest-AttachVolumeTestJSON-555093534 tempest-AttachVolumeTestJSON-555093534-project] Acquiring lock "1daf4f4c-0e4a-4779-b53a-78c48397ea2f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120741) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 18:07:56.914026 dv-cinder-852009-8-iscsi devstack@n-api.service[120741]: DEBUG oslo_concurrency.lockutils [None req-2d04f2d0-ee5f-469f-ae79-730bb6fc1840 tempest-AttachVolumeTestJSON-555093534 tempest-AttachVolumeTestJSON-555093534-project] Lock "1daf4f4c-0e4a-4779-b53a-78c48397ea2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120741) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 18:07:56.914457 dv-cinder-852009-8-iscsi devstack@n-api.service[120741]: DEBUG oslo_concurrency.lockutils [None req-2d04f2d0-ee5f-469f-ae79-730bb6fc1840 tempest-AttachVolumeTestJSON-555093534 tempest-AttachVolumeTestJSON-555093534-project] Lock "1daf4f4c-0e4a-4779-b53a-78c48397ea2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120741) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 18:07:56.915345 dv-cinder-852009-8-iscsi devstack@n-api.service[120741]: DEBUG oslo_concurrency.lockutils [None req-2d04f2d0-ee5f-469f-ae79-730bb6fc1840 tempest-AttachVolumeTestJSON-555093534 tempest-AttachVolumeTestJSON-555093534-project] Acquiring lock "1daf4f4c-0e4a-4779-b53a-78c48397ea2f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120741) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 18:07:56.915795 dv-cinder-852009-8-iscsi devstack@n-api.service[120741]: DEBUG oslo_concurrency.lockutils [None req-2d04f2d0-ee5f-469f-ae79-730bb6fc1840 tempest-AttachVolumeTestJSON-555093534 tempest-AttachVolumeTestJSON-555093534-project] Lock "1daf4f4c-0e4a-4779-b53a-78c48397ea2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120741) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 18:07:56.916216 dv-cinder-852009-8-iscsi devstack@n-api.service[120741]: DEBUG oslo_concurrency.lockutils [None req-2d04f2d0-ee5f-469f-ae79-730bb6fc1840 tempest-AttachVolumeTestJSON-555093534 tempest-AttachVolumeTestJSON-555093534-project] Lock "1daf4f4c-0e4a-4779-b53a-78c48397ea2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120741) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 18:07:56.931925 dv-cinder-852009-8-iscsi devstack@n-api.service[120741]: INFO nova.api.openstack.wsgi [None req-2d04f2d0-ee5f-469f-ae79-730bb6fc1840 tempest-AttachVolumeTestJSON-555093534 tempest-AttachVolumeTestJSON-555093534-project] HTTP exception thrown: Instance d0983ec1-bb82-4a7d-9dba-ace1e3eb383a could not be found. Sep 13 18:07:56.933562 dv-cinder-852009-8-iscsi devstack@n-api.service[120741]: DEBUG nova.api.openstack.wsgi [None req-2d04f2d0-ee5f-469f-ae79-730bb6fc1840 tempest-AttachVolumeTestJSON-555093534 tempest-AttachVolumeTestJSON-555093534-project] Request method failure captured: Sep 13 18:07:56.933562 dv-cinder-852009-8-iscsi devstack@n-api.service[120741]: request: DELETE /compute/v2.1/servers/d0983ec1-bb82-4a7d-9dba-ace1e3eb383a HTTP/1.1 Sep 13 18:07:56.933562 dv-cinder-852009-8-iscsi devstack@n-api.service[120741]: Accept: application/json Sep 13 18:07:56.933562 dv-cinder-852009-8-iscsi devstack@n-api.service[120741]: Accept-Encoding: identity Sep 13 18:07:56.933562 dv-cinder-852009-8-iscsi devstack@n-api.service[120741]: Connection: close Sep 13 18:07:56.933562 dv-cinder-852009-8-iscsi devstack@n-api.service[120741]: Content-Length: 0 Sep 13 18:07:56.933562 dv-cinder-852009-8-iscsi devstack@n-api.service[120741]: Content-Type: application/json Sep 13 18:07:56.933562 dv-cinder-852009-8-iscsi devstack@n-api.service[120741]: Host: 10.222.0.43 Sep 13 18:07:56.933562 dv-cinder-852009-8-iscsi devstack@n-api.service[120741]: Openstack-System-Scope: None Sep 13 18:07:56.933562 dv-cinder-852009-8-iscsi devstack@n-api.service[120741]: User-Agent: python-urllib3/1.26.12 Sep 13 18:07:56.933562 dv-cinder-852009-8-iscsi devstack@n-api.service[120741]: X-Auth-Token: gAAAAABjIMWRpvfFxseo-bDVg1fnd5kZdHkOwDthdyuSjyLDBDaGBd0tRNAcWyUQSN99QlQGzPKdIVzTAWNjmk4wTGD41N0QFzkZdw8xrHL4a_XEHs7QZTJgaqv9b_MZ7RjwVfYtFh2UsHqvKyEbteoXm1QxW-OO9FPnECIQbldvbAikLpdkEmw Sep 13 18:07:56.933562 dv-cinder-852009-8-iscsi devstack@n-api.service[120741]: X-Domain-Id: None Sep 13 18:07:56.933562 dv-cinder-852009-8-iscsi devstack@n-api.service[120741]: X-Domain-Name: None Sep 13 18:07:56.933562 dv-cinder-852009-8-iscsi devstack@n-api.service[120741]: X-Identity-Status: Confirmed Sep 13 18:07:56.933562 dv-cinder-852009-8-iscsi devstack@n-api.service[120741]: X-Is-Admin-Project: True Sep 13 18:07:56.933562 dv-cinder-852009-8-iscsi devstack@n-api.service[120741]: X-Project-Domain-Id: default Sep 13 18:07:56.933562 dv-cinder-852009-8-iscsi devstack@n-api.service[120741]: X-Project-Domain-Name: Default Sep 13 18:07:56.933562 dv-cinder-852009-8-iscsi devstack@n-api.service[120741]: X-Project-Id: a279fcbf274c4704a31a2b95061e1469 Sep 13 18:07:56.933562 dv-cinder-852009-8-iscsi devstack@n-api.service[120741]: X-Project-Name: tempest-AttachVolumeTestJSON-555093534 Sep 13 18:07:56.933562 dv-cinder-852009-8-iscsi devstack@n-api.service[120741]: X-Role: reader,member Sep 13 18:07:56.933562 dv-cinder-852009-8-iscsi devstack@n-api.service[120741]: X-Roles: reader,member Sep 13 18:07:56.935098 dv-cinder-852009-8-iscsi devstack@n-api.service[120741]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/identity"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/compute/v2/a279fcbf274c4704a31a2b95061e1469"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.43:8080", "publicURL": "http://10.222.0.43:8080/v1/AUTH_a279fcbf274c4704a31a2b95061e1469"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43:9696/networking"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/volume/v3/a279fcbf274c4704a31a2b95061e1469"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/compute/v2.1"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/placement"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/volume/v3/a279fcbf274c4704a31a2b95061e1469"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/image"}]}] Sep 13 18:07:56.935098 dv-cinder-852009-8-iscsi devstack@n-api.service[120741]: X-Tenant: tempest-AttachVolumeTestJSON-555093534 Sep 13 18:07:56.935098 dv-cinder-852009-8-iscsi devstack@n-api.service[120741]: X-Tenant-Id: a279fcbf274c4704a31a2b95061e1469 Sep 13 18:07:56.935098 dv-cinder-852009-8-iscsi devstack@n-api.service[120741]: X-Tenant-Name: tempest-AttachVolumeTestJSON-555093534 Sep 13 18:07:56.935098 dv-cinder-852009-8-iscsi devstack@n-api.service[120741]: X-User: tempest-AttachVolumeTestJSON-555093534-project Sep 13 18:07:56.935098 dv-cinder-852009-8-iscsi devstack@n-api.service[120741]: X-User-Domain-Id: default Sep 13 18:07:56.935098 dv-cinder-852009-8-iscsi devstack@n-api.service[120741]: X-User-Domain-Name: Default Sep 13 18:07:56.935098 dv-cinder-852009-8-iscsi devstack@n-api.service[120741]: X-User-Id: 0625b3113ce044bbac4f6142eaade11c Sep 13 18:07:56.935098 dv-cinder-852009-8-iscsi devstack@n-api.service[120741]: X-User-Name: tempest-AttachVolumeTestJSON-555093534-project Sep 13 18:07:56.935098 dv-cinder-852009-8-iscsi devstack@n-api.service[120741]: method: > Sep 13 18:07:56.935098 dv-cinder-852009-8-iscsi devstack@n-api.service[120741]: exception: Instance d0983ec1-bb82-4a7d-9dba-ace1e3eb383a could not be found. Sep 13 18:07:56.935098 dv-cinder-852009-8-iscsi devstack@n-api.service[120741]: action_args: {'id': 'd0983ec1-bb82-4a7d-9dba-ace1e3eb383a'} Sep 13 18:07:56.936193 dv-cinder-852009-8-iscsi devstack@n-api.service[120741]: {{(pid=120741) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 13 18:07:56.936193 dv-cinder-852009-8-iscsi devstack@n-api.service[120741]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 13 18:07:56.936193 dv-cinder-852009-8-iscsi devstack@n-api.service[120741]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Sep 13 18:07:56.936193 dv-cinder-852009-8-iscsi devstack@n-api.service[120741]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Sep 13 18:07:56.936193 dv-cinder-852009-8-iscsi devstack@n-api.service[120741]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Sep 13 18:07:56.936193 dv-cinder-852009-8-iscsi devstack@n-api.service[120741]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Sep 13 18:07:56.936193 dv-cinder-852009-8-iscsi devstack@n-api.service[120741]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Sep 13 18:07:56.936193 dv-cinder-852009-8-iscsi devstack@n-api.service[120741]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Sep 13 18:07:56.936193 dv-cinder-852009-8-iscsi devstack@n-api.service[120741]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Sep 13 18:07:56.936193 dv-cinder-852009-8-iscsi devstack@n-api.service[120741]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Sep 13 18:07:56.936193 dv-cinder-852009-8-iscsi devstack@n-api.service[120741]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance d0983ec1-bb82-4a7d-9dba-ace1e3eb383a could not be found. Sep 13 18:07:56.936193 dv-cinder-852009-8-iscsi devstack@n-api.service[120741]: ERROR nova.api.openstack.wsgi Sep 13 18:07:56.936193 dv-cinder-852009-8-iscsi devstack@n-api.service[120741]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 13 18:07:56.936193 dv-cinder-852009-8-iscsi devstack@n-api.service[120741]: ERROR nova.api.openstack.wsgi Sep 13 18:07:56.936193 dv-cinder-852009-8-iscsi devstack@n-api.service[120741]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 13 18:07:56.936193 dv-cinder-852009-8-iscsi devstack@n-api.service[120741]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 13 18:07:56.936193 dv-cinder-852009-8-iscsi devstack@n-api.service[120741]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 13 18:07:56.936193 dv-cinder-852009-8-iscsi devstack@n-api.service[120741]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 13 18:07:56.936193 dv-cinder-852009-8-iscsi devstack@n-api.service[120741]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 13 18:07:56.936193 dv-cinder-852009-8-iscsi devstack@n-api.service[120741]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 13 18:07:56.937607 dv-cinder-852009-8-iscsi devstack@n-api.service[120741]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 13 18:07:56.937607 dv-cinder-852009-8-iscsi devstack@n-api.service[120741]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete Sep 13 18:07:56.937607 dv-cinder-852009-8-iscsi devstack@n-api.service[120741]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) Sep 13 18:07:56.937607 dv-cinder-852009-8-iscsi devstack@n-api.service[120741]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete Sep 13 18:07:56.937607 dv-cinder-852009-8-iscsi devstack@n-api.service[120741]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) Sep 13 18:07:56.937607 dv-cinder-852009-8-iscsi devstack@n-api.service[120741]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Sep 13 18:07:56.937607 dv-cinder-852009-8-iscsi devstack@n-api.service[120741]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Sep 13 18:07:56.937607 dv-cinder-852009-8-iscsi devstack@n-api.service[120741]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Sep 13 18:07:56.937607 dv-cinder-852009-8-iscsi devstack@n-api.service[120741]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Sep 13 18:07:56.937607 dv-cinder-852009-8-iscsi devstack@n-api.service[120741]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance d0983ec1-bb82-4a7d-9dba-ace1e3eb383a could not be found. Sep 13 18:07:56.937607 dv-cinder-852009-8-iscsi devstack@n-api.service[120741]: ERROR nova.api.openstack.wsgi Sep 13 18:07:56.937607 dv-cinder-852009-8-iscsi devstack@n-api.service[120741]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 13 18:07:56.937607 dv-cinder-852009-8-iscsi devstack@n-api.service[120741]: ERROR nova.api.openstack.wsgi Sep 13 18:07:56.937607 dv-cinder-852009-8-iscsi devstack@n-api.service[120741]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 13 18:07:56.937607 dv-cinder-852009-8-iscsi devstack@n-api.service[120741]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 13 18:07:56.937607 dv-cinder-852009-8-iscsi devstack@n-api.service[120741]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 13 18:07:56.937607 dv-cinder-852009-8-iscsi devstack@n-api.service[120741]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 13 18:07:56.937607 dv-cinder-852009-8-iscsi devstack@n-api.service[120741]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 13 18:07:56.937607 dv-cinder-852009-8-iscsi devstack@n-api.service[120741]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance d0983ec1-bb82-4a7d-9dba-ace1e3eb383a could not be found. Sep 13 18:07:56.937607 dv-cinder-852009-8-iscsi devstack@n-api.service[120741]: ERROR nova.api.openstack.wsgi Sep 13 18:07:56.939501 dv-cinder-852009-8-iscsi devstack@n-api.service[120741]: DEBUG nova.api.openstack.wsgi [None req-2d04f2d0-ee5f-469f-ae79-730bb6fc1840 tempest-AttachVolumeTestJSON-555093534 tempest-AttachVolumeTestJSON-555093534-project] Returning 404 to user: Instance d0983ec1-bb82-4a7d-9dba-ace1e3eb383a could not be found. {{(pid=120741) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 13 18:07:56.939501 dv-cinder-852009-8-iscsi devstack@n-api.service[120741]: INFO nova.api.openstack.requestlog [None req-2d04f2d0-ee5f-469f-ae79-730bb6fc1840 tempest-AttachVolumeTestJSON-555093534 tempest-AttachVolumeTestJSON-555093534-project] 10.222.0.43 "DELETE /compute/v2.1/servers/d0983ec1-bb82-4a7d-9dba-ace1e3eb383a" status: 404 len: 111 microversion: 2.1 time: 0.033410 Sep 13 18:07:56.939501 dv-cinder-852009-8-iscsi devstack@n-api.service[120741]: [pid: 120741|app: 0|req: 346/700] 10.222.0.43 () {58 vars in 1239 bytes} [Tue Sep 13 18:07:56 2022] DELETE /compute/v2.1/servers/d0983ec1-bb82-4a7d-9dba-ace1e3eb383a => generated 111 bytes in 38 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Sep 13 18:07:56.945373 dv-cinder-852009-8-iscsi devstack@n-api.service[120740]: DEBUG nova.api.openstack.wsgi [None req-0aab4136-1cdc-4e48-81ae-f84386453f90 tempest-AttachVolumeTestJSON-555093534 tempest-AttachVolumeTestJSON-555093534-project] Calling method '>' {{(pid=120740) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 18:07:56.945986 dv-cinder-852009-8-iscsi devstack@n-api.service[120740]: DEBUG nova.compute.api [None req-0aab4136-1cdc-4e48-81ae-f84386453f90 tempest-AttachVolumeTestJSON-555093534 tempest-AttachVolumeTestJSON-555093534-project] [instance: d0983ec1-bb82-4a7d-9dba-ace1e3eb383a] Fetching instance by UUID {{(pid=120740) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 18:07:56.952939 dv-cinder-852009-8-iscsi devstack@n-api.service[120740]: DEBUG oslo_concurrency.lockutils [None req-0aab4136-1cdc-4e48-81ae-f84386453f90 tempest-AttachVolumeTestJSON-555093534 tempest-AttachVolumeTestJSON-555093534-project] Acquiring lock "1daf4f4c-0e4a-4779-b53a-78c48397ea2f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120740) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 18:07:56.953425 dv-cinder-852009-8-iscsi devstack@n-api.service[120740]: DEBUG oslo_concurrency.lockutils [None req-0aab4136-1cdc-4e48-81ae-f84386453f90 tempest-AttachVolumeTestJSON-555093534 tempest-AttachVolumeTestJSON-555093534-project] Lock "1daf4f4c-0e4a-4779-b53a-78c48397ea2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120740) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 18:07:56.953850 dv-cinder-852009-8-iscsi devstack@n-api.service[120740]: DEBUG oslo_concurrency.lockutils [None req-0aab4136-1cdc-4e48-81ae-f84386453f90 tempest-AttachVolumeTestJSON-555093534 tempest-AttachVolumeTestJSON-555093534-project] Lock "1daf4f4c-0e4a-4779-b53a-78c48397ea2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120740) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 18:07:56.954559 dv-cinder-852009-8-iscsi devstack@n-api.service[120740]: DEBUG oslo_concurrency.lockutils [None req-0aab4136-1cdc-4e48-81ae-f84386453f90 tempest-AttachVolumeTestJSON-555093534 tempest-AttachVolumeTestJSON-555093534-project] Acquiring lock "1daf4f4c-0e4a-4779-b53a-78c48397ea2f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120740) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 18:07:56.955097 dv-cinder-852009-8-iscsi devstack@n-api.service[120740]: DEBUG oslo_concurrency.lockutils [None req-0aab4136-1cdc-4e48-81ae-f84386453f90 tempest-AttachVolumeTestJSON-555093534 tempest-AttachVolumeTestJSON-555093534-project] Lock "1daf4f4c-0e4a-4779-b53a-78c48397ea2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120740) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 18:07:56.955517 dv-cinder-852009-8-iscsi devstack@n-api.service[120740]: DEBUG oslo_concurrency.lockutils [None req-0aab4136-1cdc-4e48-81ae-f84386453f90 tempest-AttachVolumeTestJSON-555093534 tempest-AttachVolumeTestJSON-555093534-project] Lock "1daf4f4c-0e4a-4779-b53a-78c48397ea2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120740) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 18:07:56.973096 dv-cinder-852009-8-iscsi devstack@n-api.service[120740]: INFO nova.api.openstack.wsgi [None req-0aab4136-1cdc-4e48-81ae-f84386453f90 tempest-AttachVolumeTestJSON-555093534 tempest-AttachVolumeTestJSON-555093534-project] HTTP exception thrown: Instance d0983ec1-bb82-4a7d-9dba-ace1e3eb383a could not be found. Sep 13 18:07:56.974734 dv-cinder-852009-8-iscsi devstack@n-api.service[120740]: DEBUG nova.api.openstack.wsgi [None req-0aab4136-1cdc-4e48-81ae-f84386453f90 tempest-AttachVolumeTestJSON-555093534 tempest-AttachVolumeTestJSON-555093534-project] Request method failure captured: Sep 13 18:07:56.974734 dv-cinder-852009-8-iscsi devstack@n-api.service[120740]: request: GET /compute/v2.1/servers/d0983ec1-bb82-4a7d-9dba-ace1e3eb383a HTTP/1.1 Sep 13 18:07:56.974734 dv-cinder-852009-8-iscsi devstack@n-api.service[120740]: Accept: application/json Sep 13 18:07:56.974734 dv-cinder-852009-8-iscsi devstack@n-api.service[120740]: Accept-Encoding: identity Sep 13 18:07:56.974734 dv-cinder-852009-8-iscsi devstack@n-api.service[120740]: Connection: close Sep 13 18:07:56.974734 dv-cinder-852009-8-iscsi devstack@n-api.service[120740]: Content-Length: 0 Sep 13 18:07:56.974734 dv-cinder-852009-8-iscsi devstack@n-api.service[120740]: Content-Type: application/json Sep 13 18:07:56.974734 dv-cinder-852009-8-iscsi devstack@n-api.service[120740]: Host: 10.222.0.43 Sep 13 18:07:56.974734 dv-cinder-852009-8-iscsi devstack@n-api.service[120740]: Openstack-System-Scope: None Sep 13 18:07:56.974734 dv-cinder-852009-8-iscsi devstack@n-api.service[120740]: User-Agent: python-urllib3/1.26.12 Sep 13 18:07:56.974734 dv-cinder-852009-8-iscsi devstack@n-api.service[120740]: X-Auth-Token: gAAAAABjIMWRpvfFxseo-bDVg1fnd5kZdHkOwDthdyuSjyLDBDaGBd0tRNAcWyUQSN99QlQGzPKdIVzTAWNjmk4wTGD41N0QFzkZdw8xrHL4a_XEHs7QZTJgaqv9b_MZ7RjwVfYtFh2UsHqvKyEbteoXm1QxW-OO9FPnECIQbldvbAikLpdkEmw Sep 13 18:07:56.974734 dv-cinder-852009-8-iscsi devstack@n-api.service[120740]: X-Domain-Id: None Sep 13 18:07:56.974734 dv-cinder-852009-8-iscsi devstack@n-api.service[120740]: X-Domain-Name: None Sep 13 18:07:56.974734 dv-cinder-852009-8-iscsi devstack@n-api.service[120740]: X-Identity-Status: Confirmed Sep 13 18:07:56.974734 dv-cinder-852009-8-iscsi devstack@n-api.service[120740]: X-Is-Admin-Project: True Sep 13 18:07:56.974734 dv-cinder-852009-8-iscsi devstack@n-api.service[120740]: X-Project-Domain-Id: default Sep 13 18:07:56.974734 dv-cinder-852009-8-iscsi devstack@n-api.service[120740]: X-Project-Domain-Name: Default Sep 13 18:07:56.974734 dv-cinder-852009-8-iscsi devstack@n-api.service[120740]: X-Project-Id: a279fcbf274c4704a31a2b95061e1469 Sep 13 18:07:56.974734 dv-cinder-852009-8-iscsi devstack@n-api.service[120740]: X-Project-Name: tempest-AttachVolumeTestJSON-555093534 Sep 13 18:07:56.974734 dv-cinder-852009-8-iscsi devstack@n-api.service[120740]: X-Role: reader,member Sep 13 18:07:56.974734 dv-cinder-852009-8-iscsi devstack@n-api.service[120740]: X-Roles: reader,member Sep 13 18:07:56.976092 dv-cinder-852009-8-iscsi devstack@n-api.service[120740]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/identity"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/compute/v2/a279fcbf274c4704a31a2b95061e1469"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.43:8080", "publicURL": "http://10.222.0.43:8080/v1/AUTH_a279fcbf274c4704a31a2b95061e1469"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43:9696/networking"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/volume/v3/a279fcbf274c4704a31a2b95061e1469"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/compute/v2.1"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/placement"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/volume/v3/a279fcbf274c4704a31a2b95061e1469"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/image"}]}] Sep 13 18:07:56.976092 dv-cinder-852009-8-iscsi devstack@n-api.service[120740]: X-Tenant: tempest-AttachVolumeTestJSON-555093534 Sep 13 18:07:56.976092 dv-cinder-852009-8-iscsi devstack@n-api.service[120740]: X-Tenant-Id: a279fcbf274c4704a31a2b95061e1469 Sep 13 18:07:56.976092 dv-cinder-852009-8-iscsi devstack@n-api.service[120740]: X-Tenant-Name: tempest-AttachVolumeTestJSON-555093534 Sep 13 18:07:56.976092 dv-cinder-852009-8-iscsi devstack@n-api.service[120740]: X-User: tempest-AttachVolumeTestJSON-555093534-project Sep 13 18:07:56.976092 dv-cinder-852009-8-iscsi devstack@n-api.service[120740]: X-User-Domain-Id: default Sep 13 18:07:56.976092 dv-cinder-852009-8-iscsi devstack@n-api.service[120740]: X-User-Domain-Name: Default Sep 13 18:07:56.976092 dv-cinder-852009-8-iscsi devstack@n-api.service[120740]: X-User-Id: 0625b3113ce044bbac4f6142eaade11c Sep 13 18:07:56.976092 dv-cinder-852009-8-iscsi devstack@n-api.service[120740]: X-User-Name: tempest-AttachVolumeTestJSON-555093534-project Sep 13 18:07:56.976092 dv-cinder-852009-8-iscsi devstack@n-api.service[120740]: method: > Sep 13 18:07:56.976092 dv-cinder-852009-8-iscsi devstack@n-api.service[120740]: exception: Instance d0983ec1-bb82-4a7d-9dba-ace1e3eb383a could not be found. Sep 13 18:07:56.976092 dv-cinder-852009-8-iscsi devstack@n-api.service[120740]: action_args: {'id': 'd0983ec1-bb82-4a7d-9dba-ace1e3eb383a'} Sep 13 18:07:56.978196 dv-cinder-852009-8-iscsi devstack@n-api.service[120740]: {{(pid=120740) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 13 18:07:56.978196 dv-cinder-852009-8-iscsi devstack@n-api.service[120740]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 13 18:07:56.978196 dv-cinder-852009-8-iscsi devstack@n-api.service[120740]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Sep 13 18:07:56.978196 dv-cinder-852009-8-iscsi devstack@n-api.service[120740]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Sep 13 18:07:56.978196 dv-cinder-852009-8-iscsi devstack@n-api.service[120740]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Sep 13 18:07:56.978196 dv-cinder-852009-8-iscsi devstack@n-api.service[120740]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Sep 13 18:07:56.978196 dv-cinder-852009-8-iscsi devstack@n-api.service[120740]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Sep 13 18:07:56.978196 dv-cinder-852009-8-iscsi devstack@n-api.service[120740]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Sep 13 18:07:56.978196 dv-cinder-852009-8-iscsi devstack@n-api.service[120740]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Sep 13 18:07:56.978196 dv-cinder-852009-8-iscsi devstack@n-api.service[120740]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Sep 13 18:07:56.978196 dv-cinder-852009-8-iscsi devstack@n-api.service[120740]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance d0983ec1-bb82-4a7d-9dba-ace1e3eb383a could not be found. Sep 13 18:07:56.978196 dv-cinder-852009-8-iscsi devstack@n-api.service[120740]: ERROR nova.api.openstack.wsgi Sep 13 18:07:56.978196 dv-cinder-852009-8-iscsi devstack@n-api.service[120740]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 13 18:07:56.978196 dv-cinder-852009-8-iscsi devstack@n-api.service[120740]: ERROR nova.api.openstack.wsgi Sep 13 18:07:56.978196 dv-cinder-852009-8-iscsi devstack@n-api.service[120740]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 13 18:07:56.978196 dv-cinder-852009-8-iscsi devstack@n-api.service[120740]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 13 18:07:56.978196 dv-cinder-852009-8-iscsi devstack@n-api.service[120740]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 13 18:07:56.978196 dv-cinder-852009-8-iscsi devstack@n-api.service[120740]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 13 18:07:56.978196 dv-cinder-852009-8-iscsi devstack@n-api.service[120740]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 13 18:07:56.978196 dv-cinder-852009-8-iscsi devstack@n-api.service[120740]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 13 18:07:56.979572 dv-cinder-852009-8-iscsi devstack@n-api.service[120740]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 13 18:07:56.979572 dv-cinder-852009-8-iscsi devstack@n-api.service[120740]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Sep 13 18:07:56.979572 dv-cinder-852009-8-iscsi devstack@n-api.service[120740]: ERROR nova.api.openstack.wsgi instance = self._get_server( Sep 13 18:07:56.979572 dv-cinder-852009-8-iscsi devstack@n-api.service[120740]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Sep 13 18:07:56.979572 dv-cinder-852009-8-iscsi devstack@n-api.service[120740]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Sep 13 18:07:56.979572 dv-cinder-852009-8-iscsi devstack@n-api.service[120740]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Sep 13 18:07:56.979572 dv-cinder-852009-8-iscsi devstack@n-api.service[120740]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Sep 13 18:07:56.979572 dv-cinder-852009-8-iscsi devstack@n-api.service[120740]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance d0983ec1-bb82-4a7d-9dba-ace1e3eb383a could not be found. Sep 13 18:07:56.979572 dv-cinder-852009-8-iscsi devstack@n-api.service[120740]: ERROR nova.api.openstack.wsgi Sep 13 18:07:56.979572 dv-cinder-852009-8-iscsi devstack@n-api.service[120740]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 13 18:07:56.979572 dv-cinder-852009-8-iscsi devstack@n-api.service[120740]: ERROR nova.api.openstack.wsgi Sep 13 18:07:56.979572 dv-cinder-852009-8-iscsi devstack@n-api.service[120740]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 13 18:07:56.979572 dv-cinder-852009-8-iscsi devstack@n-api.service[120740]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 13 18:07:56.979572 dv-cinder-852009-8-iscsi devstack@n-api.service[120740]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 13 18:07:56.979572 dv-cinder-852009-8-iscsi devstack@n-api.service[120740]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 13 18:07:56.979572 dv-cinder-852009-8-iscsi devstack@n-api.service[120740]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 13 18:07:56.979572 dv-cinder-852009-8-iscsi devstack@n-api.service[120740]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance d0983ec1-bb82-4a7d-9dba-ace1e3eb383a could not be found. Sep 13 18:07:56.979572 dv-cinder-852009-8-iscsi devstack@n-api.service[120740]: ERROR nova.api.openstack.wsgi Sep 13 18:07:56.980733 dv-cinder-852009-8-iscsi devstack@n-api.service[120740]: DEBUG nova.api.openstack.wsgi [None req-0aab4136-1cdc-4e48-81ae-f84386453f90 tempest-AttachVolumeTestJSON-555093534 tempest-AttachVolumeTestJSON-555093534-project] Returning 404 to user: Instance d0983ec1-bb82-4a7d-9dba-ace1e3eb383a could not be found. {{(pid=120740) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 13 18:07:56.980733 dv-cinder-852009-8-iscsi devstack@n-api.service[120740]: INFO nova.api.openstack.requestlog [None req-0aab4136-1cdc-4e48-81ae-f84386453f90 tempest-AttachVolumeTestJSON-555093534 tempest-AttachVolumeTestJSON-555093534-project] 10.222.0.43 "GET /compute/v2.1/servers/d0983ec1-bb82-4a7d-9dba-ace1e3eb383a" status: 404 len: 111 microversion: 2.1 time: 0.035820 Sep 13 18:07:56.980733 dv-cinder-852009-8-iscsi devstack@n-api.service[120740]: [pid: 120740|app: 0|req: 355/701] 10.222.0.43 () {58 vars in 1236 bytes} [Tue Sep 13 18:07:56 2022] GET /compute/v2.1/servers/d0983ec1-bb82-4a7d-9dba-ace1e3eb383a => generated 111 bytes in 37 msecs (HTTP/1.1 404) 9 headers in 379 bytes (2 switches on core 0) Sep 13 18:07:58.142553 dv-cinder-852009-8-iscsi devstack@n-api.service[120741]: DEBUG nova.api.openstack.wsgi [None req-00085da5-f786-4f3c-8e80-590117640eca tempest-AttachVolumeTestJSON-555093534 tempest-AttachVolumeTestJSON-555093534-project] Calling method '>' {{(pid=120741) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 18:07:58.143050 dv-cinder-852009-8-iscsi devstack@n-api.service[120741]: DEBUG nova.compute.api [None req-00085da5-f786-4f3c-8e80-590117640eca tempest-AttachVolumeTestJSON-555093534 tempest-AttachVolumeTestJSON-555093534-project] [instance: b958d409-df20-44c6-aa0e-58cb0a482edf] Fetching instance by UUID {{(pid=120741) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 18:07:58.149608 dv-cinder-852009-8-iscsi devstack@n-api.service[120741]: DEBUG oslo_concurrency.lockutils [None req-00085da5-f786-4f3c-8e80-590117640eca tempest-AttachVolumeTestJSON-555093534 tempest-AttachVolumeTestJSON-555093534-project] Acquiring lock "1daf4f4c-0e4a-4779-b53a-78c48397ea2f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120741) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 18:07:58.150135 dv-cinder-852009-8-iscsi devstack@n-api.service[120741]: DEBUG oslo_concurrency.lockutils [None req-00085da5-f786-4f3c-8e80-590117640eca tempest-AttachVolumeTestJSON-555093534 tempest-AttachVolumeTestJSON-555093534-project] Lock "1daf4f4c-0e4a-4779-b53a-78c48397ea2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120741) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 18:07:58.150615 dv-cinder-852009-8-iscsi devstack@n-api.service[120741]: DEBUG oslo_concurrency.lockutils [None req-00085da5-f786-4f3c-8e80-590117640eca tempest-AttachVolumeTestJSON-555093534 tempest-AttachVolumeTestJSON-555093534-project] Lock "1daf4f4c-0e4a-4779-b53a-78c48397ea2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120741) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 18:07:58.151264 dv-cinder-852009-8-iscsi devstack@n-api.service[120741]: DEBUG oslo_concurrency.lockutils [None req-00085da5-f786-4f3c-8e80-590117640eca tempest-AttachVolumeTestJSON-555093534 tempest-AttachVolumeTestJSON-555093534-project] Acquiring lock "1daf4f4c-0e4a-4779-b53a-78c48397ea2f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120741) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 18:07:58.151844 dv-cinder-852009-8-iscsi devstack@n-api.service[120741]: DEBUG oslo_concurrency.lockutils [None req-00085da5-f786-4f3c-8e80-590117640eca tempest-AttachVolumeTestJSON-555093534 tempest-AttachVolumeTestJSON-555093534-project] Lock "1daf4f4c-0e4a-4779-b53a-78c48397ea2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120741) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 18:07:58.152457 dv-cinder-852009-8-iscsi devstack@n-api.service[120741]: DEBUG oslo_concurrency.lockutils [None req-00085da5-f786-4f3c-8e80-590117640eca tempest-AttachVolumeTestJSON-555093534 tempest-AttachVolumeTestJSON-555093534-project] Lock "1daf4f4c-0e4a-4779-b53a-78c48397ea2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120741) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 18:07:58.167896 dv-cinder-852009-8-iscsi devstack@n-api.service[120741]: INFO nova.api.openstack.wsgi [None req-00085da5-f786-4f3c-8e80-590117640eca tempest-AttachVolumeTestJSON-555093534 tempest-AttachVolumeTestJSON-555093534-project] HTTP exception thrown: Instance b958d409-df20-44c6-aa0e-58cb0a482edf could not be found. Sep 13 18:07:58.169631 dv-cinder-852009-8-iscsi devstack@n-api.service[120741]: DEBUG nova.api.openstack.wsgi [None req-00085da5-f786-4f3c-8e80-590117640eca tempest-AttachVolumeTestJSON-555093534 tempest-AttachVolumeTestJSON-555093534-project] Request method failure captured: Sep 13 18:07:58.169631 dv-cinder-852009-8-iscsi devstack@n-api.service[120741]: request: DELETE /compute/v2.1/servers/b958d409-df20-44c6-aa0e-58cb0a482edf HTTP/1.1 Sep 13 18:07:58.169631 dv-cinder-852009-8-iscsi devstack@n-api.service[120741]: Accept: application/json Sep 13 18:07:58.169631 dv-cinder-852009-8-iscsi devstack@n-api.service[120741]: Accept-Encoding: identity Sep 13 18:07:58.169631 dv-cinder-852009-8-iscsi devstack@n-api.service[120741]: Connection: close Sep 13 18:07:58.169631 dv-cinder-852009-8-iscsi devstack@n-api.service[120741]: Content-Length: 0 Sep 13 18:07:58.169631 dv-cinder-852009-8-iscsi devstack@n-api.service[120741]: Content-Type: application/json Sep 13 18:07:58.169631 dv-cinder-852009-8-iscsi devstack@n-api.service[120741]: Host: 10.222.0.43 Sep 13 18:07:58.169631 dv-cinder-852009-8-iscsi devstack@n-api.service[120741]: Openstack-System-Scope: None Sep 13 18:07:58.169631 dv-cinder-852009-8-iscsi devstack@n-api.service[120741]: User-Agent: python-urllib3/1.26.12 Sep 13 18:07:58.169631 dv-cinder-852009-8-iscsi devstack@n-api.service[120741]: X-Auth-Token: gAAAAABjIMWRpvfFxseo-bDVg1fnd5kZdHkOwDthdyuSjyLDBDaGBd0tRNAcWyUQSN99QlQGzPKdIVzTAWNjmk4wTGD41N0QFzkZdw8xrHL4a_XEHs7QZTJgaqv9b_MZ7RjwVfYtFh2UsHqvKyEbteoXm1QxW-OO9FPnECIQbldvbAikLpdkEmw Sep 13 18:07:58.169631 dv-cinder-852009-8-iscsi devstack@n-api.service[120741]: X-Domain-Id: None Sep 13 18:07:58.169631 dv-cinder-852009-8-iscsi devstack@n-api.service[120741]: X-Domain-Name: None Sep 13 18:07:58.169631 dv-cinder-852009-8-iscsi devstack@n-api.service[120741]: X-Identity-Status: Confirmed Sep 13 18:07:58.169631 dv-cinder-852009-8-iscsi devstack@n-api.service[120741]: X-Is-Admin-Project: True Sep 13 18:07:58.169631 dv-cinder-852009-8-iscsi devstack@n-api.service[120741]: X-Project-Domain-Id: default Sep 13 18:07:58.169631 dv-cinder-852009-8-iscsi devstack@n-api.service[120741]: X-Project-Domain-Name: Default Sep 13 18:07:58.169631 dv-cinder-852009-8-iscsi devstack@n-api.service[120741]: X-Project-Id: a279fcbf274c4704a31a2b95061e1469 Sep 13 18:07:58.169631 dv-cinder-852009-8-iscsi devstack@n-api.service[120741]: X-Project-Name: tempest-AttachVolumeTestJSON-555093534 Sep 13 18:07:58.169631 dv-cinder-852009-8-iscsi devstack@n-api.service[120741]: X-Role: reader,member Sep 13 18:07:58.169631 dv-cinder-852009-8-iscsi devstack@n-api.service[120741]: X-Roles: reader,member Sep 13 18:07:58.171506 dv-cinder-852009-8-iscsi devstack@n-api.service[120741]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/identity"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/compute/v2/a279fcbf274c4704a31a2b95061e1469"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.43:8080", "publicURL": "http://10.222.0.43:8080/v1/AUTH_a279fcbf274c4704a31a2b95061e1469"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43:9696/networking"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/volume/v3/a279fcbf274c4704a31a2b95061e1469"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/compute/v2.1"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/placement"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/volume/v3/a279fcbf274c4704a31a2b95061e1469"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/image"}]}] Sep 13 18:07:58.171506 dv-cinder-852009-8-iscsi devstack@n-api.service[120741]: X-Tenant: tempest-AttachVolumeTestJSON-555093534 Sep 13 18:07:58.171506 dv-cinder-852009-8-iscsi devstack@n-api.service[120741]: X-Tenant-Id: a279fcbf274c4704a31a2b95061e1469 Sep 13 18:07:58.171506 dv-cinder-852009-8-iscsi devstack@n-api.service[120741]: X-Tenant-Name: tempest-AttachVolumeTestJSON-555093534 Sep 13 18:07:58.171506 dv-cinder-852009-8-iscsi devstack@n-api.service[120741]: X-User: tempest-AttachVolumeTestJSON-555093534-project Sep 13 18:07:58.171506 dv-cinder-852009-8-iscsi devstack@n-api.service[120741]: X-User-Domain-Id: default Sep 13 18:07:58.171506 dv-cinder-852009-8-iscsi devstack@n-api.service[120741]: X-User-Domain-Name: Default Sep 13 18:07:58.171506 dv-cinder-852009-8-iscsi devstack@n-api.service[120741]: X-User-Id: 0625b3113ce044bbac4f6142eaade11c Sep 13 18:07:58.171506 dv-cinder-852009-8-iscsi devstack@n-api.service[120741]: X-User-Name: tempest-AttachVolumeTestJSON-555093534-project Sep 13 18:07:58.171506 dv-cinder-852009-8-iscsi devstack@n-api.service[120741]: method: > Sep 13 18:07:58.171506 dv-cinder-852009-8-iscsi devstack@n-api.service[120741]: exception: Instance b958d409-df20-44c6-aa0e-58cb0a482edf could not be found. Sep 13 18:07:58.171506 dv-cinder-852009-8-iscsi devstack@n-api.service[120741]: action_args: {'id': 'b958d409-df20-44c6-aa0e-58cb0a482edf'} Sep 13 18:07:58.175567 dv-cinder-852009-8-iscsi devstack@n-api.service[120741]: {{(pid=120741) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 13 18:07:58.175567 dv-cinder-852009-8-iscsi devstack@n-api.service[120741]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 13 18:07:58.175567 dv-cinder-852009-8-iscsi devstack@n-api.service[120741]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Sep 13 18:07:58.175567 dv-cinder-852009-8-iscsi devstack@n-api.service[120741]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Sep 13 18:07:58.175567 dv-cinder-852009-8-iscsi devstack@n-api.service[120741]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Sep 13 18:07:58.175567 dv-cinder-852009-8-iscsi devstack@n-api.service[120741]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Sep 13 18:07:58.175567 dv-cinder-852009-8-iscsi devstack@n-api.service[120741]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Sep 13 18:07:58.175567 dv-cinder-852009-8-iscsi devstack@n-api.service[120741]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Sep 13 18:07:58.175567 dv-cinder-852009-8-iscsi devstack@n-api.service[120741]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Sep 13 18:07:58.175567 dv-cinder-852009-8-iscsi devstack@n-api.service[120741]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Sep 13 18:07:58.175567 dv-cinder-852009-8-iscsi devstack@n-api.service[120741]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance b958d409-df20-44c6-aa0e-58cb0a482edf could not be found. Sep 13 18:07:58.175567 dv-cinder-852009-8-iscsi devstack@n-api.service[120741]: ERROR nova.api.openstack.wsgi Sep 13 18:07:58.175567 dv-cinder-852009-8-iscsi devstack@n-api.service[120741]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 13 18:07:58.175567 dv-cinder-852009-8-iscsi devstack@n-api.service[120741]: ERROR nova.api.openstack.wsgi Sep 13 18:07:58.175567 dv-cinder-852009-8-iscsi devstack@n-api.service[120741]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 13 18:07:58.175567 dv-cinder-852009-8-iscsi devstack@n-api.service[120741]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 13 18:07:58.175567 dv-cinder-852009-8-iscsi devstack@n-api.service[120741]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 13 18:07:58.175567 dv-cinder-852009-8-iscsi devstack@n-api.service[120741]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 13 18:07:58.175567 dv-cinder-852009-8-iscsi devstack@n-api.service[120741]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 13 18:07:58.175567 dv-cinder-852009-8-iscsi devstack@n-api.service[120741]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 13 18:07:58.177312 dv-cinder-852009-8-iscsi devstack@n-api.service[120741]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 13 18:07:58.177312 dv-cinder-852009-8-iscsi devstack@n-api.service[120741]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete Sep 13 18:07:58.177312 dv-cinder-852009-8-iscsi devstack@n-api.service[120741]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) Sep 13 18:07:58.177312 dv-cinder-852009-8-iscsi devstack@n-api.service[120741]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete Sep 13 18:07:58.177312 dv-cinder-852009-8-iscsi devstack@n-api.service[120741]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) Sep 13 18:07:58.177312 dv-cinder-852009-8-iscsi devstack@n-api.service[120741]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Sep 13 18:07:58.177312 dv-cinder-852009-8-iscsi devstack@n-api.service[120741]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Sep 13 18:07:58.177312 dv-cinder-852009-8-iscsi devstack@n-api.service[120741]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Sep 13 18:07:58.177312 dv-cinder-852009-8-iscsi devstack@n-api.service[120741]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Sep 13 18:07:58.177312 dv-cinder-852009-8-iscsi devstack@n-api.service[120741]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance b958d409-df20-44c6-aa0e-58cb0a482edf could not be found. Sep 13 18:07:58.177312 dv-cinder-852009-8-iscsi devstack@n-api.service[120741]: ERROR nova.api.openstack.wsgi Sep 13 18:07:58.177312 dv-cinder-852009-8-iscsi devstack@n-api.service[120741]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 13 18:07:58.177312 dv-cinder-852009-8-iscsi devstack@n-api.service[120741]: ERROR nova.api.openstack.wsgi Sep 13 18:07:58.177312 dv-cinder-852009-8-iscsi devstack@n-api.service[120741]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 13 18:07:58.177312 dv-cinder-852009-8-iscsi devstack@n-api.service[120741]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 13 18:07:58.177312 dv-cinder-852009-8-iscsi devstack@n-api.service[120741]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 13 18:07:58.177312 dv-cinder-852009-8-iscsi devstack@n-api.service[120741]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 13 18:07:58.177312 dv-cinder-852009-8-iscsi devstack@n-api.service[120741]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 13 18:07:58.177312 dv-cinder-852009-8-iscsi devstack@n-api.service[120741]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance b958d409-df20-44c6-aa0e-58cb0a482edf could not be found. Sep 13 18:07:58.177312 dv-cinder-852009-8-iscsi devstack@n-api.service[120741]: ERROR nova.api.openstack.wsgi Sep 13 18:07:58.178994 dv-cinder-852009-8-iscsi devstack@n-api.service[120741]: DEBUG nova.api.openstack.wsgi [None req-00085da5-f786-4f3c-8e80-590117640eca tempest-AttachVolumeTestJSON-555093534 tempest-AttachVolumeTestJSON-555093534-project] Returning 404 to user: Instance b958d409-df20-44c6-aa0e-58cb0a482edf could not be found. {{(pid=120741) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 13 18:07:58.178994 dv-cinder-852009-8-iscsi devstack@n-api.service[120741]: INFO nova.api.openstack.requestlog [None req-00085da5-f786-4f3c-8e80-590117640eca tempest-AttachVolumeTestJSON-555093534 tempest-AttachVolumeTestJSON-555093534-project] 10.222.0.43 "DELETE /compute/v2.1/servers/b958d409-df20-44c6-aa0e-58cb0a482edf" status: 404 len: 111 microversion: 2.1 time: 0.033581 Sep 13 18:07:58.178994 dv-cinder-852009-8-iscsi devstack@n-api.service[120741]: [pid: 120741|app: 0|req: 347/702] 10.222.0.43 () {58 vars in 1239 bytes} [Tue Sep 13 18:07:58 2022] DELETE /compute/v2.1/servers/b958d409-df20-44c6-aa0e-58cb0a482edf => generated 111 bytes in 35 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Sep 13 18:07:58.181733 dv-cinder-852009-8-iscsi devstack@n-api.service[120740]: DEBUG nova.api.openstack.wsgi [None req-66d86dfb-ef72-4f07-b9ab-c2eca1463a58 tempest-AttachVolumeTestJSON-555093534 tempest-AttachVolumeTestJSON-555093534-project] Calling method '>' {{(pid=120740) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 18:07:58.182286 dv-cinder-852009-8-iscsi devstack@n-api.service[120740]: DEBUG nova.compute.api [None req-66d86dfb-ef72-4f07-b9ab-c2eca1463a58 tempest-AttachVolumeTestJSON-555093534 tempest-AttachVolumeTestJSON-555093534-project] [instance: b958d409-df20-44c6-aa0e-58cb0a482edf] Fetching instance by UUID {{(pid=120740) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 18:07:58.189200 dv-cinder-852009-8-iscsi devstack@n-api.service[120740]: DEBUG oslo_concurrency.lockutils [None req-66d86dfb-ef72-4f07-b9ab-c2eca1463a58 tempest-AttachVolumeTestJSON-555093534 tempest-AttachVolumeTestJSON-555093534-project] Acquiring lock "1daf4f4c-0e4a-4779-b53a-78c48397ea2f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120740) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 18:07:58.189692 dv-cinder-852009-8-iscsi devstack@n-api.service[120740]: DEBUG oslo_concurrency.lockutils [None req-66d86dfb-ef72-4f07-b9ab-c2eca1463a58 tempest-AttachVolumeTestJSON-555093534 tempest-AttachVolumeTestJSON-555093534-project] Lock "1daf4f4c-0e4a-4779-b53a-78c48397ea2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120740) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 18:07:58.190111 dv-cinder-852009-8-iscsi devstack@n-api.service[120740]: DEBUG oslo_concurrency.lockutils [None req-66d86dfb-ef72-4f07-b9ab-c2eca1463a58 tempest-AttachVolumeTestJSON-555093534 tempest-AttachVolumeTestJSON-555093534-project] Lock "1daf4f4c-0e4a-4779-b53a-78c48397ea2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120740) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 18:07:58.190800 dv-cinder-852009-8-iscsi devstack@n-api.service[120740]: DEBUG oslo_concurrency.lockutils [None req-66d86dfb-ef72-4f07-b9ab-c2eca1463a58 tempest-AttachVolumeTestJSON-555093534 tempest-AttachVolumeTestJSON-555093534-project] Acquiring lock "1daf4f4c-0e4a-4779-b53a-78c48397ea2f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120740) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 18:07:58.191243 dv-cinder-852009-8-iscsi devstack@n-api.service[120740]: DEBUG oslo_concurrency.lockutils [None req-66d86dfb-ef72-4f07-b9ab-c2eca1463a58 tempest-AttachVolumeTestJSON-555093534 tempest-AttachVolumeTestJSON-555093534-project] Lock "1daf4f4c-0e4a-4779-b53a-78c48397ea2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120740) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 18:07:58.191655 dv-cinder-852009-8-iscsi devstack@n-api.service[120740]: DEBUG oslo_concurrency.lockutils [None req-66d86dfb-ef72-4f07-b9ab-c2eca1463a58 tempest-AttachVolumeTestJSON-555093534 tempest-AttachVolumeTestJSON-555093534-project] Lock "1daf4f4c-0e4a-4779-b53a-78c48397ea2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120740) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 18:07:58.205765 dv-cinder-852009-8-iscsi devstack@n-api.service[120740]: INFO nova.api.openstack.wsgi [None req-66d86dfb-ef72-4f07-b9ab-c2eca1463a58 tempest-AttachVolumeTestJSON-555093534 tempest-AttachVolumeTestJSON-555093534-project] HTTP exception thrown: Instance b958d409-df20-44c6-aa0e-58cb0a482edf could not be found. Sep 13 18:07:58.207334 dv-cinder-852009-8-iscsi devstack@n-api.service[120740]: DEBUG nova.api.openstack.wsgi [None req-66d86dfb-ef72-4f07-b9ab-c2eca1463a58 tempest-AttachVolumeTestJSON-555093534 tempest-AttachVolumeTestJSON-555093534-project] Request method failure captured: Sep 13 18:07:58.207334 dv-cinder-852009-8-iscsi devstack@n-api.service[120740]: request: GET /compute/v2.1/servers/b958d409-df20-44c6-aa0e-58cb0a482edf HTTP/1.1 Sep 13 18:07:58.207334 dv-cinder-852009-8-iscsi devstack@n-api.service[120740]: Accept: application/json Sep 13 18:07:58.207334 dv-cinder-852009-8-iscsi devstack@n-api.service[120740]: Accept-Encoding: identity Sep 13 18:07:58.207334 dv-cinder-852009-8-iscsi devstack@n-api.service[120740]: Connection: close Sep 13 18:07:58.207334 dv-cinder-852009-8-iscsi devstack@n-api.service[120740]: Content-Length: 0 Sep 13 18:07:58.207334 dv-cinder-852009-8-iscsi devstack@n-api.service[120740]: Content-Type: application/json Sep 13 18:07:58.207334 dv-cinder-852009-8-iscsi devstack@n-api.service[120740]: Host: 10.222.0.43 Sep 13 18:07:58.207334 dv-cinder-852009-8-iscsi devstack@n-api.service[120740]: Openstack-System-Scope: None Sep 13 18:07:58.207334 dv-cinder-852009-8-iscsi devstack@n-api.service[120740]: User-Agent: python-urllib3/1.26.12 Sep 13 18:07:58.207334 dv-cinder-852009-8-iscsi devstack@n-api.service[120740]: X-Auth-Token: gAAAAABjIMWRpvfFxseo-bDVg1fnd5kZdHkOwDthdyuSjyLDBDaGBd0tRNAcWyUQSN99QlQGzPKdIVzTAWNjmk4wTGD41N0QFzkZdw8xrHL4a_XEHs7QZTJgaqv9b_MZ7RjwVfYtFh2UsHqvKyEbteoXm1QxW-OO9FPnECIQbldvbAikLpdkEmw Sep 13 18:07:58.207334 dv-cinder-852009-8-iscsi devstack@n-api.service[120740]: X-Domain-Id: None Sep 13 18:07:58.207334 dv-cinder-852009-8-iscsi devstack@n-api.service[120740]: X-Domain-Name: None Sep 13 18:07:58.207334 dv-cinder-852009-8-iscsi devstack@n-api.service[120740]: X-Identity-Status: Confirmed Sep 13 18:07:58.207334 dv-cinder-852009-8-iscsi devstack@n-api.service[120740]: X-Is-Admin-Project: True Sep 13 18:07:58.207334 dv-cinder-852009-8-iscsi devstack@n-api.service[120740]: X-Project-Domain-Id: default Sep 13 18:07:58.207334 dv-cinder-852009-8-iscsi devstack@n-api.service[120740]: X-Project-Domain-Name: Default Sep 13 18:07:58.207334 dv-cinder-852009-8-iscsi devstack@n-api.service[120740]: X-Project-Id: a279fcbf274c4704a31a2b95061e1469 Sep 13 18:07:58.207334 dv-cinder-852009-8-iscsi devstack@n-api.service[120740]: X-Project-Name: tempest-AttachVolumeTestJSON-555093534 Sep 13 18:07:58.207334 dv-cinder-852009-8-iscsi devstack@n-api.service[120740]: X-Role: reader,member Sep 13 18:07:58.207334 dv-cinder-852009-8-iscsi devstack@n-api.service[120740]: X-Roles: reader,member Sep 13 18:07:58.208852 dv-cinder-852009-8-iscsi devstack@n-api.service[120740]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/identity"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/compute/v2/a279fcbf274c4704a31a2b95061e1469"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.43:8080", "publicURL": "http://10.222.0.43:8080/v1/AUTH_a279fcbf274c4704a31a2b95061e1469"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43:9696/networking"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/volume/v3/a279fcbf274c4704a31a2b95061e1469"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/compute/v2.1"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/placement"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/volume/v3/a279fcbf274c4704a31a2b95061e1469"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/image"}]}] Sep 13 18:07:58.208852 dv-cinder-852009-8-iscsi devstack@n-api.service[120740]: X-Tenant: tempest-AttachVolumeTestJSON-555093534 Sep 13 18:07:58.208852 dv-cinder-852009-8-iscsi devstack@n-api.service[120740]: X-Tenant-Id: a279fcbf274c4704a31a2b95061e1469 Sep 13 18:07:58.208852 dv-cinder-852009-8-iscsi devstack@n-api.service[120740]: X-Tenant-Name: tempest-AttachVolumeTestJSON-555093534 Sep 13 18:07:58.208852 dv-cinder-852009-8-iscsi devstack@n-api.service[120740]: X-User: tempest-AttachVolumeTestJSON-555093534-project Sep 13 18:07:58.208852 dv-cinder-852009-8-iscsi devstack@n-api.service[120740]: X-User-Domain-Id: default Sep 13 18:07:58.208852 dv-cinder-852009-8-iscsi devstack@n-api.service[120740]: X-User-Domain-Name: Default Sep 13 18:07:58.208852 dv-cinder-852009-8-iscsi devstack@n-api.service[120740]: X-User-Id: 0625b3113ce044bbac4f6142eaade11c Sep 13 18:07:58.208852 dv-cinder-852009-8-iscsi devstack@n-api.service[120740]: X-User-Name: tempest-AttachVolumeTestJSON-555093534-project Sep 13 18:07:58.208852 dv-cinder-852009-8-iscsi devstack@n-api.service[120740]: method: > Sep 13 18:07:58.208852 dv-cinder-852009-8-iscsi devstack@n-api.service[120740]: exception: Instance b958d409-df20-44c6-aa0e-58cb0a482edf could not be found. Sep 13 18:07:58.208852 dv-cinder-852009-8-iscsi devstack@n-api.service[120740]: action_args: {'id': 'b958d409-df20-44c6-aa0e-58cb0a482edf'} Sep 13 18:07:58.209770 dv-cinder-852009-8-iscsi devstack@n-api.service[120740]: {{(pid=120740) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 13 18:07:58.209770 dv-cinder-852009-8-iscsi devstack@n-api.service[120740]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 13 18:07:58.209770 dv-cinder-852009-8-iscsi devstack@n-api.service[120740]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Sep 13 18:07:58.209770 dv-cinder-852009-8-iscsi devstack@n-api.service[120740]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Sep 13 18:07:58.209770 dv-cinder-852009-8-iscsi devstack@n-api.service[120740]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Sep 13 18:07:58.209770 dv-cinder-852009-8-iscsi devstack@n-api.service[120740]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Sep 13 18:07:58.209770 dv-cinder-852009-8-iscsi devstack@n-api.service[120740]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Sep 13 18:07:58.209770 dv-cinder-852009-8-iscsi devstack@n-api.service[120740]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Sep 13 18:07:58.209770 dv-cinder-852009-8-iscsi devstack@n-api.service[120740]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Sep 13 18:07:58.209770 dv-cinder-852009-8-iscsi devstack@n-api.service[120740]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Sep 13 18:07:58.209770 dv-cinder-852009-8-iscsi devstack@n-api.service[120740]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance b958d409-df20-44c6-aa0e-58cb0a482edf could not be found. Sep 13 18:07:58.209770 dv-cinder-852009-8-iscsi devstack@n-api.service[120740]: ERROR nova.api.openstack.wsgi Sep 13 18:07:58.209770 dv-cinder-852009-8-iscsi devstack@n-api.service[120740]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 13 18:07:58.209770 dv-cinder-852009-8-iscsi devstack@n-api.service[120740]: ERROR nova.api.openstack.wsgi Sep 13 18:07:58.209770 dv-cinder-852009-8-iscsi devstack@n-api.service[120740]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 13 18:07:58.209770 dv-cinder-852009-8-iscsi devstack@n-api.service[120740]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 13 18:07:58.209770 dv-cinder-852009-8-iscsi devstack@n-api.service[120740]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 13 18:07:58.209770 dv-cinder-852009-8-iscsi devstack@n-api.service[120740]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 13 18:07:58.209770 dv-cinder-852009-8-iscsi devstack@n-api.service[120740]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 13 18:07:58.209770 dv-cinder-852009-8-iscsi devstack@n-api.service[120740]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 13 18:07:58.211136 dv-cinder-852009-8-iscsi devstack@n-api.service[120740]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 13 18:07:58.211136 dv-cinder-852009-8-iscsi devstack@n-api.service[120740]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Sep 13 18:07:58.211136 dv-cinder-852009-8-iscsi devstack@n-api.service[120740]: ERROR nova.api.openstack.wsgi instance = self._get_server( Sep 13 18:07:58.211136 dv-cinder-852009-8-iscsi devstack@n-api.service[120740]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Sep 13 18:07:58.211136 dv-cinder-852009-8-iscsi devstack@n-api.service[120740]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Sep 13 18:07:58.211136 dv-cinder-852009-8-iscsi devstack@n-api.service[120740]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Sep 13 18:07:58.211136 dv-cinder-852009-8-iscsi devstack@n-api.service[120740]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Sep 13 18:07:58.211136 dv-cinder-852009-8-iscsi devstack@n-api.service[120740]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance b958d409-df20-44c6-aa0e-58cb0a482edf could not be found. Sep 13 18:07:58.211136 dv-cinder-852009-8-iscsi devstack@n-api.service[120740]: ERROR nova.api.openstack.wsgi Sep 13 18:07:58.211136 dv-cinder-852009-8-iscsi devstack@n-api.service[120740]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 13 18:07:58.211136 dv-cinder-852009-8-iscsi devstack@n-api.service[120740]: ERROR nova.api.openstack.wsgi Sep 13 18:07:58.211136 dv-cinder-852009-8-iscsi devstack@n-api.service[120740]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 13 18:07:58.211136 dv-cinder-852009-8-iscsi devstack@n-api.service[120740]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 13 18:07:58.211136 dv-cinder-852009-8-iscsi devstack@n-api.service[120740]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 13 18:07:58.211136 dv-cinder-852009-8-iscsi devstack@n-api.service[120740]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 13 18:07:58.211136 dv-cinder-852009-8-iscsi devstack@n-api.service[120740]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 13 18:07:58.211136 dv-cinder-852009-8-iscsi devstack@n-api.service[120740]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance b958d409-df20-44c6-aa0e-58cb0a482edf could not be found. Sep 13 18:07:58.211136 dv-cinder-852009-8-iscsi devstack@n-api.service[120740]: ERROR nova.api.openstack.wsgi Sep 13 18:07:58.212314 dv-cinder-852009-8-iscsi devstack@n-api.service[120740]: DEBUG nova.api.openstack.wsgi [None req-66d86dfb-ef72-4f07-b9ab-c2eca1463a58 tempest-AttachVolumeTestJSON-555093534 tempest-AttachVolumeTestJSON-555093534-project] Returning 404 to user: Instance b958d409-df20-44c6-aa0e-58cb0a482edf could not be found. {{(pid=120740) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 13 18:07:58.212314 dv-cinder-852009-8-iscsi devstack@n-api.service[120740]: INFO nova.api.openstack.requestlog [None req-66d86dfb-ef72-4f07-b9ab-c2eca1463a58 tempest-AttachVolumeTestJSON-555093534 tempest-AttachVolumeTestJSON-555093534-project] 10.222.0.43 "GET /compute/v2.1/servers/b958d409-df20-44c6-aa0e-58cb0a482edf" status: 404 len: 111 microversion: 2.1 time: 0.031048 Sep 13 18:07:58.212908 dv-cinder-852009-8-iscsi devstack@n-api.service[120740]: [pid: 120740|app: 0|req: 356/703] 10.222.0.43 () {58 vars in 1236 bytes} [Tue Sep 13 18:07:58 2022] GET /compute/v2.1/servers/b958d409-df20-44c6-aa0e-58cb0a482edf => generated 111 bytes in 36 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Sep 13 18:08:19.085464 dv-cinder-852009-8-iscsi devstack@n-api.service[120741]: DEBUG nova.api.openstack.wsgi [None req-305e5827-062d-4c77-a75b-0caa5d9a17c6 tempest-AttachVolumeShelveTestJSON-385853788 tempest-AttachVolumeShelveTestJSON-385853788-project] Calling method '>' {{(pid=120741) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 18:08:19.087809 dv-cinder-852009-8-iscsi devstack@n-api.service[120741]: DEBUG nova.compute.api [None req-305e5827-062d-4c77-a75b-0caa5d9a17c6 tempest-AttachVolumeShelveTestJSON-385853788 tempest-AttachVolumeShelveTestJSON-385853788-project] [instance: 8cecf08e-bea8-4cef-9439-0eaa242bfed1] Fetching instance by UUID {{(pid=120741) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 18:08:19.090629 dv-cinder-852009-8-iscsi devstack@n-api.service[120741]: DEBUG dbcounter [-] [120741] Writing DB stats nova_api:SELECT=40,nova_api:DELETE=1 {{(pid=120741) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 18:08:19.091425 dv-cinder-852009-8-iscsi devstack@n-api.service[120741]: DEBUG dbcounter [-] [120741] Writing DB stats nova_cell1:SELECT=7 {{(pid=120741) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 18:08:19.097086 dv-cinder-852009-8-iscsi devstack@n-api.service[120741]: DEBUG oslo_concurrency.lockutils [None req-305e5827-062d-4c77-a75b-0caa5d9a17c6 tempest-AttachVolumeShelveTestJSON-385853788 tempest-AttachVolumeShelveTestJSON-385853788-project] Acquiring lock "1daf4f4c-0e4a-4779-b53a-78c48397ea2f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120741) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 18:08:19.097679 dv-cinder-852009-8-iscsi devstack@n-api.service[120741]: DEBUG oslo_concurrency.lockutils [None req-305e5827-062d-4c77-a75b-0caa5d9a17c6 tempest-AttachVolumeShelveTestJSON-385853788 tempest-AttachVolumeShelveTestJSON-385853788-project] Lock "1daf4f4c-0e4a-4779-b53a-78c48397ea2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120741) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 18:08:19.098111 dv-cinder-852009-8-iscsi devstack@n-api.service[120741]: DEBUG oslo_concurrency.lockutils [None req-305e5827-062d-4c77-a75b-0caa5d9a17c6 tempest-AttachVolumeShelveTestJSON-385853788 tempest-AttachVolumeShelveTestJSON-385853788-project] Lock "1daf4f4c-0e4a-4779-b53a-78c48397ea2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120741) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 18:08:19.098802 dv-cinder-852009-8-iscsi devstack@n-api.service[120741]: DEBUG oslo_concurrency.lockutils [None req-305e5827-062d-4c77-a75b-0caa5d9a17c6 tempest-AttachVolumeShelveTestJSON-385853788 tempest-AttachVolumeShelveTestJSON-385853788-project] Acquiring lock "1daf4f4c-0e4a-4779-b53a-78c48397ea2f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120741) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 18:08:19.099250 dv-cinder-852009-8-iscsi devstack@n-api.service[120741]: DEBUG oslo_concurrency.lockutils [None req-305e5827-062d-4c77-a75b-0caa5d9a17c6 tempest-AttachVolumeShelveTestJSON-385853788 tempest-AttachVolumeShelveTestJSON-385853788-project] Lock "1daf4f4c-0e4a-4779-b53a-78c48397ea2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120741) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 18:08:19.099685 dv-cinder-852009-8-iscsi devstack@n-api.service[120741]: DEBUG oslo_concurrency.lockutils [None req-305e5827-062d-4c77-a75b-0caa5d9a17c6 tempest-AttachVolumeShelveTestJSON-385853788 tempest-AttachVolumeShelveTestJSON-385853788-project] Lock "1daf4f4c-0e4a-4779-b53a-78c48397ea2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120741) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 18:08:19.131661 dv-cinder-852009-8-iscsi devstack@n-api.service[120741]: INFO nova.api.openstack.requestlog [None req-305e5827-062d-4c77-a75b-0caa5d9a17c6 tempest-AttachVolumeShelveTestJSON-385853788 tempest-AttachVolumeShelveTestJSON-385853788-project] 10.222.0.43 "GET /compute/v2.1/servers/8cecf08e-bea8-4cef-9439-0eaa242bfed1/os-volume_attachments" status: 200 len: 25 microversion: 2.20 time: 0.051084 Sep 13 18:08:19.132246 dv-cinder-852009-8-iscsi devstack@n-api.service[120741]: [pid: 120741|app: 0|req: 348/704] 10.222.0.43 () {60 vars in 1343 bytes} [Tue Sep 13 18:08:19 2022] GET /compute/v2.1/servers/8cecf08e-bea8-4cef-9439-0eaa242bfed1/os-volume_attachments => generated 25 bytes in 52 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 13 18:08:19.200272 dv-cinder-852009-8-iscsi devstack@n-api.service[120740]: DEBUG nova.api.openstack.wsgi [None req-60b1edde-4830-4e4d-b784-3156373245be tempest-AttachVolumeShelveTestJSON-385853788 tempest-AttachVolumeShelveTestJSON-385853788-project] Calling method '>' {{(pid=120740) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 18:08:19.200841 dv-cinder-852009-8-iscsi devstack@n-api.service[120740]: DEBUG nova.compute.api [None req-60b1edde-4830-4e4d-b784-3156373245be tempest-AttachVolumeShelveTestJSON-385853788 tempest-AttachVolumeShelveTestJSON-385853788-project] [instance: 8cecf08e-bea8-4cef-9439-0eaa242bfed1] Fetching instance by UUID {{(pid=120740) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 18:08:19.204280 dv-cinder-852009-8-iscsi devstack@n-api.service[120740]: DEBUG dbcounter [-] [120740] Writing DB stats nova_api:SELECT=20,nova_api:DELETE=1 {{(pid=120740) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 18:08:19.204946 dv-cinder-852009-8-iscsi devstack@n-api.service[120740]: DEBUG dbcounter [-] [120740] Writing DB stats nova_cell1:SELECT=35 {{(pid=120740) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 18:08:19.211080 dv-cinder-852009-8-iscsi devstack@n-api.service[120740]: DEBUG oslo_concurrency.lockutils [None req-60b1edde-4830-4e4d-b784-3156373245be tempest-AttachVolumeShelveTestJSON-385853788 tempest-AttachVolumeShelveTestJSON-385853788-project] Acquiring lock "1daf4f4c-0e4a-4779-b53a-78c48397ea2f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120740) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 18:08:19.211555 dv-cinder-852009-8-iscsi devstack@n-api.service[120740]: DEBUG oslo_concurrency.lockutils [None req-60b1edde-4830-4e4d-b784-3156373245be tempest-AttachVolumeShelveTestJSON-385853788 tempest-AttachVolumeShelveTestJSON-385853788-project] Lock "1daf4f4c-0e4a-4779-b53a-78c48397ea2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120740) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 18:08:19.211977 dv-cinder-852009-8-iscsi devstack@n-api.service[120740]: DEBUG oslo_concurrency.lockutils [None req-60b1edde-4830-4e4d-b784-3156373245be tempest-AttachVolumeShelveTestJSON-385853788 tempest-AttachVolumeShelveTestJSON-385853788-project] Lock "1daf4f4c-0e4a-4779-b53a-78c48397ea2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120740) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 18:08:19.212695 dv-cinder-852009-8-iscsi devstack@n-api.service[120740]: DEBUG oslo_concurrency.lockutils [None req-60b1edde-4830-4e4d-b784-3156373245be tempest-AttachVolumeShelveTestJSON-385853788 tempest-AttachVolumeShelveTestJSON-385853788-project] Acquiring lock "1daf4f4c-0e4a-4779-b53a-78c48397ea2f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120740) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 18:08:19.213134 dv-cinder-852009-8-iscsi devstack@n-api.service[120740]: DEBUG oslo_concurrency.lockutils [None req-60b1edde-4830-4e4d-b784-3156373245be tempest-AttachVolumeShelveTestJSON-385853788 tempest-AttachVolumeShelveTestJSON-385853788-project] Lock "1daf4f4c-0e4a-4779-b53a-78c48397ea2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120740) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 18:08:19.213540 dv-cinder-852009-8-iscsi devstack@n-api.service[120740]: DEBUG oslo_concurrency.lockutils [None req-60b1edde-4830-4e4d-b784-3156373245be tempest-AttachVolumeShelveTestJSON-385853788 tempest-AttachVolumeShelveTestJSON-385853788-project] Lock "1daf4f4c-0e4a-4779-b53a-78c48397ea2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120740) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 18:08:19.241309 dv-cinder-852009-8-iscsi devstack@n-api.service[120740]: DEBUG nova.compute.api [None req-60b1edde-4830-4e4d-b784-3156373245be tempest-AttachVolumeShelveTestJSON-385853788 tempest-AttachVolumeShelveTestJSON-385853788-project] [instance: 8cecf08e-bea8-4cef-9439-0eaa242bfed1] Going to try to terminate instance {{(pid=120740) delete /opt/stack/nova/nova/compute/api.py:2719}} Sep 13 18:08:19.323818 dv-cinder-852009-8-iscsi devstack@n-api.service[120740]: INFO nova.api.openstack.requestlog [None req-60b1edde-4830-4e4d-b784-3156373245be tempest-AttachVolumeShelveTestJSON-385853788 tempest-AttachVolumeShelveTestJSON-385853788-project] 10.222.0.43 "DELETE /compute/v2.1/servers/8cecf08e-bea8-4cef-9439-0eaa242bfed1" status: 204 len: 0 microversion: 2.20 time: 0.129551 Sep 13 18:08:19.324410 dv-cinder-852009-8-iscsi devstack@n-api.service[120740]: [pid: 120740|app: 0|req: 357/705] 10.222.0.43 () {60 vars in 1280 bytes} [Tue Sep 13 18:08:19 2022] DELETE /compute/v2.1/servers/8cecf08e-bea8-4cef-9439-0eaa242bfed1 => generated 0 bytes in 131 msecs (HTTP/1.1 204) 9 headers in 365 bytes (1 switches on core 0) Sep 13 18:08:19.333700 dv-cinder-852009-8-iscsi devstack@n-api.service[120741]: DEBUG nova.api.openstack.wsgi [None req-a7b0fbf4-9906-47aa-bceb-4cb08f2ce663 tempest-AttachVolumeShelveTestJSON-385853788 tempest-AttachVolumeShelveTestJSON-385853788-project] Calling method '>' {{(pid=120741) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 18:08:19.334424 dv-cinder-852009-8-iscsi devstack@n-api.service[120741]: DEBUG nova.compute.api [None req-a7b0fbf4-9906-47aa-bceb-4cb08f2ce663 tempest-AttachVolumeShelveTestJSON-385853788 tempest-AttachVolumeShelveTestJSON-385853788-project] [instance: 8cecf08e-bea8-4cef-9439-0eaa242bfed1] Fetching instance by UUID {{(pid=120741) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 18:08:19.340626 dv-cinder-852009-8-iscsi devstack@n-api.service[120741]: DEBUG oslo_concurrency.lockutils [None req-a7b0fbf4-9906-47aa-bceb-4cb08f2ce663 tempest-AttachVolumeShelveTestJSON-385853788 tempest-AttachVolumeShelveTestJSON-385853788-project] Acquiring lock "1daf4f4c-0e4a-4779-b53a-78c48397ea2f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120741) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 18:08:19.341111 dv-cinder-852009-8-iscsi devstack@n-api.service[120741]: DEBUG oslo_concurrency.lockutils [None req-a7b0fbf4-9906-47aa-bceb-4cb08f2ce663 tempest-AttachVolumeShelveTestJSON-385853788 tempest-AttachVolumeShelveTestJSON-385853788-project] Lock "1daf4f4c-0e4a-4779-b53a-78c48397ea2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120741) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 18:08:19.341540 dv-cinder-852009-8-iscsi devstack@n-api.service[120741]: DEBUG oslo_concurrency.lockutils [None req-a7b0fbf4-9906-47aa-bceb-4cb08f2ce663 tempest-AttachVolumeShelveTestJSON-385853788 tempest-AttachVolumeShelveTestJSON-385853788-project] Lock "1daf4f4c-0e4a-4779-b53a-78c48397ea2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120741) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 18:08:19.342228 dv-cinder-852009-8-iscsi devstack@n-api.service[120741]: DEBUG oslo_concurrency.lockutils [None req-a7b0fbf4-9906-47aa-bceb-4cb08f2ce663 tempest-AttachVolumeShelveTestJSON-385853788 tempest-AttachVolumeShelveTestJSON-385853788-project] Acquiring lock "1daf4f4c-0e4a-4779-b53a-78c48397ea2f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120741) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 18:08:19.342684 dv-cinder-852009-8-iscsi devstack@n-api.service[120741]: DEBUG oslo_concurrency.lockutils [None req-a7b0fbf4-9906-47aa-bceb-4cb08f2ce663 tempest-AttachVolumeShelveTestJSON-385853788 tempest-AttachVolumeShelveTestJSON-385853788-project] Lock "1daf4f4c-0e4a-4779-b53a-78c48397ea2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120741) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 18:08:19.343089 dv-cinder-852009-8-iscsi devstack@n-api.service[120741]: DEBUG oslo_concurrency.lockutils [None req-a7b0fbf4-9906-47aa-bceb-4cb08f2ce663 tempest-AttachVolumeShelveTestJSON-385853788 tempest-AttachVolumeShelveTestJSON-385853788-project] Lock "1daf4f4c-0e4a-4779-b53a-78c48397ea2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120741) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 18:08:19.478644 dv-cinder-852009-8-iscsi devstack@n-api.service[120741]: DEBUG nova.policy [None req-a7b0fbf4-9906-47aa-bceb-4cb08f2ce663 tempest-AttachVolumeShelveTestJSON-385853788 tempest-AttachVolumeShelveTestJSON-385853788-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e68ecd9b3ca643539b109f75bb242d6f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '75e14fd88bfb4cd896fa7b070a0fac47', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120741) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 18:08:19.487910 dv-cinder-852009-8-iscsi devstack@n-api.service[120741]: DEBUG nova.policy [None req-a7b0fbf4-9906-47aa-bceb-4cb08f2ce663 tempest-AttachVolumeShelveTestJSON-385853788 tempest-AttachVolumeShelveTestJSON-385853788-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'e68ecd9b3ca643539b109f75bb242d6f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '75e14fd88bfb4cd896fa7b070a0fac47', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120741) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 18:08:19.489396 dv-cinder-852009-8-iscsi devstack@n-api.service[120741]: DEBUG nova.policy [None req-a7b0fbf4-9906-47aa-bceb-4cb08f2ce663 tempest-AttachVolumeShelveTestJSON-385853788 tempest-AttachVolumeShelveTestJSON-385853788-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'e68ecd9b3ca643539b109f75bb242d6f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '75e14fd88bfb4cd896fa7b070a0fac47', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120741) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 18:08:19.490560 dv-cinder-852009-8-iscsi devstack@n-api.service[120741]: INFO nova.api.openstack.requestlog [None req-a7b0fbf4-9906-47aa-bceb-4cb08f2ce663 tempest-AttachVolumeShelveTestJSON-385853788 tempest-AttachVolumeShelveTestJSON-385853788-project] 10.222.0.43 "GET /compute/v2.1/servers/8cecf08e-bea8-4cef-9439-0eaa242bfed1" status: 200 len: 1722 microversion: 2.20 time: 0.160969 Sep 13 18:08:19.491104 dv-cinder-852009-8-iscsi devstack@n-api.service[120741]: [pid: 120741|app: 0|req: 349/706] 10.222.0.43 () {60 vars in 1277 bytes} [Tue Sep 13 18:08:19 2022] GET /compute/v2.1/servers/8cecf08e-bea8-4cef-9439-0eaa242bfed1 => generated 1722 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 13 18:08:20.522658 dv-cinder-852009-8-iscsi devstack@n-api.service[120740]: DEBUG nova.api.openstack.wsgi [None req-1eafdcd5-2437-4cb9-90ab-cd052c148c19 tempest-AttachVolumeShelveTestJSON-385853788 tempest-AttachVolumeShelveTestJSON-385853788-project] Calling method '>' {{(pid=120740) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 18:08:20.523508 dv-cinder-852009-8-iscsi devstack@n-api.service[120740]: DEBUG nova.compute.api [None req-1eafdcd5-2437-4cb9-90ab-cd052c148c19 tempest-AttachVolumeShelveTestJSON-385853788 tempest-AttachVolumeShelveTestJSON-385853788-project] [instance: 8cecf08e-bea8-4cef-9439-0eaa242bfed1] Fetching instance by UUID {{(pid=120740) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 18:08:20.530264 dv-cinder-852009-8-iscsi devstack@n-api.service[120740]: DEBUG oslo_concurrency.lockutils [None req-1eafdcd5-2437-4cb9-90ab-cd052c148c19 tempest-AttachVolumeShelveTestJSON-385853788 tempest-AttachVolumeShelveTestJSON-385853788-project] Acquiring lock "1daf4f4c-0e4a-4779-b53a-78c48397ea2f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120740) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 18:08:20.530755 dv-cinder-852009-8-iscsi devstack@n-api.service[120740]: DEBUG oslo_concurrency.lockutils [None req-1eafdcd5-2437-4cb9-90ab-cd052c148c19 tempest-AttachVolumeShelveTestJSON-385853788 tempest-AttachVolumeShelveTestJSON-385853788-project] Lock "1daf4f4c-0e4a-4779-b53a-78c48397ea2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120740) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 18:08:20.531382 dv-cinder-852009-8-iscsi devstack@n-api.service[120740]: DEBUG oslo_concurrency.lockutils [None req-1eafdcd5-2437-4cb9-90ab-cd052c148c19 tempest-AttachVolumeShelveTestJSON-385853788 tempest-AttachVolumeShelveTestJSON-385853788-project] Lock "1daf4f4c-0e4a-4779-b53a-78c48397ea2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120740) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 18:08:20.531880 dv-cinder-852009-8-iscsi devstack@n-api.service[120740]: DEBUG oslo_concurrency.lockutils [None req-1eafdcd5-2437-4cb9-90ab-cd052c148c19 tempest-AttachVolumeShelveTestJSON-385853788 tempest-AttachVolumeShelveTestJSON-385853788-project] Acquiring lock "1daf4f4c-0e4a-4779-b53a-78c48397ea2f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120740) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 18:08:20.532327 dv-cinder-852009-8-iscsi devstack@n-api.service[120740]: DEBUG oslo_concurrency.lockutils [None req-1eafdcd5-2437-4cb9-90ab-cd052c148c19 tempest-AttachVolumeShelveTestJSON-385853788 tempest-AttachVolumeShelveTestJSON-385853788-project] Lock "1daf4f4c-0e4a-4779-b53a-78c48397ea2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120740) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 18:08:20.532781 dv-cinder-852009-8-iscsi devstack@n-api.service[120740]: DEBUG oslo_concurrency.lockutils [None req-1eafdcd5-2437-4cb9-90ab-cd052c148c19 tempest-AttachVolumeShelveTestJSON-385853788 tempest-AttachVolumeShelveTestJSON-385853788-project] Lock "1daf4f4c-0e4a-4779-b53a-78c48397ea2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120740) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 18:08:20.674461 dv-cinder-852009-8-iscsi devstack@n-api.service[120740]: DEBUG nova.policy [None req-1eafdcd5-2437-4cb9-90ab-cd052c148c19 tempest-AttachVolumeShelveTestJSON-385853788 tempest-AttachVolumeShelveTestJSON-385853788-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e68ecd9b3ca643539b109f75bb242d6f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '75e14fd88bfb4cd896fa7b070a0fac47', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120740) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 18:08:20.684561 dv-cinder-852009-8-iscsi devstack@n-api.service[120740]: DEBUG nova.policy [None req-1eafdcd5-2437-4cb9-90ab-cd052c148c19 tempest-AttachVolumeShelveTestJSON-385853788 tempest-AttachVolumeShelveTestJSON-385853788-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'e68ecd9b3ca643539b109f75bb242d6f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '75e14fd88bfb4cd896fa7b070a0fac47', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120740) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 18:08:20.684961 dv-cinder-852009-8-iscsi devstack@n-api.service[120740]: DEBUG nova.policy [None req-1eafdcd5-2437-4cb9-90ab-cd052c148c19 tempest-AttachVolumeShelveTestJSON-385853788 tempest-AttachVolumeShelveTestJSON-385853788-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'e68ecd9b3ca643539b109f75bb242d6f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '75e14fd88bfb4cd896fa7b070a0fac47', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120740) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 18:08:20.686037 dv-cinder-852009-8-iscsi devstack@n-api.service[120740]: INFO nova.api.openstack.requestlog [None req-1eafdcd5-2437-4cb9-90ab-cd052c148c19 tempest-AttachVolumeShelveTestJSON-385853788 tempest-AttachVolumeShelveTestJSON-385853788-project] 10.222.0.43 "GET /compute/v2.1/servers/8cecf08e-bea8-4cef-9439-0eaa242bfed1" status: 200 len: 1722 microversion: 2.20 time: 0.170622 Sep 13 18:08:20.686631 dv-cinder-852009-8-iscsi devstack@n-api.service[120740]: [pid: 120740|app: 0|req: 358/707] 10.222.0.43 () {60 vars in 1277 bytes} [Tue Sep 13 18:08:20 2022] GET /compute/v2.1/servers/8cecf08e-bea8-4cef-9439-0eaa242bfed1 => generated 1722 bytes in 172 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 13 18:08:21.512793 dv-cinder-852009-8-iscsi devstack@n-api.service[120741]: DEBUG nova.api.openstack.wsgi [req-21428585-f55a-4b8d-8d17-f9efe5258a9a req-a7734a22-b2f8-4cbf-9055-e6c71c3ec74f service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "8cecf08e-bea8-4cef-9439-0eaa242bfed1", "name": "network-vif-deleted", "tag": "cf75920d-98e9-4700-bdad-ac46b7b3f022"}]} {{(pid=120741) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 13 18:08:21.525915 dv-cinder-852009-8-iscsi devstack@n-api.service[120741]: DEBUG oslo_concurrency.lockutils [req-21428585-f55a-4b8d-8d17-f9efe5258a9a req-a7734a22-b2f8-4cbf-9055-e6c71c3ec74f service nova] Acquiring lock "1daf4f4c-0e4a-4779-b53a-78c48397ea2f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120741) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 18:08:21.526519 dv-cinder-852009-8-iscsi devstack@n-api.service[120741]: DEBUG oslo_concurrency.lockutils [req-21428585-f55a-4b8d-8d17-f9efe5258a9a req-a7734a22-b2f8-4cbf-9055-e6c71c3ec74f service nova] Lock "1daf4f4c-0e4a-4779-b53a-78c48397ea2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120741) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 18:08:21.527149 dv-cinder-852009-8-iscsi devstack@n-api.service[120741]: DEBUG oslo_concurrency.lockutils [req-21428585-f55a-4b8d-8d17-f9efe5258a9a req-a7734a22-b2f8-4cbf-9055-e6c71c3ec74f service nova] Lock "1daf4f4c-0e4a-4779-b53a-78c48397ea2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120741) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 18:08:21.541269 dv-cinder-852009-8-iscsi devstack@n-api.service[120741]: INFO nova.api.openstack.compute.server_external_events [req-21428585-f55a-4b8d-8d17-f9efe5258a9a req-a7734a22-b2f8-4cbf-9055-e6c71c3ec74f service nova] Creating event network-vif-deleted:cf75920d-98e9-4700-bdad-ac46b7b3f022 for instance 8cecf08e-bea8-4cef-9439-0eaa242bfed1 on hv-cinder-85200 Sep 13 18:08:21.547603 dv-cinder-852009-8-iscsi devstack@n-api.service[120741]: INFO nova.api.openstack.requestlog [req-21428585-f55a-4b8d-8d17-f9efe5258a9a req-a7734a22-b2f8-4cbf-9055-e6c71c3ec74f service nova] 10.222.0.43 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.039412 Sep 13 18:08:21.548497 dv-cinder-852009-8-iscsi devstack@n-api.service[120741]: [pid: 120741|app: 0|req: 350/708] 10.222.0.43 () {64 vars in 1317 bytes} [Tue Sep 13 18:08:21 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 41 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 13 18:08:21.711803 dv-cinder-852009-8-iscsi devstack@n-api.service[120740]: DEBUG nova.api.openstack.wsgi [None req-6cc8c54c-9a13-4ed8-aab1-9ba68d99f963 tempest-AttachVolumeShelveTestJSON-385853788 tempest-AttachVolumeShelveTestJSON-385853788-project] Calling method '>' {{(pid=120740) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 18:08:21.712668 dv-cinder-852009-8-iscsi devstack@n-api.service[120740]: DEBUG nova.compute.api [None req-6cc8c54c-9a13-4ed8-aab1-9ba68d99f963 tempest-AttachVolumeShelveTestJSON-385853788 tempest-AttachVolumeShelveTestJSON-385853788-project] [instance: 8cecf08e-bea8-4cef-9439-0eaa242bfed1] Fetching instance by UUID {{(pid=120740) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 18:08:21.720051 dv-cinder-852009-8-iscsi devstack@n-api.service[120740]: DEBUG oslo_concurrency.lockutils [None req-6cc8c54c-9a13-4ed8-aab1-9ba68d99f963 tempest-AttachVolumeShelveTestJSON-385853788 tempest-AttachVolumeShelveTestJSON-385853788-project] Acquiring lock "1daf4f4c-0e4a-4779-b53a-78c48397ea2f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120740) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 18:08:21.720591 dv-cinder-852009-8-iscsi devstack@n-api.service[120740]: DEBUG oslo_concurrency.lockutils [None req-6cc8c54c-9a13-4ed8-aab1-9ba68d99f963 tempest-AttachVolumeShelveTestJSON-385853788 tempest-AttachVolumeShelveTestJSON-385853788-project] Lock "1daf4f4c-0e4a-4779-b53a-78c48397ea2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120740) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 18:08:21.726316 dv-cinder-852009-8-iscsi devstack@n-api.service[120740]: DEBUG oslo_concurrency.lockutils [None req-6cc8c54c-9a13-4ed8-aab1-9ba68d99f963 tempest-AttachVolumeShelveTestJSON-385853788 tempest-AttachVolumeShelveTestJSON-385853788-project] Lock "1daf4f4c-0e4a-4779-b53a-78c48397ea2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120740) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 18:08:21.728401 dv-cinder-852009-8-iscsi devstack@n-api.service[120740]: DEBUG oslo_concurrency.lockutils [None req-6cc8c54c-9a13-4ed8-aab1-9ba68d99f963 tempest-AttachVolumeShelveTestJSON-385853788 tempest-AttachVolumeShelveTestJSON-385853788-project] Acquiring lock "1daf4f4c-0e4a-4779-b53a-78c48397ea2f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120740) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 18:08:21.729610 dv-cinder-852009-8-iscsi devstack@n-api.service[120740]: DEBUG oslo_concurrency.lockutils [None req-6cc8c54c-9a13-4ed8-aab1-9ba68d99f963 tempest-AttachVolumeShelveTestJSON-385853788 tempest-AttachVolumeShelveTestJSON-385853788-project] Lock "1daf4f4c-0e4a-4779-b53a-78c48397ea2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120740) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 18:08:21.730338 dv-cinder-852009-8-iscsi devstack@n-api.service[120740]: DEBUG oslo_concurrency.lockutils [None req-6cc8c54c-9a13-4ed8-aab1-9ba68d99f963 tempest-AttachVolumeShelveTestJSON-385853788 tempest-AttachVolumeShelveTestJSON-385853788-project] Lock "1daf4f4c-0e4a-4779-b53a-78c48397ea2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120740) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 18:08:21.778386 dv-cinder-852009-8-iscsi devstack@n-api.service[120740]: DEBUG oslo_concurrency.lockutils [None req-6cc8c54c-9a13-4ed8-aab1-9ba68d99f963 tempest-AttachVolumeShelveTestJSON-385853788 tempest-AttachVolumeShelveTestJSON-385853788-project] Acquiring lock "1daf4f4c-0e4a-4779-b53a-78c48397ea2f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120740) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 18:08:21.779372 dv-cinder-852009-8-iscsi devstack@n-api.service[120740]: DEBUG oslo_concurrency.lockutils [None req-6cc8c54c-9a13-4ed8-aab1-9ba68d99f963 tempest-AttachVolumeShelveTestJSON-385853788 tempest-AttachVolumeShelveTestJSON-385853788-project] Lock "1daf4f4c-0e4a-4779-b53a-78c48397ea2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120740) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 18:08:21.779871 dv-cinder-852009-8-iscsi devstack@n-api.service[120740]: DEBUG oslo_concurrency.lockutils [None req-6cc8c54c-9a13-4ed8-aab1-9ba68d99f963 tempest-AttachVolumeShelveTestJSON-385853788 tempest-AttachVolumeShelveTestJSON-385853788-project] Lock "1daf4f4c-0e4a-4779-b53a-78c48397ea2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120740) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 18:08:21.780660 dv-cinder-852009-8-iscsi devstack@n-api.service[120740]: DEBUG nova.objects.instance [None req-6cc8c54c-9a13-4ed8-aab1-9ba68d99f963 tempest-AttachVolumeShelveTestJSON-385853788 tempest-AttachVolumeShelveTestJSON-385853788-project] Lazy-loading 'fault' on Instance uuid 8cecf08e-bea8-4cef-9439-0eaa242bfed1 {{(pid=120740) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Sep 13 18:08:21.829259 dv-cinder-852009-8-iscsi devstack@n-api.service[120740]: DEBUG nova.policy [None req-6cc8c54c-9a13-4ed8-aab1-9ba68d99f963 tempest-AttachVolumeShelveTestJSON-385853788 tempest-AttachVolumeShelveTestJSON-385853788-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e68ecd9b3ca643539b109f75bb242d6f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '75e14fd88bfb4cd896fa7b070a0fac47', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120740) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 18:08:21.836748 dv-cinder-852009-8-iscsi devstack@n-api.service[120740]: DEBUG nova.policy [None req-6cc8c54c-9a13-4ed8-aab1-9ba68d99f963 tempest-AttachVolumeShelveTestJSON-385853788 tempest-AttachVolumeShelveTestJSON-385853788-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'e68ecd9b3ca643539b109f75bb242d6f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '75e14fd88bfb4cd896fa7b070a0fac47', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120740) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 18:08:21.838199 dv-cinder-852009-8-iscsi devstack@n-api.service[120740]: DEBUG nova.policy [None req-6cc8c54c-9a13-4ed8-aab1-9ba68d99f963 tempest-AttachVolumeShelveTestJSON-385853788 tempest-AttachVolumeShelveTestJSON-385853788-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'e68ecd9b3ca643539b109f75bb242d6f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '75e14fd88bfb4cd896fa7b070a0fac47', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120740) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 18:08:21.839598 dv-cinder-852009-8-iscsi devstack@n-api.service[120740]: INFO nova.api.openstack.requestlog [None req-6cc8c54c-9a13-4ed8-aab1-9ba68d99f963 tempest-AttachVolumeShelveTestJSON-385853788 tempest-AttachVolumeShelveTestJSON-385853788-project] 10.222.0.43 "GET /compute/v2.1/servers/8cecf08e-bea8-4cef-9439-0eaa242bfed1" status: 200 len: 1370 microversion: 2.20 time: 0.131779 Sep 13 18:08:21.840129 dv-cinder-852009-8-iscsi devstack@n-api.service[120740]: [pid: 120740|app: 0|req: 359/709] 10.222.0.43 () {60 vars in 1277 bytes} [Tue Sep 13 18:08:21 2022] GET /compute/v2.1/servers/8cecf08e-bea8-4cef-9439-0eaa242bfed1 => generated 1370 bytes in 133 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 13 18:08:22.865311 dv-cinder-852009-8-iscsi devstack@n-api.service[120741]: DEBUG nova.api.openstack.wsgi [None req-7a12c2f1-5cc9-45b5-a82c-84da3e0b9068 tempest-AttachVolumeShelveTestJSON-385853788 tempest-AttachVolumeShelveTestJSON-385853788-project] Calling method '>' {{(pid=120741) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 18:08:22.866015 dv-cinder-852009-8-iscsi devstack@n-api.service[120741]: DEBUG nova.compute.api [None req-7a12c2f1-5cc9-45b5-a82c-84da3e0b9068 tempest-AttachVolumeShelveTestJSON-385853788 tempest-AttachVolumeShelveTestJSON-385853788-project] [instance: 8cecf08e-bea8-4cef-9439-0eaa242bfed1] Fetching instance by UUID {{(pid=120741) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 18:08:22.872908 dv-cinder-852009-8-iscsi devstack@n-api.service[120741]: DEBUG oslo_concurrency.lockutils [None req-7a12c2f1-5cc9-45b5-a82c-84da3e0b9068 tempest-AttachVolumeShelveTestJSON-385853788 tempest-AttachVolumeShelveTestJSON-385853788-project] Acquiring lock "1daf4f4c-0e4a-4779-b53a-78c48397ea2f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120741) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 18:08:22.873381 dv-cinder-852009-8-iscsi devstack@n-api.service[120741]: DEBUG oslo_concurrency.lockutils [None req-7a12c2f1-5cc9-45b5-a82c-84da3e0b9068 tempest-AttachVolumeShelveTestJSON-385853788 tempest-AttachVolumeShelveTestJSON-385853788-project] Lock "1daf4f4c-0e4a-4779-b53a-78c48397ea2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120741) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 18:08:22.873817 dv-cinder-852009-8-iscsi devstack@n-api.service[120741]: DEBUG oslo_concurrency.lockutils [None req-7a12c2f1-5cc9-45b5-a82c-84da3e0b9068 tempest-AttachVolumeShelveTestJSON-385853788 tempest-AttachVolumeShelveTestJSON-385853788-project] Lock "1daf4f4c-0e4a-4779-b53a-78c48397ea2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120741) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 18:08:22.874611 dv-cinder-852009-8-iscsi devstack@n-api.service[120741]: DEBUG oslo_concurrency.lockutils [None req-7a12c2f1-5cc9-45b5-a82c-84da3e0b9068 tempest-AttachVolumeShelveTestJSON-385853788 tempest-AttachVolumeShelveTestJSON-385853788-project] Acquiring lock "1daf4f4c-0e4a-4779-b53a-78c48397ea2f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120741) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 18:08:22.875075 dv-cinder-852009-8-iscsi devstack@n-api.service[120741]: DEBUG oslo_concurrency.lockutils [None req-7a12c2f1-5cc9-45b5-a82c-84da3e0b9068 tempest-AttachVolumeShelveTestJSON-385853788 tempest-AttachVolumeShelveTestJSON-385853788-project] Lock "1daf4f4c-0e4a-4779-b53a-78c48397ea2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120741) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 18:08:22.875529 dv-cinder-852009-8-iscsi devstack@n-api.service[120741]: DEBUG oslo_concurrency.lockutils [None req-7a12c2f1-5cc9-45b5-a82c-84da3e0b9068 tempest-AttachVolumeShelveTestJSON-385853788 tempest-AttachVolumeShelveTestJSON-385853788-project] Lock "1daf4f4c-0e4a-4779-b53a-78c48397ea2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120741) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 18:08:22.889219 dv-cinder-852009-8-iscsi devstack@n-api.service[120741]: INFO nova.api.openstack.wsgi [None req-7a12c2f1-5cc9-45b5-a82c-84da3e0b9068 tempest-AttachVolumeShelveTestJSON-385853788 tempest-AttachVolumeShelveTestJSON-385853788-project] HTTP exception thrown: Instance 8cecf08e-bea8-4cef-9439-0eaa242bfed1 could not be found. Sep 13 18:08:22.890838 dv-cinder-852009-8-iscsi devstack@n-api.service[120741]: DEBUG nova.api.openstack.wsgi [None req-7a12c2f1-5cc9-45b5-a82c-84da3e0b9068 tempest-AttachVolumeShelveTestJSON-385853788 tempest-AttachVolumeShelveTestJSON-385853788-project] Request method failure captured: Sep 13 18:08:22.890838 dv-cinder-852009-8-iscsi devstack@n-api.service[120741]: request: GET /compute/v2.1/servers/8cecf08e-bea8-4cef-9439-0eaa242bfed1 HTTP/1.1 Sep 13 18:08:22.890838 dv-cinder-852009-8-iscsi devstack@n-api.service[120741]: Accept: application/json Sep 13 18:08:22.890838 dv-cinder-852009-8-iscsi devstack@n-api.service[120741]: Accept-Encoding: identity Sep 13 18:08:22.890838 dv-cinder-852009-8-iscsi devstack@n-api.service[120741]: Connection: close Sep 13 18:08:22.890838 dv-cinder-852009-8-iscsi devstack@n-api.service[120741]: Content-Length: 0 Sep 13 18:08:22.890838 dv-cinder-852009-8-iscsi devstack@n-api.service[120741]: Content-Type: application/json Sep 13 18:08:22.890838 dv-cinder-852009-8-iscsi devstack@n-api.service[120741]: Host: 10.222.0.43 Sep 13 18:08:22.890838 dv-cinder-852009-8-iscsi devstack@n-api.service[120741]: Openstack-System-Scope: None Sep 13 18:08:22.890838 dv-cinder-852009-8-iscsi devstack@n-api.service[120741]: User-Agent: python-urllib3/1.26.12 Sep 13 18:08:22.890838 dv-cinder-852009-8-iscsi devstack@n-api.service[120741]: X-Auth-Token: gAAAAABjIMWMYqPVtf0Rs9jRF4xl1KD9-SjO_FS4g579Cc1gUdbkqCtXPDYdTxBMbLmZqtgmWQubM-SSNfaWwXS4FDzkQIkG_6wttMeObykV4FtQQ2VkVt80Xzr2XOrB1n0hRb-cwFsutvG_3Oz7IRpcKn9EZa84Z-Ec1SHW4W3F55A21YEi9KQ Sep 13 18:08:22.890838 dv-cinder-852009-8-iscsi devstack@n-api.service[120741]: X-Domain-Id: None Sep 13 18:08:22.890838 dv-cinder-852009-8-iscsi devstack@n-api.service[120741]: X-Domain-Name: None Sep 13 18:08:22.890838 dv-cinder-852009-8-iscsi devstack@n-api.service[120741]: X-Identity-Status: Confirmed Sep 13 18:08:22.890838 dv-cinder-852009-8-iscsi devstack@n-api.service[120741]: X-Is-Admin-Project: True Sep 13 18:08:22.890838 dv-cinder-852009-8-iscsi devstack@n-api.service[120741]: X-Openstack-Nova-Api-Version: 2.20 Sep 13 18:08:22.890838 dv-cinder-852009-8-iscsi devstack@n-api.service[120741]: X-Project-Domain-Id: default Sep 13 18:08:22.890838 dv-cinder-852009-8-iscsi devstack@n-api.service[120741]: X-Project-Domain-Name: Default Sep 13 18:08:22.890838 dv-cinder-852009-8-iscsi devstack@n-api.service[120741]: X-Project-Id: 75e14fd88bfb4cd896fa7b070a0fac47 Sep 13 18:08:22.890838 dv-cinder-852009-8-iscsi devstack@n-api.service[120741]: X-Project-Name: tempest-AttachVolumeShelveTestJSON-385853788 Sep 13 18:08:22.890838 dv-cinder-852009-8-iscsi devstack@n-api.service[120741]: X-Role: reader,member Sep 13 18:08:22.890838 dv-cinder-852009-8-iscsi devstack@n-api.service[120741]: X-Roles: reader,member Sep 13 18:08:22.892933 dv-cinder-852009-8-iscsi devstack@n-api.service[120741]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/identity"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/compute/v2/75e14fd88bfb4cd896fa7b070a0fac47"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.43:8080", "publicURL": "http://10.222.0.43:8080/v1/AUTH_75e14fd88bfb4cd896fa7b070a0fac47"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43:9696/networking"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/volume/v3/75e14fd88bfb4cd896fa7b070a0fac47"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/compute/v2.1"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/placement"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/volume/v3/75e14fd88bfb4cd896fa7b070a0fac47"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/image"}]}] Sep 13 18:08:22.892933 dv-cinder-852009-8-iscsi devstack@n-api.service[120741]: X-Tenant: tempest-AttachVolumeShelveTestJSON-385853788 Sep 13 18:08:22.892933 dv-cinder-852009-8-iscsi devstack@n-api.service[120741]: X-Tenant-Id: 75e14fd88bfb4cd896fa7b070a0fac47 Sep 13 18:08:22.892933 dv-cinder-852009-8-iscsi devstack@n-api.service[120741]: X-Tenant-Name: tempest-AttachVolumeShelveTestJSON-385853788 Sep 13 18:08:22.892933 dv-cinder-852009-8-iscsi devstack@n-api.service[120741]: X-User: tempest-AttachVolumeShelveTestJSON-385853788-project Sep 13 18:08:22.892933 dv-cinder-852009-8-iscsi devstack@n-api.service[120741]: X-User-Domain-Id: default Sep 13 18:08:22.892933 dv-cinder-852009-8-iscsi devstack@n-api.service[120741]: X-User-Domain-Name: Default Sep 13 18:08:22.892933 dv-cinder-852009-8-iscsi devstack@n-api.service[120741]: X-User-Id: e68ecd9b3ca643539b109f75bb242d6f Sep 13 18:08:22.892933 dv-cinder-852009-8-iscsi devstack@n-api.service[120741]: X-User-Name: tempest-AttachVolumeShelveTestJSON-385853788-project Sep 13 18:08:22.892933 dv-cinder-852009-8-iscsi devstack@n-api.service[120741]: method: > Sep 13 18:08:22.892933 dv-cinder-852009-8-iscsi devstack@n-api.service[120741]: exception: Instance 8cecf08e-bea8-4cef-9439-0eaa242bfed1 could not be found. Sep 13 18:08:22.892933 dv-cinder-852009-8-iscsi devstack@n-api.service[120741]: action_args: {'id': '8cecf08e-bea8-4cef-9439-0eaa242bfed1'} Sep 13 18:08:22.894028 dv-cinder-852009-8-iscsi devstack@n-api.service[120741]: {{(pid=120741) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 13 18:08:22.894028 dv-cinder-852009-8-iscsi devstack@n-api.service[120741]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 13 18:08:22.894028 dv-cinder-852009-8-iscsi devstack@n-api.service[120741]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Sep 13 18:08:22.894028 dv-cinder-852009-8-iscsi devstack@n-api.service[120741]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Sep 13 18:08:22.894028 dv-cinder-852009-8-iscsi devstack@n-api.service[120741]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Sep 13 18:08:22.894028 dv-cinder-852009-8-iscsi devstack@n-api.service[120741]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Sep 13 18:08:22.894028 dv-cinder-852009-8-iscsi devstack@n-api.service[120741]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Sep 13 18:08:22.894028 dv-cinder-852009-8-iscsi devstack@n-api.service[120741]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Sep 13 18:08:22.894028 dv-cinder-852009-8-iscsi devstack@n-api.service[120741]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Sep 13 18:08:22.894028 dv-cinder-852009-8-iscsi devstack@n-api.service[120741]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Sep 13 18:08:22.894028 dv-cinder-852009-8-iscsi devstack@n-api.service[120741]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 8cecf08e-bea8-4cef-9439-0eaa242bfed1 could not be found. Sep 13 18:08:22.894028 dv-cinder-852009-8-iscsi devstack@n-api.service[120741]: ERROR nova.api.openstack.wsgi Sep 13 18:08:22.894028 dv-cinder-852009-8-iscsi devstack@n-api.service[120741]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 13 18:08:22.894028 dv-cinder-852009-8-iscsi devstack@n-api.service[120741]: ERROR nova.api.openstack.wsgi Sep 13 18:08:22.894028 dv-cinder-852009-8-iscsi devstack@n-api.service[120741]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 13 18:08:22.894028 dv-cinder-852009-8-iscsi devstack@n-api.service[120741]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 13 18:08:22.894028 dv-cinder-852009-8-iscsi devstack@n-api.service[120741]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 13 18:08:22.894028 dv-cinder-852009-8-iscsi devstack@n-api.service[120741]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 13 18:08:22.894028 dv-cinder-852009-8-iscsi devstack@n-api.service[120741]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 13 18:08:22.894028 dv-cinder-852009-8-iscsi devstack@n-api.service[120741]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 13 18:08:22.895578 dv-cinder-852009-8-iscsi devstack@n-api.service[120741]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 13 18:08:22.895578 dv-cinder-852009-8-iscsi devstack@n-api.service[120741]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Sep 13 18:08:22.895578 dv-cinder-852009-8-iscsi devstack@n-api.service[120741]: ERROR nova.api.openstack.wsgi instance = self._get_server( Sep 13 18:08:22.895578 dv-cinder-852009-8-iscsi devstack@n-api.service[120741]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Sep 13 18:08:22.895578 dv-cinder-852009-8-iscsi devstack@n-api.service[120741]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Sep 13 18:08:22.895578 dv-cinder-852009-8-iscsi devstack@n-api.service[120741]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Sep 13 18:08:22.895578 dv-cinder-852009-8-iscsi devstack@n-api.service[120741]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Sep 13 18:08:22.895578 dv-cinder-852009-8-iscsi devstack@n-api.service[120741]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 8cecf08e-bea8-4cef-9439-0eaa242bfed1 could not be found. Sep 13 18:08:22.895578 dv-cinder-852009-8-iscsi devstack@n-api.service[120741]: ERROR nova.api.openstack.wsgi Sep 13 18:08:22.895578 dv-cinder-852009-8-iscsi devstack@n-api.service[120741]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 13 18:08:22.895578 dv-cinder-852009-8-iscsi devstack@n-api.service[120741]: ERROR nova.api.openstack.wsgi Sep 13 18:08:22.895578 dv-cinder-852009-8-iscsi devstack@n-api.service[120741]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 13 18:08:22.895578 dv-cinder-852009-8-iscsi devstack@n-api.service[120741]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 13 18:08:22.895578 dv-cinder-852009-8-iscsi devstack@n-api.service[120741]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 13 18:08:22.895578 dv-cinder-852009-8-iscsi devstack@n-api.service[120741]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 13 18:08:22.895578 dv-cinder-852009-8-iscsi devstack@n-api.service[120741]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 13 18:08:22.895578 dv-cinder-852009-8-iscsi devstack@n-api.service[120741]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 8cecf08e-bea8-4cef-9439-0eaa242bfed1 could not be found. Sep 13 18:08:22.895578 dv-cinder-852009-8-iscsi devstack@n-api.service[120741]: ERROR nova.api.openstack.wsgi Sep 13 18:08:22.897236 dv-cinder-852009-8-iscsi devstack@n-api.service[120741]: DEBUG nova.api.openstack.wsgi [None req-7a12c2f1-5cc9-45b5-a82c-84da3e0b9068 tempest-AttachVolumeShelveTestJSON-385853788 tempest-AttachVolumeShelveTestJSON-385853788-project] Returning 404 to user: Instance 8cecf08e-bea8-4cef-9439-0eaa242bfed1 could not be found. {{(pid=120741) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 13 18:08:22.897236 dv-cinder-852009-8-iscsi devstack@n-api.service[120741]: INFO nova.api.openstack.requestlog [None req-7a12c2f1-5cc9-45b5-a82c-84da3e0b9068 tempest-AttachVolumeShelveTestJSON-385853788 tempest-AttachVolumeShelveTestJSON-385853788-project] 10.222.0.43 "GET /compute/v2.1/servers/8cecf08e-bea8-4cef-9439-0eaa242bfed1" status: 404 len: 111 microversion: 2.20 time: 0.031245 Sep 13 18:08:22.897236 dv-cinder-852009-8-iscsi devstack@n-api.service[120741]: [pid: 120741|app: 0|req: 351/710] 10.222.0.43 () {60 vars in 1277 bytes} [Tue Sep 13 18:08:22 2022] GET /compute/v2.1/servers/8cecf08e-bea8-4cef-9439-0eaa242bfed1 => generated 111 bytes in 33 msecs (HTTP/1.1 404) 9 headers in 381 bytes (1 switches on core 0) Sep 13 18:08:22.901322 dv-cinder-852009-8-iscsi devstack@n-api.service[120740]: DEBUG nova.api.openstack.wsgi [None req-1fb26d5a-0f0d-476a-9e2c-e31d4bdf4161 tempest-AttachVolumeShelveTestJSON-385853788 tempest-AttachVolumeShelveTestJSON-385853788-project] Calling method '.version_select at 0x7fa626ad2af0>' {{(pid=120740) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 18:08:22.922234 dv-cinder-852009-8-iscsi devstack@n-api.service[120740]: INFO nova.api.openstack.requestlog [None req-1fb26d5a-0f0d-476a-9e2c-e31d4bdf4161 tempest-AttachVolumeShelveTestJSON-385853788 tempest-AttachVolumeShelveTestJSON-385853788-project] 10.222.0.43 "DELETE /compute/v2.1/os-keypairs/tempest-keypair-1669216601" status: 204 len: 0 microversion: 2.20 time: 0.024901 Sep 13 18:08:22.922809 dv-cinder-852009-8-iscsi devstack@n-api.service[120740]: [pid: 120740|app: 0|req: 360/711] 10.222.0.43 () {60 vars in 1262 bytes} [Tue Sep 13 18:08:22 2022] DELETE /compute/v2.1/os-keypairs/tempest-keypair-1669216601 => generated 0 bytes in 26 msecs (HTTP/1.1 204) 9 headers in 365 bytes (2 switches on core 0) Sep 13 18:08:24.698676 dv-cinder-852009-8-iscsi devstack@n-api.service[120741]: DEBUG nova.api.openstack.wsgi [None req-eca2d1ee-a19a-485f-a89a-d4794431e460 tempest-AttachVolumeShelveTestJSON-385853788 tempest-AttachVolumeShelveTestJSON-385853788-project] Calling method '>' {{(pid=120741) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 18:08:24.699182 dv-cinder-852009-8-iscsi devstack@n-api.service[120741]: DEBUG nova.compute.api [None req-eca2d1ee-a19a-485f-a89a-d4794431e460 tempest-AttachVolumeShelveTestJSON-385853788 tempest-AttachVolumeShelveTestJSON-385853788-project] [instance: 8cecf08e-bea8-4cef-9439-0eaa242bfed1] Fetching instance by UUID {{(pid=120741) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 18:08:24.706106 dv-cinder-852009-8-iscsi devstack@n-api.service[120741]: DEBUG oslo_concurrency.lockutils [None req-eca2d1ee-a19a-485f-a89a-d4794431e460 tempest-AttachVolumeShelveTestJSON-385853788 tempest-AttachVolumeShelveTestJSON-385853788-project] Acquiring lock "1daf4f4c-0e4a-4779-b53a-78c48397ea2f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120741) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 18:08:24.706584 dv-cinder-852009-8-iscsi devstack@n-api.service[120741]: DEBUG oslo_concurrency.lockutils [None req-eca2d1ee-a19a-485f-a89a-d4794431e460 tempest-AttachVolumeShelveTestJSON-385853788 tempest-AttachVolumeShelveTestJSON-385853788-project] Lock "1daf4f4c-0e4a-4779-b53a-78c48397ea2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120741) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 18:08:24.707005 dv-cinder-852009-8-iscsi devstack@n-api.service[120741]: DEBUG oslo_concurrency.lockutils [None req-eca2d1ee-a19a-485f-a89a-d4794431e460 tempest-AttachVolumeShelveTestJSON-385853788 tempest-AttachVolumeShelveTestJSON-385853788-project] Lock "1daf4f4c-0e4a-4779-b53a-78c48397ea2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120741) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 18:08:24.707694 dv-cinder-852009-8-iscsi devstack@n-api.service[120741]: DEBUG oslo_concurrency.lockutils [None req-eca2d1ee-a19a-485f-a89a-d4794431e460 tempest-AttachVolumeShelveTestJSON-385853788 tempest-AttachVolumeShelveTestJSON-385853788-project] Acquiring lock "1daf4f4c-0e4a-4779-b53a-78c48397ea2f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120741) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 18:08:24.708129 dv-cinder-852009-8-iscsi devstack@n-api.service[120741]: DEBUG oslo_concurrency.lockutils [None req-eca2d1ee-a19a-485f-a89a-d4794431e460 tempest-AttachVolumeShelveTestJSON-385853788 tempest-AttachVolumeShelveTestJSON-385853788-project] Lock "1daf4f4c-0e4a-4779-b53a-78c48397ea2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120741) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 18:08:24.708570 dv-cinder-852009-8-iscsi devstack@n-api.service[120741]: DEBUG oslo_concurrency.lockutils [None req-eca2d1ee-a19a-485f-a89a-d4794431e460 tempest-AttachVolumeShelveTestJSON-385853788 tempest-AttachVolumeShelveTestJSON-385853788-project] Lock "1daf4f4c-0e4a-4779-b53a-78c48397ea2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120741) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 18:08:24.722693 dv-cinder-852009-8-iscsi devstack@n-api.service[120741]: INFO nova.api.openstack.wsgi [None req-eca2d1ee-a19a-485f-a89a-d4794431e460 tempest-AttachVolumeShelveTestJSON-385853788 tempest-AttachVolumeShelveTestJSON-385853788-project] HTTP exception thrown: Instance 8cecf08e-bea8-4cef-9439-0eaa242bfed1 could not be found. Sep 13 18:08:24.724265 dv-cinder-852009-8-iscsi devstack@n-api.service[120741]: DEBUG nova.api.openstack.wsgi [None req-eca2d1ee-a19a-485f-a89a-d4794431e460 tempest-AttachVolumeShelveTestJSON-385853788 tempest-AttachVolumeShelveTestJSON-385853788-project] Request method failure captured: Sep 13 18:08:24.724265 dv-cinder-852009-8-iscsi devstack@n-api.service[120741]: request: DELETE /compute/v2.1/servers/8cecf08e-bea8-4cef-9439-0eaa242bfed1 HTTP/1.1 Sep 13 18:08:24.724265 dv-cinder-852009-8-iscsi devstack@n-api.service[120741]: Accept: application/json Sep 13 18:08:24.724265 dv-cinder-852009-8-iscsi devstack@n-api.service[120741]: Accept-Encoding: identity Sep 13 18:08:24.724265 dv-cinder-852009-8-iscsi devstack@n-api.service[120741]: Connection: close Sep 13 18:08:24.724265 dv-cinder-852009-8-iscsi devstack@n-api.service[120741]: Content-Length: 0 Sep 13 18:08:24.724265 dv-cinder-852009-8-iscsi devstack@n-api.service[120741]: Content-Type: application/json Sep 13 18:08:24.724265 dv-cinder-852009-8-iscsi devstack@n-api.service[120741]: Host: 10.222.0.43 Sep 13 18:08:24.724265 dv-cinder-852009-8-iscsi devstack@n-api.service[120741]: Openstack-System-Scope: None Sep 13 18:08:24.724265 dv-cinder-852009-8-iscsi devstack@n-api.service[120741]: User-Agent: python-urllib3/1.26.12 Sep 13 18:08:24.724265 dv-cinder-852009-8-iscsi devstack@n-api.service[120741]: X-Auth-Token: gAAAAABjIMWMYqPVtf0Rs9jRF4xl1KD9-SjO_FS4g579Cc1gUdbkqCtXPDYdTxBMbLmZqtgmWQubM-SSNfaWwXS4FDzkQIkG_6wttMeObykV4FtQQ2VkVt80Xzr2XOrB1n0hRb-cwFsutvG_3Oz7IRpcKn9EZa84Z-Ec1SHW4W3F55A21YEi9KQ Sep 13 18:08:24.724265 dv-cinder-852009-8-iscsi devstack@n-api.service[120741]: X-Domain-Id: None Sep 13 18:08:24.724265 dv-cinder-852009-8-iscsi devstack@n-api.service[120741]: X-Domain-Name: None Sep 13 18:08:24.724265 dv-cinder-852009-8-iscsi devstack@n-api.service[120741]: X-Identity-Status: Confirmed Sep 13 18:08:24.724265 dv-cinder-852009-8-iscsi devstack@n-api.service[120741]: X-Is-Admin-Project: True Sep 13 18:08:24.724265 dv-cinder-852009-8-iscsi devstack@n-api.service[120741]: X-Openstack-Nova-Api-Version: 2.20 Sep 13 18:08:24.724265 dv-cinder-852009-8-iscsi devstack@n-api.service[120741]: X-Project-Domain-Id: default Sep 13 18:08:24.724265 dv-cinder-852009-8-iscsi devstack@n-api.service[120741]: X-Project-Domain-Name: Default Sep 13 18:08:24.724265 dv-cinder-852009-8-iscsi devstack@n-api.service[120741]: X-Project-Id: 75e14fd88bfb4cd896fa7b070a0fac47 Sep 13 18:08:24.724265 dv-cinder-852009-8-iscsi devstack@n-api.service[120741]: X-Project-Name: tempest-AttachVolumeShelveTestJSON-385853788 Sep 13 18:08:24.724265 dv-cinder-852009-8-iscsi devstack@n-api.service[120741]: X-Role: reader,member Sep 13 18:08:24.724265 dv-cinder-852009-8-iscsi devstack@n-api.service[120741]: X-Roles: reader,member Sep 13 18:08:24.725785 dv-cinder-852009-8-iscsi devstack@n-api.service[120741]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/identity"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/compute/v2/75e14fd88bfb4cd896fa7b070a0fac47"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.43:8080", "publicURL": "http://10.222.0.43:8080/v1/AUTH_75e14fd88bfb4cd896fa7b070a0fac47"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43:9696/networking"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/volume/v3/75e14fd88bfb4cd896fa7b070a0fac47"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/compute/v2.1"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/placement"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/volume/v3/75e14fd88bfb4cd896fa7b070a0fac47"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/image"}]}] Sep 13 18:08:24.725785 dv-cinder-852009-8-iscsi devstack@n-api.service[120741]: X-Tenant: tempest-AttachVolumeShelveTestJSON-385853788 Sep 13 18:08:24.725785 dv-cinder-852009-8-iscsi devstack@n-api.service[120741]: X-Tenant-Id: 75e14fd88bfb4cd896fa7b070a0fac47 Sep 13 18:08:24.725785 dv-cinder-852009-8-iscsi devstack@n-api.service[120741]: X-Tenant-Name: tempest-AttachVolumeShelveTestJSON-385853788 Sep 13 18:08:24.725785 dv-cinder-852009-8-iscsi devstack@n-api.service[120741]: X-User: tempest-AttachVolumeShelveTestJSON-385853788-project Sep 13 18:08:24.725785 dv-cinder-852009-8-iscsi devstack@n-api.service[120741]: X-User-Domain-Id: default Sep 13 18:08:24.725785 dv-cinder-852009-8-iscsi devstack@n-api.service[120741]: X-User-Domain-Name: Default Sep 13 18:08:24.725785 dv-cinder-852009-8-iscsi devstack@n-api.service[120741]: X-User-Id: e68ecd9b3ca643539b109f75bb242d6f Sep 13 18:08:24.725785 dv-cinder-852009-8-iscsi devstack@n-api.service[120741]: X-User-Name: tempest-AttachVolumeShelveTestJSON-385853788-project Sep 13 18:08:24.725785 dv-cinder-852009-8-iscsi devstack@n-api.service[120741]: method: > Sep 13 18:08:24.725785 dv-cinder-852009-8-iscsi devstack@n-api.service[120741]: exception: Instance 8cecf08e-bea8-4cef-9439-0eaa242bfed1 could not be found. Sep 13 18:08:24.725785 dv-cinder-852009-8-iscsi devstack@n-api.service[120741]: action_args: {'id': '8cecf08e-bea8-4cef-9439-0eaa242bfed1'} Sep 13 18:08:24.726664 dv-cinder-852009-8-iscsi devstack@n-api.service[120741]: {{(pid=120741) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 13 18:08:24.726664 dv-cinder-852009-8-iscsi devstack@n-api.service[120741]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 13 18:08:24.726664 dv-cinder-852009-8-iscsi devstack@n-api.service[120741]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Sep 13 18:08:24.726664 dv-cinder-852009-8-iscsi devstack@n-api.service[120741]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Sep 13 18:08:24.726664 dv-cinder-852009-8-iscsi devstack@n-api.service[120741]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Sep 13 18:08:24.726664 dv-cinder-852009-8-iscsi devstack@n-api.service[120741]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Sep 13 18:08:24.726664 dv-cinder-852009-8-iscsi devstack@n-api.service[120741]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Sep 13 18:08:24.726664 dv-cinder-852009-8-iscsi devstack@n-api.service[120741]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Sep 13 18:08:24.726664 dv-cinder-852009-8-iscsi devstack@n-api.service[120741]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Sep 13 18:08:24.726664 dv-cinder-852009-8-iscsi devstack@n-api.service[120741]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Sep 13 18:08:24.726664 dv-cinder-852009-8-iscsi devstack@n-api.service[120741]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 8cecf08e-bea8-4cef-9439-0eaa242bfed1 could not be found. Sep 13 18:08:24.726664 dv-cinder-852009-8-iscsi devstack@n-api.service[120741]: ERROR nova.api.openstack.wsgi Sep 13 18:08:24.726664 dv-cinder-852009-8-iscsi devstack@n-api.service[120741]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 13 18:08:24.726664 dv-cinder-852009-8-iscsi devstack@n-api.service[120741]: ERROR nova.api.openstack.wsgi Sep 13 18:08:24.726664 dv-cinder-852009-8-iscsi devstack@n-api.service[120741]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 13 18:08:24.726664 dv-cinder-852009-8-iscsi devstack@n-api.service[120741]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 13 18:08:24.726664 dv-cinder-852009-8-iscsi devstack@n-api.service[120741]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 13 18:08:24.726664 dv-cinder-852009-8-iscsi devstack@n-api.service[120741]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 13 18:08:24.726664 dv-cinder-852009-8-iscsi devstack@n-api.service[120741]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 13 18:08:24.726664 dv-cinder-852009-8-iscsi devstack@n-api.service[120741]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 13 18:08:24.727992 dv-cinder-852009-8-iscsi devstack@n-api.service[120741]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 13 18:08:24.727992 dv-cinder-852009-8-iscsi devstack@n-api.service[120741]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete Sep 13 18:08:24.727992 dv-cinder-852009-8-iscsi devstack@n-api.service[120741]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) Sep 13 18:08:24.727992 dv-cinder-852009-8-iscsi devstack@n-api.service[120741]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete Sep 13 18:08:24.727992 dv-cinder-852009-8-iscsi devstack@n-api.service[120741]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) Sep 13 18:08:24.727992 dv-cinder-852009-8-iscsi devstack@n-api.service[120741]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Sep 13 18:08:24.727992 dv-cinder-852009-8-iscsi devstack@n-api.service[120741]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Sep 13 18:08:24.727992 dv-cinder-852009-8-iscsi devstack@n-api.service[120741]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Sep 13 18:08:24.727992 dv-cinder-852009-8-iscsi devstack@n-api.service[120741]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Sep 13 18:08:24.727992 dv-cinder-852009-8-iscsi devstack@n-api.service[120741]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 8cecf08e-bea8-4cef-9439-0eaa242bfed1 could not be found. Sep 13 18:08:24.727992 dv-cinder-852009-8-iscsi devstack@n-api.service[120741]: ERROR nova.api.openstack.wsgi Sep 13 18:08:24.727992 dv-cinder-852009-8-iscsi devstack@n-api.service[120741]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 13 18:08:24.727992 dv-cinder-852009-8-iscsi devstack@n-api.service[120741]: ERROR nova.api.openstack.wsgi Sep 13 18:08:24.727992 dv-cinder-852009-8-iscsi devstack@n-api.service[120741]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 13 18:08:24.727992 dv-cinder-852009-8-iscsi devstack@n-api.service[120741]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 13 18:08:24.727992 dv-cinder-852009-8-iscsi devstack@n-api.service[120741]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 13 18:08:24.727992 dv-cinder-852009-8-iscsi devstack@n-api.service[120741]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 13 18:08:24.727992 dv-cinder-852009-8-iscsi devstack@n-api.service[120741]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 13 18:08:24.727992 dv-cinder-852009-8-iscsi devstack@n-api.service[120741]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 8cecf08e-bea8-4cef-9439-0eaa242bfed1 could not be found. Sep 13 18:08:24.727992 dv-cinder-852009-8-iscsi devstack@n-api.service[120741]: ERROR nova.api.openstack.wsgi Sep 13 18:08:24.729239 dv-cinder-852009-8-iscsi devstack@n-api.service[120741]: DEBUG nova.api.openstack.wsgi [None req-eca2d1ee-a19a-485f-a89a-d4794431e460 tempest-AttachVolumeShelveTestJSON-385853788 tempest-AttachVolumeShelveTestJSON-385853788-project] Returning 404 to user: Instance 8cecf08e-bea8-4cef-9439-0eaa242bfed1 could not be found. {{(pid=120741) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 13 18:08:24.729239 dv-cinder-852009-8-iscsi devstack@n-api.service[120741]: INFO nova.api.openstack.requestlog [None req-eca2d1ee-a19a-485f-a89a-d4794431e460 tempest-AttachVolumeShelveTestJSON-385853788 tempest-AttachVolumeShelveTestJSON-385853788-project] 10.222.0.43 "DELETE /compute/v2.1/servers/8cecf08e-bea8-4cef-9439-0eaa242bfed1" status: 404 len: 111 microversion: 2.20 time: 0.031115 Sep 13 18:08:24.729239 dv-cinder-852009-8-iscsi devstack@n-api.service[120741]: [pid: 120741|app: 0|req: 352/712] 10.222.0.43 () {60 vars in 1280 bytes} [Tue Sep 13 18:08:24 2022] DELETE /compute/v2.1/servers/8cecf08e-bea8-4cef-9439-0eaa242bfed1 => generated 111 bytes in 32 msecs (HTTP/1.1 404) 9 headers in 381 bytes (1 switches on core 0) Sep 13 18:08:24.737711 dv-cinder-852009-8-iscsi devstack@n-api.service[120740]: DEBUG nova.api.openstack.wsgi [None req-059ba83b-559a-4c41-a2ff-9929fa03983e tempest-AttachVolumeShelveTestJSON-385853788 tempest-AttachVolumeShelveTestJSON-385853788-project] Calling method '>' {{(pid=120740) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 18:08:24.738094 dv-cinder-852009-8-iscsi devstack@n-api.service[120740]: DEBUG nova.compute.api [None req-059ba83b-559a-4c41-a2ff-9929fa03983e tempest-AttachVolumeShelveTestJSON-385853788 tempest-AttachVolumeShelveTestJSON-385853788-project] [instance: 8cecf08e-bea8-4cef-9439-0eaa242bfed1] Fetching instance by UUID {{(pid=120740) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 18:08:24.744455 dv-cinder-852009-8-iscsi devstack@n-api.service[120740]: DEBUG oslo_concurrency.lockutils [None req-059ba83b-559a-4c41-a2ff-9929fa03983e tempest-AttachVolumeShelveTestJSON-385853788 tempest-AttachVolumeShelveTestJSON-385853788-project] Acquiring lock "1daf4f4c-0e4a-4779-b53a-78c48397ea2f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120740) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 18:08:24.744952 dv-cinder-852009-8-iscsi devstack@n-api.service[120740]: DEBUG oslo_concurrency.lockutils [None req-059ba83b-559a-4c41-a2ff-9929fa03983e tempest-AttachVolumeShelveTestJSON-385853788 tempest-AttachVolumeShelveTestJSON-385853788-project] Lock "1daf4f4c-0e4a-4779-b53a-78c48397ea2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120740) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 18:08:24.745376 dv-cinder-852009-8-iscsi devstack@n-api.service[120740]: DEBUG oslo_concurrency.lockutils [None req-059ba83b-559a-4c41-a2ff-9929fa03983e tempest-AttachVolumeShelveTestJSON-385853788 tempest-AttachVolumeShelveTestJSON-385853788-project] Lock "1daf4f4c-0e4a-4779-b53a-78c48397ea2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120740) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 18:08:24.746117 dv-cinder-852009-8-iscsi devstack@n-api.service[120740]: DEBUG oslo_concurrency.lockutils [None req-059ba83b-559a-4c41-a2ff-9929fa03983e tempest-AttachVolumeShelveTestJSON-385853788 tempest-AttachVolumeShelveTestJSON-385853788-project] Acquiring lock "1daf4f4c-0e4a-4779-b53a-78c48397ea2f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120740) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 18:08:24.746563 dv-cinder-852009-8-iscsi devstack@n-api.service[120740]: DEBUG oslo_concurrency.lockutils [None req-059ba83b-559a-4c41-a2ff-9929fa03983e tempest-AttachVolumeShelveTestJSON-385853788 tempest-AttachVolumeShelveTestJSON-385853788-project] Lock "1daf4f4c-0e4a-4779-b53a-78c48397ea2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120740) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 18:08:24.746975 dv-cinder-852009-8-iscsi devstack@n-api.service[120740]: DEBUG oslo_concurrency.lockutils [None req-059ba83b-559a-4c41-a2ff-9929fa03983e tempest-AttachVolumeShelveTestJSON-385853788 tempest-AttachVolumeShelveTestJSON-385853788-project] Lock "1daf4f4c-0e4a-4779-b53a-78c48397ea2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120740) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 18:08:24.760772 dv-cinder-852009-8-iscsi devstack@n-api.service[120740]: INFO nova.api.openstack.wsgi [None req-059ba83b-559a-4c41-a2ff-9929fa03983e tempest-AttachVolumeShelveTestJSON-385853788 tempest-AttachVolumeShelveTestJSON-385853788-project] HTTP exception thrown: Instance 8cecf08e-bea8-4cef-9439-0eaa242bfed1 could not be found. Sep 13 18:08:24.762442 dv-cinder-852009-8-iscsi devstack@n-api.service[120740]: DEBUG nova.api.openstack.wsgi [None req-059ba83b-559a-4c41-a2ff-9929fa03983e tempest-AttachVolumeShelveTestJSON-385853788 tempest-AttachVolumeShelveTestJSON-385853788-project] Request method failure captured: Sep 13 18:08:24.762442 dv-cinder-852009-8-iscsi devstack@n-api.service[120740]: request: GET /compute/v2.1/servers/8cecf08e-bea8-4cef-9439-0eaa242bfed1 HTTP/1.1 Sep 13 18:08:24.762442 dv-cinder-852009-8-iscsi devstack@n-api.service[120740]: Accept: application/json Sep 13 18:08:24.762442 dv-cinder-852009-8-iscsi devstack@n-api.service[120740]: Accept-Encoding: identity Sep 13 18:08:24.762442 dv-cinder-852009-8-iscsi devstack@n-api.service[120740]: Connection: close Sep 13 18:08:24.762442 dv-cinder-852009-8-iscsi devstack@n-api.service[120740]: Content-Length: 0 Sep 13 18:08:24.762442 dv-cinder-852009-8-iscsi devstack@n-api.service[120740]: Content-Type: application/json Sep 13 18:08:24.762442 dv-cinder-852009-8-iscsi devstack@n-api.service[120740]: Host: 10.222.0.43 Sep 13 18:08:24.762442 dv-cinder-852009-8-iscsi devstack@n-api.service[120740]: Openstack-System-Scope: None Sep 13 18:08:24.762442 dv-cinder-852009-8-iscsi devstack@n-api.service[120740]: User-Agent: python-urllib3/1.26.12 Sep 13 18:08:24.762442 dv-cinder-852009-8-iscsi devstack@n-api.service[120740]: X-Auth-Token: gAAAAABjIMWMYqPVtf0Rs9jRF4xl1KD9-SjO_FS4g579Cc1gUdbkqCtXPDYdTxBMbLmZqtgmWQubM-SSNfaWwXS4FDzkQIkG_6wttMeObykV4FtQQ2VkVt80Xzr2XOrB1n0hRb-cwFsutvG_3Oz7IRpcKn9EZa84Z-Ec1SHW4W3F55A21YEi9KQ Sep 13 18:08:24.762442 dv-cinder-852009-8-iscsi devstack@n-api.service[120740]: X-Domain-Id: None Sep 13 18:08:24.762442 dv-cinder-852009-8-iscsi devstack@n-api.service[120740]: X-Domain-Name: None Sep 13 18:08:24.762442 dv-cinder-852009-8-iscsi devstack@n-api.service[120740]: X-Identity-Status: Confirmed Sep 13 18:08:24.762442 dv-cinder-852009-8-iscsi devstack@n-api.service[120740]: X-Is-Admin-Project: True Sep 13 18:08:24.762442 dv-cinder-852009-8-iscsi devstack@n-api.service[120740]: X-Openstack-Nova-Api-Version: 2.20 Sep 13 18:08:24.762442 dv-cinder-852009-8-iscsi devstack@n-api.service[120740]: X-Project-Domain-Id: default Sep 13 18:08:24.762442 dv-cinder-852009-8-iscsi devstack@n-api.service[120740]: X-Project-Domain-Name: Default Sep 13 18:08:24.762442 dv-cinder-852009-8-iscsi devstack@n-api.service[120740]: X-Project-Id: 75e14fd88bfb4cd896fa7b070a0fac47 Sep 13 18:08:24.762442 dv-cinder-852009-8-iscsi devstack@n-api.service[120740]: X-Project-Name: tempest-AttachVolumeShelveTestJSON-385853788 Sep 13 18:08:24.762442 dv-cinder-852009-8-iscsi devstack@n-api.service[120740]: X-Role: reader,member Sep 13 18:08:24.762442 dv-cinder-852009-8-iscsi devstack@n-api.service[120740]: X-Roles: reader,member Sep 13 18:08:24.764111 dv-cinder-852009-8-iscsi devstack@n-api.service[120740]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/identity"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/compute/v2/75e14fd88bfb4cd896fa7b070a0fac47"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.43:8080", "publicURL": "http://10.222.0.43:8080/v1/AUTH_75e14fd88bfb4cd896fa7b070a0fac47"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43:9696/networking"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/volume/v3/75e14fd88bfb4cd896fa7b070a0fac47"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/compute/v2.1"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/placement"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/volume/v3/75e14fd88bfb4cd896fa7b070a0fac47"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/image"}]}] Sep 13 18:08:24.764111 dv-cinder-852009-8-iscsi devstack@n-api.service[120740]: X-Tenant: tempest-AttachVolumeShelveTestJSON-385853788 Sep 13 18:08:24.764111 dv-cinder-852009-8-iscsi devstack@n-api.service[120740]: X-Tenant-Id: 75e14fd88bfb4cd896fa7b070a0fac47 Sep 13 18:08:24.764111 dv-cinder-852009-8-iscsi devstack@n-api.service[120740]: X-Tenant-Name: tempest-AttachVolumeShelveTestJSON-385853788 Sep 13 18:08:24.764111 dv-cinder-852009-8-iscsi devstack@n-api.service[120740]: X-User: tempest-AttachVolumeShelveTestJSON-385853788-project Sep 13 18:08:24.764111 dv-cinder-852009-8-iscsi devstack@n-api.service[120740]: X-User-Domain-Id: default Sep 13 18:08:24.764111 dv-cinder-852009-8-iscsi devstack@n-api.service[120740]: X-User-Domain-Name: Default Sep 13 18:08:24.764111 dv-cinder-852009-8-iscsi devstack@n-api.service[120740]: X-User-Id: e68ecd9b3ca643539b109f75bb242d6f Sep 13 18:08:24.764111 dv-cinder-852009-8-iscsi devstack@n-api.service[120740]: X-User-Name: tempest-AttachVolumeShelveTestJSON-385853788-project Sep 13 18:08:24.764111 dv-cinder-852009-8-iscsi devstack@n-api.service[120740]: method: > Sep 13 18:08:24.764111 dv-cinder-852009-8-iscsi devstack@n-api.service[120740]: exception: Instance 8cecf08e-bea8-4cef-9439-0eaa242bfed1 could not be found. Sep 13 18:08:24.764111 dv-cinder-852009-8-iscsi devstack@n-api.service[120740]: action_args: {'id': '8cecf08e-bea8-4cef-9439-0eaa242bfed1'} Sep 13 18:08:24.764987 dv-cinder-852009-8-iscsi devstack@n-api.service[120740]: {{(pid=120740) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 13 18:08:24.764987 dv-cinder-852009-8-iscsi devstack@n-api.service[120740]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 13 18:08:24.764987 dv-cinder-852009-8-iscsi devstack@n-api.service[120740]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Sep 13 18:08:24.764987 dv-cinder-852009-8-iscsi devstack@n-api.service[120740]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Sep 13 18:08:24.764987 dv-cinder-852009-8-iscsi devstack@n-api.service[120740]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Sep 13 18:08:24.764987 dv-cinder-852009-8-iscsi devstack@n-api.service[120740]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Sep 13 18:08:24.764987 dv-cinder-852009-8-iscsi devstack@n-api.service[120740]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Sep 13 18:08:24.764987 dv-cinder-852009-8-iscsi devstack@n-api.service[120740]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Sep 13 18:08:24.764987 dv-cinder-852009-8-iscsi devstack@n-api.service[120740]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Sep 13 18:08:24.764987 dv-cinder-852009-8-iscsi devstack@n-api.service[120740]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Sep 13 18:08:24.764987 dv-cinder-852009-8-iscsi devstack@n-api.service[120740]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 8cecf08e-bea8-4cef-9439-0eaa242bfed1 could not be found. Sep 13 18:08:24.764987 dv-cinder-852009-8-iscsi devstack@n-api.service[120740]: ERROR nova.api.openstack.wsgi Sep 13 18:08:24.764987 dv-cinder-852009-8-iscsi devstack@n-api.service[120740]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 13 18:08:24.764987 dv-cinder-852009-8-iscsi devstack@n-api.service[120740]: ERROR nova.api.openstack.wsgi Sep 13 18:08:24.764987 dv-cinder-852009-8-iscsi devstack@n-api.service[120740]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 13 18:08:24.764987 dv-cinder-852009-8-iscsi devstack@n-api.service[120740]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 13 18:08:24.764987 dv-cinder-852009-8-iscsi devstack@n-api.service[120740]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 13 18:08:24.764987 dv-cinder-852009-8-iscsi devstack@n-api.service[120740]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 13 18:08:24.764987 dv-cinder-852009-8-iscsi devstack@n-api.service[120740]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 13 18:08:24.764987 dv-cinder-852009-8-iscsi devstack@n-api.service[120740]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 13 18:08:24.766191 dv-cinder-852009-8-iscsi devstack@n-api.service[120740]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 13 18:08:24.766191 dv-cinder-852009-8-iscsi devstack@n-api.service[120740]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Sep 13 18:08:24.766191 dv-cinder-852009-8-iscsi devstack@n-api.service[120740]: ERROR nova.api.openstack.wsgi instance = self._get_server( Sep 13 18:08:24.766191 dv-cinder-852009-8-iscsi devstack@n-api.service[120740]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Sep 13 18:08:24.766191 dv-cinder-852009-8-iscsi devstack@n-api.service[120740]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Sep 13 18:08:24.766191 dv-cinder-852009-8-iscsi devstack@n-api.service[120740]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Sep 13 18:08:24.766191 dv-cinder-852009-8-iscsi devstack@n-api.service[120740]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Sep 13 18:08:24.766191 dv-cinder-852009-8-iscsi devstack@n-api.service[120740]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 8cecf08e-bea8-4cef-9439-0eaa242bfed1 could not be found. Sep 13 18:08:24.766191 dv-cinder-852009-8-iscsi devstack@n-api.service[120740]: ERROR nova.api.openstack.wsgi Sep 13 18:08:24.766191 dv-cinder-852009-8-iscsi devstack@n-api.service[120740]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 13 18:08:24.766191 dv-cinder-852009-8-iscsi devstack@n-api.service[120740]: ERROR nova.api.openstack.wsgi Sep 13 18:08:24.766191 dv-cinder-852009-8-iscsi devstack@n-api.service[120740]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 13 18:08:24.766191 dv-cinder-852009-8-iscsi devstack@n-api.service[120740]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 13 18:08:24.766191 dv-cinder-852009-8-iscsi devstack@n-api.service[120740]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 13 18:08:24.766191 dv-cinder-852009-8-iscsi devstack@n-api.service[120740]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 13 18:08:24.766191 dv-cinder-852009-8-iscsi devstack@n-api.service[120740]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 13 18:08:24.766191 dv-cinder-852009-8-iscsi devstack@n-api.service[120740]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 8cecf08e-bea8-4cef-9439-0eaa242bfed1 could not be found. Sep 13 18:08:24.766191 dv-cinder-852009-8-iscsi devstack@n-api.service[120740]: ERROR nova.api.openstack.wsgi Sep 13 18:08:24.767357 dv-cinder-852009-8-iscsi devstack@n-api.service[120740]: DEBUG nova.api.openstack.wsgi [None req-059ba83b-559a-4c41-a2ff-9929fa03983e tempest-AttachVolumeShelveTestJSON-385853788 tempest-AttachVolumeShelveTestJSON-385853788-project] Returning 404 to user: Instance 8cecf08e-bea8-4cef-9439-0eaa242bfed1 could not be found. {{(pid=120740) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 13 18:08:24.767357 dv-cinder-852009-8-iscsi devstack@n-api.service[120740]: INFO nova.api.openstack.requestlog [None req-059ba83b-559a-4c41-a2ff-9929fa03983e tempest-AttachVolumeShelveTestJSON-385853788 tempest-AttachVolumeShelveTestJSON-385853788-project] 10.222.0.43 "GET /compute/v2.1/servers/8cecf08e-bea8-4cef-9439-0eaa242bfed1" status: 404 len: 111 microversion: 2.20 time: 0.033321 Sep 13 18:08:24.767357 dv-cinder-852009-8-iscsi devstack@n-api.service[120740]: [pid: 120740|app: 0|req: 361/713] 10.222.0.43 () {60 vars in 1277 bytes} [Tue Sep 13 18:08:24 2022] GET /compute/v2.1/servers/8cecf08e-bea8-4cef-9439-0eaa242bfed1 => generated 111 bytes in 35 msecs (HTTP/1.1 404) 9 headers in 381 bytes (1 switches on core 0) Sep 13 18:08:25.919409 dv-cinder-852009-8-iscsi devstack@n-api.service[120741]: DEBUG nova.api.openstack.wsgi [None req-2230baaf-ab04-41ca-bb7f-af3cab0326c7 tempest-AttachVolumeShelveTestJSON-385853788 tempest-AttachVolumeShelveTestJSON-385853788-project] Calling method '>' {{(pid=120741) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 18:08:25.919905 dv-cinder-852009-8-iscsi devstack@n-api.service[120741]: DEBUG nova.compute.api [None req-2230baaf-ab04-41ca-bb7f-af3cab0326c7 tempest-AttachVolumeShelveTestJSON-385853788 tempest-AttachVolumeShelveTestJSON-385853788-project] [instance: 11d2616a-96f9-4a7a-aab8-219219986a8b] Fetching instance by UUID {{(pid=120741) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 18:08:25.926609 dv-cinder-852009-8-iscsi devstack@n-api.service[120741]: DEBUG oslo_concurrency.lockutils [None req-2230baaf-ab04-41ca-bb7f-af3cab0326c7 tempest-AttachVolumeShelveTestJSON-385853788 tempest-AttachVolumeShelveTestJSON-385853788-project] Acquiring lock "1daf4f4c-0e4a-4779-b53a-78c48397ea2f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120741) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 18:08:25.927094 dv-cinder-852009-8-iscsi devstack@n-api.service[120741]: DEBUG oslo_concurrency.lockutils [None req-2230baaf-ab04-41ca-bb7f-af3cab0326c7 tempest-AttachVolumeShelveTestJSON-385853788 tempest-AttachVolumeShelveTestJSON-385853788-project] Lock "1daf4f4c-0e4a-4779-b53a-78c48397ea2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120741) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 18:08:25.927532 dv-cinder-852009-8-iscsi devstack@n-api.service[120741]: DEBUG oslo_concurrency.lockutils [None req-2230baaf-ab04-41ca-bb7f-af3cab0326c7 tempest-AttachVolumeShelveTestJSON-385853788 tempest-AttachVolumeShelveTestJSON-385853788-project] Lock "1daf4f4c-0e4a-4779-b53a-78c48397ea2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120741) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 18:08:25.928253 dv-cinder-852009-8-iscsi devstack@n-api.service[120741]: DEBUG oslo_concurrency.lockutils [None req-2230baaf-ab04-41ca-bb7f-af3cab0326c7 tempest-AttachVolumeShelveTestJSON-385853788 tempest-AttachVolumeShelveTestJSON-385853788-project] Acquiring lock "1daf4f4c-0e4a-4779-b53a-78c48397ea2f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120741) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 18:08:25.928759 dv-cinder-852009-8-iscsi devstack@n-api.service[120741]: DEBUG oslo_concurrency.lockutils [None req-2230baaf-ab04-41ca-bb7f-af3cab0326c7 tempest-AttachVolumeShelveTestJSON-385853788 tempest-AttachVolumeShelveTestJSON-385853788-project] Lock "1daf4f4c-0e4a-4779-b53a-78c48397ea2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120741) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 18:08:25.929173 dv-cinder-852009-8-iscsi devstack@n-api.service[120741]: DEBUG oslo_concurrency.lockutils [None req-2230baaf-ab04-41ca-bb7f-af3cab0326c7 tempest-AttachVolumeShelveTestJSON-385853788 tempest-AttachVolumeShelveTestJSON-385853788-project] Lock "1daf4f4c-0e4a-4779-b53a-78c48397ea2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120741) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 18:08:25.942948 dv-cinder-852009-8-iscsi devstack@n-api.service[120741]: INFO nova.api.openstack.wsgi [None req-2230baaf-ab04-41ca-bb7f-af3cab0326c7 tempest-AttachVolumeShelveTestJSON-385853788 tempest-AttachVolumeShelveTestJSON-385853788-project] HTTP exception thrown: Instance 11d2616a-96f9-4a7a-aab8-219219986a8b could not be found. Sep 13 18:08:25.944534 dv-cinder-852009-8-iscsi devstack@n-api.service[120741]: DEBUG nova.api.openstack.wsgi [None req-2230baaf-ab04-41ca-bb7f-af3cab0326c7 tempest-AttachVolumeShelveTestJSON-385853788 tempest-AttachVolumeShelveTestJSON-385853788-project] Request method failure captured: Sep 13 18:08:25.944534 dv-cinder-852009-8-iscsi devstack@n-api.service[120741]: request: DELETE /compute/v2.1/servers/11d2616a-96f9-4a7a-aab8-219219986a8b HTTP/1.1 Sep 13 18:08:25.944534 dv-cinder-852009-8-iscsi devstack@n-api.service[120741]: Accept: application/json Sep 13 18:08:25.944534 dv-cinder-852009-8-iscsi devstack@n-api.service[120741]: Accept-Encoding: identity Sep 13 18:08:25.944534 dv-cinder-852009-8-iscsi devstack@n-api.service[120741]: Connection: close Sep 13 18:08:25.944534 dv-cinder-852009-8-iscsi devstack@n-api.service[120741]: Content-Length: 0 Sep 13 18:08:25.944534 dv-cinder-852009-8-iscsi devstack@n-api.service[120741]: Content-Type: application/json Sep 13 18:08:25.944534 dv-cinder-852009-8-iscsi devstack@n-api.service[120741]: Host: 10.222.0.43 Sep 13 18:08:25.944534 dv-cinder-852009-8-iscsi devstack@n-api.service[120741]: Openstack-System-Scope: None Sep 13 18:08:25.944534 dv-cinder-852009-8-iscsi devstack@n-api.service[120741]: User-Agent: python-urllib3/1.26.12 Sep 13 18:08:25.944534 dv-cinder-852009-8-iscsi devstack@n-api.service[120741]: X-Auth-Token: gAAAAABjIMWMYqPVtf0Rs9jRF4xl1KD9-SjO_FS4g579Cc1gUdbkqCtXPDYdTxBMbLmZqtgmWQubM-SSNfaWwXS4FDzkQIkG_6wttMeObykV4FtQQ2VkVt80Xzr2XOrB1n0hRb-cwFsutvG_3Oz7IRpcKn9EZa84Z-Ec1SHW4W3F55A21YEi9KQ Sep 13 18:08:25.944534 dv-cinder-852009-8-iscsi devstack@n-api.service[120741]: X-Domain-Id: None Sep 13 18:08:25.944534 dv-cinder-852009-8-iscsi devstack@n-api.service[120741]: X-Domain-Name: None Sep 13 18:08:25.944534 dv-cinder-852009-8-iscsi devstack@n-api.service[120741]: X-Identity-Status: Confirmed Sep 13 18:08:25.944534 dv-cinder-852009-8-iscsi devstack@n-api.service[120741]: X-Is-Admin-Project: True Sep 13 18:08:25.944534 dv-cinder-852009-8-iscsi devstack@n-api.service[120741]: X-Openstack-Nova-Api-Version: 2.20 Sep 13 18:08:25.944534 dv-cinder-852009-8-iscsi devstack@n-api.service[120741]: X-Project-Domain-Id: default Sep 13 18:08:25.944534 dv-cinder-852009-8-iscsi devstack@n-api.service[120741]: X-Project-Domain-Name: Default Sep 13 18:08:25.944534 dv-cinder-852009-8-iscsi devstack@n-api.service[120741]: X-Project-Id: 75e14fd88bfb4cd896fa7b070a0fac47 Sep 13 18:08:25.944534 dv-cinder-852009-8-iscsi devstack@n-api.service[120741]: X-Project-Name: tempest-AttachVolumeShelveTestJSON-385853788 Sep 13 18:08:25.944534 dv-cinder-852009-8-iscsi devstack@n-api.service[120741]: X-Role: reader,member Sep 13 18:08:25.944534 dv-cinder-852009-8-iscsi devstack@n-api.service[120741]: X-Roles: reader,member Sep 13 18:08:25.946158 dv-cinder-852009-8-iscsi devstack@n-api.service[120741]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/identity"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/compute/v2/75e14fd88bfb4cd896fa7b070a0fac47"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.43:8080", "publicURL": "http://10.222.0.43:8080/v1/AUTH_75e14fd88bfb4cd896fa7b070a0fac47"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43:9696/networking"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/volume/v3/75e14fd88bfb4cd896fa7b070a0fac47"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/compute/v2.1"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/placement"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/volume/v3/75e14fd88bfb4cd896fa7b070a0fac47"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/image"}]}] Sep 13 18:08:25.946158 dv-cinder-852009-8-iscsi devstack@n-api.service[120741]: X-Tenant: tempest-AttachVolumeShelveTestJSON-385853788 Sep 13 18:08:25.946158 dv-cinder-852009-8-iscsi devstack@n-api.service[120741]: X-Tenant-Id: 75e14fd88bfb4cd896fa7b070a0fac47 Sep 13 18:08:25.946158 dv-cinder-852009-8-iscsi devstack@n-api.service[120741]: X-Tenant-Name: tempest-AttachVolumeShelveTestJSON-385853788 Sep 13 18:08:25.946158 dv-cinder-852009-8-iscsi devstack@n-api.service[120741]: X-User: tempest-AttachVolumeShelveTestJSON-385853788-project Sep 13 18:08:25.946158 dv-cinder-852009-8-iscsi devstack@n-api.service[120741]: X-User-Domain-Id: default Sep 13 18:08:25.946158 dv-cinder-852009-8-iscsi devstack@n-api.service[120741]: X-User-Domain-Name: Default Sep 13 18:08:25.946158 dv-cinder-852009-8-iscsi devstack@n-api.service[120741]: X-User-Id: e68ecd9b3ca643539b109f75bb242d6f Sep 13 18:08:25.946158 dv-cinder-852009-8-iscsi devstack@n-api.service[120741]: X-User-Name: tempest-AttachVolumeShelveTestJSON-385853788-project Sep 13 18:08:25.946158 dv-cinder-852009-8-iscsi devstack@n-api.service[120741]: method: > Sep 13 18:08:25.946158 dv-cinder-852009-8-iscsi devstack@n-api.service[120741]: exception: Instance 11d2616a-96f9-4a7a-aab8-219219986a8b could not be found. Sep 13 18:08:25.946158 dv-cinder-852009-8-iscsi devstack@n-api.service[120741]: action_args: {'id': '11d2616a-96f9-4a7a-aab8-219219986a8b'} Sep 13 18:08:25.947703 dv-cinder-852009-8-iscsi devstack@n-api.service[120741]: {{(pid=120741) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 13 18:08:25.947703 dv-cinder-852009-8-iscsi devstack@n-api.service[120741]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 13 18:08:25.947703 dv-cinder-852009-8-iscsi devstack@n-api.service[120741]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Sep 13 18:08:25.947703 dv-cinder-852009-8-iscsi devstack@n-api.service[120741]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Sep 13 18:08:25.947703 dv-cinder-852009-8-iscsi devstack@n-api.service[120741]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Sep 13 18:08:25.947703 dv-cinder-852009-8-iscsi devstack@n-api.service[120741]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Sep 13 18:08:25.947703 dv-cinder-852009-8-iscsi devstack@n-api.service[120741]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Sep 13 18:08:25.947703 dv-cinder-852009-8-iscsi devstack@n-api.service[120741]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Sep 13 18:08:25.947703 dv-cinder-852009-8-iscsi devstack@n-api.service[120741]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Sep 13 18:08:25.947703 dv-cinder-852009-8-iscsi devstack@n-api.service[120741]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Sep 13 18:08:25.947703 dv-cinder-852009-8-iscsi devstack@n-api.service[120741]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 11d2616a-96f9-4a7a-aab8-219219986a8b could not be found. Sep 13 18:08:25.947703 dv-cinder-852009-8-iscsi devstack@n-api.service[120741]: ERROR nova.api.openstack.wsgi Sep 13 18:08:25.947703 dv-cinder-852009-8-iscsi devstack@n-api.service[120741]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 13 18:08:25.947703 dv-cinder-852009-8-iscsi devstack@n-api.service[120741]: ERROR nova.api.openstack.wsgi Sep 13 18:08:25.947703 dv-cinder-852009-8-iscsi devstack@n-api.service[120741]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 13 18:08:25.947703 dv-cinder-852009-8-iscsi devstack@n-api.service[120741]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 13 18:08:25.947703 dv-cinder-852009-8-iscsi devstack@n-api.service[120741]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 13 18:08:25.947703 dv-cinder-852009-8-iscsi devstack@n-api.service[120741]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 13 18:08:25.947703 dv-cinder-852009-8-iscsi devstack@n-api.service[120741]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 13 18:08:25.947703 dv-cinder-852009-8-iscsi devstack@n-api.service[120741]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 13 18:08:25.949769 dv-cinder-852009-8-iscsi devstack@n-api.service[120741]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 13 18:08:25.949769 dv-cinder-852009-8-iscsi devstack@n-api.service[120741]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete Sep 13 18:08:25.949769 dv-cinder-852009-8-iscsi devstack@n-api.service[120741]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) Sep 13 18:08:25.949769 dv-cinder-852009-8-iscsi devstack@n-api.service[120741]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete Sep 13 18:08:25.949769 dv-cinder-852009-8-iscsi devstack@n-api.service[120741]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) Sep 13 18:08:25.949769 dv-cinder-852009-8-iscsi devstack@n-api.service[120741]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Sep 13 18:08:25.949769 dv-cinder-852009-8-iscsi devstack@n-api.service[120741]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Sep 13 18:08:25.949769 dv-cinder-852009-8-iscsi devstack@n-api.service[120741]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Sep 13 18:08:25.949769 dv-cinder-852009-8-iscsi devstack@n-api.service[120741]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Sep 13 18:08:25.949769 dv-cinder-852009-8-iscsi devstack@n-api.service[120741]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 11d2616a-96f9-4a7a-aab8-219219986a8b could not be found. Sep 13 18:08:25.949769 dv-cinder-852009-8-iscsi devstack@n-api.service[120741]: ERROR nova.api.openstack.wsgi Sep 13 18:08:25.949769 dv-cinder-852009-8-iscsi devstack@n-api.service[120741]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 13 18:08:25.949769 dv-cinder-852009-8-iscsi devstack@n-api.service[120741]: ERROR nova.api.openstack.wsgi Sep 13 18:08:25.949769 dv-cinder-852009-8-iscsi devstack@n-api.service[120741]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 13 18:08:25.949769 dv-cinder-852009-8-iscsi devstack@n-api.service[120741]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 13 18:08:25.949769 dv-cinder-852009-8-iscsi devstack@n-api.service[120741]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 13 18:08:25.949769 dv-cinder-852009-8-iscsi devstack@n-api.service[120741]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 13 18:08:25.949769 dv-cinder-852009-8-iscsi devstack@n-api.service[120741]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 13 18:08:25.949769 dv-cinder-852009-8-iscsi devstack@n-api.service[120741]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 11d2616a-96f9-4a7a-aab8-219219986a8b could not be found. Sep 13 18:08:25.949769 dv-cinder-852009-8-iscsi devstack@n-api.service[120741]: ERROR nova.api.openstack.wsgi Sep 13 18:08:25.951463 dv-cinder-852009-8-iscsi devstack@n-api.service[120741]: DEBUG nova.api.openstack.wsgi [None req-2230baaf-ab04-41ca-bb7f-af3cab0326c7 tempest-AttachVolumeShelveTestJSON-385853788 tempest-AttachVolumeShelveTestJSON-385853788-project] Returning 404 to user: Instance 11d2616a-96f9-4a7a-aab8-219219986a8b could not be found. {{(pid=120741) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 13 18:08:25.951463 dv-cinder-852009-8-iscsi devstack@n-api.service[120741]: INFO nova.api.openstack.requestlog [None req-2230baaf-ab04-41ca-bb7f-af3cab0326c7 tempest-AttachVolumeShelveTestJSON-385853788 tempest-AttachVolumeShelveTestJSON-385853788-project] 10.222.0.43 "DELETE /compute/v2.1/servers/11d2616a-96f9-4a7a-aab8-219219986a8b" status: 404 len: 111 microversion: 2.20 time: 0.030473 Sep 13 18:08:25.951463 dv-cinder-852009-8-iscsi devstack@n-api.service[120741]: [pid: 120741|app: 0|req: 353/714] 10.222.0.43 () {60 vars in 1280 bytes} [Tue Sep 13 18:08:25 2022] DELETE /compute/v2.1/servers/11d2616a-96f9-4a7a-aab8-219219986a8b => generated 111 bytes in 31 msecs (HTTP/1.1 404) 9 headers in 381 bytes (1 switches on core 0) Sep 13 18:08:25.956938 dv-cinder-852009-8-iscsi devstack@n-api.service[120740]: DEBUG nova.api.openstack.wsgi [None req-cd2effb0-7322-41c0-95ac-a93e581766f6 tempest-AttachVolumeShelveTestJSON-385853788 tempest-AttachVolumeShelveTestJSON-385853788-project] Calling method '>' {{(pid=120740) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 18:08:25.957548 dv-cinder-852009-8-iscsi devstack@n-api.service[120740]: DEBUG nova.compute.api [None req-cd2effb0-7322-41c0-95ac-a93e581766f6 tempest-AttachVolumeShelveTestJSON-385853788 tempest-AttachVolumeShelveTestJSON-385853788-project] [instance: 11d2616a-96f9-4a7a-aab8-219219986a8b] Fetching instance by UUID {{(pid=120740) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 18:08:25.963933 dv-cinder-852009-8-iscsi devstack@n-api.service[120740]: DEBUG oslo_concurrency.lockutils [None req-cd2effb0-7322-41c0-95ac-a93e581766f6 tempest-AttachVolumeShelveTestJSON-385853788 tempest-AttachVolumeShelveTestJSON-385853788-project] Acquiring lock "1daf4f4c-0e4a-4779-b53a-78c48397ea2f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120740) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 18:08:25.964448 dv-cinder-852009-8-iscsi devstack@n-api.service[120740]: DEBUG oslo_concurrency.lockutils [None req-cd2effb0-7322-41c0-95ac-a93e581766f6 tempest-AttachVolumeShelveTestJSON-385853788 tempest-AttachVolumeShelveTestJSON-385853788-project] Lock "1daf4f4c-0e4a-4779-b53a-78c48397ea2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120740) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 18:08:25.964877 dv-cinder-852009-8-iscsi devstack@n-api.service[120740]: DEBUG oslo_concurrency.lockutils [None req-cd2effb0-7322-41c0-95ac-a93e581766f6 tempest-AttachVolumeShelveTestJSON-385853788 tempest-AttachVolumeShelveTestJSON-385853788-project] Lock "1daf4f4c-0e4a-4779-b53a-78c48397ea2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120740) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 18:08:25.965567 dv-cinder-852009-8-iscsi devstack@n-api.service[120740]: DEBUG oslo_concurrency.lockutils [None req-cd2effb0-7322-41c0-95ac-a93e581766f6 tempest-AttachVolumeShelveTestJSON-385853788 tempest-AttachVolumeShelveTestJSON-385853788-project] Acquiring lock "1daf4f4c-0e4a-4779-b53a-78c48397ea2f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120740) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 18:08:25.966016 dv-cinder-852009-8-iscsi devstack@n-api.service[120740]: DEBUG oslo_concurrency.lockutils [None req-cd2effb0-7322-41c0-95ac-a93e581766f6 tempest-AttachVolumeShelveTestJSON-385853788 tempest-AttachVolumeShelveTestJSON-385853788-project] Lock "1daf4f4c-0e4a-4779-b53a-78c48397ea2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120740) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 18:08:25.966433 dv-cinder-852009-8-iscsi devstack@n-api.service[120740]: DEBUG oslo_concurrency.lockutils [None req-cd2effb0-7322-41c0-95ac-a93e581766f6 tempest-AttachVolumeShelveTestJSON-385853788 tempest-AttachVolumeShelveTestJSON-385853788-project] Lock "1daf4f4c-0e4a-4779-b53a-78c48397ea2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120740) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 18:08:25.982022 dv-cinder-852009-8-iscsi devstack@n-api.service[120740]: INFO nova.api.openstack.wsgi [None req-cd2effb0-7322-41c0-95ac-a93e581766f6 tempest-AttachVolumeShelveTestJSON-385853788 tempest-AttachVolumeShelveTestJSON-385853788-project] HTTP exception thrown: Instance 11d2616a-96f9-4a7a-aab8-219219986a8b could not be found. Sep 13 18:08:25.983565 dv-cinder-852009-8-iscsi devstack@n-api.service[120740]: DEBUG nova.api.openstack.wsgi [None req-cd2effb0-7322-41c0-95ac-a93e581766f6 tempest-AttachVolumeShelveTestJSON-385853788 tempest-AttachVolumeShelveTestJSON-385853788-project] Request method failure captured: Sep 13 18:08:25.983565 dv-cinder-852009-8-iscsi devstack@n-api.service[120740]: request: GET /compute/v2.1/servers/11d2616a-96f9-4a7a-aab8-219219986a8b HTTP/1.1 Sep 13 18:08:25.983565 dv-cinder-852009-8-iscsi devstack@n-api.service[120740]: Accept: application/json Sep 13 18:08:25.983565 dv-cinder-852009-8-iscsi devstack@n-api.service[120740]: Accept-Encoding: identity Sep 13 18:08:25.983565 dv-cinder-852009-8-iscsi devstack@n-api.service[120740]: Connection: close Sep 13 18:08:25.983565 dv-cinder-852009-8-iscsi devstack@n-api.service[120740]: Content-Length: 0 Sep 13 18:08:25.983565 dv-cinder-852009-8-iscsi devstack@n-api.service[120740]: Content-Type: application/json Sep 13 18:08:25.983565 dv-cinder-852009-8-iscsi devstack@n-api.service[120740]: Host: 10.222.0.43 Sep 13 18:08:25.983565 dv-cinder-852009-8-iscsi devstack@n-api.service[120740]: Openstack-System-Scope: None Sep 13 18:08:25.983565 dv-cinder-852009-8-iscsi devstack@n-api.service[120740]: User-Agent: python-urllib3/1.26.12 Sep 13 18:08:25.983565 dv-cinder-852009-8-iscsi devstack@n-api.service[120740]: X-Auth-Token: gAAAAABjIMWMYqPVtf0Rs9jRF4xl1KD9-SjO_FS4g579Cc1gUdbkqCtXPDYdTxBMbLmZqtgmWQubM-SSNfaWwXS4FDzkQIkG_6wttMeObykV4FtQQ2VkVt80Xzr2XOrB1n0hRb-cwFsutvG_3Oz7IRpcKn9EZa84Z-Ec1SHW4W3F55A21YEi9KQ Sep 13 18:08:25.983565 dv-cinder-852009-8-iscsi devstack@n-api.service[120740]: X-Domain-Id: None Sep 13 18:08:25.983565 dv-cinder-852009-8-iscsi devstack@n-api.service[120740]: X-Domain-Name: None Sep 13 18:08:25.983565 dv-cinder-852009-8-iscsi devstack@n-api.service[120740]: X-Identity-Status: Confirmed Sep 13 18:08:25.983565 dv-cinder-852009-8-iscsi devstack@n-api.service[120740]: X-Is-Admin-Project: True Sep 13 18:08:25.983565 dv-cinder-852009-8-iscsi devstack@n-api.service[120740]: X-Openstack-Nova-Api-Version: 2.20 Sep 13 18:08:25.983565 dv-cinder-852009-8-iscsi devstack@n-api.service[120740]: X-Project-Domain-Id: default Sep 13 18:08:25.983565 dv-cinder-852009-8-iscsi devstack@n-api.service[120740]: X-Project-Domain-Name: Default Sep 13 18:08:25.983565 dv-cinder-852009-8-iscsi devstack@n-api.service[120740]: X-Project-Id: 75e14fd88bfb4cd896fa7b070a0fac47 Sep 13 18:08:25.983565 dv-cinder-852009-8-iscsi devstack@n-api.service[120740]: X-Project-Name: tempest-AttachVolumeShelveTestJSON-385853788 Sep 13 18:08:25.983565 dv-cinder-852009-8-iscsi devstack@n-api.service[120740]: X-Role: reader,member Sep 13 18:08:25.983565 dv-cinder-852009-8-iscsi devstack@n-api.service[120740]: X-Roles: reader,member Sep 13 18:08:25.985126 dv-cinder-852009-8-iscsi devstack@n-api.service[120740]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/identity"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/compute/v2/75e14fd88bfb4cd896fa7b070a0fac47"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.43:8080", "publicURL": "http://10.222.0.43:8080/v1/AUTH_75e14fd88bfb4cd896fa7b070a0fac47"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43:9696/networking"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/volume/v3/75e14fd88bfb4cd896fa7b070a0fac47"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/compute/v2.1"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/placement"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/volume/v3/75e14fd88bfb4cd896fa7b070a0fac47"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/image"}]}] Sep 13 18:08:25.985126 dv-cinder-852009-8-iscsi devstack@n-api.service[120740]: X-Tenant: tempest-AttachVolumeShelveTestJSON-385853788 Sep 13 18:08:25.985126 dv-cinder-852009-8-iscsi devstack@n-api.service[120740]: X-Tenant-Id: 75e14fd88bfb4cd896fa7b070a0fac47 Sep 13 18:08:25.985126 dv-cinder-852009-8-iscsi devstack@n-api.service[120740]: X-Tenant-Name: tempest-AttachVolumeShelveTestJSON-385853788 Sep 13 18:08:25.985126 dv-cinder-852009-8-iscsi devstack@n-api.service[120740]: X-User: tempest-AttachVolumeShelveTestJSON-385853788-project Sep 13 18:08:25.985126 dv-cinder-852009-8-iscsi devstack@n-api.service[120740]: X-User-Domain-Id: default Sep 13 18:08:25.985126 dv-cinder-852009-8-iscsi devstack@n-api.service[120740]: X-User-Domain-Name: Default Sep 13 18:08:25.985126 dv-cinder-852009-8-iscsi devstack@n-api.service[120740]: X-User-Id: e68ecd9b3ca643539b109f75bb242d6f Sep 13 18:08:25.985126 dv-cinder-852009-8-iscsi devstack@n-api.service[120740]: X-User-Name: tempest-AttachVolumeShelveTestJSON-385853788-project Sep 13 18:08:25.985126 dv-cinder-852009-8-iscsi devstack@n-api.service[120740]: method: > Sep 13 18:08:25.985126 dv-cinder-852009-8-iscsi devstack@n-api.service[120740]: exception: Instance 11d2616a-96f9-4a7a-aab8-219219986a8b could not be found. Sep 13 18:08:25.985126 dv-cinder-852009-8-iscsi devstack@n-api.service[120740]: action_args: {'id': '11d2616a-96f9-4a7a-aab8-219219986a8b'} Sep 13 18:08:25.985869 dv-cinder-852009-8-iscsi devstack@n-api.service[120740]: {{(pid=120740) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 13 18:08:25.985869 dv-cinder-852009-8-iscsi devstack@n-api.service[120740]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 13 18:08:25.985869 dv-cinder-852009-8-iscsi devstack@n-api.service[120740]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Sep 13 18:08:25.985869 dv-cinder-852009-8-iscsi devstack@n-api.service[120740]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Sep 13 18:08:25.985869 dv-cinder-852009-8-iscsi devstack@n-api.service[120740]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Sep 13 18:08:25.985869 dv-cinder-852009-8-iscsi devstack@n-api.service[120740]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Sep 13 18:08:25.985869 dv-cinder-852009-8-iscsi devstack@n-api.service[120740]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Sep 13 18:08:25.985869 dv-cinder-852009-8-iscsi devstack@n-api.service[120740]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Sep 13 18:08:25.985869 dv-cinder-852009-8-iscsi devstack@n-api.service[120740]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Sep 13 18:08:25.985869 dv-cinder-852009-8-iscsi devstack@n-api.service[120740]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Sep 13 18:08:25.985869 dv-cinder-852009-8-iscsi devstack@n-api.service[120740]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 11d2616a-96f9-4a7a-aab8-219219986a8b could not be found. Sep 13 18:08:25.985869 dv-cinder-852009-8-iscsi devstack@n-api.service[120740]: ERROR nova.api.openstack.wsgi Sep 13 18:08:25.985869 dv-cinder-852009-8-iscsi devstack@n-api.service[120740]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 13 18:08:25.985869 dv-cinder-852009-8-iscsi devstack@n-api.service[120740]: ERROR nova.api.openstack.wsgi Sep 13 18:08:25.985869 dv-cinder-852009-8-iscsi devstack@n-api.service[120740]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 13 18:08:25.985869 dv-cinder-852009-8-iscsi devstack@n-api.service[120740]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 13 18:08:25.985869 dv-cinder-852009-8-iscsi devstack@n-api.service[120740]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 13 18:08:25.985869 dv-cinder-852009-8-iscsi devstack@n-api.service[120740]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 13 18:08:25.985869 dv-cinder-852009-8-iscsi devstack@n-api.service[120740]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 13 18:08:25.985869 dv-cinder-852009-8-iscsi devstack@n-api.service[120740]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 13 18:08:25.987052 dv-cinder-852009-8-iscsi devstack@n-api.service[120740]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 13 18:08:25.987052 dv-cinder-852009-8-iscsi devstack@n-api.service[120740]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Sep 13 18:08:25.987052 dv-cinder-852009-8-iscsi devstack@n-api.service[120740]: ERROR nova.api.openstack.wsgi instance = self._get_server( Sep 13 18:08:25.987052 dv-cinder-852009-8-iscsi devstack@n-api.service[120740]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Sep 13 18:08:25.987052 dv-cinder-852009-8-iscsi devstack@n-api.service[120740]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Sep 13 18:08:25.987052 dv-cinder-852009-8-iscsi devstack@n-api.service[120740]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Sep 13 18:08:25.987052 dv-cinder-852009-8-iscsi devstack@n-api.service[120740]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Sep 13 18:08:25.987052 dv-cinder-852009-8-iscsi devstack@n-api.service[120740]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 11d2616a-96f9-4a7a-aab8-219219986a8b could not be found. Sep 13 18:08:25.987052 dv-cinder-852009-8-iscsi devstack@n-api.service[120740]: ERROR nova.api.openstack.wsgi Sep 13 18:08:25.987052 dv-cinder-852009-8-iscsi devstack@n-api.service[120740]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 13 18:08:25.987052 dv-cinder-852009-8-iscsi devstack@n-api.service[120740]: ERROR nova.api.openstack.wsgi Sep 13 18:08:25.987052 dv-cinder-852009-8-iscsi devstack@n-api.service[120740]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 13 18:08:25.987052 dv-cinder-852009-8-iscsi devstack@n-api.service[120740]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 13 18:08:25.987052 dv-cinder-852009-8-iscsi devstack@n-api.service[120740]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 13 18:08:25.987052 dv-cinder-852009-8-iscsi devstack@n-api.service[120740]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 13 18:08:25.987052 dv-cinder-852009-8-iscsi devstack@n-api.service[120740]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 13 18:08:25.987052 dv-cinder-852009-8-iscsi devstack@n-api.service[120740]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 11d2616a-96f9-4a7a-aab8-219219986a8b could not be found. Sep 13 18:08:25.987052 dv-cinder-852009-8-iscsi devstack@n-api.service[120740]: ERROR nova.api.openstack.wsgi Sep 13 18:08:25.988151 dv-cinder-852009-8-iscsi devstack@n-api.service[120740]: DEBUG nova.api.openstack.wsgi [None req-cd2effb0-7322-41c0-95ac-a93e581766f6 tempest-AttachVolumeShelveTestJSON-385853788 tempest-AttachVolumeShelveTestJSON-385853788-project] Returning 404 to user: Instance 11d2616a-96f9-4a7a-aab8-219219986a8b could not be found. {{(pid=120740) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 13 18:08:25.988151 dv-cinder-852009-8-iscsi devstack@n-api.service[120740]: INFO nova.api.openstack.requestlog [None req-cd2effb0-7322-41c0-95ac-a93e581766f6 tempest-AttachVolumeShelveTestJSON-385853788 tempest-AttachVolumeShelveTestJSON-385853788-project] 10.222.0.43 "GET /compute/v2.1/servers/11d2616a-96f9-4a7a-aab8-219219986a8b" status: 404 len: 111 microversion: 2.20 time: 0.032172 Sep 13 18:08:25.988151 dv-cinder-852009-8-iscsi devstack@n-api.service[120740]: [pid: 120740|app: 0|req: 362/715] 10.222.0.43 () {60 vars in 1277 bytes} [Tue Sep 13 18:08:25 2022] GET /compute/v2.1/servers/11d2616a-96f9-4a7a-aab8-219219986a8b => generated 111 bytes in 34 msecs (HTTP/1.1 404) 9 headers in 381 bytes (1 switches on core 0) Sep 13 18:08:35.140469 dv-cinder-852009-8-iscsi devstack@n-api.service[120741]: DEBUG nova.api.openstack.wsgi [None req-edfd5653-6fef-4c2b-a05e-cc6c257d8e7d tempest-AttachVolumeNegativeTest-1378806597 tempest-AttachVolumeNegativeTest-1378806597-project] Action: 'create', calling method: .version_select at 0x7fa626974ee0>, body: {"keypair": {"name": "tempest-keypair-695244385", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBAORfeTS0+/Ka+xW7c3djLhcHtvPr1slfg7GaUdCP9AJdjGp9hmfzYOWuV/1QJg84RyxbCeV+WOzFiSgWzDIc8MEVEJgMih9C82DE1UDwh6Gvb4h7EluxRbM3dhT8jcajg=="}} {{(pid=120741) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 13 18:08:35.157168 dv-cinder-852009-8-iscsi devstack@n-api.service[120741]: DEBUG nova.quota [None req-edfd5653-6fef-4c2b-a05e-cc6c257d8e7d tempest-AttachVolumeNegativeTest-1378806597 tempest-AttachVolumeNegativeTest-1378806597-project] Getting quotas for project 629311eda0584a5fbb7d8995cf27540c. Resources: {'key_pairs'} {{(pid=120741) _get_quotas /opt/stack/nova/nova/quota.py:393}} Sep 13 18:08:35.161253 dv-cinder-852009-8-iscsi devstack@n-api.service[120741]: DEBUG nova.quota [None req-edfd5653-6fef-4c2b-a05e-cc6c257d8e7d tempest-AttachVolumeNegativeTest-1378806597 tempest-AttachVolumeNegativeTest-1378806597-project] Getting quotas for user 714cd09ba19b492f9a8c80343abcf6b9 and project 629311eda0584a5fbb7d8995cf27540c. Resources: {'key_pairs'} {{(pid=120741) _get_quotas /opt/stack/nova/nova/quota.py:383}} Sep 13 18:08:35.187484 dv-cinder-852009-8-iscsi devstack@n-api.service[120741]: INFO nova.api.openstack.requestlog [None req-edfd5653-6fef-4c2b-a05e-cc6c257d8e7d tempest-AttachVolumeNegativeTest-1378806597 tempest-AttachVolumeNegativeTest-1378806597-project] 10.222.0.43 "POST /compute/v2.1/os-keypairs" status: 200 len: 385 microversion: 2.1 time: 0.164705 Sep 13 18:08:35.188093 dv-cinder-852009-8-iscsi devstack@n-api.service[120741]: [pid: 120741|app: 0|req: 354/716] 10.222.0.43 () {60 vars in 1159 bytes} [Tue Sep 13 18:08:35 2022] POST /compute/v2.1/os-keypairs => generated 385 bytes in 166 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 13 18:08:36.486543 dv-cinder-852009-8-iscsi devstack@n-api.service[120740]: DEBUG nova.api.openstack.wsgi [None req-f9e8f959-9e03-4bb4-a027-d5d5fc2d19d1 tempest-AttachVolumeNegativeTest-1378806597 tempest-AttachVolumeNegativeTest-1378806597-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-AttachVolumeNegativeTest-server-1401597029", "imageRef": "33034e36-e6b2-4847-92a1-ff3188c05a4a", "flavorRef": "452", "adminPass": "***", "networks": [{"uuid": "e19c1043-1c23-4c64-9720-4320d6d11eef"}], "security_groups": [{"name": "tempest-securitygroup--184641424"}], "key_name": "tempest-keypair-695244385", "user_data": "}} {{(pid=120740) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 13 18:08:36.495797 dv-cinder-852009-8-iscsi devstack@n-api.service[120740]: DEBUG dbcounter [-] [120740] Writing DB stats nova_api:SELECT=20,nova_api:UPDATE=1,nova_api:DELETE=1 {{(pid=120740) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 18:08:36.496481 dv-cinder-852009-8-iscsi devstack@n-api.service[120740]: DEBUG dbcounter [-] [120740] Writing DB stats nova_cell1:SELECT=32,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=120740) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 18:08:36.595128 dv-cinder-852009-8-iscsi devstack@n-api.service[120740]: DEBUG nova.network.neutron [None req-f9e8f959-9e03-4bb4-a027-d5d5fc2d19d1 tempest-AttachVolumeNegativeTest-1378806597 tempest-AttachVolumeNegativeTest-1378806597-project] validate_networks() for [('e19c1043-1c23-4c64-9720-4320d6d11eef', None, None, None, None, None)] {{(pid=120740) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Sep 13 18:08:36.977743 dv-cinder-852009-8-iscsi devstack@n-api.service[120740]: DEBUG nova.virt.hardware [None req-f9e8f959-9e03-4bb4-a027-d5d5fc2d19d1 tempest-AttachVolumeNegativeTest-1378806597 tempest-AttachVolumeNegativeTest-1378806597-project] Flavor limits 0:0:0 {{(pid=120740) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Sep 13 18:08:36.978159 dv-cinder-852009-8-iscsi devstack@n-api.service[120740]: DEBUG nova.virt.hardware [None req-f9e8f959-9e03-4bb4-a027-d5d5fc2d19d1 tempest-AttachVolumeNegativeTest-1378806597 tempest-AttachVolumeNegativeTest-1378806597-project] Image limits 0:0:0 {{(pid=120740) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Sep 13 18:08:36.978624 dv-cinder-852009-8-iscsi devstack@n-api.service[120740]: DEBUG nova.virt.hardware [None req-f9e8f959-9e03-4bb4-a027-d5d5fc2d19d1 tempest-AttachVolumeNegativeTest-1378806597 tempest-AttachVolumeNegativeTest-1378806597-project] Flavor pref 0:0:0 {{(pid=120740) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Sep 13 18:08:36.979024 dv-cinder-852009-8-iscsi devstack@n-api.service[120740]: DEBUG nova.virt.hardware [None req-f9e8f959-9e03-4bb4-a027-d5d5fc2d19d1 tempest-AttachVolumeNegativeTest-1378806597 tempest-AttachVolumeNegativeTest-1378806597-project] Image pref 0:0:0 {{(pid=120740) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Sep 13 18:08:36.979428 dv-cinder-852009-8-iscsi devstack@n-api.service[120740]: DEBUG nova.virt.hardware [None req-f9e8f959-9e03-4bb4-a027-d5d5fc2d19d1 tempest-AttachVolumeNegativeTest-1378806597 tempest-AttachVolumeNegativeTest-1378806597-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=120740) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Sep 13 18:08:36.989127 dv-cinder-852009-8-iscsi devstack@n-api.service[120740]: DEBUG oslo_concurrency.lockutils [None req-f9e8f959-9e03-4bb4-a027-d5d5fc2d19d1 tempest-AttachVolumeNegativeTest-1378806597 tempest-AttachVolumeNegativeTest-1378806597-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120740) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 18:08:36.989786 dv-cinder-852009-8-iscsi devstack@n-api.service[120740]: DEBUG oslo_concurrency.lockutils [None req-f9e8f959-9e03-4bb4-a027-d5d5fc2d19d1 tempest-AttachVolumeNegativeTest-1378806597 tempest-AttachVolumeNegativeTest-1378806597-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120740) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 18:08:36.990355 dv-cinder-852009-8-iscsi devstack@n-api.service[120740]: DEBUG oslo_concurrency.lockutils [None req-f9e8f959-9e03-4bb4-a027-d5d5fc2d19d1 tempest-AttachVolumeNegativeTest-1378806597 tempest-AttachVolumeNegativeTest-1378806597-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120740) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 18:08:36.991169 dv-cinder-852009-8-iscsi devstack@n-api.service[120740]: DEBUG oslo_concurrency.lockutils [None req-f9e8f959-9e03-4bb4-a027-d5d5fc2d19d1 tempest-AttachVolumeNegativeTest-1378806597 tempest-AttachVolumeNegativeTest-1378806597-project] Acquiring lock "1daf4f4c-0e4a-4779-b53a-78c48397ea2f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120740) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 18:08:36.991707 dv-cinder-852009-8-iscsi devstack@n-api.service[120740]: DEBUG oslo_concurrency.lockutils [None req-f9e8f959-9e03-4bb4-a027-d5d5fc2d19d1 tempest-AttachVolumeNegativeTest-1378806597 tempest-AttachVolumeNegativeTest-1378806597-project] Lock "1daf4f4c-0e4a-4779-b53a-78c48397ea2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120740) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 18:08:36.992217 dv-cinder-852009-8-iscsi devstack@n-api.service[120740]: DEBUG oslo_concurrency.lockutils [None req-f9e8f959-9e03-4bb4-a027-d5d5fc2d19d1 tempest-AttachVolumeNegativeTest-1378806597 tempest-AttachVolumeNegativeTest-1378806597-project] Lock "1daf4f4c-0e4a-4779-b53a-78c48397ea2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120740) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 18:08:37.010428 dv-cinder-852009-8-iscsi devstack@n-api.service[120740]: DEBUG nova.quota [None req-f9e8f959-9e03-4bb4-a027-d5d5fc2d19d1 tempest-AttachVolumeNegativeTest-1378806597 tempest-AttachVolumeNegativeTest-1378806597-project] Getting quotas for project 629311eda0584a5fbb7d8995cf27540c. Resources: {'cores', 'ram', 'instances'} {{(pid=120740) _get_quotas /opt/stack/nova/nova/quota.py:393}} Sep 13 18:08:37.014374 dv-cinder-852009-8-iscsi devstack@n-api.service[120740]: DEBUG nova.quota [None req-f9e8f959-9e03-4bb4-a027-d5d5fc2d19d1 tempest-AttachVolumeNegativeTest-1378806597 tempest-AttachVolumeNegativeTest-1378806597-project] Getting quotas for user 714cd09ba19b492f9a8c80343abcf6b9 and project 629311eda0584a5fbb7d8995cf27540c. Resources: {'cores', 'ram', 'instances'} {{(pid=120740) _get_quotas /opt/stack/nova/nova/quota.py:383}} Sep 13 18:08:37.026710 dv-cinder-852009-8-iscsi devstack@n-api.service[120740]: DEBUG nova.compute.api [None req-f9e8f959-9e03-4bb4-a027-d5d5fc2d19d1 tempest-AttachVolumeNegativeTest-1378806597 tempest-AttachVolumeNegativeTest-1378806597-project] Going to run 1 instances... {{(pid=120740) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Sep 13 18:08:37.029114 dv-cinder-852009-8-iscsi devstack@n-api.service[120740]: DEBUG nova.compute.api [None req-f9e8f959-9e03-4bb4-a027-d5d5fc2d19d1 tempest-AttachVolumeNegativeTest-1378806597 tempest-AttachVolumeNegativeTest-1378806597-project] [instance: 75289327-97d1-42bd-a6c7-6f2b1aa3236a] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='33034e36-e6b2-4847-92a1-ff3188c05a4a',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=120740) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Sep 13 18:08:37.076938 dv-cinder-852009-8-iscsi devstack@n-api.service[120740]: INFO nova.api.openstack.requestlog [None req-f9e8f959-9e03-4bb4-a027-d5d5fc2d19d1 tempest-AttachVolumeNegativeTest-1378806597 tempest-AttachVolumeNegativeTest-1378806597-project] 10.222.0.43 "POST /compute/v2.1/servers" status: 202 len: 401 microversion: 2.1 time: 0.594584 Sep 13 18:08:37.077586 dv-cinder-852009-8-iscsi devstack@n-api.service[120740]: [pid: 120740|app: 0|req: 363/717] 10.222.0.43 () {60 vars in 1147 bytes} [Tue Sep 13 18:08:36 2022] POST /compute/v2.1/servers => generated 401 bytes in 596 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Sep 13 18:08:37.089518 dv-cinder-852009-8-iscsi devstack@n-api.service[120741]: DEBUG nova.api.openstack.wsgi [None req-a0a5b2c6-b6f8-48a5-a590-54e2abdd2637 tempest-AttachVolumeNegativeTest-1378806597 tempest-AttachVolumeNegativeTest-1378806597-project] Calling method '>' {{(pid=120741) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 18:08:37.091092 dv-cinder-852009-8-iscsi devstack@n-api.service[120741]: DEBUG nova.compute.api [None req-a0a5b2c6-b6f8-48a5-a590-54e2abdd2637 tempest-AttachVolumeNegativeTest-1378806597 tempest-AttachVolumeNegativeTest-1378806597-project] [instance: 75289327-97d1-42bd-a6c7-6f2b1aa3236a] Fetching instance by UUID {{(pid=120741) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 18:08:37.095325 dv-cinder-852009-8-iscsi devstack@n-api.service[120741]: DEBUG dbcounter [-] [120741] Writing DB stats nova_cell1:SELECT=20 {{(pid=120741) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 18:08:37.189735 dv-cinder-852009-8-iscsi devstack@n-api.service[120741]: DEBUG nova.policy [None req-a0a5b2c6-b6f8-48a5-a590-54e2abdd2637 tempest-AttachVolumeNegativeTest-1378806597 tempest-AttachVolumeNegativeTest-1378806597-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '714cd09ba19b492f9a8c80343abcf6b9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '629311eda0584a5fbb7d8995cf27540c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120741) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 18:08:37.197820 dv-cinder-852009-8-iscsi devstack@n-api.service[120741]: INFO nova.api.openstack.requestlog [None req-a0a5b2c6-b6f8-48a5-a590-54e2abdd2637 tempest-AttachVolumeNegativeTest-1378806597 tempest-AttachVolumeNegativeTest-1378806597-project] 10.222.0.43 "GET /compute/v2.1/servers/75289327-97d1-42bd-a6c7-6f2b1aa3236a" status: 200 len: 1241 microversion: 2.1 time: 0.112628 Sep 13 18:08:37.200827 dv-cinder-852009-8-iscsi devstack@n-api.service[120741]: [pid: 120741|app: 0|req: 355/718] 10.222.0.43 () {58 vars in 1236 bytes} [Tue Sep 13 18:08:37 2022] GET /compute/v2.1/servers/75289327-97d1-42bd-a6c7-6f2b1aa3236a => generated 1241 bytes in 116 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 13 18:08:38.236716 dv-cinder-852009-8-iscsi devstack@n-api.service[120740]: DEBUG nova.api.openstack.wsgi [None req-209563bb-f2c5-4ce5-a993-4c2923caf3a9 tempest-AttachVolumeNegativeTest-1378806597 tempest-AttachVolumeNegativeTest-1378806597-project] Calling method '>' {{(pid=120740) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 18:08:38.238621 dv-cinder-852009-8-iscsi devstack@n-api.service[120740]: DEBUG nova.compute.api [None req-209563bb-f2c5-4ce5-a993-4c2923caf3a9 tempest-AttachVolumeNegativeTest-1378806597 tempest-AttachVolumeNegativeTest-1378806597-project] [instance: 75289327-97d1-42bd-a6c7-6f2b1aa3236a] Fetching instance by UUID {{(pid=120740) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 18:08:38.259991 dv-cinder-852009-8-iscsi devstack@n-api.service[120740]: DEBUG oslo_concurrency.lockutils [None req-209563bb-f2c5-4ce5-a993-4c2923caf3a9 tempest-AttachVolumeNegativeTest-1378806597 tempest-AttachVolumeNegativeTest-1378806597-project] Acquiring lock "1daf4f4c-0e4a-4779-b53a-78c48397ea2f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120740) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 18:08:38.260795 dv-cinder-852009-8-iscsi devstack@n-api.service[120740]: DEBUG oslo_concurrency.lockutils [None req-209563bb-f2c5-4ce5-a993-4c2923caf3a9 tempest-AttachVolumeNegativeTest-1378806597 tempest-AttachVolumeNegativeTest-1378806597-project] Lock "1daf4f4c-0e4a-4779-b53a-78c48397ea2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120740) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 18:08:38.261383 dv-cinder-852009-8-iscsi devstack@n-api.service[120740]: DEBUG oslo_concurrency.lockutils [None req-209563bb-f2c5-4ce5-a993-4c2923caf3a9 tempest-AttachVolumeNegativeTest-1378806597 tempest-AttachVolumeNegativeTest-1378806597-project] Lock "1daf4f4c-0e4a-4779-b53a-78c48397ea2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120740) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 18:08:38.265864 dv-cinder-852009-8-iscsi devstack@n-api.service[120740]: DEBUG oslo_concurrency.lockutils [None req-209563bb-f2c5-4ce5-a993-4c2923caf3a9 tempest-AttachVolumeNegativeTest-1378806597 tempest-AttachVolumeNegativeTest-1378806597-project] Acquiring lock "1daf4f4c-0e4a-4779-b53a-78c48397ea2f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120740) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 18:08:38.266532 dv-cinder-852009-8-iscsi devstack@n-api.service[120740]: DEBUG oslo_concurrency.lockutils [None req-209563bb-f2c5-4ce5-a993-4c2923caf3a9 tempest-AttachVolumeNegativeTest-1378806597 tempest-AttachVolumeNegativeTest-1378806597-project] Lock "1daf4f4c-0e4a-4779-b53a-78c48397ea2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120740) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 18:08:38.267115 dv-cinder-852009-8-iscsi devstack@n-api.service[120740]: DEBUG oslo_concurrency.lockutils [None req-209563bb-f2c5-4ce5-a993-4c2923caf3a9 tempest-AttachVolumeNegativeTest-1378806597 tempest-AttachVolumeNegativeTest-1378806597-project] Lock "1daf4f4c-0e4a-4779-b53a-78c48397ea2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120740) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 18:08:38.367633 dv-cinder-852009-8-iscsi devstack@n-api.service[120740]: DEBUG nova.policy [None req-209563bb-f2c5-4ce5-a993-4c2923caf3a9 tempest-AttachVolumeNegativeTest-1378806597 tempest-AttachVolumeNegativeTest-1378806597-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '714cd09ba19b492f9a8c80343abcf6b9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '629311eda0584a5fbb7d8995cf27540c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120740) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 18:08:38.376202 dv-cinder-852009-8-iscsi devstack@n-api.service[120740]: INFO nova.api.openstack.requestlog [None req-209563bb-f2c5-4ce5-a993-4c2923caf3a9 tempest-AttachVolumeNegativeTest-1378806597 tempest-AttachVolumeNegativeTest-1378806597-project] 10.222.0.43 "GET /compute/v2.1/servers/75289327-97d1-42bd-a6c7-6f2b1aa3236a" status: 200 len: 1311 microversion: 2.1 time: 0.153932 Sep 13 18:08:38.397026 dv-cinder-852009-8-iscsi devstack@n-api.service[120740]: [pid: 120740|app: 0|req: 364/719] 10.222.0.43 () {58 vars in 1236 bytes} [Tue Sep 13 18:08:38 2022] GET /compute/v2.1/servers/75289327-97d1-42bd-a6c7-6f2b1aa3236a => generated 1311 bytes in 175 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 13 18:08:39.404251 dv-cinder-852009-8-iscsi devstack@n-api.service[120741]: DEBUG nova.api.openstack.wsgi [None req-1aefabe1-40ab-4d9a-bf4e-f8976de1cd21 tempest-AttachVolumeNegativeTest-1378806597 tempest-AttachVolumeNegativeTest-1378806597-project] Calling method '>' {{(pid=120741) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 18:08:39.404857 dv-cinder-852009-8-iscsi devstack@n-api.service[120741]: DEBUG nova.compute.api [None req-1aefabe1-40ab-4d9a-bf4e-f8976de1cd21 tempest-AttachVolumeNegativeTest-1378806597 tempest-AttachVolumeNegativeTest-1378806597-project] [instance: 75289327-97d1-42bd-a6c7-6f2b1aa3236a] Fetching instance by UUID {{(pid=120741) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 18:08:39.412457 dv-cinder-852009-8-iscsi devstack@n-api.service[120741]: DEBUG oslo_concurrency.lockutils [None req-1aefabe1-40ab-4d9a-bf4e-f8976de1cd21 tempest-AttachVolumeNegativeTest-1378806597 tempest-AttachVolumeNegativeTest-1378806597-project] Acquiring lock "1daf4f4c-0e4a-4779-b53a-78c48397ea2f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120741) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 18:08:39.412981 dv-cinder-852009-8-iscsi devstack@n-api.service[120741]: DEBUG oslo_concurrency.lockutils [None req-1aefabe1-40ab-4d9a-bf4e-f8976de1cd21 tempest-AttachVolumeNegativeTest-1378806597 tempest-AttachVolumeNegativeTest-1378806597-project] Lock "1daf4f4c-0e4a-4779-b53a-78c48397ea2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120741) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 18:08:39.413450 dv-cinder-852009-8-iscsi devstack@n-api.service[120741]: DEBUG oslo_concurrency.lockutils [None req-1aefabe1-40ab-4d9a-bf4e-f8976de1cd21 tempest-AttachVolumeNegativeTest-1378806597 tempest-AttachVolumeNegativeTest-1378806597-project] Lock "1daf4f4c-0e4a-4779-b53a-78c48397ea2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120741) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 18:08:39.414126 dv-cinder-852009-8-iscsi devstack@n-api.service[120741]: DEBUG oslo_concurrency.lockutils [None req-1aefabe1-40ab-4d9a-bf4e-f8976de1cd21 tempest-AttachVolumeNegativeTest-1378806597 tempest-AttachVolumeNegativeTest-1378806597-project] Acquiring lock "1daf4f4c-0e4a-4779-b53a-78c48397ea2f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120741) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 18:08:39.414642 dv-cinder-852009-8-iscsi devstack@n-api.service[120741]: DEBUG oslo_concurrency.lockutils [None req-1aefabe1-40ab-4d9a-bf4e-f8976de1cd21 tempest-AttachVolumeNegativeTest-1378806597 tempest-AttachVolumeNegativeTest-1378806597-project] Lock "1daf4f4c-0e4a-4779-b53a-78c48397ea2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120741) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 18:08:39.415087 dv-cinder-852009-8-iscsi devstack@n-api.service[120741]: DEBUG oslo_concurrency.lockutils [None req-1aefabe1-40ab-4d9a-bf4e-f8976de1cd21 tempest-AttachVolumeNegativeTest-1378806597 tempest-AttachVolumeNegativeTest-1378806597-project] Lock "1daf4f4c-0e4a-4779-b53a-78c48397ea2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120741) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 18:08:39.546284 dv-cinder-852009-8-iscsi devstack@n-api.service[120741]: DEBUG nova.policy [None req-1aefabe1-40ab-4d9a-bf4e-f8976de1cd21 tempest-AttachVolumeNegativeTest-1378806597 tempest-AttachVolumeNegativeTest-1378806597-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '714cd09ba19b492f9a8c80343abcf6b9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '629311eda0584a5fbb7d8995cf27540c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120741) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 18:08:39.554715 dv-cinder-852009-8-iscsi devstack@n-api.service[120741]: INFO nova.api.openstack.requestlog [None req-1aefabe1-40ab-4d9a-bf4e-f8976de1cd21 tempest-AttachVolumeNegativeTest-1378806597 tempest-AttachVolumeNegativeTest-1378806597-project] 10.222.0.43 "GET /compute/v2.1/servers/75289327-97d1-42bd-a6c7-6f2b1aa3236a" status: 200 len: 1366 microversion: 2.1 time: 0.154506 Sep 13 18:08:39.555514 dv-cinder-852009-8-iscsi devstack@n-api.service[120741]: [pid: 120741|app: 0|req: 356/720] 10.222.0.43 () {58 vars in 1236 bytes} [Tue Sep 13 18:08:39 2022] GET /compute/v2.1/servers/75289327-97d1-42bd-a6c7-6f2b1aa3236a => generated 1366 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 13 18:08:39.767472 dv-cinder-852009-8-iscsi devstack@n-api.service[120740]: DEBUG nova.api.openstack.wsgi [req-222fcab4-ec8e-47ee-96c4-3b526562bde2 req-90e5d31e-5d76-462d-a5bd-aa29cf229b24 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "75289327-97d1-42bd-a6c7-6f2b1aa3236a", "tag": "4df04d71-3866-4544-aec1-8f254829f81c"}]} {{(pid=120740) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 13 18:08:39.778937 dv-cinder-852009-8-iscsi devstack@n-api.service[120740]: DEBUG oslo_concurrency.lockutils [req-222fcab4-ec8e-47ee-96c4-3b526562bde2 req-90e5d31e-5d76-462d-a5bd-aa29cf229b24 service nova] Acquiring lock "1daf4f4c-0e4a-4779-b53a-78c48397ea2f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120740) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 18:08:39.779337 dv-cinder-852009-8-iscsi devstack@n-api.service[120740]: DEBUG oslo_concurrency.lockutils [req-222fcab4-ec8e-47ee-96c4-3b526562bde2 req-90e5d31e-5d76-462d-a5bd-aa29cf229b24 service nova] Lock "1daf4f4c-0e4a-4779-b53a-78c48397ea2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120740) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 18:08:39.780060 dv-cinder-852009-8-iscsi devstack@n-api.service[120740]: DEBUG oslo_concurrency.lockutils [req-222fcab4-ec8e-47ee-96c4-3b526562bde2 req-90e5d31e-5d76-462d-a5bd-aa29cf229b24 service nova] Lock "1daf4f4c-0e4a-4779-b53a-78c48397ea2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120740) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 18:08:39.794674 dv-cinder-852009-8-iscsi devstack@n-api.service[120740]: INFO nova.api.openstack.compute.server_external_events [req-222fcab4-ec8e-47ee-96c4-3b526562bde2 req-90e5d31e-5d76-462d-a5bd-aa29cf229b24 service nova] Creating event network-changed:4df04d71-3866-4544-aec1-8f254829f81c for instance 75289327-97d1-42bd-a6c7-6f2b1aa3236a on hv-cinder-85200 Sep 13 18:08:39.800917 dv-cinder-852009-8-iscsi devstack@n-api.service[120740]: INFO nova.api.openstack.requestlog [req-222fcab4-ec8e-47ee-96c4-3b526562bde2 req-90e5d31e-5d76-462d-a5bd-aa29cf229b24 service nova] 10.222.0.43 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.036999 Sep 13 18:08:39.801478 dv-cinder-852009-8-iscsi devstack@n-api.service[120740]: [pid: 120740|app: 0|req: 365/721] 10.222.0.43 () {64 vars in 1317 bytes} [Tue Sep 13 18:08:39 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 39 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 13 18:08:40.582710 dv-cinder-852009-8-iscsi devstack@n-api.service[120741]: DEBUG nova.api.openstack.wsgi [None req-72f93e72-2cb6-4028-b52f-971e65287a95 tempest-AttachVolumeNegativeTest-1378806597 tempest-AttachVolumeNegativeTest-1378806597-project] Calling method '>' {{(pid=120741) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 18:08:40.583694 dv-cinder-852009-8-iscsi devstack@n-api.service[120741]: DEBUG nova.compute.api [None req-72f93e72-2cb6-4028-b52f-971e65287a95 tempest-AttachVolumeNegativeTest-1378806597 tempest-AttachVolumeNegativeTest-1378806597-project] [instance: 75289327-97d1-42bd-a6c7-6f2b1aa3236a] Fetching instance by UUID {{(pid=120741) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 18:08:40.595045 dv-cinder-852009-8-iscsi devstack@n-api.service[120741]: DEBUG oslo_concurrency.lockutils [None req-72f93e72-2cb6-4028-b52f-971e65287a95 tempest-AttachVolumeNegativeTest-1378806597 tempest-AttachVolumeNegativeTest-1378806597-project] Acquiring lock "1daf4f4c-0e4a-4779-b53a-78c48397ea2f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120741) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 18:08:40.595735 dv-cinder-852009-8-iscsi devstack@n-api.service[120741]: DEBUG oslo_concurrency.lockutils [None req-72f93e72-2cb6-4028-b52f-971e65287a95 tempest-AttachVolumeNegativeTest-1378806597 tempest-AttachVolumeNegativeTest-1378806597-project] Lock "1daf4f4c-0e4a-4779-b53a-78c48397ea2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120741) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 18:08:40.596519 dv-cinder-852009-8-iscsi devstack@n-api.service[120741]: DEBUG oslo_concurrency.lockutils [None req-72f93e72-2cb6-4028-b52f-971e65287a95 tempest-AttachVolumeNegativeTest-1378806597 tempest-AttachVolumeNegativeTest-1378806597-project] Lock "1daf4f4c-0e4a-4779-b53a-78c48397ea2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120741) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 18:08:40.597631 dv-cinder-852009-8-iscsi devstack@n-api.service[120741]: DEBUG oslo_concurrency.lockutils [None req-72f93e72-2cb6-4028-b52f-971e65287a95 tempest-AttachVolumeNegativeTest-1378806597 tempest-AttachVolumeNegativeTest-1378806597-project] Acquiring lock "1daf4f4c-0e4a-4779-b53a-78c48397ea2f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120741) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 18:08:40.598379 dv-cinder-852009-8-iscsi devstack@n-api.service[120741]: DEBUG oslo_concurrency.lockutils [None req-72f93e72-2cb6-4028-b52f-971e65287a95 tempest-AttachVolumeNegativeTest-1378806597 tempest-AttachVolumeNegativeTest-1378806597-project] Lock "1daf4f4c-0e4a-4779-b53a-78c48397ea2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120741) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 18:08:40.599070 dv-cinder-852009-8-iscsi devstack@n-api.service[120741]: DEBUG oslo_concurrency.lockutils [None req-72f93e72-2cb6-4028-b52f-971e65287a95 tempest-AttachVolumeNegativeTest-1378806597 tempest-AttachVolumeNegativeTest-1378806597-project] Lock "1daf4f4c-0e4a-4779-b53a-78c48397ea2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120741) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 18:08:40.744782 dv-cinder-852009-8-iscsi devstack@n-api.service[120741]: DEBUG nova.policy [None req-72f93e72-2cb6-4028-b52f-971e65287a95 tempest-AttachVolumeNegativeTest-1378806597 tempest-AttachVolumeNegativeTest-1378806597-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '714cd09ba19b492f9a8c80343abcf6b9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '629311eda0584a5fbb7d8995cf27540c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120741) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 18:08:40.754227 dv-cinder-852009-8-iscsi devstack@n-api.service[120741]: INFO nova.api.openstack.requestlog [None req-72f93e72-2cb6-4028-b52f-971e65287a95 tempest-AttachVolumeNegativeTest-1378806597 tempest-AttachVolumeNegativeTest-1378806597-project] 10.222.0.43 "GET /compute/v2.1/servers/75289327-97d1-42bd-a6c7-6f2b1aa3236a" status: 200 len: 1366 microversion: 2.1 time: 0.177988 Sep 13 18:08:40.754943 dv-cinder-852009-8-iscsi devstack@n-api.service[120741]: [pid: 120741|app: 0|req: 357/722] 10.222.0.43 () {58 vars in 1236 bytes} [Tue Sep 13 18:08:40 2022] GET /compute/v2.1/servers/75289327-97d1-42bd-a6c7-6f2b1aa3236a => generated 1366 bytes in 180 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 13 18:08:41.779003 dv-cinder-852009-8-iscsi devstack@n-api.service[120740]: DEBUG nova.api.openstack.wsgi [None req-65e8421c-5ed1-4698-959a-709f4dbbf5ec tempest-AttachVolumeNegativeTest-1378806597 tempest-AttachVolumeNegativeTest-1378806597-project] Calling method '>' {{(pid=120740) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 18:08:41.779705 dv-cinder-852009-8-iscsi devstack@n-api.service[120740]: DEBUG nova.compute.api [None req-65e8421c-5ed1-4698-959a-709f4dbbf5ec tempest-AttachVolumeNegativeTest-1378806597 tempest-AttachVolumeNegativeTest-1378806597-project] [instance: 75289327-97d1-42bd-a6c7-6f2b1aa3236a] Fetching instance by UUID {{(pid=120740) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 18:08:41.786031 dv-cinder-852009-8-iscsi devstack@n-api.service[120740]: DEBUG oslo_concurrency.lockutils [None req-65e8421c-5ed1-4698-959a-709f4dbbf5ec tempest-AttachVolumeNegativeTest-1378806597 tempest-AttachVolumeNegativeTest-1378806597-project] Acquiring lock "1daf4f4c-0e4a-4779-b53a-78c48397ea2f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120740) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 18:08:41.786519 dv-cinder-852009-8-iscsi devstack@n-api.service[120740]: DEBUG oslo_concurrency.lockutils [None req-65e8421c-5ed1-4698-959a-709f4dbbf5ec tempest-AttachVolumeNegativeTest-1378806597 tempest-AttachVolumeNegativeTest-1378806597-project] Lock "1daf4f4c-0e4a-4779-b53a-78c48397ea2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120740) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 18:08:41.786952 dv-cinder-852009-8-iscsi devstack@n-api.service[120740]: DEBUG oslo_concurrency.lockutils [None req-65e8421c-5ed1-4698-959a-709f4dbbf5ec tempest-AttachVolumeNegativeTest-1378806597 tempest-AttachVolumeNegativeTest-1378806597-project] Lock "1daf4f4c-0e4a-4779-b53a-78c48397ea2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120740) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 18:08:41.787648 dv-cinder-852009-8-iscsi devstack@n-api.service[120740]: DEBUG oslo_concurrency.lockutils [None req-65e8421c-5ed1-4698-959a-709f4dbbf5ec tempest-AttachVolumeNegativeTest-1378806597 tempest-AttachVolumeNegativeTest-1378806597-project] Acquiring lock "1daf4f4c-0e4a-4779-b53a-78c48397ea2f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120740) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 18:08:41.788094 dv-cinder-852009-8-iscsi devstack@n-api.service[120740]: DEBUG oslo_concurrency.lockutils [None req-65e8421c-5ed1-4698-959a-709f4dbbf5ec tempest-AttachVolumeNegativeTest-1378806597 tempest-AttachVolumeNegativeTest-1378806597-project] Lock "1daf4f4c-0e4a-4779-b53a-78c48397ea2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120740) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 18:08:41.788559 dv-cinder-852009-8-iscsi devstack@n-api.service[120740]: DEBUG oslo_concurrency.lockutils [None req-65e8421c-5ed1-4698-959a-709f4dbbf5ec tempest-AttachVolumeNegativeTest-1378806597 tempest-AttachVolumeNegativeTest-1378806597-project] Lock "1daf4f4c-0e4a-4779-b53a-78c48397ea2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120740) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 18:08:41.957940 dv-cinder-852009-8-iscsi devstack@n-api.service[120741]: DEBUG nova.api.openstack.wsgi [None req-e12f184f-e19e-4670-bb10-fd988f737ba6 tempest-TestShelveInstance-6258502 tempest-TestShelveInstance-6258502-project] Calling method '>' {{(pid=120741) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 18:08:41.958516 dv-cinder-852009-8-iscsi devstack@n-api.service[120741]: DEBUG nova.compute.api [None req-e12f184f-e19e-4670-bb10-fd988f737ba6 tempest-TestShelveInstance-6258502 tempest-TestShelveInstance-6258502-project] [instance: 2d60cc6d-a699-417d-aa20-fe3e1bfc351e] Fetching instance by UUID {{(pid=120741) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 18:08:41.965052 dv-cinder-852009-8-iscsi devstack@n-api.service[120741]: DEBUG oslo_concurrency.lockutils [None req-e12f184f-e19e-4670-bb10-fd988f737ba6 tempest-TestShelveInstance-6258502 tempest-TestShelveInstance-6258502-project] Acquiring lock "1daf4f4c-0e4a-4779-b53a-78c48397ea2f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120741) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 18:08:41.965509 dv-cinder-852009-8-iscsi devstack@n-api.service[120741]: DEBUG oslo_concurrency.lockutils [None req-e12f184f-e19e-4670-bb10-fd988f737ba6 tempest-TestShelveInstance-6258502 tempest-TestShelveInstance-6258502-project] Lock "1daf4f4c-0e4a-4779-b53a-78c48397ea2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120741) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 18:08:41.966014 dv-cinder-852009-8-iscsi devstack@n-api.service[120741]: DEBUG oslo_concurrency.lockutils [None req-e12f184f-e19e-4670-bb10-fd988f737ba6 tempest-TestShelveInstance-6258502 tempest-TestShelveInstance-6258502-project] Lock "1daf4f4c-0e4a-4779-b53a-78c48397ea2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120741) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 18:08:41.966721 dv-cinder-852009-8-iscsi devstack@n-api.service[120741]: DEBUG oslo_concurrency.lockutils [None req-e12f184f-e19e-4670-bb10-fd988f737ba6 tempest-TestShelveInstance-6258502 tempest-TestShelveInstance-6258502-project] Acquiring lock "1daf4f4c-0e4a-4779-b53a-78c48397ea2f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120741) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 18:08:41.967165 dv-cinder-852009-8-iscsi devstack@n-api.service[120741]: DEBUG oslo_concurrency.lockutils [None req-e12f184f-e19e-4670-bb10-fd988f737ba6 tempest-TestShelveInstance-6258502 tempest-TestShelveInstance-6258502-project] Lock "1daf4f4c-0e4a-4779-b53a-78c48397ea2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120741) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 18:08:41.967576 dv-cinder-852009-8-iscsi devstack@n-api.service[120741]: DEBUG oslo_concurrency.lockutils [None req-e12f184f-e19e-4670-bb10-fd988f737ba6 tempest-TestShelveInstance-6258502 tempest-TestShelveInstance-6258502-project] Lock "1daf4f4c-0e4a-4779-b53a-78c48397ea2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120741) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 18:08:41.981545 dv-cinder-852009-8-iscsi devstack@n-api.service[120740]: DEBUG nova.policy [None req-65e8421c-5ed1-4698-959a-709f4dbbf5ec tempest-AttachVolumeNegativeTest-1378806597 tempest-AttachVolumeNegativeTest-1378806597-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '714cd09ba19b492f9a8c80343abcf6b9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '629311eda0584a5fbb7d8995cf27540c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120740) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 18:08:41.989774 dv-cinder-852009-8-iscsi devstack@n-api.service[120740]: INFO nova.api.openstack.requestlog [None req-65e8421c-5ed1-4698-959a-709f4dbbf5ec tempest-AttachVolumeNegativeTest-1378806597 tempest-AttachVolumeNegativeTest-1378806597-project] 10.222.0.43 "GET /compute/v2.1/servers/75289327-97d1-42bd-a6c7-6f2b1aa3236a" status: 200 len: 1366 microversion: 2.1 time: 0.215466 Sep 13 18:08:41.990258 dv-cinder-852009-8-iscsi devstack@n-api.service[120740]: [pid: 120740|app: 0|req: 366/723] 10.222.0.43 () {58 vars in 1236 bytes} [Tue Sep 13 18:08:41 2022] GET /compute/v2.1/servers/75289327-97d1-42bd-a6c7-6f2b1aa3236a => generated 1366 bytes in 217 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 13 18:08:41.994182 dv-cinder-852009-8-iscsi devstack@n-api.service[120741]: DEBUG nova.compute.api [None req-e12f184f-e19e-4670-bb10-fd988f737ba6 tempest-TestShelveInstance-6258502 tempest-TestShelveInstance-6258502-project] [instance: 2d60cc6d-a699-417d-aa20-fe3e1bfc351e] Going to try to terminate instance {{(pid=120741) delete /opt/stack/nova/nova/compute/api.py:2719}} Sep 13 18:08:41.996845 dv-cinder-852009-8-iscsi devstack@n-api.service[120740]: DEBUG nova.api.openstack.wsgi [req-c52a3c04-1c05-4115-a7ff-e86c66bc94f3 req-db77aa2b-350d-41e7-ba63-12cd0c3db6a7 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "2d60cc6d-a699-417d-aa20-fe3e1bfc351e", "tag": "fa199ada-f924-4f1a-9116-5daf985f618d"}]} {{(pid=120740) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 13 18:08:42.008311 dv-cinder-852009-8-iscsi devstack@n-api.service[120740]: DEBUG oslo_concurrency.lockutils [req-c52a3c04-1c05-4115-a7ff-e86c66bc94f3 req-db77aa2b-350d-41e7-ba63-12cd0c3db6a7 service nova] Acquiring lock "1daf4f4c-0e4a-4779-b53a-78c48397ea2f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120740) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 18:08:42.009042 dv-cinder-852009-8-iscsi devstack@n-api.service[120740]: DEBUG oslo_concurrency.lockutils [req-c52a3c04-1c05-4115-a7ff-e86c66bc94f3 req-db77aa2b-350d-41e7-ba63-12cd0c3db6a7 service nova] Lock "1daf4f4c-0e4a-4779-b53a-78c48397ea2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120740) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 18:08:42.009555 dv-cinder-852009-8-iscsi devstack@n-api.service[120740]: DEBUG oslo_concurrency.lockutils [req-c52a3c04-1c05-4115-a7ff-e86c66bc94f3 req-db77aa2b-350d-41e7-ba63-12cd0c3db6a7 service nova] Lock "1daf4f4c-0e4a-4779-b53a-78c48397ea2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120740) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 18:08:42.021589 dv-cinder-852009-8-iscsi devstack@n-api.service[120740]: INFO nova.api.openstack.compute.server_external_events [req-c52a3c04-1c05-4115-a7ff-e86c66bc94f3 req-db77aa2b-350d-41e7-ba63-12cd0c3db6a7 service nova] Creating event network-changed:fa199ada-f924-4f1a-9116-5daf985f618d for instance 2d60cc6d-a699-417d-aa20-fe3e1bfc351e on hv-cinder-85200 Sep 13 18:08:42.026698 dv-cinder-852009-8-iscsi devstack@n-api.service[120740]: INFO nova.api.openstack.requestlog [req-c52a3c04-1c05-4115-a7ff-e86c66bc94f3 req-db77aa2b-350d-41e7-ba63-12cd0c3db6a7 service nova] 10.222.0.43 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.035001 Sep 13 18:08:42.027305 dv-cinder-852009-8-iscsi devstack@n-api.service[120740]: [pid: 120740|app: 0|req: 367/724] 10.222.0.43 () {64 vars in 1317 bytes} [Tue Sep 13 18:08:41 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 36 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 13 18:08:42.082170 dv-cinder-852009-8-iscsi devstack@n-api.service[120741]: INFO nova.api.openstack.requestlog [None req-e12f184f-e19e-4670-bb10-fd988f737ba6 tempest-TestShelveInstance-6258502 tempest-TestShelveInstance-6258502-project] 10.222.0.43 "DELETE /compute/v2.1/servers/2d60cc6d-a699-417d-aa20-fe3e1bfc351e" status: 204 len: 0 microversion: 2.1 time: 0.130662 Sep 13 18:08:42.086473 dv-cinder-852009-8-iscsi devstack@n-api.service[120741]: [pid: 120741|app: 0|req: 358/725] 10.222.0.43 () {58 vars in 1239 bytes} [Tue Sep 13 18:08:41 2022] DELETE /compute/v2.1/servers/2d60cc6d-a699-417d-aa20-fe3e1bfc351e => generated 0 bytes in 133 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Sep 13 18:08:42.092487 dv-cinder-852009-8-iscsi devstack@n-api.service[120740]: DEBUG nova.api.openstack.wsgi [None req-0df60c08-a54a-49a0-863f-00df6924ec9e tempest-TestShelveInstance-6258502 tempest-TestShelveInstance-6258502-project] Calling method '>' {{(pid=120740) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 18:08:42.093257 dv-cinder-852009-8-iscsi devstack@n-api.service[120740]: DEBUG nova.compute.api [None req-0df60c08-a54a-49a0-863f-00df6924ec9e tempest-TestShelveInstance-6258502 tempest-TestShelveInstance-6258502-project] [instance: 2d60cc6d-a699-417d-aa20-fe3e1bfc351e] Fetching instance by UUID {{(pid=120740) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 18:08:42.099641 dv-cinder-852009-8-iscsi devstack@n-api.service[120740]: DEBUG oslo_concurrency.lockutils [None req-0df60c08-a54a-49a0-863f-00df6924ec9e tempest-TestShelveInstance-6258502 tempest-TestShelveInstance-6258502-project] Acquiring lock "1daf4f4c-0e4a-4779-b53a-78c48397ea2f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120740) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 18:08:42.100199 dv-cinder-852009-8-iscsi devstack@n-api.service[120740]: DEBUG oslo_concurrency.lockutils [None req-0df60c08-a54a-49a0-863f-00df6924ec9e tempest-TestShelveInstance-6258502 tempest-TestShelveInstance-6258502-project] Lock "1daf4f4c-0e4a-4779-b53a-78c48397ea2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120740) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 18:08:42.100734 dv-cinder-852009-8-iscsi devstack@n-api.service[120740]: DEBUG oslo_concurrency.lockutils [None req-0df60c08-a54a-49a0-863f-00df6924ec9e tempest-TestShelveInstance-6258502 tempest-TestShelveInstance-6258502-project] Lock "1daf4f4c-0e4a-4779-b53a-78c48397ea2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120740) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 18:08:42.101497 dv-cinder-852009-8-iscsi devstack@n-api.service[120740]: DEBUG oslo_concurrency.lockutils [None req-0df60c08-a54a-49a0-863f-00df6924ec9e tempest-TestShelveInstance-6258502 tempest-TestShelveInstance-6258502-project] Acquiring lock "1daf4f4c-0e4a-4779-b53a-78c48397ea2f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120740) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 18:08:42.102014 dv-cinder-852009-8-iscsi devstack@n-api.service[120740]: DEBUG oslo_concurrency.lockutils [None req-0df60c08-a54a-49a0-863f-00df6924ec9e tempest-TestShelveInstance-6258502 tempest-TestShelveInstance-6258502-project] Lock "1daf4f4c-0e4a-4779-b53a-78c48397ea2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120740) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 18:08:42.102526 dv-cinder-852009-8-iscsi devstack@n-api.service[120740]: DEBUG oslo_concurrency.lockutils [None req-0df60c08-a54a-49a0-863f-00df6924ec9e tempest-TestShelveInstance-6258502 tempest-TestShelveInstance-6258502-project] Lock "1daf4f4c-0e4a-4779-b53a-78c48397ea2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120740) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 18:08:42.239610 dv-cinder-852009-8-iscsi devstack@n-api.service[120740]: DEBUG nova.policy [None req-0df60c08-a54a-49a0-863f-00df6924ec9e tempest-TestShelveInstance-6258502 tempest-TestShelveInstance-6258502-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2ab9930d6ce54cacbb3d4fd6313294d5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5eafd54351bd4049b87ad308a3638f80', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120740) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 18:08:42.250132 dv-cinder-852009-8-iscsi devstack@n-api.service[120740]: INFO nova.api.openstack.requestlog [None req-0df60c08-a54a-49a0-863f-00df6924ec9e tempest-TestShelveInstance-6258502 tempest-TestShelveInstance-6258502-project] 10.222.0.43 "GET /compute/v2.1/servers/2d60cc6d-a699-417d-aa20-fe3e1bfc351e" status: 200 len: 1570 microversion: 2.1 time: 0.161780 Sep 13 18:08:42.250788 dv-cinder-852009-8-iscsi devstack@n-api.service[120740]: [pid: 120740|app: 0|req: 368/726] 10.222.0.43 () {58 vars in 1236 bytes} [Tue Sep 13 18:08:42 2022] GET /compute/v2.1/servers/2d60cc6d-a699-417d-aa20-fe3e1bfc351e => generated 1570 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 13 18:08:43.015922 dv-cinder-852009-8-iscsi devstack@n-api.service[120741]: DEBUG nova.api.openstack.wsgi [None req-13e236d2-4601-4bf1-bd43-dbf2948215e8 tempest-AttachVolumeNegativeTest-1378806597 tempest-AttachVolumeNegativeTest-1378806597-project] Calling method '>' {{(pid=120741) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 18:08:43.016661 dv-cinder-852009-8-iscsi devstack@n-api.service[120741]: DEBUG nova.compute.api [None req-13e236d2-4601-4bf1-bd43-dbf2948215e8 tempest-AttachVolumeNegativeTest-1378806597 tempest-AttachVolumeNegativeTest-1378806597-project] [instance: 75289327-97d1-42bd-a6c7-6f2b1aa3236a] Fetching instance by UUID {{(pid=120741) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 18:08:43.023345 dv-cinder-852009-8-iscsi devstack@n-api.service[120741]: DEBUG oslo_concurrency.lockutils [None req-13e236d2-4601-4bf1-bd43-dbf2948215e8 tempest-AttachVolumeNegativeTest-1378806597 tempest-AttachVolumeNegativeTest-1378806597-project] Acquiring lock "1daf4f4c-0e4a-4779-b53a-78c48397ea2f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120741) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 18:08:43.023830 dv-cinder-852009-8-iscsi devstack@n-api.service[120741]: DEBUG oslo_concurrency.lockutils [None req-13e236d2-4601-4bf1-bd43-dbf2948215e8 tempest-AttachVolumeNegativeTest-1378806597 tempest-AttachVolumeNegativeTest-1378806597-project] Lock "1daf4f4c-0e4a-4779-b53a-78c48397ea2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120741) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 18:08:43.024265 dv-cinder-852009-8-iscsi devstack@n-api.service[120741]: DEBUG oslo_concurrency.lockutils [None req-13e236d2-4601-4bf1-bd43-dbf2948215e8 tempest-AttachVolumeNegativeTest-1378806597 tempest-AttachVolumeNegativeTest-1378806597-project] Lock "1daf4f4c-0e4a-4779-b53a-78c48397ea2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120741) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 18:08:43.025063 dv-cinder-852009-8-iscsi devstack@n-api.service[120741]: DEBUG oslo_concurrency.lockutils [None req-13e236d2-4601-4bf1-bd43-dbf2948215e8 tempest-AttachVolumeNegativeTest-1378806597 tempest-AttachVolumeNegativeTest-1378806597-project] Acquiring lock "1daf4f4c-0e4a-4779-b53a-78c48397ea2f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120741) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 18:08:43.025554 dv-cinder-852009-8-iscsi devstack@n-api.service[120741]: DEBUG oslo_concurrency.lockutils [None req-13e236d2-4601-4bf1-bd43-dbf2948215e8 tempest-AttachVolumeNegativeTest-1378806597 tempest-AttachVolumeNegativeTest-1378806597-project] Lock "1daf4f4c-0e4a-4779-b53a-78c48397ea2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120741) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 18:08:43.026094 dv-cinder-852009-8-iscsi devstack@n-api.service[120741]: DEBUG oslo_concurrency.lockutils [None req-13e236d2-4601-4bf1-bd43-dbf2948215e8 tempest-AttachVolumeNegativeTest-1378806597 tempest-AttachVolumeNegativeTest-1378806597-project] Lock "1daf4f4c-0e4a-4779-b53a-78c48397ea2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120741) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 18:08:43.158504 dv-cinder-852009-8-iscsi devstack@n-api.service[120741]: DEBUG nova.policy [None req-13e236d2-4601-4bf1-bd43-dbf2948215e8 tempest-AttachVolumeNegativeTest-1378806597 tempest-AttachVolumeNegativeTest-1378806597-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '714cd09ba19b492f9a8c80343abcf6b9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '629311eda0584a5fbb7d8995cf27540c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120741) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 18:08:43.166683 dv-cinder-852009-8-iscsi devstack@n-api.service[120741]: INFO nova.api.openstack.requestlog [None req-13e236d2-4601-4bf1-bd43-dbf2948215e8 tempest-AttachVolumeNegativeTest-1378806597 tempest-AttachVolumeNegativeTest-1378806597-project] 10.222.0.43 "GET /compute/v2.1/servers/75289327-97d1-42bd-a6c7-6f2b1aa3236a" status: 200 len: 1366 microversion: 2.1 time: 0.155131 Sep 13 18:08:43.167267 dv-cinder-852009-8-iscsi devstack@n-api.service[120741]: [pid: 120741|app: 0|req: 359/727] 10.222.0.43 () {58 vars in 1236 bytes} [Tue Sep 13 18:08:43 2022] GET /compute/v2.1/servers/75289327-97d1-42bd-a6c7-6f2b1aa3236a => generated 1366 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 13 18:08:43.273957 dv-cinder-852009-8-iscsi devstack@n-api.service[120740]: DEBUG nova.api.openstack.wsgi [None req-b78df5b3-190c-4179-aba9-b589c829f622 tempest-TestShelveInstance-6258502 tempest-TestShelveInstance-6258502-project] Calling method '>' {{(pid=120740) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 18:08:43.274517 dv-cinder-852009-8-iscsi devstack@n-api.service[120740]: DEBUG nova.compute.api [None req-b78df5b3-190c-4179-aba9-b589c829f622 tempest-TestShelveInstance-6258502 tempest-TestShelveInstance-6258502-project] [instance: 2d60cc6d-a699-417d-aa20-fe3e1bfc351e] Fetching instance by UUID {{(pid=120740) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 18:08:43.281331 dv-cinder-852009-8-iscsi devstack@n-api.service[120740]: DEBUG oslo_concurrency.lockutils [None req-b78df5b3-190c-4179-aba9-b589c829f622 tempest-TestShelveInstance-6258502 tempest-TestShelveInstance-6258502-project] Acquiring lock "1daf4f4c-0e4a-4779-b53a-78c48397ea2f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120740) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 18:08:43.281819 dv-cinder-852009-8-iscsi devstack@n-api.service[120740]: DEBUG oslo_concurrency.lockutils [None req-b78df5b3-190c-4179-aba9-b589c829f622 tempest-TestShelveInstance-6258502 tempest-TestShelveInstance-6258502-project] Lock "1daf4f4c-0e4a-4779-b53a-78c48397ea2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120740) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 18:08:43.282246 dv-cinder-852009-8-iscsi devstack@n-api.service[120740]: DEBUG oslo_concurrency.lockutils [None req-b78df5b3-190c-4179-aba9-b589c829f622 tempest-TestShelveInstance-6258502 tempest-TestShelveInstance-6258502-project] Lock "1daf4f4c-0e4a-4779-b53a-78c48397ea2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120740) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 18:08:43.282950 dv-cinder-852009-8-iscsi devstack@n-api.service[120740]: DEBUG oslo_concurrency.lockutils [None req-b78df5b3-190c-4179-aba9-b589c829f622 tempest-TestShelveInstance-6258502 tempest-TestShelveInstance-6258502-project] Acquiring lock "1daf4f4c-0e4a-4779-b53a-78c48397ea2f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120740) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 18:08:43.283399 dv-cinder-852009-8-iscsi devstack@n-api.service[120740]: DEBUG oslo_concurrency.lockutils [None req-b78df5b3-190c-4179-aba9-b589c829f622 tempest-TestShelveInstance-6258502 tempest-TestShelveInstance-6258502-project] Lock "1daf4f4c-0e4a-4779-b53a-78c48397ea2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120740) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 18:08:43.283819 dv-cinder-852009-8-iscsi devstack@n-api.service[120740]: DEBUG oslo_concurrency.lockutils [None req-b78df5b3-190c-4179-aba9-b589c829f622 tempest-TestShelveInstance-6258502 tempest-TestShelveInstance-6258502-project] Lock "1daf4f4c-0e4a-4779-b53a-78c48397ea2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120740) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 18:08:43.429240 dv-cinder-852009-8-iscsi devstack@n-api.service[120740]: DEBUG nova.policy [None req-b78df5b3-190c-4179-aba9-b589c829f622 tempest-TestShelveInstance-6258502 tempest-TestShelveInstance-6258502-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2ab9930d6ce54cacbb3d4fd6313294d5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5eafd54351bd4049b87ad308a3638f80', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120740) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 18:08:43.441147 dv-cinder-852009-8-iscsi devstack@n-api.service[120740]: INFO nova.api.openstack.requestlog [None req-b78df5b3-190c-4179-aba9-b589c829f622 tempest-TestShelveInstance-6258502 tempest-TestShelveInstance-6258502-project] 10.222.0.43 "GET /compute/v2.1/servers/2d60cc6d-a699-417d-aa20-fe3e1bfc351e" status: 200 len: 1570 microversion: 2.1 time: 0.170917 Sep 13 18:08:43.446071 dv-cinder-852009-8-iscsi devstack@n-api.service[120740]: [pid: 120740|app: 0|req: 369/728] 10.222.0.43 () {58 vars in 1236 bytes} [Tue Sep 13 18:08:43 2022] GET /compute/v2.1/servers/2d60cc6d-a699-417d-aa20-fe3e1bfc351e => generated 1570 bytes in 176 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 13 18:08:44.191076 dv-cinder-852009-8-iscsi devstack@n-api.service[120741]: DEBUG nova.api.openstack.wsgi [None req-8f27cb32-a2b2-4efc-acb3-2979e6b6c12b tempest-AttachVolumeNegativeTest-1378806597 tempest-AttachVolumeNegativeTest-1378806597-project] Calling method '>' {{(pid=120741) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 18:08:44.191787 dv-cinder-852009-8-iscsi devstack@n-api.service[120741]: DEBUG nova.compute.api [None req-8f27cb32-a2b2-4efc-acb3-2979e6b6c12b tempest-AttachVolumeNegativeTest-1378806597 tempest-AttachVolumeNegativeTest-1378806597-project] [instance: 75289327-97d1-42bd-a6c7-6f2b1aa3236a] Fetching instance by UUID {{(pid=120741) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 18:08:44.199493 dv-cinder-852009-8-iscsi devstack@n-api.service[120741]: DEBUG oslo_concurrency.lockutils [None req-8f27cb32-a2b2-4efc-acb3-2979e6b6c12b tempest-AttachVolumeNegativeTest-1378806597 tempest-AttachVolumeNegativeTest-1378806597-project] Acquiring lock "1daf4f4c-0e4a-4779-b53a-78c48397ea2f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120741) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 18:08:44.199980 dv-cinder-852009-8-iscsi devstack@n-api.service[120741]: DEBUG oslo_concurrency.lockutils [None req-8f27cb32-a2b2-4efc-acb3-2979e6b6c12b tempest-AttachVolumeNegativeTest-1378806597 tempest-AttachVolumeNegativeTest-1378806597-project] Lock "1daf4f4c-0e4a-4779-b53a-78c48397ea2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120741) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 18:08:44.200412 dv-cinder-852009-8-iscsi devstack@n-api.service[120741]: DEBUG oslo_concurrency.lockutils [None req-8f27cb32-a2b2-4efc-acb3-2979e6b6c12b tempest-AttachVolumeNegativeTest-1378806597 tempest-AttachVolumeNegativeTest-1378806597-project] Lock "1daf4f4c-0e4a-4779-b53a-78c48397ea2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120741) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 18:08:44.201135 dv-cinder-852009-8-iscsi devstack@n-api.service[120741]: DEBUG oslo_concurrency.lockutils [None req-8f27cb32-a2b2-4efc-acb3-2979e6b6c12b tempest-AttachVolumeNegativeTest-1378806597 tempest-AttachVolumeNegativeTest-1378806597-project] Acquiring lock "1daf4f4c-0e4a-4779-b53a-78c48397ea2f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120741) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 18:08:44.201585 dv-cinder-852009-8-iscsi devstack@n-api.service[120741]: DEBUG oslo_concurrency.lockutils [None req-8f27cb32-a2b2-4efc-acb3-2979e6b6c12b tempest-AttachVolumeNegativeTest-1378806597 tempest-AttachVolumeNegativeTest-1378806597-project] Lock "1daf4f4c-0e4a-4779-b53a-78c48397ea2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120741) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 18:08:44.202005 dv-cinder-852009-8-iscsi devstack@n-api.service[120741]: DEBUG oslo_concurrency.lockutils [None req-8f27cb32-a2b2-4efc-acb3-2979e6b6c12b tempest-AttachVolumeNegativeTest-1378806597 tempest-AttachVolumeNegativeTest-1378806597-project] Lock "1daf4f4c-0e4a-4779-b53a-78c48397ea2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120741) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 18:08:44.340116 dv-cinder-852009-8-iscsi devstack@n-api.service[120741]: DEBUG nova.policy [None req-8f27cb32-a2b2-4efc-acb3-2979e6b6c12b tempest-AttachVolumeNegativeTest-1378806597 tempest-AttachVolumeNegativeTest-1378806597-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '714cd09ba19b492f9a8c80343abcf6b9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '629311eda0584a5fbb7d8995cf27540c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120741) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 18:08:44.348206 dv-cinder-852009-8-iscsi devstack@n-api.service[120741]: INFO nova.api.openstack.requestlog [None req-8f27cb32-a2b2-4efc-acb3-2979e6b6c12b tempest-AttachVolumeNegativeTest-1378806597 tempest-AttachVolumeNegativeTest-1378806597-project] 10.222.0.43 "GET /compute/v2.1/servers/75289327-97d1-42bd-a6c7-6f2b1aa3236a" status: 200 len: 1366 microversion: 2.1 time: 0.161754 Sep 13 18:08:44.348894 dv-cinder-852009-8-iscsi devstack@n-api.service[120741]: [pid: 120741|app: 0|req: 360/729] 10.222.0.43 () {58 vars in 1236 bytes} [Tue Sep 13 18:08:44 2022] GET /compute/v2.1/servers/75289327-97d1-42bd-a6c7-6f2b1aa3236a => generated 1366 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 13 18:08:44.467008 dv-cinder-852009-8-iscsi devstack@n-api.service[120740]: DEBUG nova.api.openstack.wsgi [None req-9f3f6963-b538-4581-a426-8cfb787a7137 tempest-TestShelveInstance-6258502 tempest-TestShelveInstance-6258502-project] Calling method '>' {{(pid=120740) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 18:08:44.467574 dv-cinder-852009-8-iscsi devstack@n-api.service[120740]: DEBUG nova.compute.api [None req-9f3f6963-b538-4581-a426-8cfb787a7137 tempest-TestShelveInstance-6258502 tempest-TestShelveInstance-6258502-project] [instance: 2d60cc6d-a699-417d-aa20-fe3e1bfc351e] Fetching instance by UUID {{(pid=120740) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 18:08:44.474643 dv-cinder-852009-8-iscsi devstack@n-api.service[120740]: DEBUG oslo_concurrency.lockutils [None req-9f3f6963-b538-4581-a426-8cfb787a7137 tempest-TestShelveInstance-6258502 tempest-TestShelveInstance-6258502-project] Acquiring lock "1daf4f4c-0e4a-4779-b53a-78c48397ea2f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120740) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 18:08:44.475175 dv-cinder-852009-8-iscsi devstack@n-api.service[120740]: DEBUG oslo_concurrency.lockutils [None req-9f3f6963-b538-4581-a426-8cfb787a7137 tempest-TestShelveInstance-6258502 tempest-TestShelveInstance-6258502-project] Lock "1daf4f4c-0e4a-4779-b53a-78c48397ea2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120740) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 18:08:44.475612 dv-cinder-852009-8-iscsi devstack@n-api.service[120740]: DEBUG oslo_concurrency.lockutils [None req-9f3f6963-b538-4581-a426-8cfb787a7137 tempest-TestShelveInstance-6258502 tempest-TestShelveInstance-6258502-project] Lock "1daf4f4c-0e4a-4779-b53a-78c48397ea2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120740) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 18:08:44.476317 dv-cinder-852009-8-iscsi devstack@n-api.service[120740]: DEBUG oslo_concurrency.lockutils [None req-9f3f6963-b538-4581-a426-8cfb787a7137 tempest-TestShelveInstance-6258502 tempest-TestShelveInstance-6258502-project] Acquiring lock "1daf4f4c-0e4a-4779-b53a-78c48397ea2f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120740) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 18:08:44.476946 dv-cinder-852009-8-iscsi devstack@n-api.service[120740]: DEBUG oslo_concurrency.lockutils [None req-9f3f6963-b538-4581-a426-8cfb787a7137 tempest-TestShelveInstance-6258502 tempest-TestShelveInstance-6258502-project] Lock "1daf4f4c-0e4a-4779-b53a-78c48397ea2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120740) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 18:08:44.477168 dv-cinder-852009-8-iscsi devstack@n-api.service[120740]: DEBUG oslo_concurrency.lockutils [None req-9f3f6963-b538-4581-a426-8cfb787a7137 tempest-TestShelveInstance-6258502 tempest-TestShelveInstance-6258502-project] Lock "1daf4f4c-0e4a-4779-b53a-78c48397ea2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120740) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 18:08:44.635783 dv-cinder-852009-8-iscsi devstack@n-api.service[120740]: DEBUG nova.policy [None req-9f3f6963-b538-4581-a426-8cfb787a7137 tempest-TestShelveInstance-6258502 tempest-TestShelveInstance-6258502-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2ab9930d6ce54cacbb3d4fd6313294d5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5eafd54351bd4049b87ad308a3638f80', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120740) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 18:08:44.644262 dv-cinder-852009-8-iscsi devstack@n-api.service[120740]: INFO nova.api.openstack.requestlog [None req-9f3f6963-b538-4581-a426-8cfb787a7137 tempest-TestShelveInstance-6258502 tempest-TestShelveInstance-6258502-project] 10.222.0.43 "GET /compute/v2.1/servers/2d60cc6d-a699-417d-aa20-fe3e1bfc351e" status: 200 len: 1570 microversion: 2.1 time: 0.181535 Sep 13 18:08:44.644962 dv-cinder-852009-8-iscsi devstack@n-api.service[120740]: [pid: 120740|app: 0|req: 370/730] 10.222.0.43 () {58 vars in 1236 bytes} [Tue Sep 13 18:08:44 2022] GET /compute/v2.1/servers/2d60cc6d-a699-417d-aa20-fe3e1bfc351e => generated 1570 bytes in 183 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 13 18:08:45.375640 dv-cinder-852009-8-iscsi devstack@n-api.service[120741]: DEBUG nova.api.openstack.wsgi [None req-00314b12-19f6-415c-89f5-4dd96246c618 tempest-AttachVolumeNegativeTest-1378806597 tempest-AttachVolumeNegativeTest-1378806597-project] Calling method '>' {{(pid=120741) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 18:08:45.377334 dv-cinder-852009-8-iscsi devstack@n-api.service[120741]: DEBUG nova.compute.api [None req-00314b12-19f6-415c-89f5-4dd96246c618 tempest-AttachVolumeNegativeTest-1378806597 tempest-AttachVolumeNegativeTest-1378806597-project] [instance: 75289327-97d1-42bd-a6c7-6f2b1aa3236a] Fetching instance by UUID {{(pid=120741) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 18:08:45.383807 dv-cinder-852009-8-iscsi devstack@n-api.service[120741]: DEBUG oslo_concurrency.lockutils [None req-00314b12-19f6-415c-89f5-4dd96246c618 tempest-AttachVolumeNegativeTest-1378806597 tempest-AttachVolumeNegativeTest-1378806597-project] Acquiring lock "1daf4f4c-0e4a-4779-b53a-78c48397ea2f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120741) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 18:08:45.384301 dv-cinder-852009-8-iscsi devstack@n-api.service[120741]: DEBUG oslo_concurrency.lockutils [None req-00314b12-19f6-415c-89f5-4dd96246c618 tempest-AttachVolumeNegativeTest-1378806597 tempest-AttachVolumeNegativeTest-1378806597-project] Lock "1daf4f4c-0e4a-4779-b53a-78c48397ea2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120741) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 18:08:45.385451 dv-cinder-852009-8-iscsi devstack@n-api.service[120741]: DEBUG oslo_concurrency.lockutils [None req-00314b12-19f6-415c-89f5-4dd96246c618 tempest-AttachVolumeNegativeTest-1378806597 tempest-AttachVolumeNegativeTest-1378806597-project] Lock "1daf4f4c-0e4a-4779-b53a-78c48397ea2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120741) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 18:08:45.386284 dv-cinder-852009-8-iscsi devstack@n-api.service[120741]: DEBUG oslo_concurrency.lockutils [None req-00314b12-19f6-415c-89f5-4dd96246c618 tempest-AttachVolumeNegativeTest-1378806597 tempest-AttachVolumeNegativeTest-1378806597-project] Acquiring lock "1daf4f4c-0e4a-4779-b53a-78c48397ea2f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120741) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 18:08:45.386823 dv-cinder-852009-8-iscsi devstack@n-api.service[120741]: DEBUG oslo_concurrency.lockutils [None req-00314b12-19f6-415c-89f5-4dd96246c618 tempest-AttachVolumeNegativeTest-1378806597 tempest-AttachVolumeNegativeTest-1378806597-project] Lock "1daf4f4c-0e4a-4779-b53a-78c48397ea2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120741) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 18:08:45.387248 dv-cinder-852009-8-iscsi devstack@n-api.service[120741]: DEBUG oslo_concurrency.lockutils [None req-00314b12-19f6-415c-89f5-4dd96246c618 tempest-AttachVolumeNegativeTest-1378806597 tempest-AttachVolumeNegativeTest-1378806597-project] Lock "1daf4f4c-0e4a-4779-b53a-78c48397ea2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120741) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 18:08:45.561089 dv-cinder-852009-8-iscsi devstack@n-api.service[120740]: DEBUG nova.api.openstack.wsgi [req-792491cc-5bfd-4098-8298-ace4d8029529 req-bfb0c70a-2eeb-4459-b389-a7e4647cdfbc service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "2d60cc6d-a699-417d-aa20-fe3e1bfc351e", "name": "network-vif-deleted", "tag": "fa199ada-f924-4f1a-9116-5daf985f618d"}]} {{(pid=120740) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 13 18:08:45.574029 dv-cinder-852009-8-iscsi devstack@n-api.service[120740]: DEBUG oslo_concurrency.lockutils [req-792491cc-5bfd-4098-8298-ace4d8029529 req-bfb0c70a-2eeb-4459-b389-a7e4647cdfbc service nova] Acquiring lock "1daf4f4c-0e4a-4779-b53a-78c48397ea2f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120740) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 18:08:45.574907 dv-cinder-852009-8-iscsi devstack@n-api.service[120740]: DEBUG oslo_concurrency.lockutils [req-792491cc-5bfd-4098-8298-ace4d8029529 req-bfb0c70a-2eeb-4459-b389-a7e4647cdfbc service nova] Lock "1daf4f4c-0e4a-4779-b53a-78c48397ea2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120740) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 18:08:45.575326 dv-cinder-852009-8-iscsi devstack@n-api.service[120740]: DEBUG oslo_concurrency.lockutils [req-792491cc-5bfd-4098-8298-ace4d8029529 req-bfb0c70a-2eeb-4459-b389-a7e4647cdfbc service nova] Lock "1daf4f4c-0e4a-4779-b53a-78c48397ea2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120740) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 18:08:45.600596 dv-cinder-852009-8-iscsi devstack@n-api.service[120740]: INFO nova.api.openstack.compute.server_external_events [req-792491cc-5bfd-4098-8298-ace4d8029529 req-bfb0c70a-2eeb-4459-b389-a7e4647cdfbc service nova] Creating event network-vif-deleted:fa199ada-f924-4f1a-9116-5daf985f618d for instance 2d60cc6d-a699-417d-aa20-fe3e1bfc351e on hv-cinder-85200 Sep 13 18:08:45.609381 dv-cinder-852009-8-iscsi devstack@n-api.service[120741]: DEBUG nova.policy [None req-00314b12-19f6-415c-89f5-4dd96246c618 tempest-AttachVolumeNegativeTest-1378806597 tempest-AttachVolumeNegativeTest-1378806597-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '714cd09ba19b492f9a8c80343abcf6b9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '629311eda0584a5fbb7d8995cf27540c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120741) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 18:08:45.613527 dv-cinder-852009-8-iscsi devstack@n-api.service[120740]: INFO nova.api.openstack.requestlog [req-792491cc-5bfd-4098-8298-ace4d8029529 req-bfb0c70a-2eeb-4459-b389-a7e4647cdfbc service nova] 10.222.0.43 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.055856 Sep 13 18:08:45.618311 dv-cinder-852009-8-iscsi devstack@n-api.service[120740]: [pid: 120740|app: 0|req: 371/731] 10.222.0.43 () {64 vars in 1317 bytes} [Tue Sep 13 18:08:45 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 62 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 13 18:08:45.622334 dv-cinder-852009-8-iscsi devstack@n-api.service[120741]: INFO nova.api.openstack.requestlog [None req-00314b12-19f6-415c-89f5-4dd96246c618 tempest-AttachVolumeNegativeTest-1378806597 tempest-AttachVolumeNegativeTest-1378806597-project] 10.222.0.43 "GET /compute/v2.1/servers/75289327-97d1-42bd-a6c7-6f2b1aa3236a" status: 200 len: 1366 microversion: 2.1 time: 0.251325 Sep 13 18:08:45.629676 dv-cinder-852009-8-iscsi devstack@n-api.service[120741]: [pid: 120741|app: 0|req: 361/732] 10.222.0.43 () {58 vars in 1236 bytes} [Tue Sep 13 18:08:45 2022] GET /compute/v2.1/servers/75289327-97d1-42bd-a6c7-6f2b1aa3236a => generated 1366 bytes in 253 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 13 18:08:45.669226 dv-cinder-852009-8-iscsi devstack@n-api.service[120740]: DEBUG nova.api.openstack.wsgi [None req-cf7c29f3-913b-4ca5-8288-8b49072b41f1 tempest-TestShelveInstance-6258502 tempest-TestShelveInstance-6258502-project] Calling method '>' {{(pid=120740) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 18:08:45.669930 dv-cinder-852009-8-iscsi devstack@n-api.service[120740]: DEBUG nova.compute.api [None req-cf7c29f3-913b-4ca5-8288-8b49072b41f1 tempest-TestShelveInstance-6258502 tempest-TestShelveInstance-6258502-project] [instance: 2d60cc6d-a699-417d-aa20-fe3e1bfc351e] Fetching instance by UUID {{(pid=120740) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 18:08:45.675978 dv-cinder-852009-8-iscsi devstack@n-api.service[120740]: DEBUG oslo_concurrency.lockutils [None req-cf7c29f3-913b-4ca5-8288-8b49072b41f1 tempest-TestShelveInstance-6258502 tempest-TestShelveInstance-6258502-project] Acquiring lock "1daf4f4c-0e4a-4779-b53a-78c48397ea2f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120740) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 18:08:45.676469 dv-cinder-852009-8-iscsi devstack@n-api.service[120740]: DEBUG oslo_concurrency.lockutils [None req-cf7c29f3-913b-4ca5-8288-8b49072b41f1 tempest-TestShelveInstance-6258502 tempest-TestShelveInstance-6258502-project] Lock "1daf4f4c-0e4a-4779-b53a-78c48397ea2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120740) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 18:08:45.676903 dv-cinder-852009-8-iscsi devstack@n-api.service[120740]: DEBUG oslo_concurrency.lockutils [None req-cf7c29f3-913b-4ca5-8288-8b49072b41f1 tempest-TestShelveInstance-6258502 tempest-TestShelveInstance-6258502-project] Lock "1daf4f4c-0e4a-4779-b53a-78c48397ea2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120740) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 18:08:45.677589 dv-cinder-852009-8-iscsi devstack@n-api.service[120740]: DEBUG oslo_concurrency.lockutils [None req-cf7c29f3-913b-4ca5-8288-8b49072b41f1 tempest-TestShelveInstance-6258502 tempest-TestShelveInstance-6258502-project] Acquiring lock "1daf4f4c-0e4a-4779-b53a-78c48397ea2f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120740) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 18:08:45.678038 dv-cinder-852009-8-iscsi devstack@n-api.service[120740]: DEBUG oslo_concurrency.lockutils [None req-cf7c29f3-913b-4ca5-8288-8b49072b41f1 tempest-TestShelveInstance-6258502 tempest-TestShelveInstance-6258502-project] Lock "1daf4f4c-0e4a-4779-b53a-78c48397ea2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120740) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 18:08:45.678463 dv-cinder-852009-8-iscsi devstack@n-api.service[120740]: DEBUG oslo_concurrency.lockutils [None req-cf7c29f3-913b-4ca5-8288-8b49072b41f1 tempest-TestShelveInstance-6258502 tempest-TestShelveInstance-6258502-project] Lock "1daf4f4c-0e4a-4779-b53a-78c48397ea2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120740) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 18:08:45.744143 dv-cinder-852009-8-iscsi devstack@n-api.service[120740]: DEBUG nova.policy [None req-cf7c29f3-913b-4ca5-8288-8b49072b41f1 tempest-TestShelveInstance-6258502 tempest-TestShelveInstance-6258502-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2ab9930d6ce54cacbb3d4fd6313294d5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5eafd54351bd4049b87ad308a3638f80', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120740) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 18:08:45.752660 dv-cinder-852009-8-iscsi devstack@n-api.service[120740]: INFO nova.api.openstack.requestlog [None req-cf7c29f3-913b-4ca5-8288-8b49072b41f1 tempest-TestShelveInstance-6258502 tempest-TestShelveInstance-6258502-project] 10.222.0.43 "GET /compute/v2.1/servers/2d60cc6d-a699-417d-aa20-fe3e1bfc351e" status: 200 len: 1383 microversion: 2.1 time: 0.087505 Sep 13 18:08:45.753334 dv-cinder-852009-8-iscsi devstack@n-api.service[120740]: [pid: 120740|app: 0|req: 372/733] 10.222.0.43 () {58 vars in 1236 bytes} [Tue Sep 13 18:08:45 2022] GET /compute/v2.1/servers/2d60cc6d-a699-417d-aa20-fe3e1bfc351e => generated 1383 bytes in 89 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 13 18:08:46.651611 dv-cinder-852009-8-iscsi devstack@n-api.service[120741]: DEBUG nova.api.openstack.wsgi [None req-139b7b36-ae38-4690-881b-2adefd358a0b tempest-AttachVolumeNegativeTest-1378806597 tempest-AttachVolumeNegativeTest-1378806597-project] Calling method '>' {{(pid=120741) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 18:08:46.652685 dv-cinder-852009-8-iscsi devstack@n-api.service[120741]: DEBUG nova.compute.api [None req-139b7b36-ae38-4690-881b-2adefd358a0b tempest-AttachVolumeNegativeTest-1378806597 tempest-AttachVolumeNegativeTest-1378806597-project] [instance: 75289327-97d1-42bd-a6c7-6f2b1aa3236a] Fetching instance by UUID {{(pid=120741) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 18:08:46.662824 dv-cinder-852009-8-iscsi devstack@n-api.service[120741]: DEBUG oslo_concurrency.lockutils [None req-139b7b36-ae38-4690-881b-2adefd358a0b tempest-AttachVolumeNegativeTest-1378806597 tempest-AttachVolumeNegativeTest-1378806597-project] Acquiring lock "1daf4f4c-0e4a-4779-b53a-78c48397ea2f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120741) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 18:08:46.663619 dv-cinder-852009-8-iscsi devstack@n-api.service[120741]: DEBUG oslo_concurrency.lockutils [None req-139b7b36-ae38-4690-881b-2adefd358a0b tempest-AttachVolumeNegativeTest-1378806597 tempest-AttachVolumeNegativeTest-1378806597-project] Lock "1daf4f4c-0e4a-4779-b53a-78c48397ea2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120741) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 18:08:46.664339 dv-cinder-852009-8-iscsi devstack@n-api.service[120741]: DEBUG oslo_concurrency.lockutils [None req-139b7b36-ae38-4690-881b-2adefd358a0b tempest-AttachVolumeNegativeTest-1378806597 tempest-AttachVolumeNegativeTest-1378806597-project] Lock "1daf4f4c-0e4a-4779-b53a-78c48397ea2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120741) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 18:08:46.665672 dv-cinder-852009-8-iscsi devstack@n-api.service[120741]: DEBUG oslo_concurrency.lockutils [None req-139b7b36-ae38-4690-881b-2adefd358a0b tempest-AttachVolumeNegativeTest-1378806597 tempest-AttachVolumeNegativeTest-1378806597-project] Acquiring lock "1daf4f4c-0e4a-4779-b53a-78c48397ea2f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120741) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 18:08:46.666172 dv-cinder-852009-8-iscsi devstack@n-api.service[120741]: DEBUG oslo_concurrency.lockutils [None req-139b7b36-ae38-4690-881b-2adefd358a0b tempest-AttachVolumeNegativeTest-1378806597 tempest-AttachVolumeNegativeTest-1378806597-project] Lock "1daf4f4c-0e4a-4779-b53a-78c48397ea2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120741) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 18:08:46.666594 dv-cinder-852009-8-iscsi devstack@n-api.service[120741]: DEBUG oslo_concurrency.lockutils [None req-139b7b36-ae38-4690-881b-2adefd358a0b tempest-AttachVolumeNegativeTest-1378806597 tempest-AttachVolumeNegativeTest-1378806597-project] Lock "1daf4f4c-0e4a-4779-b53a-78c48397ea2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120741) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 18:08:46.775362 dv-cinder-852009-8-iscsi devstack@n-api.service[120740]: DEBUG nova.api.openstack.wsgi [None req-ca3958e4-f479-4a22-a080-09732671ea1d tempest-TestShelveInstance-6258502 tempest-TestShelveInstance-6258502-project] Calling method '>' {{(pid=120740) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 18:08:46.775962 dv-cinder-852009-8-iscsi devstack@n-api.service[120740]: DEBUG nova.compute.api [None req-ca3958e4-f479-4a22-a080-09732671ea1d tempest-TestShelveInstance-6258502 tempest-TestShelveInstance-6258502-project] [instance: 2d60cc6d-a699-417d-aa20-fe3e1bfc351e] Fetching instance by UUID {{(pid=120740) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 18:08:46.782539 dv-cinder-852009-8-iscsi devstack@n-api.service[120740]: DEBUG oslo_concurrency.lockutils [None req-ca3958e4-f479-4a22-a080-09732671ea1d tempest-TestShelveInstance-6258502 tempest-TestShelveInstance-6258502-project] Acquiring lock "1daf4f4c-0e4a-4779-b53a-78c48397ea2f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120740) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 18:08:46.783060 dv-cinder-852009-8-iscsi devstack@n-api.service[120740]: DEBUG oslo_concurrency.lockutils [None req-ca3958e4-f479-4a22-a080-09732671ea1d tempest-TestShelveInstance-6258502 tempest-TestShelveInstance-6258502-project] Lock "1daf4f4c-0e4a-4779-b53a-78c48397ea2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120740) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 18:08:46.783493 dv-cinder-852009-8-iscsi devstack@n-api.service[120740]: DEBUG oslo_concurrency.lockutils [None req-ca3958e4-f479-4a22-a080-09732671ea1d tempest-TestShelveInstance-6258502 tempest-TestShelveInstance-6258502-project] Lock "1daf4f4c-0e4a-4779-b53a-78c48397ea2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120740) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 18:08:46.784192 dv-cinder-852009-8-iscsi devstack@n-api.service[120740]: DEBUG oslo_concurrency.lockutils [None req-ca3958e4-f479-4a22-a080-09732671ea1d tempest-TestShelveInstance-6258502 tempest-TestShelveInstance-6258502-project] Acquiring lock "1daf4f4c-0e4a-4779-b53a-78c48397ea2f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120740) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 18:08:46.784677 dv-cinder-852009-8-iscsi devstack@n-api.service[120740]: DEBUG oslo_concurrency.lockutils [None req-ca3958e4-f479-4a22-a080-09732671ea1d tempest-TestShelveInstance-6258502 tempest-TestShelveInstance-6258502-project] Lock "1daf4f4c-0e4a-4779-b53a-78c48397ea2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120740) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 18:08:46.785099 dv-cinder-852009-8-iscsi devstack@n-api.service[120740]: DEBUG oslo_concurrency.lockutils [None req-ca3958e4-f479-4a22-a080-09732671ea1d tempest-TestShelveInstance-6258502 tempest-TestShelveInstance-6258502-project] Lock "1daf4f4c-0e4a-4779-b53a-78c48397ea2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120740) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 18:08:46.798784 dv-cinder-852009-8-iscsi devstack@n-api.service[120740]: INFO nova.api.openstack.wsgi [None req-ca3958e4-f479-4a22-a080-09732671ea1d tempest-TestShelveInstance-6258502 tempest-TestShelveInstance-6258502-project] HTTP exception thrown: Instance 2d60cc6d-a699-417d-aa20-fe3e1bfc351e could not be found. Sep 13 18:08:46.800440 dv-cinder-852009-8-iscsi devstack@n-api.service[120740]: DEBUG nova.api.openstack.wsgi [None req-ca3958e4-f479-4a22-a080-09732671ea1d tempest-TestShelveInstance-6258502 tempest-TestShelveInstance-6258502-project] Request method failure captured: Sep 13 18:08:46.800440 dv-cinder-852009-8-iscsi devstack@n-api.service[120740]: request: GET /compute/v2.1/servers/2d60cc6d-a699-417d-aa20-fe3e1bfc351e HTTP/1.1 Sep 13 18:08:46.800440 dv-cinder-852009-8-iscsi devstack@n-api.service[120740]: Accept: application/json Sep 13 18:08:46.800440 dv-cinder-852009-8-iscsi devstack@n-api.service[120740]: Accept-Encoding: identity Sep 13 18:08:46.800440 dv-cinder-852009-8-iscsi devstack@n-api.service[120740]: Connection: close Sep 13 18:08:46.800440 dv-cinder-852009-8-iscsi devstack@n-api.service[120740]: Content-Length: 0 Sep 13 18:08:46.800440 dv-cinder-852009-8-iscsi devstack@n-api.service[120740]: Content-Type: application/json Sep 13 18:08:46.800440 dv-cinder-852009-8-iscsi devstack@n-api.service[120740]: Host: 10.222.0.43 Sep 13 18:08:46.800440 dv-cinder-852009-8-iscsi devstack@n-api.service[120740]: Openstack-System-Scope: None Sep 13 18:08:46.800440 dv-cinder-852009-8-iscsi devstack@n-api.service[120740]: User-Agent: python-urllib3/1.26.12 Sep 13 18:08:46.800440 dv-cinder-852009-8-iscsi devstack@n-api.service[120740]: X-Auth-Token: gAAAAABjIMXv85_BlSP0sz07KwO_5BQuYIgypdrW_xeS8R7o6TEI1CTqGysx_FUaAouU3wpKNXa0HmVY6fdZX7RbmHqRmNzbgpcaHGoKu81CeD1_DfFV6ns0ZZh0BsEioJaNNGbXjdui6fm-35y5m9zdoIkytobGjsg0qhaFdOfoy0yegDS_kfQ Sep 13 18:08:46.800440 dv-cinder-852009-8-iscsi devstack@n-api.service[120740]: X-Domain-Id: None Sep 13 18:08:46.800440 dv-cinder-852009-8-iscsi devstack@n-api.service[120740]: X-Domain-Name: None Sep 13 18:08:46.800440 dv-cinder-852009-8-iscsi devstack@n-api.service[120740]: X-Identity-Status: Confirmed Sep 13 18:08:46.800440 dv-cinder-852009-8-iscsi devstack@n-api.service[120740]: X-Is-Admin-Project: True Sep 13 18:08:46.800440 dv-cinder-852009-8-iscsi devstack@n-api.service[120740]: X-Project-Domain-Id: default Sep 13 18:08:46.800440 dv-cinder-852009-8-iscsi devstack@n-api.service[120740]: X-Project-Domain-Name: Default Sep 13 18:08:46.800440 dv-cinder-852009-8-iscsi devstack@n-api.service[120740]: X-Project-Id: 5eafd54351bd4049b87ad308a3638f80 Sep 13 18:08:46.800440 dv-cinder-852009-8-iscsi devstack@n-api.service[120740]: X-Project-Name: tempest-TestShelveInstance-6258502 Sep 13 18:08:46.800440 dv-cinder-852009-8-iscsi devstack@n-api.service[120740]: X-Role: reader,member Sep 13 18:08:46.800440 dv-cinder-852009-8-iscsi devstack@n-api.service[120740]: X-Roles: reader,member Sep 13 18:08:46.801853 dv-cinder-852009-8-iscsi devstack@n-api.service[120740]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/identity"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/compute/v2/5eafd54351bd4049b87ad308a3638f80"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.43:8080", "publicURL": "http://10.222.0.43:8080/v1/AUTH_5eafd54351bd4049b87ad308a3638f80"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43:9696/networking"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/volume/v3/5eafd54351bd4049b87ad308a3638f80"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/compute/v2.1"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/placement"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/volume/v3/5eafd54351bd4049b87ad308a3638f80"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/image"}]}] Sep 13 18:08:46.801853 dv-cinder-852009-8-iscsi devstack@n-api.service[120740]: X-Tenant: tempest-TestShelveInstance-6258502 Sep 13 18:08:46.801853 dv-cinder-852009-8-iscsi devstack@n-api.service[120740]: X-Tenant-Id: 5eafd54351bd4049b87ad308a3638f80 Sep 13 18:08:46.801853 dv-cinder-852009-8-iscsi devstack@n-api.service[120740]: X-Tenant-Name: tempest-TestShelveInstance-6258502 Sep 13 18:08:46.801853 dv-cinder-852009-8-iscsi devstack@n-api.service[120740]: X-User: tempest-TestShelveInstance-6258502-project Sep 13 18:08:46.801853 dv-cinder-852009-8-iscsi devstack@n-api.service[120740]: X-User-Domain-Id: default Sep 13 18:08:46.801853 dv-cinder-852009-8-iscsi devstack@n-api.service[120740]: X-User-Domain-Name: Default Sep 13 18:08:46.801853 dv-cinder-852009-8-iscsi devstack@n-api.service[120740]: X-User-Id: 2ab9930d6ce54cacbb3d4fd6313294d5 Sep 13 18:08:46.801853 dv-cinder-852009-8-iscsi devstack@n-api.service[120740]: X-User-Name: tempest-TestShelveInstance-6258502-project Sep 13 18:08:46.801853 dv-cinder-852009-8-iscsi devstack@n-api.service[120740]: method: > Sep 13 18:08:46.801853 dv-cinder-852009-8-iscsi devstack@n-api.service[120740]: exception: Instance 2d60cc6d-a699-417d-aa20-fe3e1bfc351e could not be found. Sep 13 18:08:46.801853 dv-cinder-852009-8-iscsi devstack@n-api.service[120740]: action_args: {'id': '2d60cc6d-a699-417d-aa20-fe3e1bfc351e'} Sep 13 18:08:46.802751 dv-cinder-852009-8-iscsi devstack@n-api.service[120740]: {{(pid=120740) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 13 18:08:46.802751 dv-cinder-852009-8-iscsi devstack@n-api.service[120740]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 13 18:08:46.802751 dv-cinder-852009-8-iscsi devstack@n-api.service[120740]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Sep 13 18:08:46.802751 dv-cinder-852009-8-iscsi devstack@n-api.service[120740]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Sep 13 18:08:46.802751 dv-cinder-852009-8-iscsi devstack@n-api.service[120740]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Sep 13 18:08:46.802751 dv-cinder-852009-8-iscsi devstack@n-api.service[120740]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Sep 13 18:08:46.802751 dv-cinder-852009-8-iscsi devstack@n-api.service[120740]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Sep 13 18:08:46.802751 dv-cinder-852009-8-iscsi devstack@n-api.service[120740]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Sep 13 18:08:46.802751 dv-cinder-852009-8-iscsi devstack@n-api.service[120740]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Sep 13 18:08:46.802751 dv-cinder-852009-8-iscsi devstack@n-api.service[120740]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Sep 13 18:08:46.802751 dv-cinder-852009-8-iscsi devstack@n-api.service[120740]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 2d60cc6d-a699-417d-aa20-fe3e1bfc351e could not be found. Sep 13 18:08:46.802751 dv-cinder-852009-8-iscsi devstack@n-api.service[120740]: ERROR nova.api.openstack.wsgi Sep 13 18:08:46.802751 dv-cinder-852009-8-iscsi devstack@n-api.service[120740]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 13 18:08:46.802751 dv-cinder-852009-8-iscsi devstack@n-api.service[120740]: ERROR nova.api.openstack.wsgi Sep 13 18:08:46.802751 dv-cinder-852009-8-iscsi devstack@n-api.service[120740]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 13 18:08:46.802751 dv-cinder-852009-8-iscsi devstack@n-api.service[120740]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 13 18:08:46.802751 dv-cinder-852009-8-iscsi devstack@n-api.service[120740]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 13 18:08:46.802751 dv-cinder-852009-8-iscsi devstack@n-api.service[120740]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 13 18:08:46.802751 dv-cinder-852009-8-iscsi devstack@n-api.service[120740]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 13 18:08:46.802751 dv-cinder-852009-8-iscsi devstack@n-api.service[120740]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 13 18:08:46.804107 dv-cinder-852009-8-iscsi devstack@n-api.service[120740]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 13 18:08:46.804107 dv-cinder-852009-8-iscsi devstack@n-api.service[120740]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Sep 13 18:08:46.804107 dv-cinder-852009-8-iscsi devstack@n-api.service[120740]: ERROR nova.api.openstack.wsgi instance = self._get_server( Sep 13 18:08:46.804107 dv-cinder-852009-8-iscsi devstack@n-api.service[120740]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Sep 13 18:08:46.804107 dv-cinder-852009-8-iscsi devstack@n-api.service[120740]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Sep 13 18:08:46.804107 dv-cinder-852009-8-iscsi devstack@n-api.service[120740]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Sep 13 18:08:46.804107 dv-cinder-852009-8-iscsi devstack@n-api.service[120740]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Sep 13 18:08:46.804107 dv-cinder-852009-8-iscsi devstack@n-api.service[120740]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 2d60cc6d-a699-417d-aa20-fe3e1bfc351e could not be found. Sep 13 18:08:46.804107 dv-cinder-852009-8-iscsi devstack@n-api.service[120740]: ERROR nova.api.openstack.wsgi Sep 13 18:08:46.804107 dv-cinder-852009-8-iscsi devstack@n-api.service[120740]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 13 18:08:46.804107 dv-cinder-852009-8-iscsi devstack@n-api.service[120740]: ERROR nova.api.openstack.wsgi Sep 13 18:08:46.804107 dv-cinder-852009-8-iscsi devstack@n-api.service[120740]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 13 18:08:46.804107 dv-cinder-852009-8-iscsi devstack@n-api.service[120740]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 13 18:08:46.804107 dv-cinder-852009-8-iscsi devstack@n-api.service[120740]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 13 18:08:46.804107 dv-cinder-852009-8-iscsi devstack@n-api.service[120740]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 13 18:08:46.804107 dv-cinder-852009-8-iscsi devstack@n-api.service[120740]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 13 18:08:46.804107 dv-cinder-852009-8-iscsi devstack@n-api.service[120740]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 2d60cc6d-a699-417d-aa20-fe3e1bfc351e could not be found. Sep 13 18:08:46.804107 dv-cinder-852009-8-iscsi devstack@n-api.service[120740]: ERROR nova.api.openstack.wsgi Sep 13 18:08:46.805333 dv-cinder-852009-8-iscsi devstack@n-api.service[120740]: DEBUG nova.api.openstack.wsgi [None req-ca3958e4-f479-4a22-a080-09732671ea1d tempest-TestShelveInstance-6258502 tempest-TestShelveInstance-6258502-project] Returning 404 to user: Instance 2d60cc6d-a699-417d-aa20-fe3e1bfc351e could not be found. {{(pid=120740) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 13 18:08:46.805333 dv-cinder-852009-8-iscsi devstack@n-api.service[120740]: INFO nova.api.openstack.requestlog [None req-ca3958e4-f479-4a22-a080-09732671ea1d tempest-TestShelveInstance-6258502 tempest-TestShelveInstance-6258502-project] 10.222.0.43 "GET /compute/v2.1/servers/2d60cc6d-a699-417d-aa20-fe3e1bfc351e" status: 404 len: 111 microversion: 2.1 time: 0.030532 Sep 13 18:08:46.805333 dv-cinder-852009-8-iscsi devstack@n-api.service[120740]: [pid: 120740|app: 0|req: 373/734] 10.222.0.43 () {58 vars in 1236 bytes} [Tue Sep 13 18:08:46 2022] GET /compute/v2.1/servers/2d60cc6d-a699-417d-aa20-fe3e1bfc351e => generated 111 bytes in 32 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Sep 13 18:08:46.805533 dv-cinder-852009-8-iscsi devstack@n-api.service[120741]: DEBUG nova.policy [None req-139b7b36-ae38-4690-881b-2adefd358a0b tempest-AttachVolumeNegativeTest-1378806597 tempest-AttachVolumeNegativeTest-1378806597-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '714cd09ba19b492f9a8c80343abcf6b9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '629311eda0584a5fbb7d8995cf27540c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120741) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 18:08:46.811451 dv-cinder-852009-8-iscsi devstack@n-api.service[120741]: INFO nova.api.openstack.requestlog [None req-139b7b36-ae38-4690-881b-2adefd358a0b tempest-AttachVolumeNegativeTest-1378806597 tempest-AttachVolumeNegativeTest-1378806597-project] 10.222.0.43 "GET /compute/v2.1/servers/75289327-97d1-42bd-a6c7-6f2b1aa3236a" status: 200 len: 1366 microversion: 2.1 time: 0.167392 Sep 13 18:08:46.812216 dv-cinder-852009-8-iscsi devstack@n-api.service[120741]: [pid: 120741|app: 0|req: 362/735] 10.222.0.43 () {58 vars in 1236 bytes} [Tue Sep 13 18:08:46 2022] GET /compute/v2.1/servers/75289327-97d1-42bd-a6c7-6f2b1aa3236a => generated 1366 bytes in 169 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 13 18:08:46.970873 dv-cinder-852009-8-iscsi devstack@n-api.service[120740]: DEBUG nova.api.openstack.wsgi [None req-fd574495-b155-4f0c-96cd-7f6fd230aa36 tempest-TestShelveInstance-6258502 tempest-TestShelveInstance-6258502-project] Calling method '.version_select at 0x7fa626a25f70>' {{(pid=120740) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 18:08:46.990255 dv-cinder-852009-8-iscsi devstack@n-api.service[120740]: INFO nova.api.openstack.requestlog [None req-fd574495-b155-4f0c-96cd-7f6fd230aa36 tempest-TestShelveInstance-6258502 tempest-TestShelveInstance-6258502-project] 10.222.0.43 "DELETE /compute/v2.1/os-keypairs/tempest-TestShelveInstance-1588373406" status: 202 len: 0 microversion: 2.1 time: 0.023137 Sep 13 18:08:46.991318 dv-cinder-852009-8-iscsi devstack@n-api.service[120740]: [pid: 120740|app: 0|req: 374/736] 10.222.0.43 () {58 vars in 1254 bytes} [Tue Sep 13 18:08:46 2022] DELETE /compute/v2.1/os-keypairs/tempest-TestShelveInstance-1588373406 => generated 0 bytes in 25 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Sep 13 18:08:47.834480 dv-cinder-852009-8-iscsi devstack@n-api.service[120741]: DEBUG nova.api.openstack.wsgi [None req-6cbe23b5-39a8-470c-8b60-536a04235199 tempest-AttachVolumeNegativeTest-1378806597 tempest-AttachVolumeNegativeTest-1378806597-project] Calling method '>' {{(pid=120741) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 18:08:47.835222 dv-cinder-852009-8-iscsi devstack@n-api.service[120741]: DEBUG nova.compute.api [None req-6cbe23b5-39a8-470c-8b60-536a04235199 tempest-AttachVolumeNegativeTest-1378806597 tempest-AttachVolumeNegativeTest-1378806597-project] [instance: 75289327-97d1-42bd-a6c7-6f2b1aa3236a] Fetching instance by UUID {{(pid=120741) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 18:08:47.838468 dv-cinder-852009-8-iscsi devstack@n-api.service[120741]: DEBUG dbcounter [-] [120741] Writing DB stats nova_cell0:SELECT=6 {{(pid=120741) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 18:08:47.842855 dv-cinder-852009-8-iscsi devstack@n-api.service[120741]: DEBUG oslo_concurrency.lockutils [None req-6cbe23b5-39a8-470c-8b60-536a04235199 tempest-AttachVolumeNegativeTest-1378806597 tempest-AttachVolumeNegativeTest-1378806597-project] Acquiring lock "1daf4f4c-0e4a-4779-b53a-78c48397ea2f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120741) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 18:08:47.843585 dv-cinder-852009-8-iscsi devstack@n-api.service[120741]: DEBUG oslo_concurrency.lockutils [None req-6cbe23b5-39a8-470c-8b60-536a04235199 tempest-AttachVolumeNegativeTest-1378806597 tempest-AttachVolumeNegativeTest-1378806597-project] Lock "1daf4f4c-0e4a-4779-b53a-78c48397ea2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120741) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 18:08:47.844220 dv-cinder-852009-8-iscsi devstack@n-api.service[120741]: DEBUG oslo_concurrency.lockutils [None req-6cbe23b5-39a8-470c-8b60-536a04235199 tempest-AttachVolumeNegativeTest-1378806597 tempest-AttachVolumeNegativeTest-1378806597-project] Lock "1daf4f4c-0e4a-4779-b53a-78c48397ea2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120741) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 18:08:47.845127 dv-cinder-852009-8-iscsi devstack@n-api.service[120741]: DEBUG oslo_concurrency.lockutils [None req-6cbe23b5-39a8-470c-8b60-536a04235199 tempest-AttachVolumeNegativeTest-1378806597 tempest-AttachVolumeNegativeTest-1378806597-project] Acquiring lock "1daf4f4c-0e4a-4779-b53a-78c48397ea2f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120741) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 18:08:47.845766 dv-cinder-852009-8-iscsi devstack@n-api.service[120741]: DEBUG oslo_concurrency.lockutils [None req-6cbe23b5-39a8-470c-8b60-536a04235199 tempest-AttachVolumeNegativeTest-1378806597 tempest-AttachVolumeNegativeTest-1378806597-project] Lock "1daf4f4c-0e4a-4779-b53a-78c48397ea2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120741) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 18:08:47.846393 dv-cinder-852009-8-iscsi devstack@n-api.service[120741]: DEBUG oslo_concurrency.lockutils [None req-6cbe23b5-39a8-470c-8b60-536a04235199 tempest-AttachVolumeNegativeTest-1378806597 tempest-AttachVolumeNegativeTest-1378806597-project] Lock "1daf4f4c-0e4a-4779-b53a-78c48397ea2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120741) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 18:08:48.084830 dv-cinder-852009-8-iscsi devstack@n-api.service[120740]: DEBUG nova.api.openstack.wsgi [req-e2fa9f35-9db0-44bf-9bce-302a48ad8ae9 req-79f5eeec-8094-40ed-b99d-626020df3d73 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "75289327-97d1-42bd-a6c7-6f2b1aa3236a", "name": "network-vif-plugged", "status": "completed", "tag": "4df04d71-3866-4544-aec1-8f254829f81c"}]} {{(pid=120740) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 13 18:08:48.100667 dv-cinder-852009-8-iscsi devstack@n-api.service[120740]: DEBUG dbcounter [-] [120740] Writing DB stats nova_cell0:SELECT=2 {{(pid=120740) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 18:08:48.101872 dv-cinder-852009-8-iscsi devstack@n-api.service[120740]: DEBUG dbcounter [-] [120740] Writing DB stats nova_cell0:SELECT=6 {{(pid=120740) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 18:08:48.105240 dv-cinder-852009-8-iscsi devstack@n-api.service[120740]: DEBUG oslo_concurrency.lockutils [req-e2fa9f35-9db0-44bf-9bce-302a48ad8ae9 req-79f5eeec-8094-40ed-b99d-626020df3d73 service nova] Acquiring lock "1daf4f4c-0e4a-4779-b53a-78c48397ea2f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120740) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 18:08:48.106147 dv-cinder-852009-8-iscsi devstack@n-api.service[120740]: DEBUG oslo_concurrency.lockutils [req-e2fa9f35-9db0-44bf-9bce-302a48ad8ae9 req-79f5eeec-8094-40ed-b99d-626020df3d73 service nova] Lock "1daf4f4c-0e4a-4779-b53a-78c48397ea2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120740) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 18:08:48.106898 dv-cinder-852009-8-iscsi devstack@n-api.service[120740]: DEBUG oslo_concurrency.lockutils [req-e2fa9f35-9db0-44bf-9bce-302a48ad8ae9 req-79f5eeec-8094-40ed-b99d-626020df3d73 service nova] Lock "1daf4f4c-0e4a-4779-b53a-78c48397ea2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120740) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 18:08:48.121841 dv-cinder-852009-8-iscsi devstack@n-api.service[120740]: INFO nova.api.openstack.compute.server_external_events [req-e2fa9f35-9db0-44bf-9bce-302a48ad8ae9 req-79f5eeec-8094-40ed-b99d-626020df3d73 service nova] Creating event network-vif-plugged:4df04d71-3866-4544-aec1-8f254829f81c for instance 75289327-97d1-42bd-a6c7-6f2b1aa3236a on hv-cinder-85200 Sep 13 18:08:48.131416 dv-cinder-852009-8-iscsi devstack@n-api.service[120740]: INFO nova.api.openstack.requestlog [req-e2fa9f35-9db0-44bf-9bce-302a48ad8ae9 req-79f5eeec-8094-40ed-b99d-626020df3d73 service nova] 10.222.0.43 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.054385 Sep 13 18:08:48.131802 dv-cinder-852009-8-iscsi devstack@n-api.service[120741]: DEBUG nova.policy [None req-6cbe23b5-39a8-470c-8b60-536a04235199 tempest-AttachVolumeNegativeTest-1378806597 tempest-AttachVolumeNegativeTest-1378806597-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '714cd09ba19b492f9a8c80343abcf6b9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '629311eda0584a5fbb7d8995cf27540c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120741) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 18:08:48.133022 dv-cinder-852009-8-iscsi devstack@n-api.service[120740]: [pid: 120740|app: 0|req: 375/737] 10.222.0.43 () {64 vars in 1317 bytes} [Tue Sep 13 18:08:48 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 57 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 13 18:08:48.146816 dv-cinder-852009-8-iscsi devstack@n-api.service[120741]: INFO nova.api.openstack.requestlog [None req-6cbe23b5-39a8-470c-8b60-536a04235199 tempest-AttachVolumeNegativeTest-1378806597 tempest-AttachVolumeNegativeTest-1378806597-project] 10.222.0.43 "GET /compute/v2.1/servers/75289327-97d1-42bd-a6c7-6f2b1aa3236a" status: 200 len: 1366 microversion: 2.1 time: 0.316085 Sep 13 18:08:48.148157 dv-cinder-852009-8-iscsi devstack@n-api.service[120741]: [pid: 120741|app: 0|req: 363/738] 10.222.0.43 () {58 vars in 1236 bytes} [Tue Sep 13 18:08:47 2022] GET /compute/v2.1/servers/75289327-97d1-42bd-a6c7-6f2b1aa3236a => generated 1366 bytes in 318 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 13 18:08:49.199185 dv-cinder-852009-8-iscsi devstack@n-api.service[120740]: DEBUG nova.api.openstack.wsgi [None req-aaf27608-4651-4b75-9e16-9151b330b3df tempest-AttachVolumeNegativeTest-1378806597 tempest-AttachVolumeNegativeTest-1378806597-project] Calling method '>' {{(pid=120740) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 18:08:49.200106 dv-cinder-852009-8-iscsi devstack@n-api.service[120740]: DEBUG nova.compute.api [None req-aaf27608-4651-4b75-9e16-9151b330b3df tempest-AttachVolumeNegativeTest-1378806597 tempest-AttachVolumeNegativeTest-1378806597-project] [instance: 75289327-97d1-42bd-a6c7-6f2b1aa3236a] Fetching instance by UUID {{(pid=120740) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 18:08:49.206774 dv-cinder-852009-8-iscsi devstack@n-api.service[120740]: DEBUG oslo_concurrency.lockutils [None req-aaf27608-4651-4b75-9e16-9151b330b3df tempest-AttachVolumeNegativeTest-1378806597 tempest-AttachVolumeNegativeTest-1378806597-project] Acquiring lock "1daf4f4c-0e4a-4779-b53a-78c48397ea2f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120740) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 18:08:49.207423 dv-cinder-852009-8-iscsi devstack@n-api.service[120740]: DEBUG oslo_concurrency.lockutils [None req-aaf27608-4651-4b75-9e16-9151b330b3df tempest-AttachVolumeNegativeTest-1378806597 tempest-AttachVolumeNegativeTest-1378806597-project] Lock "1daf4f4c-0e4a-4779-b53a-78c48397ea2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120740) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 18:08:49.207936 dv-cinder-852009-8-iscsi devstack@n-api.service[120740]: DEBUG oslo_concurrency.lockutils [None req-aaf27608-4651-4b75-9e16-9151b330b3df tempest-AttachVolumeNegativeTest-1378806597 tempest-AttachVolumeNegativeTest-1378806597-project] Lock "1daf4f4c-0e4a-4779-b53a-78c48397ea2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120740) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 18:08:49.208765 dv-cinder-852009-8-iscsi devstack@n-api.service[120740]: DEBUG oslo_concurrency.lockutils [None req-aaf27608-4651-4b75-9e16-9151b330b3df tempest-AttachVolumeNegativeTest-1378806597 tempest-AttachVolumeNegativeTest-1378806597-project] Acquiring lock "1daf4f4c-0e4a-4779-b53a-78c48397ea2f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120740) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 18:08:49.209420 dv-cinder-852009-8-iscsi devstack@n-api.service[120740]: DEBUG oslo_concurrency.lockutils [None req-aaf27608-4651-4b75-9e16-9151b330b3df tempest-AttachVolumeNegativeTest-1378806597 tempest-AttachVolumeNegativeTest-1378806597-project] Lock "1daf4f4c-0e4a-4779-b53a-78c48397ea2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120740) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 18:08:49.209861 dv-cinder-852009-8-iscsi devstack@n-api.service[120740]: DEBUG oslo_concurrency.lockutils [None req-aaf27608-4651-4b75-9e16-9151b330b3df tempest-AttachVolumeNegativeTest-1378806597 tempest-AttachVolumeNegativeTest-1378806597-project] Lock "1daf4f4c-0e4a-4779-b53a-78c48397ea2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120740) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 18:08:49.361839 dv-cinder-852009-8-iscsi devstack@n-api.service[120740]: DEBUG nova.policy [None req-aaf27608-4651-4b75-9e16-9151b330b3df tempest-AttachVolumeNegativeTest-1378806597 tempest-AttachVolumeNegativeTest-1378806597-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '714cd09ba19b492f9a8c80343abcf6b9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '629311eda0584a5fbb7d8995cf27540c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120740) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 18:08:49.370024 dv-cinder-852009-8-iscsi devstack@n-api.service[120740]: INFO nova.api.openstack.requestlog [None req-aaf27608-4651-4b75-9e16-9151b330b3df tempest-AttachVolumeNegativeTest-1378806597 tempest-AttachVolumeNegativeTest-1378806597-project] 10.222.0.43 "GET /compute/v2.1/servers/75289327-97d1-42bd-a6c7-6f2b1aa3236a" status: 200 len: 1366 microversion: 2.1 time: 0.176833 Sep 13 18:08:49.371247 dv-cinder-852009-8-iscsi devstack@n-api.service[120740]: [pid: 120740|app: 0|req: 376/739] 10.222.0.43 () {58 vars in 1236 bytes} [Tue Sep 13 18:08:49 2022] GET /compute/v2.1/servers/75289327-97d1-42bd-a6c7-6f2b1aa3236a => generated 1366 bytes in 179 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 13 18:08:50.394084 dv-cinder-852009-8-iscsi devstack@n-api.service[120741]: DEBUG nova.api.openstack.wsgi [None req-8575f0ae-c46b-4d39-9941-a5ca11fa828e tempest-AttachVolumeNegativeTest-1378806597 tempest-AttachVolumeNegativeTest-1378806597-project] Calling method '>' {{(pid=120741) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 18:08:50.395230 dv-cinder-852009-8-iscsi devstack@n-api.service[120741]: DEBUG nova.compute.api [None req-8575f0ae-c46b-4d39-9941-a5ca11fa828e tempest-AttachVolumeNegativeTest-1378806597 tempest-AttachVolumeNegativeTest-1378806597-project] [instance: 75289327-97d1-42bd-a6c7-6f2b1aa3236a] Fetching instance by UUID {{(pid=120741) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 18:08:50.397843 dv-cinder-852009-8-iscsi devstack@n-api.service[120741]: DEBUG dbcounter [-] [120741] Writing DB stats nova_api:SELECT=49,nova_api:INSERT=1,nova_api:UPDATE=1 {{(pid=120741) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 18:08:50.423181 dv-cinder-852009-8-iscsi devstack@n-api.service[120741]: DEBUG oslo_concurrency.lockutils [None req-8575f0ae-c46b-4d39-9941-a5ca11fa828e tempest-AttachVolumeNegativeTest-1378806597 tempest-AttachVolumeNegativeTest-1378806597-project] Acquiring lock "1daf4f4c-0e4a-4779-b53a-78c48397ea2f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120741) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 18:08:50.423668 dv-cinder-852009-8-iscsi devstack@n-api.service[120741]: DEBUG oslo_concurrency.lockutils [None req-8575f0ae-c46b-4d39-9941-a5ca11fa828e tempest-AttachVolumeNegativeTest-1378806597 tempest-AttachVolumeNegativeTest-1378806597-project] Lock "1daf4f4c-0e4a-4779-b53a-78c48397ea2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120741) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 18:08:50.424270 dv-cinder-852009-8-iscsi devstack@n-api.service[120741]: DEBUG oslo_concurrency.lockutils [None req-8575f0ae-c46b-4d39-9941-a5ca11fa828e tempest-AttachVolumeNegativeTest-1378806597 tempest-AttachVolumeNegativeTest-1378806597-project] Lock "1daf4f4c-0e4a-4779-b53a-78c48397ea2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120741) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 18:08:50.425016 dv-cinder-852009-8-iscsi devstack@n-api.service[120741]: DEBUG oslo_concurrency.lockutils [None req-8575f0ae-c46b-4d39-9941-a5ca11fa828e tempest-AttachVolumeNegativeTest-1378806597 tempest-AttachVolumeNegativeTest-1378806597-project] Acquiring lock "1daf4f4c-0e4a-4779-b53a-78c48397ea2f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120741) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 18:08:50.425460 dv-cinder-852009-8-iscsi devstack@n-api.service[120741]: DEBUG oslo_concurrency.lockutils [None req-8575f0ae-c46b-4d39-9941-a5ca11fa828e tempest-AttachVolumeNegativeTest-1378806597 tempest-AttachVolumeNegativeTest-1378806597-project] Lock "1daf4f4c-0e4a-4779-b53a-78c48397ea2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120741) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 18:08:50.426061 dv-cinder-852009-8-iscsi devstack@n-api.service[120741]: DEBUG oslo_concurrency.lockutils [None req-8575f0ae-c46b-4d39-9941-a5ca11fa828e tempest-AttachVolumeNegativeTest-1378806597 tempest-AttachVolumeNegativeTest-1378806597-project] Lock "1daf4f4c-0e4a-4779-b53a-78c48397ea2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120741) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 18:08:50.714501 dv-cinder-852009-8-iscsi devstack@n-api.service[120741]: DEBUG nova.policy [None req-8575f0ae-c46b-4d39-9941-a5ca11fa828e tempest-AttachVolumeNegativeTest-1378806597 tempest-AttachVolumeNegativeTest-1378806597-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '714cd09ba19b492f9a8c80343abcf6b9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '629311eda0584a5fbb7d8995cf27540c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120741) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 18:08:50.723158 dv-cinder-852009-8-iscsi devstack@n-api.service[120741]: INFO nova.api.openstack.requestlog [None req-8575f0ae-c46b-4d39-9941-a5ca11fa828e tempest-AttachVolumeNegativeTest-1378806597 tempest-AttachVolumeNegativeTest-1378806597-project] 10.222.0.43 "GET /compute/v2.1/servers/75289327-97d1-42bd-a6c7-6f2b1aa3236a" status: 200 len: 1557 microversion: 2.1 time: 0.332876 Sep 13 18:08:50.723728 dv-cinder-852009-8-iscsi devstack@n-api.service[120741]: [pid: 120741|app: 0|req: 364/740] 10.222.0.43 () {58 vars in 1236 bytes} [Tue Sep 13 18:08:50 2022] GET /compute/v2.1/servers/75289327-97d1-42bd-a6c7-6f2b1aa3236a => generated 1557 bytes in 334 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 13 18:08:50.746660 dv-cinder-852009-8-iscsi devstack@n-api.service[120740]: DEBUG nova.api.openstack.wsgi [None req-c4a6a67a-187c-40a8-a57e-2a8bbd631ef2 tempest-AttachVolumeNegativeTest-1378806597 tempest-AttachVolumeNegativeTest-1378806597-project] Calling method '>' {{(pid=120740) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 18:08:50.747170 dv-cinder-852009-8-iscsi devstack@n-api.service[120740]: DEBUG nova.compute.api [None req-c4a6a67a-187c-40a8-a57e-2a8bbd631ef2 tempest-AttachVolumeNegativeTest-1378806597 tempest-AttachVolumeNegativeTest-1378806597-project] [instance: 75289327-97d1-42bd-a6c7-6f2b1aa3236a] Fetching instance by UUID {{(pid=120740) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 18:08:50.760622 dv-cinder-852009-8-iscsi devstack@n-api.service[120740]: DEBUG oslo_concurrency.lockutils [None req-c4a6a67a-187c-40a8-a57e-2a8bbd631ef2 tempest-AttachVolumeNegativeTest-1378806597 tempest-AttachVolumeNegativeTest-1378806597-project] Acquiring lock "1daf4f4c-0e4a-4779-b53a-78c48397ea2f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120740) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 18:08:50.760622 dv-cinder-852009-8-iscsi devstack@n-api.service[120740]: DEBUG oslo_concurrency.lockutils [None req-c4a6a67a-187c-40a8-a57e-2a8bbd631ef2 tempest-AttachVolumeNegativeTest-1378806597 tempest-AttachVolumeNegativeTest-1378806597-project] Lock "1daf4f4c-0e4a-4779-b53a-78c48397ea2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120740) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 18:08:50.760622 dv-cinder-852009-8-iscsi devstack@n-api.service[120740]: DEBUG oslo_concurrency.lockutils [None req-c4a6a67a-187c-40a8-a57e-2a8bbd631ef2 tempest-AttachVolumeNegativeTest-1378806597 tempest-AttachVolumeNegativeTest-1378806597-project] Lock "1daf4f4c-0e4a-4779-b53a-78c48397ea2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120740) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 18:08:50.760622 dv-cinder-852009-8-iscsi devstack@n-api.service[120740]: DEBUG oslo_concurrency.lockutils [None req-c4a6a67a-187c-40a8-a57e-2a8bbd631ef2 tempest-AttachVolumeNegativeTest-1378806597 tempest-AttachVolumeNegativeTest-1378806597-project] Acquiring lock "1daf4f4c-0e4a-4779-b53a-78c48397ea2f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120740) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 18:08:50.760992 dv-cinder-852009-8-iscsi devstack@n-api.service[120740]: DEBUG oslo_concurrency.lockutils [None req-c4a6a67a-187c-40a8-a57e-2a8bbd631ef2 tempest-AttachVolumeNegativeTest-1378806597 tempest-AttachVolumeNegativeTest-1378806597-project] Lock "1daf4f4c-0e4a-4779-b53a-78c48397ea2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120740) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 18:08:50.760992 dv-cinder-852009-8-iscsi devstack@n-api.service[120740]: DEBUG oslo_concurrency.lockutils [None req-c4a6a67a-187c-40a8-a57e-2a8bbd631ef2 tempest-AttachVolumeNegativeTest-1378806597 tempest-AttachVolumeNegativeTest-1378806597-project] Lock "1daf4f4c-0e4a-4779-b53a-78c48397ea2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120740) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 18:08:50.912669 dv-cinder-852009-8-iscsi devstack@n-api.service[120740]: INFO nova.api.openstack.requestlog [None req-c4a6a67a-187c-40a8-a57e-2a8bbd631ef2 tempest-AttachVolumeNegativeTest-1378806597 tempest-AttachVolumeNegativeTest-1378806597-project] 10.222.0.43 "GET /compute/v2.1/servers/75289327-97d1-42bd-a6c7-6f2b1aa3236a/os-interface" status: 200 len: 285 microversion: 2.1 time: 0.170141 Sep 13 18:08:50.913688 dv-cinder-852009-8-iscsi devstack@n-api.service[120740]: [pid: 120740|app: 0|req: 377/741] 10.222.0.43 () {58 vars in 1275 bytes} [Tue Sep 13 18:08:50 2022] GET /compute/v2.1/servers/75289327-97d1-42bd-a6c7-6f2b1aa3236a/os-interface => generated 285 bytes in 172 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 13 18:08:52.688912 dv-cinder-852009-8-iscsi devstack@n-api.service[120741]: DEBUG nova.api.openstack.wsgi [req-e4fa6326-a2f9-4b88-a179-26a7752fbcb3 req-28403c20-00f0-4344-8f0e-86ff6b65eea7 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "75289327-97d1-42bd-a6c7-6f2b1aa3236a", "tag": "4df04d71-3866-4544-aec1-8f254829f81c"}]} {{(pid=120741) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 13 18:08:52.703080 dv-cinder-852009-8-iscsi devstack@n-api.service[120741]: DEBUG oslo_concurrency.lockutils [req-e4fa6326-a2f9-4b88-a179-26a7752fbcb3 req-28403c20-00f0-4344-8f0e-86ff6b65eea7 service nova] Acquiring lock "1daf4f4c-0e4a-4779-b53a-78c48397ea2f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120741) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 18:08:52.703738 dv-cinder-852009-8-iscsi devstack@n-api.service[120741]: DEBUG oslo_concurrency.lockutils [req-e4fa6326-a2f9-4b88-a179-26a7752fbcb3 req-28403c20-00f0-4344-8f0e-86ff6b65eea7 service nova] Lock "1daf4f4c-0e4a-4779-b53a-78c48397ea2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120741) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 18:08:52.704172 dv-cinder-852009-8-iscsi devstack@n-api.service[120741]: DEBUG oslo_concurrency.lockutils [req-e4fa6326-a2f9-4b88-a179-26a7752fbcb3 req-28403c20-00f0-4344-8f0e-86ff6b65eea7 service nova] Lock "1daf4f4c-0e4a-4779-b53a-78c48397ea2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120741) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 18:08:52.718860 dv-cinder-852009-8-iscsi devstack@n-api.service[120741]: INFO nova.api.openstack.compute.server_external_events [req-e4fa6326-a2f9-4b88-a179-26a7752fbcb3 req-28403c20-00f0-4344-8f0e-86ff6b65eea7 service nova] Creating event network-changed:4df04d71-3866-4544-aec1-8f254829f81c for instance 75289327-97d1-42bd-a6c7-6f2b1aa3236a on hv-cinder-85200 Sep 13 18:08:52.724649 dv-cinder-852009-8-iscsi devstack@n-api.service[120741]: INFO nova.api.openstack.requestlog [req-e4fa6326-a2f9-4b88-a179-26a7752fbcb3 req-28403c20-00f0-4344-8f0e-86ff6b65eea7 service nova] 10.222.0.43 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.039562 Sep 13 18:08:52.725639 dv-cinder-852009-8-iscsi devstack@n-api.service[120741]: [pid: 120741|app: 0|req: 365/742] 10.222.0.43 () {64 vars in 1317 bytes} [Tue Sep 13 18:08:52 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 41 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 13 18:09:02.753840 dv-cinder-852009-8-iscsi devstack@n-api.service[120740]: DEBUG dbcounter [-] [120740] Writing DB stats nova_api:SELECT=44,nova_api:INSERT=3,nova_api:DELETE=1 {{(pid=120740) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 18:09:02.754728 dv-cinder-852009-8-iscsi devstack@n-api.service[120740]: DEBUG dbcounter [-] [120740] Writing DB stats nova_cell1:SELECT=58 {{(pid=120740) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 18:09:02.759004 dv-cinder-852009-8-iscsi devstack@n-api.service[120740]: DEBUG nova.api.openstack.wsgi [None req-ae44d1e0-82f2-4377-b508-abaee8113112 tempest-VolumesSnapshotTestJSON-1753826991 tempest-VolumesSnapshotTestJSON-1753826991-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-VolumesSnapshotTestJSON-instance-1898529535", "imageRef": "33034e36-e6b2-4847-92a1-ff3188c05a4a", "flavorRef": "452", "networks": [{"uuid": "ca03c818-6af8-4cf9-8e16-a3a21c6ede1c"}]}} {{(pid=120740) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 13 18:09:02.812945 dv-cinder-852009-8-iscsi devstack@n-api.service[120740]: DEBUG nova.network.neutron [None req-ae44d1e0-82f2-4377-b508-abaee8113112 tempest-VolumesSnapshotTestJSON-1753826991 tempest-VolumesSnapshotTestJSON-1753826991-project] validate_networks() for [('ca03c818-6af8-4cf9-8e16-a3a21c6ede1c', None, None, None, None, None)] {{(pid=120740) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Sep 13 18:09:03.166944 dv-cinder-852009-8-iscsi devstack@n-api.service[120740]: DEBUG nova.virt.hardware [None req-ae44d1e0-82f2-4377-b508-abaee8113112 tempest-VolumesSnapshotTestJSON-1753826991 tempest-VolumesSnapshotTestJSON-1753826991-project] Flavor limits 0:0:0 {{(pid=120740) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Sep 13 18:09:03.167509 dv-cinder-852009-8-iscsi devstack@n-api.service[120740]: DEBUG nova.virt.hardware [None req-ae44d1e0-82f2-4377-b508-abaee8113112 tempest-VolumesSnapshotTestJSON-1753826991 tempest-VolumesSnapshotTestJSON-1753826991-project] Image limits 0:0:0 {{(pid=120740) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Sep 13 18:09:03.167999 dv-cinder-852009-8-iscsi devstack@n-api.service[120740]: DEBUG nova.virt.hardware [None req-ae44d1e0-82f2-4377-b508-abaee8113112 tempest-VolumesSnapshotTestJSON-1753826991 tempest-VolumesSnapshotTestJSON-1753826991-project] Flavor pref 0:0:0 {{(pid=120740) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Sep 13 18:09:03.168403 dv-cinder-852009-8-iscsi devstack@n-api.service[120740]: DEBUG nova.virt.hardware [None req-ae44d1e0-82f2-4377-b508-abaee8113112 tempest-VolumesSnapshotTestJSON-1753826991 tempest-VolumesSnapshotTestJSON-1753826991-project] Image pref 0:0:0 {{(pid=120740) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Sep 13 18:09:03.168855 dv-cinder-852009-8-iscsi devstack@n-api.service[120740]: DEBUG nova.virt.hardware [None req-ae44d1e0-82f2-4377-b508-abaee8113112 tempest-VolumesSnapshotTestJSON-1753826991 tempest-VolumesSnapshotTestJSON-1753826991-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=120740) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Sep 13 18:09:03.177935 dv-cinder-852009-8-iscsi devstack@n-api.service[120740]: DEBUG oslo_concurrency.lockutils [None req-ae44d1e0-82f2-4377-b508-abaee8113112 tempest-VolumesSnapshotTestJSON-1753826991 tempest-VolumesSnapshotTestJSON-1753826991-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120740) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 18:09:03.178344 dv-cinder-852009-8-iscsi devstack@n-api.service[120740]: DEBUG oslo_concurrency.lockutils [None req-ae44d1e0-82f2-4377-b508-abaee8113112 tempest-VolumesSnapshotTestJSON-1753826991 tempest-VolumesSnapshotTestJSON-1753826991-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120740) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 18:09:03.178775 dv-cinder-852009-8-iscsi devstack@n-api.service[120740]: DEBUG oslo_concurrency.lockutils [None req-ae44d1e0-82f2-4377-b508-abaee8113112 tempest-VolumesSnapshotTestJSON-1753826991 tempest-VolumesSnapshotTestJSON-1753826991-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120740) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 18:09:03.179499 dv-cinder-852009-8-iscsi devstack@n-api.service[120740]: DEBUG oslo_concurrency.lockutils [None req-ae44d1e0-82f2-4377-b508-abaee8113112 tempest-VolumesSnapshotTestJSON-1753826991 tempest-VolumesSnapshotTestJSON-1753826991-project] Acquiring lock "1daf4f4c-0e4a-4779-b53a-78c48397ea2f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120740) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 18:09:03.179943 dv-cinder-852009-8-iscsi devstack@n-api.service[120740]: DEBUG oslo_concurrency.lockutils [None req-ae44d1e0-82f2-4377-b508-abaee8113112 tempest-VolumesSnapshotTestJSON-1753826991 tempest-VolumesSnapshotTestJSON-1753826991-project] Lock "1daf4f4c-0e4a-4779-b53a-78c48397ea2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120740) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 18:09:03.180354 dv-cinder-852009-8-iscsi devstack@n-api.service[120740]: DEBUG oslo_concurrency.lockutils [None req-ae44d1e0-82f2-4377-b508-abaee8113112 tempest-VolumesSnapshotTestJSON-1753826991 tempest-VolumesSnapshotTestJSON-1753826991-project] Lock "1daf4f4c-0e4a-4779-b53a-78c48397ea2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120740) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 18:09:03.197326 dv-cinder-852009-8-iscsi devstack@n-api.service[120740]: DEBUG nova.quota [None req-ae44d1e0-82f2-4377-b508-abaee8113112 tempest-VolumesSnapshotTestJSON-1753826991 tempest-VolumesSnapshotTestJSON-1753826991-project] Getting quotas for project 1271ab6e6c9b4c93b05aafddbdbf9afe. Resources: {'cores', 'ram', 'instances'} {{(pid=120740) _get_quotas /opt/stack/nova/nova/quota.py:393}} Sep 13 18:09:03.201721 dv-cinder-852009-8-iscsi devstack@n-api.service[120740]: DEBUG nova.quota [None req-ae44d1e0-82f2-4377-b508-abaee8113112 tempest-VolumesSnapshotTestJSON-1753826991 tempest-VolumesSnapshotTestJSON-1753826991-project] Getting quotas for user f379ce3f38fc41568493be7493e75736 and project 1271ab6e6c9b4c93b05aafddbdbf9afe. Resources: {'cores', 'ram', 'instances'} {{(pid=120740) _get_quotas /opt/stack/nova/nova/quota.py:383}} Sep 13 18:09:03.213883 dv-cinder-852009-8-iscsi devstack@n-api.service[120740]: DEBUG nova.compute.api [None req-ae44d1e0-82f2-4377-b508-abaee8113112 tempest-VolumesSnapshotTestJSON-1753826991 tempest-VolumesSnapshotTestJSON-1753826991-project] Going to run 1 instances... {{(pid=120740) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Sep 13 18:09:03.216287 dv-cinder-852009-8-iscsi devstack@n-api.service[120740]: DEBUG nova.compute.api [None req-ae44d1e0-82f2-4377-b508-abaee8113112 tempest-VolumesSnapshotTestJSON-1753826991 tempest-VolumesSnapshotTestJSON-1753826991-project] [instance: a5fb6dae-b0b9-4bd1-8974-d5a1ae1aaeb0] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='33034e36-e6b2-4847-92a1-ff3188c05a4a',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=120740) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Sep 13 18:09:03.262981 dv-cinder-852009-8-iscsi devstack@n-api.service[120740]: INFO nova.api.openstack.requestlog [None req-ae44d1e0-82f2-4377-b508-abaee8113112 tempest-VolumesSnapshotTestJSON-1753826991 tempest-VolumesSnapshotTestJSON-1753826991-project] 10.222.0.43 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 0.511085 Sep 13 18:09:03.263623 dv-cinder-852009-8-iscsi devstack@n-api.service[120740]: [pid: 120740|app: 0|req: 378/743] 10.222.0.43 () {60 vars in 1147 bytes} [Tue Sep 13 18:09:02 2022] POST /compute/v2.1/servers => generated 380 bytes in 512 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Sep 13 18:09:03.273157 dv-cinder-852009-8-iscsi devstack@n-api.service[120741]: DEBUG dbcounter [-] [120741] Writing DB stats nova_api:SELECT=3 {{(pid=120741) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 18:09:03.273908 dv-cinder-852009-8-iscsi devstack@n-api.service[120741]: DEBUG dbcounter [-] [120741] Writing DB stats nova_cell1:SELECT=64,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=120741) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 18:09:03.278197 dv-cinder-852009-8-iscsi devstack@n-api.service[120741]: DEBUG nova.api.openstack.wsgi [None req-9dda071b-3795-4413-b139-1356da3db06d tempest-VolumesSnapshotTestJSON-1753826991 tempest-VolumesSnapshotTestJSON-1753826991-project] Calling method '>' {{(pid=120741) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 18:09:03.278891 dv-cinder-852009-8-iscsi devstack@n-api.service[120741]: DEBUG nova.compute.api [None req-9dda071b-3795-4413-b139-1356da3db06d tempest-VolumesSnapshotTestJSON-1753826991 tempest-VolumesSnapshotTestJSON-1753826991-project] [instance: a5fb6dae-b0b9-4bd1-8974-d5a1ae1aaeb0] Fetching instance by UUID {{(pid=120741) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 18:09:03.336116 dv-cinder-852009-8-iscsi devstack@n-api.service[120741]: DEBUG nova.policy [None req-9dda071b-3795-4413-b139-1356da3db06d tempest-VolumesSnapshotTestJSON-1753826991 tempest-VolumesSnapshotTestJSON-1753826991-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f379ce3f38fc41568493be7493e75736', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1271ab6e6c9b4c93b05aafddbdbf9afe', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120741) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 18:09:03.343309 dv-cinder-852009-8-iscsi devstack@n-api.service[120741]: INFO nova.api.openstack.requestlog [None req-9dda071b-3795-4413-b139-1356da3db06d tempest-VolumesSnapshotTestJSON-1753826991 tempest-VolumesSnapshotTestJSON-1753826991-project] 10.222.0.43 "GET /compute/v2.1/servers/a5fb6dae-b0b9-4bd1-8974-d5a1ae1aaeb0" status: 200 len: 1219 microversion: 2.1 time: 0.071977 Sep 13 18:09:03.343963 dv-cinder-852009-8-iscsi devstack@n-api.service[120741]: [pid: 120741|app: 0|req: 366/744] 10.222.0.43 () {58 vars in 1236 bytes} [Tue Sep 13 18:09:03 2022] GET /compute/v2.1/servers/a5fb6dae-b0b9-4bd1-8974-d5a1ae1aaeb0 => generated 1219 bytes in 73 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 13 18:09:04.367078 dv-cinder-852009-8-iscsi devstack@n-api.service[120740]: DEBUG nova.api.openstack.wsgi [None req-555abcdf-ade7-4cd5-9f75-ee0826f64a97 tempest-VolumesSnapshotTestJSON-1753826991 tempest-VolumesSnapshotTestJSON-1753826991-project] Calling method '>' {{(pid=120740) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 18:09:04.368533 dv-cinder-852009-8-iscsi devstack@n-api.service[120740]: DEBUG nova.compute.api [None req-555abcdf-ade7-4cd5-9f75-ee0826f64a97 tempest-VolumesSnapshotTestJSON-1753826991 tempest-VolumesSnapshotTestJSON-1753826991-project] [instance: a5fb6dae-b0b9-4bd1-8974-d5a1ae1aaeb0] Fetching instance by UUID {{(pid=120740) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 18:09:04.374735 dv-cinder-852009-8-iscsi devstack@n-api.service[120740]: DEBUG oslo_concurrency.lockutils [None req-555abcdf-ade7-4cd5-9f75-ee0826f64a97 tempest-VolumesSnapshotTestJSON-1753826991 tempest-VolumesSnapshotTestJSON-1753826991-project] Acquiring lock "1daf4f4c-0e4a-4779-b53a-78c48397ea2f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120740) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 18:09:04.375483 dv-cinder-852009-8-iscsi devstack@n-api.service[120740]: DEBUG oslo_concurrency.lockutils [None req-555abcdf-ade7-4cd5-9f75-ee0826f64a97 tempest-VolumesSnapshotTestJSON-1753826991 tempest-VolumesSnapshotTestJSON-1753826991-project] Lock "1daf4f4c-0e4a-4779-b53a-78c48397ea2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120740) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 18:09:04.375900 dv-cinder-852009-8-iscsi devstack@n-api.service[120740]: DEBUG oslo_concurrency.lockutils [None req-555abcdf-ade7-4cd5-9f75-ee0826f64a97 tempest-VolumesSnapshotTestJSON-1753826991 tempest-VolumesSnapshotTestJSON-1753826991-project] Lock "1daf4f4c-0e4a-4779-b53a-78c48397ea2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120740) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 18:09:04.376863 dv-cinder-852009-8-iscsi devstack@n-api.service[120740]: DEBUG oslo_concurrency.lockutils [None req-555abcdf-ade7-4cd5-9f75-ee0826f64a97 tempest-VolumesSnapshotTestJSON-1753826991 tempest-VolumesSnapshotTestJSON-1753826991-project] Acquiring lock "1daf4f4c-0e4a-4779-b53a-78c48397ea2f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120740) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 18:09:04.377650 dv-cinder-852009-8-iscsi devstack@n-api.service[120740]: DEBUG oslo_concurrency.lockutils [None req-555abcdf-ade7-4cd5-9f75-ee0826f64a97 tempest-VolumesSnapshotTestJSON-1753826991 tempest-VolumesSnapshotTestJSON-1753826991-project] Lock "1daf4f4c-0e4a-4779-b53a-78c48397ea2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120740) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 18:09:04.378342 dv-cinder-852009-8-iscsi devstack@n-api.service[120740]: DEBUG oslo_concurrency.lockutils [None req-555abcdf-ade7-4cd5-9f75-ee0826f64a97 tempest-VolumesSnapshotTestJSON-1753826991 tempest-VolumesSnapshotTestJSON-1753826991-project] Lock "1daf4f4c-0e4a-4779-b53a-78c48397ea2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120740) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 18:09:04.448762 dv-cinder-852009-8-iscsi devstack@n-api.service[120740]: DEBUG nova.policy [None req-555abcdf-ade7-4cd5-9f75-ee0826f64a97 tempest-VolumesSnapshotTestJSON-1753826991 tempest-VolumesSnapshotTestJSON-1753826991-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f379ce3f38fc41568493be7493e75736', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1271ab6e6c9b4c93b05aafddbdbf9afe', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120740) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 18:09:04.457153 dv-cinder-852009-8-iscsi devstack@n-api.service[120740]: INFO nova.api.openstack.requestlog [None req-555abcdf-ade7-4cd5-9f75-ee0826f64a97 tempest-VolumesSnapshotTestJSON-1753826991 tempest-VolumesSnapshotTestJSON-1753826991-project] 10.222.0.43 "GET /compute/v2.1/servers/a5fb6dae-b0b9-4bd1-8974-d5a1ae1aaeb0" status: 200 len: 1279 microversion: 2.1 time: 0.094784 Sep 13 18:09:04.457740 dv-cinder-852009-8-iscsi devstack@n-api.service[120740]: [pid: 120740|app: 0|req: 379/745] 10.222.0.43 () {58 vars in 1236 bytes} [Tue Sep 13 18:09:04 2022] GET /compute/v2.1/servers/a5fb6dae-b0b9-4bd1-8974-d5a1ae1aaeb0 => generated 1279 bytes in 96 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 13 18:09:05.479406 dv-cinder-852009-8-iscsi devstack@n-api.service[120741]: DEBUG nova.api.openstack.wsgi [None req-d3a6cfba-a7f2-4a13-b0c1-8c109868975a tempest-VolumesSnapshotTestJSON-1753826991 tempest-VolumesSnapshotTestJSON-1753826991-project] Calling method '>' {{(pid=120741) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 18:09:05.480141 dv-cinder-852009-8-iscsi devstack@n-api.service[120741]: DEBUG nova.compute.api [None req-d3a6cfba-a7f2-4a13-b0c1-8c109868975a tempest-VolumesSnapshotTestJSON-1753826991 tempest-VolumesSnapshotTestJSON-1753826991-project] [instance: a5fb6dae-b0b9-4bd1-8974-d5a1ae1aaeb0] Fetching instance by UUID {{(pid=120741) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 18:09:05.487879 dv-cinder-852009-8-iscsi devstack@n-api.service[120741]: DEBUG oslo_concurrency.lockutils [None req-d3a6cfba-a7f2-4a13-b0c1-8c109868975a tempest-VolumesSnapshotTestJSON-1753826991 tempest-VolumesSnapshotTestJSON-1753826991-project] Acquiring lock "1daf4f4c-0e4a-4779-b53a-78c48397ea2f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120741) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 18:09:05.488357 dv-cinder-852009-8-iscsi devstack@n-api.service[120741]: DEBUG oslo_concurrency.lockutils [None req-d3a6cfba-a7f2-4a13-b0c1-8c109868975a tempest-VolumesSnapshotTestJSON-1753826991 tempest-VolumesSnapshotTestJSON-1753826991-project] Lock "1daf4f4c-0e4a-4779-b53a-78c48397ea2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120741) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 18:09:05.488792 dv-cinder-852009-8-iscsi devstack@n-api.service[120741]: DEBUG oslo_concurrency.lockutils [None req-d3a6cfba-a7f2-4a13-b0c1-8c109868975a tempest-VolumesSnapshotTestJSON-1753826991 tempest-VolumesSnapshotTestJSON-1753826991-project] Lock "1daf4f4c-0e4a-4779-b53a-78c48397ea2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120741) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 18:09:05.489489 dv-cinder-852009-8-iscsi devstack@n-api.service[120741]: DEBUG oslo_concurrency.lockutils [None req-d3a6cfba-a7f2-4a13-b0c1-8c109868975a tempest-VolumesSnapshotTestJSON-1753826991 tempest-VolumesSnapshotTestJSON-1753826991-project] Acquiring lock "1daf4f4c-0e4a-4779-b53a-78c48397ea2f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120741) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 18:09:05.489931 dv-cinder-852009-8-iscsi devstack@n-api.service[120741]: DEBUG oslo_concurrency.lockutils [None req-d3a6cfba-a7f2-4a13-b0c1-8c109868975a tempest-VolumesSnapshotTestJSON-1753826991 tempest-VolumesSnapshotTestJSON-1753826991-project] Lock "1daf4f4c-0e4a-4779-b53a-78c48397ea2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120741) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 18:09:05.490373 dv-cinder-852009-8-iscsi devstack@n-api.service[120741]: DEBUG oslo_concurrency.lockutils [None req-d3a6cfba-a7f2-4a13-b0c1-8c109868975a tempest-VolumesSnapshotTestJSON-1753826991 tempest-VolumesSnapshotTestJSON-1753826991-project] Lock "1daf4f4c-0e4a-4779-b53a-78c48397ea2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120741) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 18:09:05.631296 dv-cinder-852009-8-iscsi devstack@n-api.service[120741]: DEBUG nova.policy [None req-d3a6cfba-a7f2-4a13-b0c1-8c109868975a tempest-VolumesSnapshotTestJSON-1753826991 tempest-VolumesSnapshotTestJSON-1753826991-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f379ce3f38fc41568493be7493e75736', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1271ab6e6c9b4c93b05aafddbdbf9afe', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120741) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 18:09:05.639020 dv-cinder-852009-8-iscsi devstack@n-api.service[120741]: INFO nova.api.openstack.requestlog [None req-d3a6cfba-a7f2-4a13-b0c1-8c109868975a tempest-VolumesSnapshotTestJSON-1753826991 tempest-VolumesSnapshotTestJSON-1753826991-project] 10.222.0.43 "GET /compute/v2.1/servers/a5fb6dae-b0b9-4bd1-8974-d5a1ae1aaeb0" status: 200 len: 1319 microversion: 2.1 time: 0.163598 Sep 13 18:09:05.639583 dv-cinder-852009-8-iscsi devstack@n-api.service[120741]: [pid: 120741|app: 0|req: 367/746] 10.222.0.43 () {58 vars in 1236 bytes} [Tue Sep 13 18:09:05 2022] GET /compute/v2.1/servers/a5fb6dae-b0b9-4bd1-8974-d5a1ae1aaeb0 => generated 1319 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 13 18:09:05.682787 dv-cinder-852009-8-iscsi devstack@n-api.service[120740]: DEBUG nova.api.openstack.wsgi [req-fd611dc9-6a84-4dc9-b73e-9ba84075e7aa req-1502bc0e-5787-442b-898a-696fc9726acc service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "a5fb6dae-b0b9-4bd1-8974-d5a1ae1aaeb0", "tag": "0002f044-eb9d-4d92-a36f-ae094de3f290"}]} {{(pid=120740) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 13 18:09:05.693612 dv-cinder-852009-8-iscsi devstack@n-api.service[120740]: DEBUG oslo_concurrency.lockutils [req-fd611dc9-6a84-4dc9-b73e-9ba84075e7aa req-1502bc0e-5787-442b-898a-696fc9726acc service nova] Acquiring lock "1daf4f4c-0e4a-4779-b53a-78c48397ea2f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120740) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 18:09:05.694047 dv-cinder-852009-8-iscsi devstack@n-api.service[120740]: DEBUG oslo_concurrency.lockutils [req-fd611dc9-6a84-4dc9-b73e-9ba84075e7aa req-1502bc0e-5787-442b-898a-696fc9726acc service nova] Lock "1daf4f4c-0e4a-4779-b53a-78c48397ea2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120740) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 18:09:05.694506 dv-cinder-852009-8-iscsi devstack@n-api.service[120740]: DEBUG oslo_concurrency.lockutils [req-fd611dc9-6a84-4dc9-b73e-9ba84075e7aa req-1502bc0e-5787-442b-898a-696fc9726acc service nova] Lock "1daf4f4c-0e4a-4779-b53a-78c48397ea2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120740) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 18:09:05.705963 dv-cinder-852009-8-iscsi devstack@n-api.service[120740]: INFO nova.api.openstack.compute.server_external_events [req-fd611dc9-6a84-4dc9-b73e-9ba84075e7aa req-1502bc0e-5787-442b-898a-696fc9726acc service nova] Creating event network-changed:0002f044-eb9d-4d92-a36f-ae094de3f290 for instance a5fb6dae-b0b9-4bd1-8974-d5a1ae1aaeb0 on hv-cinder-85200 Sep 13 18:09:05.711077 dv-cinder-852009-8-iscsi devstack@n-api.service[120740]: INFO nova.api.openstack.requestlog [req-fd611dc9-6a84-4dc9-b73e-9ba84075e7aa req-1502bc0e-5787-442b-898a-696fc9726acc service nova] 10.222.0.43 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.034096 Sep 13 18:09:05.711683 dv-cinder-852009-8-iscsi devstack@n-api.service[120740]: [pid: 120740|app: 0|req: 380/747] 10.222.0.43 () {64 vars in 1317 bytes} [Tue Sep 13 18:09:05 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 36 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 13 18:09:06.666282 dv-cinder-852009-8-iscsi devstack@n-api.service[120741]: DEBUG nova.api.openstack.wsgi [None req-ed90cd57-7929-4a56-9e8d-29633dad26a4 tempest-VolumesSnapshotTestJSON-1753826991 tempest-VolumesSnapshotTestJSON-1753826991-project] Calling method '>' {{(pid=120741) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 18:09:06.667284 dv-cinder-852009-8-iscsi devstack@n-api.service[120741]: DEBUG nova.compute.api [None req-ed90cd57-7929-4a56-9e8d-29633dad26a4 tempest-VolumesSnapshotTestJSON-1753826991 tempest-VolumesSnapshotTestJSON-1753826991-project] [instance: a5fb6dae-b0b9-4bd1-8974-d5a1ae1aaeb0] Fetching instance by UUID {{(pid=120741) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 18:09:06.674929 dv-cinder-852009-8-iscsi devstack@n-api.service[120741]: DEBUG oslo_concurrency.lockutils [None req-ed90cd57-7929-4a56-9e8d-29633dad26a4 tempest-VolumesSnapshotTestJSON-1753826991 tempest-VolumesSnapshotTestJSON-1753826991-project] Acquiring lock "1daf4f4c-0e4a-4779-b53a-78c48397ea2f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120741) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 18:09:06.675466 dv-cinder-852009-8-iscsi devstack@n-api.service[120741]: DEBUG oslo_concurrency.lockutils [None req-ed90cd57-7929-4a56-9e8d-29633dad26a4 tempest-VolumesSnapshotTestJSON-1753826991 tempest-VolumesSnapshotTestJSON-1753826991-project] Lock "1daf4f4c-0e4a-4779-b53a-78c48397ea2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120741) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 18:09:06.675923 dv-cinder-852009-8-iscsi devstack@n-api.service[120741]: DEBUG oslo_concurrency.lockutils [None req-ed90cd57-7929-4a56-9e8d-29633dad26a4 tempest-VolumesSnapshotTestJSON-1753826991 tempest-VolumesSnapshotTestJSON-1753826991-project] Lock "1daf4f4c-0e4a-4779-b53a-78c48397ea2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120741) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 18:09:06.676681 dv-cinder-852009-8-iscsi devstack@n-api.service[120741]: DEBUG oslo_concurrency.lockutils [None req-ed90cd57-7929-4a56-9e8d-29633dad26a4 tempest-VolumesSnapshotTestJSON-1753826991 tempest-VolumesSnapshotTestJSON-1753826991-project] Acquiring lock "1daf4f4c-0e4a-4779-b53a-78c48397ea2f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120741) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 18:09:06.677154 dv-cinder-852009-8-iscsi devstack@n-api.service[120741]: DEBUG oslo_concurrency.lockutils [None req-ed90cd57-7929-4a56-9e8d-29633dad26a4 tempest-VolumesSnapshotTestJSON-1753826991 tempest-VolumesSnapshotTestJSON-1753826991-project] Lock "1daf4f4c-0e4a-4779-b53a-78c48397ea2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120741) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 18:09:06.677591 dv-cinder-852009-8-iscsi devstack@n-api.service[120741]: DEBUG oslo_concurrency.lockutils [None req-ed90cd57-7929-4a56-9e8d-29633dad26a4 tempest-VolumesSnapshotTestJSON-1753826991 tempest-VolumesSnapshotTestJSON-1753826991-project] Lock "1daf4f4c-0e4a-4779-b53a-78c48397ea2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120741) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 18:09:06.808619 dv-cinder-852009-8-iscsi devstack@n-api.service[120741]: DEBUG nova.policy [None req-ed90cd57-7929-4a56-9e8d-29633dad26a4 tempest-VolumesSnapshotTestJSON-1753826991 tempest-VolumesSnapshotTestJSON-1753826991-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f379ce3f38fc41568493be7493e75736', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1271ab6e6c9b4c93b05aafddbdbf9afe', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120741) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 18:09:06.816758 dv-cinder-852009-8-iscsi devstack@n-api.service[120741]: INFO nova.api.openstack.requestlog [None req-ed90cd57-7929-4a56-9e8d-29633dad26a4 tempest-VolumesSnapshotTestJSON-1753826991 tempest-VolumesSnapshotTestJSON-1753826991-project] 10.222.0.43 "GET /compute/v2.1/servers/a5fb6dae-b0b9-4bd1-8974-d5a1ae1aaeb0" status: 200 len: 1319 microversion: 2.1 time: 0.157528 Sep 13 18:09:06.817370 dv-cinder-852009-8-iscsi devstack@n-api.service[120741]: [pid: 120741|app: 0|req: 368/748] 10.222.0.43 () {58 vars in 1236 bytes} [Tue Sep 13 18:09:06 2022] GET /compute/v2.1/servers/a5fb6dae-b0b9-4bd1-8974-d5a1ae1aaeb0 => generated 1319 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 13 18:09:07.843151 dv-cinder-852009-8-iscsi devstack@n-api.service[120740]: DEBUG nova.api.openstack.wsgi [None req-941f3901-93b2-4286-b52f-16d158c6c0eb tempest-VolumesSnapshotTestJSON-1753826991 tempest-VolumesSnapshotTestJSON-1753826991-project] Calling method '>' {{(pid=120740) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 18:09:07.843842 dv-cinder-852009-8-iscsi devstack@n-api.service[120740]: DEBUG nova.compute.api [None req-941f3901-93b2-4286-b52f-16d158c6c0eb tempest-VolumesSnapshotTestJSON-1753826991 tempest-VolumesSnapshotTestJSON-1753826991-project] [instance: a5fb6dae-b0b9-4bd1-8974-d5a1ae1aaeb0] Fetching instance by UUID {{(pid=120740) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 18:09:07.850589 dv-cinder-852009-8-iscsi devstack@n-api.service[120740]: DEBUG oslo_concurrency.lockutils [None req-941f3901-93b2-4286-b52f-16d158c6c0eb tempest-VolumesSnapshotTestJSON-1753826991 tempest-VolumesSnapshotTestJSON-1753826991-project] Acquiring lock "1daf4f4c-0e4a-4779-b53a-78c48397ea2f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120740) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 18:09:07.851062 dv-cinder-852009-8-iscsi devstack@n-api.service[120740]: DEBUG oslo_concurrency.lockutils [None req-941f3901-93b2-4286-b52f-16d158c6c0eb tempest-VolumesSnapshotTestJSON-1753826991 tempest-VolumesSnapshotTestJSON-1753826991-project] Lock "1daf4f4c-0e4a-4779-b53a-78c48397ea2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120740) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 18:09:07.851486 dv-cinder-852009-8-iscsi devstack@n-api.service[120740]: DEBUG oslo_concurrency.lockutils [None req-941f3901-93b2-4286-b52f-16d158c6c0eb tempest-VolumesSnapshotTestJSON-1753826991 tempest-VolumesSnapshotTestJSON-1753826991-project] Lock "1daf4f4c-0e4a-4779-b53a-78c48397ea2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120740) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 18:09:07.852164 dv-cinder-852009-8-iscsi devstack@n-api.service[120740]: DEBUG oslo_concurrency.lockutils [None req-941f3901-93b2-4286-b52f-16d158c6c0eb tempest-VolumesSnapshotTestJSON-1753826991 tempest-VolumesSnapshotTestJSON-1753826991-project] Acquiring lock "1daf4f4c-0e4a-4779-b53a-78c48397ea2f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120740) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 18:09:07.852647 dv-cinder-852009-8-iscsi devstack@n-api.service[120740]: DEBUG oslo_concurrency.lockutils [None req-941f3901-93b2-4286-b52f-16d158c6c0eb tempest-VolumesSnapshotTestJSON-1753826991 tempest-VolumesSnapshotTestJSON-1753826991-project] Lock "1daf4f4c-0e4a-4779-b53a-78c48397ea2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120740) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 18:09:07.853061 dv-cinder-852009-8-iscsi devstack@n-api.service[120740]: DEBUG oslo_concurrency.lockutils [None req-941f3901-93b2-4286-b52f-16d158c6c0eb tempest-VolumesSnapshotTestJSON-1753826991 tempest-VolumesSnapshotTestJSON-1753826991-project] Lock "1daf4f4c-0e4a-4779-b53a-78c48397ea2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120740) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 18:09:07.987564 dv-cinder-852009-8-iscsi devstack@n-api.service[120740]: DEBUG nova.policy [None req-941f3901-93b2-4286-b52f-16d158c6c0eb tempest-VolumesSnapshotTestJSON-1753826991 tempest-VolumesSnapshotTestJSON-1753826991-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f379ce3f38fc41568493be7493e75736', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1271ab6e6c9b4c93b05aafddbdbf9afe', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120740) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 18:09:07.995470 dv-cinder-852009-8-iscsi devstack@n-api.service[120740]: INFO nova.api.openstack.requestlog [None req-941f3901-93b2-4286-b52f-16d158c6c0eb tempest-VolumesSnapshotTestJSON-1753826991 tempest-VolumesSnapshotTestJSON-1753826991-project] 10.222.0.43 "GET /compute/v2.1/servers/a5fb6dae-b0b9-4bd1-8974-d5a1ae1aaeb0" status: 200 len: 1319 microversion: 2.1 time: 0.157783 Sep 13 18:09:07.996141 dv-cinder-852009-8-iscsi devstack@n-api.service[120740]: [pid: 120740|app: 0|req: 381/749] 10.222.0.43 () {58 vars in 1236 bytes} [Tue Sep 13 18:09:07 2022] GET /compute/v2.1/servers/a5fb6dae-b0b9-4bd1-8974-d5a1ae1aaeb0 => generated 1319 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 13 18:09:09.022976 dv-cinder-852009-8-iscsi devstack@n-api.service[120741]: DEBUG nova.api.openstack.wsgi [None req-1962f486-3b82-408b-88bc-a5a133171933 tempest-VolumesSnapshotTestJSON-1753826991 tempest-VolumesSnapshotTestJSON-1753826991-project] Calling method '>' {{(pid=120741) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 18:09:09.023962 dv-cinder-852009-8-iscsi devstack@n-api.service[120741]: DEBUG nova.compute.api [None req-1962f486-3b82-408b-88bc-a5a133171933 tempest-VolumesSnapshotTestJSON-1753826991 tempest-VolumesSnapshotTestJSON-1753826991-project] [instance: a5fb6dae-b0b9-4bd1-8974-d5a1ae1aaeb0] Fetching instance by UUID {{(pid=120741) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 18:09:09.034819 dv-cinder-852009-8-iscsi devstack@n-api.service[120741]: DEBUG oslo_concurrency.lockutils [None req-1962f486-3b82-408b-88bc-a5a133171933 tempest-VolumesSnapshotTestJSON-1753826991 tempest-VolumesSnapshotTestJSON-1753826991-project] Acquiring lock "1daf4f4c-0e4a-4779-b53a-78c48397ea2f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120741) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 18:09:09.035614 dv-cinder-852009-8-iscsi devstack@n-api.service[120741]: DEBUG oslo_concurrency.lockutils [None req-1962f486-3b82-408b-88bc-a5a133171933 tempest-VolumesSnapshotTestJSON-1753826991 tempest-VolumesSnapshotTestJSON-1753826991-project] Lock "1daf4f4c-0e4a-4779-b53a-78c48397ea2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120741) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 18:09:09.036376 dv-cinder-852009-8-iscsi devstack@n-api.service[120741]: DEBUG oslo_concurrency.lockutils [None req-1962f486-3b82-408b-88bc-a5a133171933 tempest-VolumesSnapshotTestJSON-1753826991 tempest-VolumesSnapshotTestJSON-1753826991-project] Lock "1daf4f4c-0e4a-4779-b53a-78c48397ea2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120741) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 18:09:09.037582 dv-cinder-852009-8-iscsi devstack@n-api.service[120741]: DEBUG oslo_concurrency.lockutils [None req-1962f486-3b82-408b-88bc-a5a133171933 tempest-VolumesSnapshotTestJSON-1753826991 tempest-VolumesSnapshotTestJSON-1753826991-project] Acquiring lock "1daf4f4c-0e4a-4779-b53a-78c48397ea2f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120741) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 18:09:09.038341 dv-cinder-852009-8-iscsi devstack@n-api.service[120741]: DEBUG oslo_concurrency.lockutils [None req-1962f486-3b82-408b-88bc-a5a133171933 tempest-VolumesSnapshotTestJSON-1753826991 tempest-VolumesSnapshotTestJSON-1753826991-project] Lock "1daf4f4c-0e4a-4779-b53a-78c48397ea2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120741) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 18:09:09.039034 dv-cinder-852009-8-iscsi devstack@n-api.service[120741]: DEBUG oslo_concurrency.lockutils [None req-1962f486-3b82-408b-88bc-a5a133171933 tempest-VolumesSnapshotTestJSON-1753826991 tempest-VolumesSnapshotTestJSON-1753826991-project] Lock "1daf4f4c-0e4a-4779-b53a-78c48397ea2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120741) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 18:09:09.178537 dv-cinder-852009-8-iscsi devstack@n-api.service[120741]: DEBUG nova.policy [None req-1962f486-3b82-408b-88bc-a5a133171933 tempest-VolumesSnapshotTestJSON-1753826991 tempest-VolumesSnapshotTestJSON-1753826991-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f379ce3f38fc41568493be7493e75736', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1271ab6e6c9b4c93b05aafddbdbf9afe', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120741) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 18:09:09.187723 dv-cinder-852009-8-iscsi devstack@n-api.service[120741]: INFO nova.api.openstack.requestlog [None req-1962f486-3b82-408b-88bc-a5a133171933 tempest-VolumesSnapshotTestJSON-1753826991 tempest-VolumesSnapshotTestJSON-1753826991-project] 10.222.0.43 "GET /compute/v2.1/servers/a5fb6dae-b0b9-4bd1-8974-d5a1ae1aaeb0" status: 200 len: 1319 microversion: 2.1 time: 0.171297 Sep 13 18:09:09.188290 dv-cinder-852009-8-iscsi devstack@n-api.service[120741]: [pid: 120741|app: 0|req: 369/750] 10.222.0.43 () {58 vars in 1236 bytes} [Tue Sep 13 18:09:09 2022] GET /compute/v2.1/servers/a5fb6dae-b0b9-4bd1-8974-d5a1ae1aaeb0 => generated 1319 bytes in 173 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 13 18:09:10.111733 dv-cinder-852009-8-iscsi devstack@n-api.service[120740]: DEBUG nova.api.openstack.wsgi [req-a5189f02-71a5-4f51-adef-430706037180 req-7f2a6ae6-0970-40d2-a446-d041c66d278b service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "a5fb6dae-b0b9-4bd1-8974-d5a1ae1aaeb0", "name": "network-vif-plugged", "status": "completed", "tag": "0002f044-eb9d-4d92-a36f-ae094de3f290"}]} {{(pid=120740) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 13 18:09:10.123477 dv-cinder-852009-8-iscsi devstack@n-api.service[120740]: DEBUG oslo_concurrency.lockutils [req-a5189f02-71a5-4f51-adef-430706037180 req-7f2a6ae6-0970-40d2-a446-d041c66d278b service nova] Acquiring lock "1daf4f4c-0e4a-4779-b53a-78c48397ea2f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120740) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 18:09:10.124112 dv-cinder-852009-8-iscsi devstack@n-api.service[120740]: DEBUG oslo_concurrency.lockutils [req-a5189f02-71a5-4f51-adef-430706037180 req-7f2a6ae6-0970-40d2-a446-d041c66d278b service nova] Lock "1daf4f4c-0e4a-4779-b53a-78c48397ea2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120740) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 18:09:10.124571 dv-cinder-852009-8-iscsi devstack@n-api.service[120740]: DEBUG oslo_concurrency.lockutils [req-a5189f02-71a5-4f51-adef-430706037180 req-7f2a6ae6-0970-40d2-a446-d041c66d278b service nova] Lock "1daf4f4c-0e4a-4779-b53a-78c48397ea2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120740) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 18:09:10.138489 dv-cinder-852009-8-iscsi devstack@n-api.service[120740]: INFO nova.api.openstack.compute.server_external_events [req-a5189f02-71a5-4f51-adef-430706037180 req-7f2a6ae6-0970-40d2-a446-d041c66d278b service nova] Creating event network-vif-plugged:0002f044-eb9d-4d92-a36f-ae094de3f290 for instance a5fb6dae-b0b9-4bd1-8974-d5a1ae1aaeb0 on hv-cinder-85200 Sep 13 18:09:10.143534 dv-cinder-852009-8-iscsi devstack@n-api.service[120740]: INFO nova.api.openstack.requestlog [req-a5189f02-71a5-4f51-adef-430706037180 req-7f2a6ae6-0970-40d2-a446-d041c66d278b service nova] 10.222.0.43 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.035653 Sep 13 18:09:10.144540 dv-cinder-852009-8-iscsi devstack@n-api.service[120740]: [pid: 120740|app: 0|req: 382/751] 10.222.0.43 () {64 vars in 1317 bytes} [Tue Sep 13 18:09:10 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 37 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 13 18:09:10.211348 dv-cinder-852009-8-iscsi devstack@n-api.service[120741]: DEBUG nova.api.openstack.wsgi [None req-8e86af17-270a-44de-bd16-fbe50b727514 tempest-VolumesSnapshotTestJSON-1753826991 tempest-VolumesSnapshotTestJSON-1753826991-project] Calling method '>' {{(pid=120741) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 18:09:10.212165 dv-cinder-852009-8-iscsi devstack@n-api.service[120741]: DEBUG nova.compute.api [None req-8e86af17-270a-44de-bd16-fbe50b727514 tempest-VolumesSnapshotTestJSON-1753826991 tempest-VolumesSnapshotTestJSON-1753826991-project] [instance: a5fb6dae-b0b9-4bd1-8974-d5a1ae1aaeb0] Fetching instance by UUID {{(pid=120741) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 18:09:10.218880 dv-cinder-852009-8-iscsi devstack@n-api.service[120741]: DEBUG oslo_concurrency.lockutils [None req-8e86af17-270a-44de-bd16-fbe50b727514 tempest-VolumesSnapshotTestJSON-1753826991 tempest-VolumesSnapshotTestJSON-1753826991-project] Acquiring lock "1daf4f4c-0e4a-4779-b53a-78c48397ea2f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120741) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 18:09:10.219366 dv-cinder-852009-8-iscsi devstack@n-api.service[120741]: DEBUG oslo_concurrency.lockutils [None req-8e86af17-270a-44de-bd16-fbe50b727514 tempest-VolumesSnapshotTestJSON-1753826991 tempest-VolumesSnapshotTestJSON-1753826991-project] Lock "1daf4f4c-0e4a-4779-b53a-78c48397ea2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120741) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 18:09:10.219808 dv-cinder-852009-8-iscsi devstack@n-api.service[120741]: DEBUG oslo_concurrency.lockutils [None req-8e86af17-270a-44de-bd16-fbe50b727514 tempest-VolumesSnapshotTestJSON-1753826991 tempest-VolumesSnapshotTestJSON-1753826991-project] Lock "1daf4f4c-0e4a-4779-b53a-78c48397ea2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120741) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 18:09:10.220737 dv-cinder-852009-8-iscsi devstack@n-api.service[120741]: DEBUG oslo_concurrency.lockutils [None req-8e86af17-270a-44de-bd16-fbe50b727514 tempest-VolumesSnapshotTestJSON-1753826991 tempest-VolumesSnapshotTestJSON-1753826991-project] Acquiring lock "1daf4f4c-0e4a-4779-b53a-78c48397ea2f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120741) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 18:09:10.221193 dv-cinder-852009-8-iscsi devstack@n-api.service[120741]: DEBUG oslo_concurrency.lockutils [None req-8e86af17-270a-44de-bd16-fbe50b727514 tempest-VolumesSnapshotTestJSON-1753826991 tempest-VolumesSnapshotTestJSON-1753826991-project] Lock "1daf4f4c-0e4a-4779-b53a-78c48397ea2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120741) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 18:09:10.221612 dv-cinder-852009-8-iscsi devstack@n-api.service[120741]: DEBUG oslo_concurrency.lockutils [None req-8e86af17-270a-44de-bd16-fbe50b727514 tempest-VolumesSnapshotTestJSON-1753826991 tempest-VolumesSnapshotTestJSON-1753826991-project] Lock "1daf4f4c-0e4a-4779-b53a-78c48397ea2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120741) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 18:09:10.355953 dv-cinder-852009-8-iscsi devstack@n-api.service[120741]: DEBUG nova.policy [None req-8e86af17-270a-44de-bd16-fbe50b727514 tempest-VolumesSnapshotTestJSON-1753826991 tempest-VolumesSnapshotTestJSON-1753826991-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f379ce3f38fc41568493be7493e75736', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1271ab6e6c9b4c93b05aafddbdbf9afe', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120741) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 18:09:10.363709 dv-cinder-852009-8-iscsi devstack@n-api.service[120741]: INFO nova.api.openstack.requestlog [None req-8e86af17-270a-44de-bd16-fbe50b727514 tempest-VolumesSnapshotTestJSON-1753826991 tempest-VolumesSnapshotTestJSON-1753826991-project] 10.222.0.43 "GET /compute/v2.1/servers/a5fb6dae-b0b9-4bd1-8974-d5a1ae1aaeb0" status: 200 len: 1319 microversion: 2.1 time: 0.156761 Sep 13 18:09:10.364293 dv-cinder-852009-8-iscsi devstack@n-api.service[120741]: [pid: 120741|app: 0|req: 370/752] 10.222.0.43 () {58 vars in 1236 bytes} [Tue Sep 13 18:09:10 2022] GET /compute/v2.1/servers/a5fb6dae-b0b9-4bd1-8974-d5a1ae1aaeb0 => generated 1319 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 13 18:09:11.387834 dv-cinder-852009-8-iscsi devstack@n-api.service[120740]: DEBUG nova.api.openstack.wsgi [None req-dc2ac07f-8c1e-4149-9683-9d9c8e44139d tempest-VolumesSnapshotTestJSON-1753826991 tempest-VolumesSnapshotTestJSON-1753826991-project] Calling method '>' {{(pid=120740) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 18:09:11.388588 dv-cinder-852009-8-iscsi devstack@n-api.service[120740]: DEBUG nova.compute.api [None req-dc2ac07f-8c1e-4149-9683-9d9c8e44139d tempest-VolumesSnapshotTestJSON-1753826991 tempest-VolumesSnapshotTestJSON-1753826991-project] [instance: a5fb6dae-b0b9-4bd1-8974-d5a1ae1aaeb0] Fetching instance by UUID {{(pid=120740) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 18:09:11.395634 dv-cinder-852009-8-iscsi devstack@n-api.service[120740]: DEBUG oslo_concurrency.lockutils [None req-dc2ac07f-8c1e-4149-9683-9d9c8e44139d tempest-VolumesSnapshotTestJSON-1753826991 tempest-VolumesSnapshotTestJSON-1753826991-project] Acquiring lock "1daf4f4c-0e4a-4779-b53a-78c48397ea2f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120740) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 18:09:11.396117 dv-cinder-852009-8-iscsi devstack@n-api.service[120740]: DEBUG oslo_concurrency.lockutils [None req-dc2ac07f-8c1e-4149-9683-9d9c8e44139d tempest-VolumesSnapshotTestJSON-1753826991 tempest-VolumesSnapshotTestJSON-1753826991-project] Lock "1daf4f4c-0e4a-4779-b53a-78c48397ea2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120740) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 18:09:11.396587 dv-cinder-852009-8-iscsi devstack@n-api.service[120740]: DEBUG oslo_concurrency.lockutils [None req-dc2ac07f-8c1e-4149-9683-9d9c8e44139d tempest-VolumesSnapshotTestJSON-1753826991 tempest-VolumesSnapshotTestJSON-1753826991-project] Lock "1daf4f4c-0e4a-4779-b53a-78c48397ea2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120740) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 18:09:11.397279 dv-cinder-852009-8-iscsi devstack@n-api.service[120740]: DEBUG oslo_concurrency.lockutils [None req-dc2ac07f-8c1e-4149-9683-9d9c8e44139d tempest-VolumesSnapshotTestJSON-1753826991 tempest-VolumesSnapshotTestJSON-1753826991-project] Acquiring lock "1daf4f4c-0e4a-4779-b53a-78c48397ea2f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120740) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 18:09:11.397735 dv-cinder-852009-8-iscsi devstack@n-api.service[120740]: DEBUG oslo_concurrency.lockutils [None req-dc2ac07f-8c1e-4149-9683-9d9c8e44139d tempest-VolumesSnapshotTestJSON-1753826991 tempest-VolumesSnapshotTestJSON-1753826991-project] Lock "1daf4f4c-0e4a-4779-b53a-78c48397ea2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120740) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 18:09:11.398152 dv-cinder-852009-8-iscsi devstack@n-api.service[120740]: DEBUG oslo_concurrency.lockutils [None req-dc2ac07f-8c1e-4149-9683-9d9c8e44139d tempest-VolumesSnapshotTestJSON-1753826991 tempest-VolumesSnapshotTestJSON-1753826991-project] Lock "1daf4f4c-0e4a-4779-b53a-78c48397ea2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120740) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 18:09:11.535044 dv-cinder-852009-8-iscsi devstack@n-api.service[120740]: DEBUG nova.policy [None req-dc2ac07f-8c1e-4149-9683-9d9c8e44139d tempest-VolumesSnapshotTestJSON-1753826991 tempest-VolumesSnapshotTestJSON-1753826991-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f379ce3f38fc41568493be7493e75736', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1271ab6e6c9b4c93b05aafddbdbf9afe', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120740) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 18:09:11.547106 dv-cinder-852009-8-iscsi devstack@n-api.service[120740]: INFO nova.api.openstack.requestlog [None req-dc2ac07f-8c1e-4149-9683-9d9c8e44139d tempest-VolumesSnapshotTestJSON-1753826991 tempest-VolumesSnapshotTestJSON-1753826991-project] 10.222.0.43 "GET /compute/v2.1/servers/a5fb6dae-b0b9-4bd1-8974-d5a1ae1aaeb0" status: 200 len: 1319 microversion: 2.1 time: 0.163299 Sep 13 18:09:11.547835 dv-cinder-852009-8-iscsi devstack@n-api.service[120740]: [pid: 120740|app: 0|req: 383/753] 10.222.0.43 () {58 vars in 1236 bytes} [Tue Sep 13 18:09:11 2022] GET /compute/v2.1/servers/a5fb6dae-b0b9-4bd1-8974-d5a1ae1aaeb0 => generated 1319 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 13 18:09:12.579975 dv-cinder-852009-8-iscsi devstack@n-api.service[120741]: DEBUG nova.api.openstack.wsgi [None req-a7f99b3a-026e-430d-a6a1-6d293484c36d tempest-VolumesSnapshotTestJSON-1753826991 tempest-VolumesSnapshotTestJSON-1753826991-project] Calling method '>' {{(pid=120741) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 18:09:12.580940 dv-cinder-852009-8-iscsi devstack@n-api.service[120741]: DEBUG nova.compute.api [None req-a7f99b3a-026e-430d-a6a1-6d293484c36d tempest-VolumesSnapshotTestJSON-1753826991 tempest-VolumesSnapshotTestJSON-1753826991-project] [instance: a5fb6dae-b0b9-4bd1-8974-d5a1ae1aaeb0] Fetching instance by UUID {{(pid=120741) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 18:09:12.591928 dv-cinder-852009-8-iscsi devstack@n-api.service[120741]: DEBUG oslo_concurrency.lockutils [None req-a7f99b3a-026e-430d-a6a1-6d293484c36d tempest-VolumesSnapshotTestJSON-1753826991 tempest-VolumesSnapshotTestJSON-1753826991-project] Acquiring lock "1daf4f4c-0e4a-4779-b53a-78c48397ea2f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120741) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 18:09:12.592790 dv-cinder-852009-8-iscsi devstack@n-api.service[120741]: DEBUG oslo_concurrency.lockutils [None req-a7f99b3a-026e-430d-a6a1-6d293484c36d tempest-VolumesSnapshotTestJSON-1753826991 tempest-VolumesSnapshotTestJSON-1753826991-project] Lock "1daf4f4c-0e4a-4779-b53a-78c48397ea2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120741) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 18:09:12.593502 dv-cinder-852009-8-iscsi devstack@n-api.service[120741]: DEBUG oslo_concurrency.lockutils [None req-a7f99b3a-026e-430d-a6a1-6d293484c36d tempest-VolumesSnapshotTestJSON-1753826991 tempest-VolumesSnapshotTestJSON-1753826991-project] Lock "1daf4f4c-0e4a-4779-b53a-78c48397ea2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120741) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 18:09:12.594645 dv-cinder-852009-8-iscsi devstack@n-api.service[120741]: DEBUG oslo_concurrency.lockutils [None req-a7f99b3a-026e-430d-a6a1-6d293484c36d tempest-VolumesSnapshotTestJSON-1753826991 tempest-VolumesSnapshotTestJSON-1753826991-project] Acquiring lock "1daf4f4c-0e4a-4779-b53a-78c48397ea2f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120741) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 18:09:12.595390 dv-cinder-852009-8-iscsi devstack@n-api.service[120741]: DEBUG oslo_concurrency.lockutils [None req-a7f99b3a-026e-430d-a6a1-6d293484c36d tempest-VolumesSnapshotTestJSON-1753826991 tempest-VolumesSnapshotTestJSON-1753826991-project] Lock "1daf4f4c-0e4a-4779-b53a-78c48397ea2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120741) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 18:09:12.596083 dv-cinder-852009-8-iscsi devstack@n-api.service[120741]: DEBUG oslo_concurrency.lockutils [None req-a7f99b3a-026e-430d-a6a1-6d293484c36d tempest-VolumesSnapshotTestJSON-1753826991 tempest-VolumesSnapshotTestJSON-1753826991-project] Lock "1daf4f4c-0e4a-4779-b53a-78c48397ea2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120741) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 18:09:12.733210 dv-cinder-852009-8-iscsi devstack@n-api.service[120741]: DEBUG nova.policy [None req-a7f99b3a-026e-430d-a6a1-6d293484c36d tempest-VolumesSnapshotTestJSON-1753826991 tempest-VolumesSnapshotTestJSON-1753826991-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f379ce3f38fc41568493be7493e75736', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1271ab6e6c9b4c93b05aafddbdbf9afe', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120741) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 18:09:12.741486 dv-cinder-852009-8-iscsi devstack@n-api.service[120741]: INFO nova.api.openstack.requestlog [None req-a7f99b3a-026e-430d-a6a1-6d293484c36d tempest-VolumesSnapshotTestJSON-1753826991 tempest-VolumesSnapshotTestJSON-1753826991-project] 10.222.0.43 "GET /compute/v2.1/servers/a5fb6dae-b0b9-4bd1-8974-d5a1ae1aaeb0" status: 200 len: 1507 microversion: 2.1 time: 0.168082 Sep 13 18:09:12.742065 dv-cinder-852009-8-iscsi devstack@n-api.service[120741]: [pid: 120741|app: 0|req: 371/754] 10.222.0.43 () {58 vars in 1236 bytes} [Tue Sep 13 18:09:12 2022] GET /compute/v2.1/servers/a5fb6dae-b0b9-4bd1-8974-d5a1ae1aaeb0 => generated 1507 bytes in 170 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 13 18:09:27.043850 dv-cinder-852009-8-iscsi devstack@n-api.service[120740]: DEBUG nova.api.openstack.wsgi [None req-d83b5ca1-f42c-4d24-bf7a-971446ebf17c tempest-VolumesSnapshotTestJSON-1753826991 tempest-VolumesSnapshotTestJSON-1753826991-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "045bae50-fb2c-47bb-9278-bc76f0c004eb", "device": "/dev/sdb"}} {{(pid=120740) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 13 18:09:27.046745 dv-cinder-852009-8-iscsi devstack@n-api.service[120740]: DEBUG nova.compute.api [None req-d83b5ca1-f42c-4d24-bf7a-971446ebf17c tempest-VolumesSnapshotTestJSON-1753826991 tempest-VolumesSnapshotTestJSON-1753826991-project] [instance: a5fb6dae-b0b9-4bd1-8974-d5a1ae1aaeb0] Fetching instance by UUID {{(pid=120740) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 18:09:27.048728 dv-cinder-852009-8-iscsi devstack@n-api.service[120740]: DEBUG dbcounter [-] [120740] Writing DB stats nova_cell0:SELECT=2 {{(pid=120740) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 18:09:27.049394 dv-cinder-852009-8-iscsi devstack@n-api.service[120740]: DEBUG dbcounter [-] [120740] Writing DB stats nova_cell0:SELECT=6 {{(pid=120740) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 18:09:27.050141 dv-cinder-852009-8-iscsi devstack@n-api.service[120740]: DEBUG dbcounter [-] [120740] Writing DB stats nova_api:SELECT=23,nova_api:INSERT=3 {{(pid=120740) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 18:09:27.050739 dv-cinder-852009-8-iscsi devstack@n-api.service[120740]: DEBUG dbcounter [-] [120740] Writing DB stats nova_cell1:SELECT=24 {{(pid=120740) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 18:09:27.057639 dv-cinder-852009-8-iscsi devstack@n-api.service[120740]: DEBUG oslo_concurrency.lockutils [None req-d83b5ca1-f42c-4d24-bf7a-971446ebf17c tempest-VolumesSnapshotTestJSON-1753826991 tempest-VolumesSnapshotTestJSON-1753826991-project] Acquiring lock "1daf4f4c-0e4a-4779-b53a-78c48397ea2f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120740) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 18:09:27.058132 dv-cinder-852009-8-iscsi devstack@n-api.service[120740]: DEBUG oslo_concurrency.lockutils [None req-d83b5ca1-f42c-4d24-bf7a-971446ebf17c tempest-VolumesSnapshotTestJSON-1753826991 tempest-VolumesSnapshotTestJSON-1753826991-project] Lock "1daf4f4c-0e4a-4779-b53a-78c48397ea2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120740) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 18:09:27.058630 dv-cinder-852009-8-iscsi devstack@n-api.service[120740]: DEBUG oslo_concurrency.lockutils [None req-d83b5ca1-f42c-4d24-bf7a-971446ebf17c tempest-VolumesSnapshotTestJSON-1753826991 tempest-VolumesSnapshotTestJSON-1753826991-project] Lock "1daf4f4c-0e4a-4779-b53a-78c48397ea2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120740) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 18:09:27.059323 dv-cinder-852009-8-iscsi devstack@n-api.service[120740]: DEBUG oslo_concurrency.lockutils [None req-d83b5ca1-f42c-4d24-bf7a-971446ebf17c tempest-VolumesSnapshotTestJSON-1753826991 tempest-VolumesSnapshotTestJSON-1753826991-project] Acquiring lock "1daf4f4c-0e4a-4779-b53a-78c48397ea2f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120740) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 18:09:27.059770 dv-cinder-852009-8-iscsi devstack@n-api.service[120740]: DEBUG oslo_concurrency.lockutils [None req-d83b5ca1-f42c-4d24-bf7a-971446ebf17c tempest-VolumesSnapshotTestJSON-1753826991 tempest-VolumesSnapshotTestJSON-1753826991-project] Lock "1daf4f4c-0e4a-4779-b53a-78c48397ea2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120740) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 18:09:27.060187 dv-cinder-852009-8-iscsi devstack@n-api.service[120740]: DEBUG oslo_concurrency.lockutils [None req-d83b5ca1-f42c-4d24-bf7a-971446ebf17c tempest-VolumesSnapshotTestJSON-1753826991 tempest-VolumesSnapshotTestJSON-1753826991-project] Lock "1daf4f4c-0e4a-4779-b53a-78c48397ea2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120740) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 18:09:27.070813 dv-cinder-852009-8-iscsi devstack@n-api.service[120741]: DEBUG nova.api.openstack.wsgi [None req-d4af2b2f-9264-4819-baf0-3cee011659f9 tempest-AttachVolumeNegativeTest-1378806597 tempest-AttachVolumeNegativeTest-1378806597-project] Calling method '>' {{(pid=120741) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 18:09:27.071360 dv-cinder-852009-8-iscsi devstack@n-api.service[120741]: DEBUG nova.compute.api [None req-d4af2b2f-9264-4819-baf0-3cee011659f9 tempest-AttachVolumeNegativeTest-1378806597 tempest-AttachVolumeNegativeTest-1378806597-project] [instance: 75289327-97d1-42bd-a6c7-6f2b1aa3236a] Fetching instance by UUID {{(pid=120741) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 18:09:27.073594 dv-cinder-852009-8-iscsi devstack@n-api.service[120741]: DEBUG dbcounter [-] [120741] Writing DB stats nova_cell0:SELECT=2 {{(pid=120741) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 18:09:27.074385 dv-cinder-852009-8-iscsi devstack@n-api.service[120741]: DEBUG dbcounter [-] [120741] Writing DB stats nova_api:SELECT=14 {{(pid=120741) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 18:09:27.075198 dv-cinder-852009-8-iscsi devstack@n-api.service[120741]: DEBUG dbcounter [-] [120741] Writing DB stats nova_cell1:SELECT=30 {{(pid=120741) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 18:09:27.081864 dv-cinder-852009-8-iscsi devstack@n-api.service[120741]: DEBUG oslo_concurrency.lockutils [None req-d4af2b2f-9264-4819-baf0-3cee011659f9 tempest-AttachVolumeNegativeTest-1378806597 tempest-AttachVolumeNegativeTest-1378806597-project] Acquiring lock "1daf4f4c-0e4a-4779-b53a-78c48397ea2f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120741) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 18:09:27.082516 dv-cinder-852009-8-iscsi devstack@n-api.service[120741]: DEBUG oslo_concurrency.lockutils [None req-d4af2b2f-9264-4819-baf0-3cee011659f9 tempest-AttachVolumeNegativeTest-1378806597 tempest-AttachVolumeNegativeTest-1378806597-project] Lock "1daf4f4c-0e4a-4779-b53a-78c48397ea2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120741) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 18:09:27.082917 dv-cinder-852009-8-iscsi devstack@n-api.service[120741]: DEBUG oslo_concurrency.lockutils [None req-d4af2b2f-9264-4819-baf0-3cee011659f9 tempest-AttachVolumeNegativeTest-1378806597 tempest-AttachVolumeNegativeTest-1378806597-project] Lock "1daf4f4c-0e4a-4779-b53a-78c48397ea2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120741) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 18:09:27.083707 dv-cinder-852009-8-iscsi devstack@n-api.service[120741]: DEBUG oslo_concurrency.lockutils [None req-d4af2b2f-9264-4819-baf0-3cee011659f9 tempest-AttachVolumeNegativeTest-1378806597 tempest-AttachVolumeNegativeTest-1378806597-project] Acquiring lock "1daf4f4c-0e4a-4779-b53a-78c48397ea2f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120741) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 18:09:27.084228 dv-cinder-852009-8-iscsi devstack@n-api.service[120741]: DEBUG oslo_concurrency.lockutils [None req-d4af2b2f-9264-4819-baf0-3cee011659f9 tempest-AttachVolumeNegativeTest-1378806597 tempest-AttachVolumeNegativeTest-1378806597-project] Lock "1daf4f4c-0e4a-4779-b53a-78c48397ea2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120741) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 18:09:27.084747 dv-cinder-852009-8-iscsi devstack@n-api.service[120741]: DEBUG oslo_concurrency.lockutils [None req-d4af2b2f-9264-4819-baf0-3cee011659f9 tempest-AttachVolumeNegativeTest-1378806597 tempest-AttachVolumeNegativeTest-1378806597-project] Lock "1daf4f4c-0e4a-4779-b53a-78c48397ea2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120741) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 18:09:27.114158 dv-cinder-852009-8-iscsi devstack@n-api.service[120741]: INFO nova.api.openstack.requestlog [None req-d4af2b2f-9264-4819-baf0-3cee011659f9 tempest-AttachVolumeNegativeTest-1378806597 tempest-AttachVolumeNegativeTest-1378806597-project] 10.222.0.43 "GET /compute/v2.1/servers/75289327-97d1-42bd-a6c7-6f2b1aa3236a/ips" status: 200 len: 151 microversion: 2.1 time: 0.047008 Sep 13 18:09:27.114977 dv-cinder-852009-8-iscsi devstack@n-api.service[120741]: [pid: 120741|app: 0|req: 372/755] 10.222.0.43 () {58 vars in 1248 bytes} [Tue Sep 13 18:09:27 2022] GET /compute/v2.1/servers/75289327-97d1-42bd-a6c7-6f2b1aa3236a/ips => generated 151 bytes in 49 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Sep 13 18:09:27.340599 dv-cinder-852009-8-iscsi devstack@n-api.service[120740]: INFO nova.api.openstack.requestlog [None req-d83b5ca1-f42c-4d24-bf7a-971446ebf17c tempest-VolumesSnapshotTestJSON-1753826991 tempest-VolumesSnapshotTestJSON-1753826991-project] 10.222.0.43 "POST /compute/v2.1/servers/a5fb6dae-b0b9-4bd1-8974-d5a1ae1aaeb0/os-volume_attachments" status: 200 len: 194 microversion: 2.1 time: 0.300763 Sep 13 18:09:27.341589 dv-cinder-852009-8-iscsi devstack@n-api.service[120740]: [pid: 120740|app: 0|req: 384/756] 10.222.0.43 () {60 vars in 1323 bytes} [Tue Sep 13 18:09:27 2022] POST /compute/v2.1/servers/a5fb6dae-b0b9-4bd1-8974-d5a1ae1aaeb0/os-volume_attachments => generated 194 bytes in 303 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 13 18:09:28.529958 dv-cinder-852009-8-iscsi devstack@n-api.service[120741]: DEBUG nova.api.openstack.wsgi [None req-f894541b-d0f5-4697-ad9d-74d76bf41d5a tempest-AttachVolumeNegativeTest-1378806597 tempest-AttachVolumeNegativeTest-1378806597-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "e32c0df2-e306-4d0e-a551-0fbeaed724e7"}} {{(pid=120741) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 13 18:09:28.532347 dv-cinder-852009-8-iscsi devstack@n-api.service[120741]: DEBUG nova.compute.api [None req-f894541b-d0f5-4697-ad9d-74d76bf41d5a tempest-AttachVolumeNegativeTest-1378806597 tempest-AttachVolumeNegativeTest-1378806597-project] [instance: 75289327-97d1-42bd-a6c7-6f2b1aa3236a] Fetching instance by UUID {{(pid=120741) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 18:09:28.539339 dv-cinder-852009-8-iscsi devstack@n-api.service[120741]: DEBUG oslo_concurrency.lockutils [None req-f894541b-d0f5-4697-ad9d-74d76bf41d5a tempest-AttachVolumeNegativeTest-1378806597 tempest-AttachVolumeNegativeTest-1378806597-project] Acquiring lock "1daf4f4c-0e4a-4779-b53a-78c48397ea2f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120741) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 18:09:28.539818 dv-cinder-852009-8-iscsi devstack@n-api.service[120741]: DEBUG oslo_concurrency.lockutils [None req-f894541b-d0f5-4697-ad9d-74d76bf41d5a tempest-AttachVolumeNegativeTest-1378806597 tempest-AttachVolumeNegativeTest-1378806597-project] Lock "1daf4f4c-0e4a-4779-b53a-78c48397ea2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120741) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 18:09:28.540244 dv-cinder-852009-8-iscsi devstack@n-api.service[120741]: DEBUG oslo_concurrency.lockutils [None req-f894541b-d0f5-4697-ad9d-74d76bf41d5a tempest-AttachVolumeNegativeTest-1378806597 tempest-AttachVolumeNegativeTest-1378806597-project] Lock "1daf4f4c-0e4a-4779-b53a-78c48397ea2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120741) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 18:09:28.540977 dv-cinder-852009-8-iscsi devstack@n-api.service[120741]: DEBUG oslo_concurrency.lockutils [None req-f894541b-d0f5-4697-ad9d-74d76bf41d5a tempest-AttachVolumeNegativeTest-1378806597 tempest-AttachVolumeNegativeTest-1378806597-project] Acquiring lock "1daf4f4c-0e4a-4779-b53a-78c48397ea2f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120741) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 18:09:28.541423 dv-cinder-852009-8-iscsi devstack@n-api.service[120741]: DEBUG oslo_concurrency.lockutils [None req-f894541b-d0f5-4697-ad9d-74d76bf41d5a tempest-AttachVolumeNegativeTest-1378806597 tempest-AttachVolumeNegativeTest-1378806597-project] Lock "1daf4f4c-0e4a-4779-b53a-78c48397ea2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120741) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 18:09:28.541847 dv-cinder-852009-8-iscsi devstack@n-api.service[120741]: DEBUG oslo_concurrency.lockutils [None req-f894541b-d0f5-4697-ad9d-74d76bf41d5a tempest-AttachVolumeNegativeTest-1378806597 tempest-AttachVolumeNegativeTest-1378806597-project] Lock "1daf4f4c-0e4a-4779-b53a-78c48397ea2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120741) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 18:09:28.802446 dv-cinder-852009-8-iscsi devstack@n-api.service[120741]: INFO nova.api.openstack.requestlog [None req-f894541b-d0f5-4697-ad9d-74d76bf41d5a tempest-AttachVolumeNegativeTest-1378806597 tempest-AttachVolumeNegativeTest-1378806597-project] 10.222.0.43 "POST /compute/v2.1/servers/75289327-97d1-42bd-a6c7-6f2b1aa3236a/os-volume_attachments" status: 200 len: 194 microversion: 2.1 time: 0.277635 Sep 13 18:09:28.803059 dv-cinder-852009-8-iscsi devstack@n-api.service[120741]: [pid: 120741|app: 0|req: 373/757] 10.222.0.43 () {60 vars in 1323 bytes} [Tue Sep 13 18:09:28 2022] POST /compute/v2.1/servers/75289327-97d1-42bd-a6c7-6f2b1aa3236a/os-volume_attachments => generated 194 bytes in 280 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 13 18:09:42.803074 dv-cinder-852009-8-iscsi devstack@n-api.service[120740]: DEBUG nova.api.openstack.wsgi [None req-ea664012-de40-4009-95a7-f38d85c74b27 tempest-AttachVolumeNegativeTest-1378806597 tempest-AttachVolumeNegativeTest-1378806597-project] Action: 'create', calling method: .version_select at 0x7fa626a24670>, body: {"keypair": {"name": "tempest-keypair-1906429670", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBIIPVWWLl2XduI/nhUexauslgeRjE0s+cPVqqsPSifL4QJRdKbb7eRDoc8oWgZayIBwwQ06tFDa/635Pwzjo6hFw/b/JobGaLcdbqkM2fejjECqGMZ0eKro8x8QwM4zn5Q=="}} {{(pid=120740) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 13 18:09:42.809151 dv-cinder-852009-8-iscsi devstack@n-api.service[120740]: DEBUG dbcounter [-] [120740] Writing DB stats nova_api:SELECT=2 {{(pid=120740) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 18:09:42.809801 dv-cinder-852009-8-iscsi devstack@n-api.service[120740]: DEBUG dbcounter [-] [120740] Writing DB stats nova_cell1:SELECT=11,nova_cell1:UPDATE=2,nova_cell1:INSERT=1 {{(pid=120740) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 18:09:42.823249 dv-cinder-852009-8-iscsi devstack@n-api.service[120740]: DEBUG nova.quota [None req-ea664012-de40-4009-95a7-f38d85c74b27 tempest-AttachVolumeNegativeTest-1378806597 tempest-AttachVolumeNegativeTest-1378806597-project] Getting quotas for project 629311eda0584a5fbb7d8995cf27540c. Resources: {'key_pairs'} {{(pid=120740) _get_quotas /opt/stack/nova/nova/quota.py:393}} Sep 13 18:09:42.827703 dv-cinder-852009-8-iscsi devstack@n-api.service[120740]: DEBUG nova.quota [None req-ea664012-de40-4009-95a7-f38d85c74b27 tempest-AttachVolumeNegativeTest-1378806597 tempest-AttachVolumeNegativeTest-1378806597-project] Getting quotas for user 714cd09ba19b492f9a8c80343abcf6b9 and project 629311eda0584a5fbb7d8995cf27540c. Resources: {'key_pairs'} {{(pid=120740) _get_quotas /opt/stack/nova/nova/quota.py:383}} Sep 13 18:09:42.851217 dv-cinder-852009-8-iscsi devstack@n-api.service[120740]: INFO nova.api.openstack.requestlog [None req-ea664012-de40-4009-95a7-f38d85c74b27 tempest-AttachVolumeNegativeTest-1378806597 tempest-AttachVolumeNegativeTest-1378806597-project] 10.222.0.43 "POST /compute/v2.1/os-keypairs" status: 200 len: 386 microversion: 2.1 time: 0.052442 Sep 13 18:09:42.851813 dv-cinder-852009-8-iscsi devstack@n-api.service[120740]: [pid: 120740|app: 0|req: 385/758] 10.222.0.43 () {60 vars in 1159 bytes} [Tue Sep 13 18:09:42 2022] POST /compute/v2.1/os-keypairs => generated 386 bytes in 54 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 13 18:09:44.449311 dv-cinder-852009-8-iscsi devstack@n-api.service[120741]: DEBUG dbcounter [-] [120741] Writing DB stats nova_api:SELECT=4 {{(pid=120741) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 18:09:44.450094 dv-cinder-852009-8-iscsi devstack@n-api.service[120741]: DEBUG dbcounter [-] [120741] Writing DB stats nova_cell1:SELECT=15,nova_cell1:UPDATE=2,nova_cell1:INSERT=1 {{(pid=120741) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 18:09:44.454860 dv-cinder-852009-8-iscsi devstack@n-api.service[120741]: DEBUG nova.api.openstack.wsgi [None req-55a6fd7c-49d1-4cc4-920f-663d5153cf73 tempest-AttachVolumeNegativeTest-1378806597 tempest-AttachVolumeNegativeTest-1378806597-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-AttachVolumeNegativeTest-server-1411305059", "imageRef": "33034e36-e6b2-4847-92a1-ff3188c05a4a", "flavorRef": "452", "adminPass": "***", "networks": [{"uuid": "e19c1043-1c23-4c64-9720-4320d6d11eef"}], "security_groups": [{"name": "tempest-securitygroup--1248018801"}], "key_name": "tempest-keypair-1906429670", "user_data": "}} {{(pid=120741) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 13 18:09:44.558887 dv-cinder-852009-8-iscsi devstack@n-api.service[120741]: DEBUG nova.network.neutron [None req-55a6fd7c-49d1-4cc4-920f-663d5153cf73 tempest-AttachVolumeNegativeTest-1378806597 tempest-AttachVolumeNegativeTest-1378806597-project] validate_networks() for [('e19c1043-1c23-4c64-9720-4320d6d11eef', None, None, None, None, None)] {{(pid=120741) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Sep 13 18:09:45.017551 dv-cinder-852009-8-iscsi devstack@n-api.service[120741]: DEBUG nova.virt.hardware [None req-55a6fd7c-49d1-4cc4-920f-663d5153cf73 tempest-AttachVolumeNegativeTest-1378806597 tempest-AttachVolumeNegativeTest-1378806597-project] Flavor limits 0:0:0 {{(pid=120741) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Sep 13 18:09:45.018017 dv-cinder-852009-8-iscsi devstack@n-api.service[120741]: DEBUG nova.virt.hardware [None req-55a6fd7c-49d1-4cc4-920f-663d5153cf73 tempest-AttachVolumeNegativeTest-1378806597 tempest-AttachVolumeNegativeTest-1378806597-project] Image limits 0:0:0 {{(pid=120741) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Sep 13 18:09:45.018563 dv-cinder-852009-8-iscsi devstack@n-api.service[120741]: DEBUG nova.virt.hardware [None req-55a6fd7c-49d1-4cc4-920f-663d5153cf73 tempest-AttachVolumeNegativeTest-1378806597 tempest-AttachVolumeNegativeTest-1378806597-project] Flavor pref 0:0:0 {{(pid=120741) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Sep 13 18:09:45.019051 dv-cinder-852009-8-iscsi devstack@n-api.service[120741]: DEBUG nova.virt.hardware [None req-55a6fd7c-49d1-4cc4-920f-663d5153cf73 tempest-AttachVolumeNegativeTest-1378806597 tempest-AttachVolumeNegativeTest-1378806597-project] Image pref 0:0:0 {{(pid=120741) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Sep 13 18:09:45.019495 dv-cinder-852009-8-iscsi devstack@n-api.service[120741]: DEBUG nova.virt.hardware [None req-55a6fd7c-49d1-4cc4-920f-663d5153cf73 tempest-AttachVolumeNegativeTest-1378806597 tempest-AttachVolumeNegativeTest-1378806597-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=120741) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Sep 13 18:09:45.028900 dv-cinder-852009-8-iscsi devstack@n-api.service[120741]: DEBUG oslo_concurrency.lockutils [None req-55a6fd7c-49d1-4cc4-920f-663d5153cf73 tempest-AttachVolumeNegativeTest-1378806597 tempest-AttachVolumeNegativeTest-1378806597-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120741) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 18:09:45.029387 dv-cinder-852009-8-iscsi devstack@n-api.service[120741]: DEBUG oslo_concurrency.lockutils [None req-55a6fd7c-49d1-4cc4-920f-663d5153cf73 tempest-AttachVolumeNegativeTest-1378806597 tempest-AttachVolumeNegativeTest-1378806597-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120741) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 18:09:45.029822 dv-cinder-852009-8-iscsi devstack@n-api.service[120741]: DEBUG oslo_concurrency.lockutils [None req-55a6fd7c-49d1-4cc4-920f-663d5153cf73 tempest-AttachVolumeNegativeTest-1378806597 tempest-AttachVolumeNegativeTest-1378806597-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120741) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 18:09:45.030548 dv-cinder-852009-8-iscsi devstack@n-api.service[120741]: DEBUG oslo_concurrency.lockutils [None req-55a6fd7c-49d1-4cc4-920f-663d5153cf73 tempest-AttachVolumeNegativeTest-1378806597 tempest-AttachVolumeNegativeTest-1378806597-project] Acquiring lock "1daf4f4c-0e4a-4779-b53a-78c48397ea2f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120741) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 18:09:45.030999 dv-cinder-852009-8-iscsi devstack@n-api.service[120741]: DEBUG oslo_concurrency.lockutils [None req-55a6fd7c-49d1-4cc4-920f-663d5153cf73 tempest-AttachVolumeNegativeTest-1378806597 tempest-AttachVolumeNegativeTest-1378806597-project] Lock "1daf4f4c-0e4a-4779-b53a-78c48397ea2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120741) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 18:09:45.031431 dv-cinder-852009-8-iscsi devstack@n-api.service[120741]: DEBUG oslo_concurrency.lockutils [None req-55a6fd7c-49d1-4cc4-920f-663d5153cf73 tempest-AttachVolumeNegativeTest-1378806597 tempest-AttachVolumeNegativeTest-1378806597-project] Lock "1daf4f4c-0e4a-4779-b53a-78c48397ea2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120741) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 18:09:45.047753 dv-cinder-852009-8-iscsi devstack@n-api.service[120741]: DEBUG nova.quota [None req-55a6fd7c-49d1-4cc4-920f-663d5153cf73 tempest-AttachVolumeNegativeTest-1378806597 tempest-AttachVolumeNegativeTest-1378806597-project] Getting quotas for project 629311eda0584a5fbb7d8995cf27540c. Resources: {'cores', 'ram', 'instances'} {{(pid=120741) _get_quotas /opt/stack/nova/nova/quota.py:393}} Sep 13 18:09:45.051998 dv-cinder-852009-8-iscsi devstack@n-api.service[120741]: DEBUG nova.quota [None req-55a6fd7c-49d1-4cc4-920f-663d5153cf73 tempest-AttachVolumeNegativeTest-1378806597 tempest-AttachVolumeNegativeTest-1378806597-project] Getting quotas for user 714cd09ba19b492f9a8c80343abcf6b9 and project 629311eda0584a5fbb7d8995cf27540c. Resources: {'cores', 'ram', 'instances'} {{(pid=120741) _get_quotas /opt/stack/nova/nova/quota.py:383}} Sep 13 18:09:45.063652 dv-cinder-852009-8-iscsi devstack@n-api.service[120741]: DEBUG nova.compute.api [None req-55a6fd7c-49d1-4cc4-920f-663d5153cf73 tempest-AttachVolumeNegativeTest-1378806597 tempest-AttachVolumeNegativeTest-1378806597-project] Going to run 1 instances... {{(pid=120741) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Sep 13 18:09:45.066140 dv-cinder-852009-8-iscsi devstack@n-api.service[120741]: DEBUG nova.compute.api [None req-55a6fd7c-49d1-4cc4-920f-663d5153cf73 tempest-AttachVolumeNegativeTest-1378806597 tempest-AttachVolumeNegativeTest-1378806597-project] [instance: b6be21a8-a1fd-44ff-9fca-88e979974510] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='33034e36-e6b2-4847-92a1-ff3188c05a4a',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=120741) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Sep 13 18:09:45.114682 dv-cinder-852009-8-iscsi devstack@n-api.service[120741]: INFO nova.api.openstack.requestlog [None req-55a6fd7c-49d1-4cc4-920f-663d5153cf73 tempest-AttachVolumeNegativeTest-1378806597 tempest-AttachVolumeNegativeTest-1378806597-project] 10.222.0.43 "POST /compute/v2.1/servers" status: 202 len: 402 microversion: 2.1 time: 0.666726 Sep 13 18:09:45.115245 dv-cinder-852009-8-iscsi devstack@n-api.service[120741]: [pid: 120741|app: 0|req: 374/759] 10.222.0.43 () {60 vars in 1147 bytes} [Tue Sep 13 18:09:44 2022] POST /compute/v2.1/servers => generated 402 bytes in 668 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Sep 13 18:09:45.127573 dv-cinder-852009-8-iscsi devstack@n-api.service[120740]: DEBUG nova.api.openstack.wsgi [None req-a374672d-e523-4582-96c6-18c21acd1de4 tempest-AttachVolumeNegativeTest-1378806597 tempest-AttachVolumeNegativeTest-1378806597-project] Calling method '>' {{(pid=120740) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 18:09:45.128513 dv-cinder-852009-8-iscsi devstack@n-api.service[120740]: DEBUG nova.compute.api [None req-a374672d-e523-4582-96c6-18c21acd1de4 tempest-AttachVolumeNegativeTest-1378806597 tempest-AttachVolumeNegativeTest-1378806597-project] [instance: b6be21a8-a1fd-44ff-9fca-88e979974510] Fetching instance by UUID {{(pid=120740) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 18:09:45.186129 dv-cinder-852009-8-iscsi devstack@n-api.service[120740]: DEBUG nova.policy [None req-a374672d-e523-4582-96c6-18c21acd1de4 tempest-AttachVolumeNegativeTest-1378806597 tempest-AttachVolumeNegativeTest-1378806597-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '714cd09ba19b492f9a8c80343abcf6b9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '629311eda0584a5fbb7d8995cf27540c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120740) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 18:09:45.193064 dv-cinder-852009-8-iscsi devstack@n-api.service[120740]: INFO nova.api.openstack.requestlog [None req-a374672d-e523-4582-96c6-18c21acd1de4 tempest-AttachVolumeNegativeTest-1378806597 tempest-AttachVolumeNegativeTest-1378806597-project] 10.222.0.43 "GET /compute/v2.1/servers/b6be21a8-a1fd-44ff-9fca-88e979974510" status: 200 len: 1242 microversion: 2.1 time: 0.070336 Sep 13 18:09:45.193634 dv-cinder-852009-8-iscsi devstack@n-api.service[120740]: [pid: 120740|app: 0|req: 386/760] 10.222.0.43 () {58 vars in 1236 bytes} [Tue Sep 13 18:09:45 2022] GET /compute/v2.1/servers/b6be21a8-a1fd-44ff-9fca-88e979974510 => generated 1242 bytes in 71 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 13 18:09:46.216834 dv-cinder-852009-8-iscsi devstack@n-api.service[120741]: DEBUG nova.api.openstack.wsgi [None req-44b95e5e-c735-4608-aa93-286500877d12 tempest-AttachVolumeNegativeTest-1378806597 tempest-AttachVolumeNegativeTest-1378806597-project] Calling method '>' {{(pid=120741) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 18:09:46.218130 dv-cinder-852009-8-iscsi devstack@n-api.service[120741]: DEBUG nova.compute.api [None req-44b95e5e-c735-4608-aa93-286500877d12 tempest-AttachVolumeNegativeTest-1378806597 tempest-AttachVolumeNegativeTest-1378806597-project] [instance: b6be21a8-a1fd-44ff-9fca-88e979974510] Fetching instance by UUID {{(pid=120741) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 18:09:46.225955 dv-cinder-852009-8-iscsi devstack@n-api.service[120741]: DEBUG oslo_concurrency.lockutils [None req-44b95e5e-c735-4608-aa93-286500877d12 tempest-AttachVolumeNegativeTest-1378806597 tempest-AttachVolumeNegativeTest-1378806597-project] Acquiring lock "1daf4f4c-0e4a-4779-b53a-78c48397ea2f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120741) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 18:09:46.226491 dv-cinder-852009-8-iscsi devstack@n-api.service[120741]: DEBUG oslo_concurrency.lockutils [None req-44b95e5e-c735-4608-aa93-286500877d12 tempest-AttachVolumeNegativeTest-1378806597 tempest-AttachVolumeNegativeTest-1378806597-project] Lock "1daf4f4c-0e4a-4779-b53a-78c48397ea2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120741) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 18:09:46.227085 dv-cinder-852009-8-iscsi devstack@n-api.service[120741]: DEBUG oslo_concurrency.lockutils [None req-44b95e5e-c735-4608-aa93-286500877d12 tempest-AttachVolumeNegativeTest-1378806597 tempest-AttachVolumeNegativeTest-1378806597-project] Lock "1daf4f4c-0e4a-4779-b53a-78c48397ea2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120741) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 18:09:46.228016 dv-cinder-852009-8-iscsi devstack@n-api.service[120741]: DEBUG oslo_concurrency.lockutils [None req-44b95e5e-c735-4608-aa93-286500877d12 tempest-AttachVolumeNegativeTest-1378806597 tempest-AttachVolumeNegativeTest-1378806597-project] Acquiring lock "1daf4f4c-0e4a-4779-b53a-78c48397ea2f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120741) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 18:09:46.228652 dv-cinder-852009-8-iscsi devstack@n-api.service[120741]: DEBUG oslo_concurrency.lockutils [None req-44b95e5e-c735-4608-aa93-286500877d12 tempest-AttachVolumeNegativeTest-1378806597 tempest-AttachVolumeNegativeTest-1378806597-project] Lock "1daf4f4c-0e4a-4779-b53a-78c48397ea2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120741) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 18:09:46.229242 dv-cinder-852009-8-iscsi devstack@n-api.service[120741]: DEBUG oslo_concurrency.lockutils [None req-44b95e5e-c735-4608-aa93-286500877d12 tempest-AttachVolumeNegativeTest-1378806597 tempest-AttachVolumeNegativeTest-1378806597-project] Lock "1daf4f4c-0e4a-4779-b53a-78c48397ea2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120741) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 18:09:46.550411 dv-cinder-852009-8-iscsi devstack@n-api.service[120741]: DEBUG nova.policy [None req-44b95e5e-c735-4608-aa93-286500877d12 tempest-AttachVolumeNegativeTest-1378806597 tempest-AttachVolumeNegativeTest-1378806597-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '714cd09ba19b492f9a8c80343abcf6b9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '629311eda0584a5fbb7d8995cf27540c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120741) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 18:09:46.559002 dv-cinder-852009-8-iscsi devstack@n-api.service[120741]: INFO nova.api.openstack.requestlog [None req-44b95e5e-c735-4608-aa93-286500877d12 tempest-AttachVolumeNegativeTest-1378806597 tempest-AttachVolumeNegativeTest-1378806597-project] 10.222.0.43 "GET /compute/v2.1/servers/b6be21a8-a1fd-44ff-9fca-88e979974510" status: 200 len: 1302 microversion: 2.1 time: 0.347641 Sep 13 18:09:46.559595 dv-cinder-852009-8-iscsi devstack@n-api.service[120741]: [pid: 120741|app: 0|req: 375/761] 10.222.0.43 () {58 vars in 1236 bytes} [Tue Sep 13 18:09:46 2022] GET /compute/v2.1/servers/b6be21a8-a1fd-44ff-9fca-88e979974510 => generated 1302 bytes in 349 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 13 18:09:47.582194 dv-cinder-852009-8-iscsi devstack@n-api.service[120740]: DEBUG nova.api.openstack.wsgi [None req-cdc08266-7bec-444f-a9aa-78c5b3ecb0a5 tempest-AttachVolumeNegativeTest-1378806597 tempest-AttachVolumeNegativeTest-1378806597-project] Calling method '>' {{(pid=120740) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 18:09:47.582799 dv-cinder-852009-8-iscsi devstack@n-api.service[120740]: DEBUG nova.compute.api [None req-cdc08266-7bec-444f-a9aa-78c5b3ecb0a5 tempest-AttachVolumeNegativeTest-1378806597 tempest-AttachVolumeNegativeTest-1378806597-project] [instance: b6be21a8-a1fd-44ff-9fca-88e979974510] Fetching instance by UUID {{(pid=120740) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 18:09:47.589667 dv-cinder-852009-8-iscsi devstack@n-api.service[120740]: DEBUG oslo_concurrency.lockutils [None req-cdc08266-7bec-444f-a9aa-78c5b3ecb0a5 tempest-AttachVolumeNegativeTest-1378806597 tempest-AttachVolumeNegativeTest-1378806597-project] Acquiring lock "1daf4f4c-0e4a-4779-b53a-78c48397ea2f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120740) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 18:09:47.590038 dv-cinder-852009-8-iscsi devstack@n-api.service[120740]: DEBUG oslo_concurrency.lockutils [None req-cdc08266-7bec-444f-a9aa-78c5b3ecb0a5 tempest-AttachVolumeNegativeTest-1378806597 tempest-AttachVolumeNegativeTest-1378806597-project] Lock "1daf4f4c-0e4a-4779-b53a-78c48397ea2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120740) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 18:09:47.590468 dv-cinder-852009-8-iscsi devstack@n-api.service[120740]: DEBUG oslo_concurrency.lockutils [None req-cdc08266-7bec-444f-a9aa-78c5b3ecb0a5 tempest-AttachVolumeNegativeTest-1378806597 tempest-AttachVolumeNegativeTest-1378806597-project] Lock "1daf4f4c-0e4a-4779-b53a-78c48397ea2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120740) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 18:09:47.591164 dv-cinder-852009-8-iscsi devstack@n-api.service[120740]: DEBUG oslo_concurrency.lockutils [None req-cdc08266-7bec-444f-a9aa-78c5b3ecb0a5 tempest-AttachVolumeNegativeTest-1378806597 tempest-AttachVolumeNegativeTest-1378806597-project] Acquiring lock "1daf4f4c-0e4a-4779-b53a-78c48397ea2f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120740) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 18:09:47.592274 dv-cinder-852009-8-iscsi devstack@n-api.service[120740]: DEBUG oslo_concurrency.lockutils [None req-cdc08266-7bec-444f-a9aa-78c5b3ecb0a5 tempest-AttachVolumeNegativeTest-1378806597 tempest-AttachVolumeNegativeTest-1378806597-project] Lock "1daf4f4c-0e4a-4779-b53a-78c48397ea2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120740) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 18:09:47.592733 dv-cinder-852009-8-iscsi devstack@n-api.service[120740]: DEBUG oslo_concurrency.lockutils [None req-cdc08266-7bec-444f-a9aa-78c5b3ecb0a5 tempest-AttachVolumeNegativeTest-1378806597 tempest-AttachVolumeNegativeTest-1378806597-project] Lock "1daf4f4c-0e4a-4779-b53a-78c48397ea2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120740) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 18:09:47.690651 dv-cinder-852009-8-iscsi devstack@n-api.service[120741]: DEBUG nova.api.openstack.wsgi [req-f5a7924e-4a84-45e2-9b15-c608027a40e0 req-cef3a83d-056c-46c1-a97d-ec39b23ad205 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "b6be21a8-a1fd-44ff-9fca-88e979974510", "tag": "25936ca7-0cd8-4855-af50-f4d7dc68d8f0"}]} {{(pid=120741) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 13 18:09:47.706846 dv-cinder-852009-8-iscsi devstack@n-api.service[120741]: DEBUG oslo_concurrency.lockutils [req-f5a7924e-4a84-45e2-9b15-c608027a40e0 req-cef3a83d-056c-46c1-a97d-ec39b23ad205 service nova] Acquiring lock "1daf4f4c-0e4a-4779-b53a-78c48397ea2f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120741) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 18:09:47.707582 dv-cinder-852009-8-iscsi devstack@n-api.service[120741]: DEBUG oslo_concurrency.lockutils [req-f5a7924e-4a84-45e2-9b15-c608027a40e0 req-cef3a83d-056c-46c1-a97d-ec39b23ad205 service nova] Lock "1daf4f4c-0e4a-4779-b53a-78c48397ea2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120741) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 18:09:47.708264 dv-cinder-852009-8-iscsi devstack@n-api.service[120741]: DEBUG oslo_concurrency.lockutils [req-f5a7924e-4a84-45e2-9b15-c608027a40e0 req-cef3a83d-056c-46c1-a97d-ec39b23ad205 service nova] Lock "1daf4f4c-0e4a-4779-b53a-78c48397ea2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120741) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 18:09:47.724102 dv-cinder-852009-8-iscsi devstack@n-api.service[120741]: INFO nova.api.openstack.compute.server_external_events [req-f5a7924e-4a84-45e2-9b15-c608027a40e0 req-cef3a83d-056c-46c1-a97d-ec39b23ad205 service nova] Creating event network-changed:25936ca7-0cd8-4855-af50-f4d7dc68d8f0 for instance b6be21a8-a1fd-44ff-9fca-88e979974510 on hv-cinder-85200 Sep 13 18:09:47.732318 dv-cinder-852009-8-iscsi devstack@n-api.service[120741]: INFO nova.api.openstack.requestlog [req-f5a7924e-4a84-45e2-9b15-c608027a40e0 req-cef3a83d-056c-46c1-a97d-ec39b23ad205 service nova] 10.222.0.43 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.045539 Sep 13 18:09:47.733501 dv-cinder-852009-8-iscsi devstack@n-api.service[120741]: [pid: 120741|app: 0|req: 376/762] 10.222.0.43 () {64 vars in 1317 bytes} [Tue Sep 13 18:09:47 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 51 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 13 18:09:47.738809 dv-cinder-852009-8-iscsi devstack@n-api.service[120740]: DEBUG nova.policy [None req-cdc08266-7bec-444f-a9aa-78c5b3ecb0a5 tempest-AttachVolumeNegativeTest-1378806597 tempest-AttachVolumeNegativeTest-1378806597-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '714cd09ba19b492f9a8c80343abcf6b9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '629311eda0584a5fbb7d8995cf27540c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120740) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 18:09:47.750601 dv-cinder-852009-8-iscsi devstack@n-api.service[120740]: INFO nova.api.openstack.requestlog [None req-cdc08266-7bec-444f-a9aa-78c5b3ecb0a5 tempest-AttachVolumeNegativeTest-1378806597 tempest-AttachVolumeNegativeTest-1378806597-project] 10.222.0.43 "GET /compute/v2.1/servers/b6be21a8-a1fd-44ff-9fca-88e979974510" status: 200 len: 1368 microversion: 2.1 time: 0.172531 Sep 13 18:09:47.751524 dv-cinder-852009-8-iscsi devstack@n-api.service[120740]: [pid: 120740|app: 0|req: 387/763] 10.222.0.43 () {58 vars in 1236 bytes} [Tue Sep 13 18:09:47 2022] GET /compute/v2.1/servers/b6be21a8-a1fd-44ff-9fca-88e979974510 => generated 1368 bytes in 174 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 13 18:09:48.132023 dv-cinder-852009-8-iscsi devstack@n-api.service[120741]: DEBUG nova.api.openstack.wsgi [None req-d9e5a916-9867-4585-a9c1-41db60bca931 tempest-VolumesSnapshotTestJSON-1753826991 tempest-VolumesSnapshotTestJSON-1753826991-project] Calling method '>' {{(pid=120741) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 18:09:48.132628 dv-cinder-852009-8-iscsi devstack@n-api.service[120741]: DEBUG nova.compute.api [None req-d9e5a916-9867-4585-a9c1-41db60bca931 tempest-VolumesSnapshotTestJSON-1753826991 tempest-VolumesSnapshotTestJSON-1753826991-project] [instance: a5fb6dae-b0b9-4bd1-8974-d5a1ae1aaeb0] Fetching instance by UUID {{(pid=120741) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 18:09:48.140939 dv-cinder-852009-8-iscsi devstack@n-api.service[120741]: DEBUG oslo_concurrency.lockutils [None req-d9e5a916-9867-4585-a9c1-41db60bca931 tempest-VolumesSnapshotTestJSON-1753826991 tempest-VolumesSnapshotTestJSON-1753826991-project] Acquiring lock "1daf4f4c-0e4a-4779-b53a-78c48397ea2f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120741) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 18:09:48.141437 dv-cinder-852009-8-iscsi devstack@n-api.service[120741]: DEBUG oslo_concurrency.lockutils [None req-d9e5a916-9867-4585-a9c1-41db60bca931 tempest-VolumesSnapshotTestJSON-1753826991 tempest-VolumesSnapshotTestJSON-1753826991-project] Lock "1daf4f4c-0e4a-4779-b53a-78c48397ea2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120741) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 18:09:48.141861 dv-cinder-852009-8-iscsi devstack@n-api.service[120741]: DEBUG oslo_concurrency.lockutils [None req-d9e5a916-9867-4585-a9c1-41db60bca931 tempest-VolumesSnapshotTestJSON-1753826991 tempest-VolumesSnapshotTestJSON-1753826991-project] Lock "1daf4f4c-0e4a-4779-b53a-78c48397ea2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120741) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 18:09:48.143327 dv-cinder-852009-8-iscsi devstack@n-api.service[120741]: DEBUG oslo_concurrency.lockutils [None req-d9e5a916-9867-4585-a9c1-41db60bca931 tempest-VolumesSnapshotTestJSON-1753826991 tempest-VolumesSnapshotTestJSON-1753826991-project] Acquiring lock "1daf4f4c-0e4a-4779-b53a-78c48397ea2f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120741) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 18:09:48.144154 dv-cinder-852009-8-iscsi devstack@n-api.service[120741]: DEBUG oslo_concurrency.lockutils [None req-d9e5a916-9867-4585-a9c1-41db60bca931 tempest-VolumesSnapshotTestJSON-1753826991 tempest-VolumesSnapshotTestJSON-1753826991-project] Lock "1daf4f4c-0e4a-4779-b53a-78c48397ea2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120741) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 18:09:48.144628 dv-cinder-852009-8-iscsi devstack@n-api.service[120741]: DEBUG oslo_concurrency.lockutils [None req-d9e5a916-9867-4585-a9c1-41db60bca931 tempest-VolumesSnapshotTestJSON-1753826991 tempest-VolumesSnapshotTestJSON-1753826991-project] Lock "1daf4f4c-0e4a-4779-b53a-78c48397ea2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120741) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 18:09:48.231165 dv-cinder-852009-8-iscsi devstack@n-api.service[120741]: DEBUG nova.objects.instance [None req-d9e5a916-9867-4585-a9c1-41db60bca931 tempest-VolumesSnapshotTestJSON-1753826991 tempest-VolumesSnapshotTestJSON-1753826991-project] Lazy-loading 'services' on Instance uuid a5fb6dae-b0b9-4bd1-8974-d5a1ae1aaeb0 {{(pid=120741) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Sep 13 18:09:48.306095 dv-cinder-852009-8-iscsi devstack@n-api.service[120741]: INFO nova.api.openstack.requestlog [None req-d9e5a916-9867-4585-a9c1-41db60bca931 tempest-VolumesSnapshotTestJSON-1753826991 tempest-VolumesSnapshotTestJSON-1753826991-project] 10.222.0.43 "DELETE /compute/v2.1/servers/a5fb6dae-b0b9-4bd1-8974-d5a1ae1aaeb0/os-volume_attachments/045bae50-fb2c-47bb-9278-bc76f0c004eb" status: 202 len: 0 microversion: 2.1 time: 0.179693 Sep 13 18:09:48.306684 dv-cinder-852009-8-iscsi devstack@n-api.service[120741]: [pid: 120741|app: 0|req: 377/764] 10.222.0.43 () {58 vars in 1416 bytes} [Tue Sep 13 18:09:48 2022] DELETE /compute/v2.1/servers/a5fb6dae-b0b9-4bd1-8974-d5a1ae1aaeb0/os-volume_attachments/045bae50-fb2c-47bb-9278-bc76f0c004eb => generated 0 bytes in 181 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Sep 13 18:09:48.774677 dv-cinder-852009-8-iscsi devstack@n-api.service[120740]: DEBUG nova.api.openstack.wsgi [None req-1bf16080-624e-444b-9862-1b81698d4e4e tempest-AttachVolumeNegativeTest-1378806597 tempest-AttachVolumeNegativeTest-1378806597-project] Calling method '>' {{(pid=120740) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 18:09:48.775325 dv-cinder-852009-8-iscsi devstack@n-api.service[120740]: DEBUG nova.compute.api [None req-1bf16080-624e-444b-9862-1b81698d4e4e tempest-AttachVolumeNegativeTest-1378806597 tempest-AttachVolumeNegativeTest-1378806597-project] [instance: b6be21a8-a1fd-44ff-9fca-88e979974510] Fetching instance by UUID {{(pid=120740) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 18:09:48.784082 dv-cinder-852009-8-iscsi devstack@n-api.service[120740]: DEBUG oslo_concurrency.lockutils [None req-1bf16080-624e-444b-9862-1b81698d4e4e tempest-AttachVolumeNegativeTest-1378806597 tempest-AttachVolumeNegativeTest-1378806597-project] Acquiring lock "1daf4f4c-0e4a-4779-b53a-78c48397ea2f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120740) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 18:09:48.784905 dv-cinder-852009-8-iscsi devstack@n-api.service[120740]: DEBUG oslo_concurrency.lockutils [None req-1bf16080-624e-444b-9862-1b81698d4e4e tempest-AttachVolumeNegativeTest-1378806597 tempest-AttachVolumeNegativeTest-1378806597-project] Lock "1daf4f4c-0e4a-4779-b53a-78c48397ea2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120740) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 18:09:48.785614 dv-cinder-852009-8-iscsi devstack@n-api.service[120740]: DEBUG oslo_concurrency.lockutils [None req-1bf16080-624e-444b-9862-1b81698d4e4e tempest-AttachVolumeNegativeTest-1378806597 tempest-AttachVolumeNegativeTest-1378806597-project] Lock "1daf4f4c-0e4a-4779-b53a-78c48397ea2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120740) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 18:09:48.786728 dv-cinder-852009-8-iscsi devstack@n-api.service[120740]: DEBUG oslo_concurrency.lockutils [None req-1bf16080-624e-444b-9862-1b81698d4e4e tempest-AttachVolumeNegativeTest-1378806597 tempest-AttachVolumeNegativeTest-1378806597-project] Acquiring lock "1daf4f4c-0e4a-4779-b53a-78c48397ea2f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120740) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 18:09:48.787457 dv-cinder-852009-8-iscsi devstack@n-api.service[120740]: DEBUG oslo_concurrency.lockutils [None req-1bf16080-624e-444b-9862-1b81698d4e4e tempest-AttachVolumeNegativeTest-1378806597 tempest-AttachVolumeNegativeTest-1378806597-project] Lock "1daf4f4c-0e4a-4779-b53a-78c48397ea2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120740) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 18:09:48.788141 dv-cinder-852009-8-iscsi devstack@n-api.service[120740]: DEBUG oslo_concurrency.lockutils [None req-1bf16080-624e-444b-9862-1b81698d4e4e tempest-AttachVolumeNegativeTest-1378806597 tempest-AttachVolumeNegativeTest-1378806597-project] Lock "1daf4f4c-0e4a-4779-b53a-78c48397ea2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120740) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 18:09:48.932161 dv-cinder-852009-8-iscsi devstack@n-api.service[120740]: DEBUG nova.policy [None req-1bf16080-624e-444b-9862-1b81698d4e4e tempest-AttachVolumeNegativeTest-1378806597 tempest-AttachVolumeNegativeTest-1378806597-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '714cd09ba19b492f9a8c80343abcf6b9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '629311eda0584a5fbb7d8995cf27540c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120740) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 18:09:48.940865 dv-cinder-852009-8-iscsi devstack@n-api.service[120740]: INFO nova.api.openstack.requestlog [None req-1bf16080-624e-444b-9862-1b81698d4e4e tempest-AttachVolumeNegativeTest-1378806597 tempest-AttachVolumeNegativeTest-1378806597-project] 10.222.0.43 "GET /compute/v2.1/servers/b6be21a8-a1fd-44ff-9fca-88e979974510" status: 200 len: 1368 microversion: 2.1 time: 0.170365 Sep 13 18:09:48.941416 dv-cinder-852009-8-iscsi devstack@n-api.service[120740]: [pid: 120740|app: 0|req: 388/765] 10.222.0.43 () {58 vars in 1236 bytes} [Tue Sep 13 18:09:48 2022] GET /compute/v2.1/servers/b6be21a8-a1fd-44ff-9fca-88e979974510 => generated 1368 bytes in 172 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 13 18:09:49.970301 dv-cinder-852009-8-iscsi devstack@n-api.service[120741]: DEBUG nova.api.openstack.wsgi [None req-19577397-c2a8-4a54-be15-9af4a4514ccb tempest-AttachVolumeNegativeTest-1378806597 tempest-AttachVolumeNegativeTest-1378806597-project] Calling method '>' {{(pid=120741) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 18:09:49.971325 dv-cinder-852009-8-iscsi devstack@n-api.service[120741]: DEBUG nova.compute.api [None req-19577397-c2a8-4a54-be15-9af4a4514ccb tempest-AttachVolumeNegativeTest-1378806597 tempest-AttachVolumeNegativeTest-1378806597-project] [instance: b6be21a8-a1fd-44ff-9fca-88e979974510] Fetching instance by UUID {{(pid=120741) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 18:09:49.978330 dv-cinder-852009-8-iscsi devstack@n-api.service[120741]: DEBUG oslo_concurrency.lockutils [None req-19577397-c2a8-4a54-be15-9af4a4514ccb tempest-AttachVolumeNegativeTest-1378806597 tempest-AttachVolumeNegativeTest-1378806597-project] Acquiring lock "1daf4f4c-0e4a-4779-b53a-78c48397ea2f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120741) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 18:09:49.978814 dv-cinder-852009-8-iscsi devstack@n-api.service[120741]: DEBUG oslo_concurrency.lockutils [None req-19577397-c2a8-4a54-be15-9af4a4514ccb tempest-AttachVolumeNegativeTest-1378806597 tempest-AttachVolumeNegativeTest-1378806597-project] Lock "1daf4f4c-0e4a-4779-b53a-78c48397ea2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120741) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 18:09:49.979280 dv-cinder-852009-8-iscsi devstack@n-api.service[120741]: DEBUG oslo_concurrency.lockutils [None req-19577397-c2a8-4a54-be15-9af4a4514ccb tempest-AttachVolumeNegativeTest-1378806597 tempest-AttachVolumeNegativeTest-1378806597-project] Lock "1daf4f4c-0e4a-4779-b53a-78c48397ea2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120741) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 18:09:49.979970 dv-cinder-852009-8-iscsi devstack@n-api.service[120741]: DEBUG oslo_concurrency.lockutils [None req-19577397-c2a8-4a54-be15-9af4a4514ccb tempest-AttachVolumeNegativeTest-1378806597 tempest-AttachVolumeNegativeTest-1378806597-project] Acquiring lock "1daf4f4c-0e4a-4779-b53a-78c48397ea2f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120741) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 18:09:49.980452 dv-cinder-852009-8-iscsi devstack@n-api.service[120741]: DEBUG oslo_concurrency.lockutils [None req-19577397-c2a8-4a54-be15-9af4a4514ccb tempest-AttachVolumeNegativeTest-1378806597 tempest-AttachVolumeNegativeTest-1378806597-project] Lock "1daf4f4c-0e4a-4779-b53a-78c48397ea2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120741) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 18:09:49.980878 dv-cinder-852009-8-iscsi devstack@n-api.service[120741]: DEBUG oslo_concurrency.lockutils [None req-19577397-c2a8-4a54-be15-9af4a4514ccb tempest-AttachVolumeNegativeTest-1378806597 tempest-AttachVolumeNegativeTest-1378806597-project] Lock "1daf4f4c-0e4a-4779-b53a-78c48397ea2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120741) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 18:09:50.123254 dv-cinder-852009-8-iscsi devstack@n-api.service[120741]: DEBUG nova.policy [None req-19577397-c2a8-4a54-be15-9af4a4514ccb tempest-AttachVolumeNegativeTest-1378806597 tempest-AttachVolumeNegativeTest-1378806597-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '714cd09ba19b492f9a8c80343abcf6b9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '629311eda0584a5fbb7d8995cf27540c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120741) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 18:09:50.133447 dv-cinder-852009-8-iscsi devstack@n-api.service[120741]: INFO nova.api.openstack.requestlog [None req-19577397-c2a8-4a54-be15-9af4a4514ccb tempest-AttachVolumeNegativeTest-1378806597 tempest-AttachVolumeNegativeTest-1378806597-project] 10.222.0.43 "GET /compute/v2.1/servers/b6be21a8-a1fd-44ff-9fca-88e979974510" status: 200 len: 1368 microversion: 2.1 time: 0.171502 Sep 13 18:09:50.134026 dv-cinder-852009-8-iscsi devstack@n-api.service[120741]: [pid: 120741|app: 0|req: 378/766] 10.222.0.43 () {58 vars in 1236 bytes} [Tue Sep 13 18:09:49 2022] GET /compute/v2.1/servers/b6be21a8-a1fd-44ff-9fca-88e979974510 => generated 1368 bytes in 173 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 13 18:09:50.506726 dv-cinder-852009-8-iscsi devstack@n-api.service[120740]: DEBUG nova.api.openstack.wsgi [None req-81a206e5-edc4-4fe8-a632-e5932e164e57 tempest-VolumesSnapshotTestJSON-1753826991 tempest-VolumesSnapshotTestJSON-1753826991-project] Calling method '>' {{(pid=120740) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 18:09:50.507280 dv-cinder-852009-8-iscsi devstack@n-api.service[120740]: DEBUG nova.compute.api [None req-81a206e5-edc4-4fe8-a632-e5932e164e57 tempest-VolumesSnapshotTestJSON-1753826991 tempest-VolumesSnapshotTestJSON-1753826991-project] [instance: a5fb6dae-b0b9-4bd1-8974-d5a1ae1aaeb0] Fetching instance by UUID {{(pid=120740) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 18:09:50.513819 dv-cinder-852009-8-iscsi devstack@n-api.service[120740]: DEBUG oslo_concurrency.lockutils [None req-81a206e5-edc4-4fe8-a632-e5932e164e57 tempest-VolumesSnapshotTestJSON-1753826991 tempest-VolumesSnapshotTestJSON-1753826991-project] Acquiring lock "1daf4f4c-0e4a-4779-b53a-78c48397ea2f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120740) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 18:09:50.514296 dv-cinder-852009-8-iscsi devstack@n-api.service[120740]: DEBUG oslo_concurrency.lockutils [None req-81a206e5-edc4-4fe8-a632-e5932e164e57 tempest-VolumesSnapshotTestJSON-1753826991 tempest-VolumesSnapshotTestJSON-1753826991-project] Lock "1daf4f4c-0e4a-4779-b53a-78c48397ea2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120740) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 18:09:50.514720 dv-cinder-852009-8-iscsi devstack@n-api.service[120740]: DEBUG oslo_concurrency.lockutils [None req-81a206e5-edc4-4fe8-a632-e5932e164e57 tempest-VolumesSnapshotTestJSON-1753826991 tempest-VolumesSnapshotTestJSON-1753826991-project] Lock "1daf4f4c-0e4a-4779-b53a-78c48397ea2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120740) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 18:09:50.515399 dv-cinder-852009-8-iscsi devstack@n-api.service[120740]: DEBUG oslo_concurrency.lockutils [None req-81a206e5-edc4-4fe8-a632-e5932e164e57 tempest-VolumesSnapshotTestJSON-1753826991 tempest-VolumesSnapshotTestJSON-1753826991-project] Acquiring lock "1daf4f4c-0e4a-4779-b53a-78c48397ea2f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120740) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 18:09:50.515841 dv-cinder-852009-8-iscsi devstack@n-api.service[120740]: DEBUG oslo_concurrency.lockutils [None req-81a206e5-edc4-4fe8-a632-e5932e164e57 tempest-VolumesSnapshotTestJSON-1753826991 tempest-VolumesSnapshotTestJSON-1753826991-project] Lock "1daf4f4c-0e4a-4779-b53a-78c48397ea2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120740) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 18:09:50.516229 dv-cinder-852009-8-iscsi devstack@n-api.service[120740]: DEBUG oslo_concurrency.lockutils [None req-81a206e5-edc4-4fe8-a632-e5932e164e57 tempest-VolumesSnapshotTestJSON-1753826991 tempest-VolumesSnapshotTestJSON-1753826991-project] Lock "1daf4f4c-0e4a-4779-b53a-78c48397ea2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120740) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 18:09:50.543502 dv-cinder-852009-8-iscsi devstack@n-api.service[120740]: DEBUG nova.compute.api [None req-81a206e5-edc4-4fe8-a632-e5932e164e57 tempest-VolumesSnapshotTestJSON-1753826991 tempest-VolumesSnapshotTestJSON-1753826991-project] [instance: a5fb6dae-b0b9-4bd1-8974-d5a1ae1aaeb0] Going to try to terminate instance {{(pid=120740) delete /opt/stack/nova/nova/compute/api.py:2719}} Sep 13 18:09:50.626241 dv-cinder-852009-8-iscsi devstack@n-api.service[120740]: INFO nova.api.openstack.requestlog [None req-81a206e5-edc4-4fe8-a632-e5932e164e57 tempest-VolumesSnapshotTestJSON-1753826991 tempest-VolumesSnapshotTestJSON-1753826991-project] 10.222.0.43 "DELETE /compute/v2.1/servers/a5fb6dae-b0b9-4bd1-8974-d5a1ae1aaeb0" status: 204 len: 0 microversion: 2.1 time: 0.123732 Sep 13 18:09:50.626788 dv-cinder-852009-8-iscsi devstack@n-api.service[120740]: [pid: 120740|app: 0|req: 389/767] 10.222.0.43 () {58 vars in 1239 bytes} [Tue Sep 13 18:09:50 2022] DELETE /compute/v2.1/servers/a5fb6dae-b0b9-4bd1-8974-d5a1ae1aaeb0 => generated 0 bytes in 125 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Sep 13 18:09:50.636981 dv-cinder-852009-8-iscsi devstack@n-api.service[120741]: DEBUG nova.api.openstack.wsgi [None req-67b15519-5a4b-4db4-bc3b-f467bd9d8bbc tempest-VolumesSnapshotTestJSON-1753826991 tempest-VolumesSnapshotTestJSON-1753826991-project] Calling method '>' {{(pid=120741) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 18:09:50.637683 dv-cinder-852009-8-iscsi devstack@n-api.service[120741]: DEBUG nova.compute.api [None req-67b15519-5a4b-4db4-bc3b-f467bd9d8bbc tempest-VolumesSnapshotTestJSON-1753826991 tempest-VolumesSnapshotTestJSON-1753826991-project] [instance: a5fb6dae-b0b9-4bd1-8974-d5a1ae1aaeb0] Fetching instance by UUID {{(pid=120741) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 18:09:50.644196 dv-cinder-852009-8-iscsi devstack@n-api.service[120741]: DEBUG oslo_concurrency.lockutils [None req-67b15519-5a4b-4db4-bc3b-f467bd9d8bbc tempest-VolumesSnapshotTestJSON-1753826991 tempest-VolumesSnapshotTestJSON-1753826991-project] Acquiring lock "1daf4f4c-0e4a-4779-b53a-78c48397ea2f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120741) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 18:09:50.644788 dv-cinder-852009-8-iscsi devstack@n-api.service[120741]: DEBUG oslo_concurrency.lockutils [None req-67b15519-5a4b-4db4-bc3b-f467bd9d8bbc tempest-VolumesSnapshotTestJSON-1753826991 tempest-VolumesSnapshotTestJSON-1753826991-project] Lock "1daf4f4c-0e4a-4779-b53a-78c48397ea2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120741) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 18:09:50.645280 dv-cinder-852009-8-iscsi devstack@n-api.service[120741]: DEBUG oslo_concurrency.lockutils [None req-67b15519-5a4b-4db4-bc3b-f467bd9d8bbc tempest-VolumesSnapshotTestJSON-1753826991 tempest-VolumesSnapshotTestJSON-1753826991-project] Lock "1daf4f4c-0e4a-4779-b53a-78c48397ea2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120741) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 18:09:50.646047 dv-cinder-852009-8-iscsi devstack@n-api.service[120741]: DEBUG oslo_concurrency.lockutils [None req-67b15519-5a4b-4db4-bc3b-f467bd9d8bbc tempest-VolumesSnapshotTestJSON-1753826991 tempest-VolumesSnapshotTestJSON-1753826991-project] Acquiring lock "1daf4f4c-0e4a-4779-b53a-78c48397ea2f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120741) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 18:09:50.646568 dv-cinder-852009-8-iscsi devstack@n-api.service[120741]: DEBUG oslo_concurrency.lockutils [None req-67b15519-5a4b-4db4-bc3b-f467bd9d8bbc tempest-VolumesSnapshotTestJSON-1753826991 tempest-VolumesSnapshotTestJSON-1753826991-project] Lock "1daf4f4c-0e4a-4779-b53a-78c48397ea2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120741) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 18:09:50.647044 dv-cinder-852009-8-iscsi devstack@n-api.service[120741]: DEBUG oslo_concurrency.lockutils [None req-67b15519-5a4b-4db4-bc3b-f467bd9d8bbc tempest-VolumesSnapshotTestJSON-1753826991 tempest-VolumesSnapshotTestJSON-1753826991-project] Lock "1daf4f4c-0e4a-4779-b53a-78c48397ea2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120741) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 18:09:50.784101 dv-cinder-852009-8-iscsi devstack@n-api.service[120741]: DEBUG nova.policy [None req-67b15519-5a4b-4db4-bc3b-f467bd9d8bbc tempest-VolumesSnapshotTestJSON-1753826991 tempest-VolumesSnapshotTestJSON-1753826991-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f379ce3f38fc41568493be7493e75736', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1271ab6e6c9b4c93b05aafddbdbf9afe', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120741) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 18:09:50.791984 dv-cinder-852009-8-iscsi devstack@n-api.service[120741]: INFO nova.api.openstack.requestlog [None req-67b15519-5a4b-4db4-bc3b-f467bd9d8bbc tempest-VolumesSnapshotTestJSON-1753826991 tempest-VolumesSnapshotTestJSON-1753826991-project] 10.222.0.43 "GET /compute/v2.1/servers/a5fb6dae-b0b9-4bd1-8974-d5a1ae1aaeb0" status: 200 len: 1513 microversion: 2.1 time: 0.160300 Sep 13 18:09:50.792591 dv-cinder-852009-8-iscsi devstack@n-api.service[120741]: [pid: 120741|app: 0|req: 379/768] 10.222.0.43 () {58 vars in 1236 bytes} [Tue Sep 13 18:09:50 2022] GET /compute/v2.1/servers/a5fb6dae-b0b9-4bd1-8974-d5a1ae1aaeb0 => generated 1513 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 13 18:09:51.157230 dv-cinder-852009-8-iscsi devstack@n-api.service[120740]: DEBUG nova.api.openstack.wsgi [None req-ce651af3-c9f4-46ae-8ab3-175f9c6bc182 tempest-AttachVolumeNegativeTest-1378806597 tempest-AttachVolumeNegativeTest-1378806597-project] Calling method '>' {{(pid=120740) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 18:09:51.157935 dv-cinder-852009-8-iscsi devstack@n-api.service[120740]: DEBUG nova.compute.api [None req-ce651af3-c9f4-46ae-8ab3-175f9c6bc182 tempest-AttachVolumeNegativeTest-1378806597 tempest-AttachVolumeNegativeTest-1378806597-project] [instance: b6be21a8-a1fd-44ff-9fca-88e979974510] Fetching instance by UUID {{(pid=120740) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 18:09:51.164591 dv-cinder-852009-8-iscsi devstack@n-api.service[120740]: DEBUG oslo_concurrency.lockutils [None req-ce651af3-c9f4-46ae-8ab3-175f9c6bc182 tempest-AttachVolumeNegativeTest-1378806597 tempest-AttachVolumeNegativeTest-1378806597-project] Acquiring lock "1daf4f4c-0e4a-4779-b53a-78c48397ea2f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120740) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 18:09:51.164985 dv-cinder-852009-8-iscsi devstack@n-api.service[120740]: DEBUG oslo_concurrency.lockutils [None req-ce651af3-c9f4-46ae-8ab3-175f9c6bc182 tempest-AttachVolumeNegativeTest-1378806597 tempest-AttachVolumeNegativeTest-1378806597-project] Lock "1daf4f4c-0e4a-4779-b53a-78c48397ea2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120740) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 18:09:51.165419 dv-cinder-852009-8-iscsi devstack@n-api.service[120740]: DEBUG oslo_concurrency.lockutils [None req-ce651af3-c9f4-46ae-8ab3-175f9c6bc182 tempest-AttachVolumeNegativeTest-1378806597 tempest-AttachVolumeNegativeTest-1378806597-project] Lock "1daf4f4c-0e4a-4779-b53a-78c48397ea2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120740) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 18:09:51.166168 dv-cinder-852009-8-iscsi devstack@n-api.service[120740]: DEBUG oslo_concurrency.lockutils [None req-ce651af3-c9f4-46ae-8ab3-175f9c6bc182 tempest-AttachVolumeNegativeTest-1378806597 tempest-AttachVolumeNegativeTest-1378806597-project] Acquiring lock "1daf4f4c-0e4a-4779-b53a-78c48397ea2f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120740) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 18:09:51.166621 dv-cinder-852009-8-iscsi devstack@n-api.service[120740]: DEBUG oslo_concurrency.lockutils [None req-ce651af3-c9f4-46ae-8ab3-175f9c6bc182 tempest-AttachVolumeNegativeTest-1378806597 tempest-AttachVolumeNegativeTest-1378806597-project] Lock "1daf4f4c-0e4a-4779-b53a-78c48397ea2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120740) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 18:09:51.167017 dv-cinder-852009-8-iscsi devstack@n-api.service[120740]: DEBUG oslo_concurrency.lockutils [None req-ce651af3-c9f4-46ae-8ab3-175f9c6bc182 tempest-AttachVolumeNegativeTest-1378806597 tempest-AttachVolumeNegativeTest-1378806597-project] Lock "1daf4f4c-0e4a-4779-b53a-78c48397ea2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120740) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 18:09:51.298540 dv-cinder-852009-8-iscsi devstack@n-api.service[120740]: DEBUG nova.policy [None req-ce651af3-c9f4-46ae-8ab3-175f9c6bc182 tempest-AttachVolumeNegativeTest-1378806597 tempest-AttachVolumeNegativeTest-1378806597-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '714cd09ba19b492f9a8c80343abcf6b9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '629311eda0584a5fbb7d8995cf27540c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120740) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 18:09:51.306635 dv-cinder-852009-8-iscsi devstack@n-api.service[120740]: INFO nova.api.openstack.requestlog [None req-ce651af3-c9f4-46ae-8ab3-175f9c6bc182 tempest-AttachVolumeNegativeTest-1378806597 tempest-AttachVolumeNegativeTest-1378806597-project] 10.222.0.43 "GET /compute/v2.1/servers/b6be21a8-a1fd-44ff-9fca-88e979974510" status: 200 len: 1368 microversion: 2.1 time: 0.153784 Sep 13 18:09:51.307217 dv-cinder-852009-8-iscsi devstack@n-api.service[120740]: [pid: 120740|app: 0|req: 390/769] 10.222.0.43 () {58 vars in 1236 bytes} [Tue Sep 13 18:09:51 2022] GET /compute/v2.1/servers/b6be21a8-a1fd-44ff-9fca-88e979974510 => generated 1368 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 13 18:09:51.817095 dv-cinder-852009-8-iscsi devstack@n-api.service[120741]: DEBUG nova.api.openstack.wsgi [None req-c21b7f16-7e6f-44fe-9f89-cc618ba509d2 tempest-VolumesSnapshotTestJSON-1753826991 tempest-VolumesSnapshotTestJSON-1753826991-project] Calling method '>' {{(pid=120741) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 18:09:51.817860 dv-cinder-852009-8-iscsi devstack@n-api.service[120741]: DEBUG nova.compute.api [None req-c21b7f16-7e6f-44fe-9f89-cc618ba509d2 tempest-VolumesSnapshotTestJSON-1753826991 tempest-VolumesSnapshotTestJSON-1753826991-project] [instance: a5fb6dae-b0b9-4bd1-8974-d5a1ae1aaeb0] Fetching instance by UUID {{(pid=120741) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 18:09:51.826534 dv-cinder-852009-8-iscsi devstack@n-api.service[120741]: DEBUG oslo_concurrency.lockutils [None req-c21b7f16-7e6f-44fe-9f89-cc618ba509d2 tempest-VolumesSnapshotTestJSON-1753826991 tempest-VolumesSnapshotTestJSON-1753826991-project] Acquiring lock "1daf4f4c-0e4a-4779-b53a-78c48397ea2f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120741) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 18:09:51.827141 dv-cinder-852009-8-iscsi devstack@n-api.service[120741]: DEBUG oslo_concurrency.lockutils [None req-c21b7f16-7e6f-44fe-9f89-cc618ba509d2 tempest-VolumesSnapshotTestJSON-1753826991 tempest-VolumesSnapshotTestJSON-1753826991-project] Lock "1daf4f4c-0e4a-4779-b53a-78c48397ea2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120741) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 18:09:51.827681 dv-cinder-852009-8-iscsi devstack@n-api.service[120741]: DEBUG oslo_concurrency.lockutils [None req-c21b7f16-7e6f-44fe-9f89-cc618ba509d2 tempest-VolumesSnapshotTestJSON-1753826991 tempest-VolumesSnapshotTestJSON-1753826991-project] Lock "1daf4f4c-0e4a-4779-b53a-78c48397ea2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120741) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 18:09:51.828610 dv-cinder-852009-8-iscsi devstack@n-api.service[120741]: DEBUG oslo_concurrency.lockutils [None req-c21b7f16-7e6f-44fe-9f89-cc618ba509d2 tempest-VolumesSnapshotTestJSON-1753826991 tempest-VolumesSnapshotTestJSON-1753826991-project] Acquiring lock "1daf4f4c-0e4a-4779-b53a-78c48397ea2f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120741) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 18:09:51.829178 dv-cinder-852009-8-iscsi devstack@n-api.service[120741]: DEBUG oslo_concurrency.lockutils [None req-c21b7f16-7e6f-44fe-9f89-cc618ba509d2 tempest-VolumesSnapshotTestJSON-1753826991 tempest-VolumesSnapshotTestJSON-1753826991-project] Lock "1daf4f4c-0e4a-4779-b53a-78c48397ea2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120741) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 18:09:51.829706 dv-cinder-852009-8-iscsi devstack@n-api.service[120741]: DEBUG oslo_concurrency.lockutils [None req-c21b7f16-7e6f-44fe-9f89-cc618ba509d2 tempest-VolumesSnapshotTestJSON-1753826991 tempest-VolumesSnapshotTestJSON-1753826991-project] Lock "1daf4f4c-0e4a-4779-b53a-78c48397ea2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120741) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 18:09:51.969554 dv-cinder-852009-8-iscsi devstack@n-api.service[120741]: DEBUG nova.policy [None req-c21b7f16-7e6f-44fe-9f89-cc618ba509d2 tempest-VolumesSnapshotTestJSON-1753826991 tempest-VolumesSnapshotTestJSON-1753826991-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f379ce3f38fc41568493be7493e75736', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1271ab6e6c9b4c93b05aafddbdbf9afe', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120741) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 18:09:51.977340 dv-cinder-852009-8-iscsi devstack@n-api.service[120741]: INFO nova.api.openstack.requestlog [None req-c21b7f16-7e6f-44fe-9f89-cc618ba509d2 tempest-VolumesSnapshotTestJSON-1753826991 tempest-VolumesSnapshotTestJSON-1753826991-project] 10.222.0.43 "GET /compute/v2.1/servers/a5fb6dae-b0b9-4bd1-8974-d5a1ae1aaeb0" status: 200 len: 1513 microversion: 2.1 time: 0.165287 Sep 13 18:09:51.977882 dv-cinder-852009-8-iscsi devstack@n-api.service[120741]: [pid: 120741|app: 0|req: 380/770] 10.222.0.43 () {58 vars in 1236 bytes} [Tue Sep 13 18:09:51 2022] GET /compute/v2.1/servers/a5fb6dae-b0b9-4bd1-8974-d5a1ae1aaeb0 => generated 1513 bytes in 167 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 13 18:09:52.330579 dv-cinder-852009-8-iscsi devstack@n-api.service[120740]: DEBUG nova.api.openstack.wsgi [None req-4e22a58b-5b1f-4793-ab9b-12bedd9d7bd6 tempest-AttachVolumeNegativeTest-1378806597 tempest-AttachVolumeNegativeTest-1378806597-project] Calling method '>' {{(pid=120740) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 18:09:52.331182 dv-cinder-852009-8-iscsi devstack@n-api.service[120740]: DEBUG nova.compute.api [None req-4e22a58b-5b1f-4793-ab9b-12bedd9d7bd6 tempest-AttachVolumeNegativeTest-1378806597 tempest-AttachVolumeNegativeTest-1378806597-project] [instance: b6be21a8-a1fd-44ff-9fca-88e979974510] Fetching instance by UUID {{(pid=120740) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 18:09:52.338311 dv-cinder-852009-8-iscsi devstack@n-api.service[120740]: DEBUG oslo_concurrency.lockutils [None req-4e22a58b-5b1f-4793-ab9b-12bedd9d7bd6 tempest-AttachVolumeNegativeTest-1378806597 tempest-AttachVolumeNegativeTest-1378806597-project] Acquiring lock "1daf4f4c-0e4a-4779-b53a-78c48397ea2f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120740) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 18:09:52.338804 dv-cinder-852009-8-iscsi devstack@n-api.service[120740]: DEBUG oslo_concurrency.lockutils [None req-4e22a58b-5b1f-4793-ab9b-12bedd9d7bd6 tempest-AttachVolumeNegativeTest-1378806597 tempest-AttachVolumeNegativeTest-1378806597-project] Lock "1daf4f4c-0e4a-4779-b53a-78c48397ea2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120740) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 18:09:52.339264 dv-cinder-852009-8-iscsi devstack@n-api.service[120740]: DEBUG oslo_concurrency.lockutils [None req-4e22a58b-5b1f-4793-ab9b-12bedd9d7bd6 tempest-AttachVolumeNegativeTest-1378806597 tempest-AttachVolumeNegativeTest-1378806597-project] Lock "1daf4f4c-0e4a-4779-b53a-78c48397ea2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120740) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 18:09:52.339962 dv-cinder-852009-8-iscsi devstack@n-api.service[120740]: DEBUG oslo_concurrency.lockutils [None req-4e22a58b-5b1f-4793-ab9b-12bedd9d7bd6 tempest-AttachVolumeNegativeTest-1378806597 tempest-AttachVolumeNegativeTest-1378806597-project] Acquiring lock "1daf4f4c-0e4a-4779-b53a-78c48397ea2f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120740) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 18:09:52.340441 dv-cinder-852009-8-iscsi devstack@n-api.service[120740]: DEBUG oslo_concurrency.lockutils [None req-4e22a58b-5b1f-4793-ab9b-12bedd9d7bd6 tempest-AttachVolumeNegativeTest-1378806597 tempest-AttachVolumeNegativeTest-1378806597-project] Lock "1daf4f4c-0e4a-4779-b53a-78c48397ea2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120740) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 18:09:52.340862 dv-cinder-852009-8-iscsi devstack@n-api.service[120740]: DEBUG oslo_concurrency.lockutils [None req-4e22a58b-5b1f-4793-ab9b-12bedd9d7bd6 tempest-AttachVolumeNegativeTest-1378806597 tempest-AttachVolumeNegativeTest-1378806597-project] Lock "1daf4f4c-0e4a-4779-b53a-78c48397ea2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120740) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 18:09:52.477482 dv-cinder-852009-8-iscsi devstack@n-api.service[120740]: DEBUG nova.policy [None req-4e22a58b-5b1f-4793-ab9b-12bedd9d7bd6 tempest-AttachVolumeNegativeTest-1378806597 tempest-AttachVolumeNegativeTest-1378806597-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '714cd09ba19b492f9a8c80343abcf6b9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '629311eda0584a5fbb7d8995cf27540c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120740) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 18:09:52.485307 dv-cinder-852009-8-iscsi devstack@n-api.service[120740]: INFO nova.api.openstack.requestlog [None req-4e22a58b-5b1f-4793-ab9b-12bedd9d7bd6 tempest-AttachVolumeNegativeTest-1378806597 tempest-AttachVolumeNegativeTest-1378806597-project] 10.222.0.43 "GET /compute/v2.1/servers/b6be21a8-a1fd-44ff-9fca-88e979974510" status: 200 len: 1368 microversion: 2.1 time: 0.159086 Sep 13 18:09:52.485862 dv-cinder-852009-8-iscsi devstack@n-api.service[120740]: [pid: 120740|app: 0|req: 391/771] 10.222.0.43 () {58 vars in 1236 bytes} [Tue Sep 13 18:09:52 2022] GET /compute/v2.1/servers/b6be21a8-a1fd-44ff-9fca-88e979974510 => generated 1368 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 13 18:09:52.689976 dv-cinder-852009-8-iscsi devstack@n-api.service[120741]: DEBUG nova.api.openstack.wsgi [req-90c30398-02b1-4061-b47f-a0b6d29a5bcb req-3039d716-6f05-40ff-b71d-eb13d2e0bf10 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "b6be21a8-a1fd-44ff-9fca-88e979974510", "name": "network-vif-plugged", "status": "completed", "tag": "25936ca7-0cd8-4855-af50-f4d7dc68d8f0"}]} {{(pid=120741) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 13 18:09:52.708692 dv-cinder-852009-8-iscsi devstack@n-api.service[120741]: DEBUG oslo_concurrency.lockutils [req-90c30398-02b1-4061-b47f-a0b6d29a5bcb req-3039d716-6f05-40ff-b71d-eb13d2e0bf10 service nova] Acquiring lock "1daf4f4c-0e4a-4779-b53a-78c48397ea2f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120741) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 18:09:52.709702 dv-cinder-852009-8-iscsi devstack@n-api.service[120741]: DEBUG oslo_concurrency.lockutils [req-90c30398-02b1-4061-b47f-a0b6d29a5bcb req-3039d716-6f05-40ff-b71d-eb13d2e0bf10 service nova] Lock "1daf4f4c-0e4a-4779-b53a-78c48397ea2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120741) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 18:09:52.710573 dv-cinder-852009-8-iscsi devstack@n-api.service[120741]: DEBUG oslo_concurrency.lockutils [req-90c30398-02b1-4061-b47f-a0b6d29a5bcb req-3039d716-6f05-40ff-b71d-eb13d2e0bf10 service nova] Lock "1daf4f4c-0e4a-4779-b53a-78c48397ea2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120741) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 18:09:52.724288 dv-cinder-852009-8-iscsi devstack@n-api.service[120741]: INFO nova.api.openstack.compute.server_external_events [req-90c30398-02b1-4061-b47f-a0b6d29a5bcb req-3039d716-6f05-40ff-b71d-eb13d2e0bf10 service nova] Creating event network-vif-plugged:25936ca7-0cd8-4855-af50-f4d7dc68d8f0 for instance b6be21a8-a1fd-44ff-9fca-88e979974510 on hv-cinder-85200 Sep 13 18:09:52.734846 dv-cinder-852009-8-iscsi devstack@n-api.service[120741]: INFO nova.api.openstack.requestlog [req-90c30398-02b1-4061-b47f-a0b6d29a5bcb req-3039d716-6f05-40ff-b71d-eb13d2e0bf10 service nova] 10.222.0.43 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.060402 Sep 13 18:09:52.737902 dv-cinder-852009-8-iscsi devstack@n-api.service[120741]: [pid: 120741|app: 0|req: 381/772] 10.222.0.43 () {64 vars in 1317 bytes} [Tue Sep 13 18:09:52 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 65 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 13 18:09:52.852069 dv-cinder-852009-8-iscsi devstack@n-api.service[120740]: DEBUG nova.api.openstack.wsgi [req-1b69f6e5-3439-463e-b025-946ff7de35c5 req-da42754e-ae53-403b-b05d-6af50a41d138 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "a5fb6dae-b0b9-4bd1-8974-d5a1ae1aaeb0", "name": "network-vif-deleted", "tag": "0002f044-eb9d-4d92-a36f-ae094de3f290"}]} {{(pid=120740) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 13 18:09:52.865016 dv-cinder-852009-8-iscsi devstack@n-api.service[120740]: DEBUG oslo_concurrency.lockutils [req-1b69f6e5-3439-463e-b025-946ff7de35c5 req-da42754e-ae53-403b-b05d-6af50a41d138 service nova] Acquiring lock "1daf4f4c-0e4a-4779-b53a-78c48397ea2f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120740) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 18:09:52.866343 dv-cinder-852009-8-iscsi devstack@n-api.service[120740]: DEBUG oslo_concurrency.lockutils [req-1b69f6e5-3439-463e-b025-946ff7de35c5 req-da42754e-ae53-403b-b05d-6af50a41d138 service nova] Lock "1daf4f4c-0e4a-4779-b53a-78c48397ea2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120740) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 18:09:52.867255 dv-cinder-852009-8-iscsi devstack@n-api.service[120740]: DEBUG oslo_concurrency.lockutils [req-1b69f6e5-3439-463e-b025-946ff7de35c5 req-da42754e-ae53-403b-b05d-6af50a41d138 service nova] Lock "1daf4f4c-0e4a-4779-b53a-78c48397ea2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120740) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 18:09:52.883560 dv-cinder-852009-8-iscsi devstack@n-api.service[120740]: INFO nova.api.openstack.compute.server_external_events [req-1b69f6e5-3439-463e-b025-946ff7de35c5 req-da42754e-ae53-403b-b05d-6af50a41d138 service nova] Creating event network-vif-deleted:0002f044-eb9d-4d92-a36f-ae094de3f290 for instance a5fb6dae-b0b9-4bd1-8974-d5a1ae1aaeb0 on hv-cinder-85200 Sep 13 18:09:52.890294 dv-cinder-852009-8-iscsi devstack@n-api.service[120740]: INFO nova.api.openstack.requestlog [req-1b69f6e5-3439-463e-b025-946ff7de35c5 req-da42754e-ae53-403b-b05d-6af50a41d138 service nova] 10.222.0.43 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.042417 Sep 13 18:09:52.891011 dv-cinder-852009-8-iscsi devstack@n-api.service[120740]: [pid: 120740|app: 0|req: 392/773] 10.222.0.43 () {64 vars in 1317 bytes} [Tue Sep 13 18:09:52 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 44 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 13 18:09:53.003024 dv-cinder-852009-8-iscsi devstack@n-api.service[120741]: DEBUG nova.api.openstack.wsgi [None req-f755604d-7f32-4988-bf59-a79a43d00c1a tempest-VolumesSnapshotTestJSON-1753826991 tempest-VolumesSnapshotTestJSON-1753826991-project] Calling method '>' {{(pid=120741) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 18:09:53.004051 dv-cinder-852009-8-iscsi devstack@n-api.service[120741]: DEBUG nova.compute.api [None req-f755604d-7f32-4988-bf59-a79a43d00c1a tempest-VolumesSnapshotTestJSON-1753826991 tempest-VolumesSnapshotTestJSON-1753826991-project] [instance: a5fb6dae-b0b9-4bd1-8974-d5a1ae1aaeb0] Fetching instance by UUID {{(pid=120741) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 18:09:53.011426 dv-cinder-852009-8-iscsi devstack@n-api.service[120741]: DEBUG oslo_concurrency.lockutils [None req-f755604d-7f32-4988-bf59-a79a43d00c1a tempest-VolumesSnapshotTestJSON-1753826991 tempest-VolumesSnapshotTestJSON-1753826991-project] Acquiring lock "1daf4f4c-0e4a-4779-b53a-78c48397ea2f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120741) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 18:09:53.012216 dv-cinder-852009-8-iscsi devstack@n-api.service[120741]: DEBUG oslo_concurrency.lockutils [None req-f755604d-7f32-4988-bf59-a79a43d00c1a tempest-VolumesSnapshotTestJSON-1753826991 tempest-VolumesSnapshotTestJSON-1753826991-project] Lock "1daf4f4c-0e4a-4779-b53a-78c48397ea2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120741) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 18:09:53.012873 dv-cinder-852009-8-iscsi devstack@n-api.service[120741]: DEBUG oslo_concurrency.lockutils [None req-f755604d-7f32-4988-bf59-a79a43d00c1a tempest-VolumesSnapshotTestJSON-1753826991 tempest-VolumesSnapshotTestJSON-1753826991-project] Lock "1daf4f4c-0e4a-4779-b53a-78c48397ea2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120741) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 18:09:53.013809 dv-cinder-852009-8-iscsi devstack@n-api.service[120741]: DEBUG oslo_concurrency.lockutils [None req-f755604d-7f32-4988-bf59-a79a43d00c1a tempest-VolumesSnapshotTestJSON-1753826991 tempest-VolumesSnapshotTestJSON-1753826991-project] Acquiring lock "1daf4f4c-0e4a-4779-b53a-78c48397ea2f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120741) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 18:09:53.014521 dv-cinder-852009-8-iscsi devstack@n-api.service[120741]: DEBUG oslo_concurrency.lockutils [None req-f755604d-7f32-4988-bf59-a79a43d00c1a tempest-VolumesSnapshotTestJSON-1753826991 tempest-VolumesSnapshotTestJSON-1753826991-project] Lock "1daf4f4c-0e4a-4779-b53a-78c48397ea2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120741) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 18:09:53.015137 dv-cinder-852009-8-iscsi devstack@n-api.service[120741]: DEBUG oslo_concurrency.lockutils [None req-f755604d-7f32-4988-bf59-a79a43d00c1a tempest-VolumesSnapshotTestJSON-1753826991 tempest-VolumesSnapshotTestJSON-1753826991-project] Lock "1daf4f4c-0e4a-4779-b53a-78c48397ea2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120741) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 18:09:53.057396 dv-cinder-852009-8-iscsi devstack@n-api.service[120741]: DEBUG oslo_concurrency.lockutils [None req-f755604d-7f32-4988-bf59-a79a43d00c1a tempest-VolumesSnapshotTestJSON-1753826991 tempest-VolumesSnapshotTestJSON-1753826991-project] Acquiring lock "1daf4f4c-0e4a-4779-b53a-78c48397ea2f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120741) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 18:09:53.058035 dv-cinder-852009-8-iscsi devstack@n-api.service[120741]: DEBUG oslo_concurrency.lockutils [None req-f755604d-7f32-4988-bf59-a79a43d00c1a tempest-VolumesSnapshotTestJSON-1753826991 tempest-VolumesSnapshotTestJSON-1753826991-project] Lock "1daf4f4c-0e4a-4779-b53a-78c48397ea2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120741) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 18:09:53.058619 dv-cinder-852009-8-iscsi devstack@n-api.service[120741]: DEBUG oslo_concurrency.lockutils [None req-f755604d-7f32-4988-bf59-a79a43d00c1a tempest-VolumesSnapshotTestJSON-1753826991 tempest-VolumesSnapshotTestJSON-1753826991-project] Lock "1daf4f4c-0e4a-4779-b53a-78c48397ea2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120741) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 18:09:53.059221 dv-cinder-852009-8-iscsi devstack@n-api.service[120741]: DEBUG nova.objects.instance [None req-f755604d-7f32-4988-bf59-a79a43d00c1a tempest-VolumesSnapshotTestJSON-1753826991 tempest-VolumesSnapshotTestJSON-1753826991-project] Lazy-loading 'fault' on Instance uuid a5fb6dae-b0b9-4bd1-8974-d5a1ae1aaeb0 {{(pid=120741) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Sep 13 18:09:53.103737 dv-cinder-852009-8-iscsi devstack@n-api.service[120741]: DEBUG nova.policy [None req-f755604d-7f32-4988-bf59-a79a43d00c1a tempest-VolumesSnapshotTestJSON-1753826991 tempest-VolumesSnapshotTestJSON-1753826991-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f379ce3f38fc41568493be7493e75736', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1271ab6e6c9b4c93b05aafddbdbf9afe', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120741) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 18:09:53.111488 dv-cinder-852009-8-iscsi devstack@n-api.service[120741]: INFO nova.api.openstack.requestlog [None req-f755604d-7f32-4988-bf59-a79a43d00c1a tempest-VolumesSnapshotTestJSON-1753826991 tempest-VolumesSnapshotTestJSON-1753826991-project] 10.222.0.43 "GET /compute/v2.1/servers/a5fb6dae-b0b9-4bd1-8974-d5a1ae1aaeb0" status: 200 len: 1309 microversion: 2.1 time: 0.113713 Sep 13 18:09:53.112054 dv-cinder-852009-8-iscsi devstack@n-api.service[120741]: [pid: 120741|app: 0|req: 382/774] 10.222.0.43 () {58 vars in 1236 bytes} [Tue Sep 13 18:09:52 2022] GET /compute/v2.1/servers/a5fb6dae-b0b9-4bd1-8974-d5a1ae1aaeb0 => generated 1309 bytes in 115 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 13 18:09:53.516011 dv-cinder-852009-8-iscsi devstack@n-api.service[120740]: DEBUG nova.api.openstack.wsgi [None req-2503e541-c667-478d-92bc-f67437afe48e tempest-AttachVolumeNegativeTest-1378806597 tempest-AttachVolumeNegativeTest-1378806597-project] Calling method '>' {{(pid=120740) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 18:09:53.517208 dv-cinder-852009-8-iscsi devstack@n-api.service[120740]: DEBUG nova.compute.api [None req-2503e541-c667-478d-92bc-f67437afe48e tempest-AttachVolumeNegativeTest-1378806597 tempest-AttachVolumeNegativeTest-1378806597-project] [instance: b6be21a8-a1fd-44ff-9fca-88e979974510] Fetching instance by UUID {{(pid=120740) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 18:09:53.526950 dv-cinder-852009-8-iscsi devstack@n-api.service[120740]: DEBUG oslo_concurrency.lockutils [None req-2503e541-c667-478d-92bc-f67437afe48e tempest-AttachVolumeNegativeTest-1378806597 tempest-AttachVolumeNegativeTest-1378806597-project] Acquiring lock "1daf4f4c-0e4a-4779-b53a-78c48397ea2f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120740) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 18:09:53.527431 dv-cinder-852009-8-iscsi devstack@n-api.service[120740]: DEBUG oslo_concurrency.lockutils [None req-2503e541-c667-478d-92bc-f67437afe48e tempest-AttachVolumeNegativeTest-1378806597 tempest-AttachVolumeNegativeTest-1378806597-project] Lock "1daf4f4c-0e4a-4779-b53a-78c48397ea2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120740) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 18:09:53.527860 dv-cinder-852009-8-iscsi devstack@n-api.service[120740]: DEBUG oslo_concurrency.lockutils [None req-2503e541-c667-478d-92bc-f67437afe48e tempest-AttachVolumeNegativeTest-1378806597 tempest-AttachVolumeNegativeTest-1378806597-project] Lock "1daf4f4c-0e4a-4779-b53a-78c48397ea2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120740) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 18:09:53.528571 dv-cinder-852009-8-iscsi devstack@n-api.service[120740]: DEBUG oslo_concurrency.lockutils [None req-2503e541-c667-478d-92bc-f67437afe48e tempest-AttachVolumeNegativeTest-1378806597 tempest-AttachVolumeNegativeTest-1378806597-project] Acquiring lock "1daf4f4c-0e4a-4779-b53a-78c48397ea2f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120740) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 18:09:53.529019 dv-cinder-852009-8-iscsi devstack@n-api.service[120740]: DEBUG oslo_concurrency.lockutils [None req-2503e541-c667-478d-92bc-f67437afe48e tempest-AttachVolumeNegativeTest-1378806597 tempest-AttachVolumeNegativeTest-1378806597-project] Lock "1daf4f4c-0e4a-4779-b53a-78c48397ea2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120740) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 18:09:53.529430 dv-cinder-852009-8-iscsi devstack@n-api.service[120740]: DEBUG oslo_concurrency.lockutils [None req-2503e541-c667-478d-92bc-f67437afe48e tempest-AttachVolumeNegativeTest-1378806597 tempest-AttachVolumeNegativeTest-1378806597-project] Lock "1daf4f4c-0e4a-4779-b53a-78c48397ea2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120740) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 18:09:53.669943 dv-cinder-852009-8-iscsi devstack@n-api.service[120740]: DEBUG nova.policy [None req-2503e541-c667-478d-92bc-f67437afe48e tempest-AttachVolumeNegativeTest-1378806597 tempest-AttachVolumeNegativeTest-1378806597-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '714cd09ba19b492f9a8c80343abcf6b9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '629311eda0584a5fbb7d8995cf27540c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120740) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 18:09:53.679546 dv-cinder-852009-8-iscsi devstack@n-api.service[120740]: INFO nova.api.openstack.requestlog [None req-2503e541-c667-478d-92bc-f67437afe48e tempest-AttachVolumeNegativeTest-1378806597 tempest-AttachVolumeNegativeTest-1378806597-project] 10.222.0.43 "GET /compute/v2.1/servers/b6be21a8-a1fd-44ff-9fca-88e979974510" status: 200 len: 1368 microversion: 2.1 time: 0.172821 Sep 13 18:09:53.680083 dv-cinder-852009-8-iscsi devstack@n-api.service[120740]: [pid: 120740|app: 0|req: 393/775] 10.222.0.43 () {58 vars in 1236 bytes} [Tue Sep 13 18:09:53 2022] GET /compute/v2.1/servers/b6be21a8-a1fd-44ff-9fca-88e979974510 => generated 1368 bytes in 175 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 13 18:09:54.136197 dv-cinder-852009-8-iscsi devstack@n-api.service[120741]: DEBUG nova.api.openstack.wsgi [None req-60ba6503-99b4-4f61-897d-a26b57ee9abf tempest-VolumesSnapshotTestJSON-1753826991 tempest-VolumesSnapshotTestJSON-1753826991-project] Calling method '>' {{(pid=120741) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 18:09:54.136785 dv-cinder-852009-8-iscsi devstack@n-api.service[120741]: DEBUG nova.compute.api [None req-60ba6503-99b4-4f61-897d-a26b57ee9abf tempest-VolumesSnapshotTestJSON-1753826991 tempest-VolumesSnapshotTestJSON-1753826991-project] [instance: a5fb6dae-b0b9-4bd1-8974-d5a1ae1aaeb0] Fetching instance by UUID {{(pid=120741) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 18:09:54.144678 dv-cinder-852009-8-iscsi devstack@n-api.service[120741]: DEBUG oslo_concurrency.lockutils [None req-60ba6503-99b4-4f61-897d-a26b57ee9abf tempest-VolumesSnapshotTestJSON-1753826991 tempest-VolumesSnapshotTestJSON-1753826991-project] Acquiring lock "1daf4f4c-0e4a-4779-b53a-78c48397ea2f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120741) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 18:09:54.145169 dv-cinder-852009-8-iscsi devstack@n-api.service[120741]: DEBUG oslo_concurrency.lockutils [None req-60ba6503-99b4-4f61-897d-a26b57ee9abf tempest-VolumesSnapshotTestJSON-1753826991 tempest-VolumesSnapshotTestJSON-1753826991-project] Lock "1daf4f4c-0e4a-4779-b53a-78c48397ea2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120741) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 18:09:54.145599 dv-cinder-852009-8-iscsi devstack@n-api.service[120741]: DEBUG oslo_concurrency.lockutils [None req-60ba6503-99b4-4f61-897d-a26b57ee9abf tempest-VolumesSnapshotTestJSON-1753826991 tempest-VolumesSnapshotTestJSON-1753826991-project] Lock "1daf4f4c-0e4a-4779-b53a-78c48397ea2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120741) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 18:09:54.146289 dv-cinder-852009-8-iscsi devstack@n-api.service[120741]: DEBUG oslo_concurrency.lockutils [None req-60ba6503-99b4-4f61-897d-a26b57ee9abf tempest-VolumesSnapshotTestJSON-1753826991 tempest-VolumesSnapshotTestJSON-1753826991-project] Acquiring lock "1daf4f4c-0e4a-4779-b53a-78c48397ea2f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120741) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 18:09:54.146738 dv-cinder-852009-8-iscsi devstack@n-api.service[120741]: DEBUG oslo_concurrency.lockutils [None req-60ba6503-99b4-4f61-897d-a26b57ee9abf tempest-VolumesSnapshotTestJSON-1753826991 tempest-VolumesSnapshotTestJSON-1753826991-project] Lock "1daf4f4c-0e4a-4779-b53a-78c48397ea2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120741) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 18:09:54.147156 dv-cinder-852009-8-iscsi devstack@n-api.service[120741]: DEBUG oslo_concurrency.lockutils [None req-60ba6503-99b4-4f61-897d-a26b57ee9abf tempest-VolumesSnapshotTestJSON-1753826991 tempest-VolumesSnapshotTestJSON-1753826991-project] Lock "1daf4f4c-0e4a-4779-b53a-78c48397ea2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120741) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 18:09:54.161509 dv-cinder-852009-8-iscsi devstack@n-api.service[120741]: INFO nova.api.openstack.wsgi [None req-60ba6503-99b4-4f61-897d-a26b57ee9abf tempest-VolumesSnapshotTestJSON-1753826991 tempest-VolumesSnapshotTestJSON-1753826991-project] HTTP exception thrown: Instance a5fb6dae-b0b9-4bd1-8974-d5a1ae1aaeb0 could not be found. Sep 13 18:09:54.163177 dv-cinder-852009-8-iscsi devstack@n-api.service[120741]: DEBUG nova.api.openstack.wsgi [None req-60ba6503-99b4-4f61-897d-a26b57ee9abf tempest-VolumesSnapshotTestJSON-1753826991 tempest-VolumesSnapshotTestJSON-1753826991-project] Request method failure captured: Sep 13 18:09:54.163177 dv-cinder-852009-8-iscsi devstack@n-api.service[120741]: request: GET /compute/v2.1/servers/a5fb6dae-b0b9-4bd1-8974-d5a1ae1aaeb0 HTTP/1.1 Sep 13 18:09:54.163177 dv-cinder-852009-8-iscsi devstack@n-api.service[120741]: Accept: application/json Sep 13 18:09:54.163177 dv-cinder-852009-8-iscsi devstack@n-api.service[120741]: Accept-Encoding: identity Sep 13 18:09:54.163177 dv-cinder-852009-8-iscsi devstack@n-api.service[120741]: Connection: close Sep 13 18:09:54.163177 dv-cinder-852009-8-iscsi devstack@n-api.service[120741]: Content-Length: 0 Sep 13 18:09:54.163177 dv-cinder-852009-8-iscsi devstack@n-api.service[120741]: Content-Type: application/json Sep 13 18:09:54.163177 dv-cinder-852009-8-iscsi devstack@n-api.service[120741]: Host: 10.222.0.43 Sep 13 18:09:54.163177 dv-cinder-852009-8-iscsi devstack@n-api.service[120741]: Openstack-System-Scope: None Sep 13 18:09:54.163177 dv-cinder-852009-8-iscsi devstack@n-api.service[120741]: User-Agent: python-urllib3/1.26.12 Sep 13 18:09:54.163177 dv-cinder-852009-8-iscsi devstack@n-api.service[120741]: X-Auth-Token: gAAAAABjIMc9u3JWOVQRO_PZplbBVSAng20bosEyqjXay_6XkiDTqaSfsjTyQyz4fI14Dsyk9Wy6VsWU9rrzMuADvTWZ0FTg8li9ukjuRJ6WcKqm2qjdY2iMI9z33xyju26Bd2dz2Uc3fcmsAciv6Ht3FQN8scDWeXC7445Fhk09XlgqWAno8nw Sep 13 18:09:54.163177 dv-cinder-852009-8-iscsi devstack@n-api.service[120741]: X-Domain-Id: None Sep 13 18:09:54.163177 dv-cinder-852009-8-iscsi devstack@n-api.service[120741]: X-Domain-Name: None Sep 13 18:09:54.163177 dv-cinder-852009-8-iscsi devstack@n-api.service[120741]: X-Identity-Status: Confirmed Sep 13 18:09:54.163177 dv-cinder-852009-8-iscsi devstack@n-api.service[120741]: X-Is-Admin-Project: True Sep 13 18:09:54.163177 dv-cinder-852009-8-iscsi devstack@n-api.service[120741]: X-Project-Domain-Id: default Sep 13 18:09:54.163177 dv-cinder-852009-8-iscsi devstack@n-api.service[120741]: X-Project-Domain-Name: Default Sep 13 18:09:54.163177 dv-cinder-852009-8-iscsi devstack@n-api.service[120741]: X-Project-Id: 1271ab6e6c9b4c93b05aafddbdbf9afe Sep 13 18:09:54.163177 dv-cinder-852009-8-iscsi devstack@n-api.service[120741]: X-Project-Name: tempest-VolumesSnapshotTestJSON-1753826991 Sep 13 18:09:54.163177 dv-cinder-852009-8-iscsi devstack@n-api.service[120741]: X-Role: reader,member Sep 13 18:09:54.163177 dv-cinder-852009-8-iscsi devstack@n-api.service[120741]: X-Roles: reader,member Sep 13 18:09:54.164678 dv-cinder-852009-8-iscsi devstack@n-api.service[120741]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/identity"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/compute/v2/1271ab6e6c9b4c93b05aafddbdbf9afe"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.43:8080", "publicURL": "http://10.222.0.43:8080/v1/AUTH_1271ab6e6c9b4c93b05aafddbdbf9afe"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43:9696/networking"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/volume/v3/1271ab6e6c9b4c93b05aafddbdbf9afe"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/compute/v2.1"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/placement"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/volume/v3/1271ab6e6c9b4c93b05aafddbdbf9afe"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/image"}]}] Sep 13 18:09:54.164678 dv-cinder-852009-8-iscsi devstack@n-api.service[120741]: X-Tenant: tempest-VolumesSnapshotTestJSON-1753826991 Sep 13 18:09:54.164678 dv-cinder-852009-8-iscsi devstack@n-api.service[120741]: X-Tenant-Id: 1271ab6e6c9b4c93b05aafddbdbf9afe Sep 13 18:09:54.164678 dv-cinder-852009-8-iscsi devstack@n-api.service[120741]: X-Tenant-Name: tempest-VolumesSnapshotTestJSON-1753826991 Sep 13 18:09:54.164678 dv-cinder-852009-8-iscsi devstack@n-api.service[120741]: X-User: tempest-VolumesSnapshotTestJSON-1753826991-project Sep 13 18:09:54.164678 dv-cinder-852009-8-iscsi devstack@n-api.service[120741]: X-User-Domain-Id: default Sep 13 18:09:54.164678 dv-cinder-852009-8-iscsi devstack@n-api.service[120741]: X-User-Domain-Name: Default Sep 13 18:09:54.164678 dv-cinder-852009-8-iscsi devstack@n-api.service[120741]: X-User-Id: f379ce3f38fc41568493be7493e75736 Sep 13 18:09:54.164678 dv-cinder-852009-8-iscsi devstack@n-api.service[120741]: X-User-Name: tempest-VolumesSnapshotTestJSON-1753826991-project Sep 13 18:09:54.164678 dv-cinder-852009-8-iscsi devstack@n-api.service[120741]: method: > Sep 13 18:09:54.164678 dv-cinder-852009-8-iscsi devstack@n-api.service[120741]: exception: Instance a5fb6dae-b0b9-4bd1-8974-d5a1ae1aaeb0 could not be found. Sep 13 18:09:54.164678 dv-cinder-852009-8-iscsi devstack@n-api.service[120741]: action_args: {'id': 'a5fb6dae-b0b9-4bd1-8974-d5a1ae1aaeb0'} Sep 13 18:09:54.169387 dv-cinder-852009-8-iscsi devstack@n-api.service[120741]: {{(pid=120741) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 13 18:09:54.169387 dv-cinder-852009-8-iscsi devstack@n-api.service[120741]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 13 18:09:54.169387 dv-cinder-852009-8-iscsi devstack@n-api.service[120741]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Sep 13 18:09:54.169387 dv-cinder-852009-8-iscsi devstack@n-api.service[120741]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Sep 13 18:09:54.169387 dv-cinder-852009-8-iscsi devstack@n-api.service[120741]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Sep 13 18:09:54.169387 dv-cinder-852009-8-iscsi devstack@n-api.service[120741]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Sep 13 18:09:54.169387 dv-cinder-852009-8-iscsi devstack@n-api.service[120741]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Sep 13 18:09:54.169387 dv-cinder-852009-8-iscsi devstack@n-api.service[120741]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Sep 13 18:09:54.169387 dv-cinder-852009-8-iscsi devstack@n-api.service[120741]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Sep 13 18:09:54.169387 dv-cinder-852009-8-iscsi devstack@n-api.service[120741]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Sep 13 18:09:54.169387 dv-cinder-852009-8-iscsi devstack@n-api.service[120741]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance a5fb6dae-b0b9-4bd1-8974-d5a1ae1aaeb0 could not be found. Sep 13 18:09:54.169387 dv-cinder-852009-8-iscsi devstack@n-api.service[120741]: ERROR nova.api.openstack.wsgi Sep 13 18:09:54.169387 dv-cinder-852009-8-iscsi devstack@n-api.service[120741]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 13 18:09:54.169387 dv-cinder-852009-8-iscsi devstack@n-api.service[120741]: ERROR nova.api.openstack.wsgi Sep 13 18:09:54.169387 dv-cinder-852009-8-iscsi devstack@n-api.service[120741]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 13 18:09:54.169387 dv-cinder-852009-8-iscsi devstack@n-api.service[120741]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 13 18:09:54.169387 dv-cinder-852009-8-iscsi devstack@n-api.service[120741]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 13 18:09:54.169387 dv-cinder-852009-8-iscsi devstack@n-api.service[120741]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 13 18:09:54.169387 dv-cinder-852009-8-iscsi devstack@n-api.service[120741]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 13 18:09:54.169387 dv-cinder-852009-8-iscsi devstack@n-api.service[120741]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 13 18:09:54.170909 dv-cinder-852009-8-iscsi devstack@n-api.service[120741]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 13 18:09:54.170909 dv-cinder-852009-8-iscsi devstack@n-api.service[120741]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Sep 13 18:09:54.170909 dv-cinder-852009-8-iscsi devstack@n-api.service[120741]: ERROR nova.api.openstack.wsgi instance = self._get_server( Sep 13 18:09:54.170909 dv-cinder-852009-8-iscsi devstack@n-api.service[120741]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Sep 13 18:09:54.170909 dv-cinder-852009-8-iscsi devstack@n-api.service[120741]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Sep 13 18:09:54.170909 dv-cinder-852009-8-iscsi devstack@n-api.service[120741]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Sep 13 18:09:54.170909 dv-cinder-852009-8-iscsi devstack@n-api.service[120741]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Sep 13 18:09:54.170909 dv-cinder-852009-8-iscsi devstack@n-api.service[120741]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance a5fb6dae-b0b9-4bd1-8974-d5a1ae1aaeb0 could not be found. Sep 13 18:09:54.170909 dv-cinder-852009-8-iscsi devstack@n-api.service[120741]: ERROR nova.api.openstack.wsgi Sep 13 18:09:54.170909 dv-cinder-852009-8-iscsi devstack@n-api.service[120741]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 13 18:09:54.170909 dv-cinder-852009-8-iscsi devstack@n-api.service[120741]: ERROR nova.api.openstack.wsgi Sep 13 18:09:54.170909 dv-cinder-852009-8-iscsi devstack@n-api.service[120741]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 13 18:09:54.170909 dv-cinder-852009-8-iscsi devstack@n-api.service[120741]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 13 18:09:54.170909 dv-cinder-852009-8-iscsi devstack@n-api.service[120741]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 13 18:09:54.170909 dv-cinder-852009-8-iscsi devstack@n-api.service[120741]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 13 18:09:54.170909 dv-cinder-852009-8-iscsi devstack@n-api.service[120741]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 13 18:09:54.170909 dv-cinder-852009-8-iscsi devstack@n-api.service[120741]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance a5fb6dae-b0b9-4bd1-8974-d5a1ae1aaeb0 could not be found. Sep 13 18:09:54.170909 dv-cinder-852009-8-iscsi devstack@n-api.service[120741]: ERROR nova.api.openstack.wsgi Sep 13 18:09:54.172162 dv-cinder-852009-8-iscsi devstack@n-api.service[120741]: DEBUG nova.api.openstack.wsgi [None req-60ba6503-99b4-4f61-897d-a26b57ee9abf tempest-VolumesSnapshotTestJSON-1753826991 tempest-VolumesSnapshotTestJSON-1753826991-project] Returning 404 to user: Instance a5fb6dae-b0b9-4bd1-8974-d5a1ae1aaeb0 could not be found. {{(pid=120741) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 13 18:09:54.172162 dv-cinder-852009-8-iscsi devstack@n-api.service[120741]: INFO nova.api.openstack.requestlog [None req-60ba6503-99b4-4f61-897d-a26b57ee9abf tempest-VolumesSnapshotTestJSON-1753826991 tempest-VolumesSnapshotTestJSON-1753826991-project] 10.222.0.43 "GET /compute/v2.1/servers/a5fb6dae-b0b9-4bd1-8974-d5a1ae1aaeb0" status: 404 len: 111 microversion: 2.1 time: 0.033416 Sep 13 18:09:54.172162 dv-cinder-852009-8-iscsi devstack@n-api.service[120741]: [pid: 120741|app: 0|req: 383/776] 10.222.0.43 () {58 vars in 1236 bytes} [Tue Sep 13 18:09:54 2022] GET /compute/v2.1/servers/a5fb6dae-b0b9-4bd1-8974-d5a1ae1aaeb0 => generated 111 bytes in 35 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Sep 13 18:09:54.703393 dv-cinder-852009-8-iscsi devstack@n-api.service[120740]: DEBUG nova.api.openstack.wsgi [None req-9b1f6e36-aec6-4f28-9af3-f4aa6177cb63 tempest-AttachVolumeNegativeTest-1378806597 tempest-AttachVolumeNegativeTest-1378806597-project] Calling method '>' {{(pid=120740) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 18:09:54.703987 dv-cinder-852009-8-iscsi devstack@n-api.service[120740]: DEBUG nova.compute.api [None req-9b1f6e36-aec6-4f28-9af3-f4aa6177cb63 tempest-AttachVolumeNegativeTest-1378806597 tempest-AttachVolumeNegativeTest-1378806597-project] [instance: b6be21a8-a1fd-44ff-9fca-88e979974510] Fetching instance by UUID {{(pid=120740) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 18:09:54.711331 dv-cinder-852009-8-iscsi devstack@n-api.service[120740]: DEBUG oslo_concurrency.lockutils [None req-9b1f6e36-aec6-4f28-9af3-f4aa6177cb63 tempest-AttachVolumeNegativeTest-1378806597 tempest-AttachVolumeNegativeTest-1378806597-project] Acquiring lock "1daf4f4c-0e4a-4779-b53a-78c48397ea2f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120740) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 18:09:54.711919 dv-cinder-852009-8-iscsi devstack@n-api.service[120740]: DEBUG oslo_concurrency.lockutils [None req-9b1f6e36-aec6-4f28-9af3-f4aa6177cb63 tempest-AttachVolumeNegativeTest-1378806597 tempest-AttachVolumeNegativeTest-1378806597-project] Lock "1daf4f4c-0e4a-4779-b53a-78c48397ea2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120740) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 18:09:54.712371 dv-cinder-852009-8-iscsi devstack@n-api.service[120740]: DEBUG oslo_concurrency.lockutils [None req-9b1f6e36-aec6-4f28-9af3-f4aa6177cb63 tempest-AttachVolumeNegativeTest-1378806597 tempest-AttachVolumeNegativeTest-1378806597-project] Lock "1daf4f4c-0e4a-4779-b53a-78c48397ea2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120740) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 18:09:54.713198 dv-cinder-852009-8-iscsi devstack@n-api.service[120740]: DEBUG oslo_concurrency.lockutils [None req-9b1f6e36-aec6-4f28-9af3-f4aa6177cb63 tempest-AttachVolumeNegativeTest-1378806597 tempest-AttachVolumeNegativeTest-1378806597-project] Acquiring lock "1daf4f4c-0e4a-4779-b53a-78c48397ea2f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120740) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 18:09:54.713700 dv-cinder-852009-8-iscsi devstack@n-api.service[120740]: DEBUG oslo_concurrency.lockutils [None req-9b1f6e36-aec6-4f28-9af3-f4aa6177cb63 tempest-AttachVolumeNegativeTest-1378806597 tempest-AttachVolumeNegativeTest-1378806597-project] Lock "1daf4f4c-0e4a-4779-b53a-78c48397ea2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120740) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 18:09:54.714143 dv-cinder-852009-8-iscsi devstack@n-api.service[120740]: DEBUG oslo_concurrency.lockutils [None req-9b1f6e36-aec6-4f28-9af3-f4aa6177cb63 tempest-AttachVolumeNegativeTest-1378806597 tempest-AttachVolumeNegativeTest-1378806597-project] Lock "1daf4f4c-0e4a-4779-b53a-78c48397ea2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120740) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 18:09:54.847568 dv-cinder-852009-8-iscsi devstack@n-api.service[120740]: DEBUG nova.policy [None req-9b1f6e36-aec6-4f28-9af3-f4aa6177cb63 tempest-AttachVolumeNegativeTest-1378806597 tempest-AttachVolumeNegativeTest-1378806597-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '714cd09ba19b492f9a8c80343abcf6b9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '629311eda0584a5fbb7d8995cf27540c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120740) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 18:09:54.855735 dv-cinder-852009-8-iscsi devstack@n-api.service[120740]: INFO nova.api.openstack.requestlog [None req-9b1f6e36-aec6-4f28-9af3-f4aa6177cb63 tempest-AttachVolumeNegativeTest-1378806597 tempest-AttachVolumeNegativeTest-1378806597-project] 10.222.0.43 "GET /compute/v2.1/servers/b6be21a8-a1fd-44ff-9fca-88e979974510" status: 200 len: 1558 microversion: 2.1 time: 0.156562 Sep 13 18:09:54.856274 dv-cinder-852009-8-iscsi devstack@n-api.service[120740]: [pid: 120740|app: 0|req: 394/777] 10.222.0.43 () {58 vars in 1236 bytes} [Tue Sep 13 18:09:54 2022] GET /compute/v2.1/servers/b6be21a8-a1fd-44ff-9fca-88e979974510 => generated 1558 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 13 18:09:54.885866 dv-cinder-852009-8-iscsi devstack@n-api.service[120741]: DEBUG nova.api.openstack.wsgi [None req-91c028f3-b9a8-4328-ad0a-7cd55d734a3b tempest-AttachVolumeNegativeTest-1378806597 tempest-AttachVolumeNegativeTest-1378806597-project] Calling method '>' {{(pid=120741) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 18:09:54.886357 dv-cinder-852009-8-iscsi devstack@n-api.service[120741]: DEBUG nova.compute.api [None req-91c028f3-b9a8-4328-ad0a-7cd55d734a3b tempest-AttachVolumeNegativeTest-1378806597 tempest-AttachVolumeNegativeTest-1378806597-project] [instance: b6be21a8-a1fd-44ff-9fca-88e979974510] Fetching instance by UUID {{(pid=120741) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 18:09:54.892811 dv-cinder-852009-8-iscsi devstack@n-api.service[120741]: DEBUG oslo_concurrency.lockutils [None req-91c028f3-b9a8-4328-ad0a-7cd55d734a3b tempest-AttachVolumeNegativeTest-1378806597 tempest-AttachVolumeNegativeTest-1378806597-project] Acquiring lock "1daf4f4c-0e4a-4779-b53a-78c48397ea2f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120741) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 18:09:54.893360 dv-cinder-852009-8-iscsi devstack@n-api.service[120741]: DEBUG oslo_concurrency.lockutils [None req-91c028f3-b9a8-4328-ad0a-7cd55d734a3b tempest-AttachVolumeNegativeTest-1378806597 tempest-AttachVolumeNegativeTest-1378806597-project] Lock "1daf4f4c-0e4a-4779-b53a-78c48397ea2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120741) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 18:09:54.893789 dv-cinder-852009-8-iscsi devstack@n-api.service[120741]: DEBUG oslo_concurrency.lockutils [None req-91c028f3-b9a8-4328-ad0a-7cd55d734a3b tempest-AttachVolumeNegativeTest-1378806597 tempest-AttachVolumeNegativeTest-1378806597-project] Lock "1daf4f4c-0e4a-4779-b53a-78c48397ea2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120741) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 18:09:54.894509 dv-cinder-852009-8-iscsi devstack@n-api.service[120741]: DEBUG oslo_concurrency.lockutils [None req-91c028f3-b9a8-4328-ad0a-7cd55d734a3b tempest-AttachVolumeNegativeTest-1378806597 tempest-AttachVolumeNegativeTest-1378806597-project] Acquiring lock "1daf4f4c-0e4a-4779-b53a-78c48397ea2f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120741) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 18:09:54.895019 dv-cinder-852009-8-iscsi devstack@n-api.service[120741]: DEBUG oslo_concurrency.lockutils [None req-91c028f3-b9a8-4328-ad0a-7cd55d734a3b tempest-AttachVolumeNegativeTest-1378806597 tempest-AttachVolumeNegativeTest-1378806597-project] Lock "1daf4f4c-0e4a-4779-b53a-78c48397ea2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120741) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 18:09:54.895434 dv-cinder-852009-8-iscsi devstack@n-api.service[120741]: DEBUG oslo_concurrency.lockutils [None req-91c028f3-b9a8-4328-ad0a-7cd55d734a3b tempest-AttachVolumeNegativeTest-1378806597 tempest-AttachVolumeNegativeTest-1378806597-project] Lock "1daf4f4c-0e4a-4779-b53a-78c48397ea2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120741) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 18:09:54.980343 dv-cinder-852009-8-iscsi devstack@n-api.service[120741]: INFO nova.api.openstack.requestlog [None req-91c028f3-b9a8-4328-ad0a-7cd55d734a3b tempest-AttachVolumeNegativeTest-1378806597 tempest-AttachVolumeNegativeTest-1378806597-project] 10.222.0.43 "GET /compute/v2.1/servers/b6be21a8-a1fd-44ff-9fca-88e979974510/os-interface" status: 200 len: 284 microversion: 2.1 time: 0.100190 Sep 13 18:09:54.980976 dv-cinder-852009-8-iscsi devstack@n-api.service[120741]: [pid: 120741|app: 0|req: 384/778] 10.222.0.43 () {58 vars in 1275 bytes} [Tue Sep 13 18:09:54 2022] GET /compute/v2.1/servers/b6be21a8-a1fd-44ff-9fca-88e979974510/os-interface => generated 284 bytes in 102 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 13 18:09:55.950389 dv-cinder-852009-8-iscsi devstack@n-api.service[120740]: DEBUG nova.api.openstack.wsgi [req-eb272a42-1107-486b-80ff-99801b9db1f9 req-70222e4f-d561-464f-af6d-5eed333bb687 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "b6be21a8-a1fd-44ff-9fca-88e979974510", "tag": "25936ca7-0cd8-4855-af50-f4d7dc68d8f0"}]} {{(pid=120740) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 13 18:09:55.955181 dv-cinder-852009-8-iscsi devstack@n-api.service[120740]: DEBUG dbcounter [-] [120740] Writing DB stats nova_cell0:SELECT=6 {{(pid=120740) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 18:09:55.962278 dv-cinder-852009-8-iscsi devstack@n-api.service[120740]: DEBUG oslo_concurrency.lockutils [req-eb272a42-1107-486b-80ff-99801b9db1f9 req-70222e4f-d561-464f-af6d-5eed333bb687 service nova] Acquiring lock "1daf4f4c-0e4a-4779-b53a-78c48397ea2f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120740) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 18:09:55.962881 dv-cinder-852009-8-iscsi devstack@n-api.service[120740]: DEBUG oslo_concurrency.lockutils [req-eb272a42-1107-486b-80ff-99801b9db1f9 req-70222e4f-d561-464f-af6d-5eed333bb687 service nova] Lock "1daf4f4c-0e4a-4779-b53a-78c48397ea2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120740) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 18:09:55.963391 dv-cinder-852009-8-iscsi devstack@n-api.service[120740]: DEBUG oslo_concurrency.lockutils [req-eb272a42-1107-486b-80ff-99801b9db1f9 req-70222e4f-d561-464f-af6d-5eed333bb687 service nova] Lock "1daf4f4c-0e4a-4779-b53a-78c48397ea2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120740) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 18:09:55.975909 dv-cinder-852009-8-iscsi devstack@n-api.service[120740]: INFO nova.api.openstack.compute.server_external_events [req-eb272a42-1107-486b-80ff-99801b9db1f9 req-70222e4f-d561-464f-af6d-5eed333bb687 service nova] Creating event network-changed:25936ca7-0cd8-4855-af50-f4d7dc68d8f0 for instance b6be21a8-a1fd-44ff-9fca-88e979974510 on hv-cinder-85200 Sep 13 18:09:55.981248 dv-cinder-852009-8-iscsi devstack@n-api.service[120740]: INFO nova.api.openstack.requestlog [req-eb272a42-1107-486b-80ff-99801b9db1f9 req-70222e4f-d561-464f-af6d-5eed333bb687 service nova] 10.222.0.43 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.034492 Sep 13 18:09:55.981839 dv-cinder-852009-8-iscsi devstack@n-api.service[120740]: [pid: 120740|app: 0|req: 395/779] 10.222.0.43 () {64 vars in 1317 bytes} [Tue Sep 13 18:09:55 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 36 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 13 18:10:02.013452 dv-cinder-852009-8-iscsi devstack@n-api.service[120741]: DEBUG dbcounter [-] [120741] Writing DB stats nova_cell0:SELECT=2 {{(pid=120741) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 18:10:02.014504 dv-cinder-852009-8-iscsi devstack@n-api.service[120741]: DEBUG dbcounter [-] [120741] Writing DB stats nova_cell0:SELECT=6 {{(pid=120741) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 18:10:02.021722 dv-cinder-852009-8-iscsi devstack@n-api.service[120741]: DEBUG nova.api.openstack.wsgi [None req-516fbb77-43b1-4d7d-9ea0-353801a93962 tempest-VolumesSnapshotTestJSON-1753826991 tempest-VolumesSnapshotTestJSON-1753826991-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-VolumesSnapshotTestJSON-instance-897308728", "imageRef": "33034e36-e6b2-4847-92a1-ff3188c05a4a", "flavorRef": "452", "networks": [{"uuid": "ca03c818-6af8-4cf9-8e16-a3a21c6ede1c"}]}} {{(pid=120741) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 13 18:10:02.082339 dv-cinder-852009-8-iscsi devstack@n-api.service[120741]: DEBUG nova.network.neutron [None req-516fbb77-43b1-4d7d-9ea0-353801a93962 tempest-VolumesSnapshotTestJSON-1753826991 tempest-VolumesSnapshotTestJSON-1753826991-project] validate_networks() for [('ca03c818-6af8-4cf9-8e16-a3a21c6ede1c', None, None, None, None, None)] {{(pid=120741) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Sep 13 18:10:02.460856 dv-cinder-852009-8-iscsi devstack@n-api.service[120741]: DEBUG nova.virt.hardware [None req-516fbb77-43b1-4d7d-9ea0-353801a93962 tempest-VolumesSnapshotTestJSON-1753826991 tempest-VolumesSnapshotTestJSON-1753826991-project] Flavor limits 0:0:0 {{(pid=120741) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Sep 13 18:10:02.461434 dv-cinder-852009-8-iscsi devstack@n-api.service[120741]: DEBUG nova.virt.hardware [None req-516fbb77-43b1-4d7d-9ea0-353801a93962 tempest-VolumesSnapshotTestJSON-1753826991 tempest-VolumesSnapshotTestJSON-1753826991-project] Image limits 0:0:0 {{(pid=120741) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Sep 13 18:10:02.462132 dv-cinder-852009-8-iscsi devstack@n-api.service[120741]: DEBUG nova.virt.hardware [None req-516fbb77-43b1-4d7d-9ea0-353801a93962 tempest-VolumesSnapshotTestJSON-1753826991 tempest-VolumesSnapshotTestJSON-1753826991-project] Flavor pref 0:0:0 {{(pid=120741) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Sep 13 18:10:02.462647 dv-cinder-852009-8-iscsi devstack@n-api.service[120741]: DEBUG nova.virt.hardware [None req-516fbb77-43b1-4d7d-9ea0-353801a93962 tempest-VolumesSnapshotTestJSON-1753826991 tempest-VolumesSnapshotTestJSON-1753826991-project] Image pref 0:0:0 {{(pid=120741) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Sep 13 18:10:02.463205 dv-cinder-852009-8-iscsi devstack@n-api.service[120741]: DEBUG nova.virt.hardware [None req-516fbb77-43b1-4d7d-9ea0-353801a93962 tempest-VolumesSnapshotTestJSON-1753826991 tempest-VolumesSnapshotTestJSON-1753826991-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=120741) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Sep 13 18:10:02.476383 dv-cinder-852009-8-iscsi devstack@n-api.service[120741]: DEBUG oslo_concurrency.lockutils [None req-516fbb77-43b1-4d7d-9ea0-353801a93962 tempest-VolumesSnapshotTestJSON-1753826991 tempest-VolumesSnapshotTestJSON-1753826991-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120741) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 18:10:02.476891 dv-cinder-852009-8-iscsi devstack@n-api.service[120741]: DEBUG oslo_concurrency.lockutils [None req-516fbb77-43b1-4d7d-9ea0-353801a93962 tempest-VolumesSnapshotTestJSON-1753826991 tempest-VolumesSnapshotTestJSON-1753826991-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120741) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 18:10:02.477317 dv-cinder-852009-8-iscsi devstack@n-api.service[120741]: DEBUG oslo_concurrency.lockutils [None req-516fbb77-43b1-4d7d-9ea0-353801a93962 tempest-VolumesSnapshotTestJSON-1753826991 tempest-VolumesSnapshotTestJSON-1753826991-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120741) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 18:10:02.478058 dv-cinder-852009-8-iscsi devstack@n-api.service[120741]: DEBUG oslo_concurrency.lockutils [None req-516fbb77-43b1-4d7d-9ea0-353801a93962 tempest-VolumesSnapshotTestJSON-1753826991 tempest-VolumesSnapshotTestJSON-1753826991-project] Acquiring lock "1daf4f4c-0e4a-4779-b53a-78c48397ea2f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120741) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 18:10:02.478499 dv-cinder-852009-8-iscsi devstack@n-api.service[120741]: DEBUG oslo_concurrency.lockutils [None req-516fbb77-43b1-4d7d-9ea0-353801a93962 tempest-VolumesSnapshotTestJSON-1753826991 tempest-VolumesSnapshotTestJSON-1753826991-project] Lock "1daf4f4c-0e4a-4779-b53a-78c48397ea2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120741) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 18:10:02.478913 dv-cinder-852009-8-iscsi devstack@n-api.service[120741]: DEBUG oslo_concurrency.lockutils [None req-516fbb77-43b1-4d7d-9ea0-353801a93962 tempest-VolumesSnapshotTestJSON-1753826991 tempest-VolumesSnapshotTestJSON-1753826991-project] Lock "1daf4f4c-0e4a-4779-b53a-78c48397ea2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120741) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 18:10:02.495645 dv-cinder-852009-8-iscsi devstack@n-api.service[120741]: DEBUG nova.quota [None req-516fbb77-43b1-4d7d-9ea0-353801a93962 tempest-VolumesSnapshotTestJSON-1753826991 tempest-VolumesSnapshotTestJSON-1753826991-project] Getting quotas for project 1271ab6e6c9b4c93b05aafddbdbf9afe. Resources: {'cores', 'ram', 'instances'} {{(pid=120741) _get_quotas /opt/stack/nova/nova/quota.py:393}} Sep 13 18:10:02.499780 dv-cinder-852009-8-iscsi devstack@n-api.service[120741]: DEBUG nova.quota [None req-516fbb77-43b1-4d7d-9ea0-353801a93962 tempest-VolumesSnapshotTestJSON-1753826991 tempest-VolumesSnapshotTestJSON-1753826991-project] Getting quotas for user f379ce3f38fc41568493be7493e75736 and project 1271ab6e6c9b4c93b05aafddbdbf9afe. Resources: {'cores', 'ram', 'instances'} {{(pid=120741) _get_quotas /opt/stack/nova/nova/quota.py:383}} Sep 13 18:10:02.511541 dv-cinder-852009-8-iscsi devstack@n-api.service[120741]: DEBUG nova.compute.api [None req-516fbb77-43b1-4d7d-9ea0-353801a93962 tempest-VolumesSnapshotTestJSON-1753826991 tempest-VolumesSnapshotTestJSON-1753826991-project] Going to run 1 instances... {{(pid=120741) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Sep 13 18:10:02.513773 dv-cinder-852009-8-iscsi devstack@n-api.service[120741]: DEBUG nova.compute.api [None req-516fbb77-43b1-4d7d-9ea0-353801a93962 tempest-VolumesSnapshotTestJSON-1753826991 tempest-VolumesSnapshotTestJSON-1753826991-project] [instance: fee345c8-9135-4695-9164-ae5dbec8c25a] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='33034e36-e6b2-4847-92a1-ff3188c05a4a',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=120741) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Sep 13 18:10:02.561375 dv-cinder-852009-8-iscsi devstack@n-api.service[120741]: INFO nova.api.openstack.requestlog [None req-516fbb77-43b1-4d7d-9ea0-353801a93962 tempest-VolumesSnapshotTestJSON-1753826991 tempest-VolumesSnapshotTestJSON-1753826991-project] 10.222.0.43 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 0.549361 Sep 13 18:10:02.562046 dv-cinder-852009-8-iscsi devstack@n-api.service[120741]: [pid: 120741|app: 0|req: 385/780] 10.222.0.43 () {60 vars in 1147 bytes} [Tue Sep 13 18:10:02 2022] POST /compute/v2.1/servers => generated 380 bytes in 551 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Sep 13 18:10:02.574548 dv-cinder-852009-8-iscsi devstack@n-api.service[120740]: DEBUG nova.api.openstack.wsgi [None req-73d8c2a8-4f7a-42ca-b58c-5232067caf5f tempest-VolumesSnapshotTestJSON-1753826991 tempest-VolumesSnapshotTestJSON-1753826991-project] Calling method '>' {{(pid=120740) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 18:10:02.575305 dv-cinder-852009-8-iscsi devstack@n-api.service[120740]: DEBUG nova.compute.api [None req-73d8c2a8-4f7a-42ca-b58c-5232067caf5f tempest-VolumesSnapshotTestJSON-1753826991 tempest-VolumesSnapshotTestJSON-1753826991-project] [instance: fee345c8-9135-4695-9164-ae5dbec8c25a] Fetching instance by UUID {{(pid=120740) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 18:10:02.628872 dv-cinder-852009-8-iscsi devstack@n-api.service[120740]: DEBUG nova.policy [None req-73d8c2a8-4f7a-42ca-b58c-5232067caf5f tempest-VolumesSnapshotTestJSON-1753826991 tempest-VolumesSnapshotTestJSON-1753826991-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f379ce3f38fc41568493be7493e75736', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1271ab6e6c9b4c93b05aafddbdbf9afe', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120740) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 18:10:02.636332 dv-cinder-852009-8-iscsi devstack@n-api.service[120740]: INFO nova.api.openstack.requestlog [None req-73d8c2a8-4f7a-42ca-b58c-5232067caf5f tempest-VolumesSnapshotTestJSON-1753826991 tempest-VolumesSnapshotTestJSON-1753826991-project] 10.222.0.43 "GET /compute/v2.1/servers/fee345c8-9135-4695-9164-ae5dbec8c25a" status: 200 len: 1218 microversion: 2.1 time: 0.066721 Sep 13 18:10:02.636974 dv-cinder-852009-8-iscsi devstack@n-api.service[120740]: [pid: 120740|app: 0|req: 396/781] 10.222.0.43 () {58 vars in 1236 bytes} [Tue Sep 13 18:10:02 2022] GET /compute/v2.1/servers/fee345c8-9135-4695-9164-ae5dbec8c25a => generated 1218 bytes in 68 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 13 18:10:03.660759 dv-cinder-852009-8-iscsi devstack@n-api.service[120741]: DEBUG nova.api.openstack.wsgi [None req-b7719157-e935-4230-ab36-d3a232306944 tempest-VolumesSnapshotTestJSON-1753826991 tempest-VolumesSnapshotTestJSON-1753826991-project] Calling method '>' {{(pid=120741) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 18:10:03.661367 dv-cinder-852009-8-iscsi devstack@n-api.service[120741]: DEBUG nova.compute.api [None req-b7719157-e935-4230-ab36-d3a232306944 tempest-VolumesSnapshotTestJSON-1753826991 tempest-VolumesSnapshotTestJSON-1753826991-project] [instance: fee345c8-9135-4695-9164-ae5dbec8c25a] Fetching instance by UUID {{(pid=120741) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 18:10:03.668754 dv-cinder-852009-8-iscsi devstack@n-api.service[120741]: DEBUG oslo_concurrency.lockutils [None req-b7719157-e935-4230-ab36-d3a232306944 tempest-VolumesSnapshotTestJSON-1753826991 tempest-VolumesSnapshotTestJSON-1753826991-project] Acquiring lock "1daf4f4c-0e4a-4779-b53a-78c48397ea2f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120741) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 18:10:03.669243 dv-cinder-852009-8-iscsi devstack@n-api.service[120741]: DEBUG oslo_concurrency.lockutils [None req-b7719157-e935-4230-ab36-d3a232306944 tempest-VolumesSnapshotTestJSON-1753826991 tempest-VolumesSnapshotTestJSON-1753826991-project] Lock "1daf4f4c-0e4a-4779-b53a-78c48397ea2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120741) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 18:10:03.669672 dv-cinder-852009-8-iscsi devstack@n-api.service[120741]: DEBUG oslo_concurrency.lockutils [None req-b7719157-e935-4230-ab36-d3a232306944 tempest-VolumesSnapshotTestJSON-1753826991 tempest-VolumesSnapshotTestJSON-1753826991-project] Lock "1daf4f4c-0e4a-4779-b53a-78c48397ea2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120741) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 18:10:03.670403 dv-cinder-852009-8-iscsi devstack@n-api.service[120741]: DEBUG oslo_concurrency.lockutils [None req-b7719157-e935-4230-ab36-d3a232306944 tempest-VolumesSnapshotTestJSON-1753826991 tempest-VolumesSnapshotTestJSON-1753826991-project] Acquiring lock "1daf4f4c-0e4a-4779-b53a-78c48397ea2f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120741) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 18:10:03.670820 dv-cinder-852009-8-iscsi devstack@n-api.service[120741]: DEBUG oslo_concurrency.lockutils [None req-b7719157-e935-4230-ab36-d3a232306944 tempest-VolumesSnapshotTestJSON-1753826991 tempest-VolumesSnapshotTestJSON-1753826991-project] Lock "1daf4f4c-0e4a-4779-b53a-78c48397ea2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120741) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 18:10:03.671434 dv-cinder-852009-8-iscsi devstack@n-api.service[120741]: DEBUG oslo_concurrency.lockutils [None req-b7719157-e935-4230-ab36-d3a232306944 tempest-VolumesSnapshotTestJSON-1753826991 tempest-VolumesSnapshotTestJSON-1753826991-project] Lock "1daf4f4c-0e4a-4779-b53a-78c48397ea2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120741) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 18:10:03.905626 dv-cinder-852009-8-iscsi devstack@n-api.service[120741]: DEBUG nova.policy [None req-b7719157-e935-4230-ab36-d3a232306944 tempest-VolumesSnapshotTestJSON-1753826991 tempest-VolumesSnapshotTestJSON-1753826991-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f379ce3f38fc41568493be7493e75736', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1271ab6e6c9b4c93b05aafddbdbf9afe', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120741) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 18:10:03.913772 dv-cinder-852009-8-iscsi devstack@n-api.service[120741]: INFO nova.api.openstack.requestlog [None req-b7719157-e935-4230-ab36-d3a232306944 tempest-VolumesSnapshotTestJSON-1753826991 tempest-VolumesSnapshotTestJSON-1753826991-project] 10.222.0.43 "GET /compute/v2.1/servers/fee345c8-9135-4695-9164-ae5dbec8c25a" status: 200 len: 1278 microversion: 2.1 time: 0.258821 Sep 13 18:10:03.917644 dv-cinder-852009-8-iscsi devstack@n-api.service[120741]: [pid: 120741|app: 0|req: 386/782] 10.222.0.43 () {58 vars in 1236 bytes} [Tue Sep 13 18:10:03 2022] GET /compute/v2.1/servers/fee345c8-9135-4695-9164-ae5dbec8c25a => generated 1278 bytes in 261 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 13 18:10:04.937409 dv-cinder-852009-8-iscsi devstack@n-api.service[120740]: DEBUG nova.api.openstack.wsgi [None req-83c0158e-64f9-42bf-95d8-84ab6cd27f82 tempest-VolumesSnapshotTestJSON-1753826991 tempest-VolumesSnapshotTestJSON-1753826991-project] Calling method '>' {{(pid=120740) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 18:10:04.938147 dv-cinder-852009-8-iscsi devstack@n-api.service[120740]: DEBUG nova.compute.api [None req-83c0158e-64f9-42bf-95d8-84ab6cd27f82 tempest-VolumesSnapshotTestJSON-1753826991 tempest-VolumesSnapshotTestJSON-1753826991-project] [instance: fee345c8-9135-4695-9164-ae5dbec8c25a] Fetching instance by UUID {{(pid=120740) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 18:10:04.944891 dv-cinder-852009-8-iscsi devstack@n-api.service[120740]: DEBUG oslo_concurrency.lockutils [None req-83c0158e-64f9-42bf-95d8-84ab6cd27f82 tempest-VolumesSnapshotTestJSON-1753826991 tempest-VolumesSnapshotTestJSON-1753826991-project] Acquiring lock "1daf4f4c-0e4a-4779-b53a-78c48397ea2f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120740) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 18:10:04.945465 dv-cinder-852009-8-iscsi devstack@n-api.service[120740]: DEBUG oslo_concurrency.lockutils [None req-83c0158e-64f9-42bf-95d8-84ab6cd27f82 tempest-VolumesSnapshotTestJSON-1753826991 tempest-VolumesSnapshotTestJSON-1753826991-project] Lock "1daf4f4c-0e4a-4779-b53a-78c48397ea2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120740) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 18:10:04.945963 dv-cinder-852009-8-iscsi devstack@n-api.service[120740]: DEBUG oslo_concurrency.lockutils [None req-83c0158e-64f9-42bf-95d8-84ab6cd27f82 tempest-VolumesSnapshotTestJSON-1753826991 tempest-VolumesSnapshotTestJSON-1753826991-project] Lock "1daf4f4c-0e4a-4779-b53a-78c48397ea2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120740) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 18:10:04.946811 dv-cinder-852009-8-iscsi devstack@n-api.service[120740]: DEBUG oslo_concurrency.lockutils [None req-83c0158e-64f9-42bf-95d8-84ab6cd27f82 tempest-VolumesSnapshotTestJSON-1753826991 tempest-VolumesSnapshotTestJSON-1753826991-project] Acquiring lock "1daf4f4c-0e4a-4779-b53a-78c48397ea2f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120740) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 18:10:04.947362 dv-cinder-852009-8-iscsi devstack@n-api.service[120740]: DEBUG oslo_concurrency.lockutils [None req-83c0158e-64f9-42bf-95d8-84ab6cd27f82 tempest-VolumesSnapshotTestJSON-1753826991 tempest-VolumesSnapshotTestJSON-1753826991-project] Lock "1daf4f4c-0e4a-4779-b53a-78c48397ea2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120740) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 18:10:04.947828 dv-cinder-852009-8-iscsi devstack@n-api.service[120740]: DEBUG oslo_concurrency.lockutils [None req-83c0158e-64f9-42bf-95d8-84ab6cd27f82 tempest-VolumesSnapshotTestJSON-1753826991 tempest-VolumesSnapshotTestJSON-1753826991-project] Lock "1daf4f4c-0e4a-4779-b53a-78c48397ea2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120740) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 18:10:05.087913 dv-cinder-852009-8-iscsi devstack@n-api.service[120740]: DEBUG nova.policy [None req-83c0158e-64f9-42bf-95d8-84ab6cd27f82 tempest-VolumesSnapshotTestJSON-1753826991 tempest-VolumesSnapshotTestJSON-1753826991-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f379ce3f38fc41568493be7493e75736', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1271ab6e6c9b4c93b05aafddbdbf9afe', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120740) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 18:10:05.095964 dv-cinder-852009-8-iscsi devstack@n-api.service[120740]: INFO nova.api.openstack.requestlog [None req-83c0158e-64f9-42bf-95d8-84ab6cd27f82 tempest-VolumesSnapshotTestJSON-1753826991 tempest-VolumesSnapshotTestJSON-1753826991-project] 10.222.0.43 "GET /compute/v2.1/servers/fee345c8-9135-4695-9164-ae5dbec8c25a" status: 200 len: 1318 microversion: 2.1 time: 0.162426 Sep 13 18:10:05.096753 dv-cinder-852009-8-iscsi devstack@n-api.service[120740]: [pid: 120740|app: 0|req: 397/783] 10.222.0.43 () {58 vars in 1236 bytes} [Tue Sep 13 18:10:04 2022] GET /compute/v2.1/servers/fee345c8-9135-4695-9164-ae5dbec8c25a => generated 1318 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 13 18:10:05.257374 dv-cinder-852009-8-iscsi devstack@n-api.service[120741]: DEBUG nova.api.openstack.wsgi [req-c9600b68-4e40-438b-bd4c-947bb640e09c req-f84e4c6e-b862-4911-a41a-8239cd338d07 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "fee345c8-9135-4695-9164-ae5dbec8c25a", "tag": "a718647a-eef3-4710-ba86-75b348efd497"}]} {{(pid=120741) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 13 18:10:05.269359 dv-cinder-852009-8-iscsi devstack@n-api.service[120741]: DEBUG oslo_concurrency.lockutils [req-c9600b68-4e40-438b-bd4c-947bb640e09c req-f84e4c6e-b862-4911-a41a-8239cd338d07 service nova] Acquiring lock "1daf4f4c-0e4a-4779-b53a-78c48397ea2f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120741) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 18:10:05.270507 dv-cinder-852009-8-iscsi devstack@n-api.service[120741]: DEBUG oslo_concurrency.lockutils [req-c9600b68-4e40-438b-bd4c-947bb640e09c req-f84e4c6e-b862-4911-a41a-8239cd338d07 service nova] Lock "1daf4f4c-0e4a-4779-b53a-78c48397ea2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120741) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 18:10:05.271383 dv-cinder-852009-8-iscsi devstack@n-api.service[120741]: DEBUG oslo_concurrency.lockutils [req-c9600b68-4e40-438b-bd4c-947bb640e09c req-f84e4c6e-b862-4911-a41a-8239cd338d07 service nova] Lock "1daf4f4c-0e4a-4779-b53a-78c48397ea2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120741) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 18:10:05.283468 dv-cinder-852009-8-iscsi devstack@n-api.service[120741]: INFO nova.api.openstack.compute.server_external_events [req-c9600b68-4e40-438b-bd4c-947bb640e09c req-f84e4c6e-b862-4911-a41a-8239cd338d07 service nova] Creating event network-changed:a718647a-eef3-4710-ba86-75b348efd497 for instance fee345c8-9135-4695-9164-ae5dbec8c25a on hv-cinder-85200 Sep 13 18:10:05.289007 dv-cinder-852009-8-iscsi devstack@n-api.service[120741]: INFO nova.api.openstack.requestlog [req-c9600b68-4e40-438b-bd4c-947bb640e09c req-f84e4c6e-b862-4911-a41a-8239cd338d07 service nova] 10.222.0.43 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.036455 Sep 13 18:10:05.289600 dv-cinder-852009-8-iscsi devstack@n-api.service[120741]: [pid: 120741|app: 0|req: 387/784] 10.222.0.43 () {64 vars in 1317 bytes} [Tue Sep 13 18:10:05 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 38 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 13 18:10:06.127611 dv-cinder-852009-8-iscsi devstack@n-api.service[120740]: DEBUG nova.api.openstack.wsgi [None req-83955d05-3e50-4e30-864a-fa324f3fe0ee tempest-VolumesSnapshotTestJSON-1753826991 tempest-VolumesSnapshotTestJSON-1753826991-project] Calling method '>' {{(pid=120740) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 18:10:06.128528 dv-cinder-852009-8-iscsi devstack@n-api.service[120740]: DEBUG nova.compute.api [None req-83955d05-3e50-4e30-864a-fa324f3fe0ee tempest-VolumesSnapshotTestJSON-1753826991 tempest-VolumesSnapshotTestJSON-1753826991-project] [instance: fee345c8-9135-4695-9164-ae5dbec8c25a] Fetching instance by UUID {{(pid=120740) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 18:10:06.139335 dv-cinder-852009-8-iscsi devstack@n-api.service[120740]: DEBUG oslo_concurrency.lockutils [None req-83955d05-3e50-4e30-864a-fa324f3fe0ee tempest-VolumesSnapshotTestJSON-1753826991 tempest-VolumesSnapshotTestJSON-1753826991-project] Acquiring lock "1daf4f4c-0e4a-4779-b53a-78c48397ea2f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120740) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 18:10:06.140103 dv-cinder-852009-8-iscsi devstack@n-api.service[120740]: DEBUG oslo_concurrency.lockutils [None req-83955d05-3e50-4e30-864a-fa324f3fe0ee tempest-VolumesSnapshotTestJSON-1753826991 tempest-VolumesSnapshotTestJSON-1753826991-project] Lock "1daf4f4c-0e4a-4779-b53a-78c48397ea2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120740) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 18:10:06.141007 dv-cinder-852009-8-iscsi devstack@n-api.service[120740]: DEBUG oslo_concurrency.lockutils [None req-83955d05-3e50-4e30-864a-fa324f3fe0ee tempest-VolumesSnapshotTestJSON-1753826991 tempest-VolumesSnapshotTestJSON-1753826991-project] Lock "1daf4f4c-0e4a-4779-b53a-78c48397ea2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120740) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 18:10:06.142133 dv-cinder-852009-8-iscsi devstack@n-api.service[120740]: DEBUG oslo_concurrency.lockutils [None req-83955d05-3e50-4e30-864a-fa324f3fe0ee tempest-VolumesSnapshotTestJSON-1753826991 tempest-VolumesSnapshotTestJSON-1753826991-project] Acquiring lock "1daf4f4c-0e4a-4779-b53a-78c48397ea2f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120740) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 18:10:06.142874 dv-cinder-852009-8-iscsi devstack@n-api.service[120740]: DEBUG oslo_concurrency.lockutils [None req-83955d05-3e50-4e30-864a-fa324f3fe0ee tempest-VolumesSnapshotTestJSON-1753826991 tempest-VolumesSnapshotTestJSON-1753826991-project] Lock "1daf4f4c-0e4a-4779-b53a-78c48397ea2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120740) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 18:10:06.143558 dv-cinder-852009-8-iscsi devstack@n-api.service[120740]: DEBUG oslo_concurrency.lockutils [None req-83955d05-3e50-4e30-864a-fa324f3fe0ee tempest-VolumesSnapshotTestJSON-1753826991 tempest-VolumesSnapshotTestJSON-1753826991-project] Lock "1daf4f4c-0e4a-4779-b53a-78c48397ea2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120740) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 18:10:06.281761 dv-cinder-852009-8-iscsi devstack@n-api.service[120740]: DEBUG nova.policy [None req-83955d05-3e50-4e30-864a-fa324f3fe0ee tempest-VolumesSnapshotTestJSON-1753826991 tempest-VolumesSnapshotTestJSON-1753826991-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f379ce3f38fc41568493be7493e75736', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1271ab6e6c9b4c93b05aafddbdbf9afe', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120740) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 18:10:06.289644 dv-cinder-852009-8-iscsi devstack@n-api.service[120740]: INFO nova.api.openstack.requestlog [None req-83955d05-3e50-4e30-864a-fa324f3fe0ee tempest-VolumesSnapshotTestJSON-1753826991 tempest-VolumesSnapshotTestJSON-1753826991-project] 10.222.0.43 "GET /compute/v2.1/servers/fee345c8-9135-4695-9164-ae5dbec8c25a" status: 200 len: 1318 microversion: 2.1 time: 0.168989 Sep 13 18:10:06.290211 dv-cinder-852009-8-iscsi devstack@n-api.service[120740]: [pid: 120740|app: 0|req: 398/785] 10.222.0.43 () {58 vars in 1236 bytes} [Tue Sep 13 18:10:06 2022] GET /compute/v2.1/servers/fee345c8-9135-4695-9164-ae5dbec8c25a => generated 1318 bytes in 171 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 13 18:10:07.313568 dv-cinder-852009-8-iscsi devstack@n-api.service[120741]: DEBUG nova.api.openstack.wsgi [None req-84aee776-bdf1-454f-9b6c-b8daa868fd8a tempest-VolumesSnapshotTestJSON-1753826991 tempest-VolumesSnapshotTestJSON-1753826991-project] Calling method '>' {{(pid=120741) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 18:10:07.314294 dv-cinder-852009-8-iscsi devstack@n-api.service[120741]: DEBUG nova.compute.api [None req-84aee776-bdf1-454f-9b6c-b8daa868fd8a tempest-VolumesSnapshotTestJSON-1753826991 tempest-VolumesSnapshotTestJSON-1753826991-project] [instance: fee345c8-9135-4695-9164-ae5dbec8c25a] Fetching instance by UUID {{(pid=120741) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 18:10:07.321383 dv-cinder-852009-8-iscsi devstack@n-api.service[120741]: DEBUG oslo_concurrency.lockutils [None req-84aee776-bdf1-454f-9b6c-b8daa868fd8a tempest-VolumesSnapshotTestJSON-1753826991 tempest-VolumesSnapshotTestJSON-1753826991-project] Acquiring lock "1daf4f4c-0e4a-4779-b53a-78c48397ea2f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120741) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 18:10:07.321865 dv-cinder-852009-8-iscsi devstack@n-api.service[120741]: DEBUG oslo_concurrency.lockutils [None req-84aee776-bdf1-454f-9b6c-b8daa868fd8a tempest-VolumesSnapshotTestJSON-1753826991 tempest-VolumesSnapshotTestJSON-1753826991-project] Lock "1daf4f4c-0e4a-4779-b53a-78c48397ea2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120741) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 18:10:07.322311 dv-cinder-852009-8-iscsi devstack@n-api.service[120741]: DEBUG oslo_concurrency.lockutils [None req-84aee776-bdf1-454f-9b6c-b8daa868fd8a tempest-VolumesSnapshotTestJSON-1753826991 tempest-VolumesSnapshotTestJSON-1753826991-project] Lock "1daf4f4c-0e4a-4779-b53a-78c48397ea2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120741) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 18:10:07.323004 dv-cinder-852009-8-iscsi devstack@n-api.service[120741]: DEBUG oslo_concurrency.lockutils [None req-84aee776-bdf1-454f-9b6c-b8daa868fd8a tempest-VolumesSnapshotTestJSON-1753826991 tempest-VolumesSnapshotTestJSON-1753826991-project] Acquiring lock "1daf4f4c-0e4a-4779-b53a-78c48397ea2f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120741) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 18:10:07.323475 dv-cinder-852009-8-iscsi devstack@n-api.service[120741]: DEBUG oslo_concurrency.lockutils [None req-84aee776-bdf1-454f-9b6c-b8daa868fd8a tempest-VolumesSnapshotTestJSON-1753826991 tempest-VolumesSnapshotTestJSON-1753826991-project] Lock "1daf4f4c-0e4a-4779-b53a-78c48397ea2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120741) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 18:10:07.323894 dv-cinder-852009-8-iscsi devstack@n-api.service[120741]: DEBUG oslo_concurrency.lockutils [None req-84aee776-bdf1-454f-9b6c-b8daa868fd8a tempest-VolumesSnapshotTestJSON-1753826991 tempest-VolumesSnapshotTestJSON-1753826991-project] Lock "1daf4f4c-0e4a-4779-b53a-78c48397ea2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120741) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 18:10:07.462703 dv-cinder-852009-8-iscsi devstack@n-api.service[120741]: DEBUG nova.policy [None req-84aee776-bdf1-454f-9b6c-b8daa868fd8a tempest-VolumesSnapshotTestJSON-1753826991 tempest-VolumesSnapshotTestJSON-1753826991-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f379ce3f38fc41568493be7493e75736', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1271ab6e6c9b4c93b05aafddbdbf9afe', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120741) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 18:10:07.473786 dv-cinder-852009-8-iscsi devstack@n-api.service[120741]: INFO nova.api.openstack.requestlog [None req-84aee776-bdf1-454f-9b6c-b8daa868fd8a tempest-VolumesSnapshotTestJSON-1753826991 tempest-VolumesSnapshotTestJSON-1753826991-project] 10.222.0.43 "GET /compute/v2.1/servers/fee345c8-9135-4695-9164-ae5dbec8c25a" status: 200 len: 1318 microversion: 2.1 time: 0.164535 Sep 13 18:10:07.474355 dv-cinder-852009-8-iscsi devstack@n-api.service[120741]: [pid: 120741|app: 0|req: 388/786] 10.222.0.43 () {58 vars in 1236 bytes} [Tue Sep 13 18:10:07 2022] GET /compute/v2.1/servers/fee345c8-9135-4695-9164-ae5dbec8c25a => generated 1318 bytes in 166 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 13 18:10:08.501648 dv-cinder-852009-8-iscsi devstack@n-api.service[120740]: DEBUG nova.api.openstack.wsgi [None req-bd805b05-b836-4b9c-bc2d-85bac78f12e1 tempest-VolumesSnapshotTestJSON-1753826991 tempest-VolumesSnapshotTestJSON-1753826991-project] Calling method '>' {{(pid=120740) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 18:10:08.502826 dv-cinder-852009-8-iscsi devstack@n-api.service[120740]: DEBUG nova.compute.api [None req-bd805b05-b836-4b9c-bc2d-85bac78f12e1 tempest-VolumesSnapshotTestJSON-1753826991 tempest-VolumesSnapshotTestJSON-1753826991-project] [instance: fee345c8-9135-4695-9164-ae5dbec8c25a] Fetching instance by UUID {{(pid=120740) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 18:10:08.513464 dv-cinder-852009-8-iscsi devstack@n-api.service[120740]: DEBUG oslo_concurrency.lockutils [None req-bd805b05-b836-4b9c-bc2d-85bac78f12e1 tempest-VolumesSnapshotTestJSON-1753826991 tempest-VolumesSnapshotTestJSON-1753826991-project] Acquiring lock "1daf4f4c-0e4a-4779-b53a-78c48397ea2f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120740) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 18:10:08.514066 dv-cinder-852009-8-iscsi devstack@n-api.service[120740]: DEBUG oslo_concurrency.lockutils [None req-bd805b05-b836-4b9c-bc2d-85bac78f12e1 tempest-VolumesSnapshotTestJSON-1753826991 tempest-VolumesSnapshotTestJSON-1753826991-project] Lock "1daf4f4c-0e4a-4779-b53a-78c48397ea2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120740) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 18:10:08.514686 dv-cinder-852009-8-iscsi devstack@n-api.service[120740]: DEBUG oslo_concurrency.lockutils [None req-bd805b05-b836-4b9c-bc2d-85bac78f12e1 tempest-VolumesSnapshotTestJSON-1753826991 tempest-VolumesSnapshotTestJSON-1753826991-project] Lock "1daf4f4c-0e4a-4779-b53a-78c48397ea2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120740) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 18:10:08.515840 dv-cinder-852009-8-iscsi devstack@n-api.service[120740]: DEBUG oslo_concurrency.lockutils [None req-bd805b05-b836-4b9c-bc2d-85bac78f12e1 tempest-VolumesSnapshotTestJSON-1753826991 tempest-VolumesSnapshotTestJSON-1753826991-project] Acquiring lock "1daf4f4c-0e4a-4779-b53a-78c48397ea2f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120740) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 18:10:08.516640 dv-cinder-852009-8-iscsi devstack@n-api.service[120740]: DEBUG oslo_concurrency.lockutils [None req-bd805b05-b836-4b9c-bc2d-85bac78f12e1 tempest-VolumesSnapshotTestJSON-1753826991 tempest-VolumesSnapshotTestJSON-1753826991-project] Lock "1daf4f4c-0e4a-4779-b53a-78c48397ea2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120740) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 18:10:08.517367 dv-cinder-852009-8-iscsi devstack@n-api.service[120740]: DEBUG oslo_concurrency.lockutils [None req-bd805b05-b836-4b9c-bc2d-85bac78f12e1 tempest-VolumesSnapshotTestJSON-1753826991 tempest-VolumesSnapshotTestJSON-1753826991-project] Lock "1daf4f4c-0e4a-4779-b53a-78c48397ea2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120740) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 18:10:08.655221 dv-cinder-852009-8-iscsi devstack@n-api.service[120740]: DEBUG nova.policy [None req-bd805b05-b836-4b9c-bc2d-85bac78f12e1 tempest-VolumesSnapshotTestJSON-1753826991 tempest-VolumesSnapshotTestJSON-1753826991-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f379ce3f38fc41568493be7493e75736', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1271ab6e6c9b4c93b05aafddbdbf9afe', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120740) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 18:10:08.663144 dv-cinder-852009-8-iscsi devstack@n-api.service[120740]: INFO nova.api.openstack.requestlog [None req-bd805b05-b836-4b9c-bc2d-85bac78f12e1 tempest-VolumesSnapshotTestJSON-1753826991 tempest-VolumesSnapshotTestJSON-1753826991-project] 10.222.0.43 "GET /compute/v2.1/servers/fee345c8-9135-4695-9164-ae5dbec8c25a" status: 200 len: 1318 microversion: 2.1 time: 0.168161 Sep 13 18:10:08.663690 dv-cinder-852009-8-iscsi devstack@n-api.service[120740]: [pid: 120740|app: 0|req: 399/787] 10.222.0.43 () {58 vars in 1236 bytes} [Tue Sep 13 18:10:08 2022] GET /compute/v2.1/servers/fee345c8-9135-4695-9164-ae5dbec8c25a => generated 1318 bytes in 170 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 13 18:10:09.690444 dv-cinder-852009-8-iscsi devstack@n-api.service[120741]: DEBUG nova.api.openstack.wsgi [None req-e55eaaff-094a-4517-8ff2-dd4f8807e0ac tempest-VolumesSnapshotTestJSON-1753826991 tempest-VolumesSnapshotTestJSON-1753826991-project] Calling method '>' {{(pid=120741) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 18:10:09.691488 dv-cinder-852009-8-iscsi devstack@n-api.service[120741]: DEBUG nova.compute.api [None req-e55eaaff-094a-4517-8ff2-dd4f8807e0ac tempest-VolumesSnapshotTestJSON-1753826991 tempest-VolumesSnapshotTestJSON-1753826991-project] [instance: fee345c8-9135-4695-9164-ae5dbec8c25a] Fetching instance by UUID {{(pid=120741) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 18:10:09.698726 dv-cinder-852009-8-iscsi devstack@n-api.service[120741]: DEBUG oslo_concurrency.lockutils [None req-e55eaaff-094a-4517-8ff2-dd4f8807e0ac tempest-VolumesSnapshotTestJSON-1753826991 tempest-VolumesSnapshotTestJSON-1753826991-project] Acquiring lock "1daf4f4c-0e4a-4779-b53a-78c48397ea2f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120741) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 18:10:09.699210 dv-cinder-852009-8-iscsi devstack@n-api.service[120741]: DEBUG oslo_concurrency.lockutils [None req-e55eaaff-094a-4517-8ff2-dd4f8807e0ac tempest-VolumesSnapshotTestJSON-1753826991 tempest-VolumesSnapshotTestJSON-1753826991-project] Lock "1daf4f4c-0e4a-4779-b53a-78c48397ea2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120741) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 18:10:09.699640 dv-cinder-852009-8-iscsi devstack@n-api.service[120741]: DEBUG oslo_concurrency.lockutils [None req-e55eaaff-094a-4517-8ff2-dd4f8807e0ac tempest-VolumesSnapshotTestJSON-1753826991 tempest-VolumesSnapshotTestJSON-1753826991-project] Lock "1daf4f4c-0e4a-4779-b53a-78c48397ea2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120741) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 18:10:09.700327 dv-cinder-852009-8-iscsi devstack@n-api.service[120741]: DEBUG oslo_concurrency.lockutils [None req-e55eaaff-094a-4517-8ff2-dd4f8807e0ac tempest-VolumesSnapshotTestJSON-1753826991 tempest-VolumesSnapshotTestJSON-1753826991-project] Acquiring lock "1daf4f4c-0e4a-4779-b53a-78c48397ea2f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120741) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 18:10:09.700809 dv-cinder-852009-8-iscsi devstack@n-api.service[120741]: DEBUG oslo_concurrency.lockutils [None req-e55eaaff-094a-4517-8ff2-dd4f8807e0ac tempest-VolumesSnapshotTestJSON-1753826991 tempest-VolumesSnapshotTestJSON-1753826991-project] Lock "1daf4f4c-0e4a-4779-b53a-78c48397ea2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120741) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 18:10:09.701256 dv-cinder-852009-8-iscsi devstack@n-api.service[120741]: DEBUG oslo_concurrency.lockutils [None req-e55eaaff-094a-4517-8ff2-dd4f8807e0ac tempest-VolumesSnapshotTestJSON-1753826991 tempest-VolumesSnapshotTestJSON-1753826991-project] Lock "1daf4f4c-0e4a-4779-b53a-78c48397ea2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120741) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 18:10:09.833541 dv-cinder-852009-8-iscsi devstack@n-api.service[120741]: DEBUG nova.policy [None req-e55eaaff-094a-4517-8ff2-dd4f8807e0ac tempest-VolumesSnapshotTestJSON-1753826991 tempest-VolumesSnapshotTestJSON-1753826991-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f379ce3f38fc41568493be7493e75736', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1271ab6e6c9b4c93b05aafddbdbf9afe', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120741) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 18:10:09.841383 dv-cinder-852009-8-iscsi devstack@n-api.service[120741]: INFO nova.api.openstack.requestlog [None req-e55eaaff-094a-4517-8ff2-dd4f8807e0ac tempest-VolumesSnapshotTestJSON-1753826991 tempest-VolumesSnapshotTestJSON-1753826991-project] 10.222.0.43 "GET /compute/v2.1/servers/fee345c8-9135-4695-9164-ae5dbec8c25a" status: 200 len: 1318 microversion: 2.1 time: 0.157514 Sep 13 18:10:09.841998 dv-cinder-852009-8-iscsi devstack@n-api.service[120741]: [pid: 120741|app: 0|req: 389/788] 10.222.0.43 () {58 vars in 1236 bytes} [Tue Sep 13 18:10:09 2022] GET /compute/v2.1/servers/fee345c8-9135-4695-9164-ae5dbec8c25a => generated 1318 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 13 18:10:10.783191 dv-cinder-852009-8-iscsi devstack@n-api.service[120740]: DEBUG nova.api.openstack.wsgi [req-c4e01782-384a-49a1-be8b-66282806f6aa req-1a934649-78b1-49fd-8a41-afc207474b6b service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "fee345c8-9135-4695-9164-ae5dbec8c25a", "name": "network-vif-plugged", "status": "completed", "tag": "a718647a-eef3-4710-ba86-75b348efd497"}]} {{(pid=120740) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 13 18:10:10.793969 dv-cinder-852009-8-iscsi devstack@n-api.service[120740]: DEBUG oslo_concurrency.lockutils [req-c4e01782-384a-49a1-be8b-66282806f6aa req-1a934649-78b1-49fd-8a41-afc207474b6b service nova] Acquiring lock "1daf4f4c-0e4a-4779-b53a-78c48397ea2f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120740) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 18:10:10.794493 dv-cinder-852009-8-iscsi devstack@n-api.service[120740]: DEBUG oslo_concurrency.lockutils [req-c4e01782-384a-49a1-be8b-66282806f6aa req-1a934649-78b1-49fd-8a41-afc207474b6b service nova] Lock "1daf4f4c-0e4a-4779-b53a-78c48397ea2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120740) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 18:10:10.794955 dv-cinder-852009-8-iscsi devstack@n-api.service[120740]: DEBUG oslo_concurrency.lockutils [req-c4e01782-384a-49a1-be8b-66282806f6aa req-1a934649-78b1-49fd-8a41-afc207474b6b service nova] Lock "1daf4f4c-0e4a-4779-b53a-78c48397ea2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120740) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 18:10:10.812466 dv-cinder-852009-8-iscsi devstack@n-api.service[120740]: INFO nova.api.openstack.compute.server_external_events [req-c4e01782-384a-49a1-be8b-66282806f6aa req-1a934649-78b1-49fd-8a41-afc207474b6b service nova] Creating event network-vif-plugged:a718647a-eef3-4710-ba86-75b348efd497 for instance fee345c8-9135-4695-9164-ae5dbec8c25a on hv-cinder-85200 Sep 13 18:10:10.818455 dv-cinder-852009-8-iscsi devstack@n-api.service[120740]: INFO nova.api.openstack.requestlog [req-c4e01782-384a-49a1-be8b-66282806f6aa req-1a934649-78b1-49fd-8a41-afc207474b6b service nova] 10.222.0.43 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.038629 Sep 13 18:10:10.819062 dv-cinder-852009-8-iscsi devstack@n-api.service[120740]: [pid: 120740|app: 0|req: 400/789] 10.222.0.43 () {64 vars in 1317 bytes} [Tue Sep 13 18:10:10 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 40 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 13 18:10:10.863670 dv-cinder-852009-8-iscsi devstack@n-api.service[120741]: DEBUG nova.api.openstack.wsgi [None req-448b6bbd-28c6-4632-b47d-fccc55bf0ed8 tempest-VolumesSnapshotTestJSON-1753826991 tempest-VolumesSnapshotTestJSON-1753826991-project] Calling method '>' {{(pid=120741) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 18:10:10.864458 dv-cinder-852009-8-iscsi devstack@n-api.service[120741]: DEBUG nova.compute.api [None req-448b6bbd-28c6-4632-b47d-fccc55bf0ed8 tempest-VolumesSnapshotTestJSON-1753826991 tempest-VolumesSnapshotTestJSON-1753826991-project] [instance: fee345c8-9135-4695-9164-ae5dbec8c25a] Fetching instance by UUID {{(pid=120741) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 18:10:10.871242 dv-cinder-852009-8-iscsi devstack@n-api.service[120741]: DEBUG oslo_concurrency.lockutils [None req-448b6bbd-28c6-4632-b47d-fccc55bf0ed8 tempest-VolumesSnapshotTestJSON-1753826991 tempest-VolumesSnapshotTestJSON-1753826991-project] Acquiring lock "1daf4f4c-0e4a-4779-b53a-78c48397ea2f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120741) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 18:10:10.871735 dv-cinder-852009-8-iscsi devstack@n-api.service[120741]: DEBUG oslo_concurrency.lockutils [None req-448b6bbd-28c6-4632-b47d-fccc55bf0ed8 tempest-VolumesSnapshotTestJSON-1753826991 tempest-VolumesSnapshotTestJSON-1753826991-project] Lock "1daf4f4c-0e4a-4779-b53a-78c48397ea2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120741) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 18:10:10.872236 dv-cinder-852009-8-iscsi devstack@n-api.service[120741]: DEBUG oslo_concurrency.lockutils [None req-448b6bbd-28c6-4632-b47d-fccc55bf0ed8 tempest-VolumesSnapshotTestJSON-1753826991 tempest-VolumesSnapshotTestJSON-1753826991-project] Lock "1daf4f4c-0e4a-4779-b53a-78c48397ea2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120741) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 18:10:10.873032 dv-cinder-852009-8-iscsi devstack@n-api.service[120741]: DEBUG oslo_concurrency.lockutils [None req-448b6bbd-28c6-4632-b47d-fccc55bf0ed8 tempest-VolumesSnapshotTestJSON-1753826991 tempest-VolumesSnapshotTestJSON-1753826991-project] Acquiring lock "1daf4f4c-0e4a-4779-b53a-78c48397ea2f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120741) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 18:10:10.873552 dv-cinder-852009-8-iscsi devstack@n-api.service[120741]: DEBUG oslo_concurrency.lockutils [None req-448b6bbd-28c6-4632-b47d-fccc55bf0ed8 tempest-VolumesSnapshotTestJSON-1753826991 tempest-VolumesSnapshotTestJSON-1753826991-project] Lock "1daf4f4c-0e4a-4779-b53a-78c48397ea2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120741) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 18:10:10.874069 dv-cinder-852009-8-iscsi devstack@n-api.service[120741]: DEBUG oslo_concurrency.lockutils [None req-448b6bbd-28c6-4632-b47d-fccc55bf0ed8 tempest-VolumesSnapshotTestJSON-1753826991 tempest-VolumesSnapshotTestJSON-1753826991-project] Lock "1daf4f4c-0e4a-4779-b53a-78c48397ea2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120741) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 18:10:11.013694 dv-cinder-852009-8-iscsi devstack@n-api.service[120741]: DEBUG nova.policy [None req-448b6bbd-28c6-4632-b47d-fccc55bf0ed8 tempest-VolumesSnapshotTestJSON-1753826991 tempest-VolumesSnapshotTestJSON-1753826991-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f379ce3f38fc41568493be7493e75736', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1271ab6e6c9b4c93b05aafddbdbf9afe', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120741) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 18:10:11.021769 dv-cinder-852009-8-iscsi devstack@n-api.service[120741]: INFO nova.api.openstack.requestlog [None req-448b6bbd-28c6-4632-b47d-fccc55bf0ed8 tempest-VolumesSnapshotTestJSON-1753826991 tempest-VolumesSnapshotTestJSON-1753826991-project] 10.222.0.43 "GET /compute/v2.1/servers/fee345c8-9135-4695-9164-ae5dbec8c25a" status: 200 len: 1318 microversion: 2.1 time: 0.162043 Sep 13 18:10:11.022343 dv-cinder-852009-8-iscsi devstack@n-api.service[120741]: [pid: 120741|app: 0|req: 390/790] 10.222.0.43 () {58 vars in 1236 bytes} [Tue Sep 13 18:10:10 2022] GET /compute/v2.1/servers/fee345c8-9135-4695-9164-ae5dbec8c25a => generated 1318 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 13 18:10:12.050646 dv-cinder-852009-8-iscsi devstack@n-api.service[120740]: DEBUG nova.api.openstack.wsgi [None req-c1f6b66d-880f-4144-b931-92db188c6321 tempest-VolumesSnapshotTestJSON-1753826991 tempest-VolumesSnapshotTestJSON-1753826991-project] Calling method '>' {{(pid=120740) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 18:10:12.051727 dv-cinder-852009-8-iscsi devstack@n-api.service[120740]: DEBUG nova.compute.api [None req-c1f6b66d-880f-4144-b931-92db188c6321 tempest-VolumesSnapshotTestJSON-1753826991 tempest-VolumesSnapshotTestJSON-1753826991-project] [instance: fee345c8-9135-4695-9164-ae5dbec8c25a] Fetching instance by UUID {{(pid=120740) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 18:10:12.058341 dv-cinder-852009-8-iscsi devstack@n-api.service[120740]: DEBUG oslo_concurrency.lockutils [None req-c1f6b66d-880f-4144-b931-92db188c6321 tempest-VolumesSnapshotTestJSON-1753826991 tempest-VolumesSnapshotTestJSON-1753826991-project] Acquiring lock "1daf4f4c-0e4a-4779-b53a-78c48397ea2f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120740) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 18:10:12.058824 dv-cinder-852009-8-iscsi devstack@n-api.service[120740]: DEBUG oslo_concurrency.lockutils [None req-c1f6b66d-880f-4144-b931-92db188c6321 tempest-VolumesSnapshotTestJSON-1753826991 tempest-VolumesSnapshotTestJSON-1753826991-project] Lock "1daf4f4c-0e4a-4779-b53a-78c48397ea2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120740) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 18:10:12.059261 dv-cinder-852009-8-iscsi devstack@n-api.service[120740]: DEBUG oslo_concurrency.lockutils [None req-c1f6b66d-880f-4144-b931-92db188c6321 tempest-VolumesSnapshotTestJSON-1753826991 tempest-VolumesSnapshotTestJSON-1753826991-project] Lock "1daf4f4c-0e4a-4779-b53a-78c48397ea2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120740) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 18:10:12.059954 dv-cinder-852009-8-iscsi devstack@n-api.service[120740]: DEBUG oslo_concurrency.lockutils [None req-c1f6b66d-880f-4144-b931-92db188c6321 tempest-VolumesSnapshotTestJSON-1753826991 tempest-VolumesSnapshotTestJSON-1753826991-project] Acquiring lock "1daf4f4c-0e4a-4779-b53a-78c48397ea2f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120740) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 18:10:12.060405 dv-cinder-852009-8-iscsi devstack@n-api.service[120740]: DEBUG oslo_concurrency.lockutils [None req-c1f6b66d-880f-4144-b931-92db188c6321 tempest-VolumesSnapshotTestJSON-1753826991 tempest-VolumesSnapshotTestJSON-1753826991-project] Lock "1daf4f4c-0e4a-4779-b53a-78c48397ea2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120740) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 18:10:12.060928 dv-cinder-852009-8-iscsi devstack@n-api.service[120740]: DEBUG oslo_concurrency.lockutils [None req-c1f6b66d-880f-4144-b931-92db188c6321 tempest-VolumesSnapshotTestJSON-1753826991 tempest-VolumesSnapshotTestJSON-1753826991-project] Lock "1daf4f4c-0e4a-4779-b53a-78c48397ea2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120740) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 18:10:12.191918 dv-cinder-852009-8-iscsi devstack@n-api.service[120740]: DEBUG nova.policy [None req-c1f6b66d-880f-4144-b931-92db188c6321 tempest-VolumesSnapshotTestJSON-1753826991 tempest-VolumesSnapshotTestJSON-1753826991-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f379ce3f38fc41568493be7493e75736', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1271ab6e6c9b4c93b05aafddbdbf9afe', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120740) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 18:10:12.203248 dv-cinder-852009-8-iscsi devstack@n-api.service[120740]: INFO nova.api.openstack.requestlog [None req-c1f6b66d-880f-4144-b931-92db188c6321 tempest-VolumesSnapshotTestJSON-1753826991 tempest-VolumesSnapshotTestJSON-1753826991-project] 10.222.0.43 "GET /compute/v2.1/servers/fee345c8-9135-4695-9164-ae5dbec8c25a" status: 200 len: 1318 microversion: 2.1 time: 0.160233 Sep 13 18:10:12.203950 dv-cinder-852009-8-iscsi devstack@n-api.service[120740]: [pid: 120740|app: 0|req: 401/791] 10.222.0.43 () {58 vars in 1236 bytes} [Tue Sep 13 18:10:12 2022] GET /compute/v2.1/servers/fee345c8-9135-4695-9164-ae5dbec8c25a => generated 1318 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 13 18:10:13.230950 dv-cinder-852009-8-iscsi devstack@n-api.service[120741]: DEBUG nova.api.openstack.wsgi [None req-d3863282-852f-4ebc-9fe2-8cf62e727049 tempest-VolumesSnapshotTestJSON-1753826991 tempest-VolumesSnapshotTestJSON-1753826991-project] Calling method '>' {{(pid=120741) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 18:10:13.231790 dv-cinder-852009-8-iscsi devstack@n-api.service[120741]: DEBUG nova.compute.api [None req-d3863282-852f-4ebc-9fe2-8cf62e727049 tempest-VolumesSnapshotTestJSON-1753826991 tempest-VolumesSnapshotTestJSON-1753826991-project] [instance: fee345c8-9135-4695-9164-ae5dbec8c25a] Fetching instance by UUID {{(pid=120741) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 18:10:13.235611 dv-cinder-852009-8-iscsi devstack@n-api.service[120741]: DEBUG dbcounter [-] [120741] Writing DB stats nova_cell0:SELECT=2 {{(pid=120741) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 18:10:13.236756 dv-cinder-852009-8-iscsi devstack@n-api.service[120741]: DEBUG dbcounter [-] [120741] Writing DB stats nova_cell0:SELECT=6 {{(pid=120741) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 18:10:13.247660 dv-cinder-852009-8-iscsi devstack@n-api.service[120741]: DEBUG oslo_concurrency.lockutils [None req-d3863282-852f-4ebc-9fe2-8cf62e727049 tempest-VolumesSnapshotTestJSON-1753826991 tempest-VolumesSnapshotTestJSON-1753826991-project] Acquiring lock "1daf4f4c-0e4a-4779-b53a-78c48397ea2f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120741) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 18:10:13.248575 dv-cinder-852009-8-iscsi devstack@n-api.service[120741]: DEBUG oslo_concurrency.lockutils [None req-d3863282-852f-4ebc-9fe2-8cf62e727049 tempest-VolumesSnapshotTestJSON-1753826991 tempest-VolumesSnapshotTestJSON-1753826991-project] Lock "1daf4f4c-0e4a-4779-b53a-78c48397ea2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120741) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 18:10:13.249363 dv-cinder-852009-8-iscsi devstack@n-api.service[120741]: DEBUG oslo_concurrency.lockutils [None req-d3863282-852f-4ebc-9fe2-8cf62e727049 tempest-VolumesSnapshotTestJSON-1753826991 tempest-VolumesSnapshotTestJSON-1753826991-project] Lock "1daf4f4c-0e4a-4779-b53a-78c48397ea2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120741) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 18:10:13.250571 dv-cinder-852009-8-iscsi devstack@n-api.service[120741]: DEBUG oslo_concurrency.lockutils [None req-d3863282-852f-4ebc-9fe2-8cf62e727049 tempest-VolumesSnapshotTestJSON-1753826991 tempest-VolumesSnapshotTestJSON-1753826991-project] Acquiring lock "1daf4f4c-0e4a-4779-b53a-78c48397ea2f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120741) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 18:10:13.251501 dv-cinder-852009-8-iscsi devstack@n-api.service[120741]: DEBUG oslo_concurrency.lockutils [None req-d3863282-852f-4ebc-9fe2-8cf62e727049 tempest-VolumesSnapshotTestJSON-1753826991 tempest-VolumesSnapshotTestJSON-1753826991-project] Lock "1daf4f4c-0e4a-4779-b53a-78c48397ea2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120741) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 18:10:13.252727 dv-cinder-852009-8-iscsi devstack@n-api.service[120741]: DEBUG oslo_concurrency.lockutils [None req-d3863282-852f-4ebc-9fe2-8cf62e727049 tempest-VolumesSnapshotTestJSON-1753826991 tempest-VolumesSnapshotTestJSON-1753826991-project] Lock "1daf4f4c-0e4a-4779-b53a-78c48397ea2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120741) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 18:10:13.392048 dv-cinder-852009-8-iscsi devstack@n-api.service[120741]: DEBUG nova.policy [None req-d3863282-852f-4ebc-9fe2-8cf62e727049 tempest-VolumesSnapshotTestJSON-1753826991 tempest-VolumesSnapshotTestJSON-1753826991-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f379ce3f38fc41568493be7493e75736', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1271ab6e6c9b4c93b05aafddbdbf9afe', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120741) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 18:10:13.400187 dv-cinder-852009-8-iscsi devstack@n-api.service[120741]: INFO nova.api.openstack.requestlog [None req-d3863282-852f-4ebc-9fe2-8cf62e727049 tempest-VolumesSnapshotTestJSON-1753826991 tempest-VolumesSnapshotTestJSON-1753826991-project] 10.222.0.43 "GET /compute/v2.1/servers/fee345c8-9135-4695-9164-ae5dbec8c25a" status: 200 len: 1506 microversion: 2.1 time: 0.176147 Sep 13 18:10:13.400775 dv-cinder-852009-8-iscsi devstack@n-api.service[120741]: [pid: 120741|app: 0|req: 391/792] 10.222.0.43 () {58 vars in 1236 bytes} [Tue Sep 13 18:10:13 2022] GET /compute/v2.1/servers/fee345c8-9135-4695-9164-ae5dbec8c25a => generated 1506 bytes in 178 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 13 18:10:13.422969 dv-cinder-852009-8-iscsi devstack@n-api.service[120740]: DEBUG nova.api.openstack.wsgi [None req-f3a9e364-5f11-4586-b396-aa72982cca42 tempest-VolumesSnapshotTestJSON-1753826991 tempest-VolumesSnapshotTestJSON-1753826991-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "faf1225a-e101-4a26-be03-ef237dbda3b7", "device": "/dev/sdb"}} {{(pid=120740) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 13 18:10:13.425467 dv-cinder-852009-8-iscsi devstack@n-api.service[120740]: DEBUG nova.compute.api [None req-f3a9e364-5f11-4586-b396-aa72982cca42 tempest-VolumesSnapshotTestJSON-1753826991 tempest-VolumesSnapshotTestJSON-1753826991-project] [instance: fee345c8-9135-4695-9164-ae5dbec8c25a] Fetching instance by UUID {{(pid=120740) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 18:10:13.427425 dv-cinder-852009-8-iscsi devstack@n-api.service[120740]: DEBUG dbcounter [-] [120740] Writing DB stats nova_cell0:SELECT=2 {{(pid=120740) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 18:10:13.428605 dv-cinder-852009-8-iscsi devstack@n-api.service[120740]: DEBUG dbcounter [-] [120740] Writing DB stats nova_api:SELECT=53,nova_api:INSERT=1,nova_api:UPDATE=1 {{(pid=120740) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 18:10:13.435242 dv-cinder-852009-8-iscsi devstack@n-api.service[120740]: DEBUG oslo_concurrency.lockutils [None req-f3a9e364-5f11-4586-b396-aa72982cca42 tempest-VolumesSnapshotTestJSON-1753826991 tempest-VolumesSnapshotTestJSON-1753826991-project] Acquiring lock "1daf4f4c-0e4a-4779-b53a-78c48397ea2f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120740) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 18:10:13.435757 dv-cinder-852009-8-iscsi devstack@n-api.service[120740]: DEBUG oslo_concurrency.lockutils [None req-f3a9e364-5f11-4586-b396-aa72982cca42 tempest-VolumesSnapshotTestJSON-1753826991 tempest-VolumesSnapshotTestJSON-1753826991-project] Lock "1daf4f4c-0e4a-4779-b53a-78c48397ea2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120740) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 18:10:13.436236 dv-cinder-852009-8-iscsi devstack@n-api.service[120740]: DEBUG oslo_concurrency.lockutils [None req-f3a9e364-5f11-4586-b396-aa72982cca42 tempest-VolumesSnapshotTestJSON-1753826991 tempest-VolumesSnapshotTestJSON-1753826991-project] Lock "1daf4f4c-0e4a-4779-b53a-78c48397ea2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120740) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 18:10:13.436956 dv-cinder-852009-8-iscsi devstack@n-api.service[120740]: DEBUG oslo_concurrency.lockutils [None req-f3a9e364-5f11-4586-b396-aa72982cca42 tempest-VolumesSnapshotTestJSON-1753826991 tempest-VolumesSnapshotTestJSON-1753826991-project] Acquiring lock "1daf4f4c-0e4a-4779-b53a-78c48397ea2f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120740) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 18:10:13.437400 dv-cinder-852009-8-iscsi devstack@n-api.service[120740]: DEBUG oslo_concurrency.lockutils [None req-f3a9e364-5f11-4586-b396-aa72982cca42 tempest-VolumesSnapshotTestJSON-1753826991 tempest-VolumesSnapshotTestJSON-1753826991-project] Lock "1daf4f4c-0e4a-4779-b53a-78c48397ea2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120740) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 18:10:13.437849 dv-cinder-852009-8-iscsi devstack@n-api.service[120740]: DEBUG oslo_concurrency.lockutils [None req-f3a9e364-5f11-4586-b396-aa72982cca42 tempest-VolumesSnapshotTestJSON-1753826991 tempest-VolumesSnapshotTestJSON-1753826991-project] Lock "1daf4f4c-0e4a-4779-b53a-78c48397ea2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120740) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 18:10:13.441984 dv-cinder-852009-8-iscsi devstack@n-api.service[120740]: DEBUG dbcounter [-] [120740] Writing DB stats nova_cell1:SELECT=81,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=120740) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 18:10:13.685461 dv-cinder-852009-8-iscsi devstack@n-api.service[120740]: INFO nova.api.openstack.requestlog [None req-f3a9e364-5f11-4586-b396-aa72982cca42 tempest-VolumesSnapshotTestJSON-1753826991 tempest-VolumesSnapshotTestJSON-1753826991-project] 10.222.0.43 "POST /compute/v2.1/servers/fee345c8-9135-4695-9164-ae5dbec8c25a/os-volume_attachments" status: 200 len: 194 microversion: 2.1 time: 0.266319 Sep 13 18:10:13.686083 dv-cinder-852009-8-iscsi devstack@n-api.service[120740]: [pid: 120740|app: 0|req: 402/793] 10.222.0.43 () {60 vars in 1323 bytes} [Tue Sep 13 18:10:13 2022] POST /compute/v2.1/servers/fee345c8-9135-4695-9164-ae5dbec8c25a/os-volume_attachments => generated 194 bytes in 268 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 13 18:10:31.106210 dv-cinder-852009-8-iscsi devstack@n-api.service[120741]: DEBUG nova.api.openstack.wsgi [None req-5c30be9a-5ec4-43c5-a58f-2f49172a3c68 tempest-VolumesSnapshotTestJSON-1753826991 tempest-VolumesSnapshotTestJSON-1753826991-project] Calling method '>' {{(pid=120741) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 18:10:31.106748 dv-cinder-852009-8-iscsi devstack@n-api.service[120741]: DEBUG nova.compute.api [None req-5c30be9a-5ec4-43c5-a58f-2f49172a3c68 tempest-VolumesSnapshotTestJSON-1753826991 tempest-VolumesSnapshotTestJSON-1753826991-project] [instance: fee345c8-9135-4695-9164-ae5dbec8c25a] Fetching instance by UUID {{(pid=120741) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 18:10:31.110270 dv-cinder-852009-8-iscsi devstack@n-api.service[120741]: DEBUG dbcounter [-] [120741] Writing DB stats nova_api:SELECT=62,nova_api:INSERT=6 {{(pid=120741) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 18:10:31.111135 dv-cinder-852009-8-iscsi devstack@n-api.service[120741]: DEBUG dbcounter [-] [120741] Writing DB stats nova_cell1:SELECT=87,nova_cell1:INSERT=1 {{(pid=120741) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 18:10:31.118548 dv-cinder-852009-8-iscsi devstack@n-api.service[120741]: DEBUG oslo_concurrency.lockutils [None req-5c30be9a-5ec4-43c5-a58f-2f49172a3c68 tempest-VolumesSnapshotTestJSON-1753826991 tempest-VolumesSnapshotTestJSON-1753826991-project] Acquiring lock "1daf4f4c-0e4a-4779-b53a-78c48397ea2f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120741) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 18:10:31.119240 dv-cinder-852009-8-iscsi devstack@n-api.service[120741]: DEBUG oslo_concurrency.lockutils [None req-5c30be9a-5ec4-43c5-a58f-2f49172a3c68 tempest-VolumesSnapshotTestJSON-1753826991 tempest-VolumesSnapshotTestJSON-1753826991-project] Lock "1daf4f4c-0e4a-4779-b53a-78c48397ea2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120741) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 18:10:31.119855 dv-cinder-852009-8-iscsi devstack@n-api.service[120741]: DEBUG oslo_concurrency.lockutils [None req-5c30be9a-5ec4-43c5-a58f-2f49172a3c68 tempest-VolumesSnapshotTestJSON-1753826991 tempest-VolumesSnapshotTestJSON-1753826991-project] Lock "1daf4f4c-0e4a-4779-b53a-78c48397ea2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120741) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 18:10:31.120765 dv-cinder-852009-8-iscsi devstack@n-api.service[120741]: DEBUG oslo_concurrency.lockutils [None req-5c30be9a-5ec4-43c5-a58f-2f49172a3c68 tempest-VolumesSnapshotTestJSON-1753826991 tempest-VolumesSnapshotTestJSON-1753826991-project] Acquiring lock "1daf4f4c-0e4a-4779-b53a-78c48397ea2f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120741) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 18:10:31.121220 dv-cinder-852009-8-iscsi devstack@n-api.service[120741]: DEBUG oslo_concurrency.lockutils [None req-5c30be9a-5ec4-43c5-a58f-2f49172a3c68 tempest-VolumesSnapshotTestJSON-1753826991 tempest-VolumesSnapshotTestJSON-1753826991-project] Lock "1daf4f4c-0e4a-4779-b53a-78c48397ea2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120741) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 18:10:31.121637 dv-cinder-852009-8-iscsi devstack@n-api.service[120741]: DEBUG oslo_concurrency.lockutils [None req-5c30be9a-5ec4-43c5-a58f-2f49172a3c68 tempest-VolumesSnapshotTestJSON-1753826991 tempest-VolumesSnapshotTestJSON-1753826991-project] Lock "1daf4f4c-0e4a-4779-b53a-78c48397ea2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120741) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 18:10:31.212391 dv-cinder-852009-8-iscsi devstack@n-api.service[120741]: DEBUG nova.objects.instance [None req-5c30be9a-5ec4-43c5-a58f-2f49172a3c68 tempest-VolumesSnapshotTestJSON-1753826991 tempest-VolumesSnapshotTestJSON-1753826991-project] Lazy-loading 'services' on Instance uuid fee345c8-9135-4695-9164-ae5dbec8c25a {{(pid=120741) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Sep 13 18:10:31.293794 dv-cinder-852009-8-iscsi devstack@n-api.service[120741]: INFO nova.api.openstack.requestlog [None req-5c30be9a-5ec4-43c5-a58f-2f49172a3c68 tempest-VolumesSnapshotTestJSON-1753826991 tempest-VolumesSnapshotTestJSON-1753826991-project] 10.222.0.43 "DELETE /compute/v2.1/servers/fee345c8-9135-4695-9164-ae5dbec8c25a/os-volume_attachments/faf1225a-e101-4a26-be03-ef237dbda3b7" status: 202 len: 0 microversion: 2.1 time: 0.193761 Sep 13 18:10:31.294433 dv-cinder-852009-8-iscsi devstack@n-api.service[120741]: [pid: 120741|app: 0|req: 392/794] 10.222.0.43 () {58 vars in 1416 bytes} [Tue Sep 13 18:10:31 2022] DELETE /compute/v2.1/servers/fee345c8-9135-4695-9164-ae5dbec8c25a/os-volume_attachments/faf1225a-e101-4a26-be03-ef237dbda3b7 => generated 0 bytes in 196 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Sep 13 18:10:32.416797 dv-cinder-852009-8-iscsi devstack@n-api.service[120740]: DEBUG dbcounter [-] [120740] Writing DB stats nova_api:SELECT=1 {{(pid=120740) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 18:10:32.417562 dv-cinder-852009-8-iscsi devstack@n-api.service[120740]: DEBUG dbcounter [-] [120740] Writing DB stats nova_cell1:SELECT=10,nova_cell1:UPDATE=2,nova_cell1:INSERT=1 {{(pid=120740) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 18:10:32.421960 dv-cinder-852009-8-iscsi devstack@n-api.service[120740]: DEBUG nova.api.openstack.wsgi [None req-f204c92e-0f85-445e-8acf-92fd4a5682d5 tempest-VolumesSnapshotTestJSON-1753826991 tempest-VolumesSnapshotTestJSON-1753826991-project] Calling method '>' {{(pid=120740) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 18:10:32.422540 dv-cinder-852009-8-iscsi devstack@n-api.service[120740]: DEBUG nova.compute.api [None req-f204c92e-0f85-445e-8acf-92fd4a5682d5 tempest-VolumesSnapshotTestJSON-1753826991 tempest-VolumesSnapshotTestJSON-1753826991-project] [instance: fee345c8-9135-4695-9164-ae5dbec8c25a] Fetching instance by UUID {{(pid=120740) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 18:10:32.430043 dv-cinder-852009-8-iscsi devstack@n-api.service[120740]: DEBUG oslo_concurrency.lockutils [None req-f204c92e-0f85-445e-8acf-92fd4a5682d5 tempest-VolumesSnapshotTestJSON-1753826991 tempest-VolumesSnapshotTestJSON-1753826991-project] Acquiring lock "1daf4f4c-0e4a-4779-b53a-78c48397ea2f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120740) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 18:10:32.430519 dv-cinder-852009-8-iscsi devstack@n-api.service[120740]: DEBUG oslo_concurrency.lockutils [None req-f204c92e-0f85-445e-8acf-92fd4a5682d5 tempest-VolumesSnapshotTestJSON-1753826991 tempest-VolumesSnapshotTestJSON-1753826991-project] Lock "1daf4f4c-0e4a-4779-b53a-78c48397ea2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120740) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 18:10:32.430959 dv-cinder-852009-8-iscsi devstack@n-api.service[120740]: DEBUG oslo_concurrency.lockutils [None req-f204c92e-0f85-445e-8acf-92fd4a5682d5 tempest-VolumesSnapshotTestJSON-1753826991 tempest-VolumesSnapshotTestJSON-1753826991-project] Lock "1daf4f4c-0e4a-4779-b53a-78c48397ea2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120740) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 18:10:32.431640 dv-cinder-852009-8-iscsi devstack@n-api.service[120740]: DEBUG oslo_concurrency.lockutils [None req-f204c92e-0f85-445e-8acf-92fd4a5682d5 tempest-VolumesSnapshotTestJSON-1753826991 tempest-VolumesSnapshotTestJSON-1753826991-project] Acquiring lock "1daf4f4c-0e4a-4779-b53a-78c48397ea2f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120740) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 18:10:32.432086 dv-cinder-852009-8-iscsi devstack@n-api.service[120740]: DEBUG oslo_concurrency.lockutils [None req-f204c92e-0f85-445e-8acf-92fd4a5682d5 tempest-VolumesSnapshotTestJSON-1753826991 tempest-VolumesSnapshotTestJSON-1753826991-project] Lock "1daf4f4c-0e4a-4779-b53a-78c48397ea2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120740) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 18:10:32.432524 dv-cinder-852009-8-iscsi devstack@n-api.service[120740]: DEBUG oslo_concurrency.lockutils [None req-f204c92e-0f85-445e-8acf-92fd4a5682d5 tempest-VolumesSnapshotTestJSON-1753826991 tempest-VolumesSnapshotTestJSON-1753826991-project] Lock "1daf4f4c-0e4a-4779-b53a-78c48397ea2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120740) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 18:10:32.460613 dv-cinder-852009-8-iscsi devstack@n-api.service[120740]: DEBUG nova.compute.api [None req-f204c92e-0f85-445e-8acf-92fd4a5682d5 tempest-VolumesSnapshotTestJSON-1753826991 tempest-VolumesSnapshotTestJSON-1753826991-project] [instance: fee345c8-9135-4695-9164-ae5dbec8c25a] Going to try to terminate instance {{(pid=120740) delete /opt/stack/nova/nova/compute/api.py:2719}} Sep 13 18:10:32.541051 dv-cinder-852009-8-iscsi devstack@n-api.service[120740]: INFO nova.api.openstack.requestlog [None req-f204c92e-0f85-445e-8acf-92fd4a5682d5 tempest-VolumesSnapshotTestJSON-1753826991 tempest-VolumesSnapshotTestJSON-1753826991-project] 10.222.0.43 "DELETE /compute/v2.1/servers/fee345c8-9135-4695-9164-ae5dbec8c25a" status: 204 len: 0 microversion: 2.1 time: 0.126058 Sep 13 18:10:32.541649 dv-cinder-852009-8-iscsi devstack@n-api.service[120740]: [pid: 120740|app: 0|req: 403/795] 10.222.0.43 () {58 vars in 1239 bytes} [Tue Sep 13 18:10:32 2022] DELETE /compute/v2.1/servers/fee345c8-9135-4695-9164-ae5dbec8c25a => generated 0 bytes in 128 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Sep 13 18:10:32.551088 dv-cinder-852009-8-iscsi devstack@n-api.service[120741]: DEBUG nova.api.openstack.wsgi [None req-6f0caa71-d2cf-447a-9541-59ab5db2c4e7 tempest-VolumesSnapshotTestJSON-1753826991 tempest-VolumesSnapshotTestJSON-1753826991-project] Calling method '>' {{(pid=120741) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 18:10:32.551758 dv-cinder-852009-8-iscsi devstack@n-api.service[120741]: DEBUG nova.compute.api [None req-6f0caa71-d2cf-447a-9541-59ab5db2c4e7 tempest-VolumesSnapshotTestJSON-1753826991 tempest-VolumesSnapshotTestJSON-1753826991-project] [instance: fee345c8-9135-4695-9164-ae5dbec8c25a] Fetching instance by UUID {{(pid=120741) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 18:10:32.558421 dv-cinder-852009-8-iscsi devstack@n-api.service[120741]: DEBUG oslo_concurrency.lockutils [None req-6f0caa71-d2cf-447a-9541-59ab5db2c4e7 tempest-VolumesSnapshotTestJSON-1753826991 tempest-VolumesSnapshotTestJSON-1753826991-project] Acquiring lock "1daf4f4c-0e4a-4779-b53a-78c48397ea2f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120741) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 18:10:32.558901 dv-cinder-852009-8-iscsi devstack@n-api.service[120741]: DEBUG oslo_concurrency.lockutils [None req-6f0caa71-d2cf-447a-9541-59ab5db2c4e7 tempest-VolumesSnapshotTestJSON-1753826991 tempest-VolumesSnapshotTestJSON-1753826991-project] Lock "1daf4f4c-0e4a-4779-b53a-78c48397ea2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120741) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 18:10:32.559324 dv-cinder-852009-8-iscsi devstack@n-api.service[120741]: DEBUG oslo_concurrency.lockutils [None req-6f0caa71-d2cf-447a-9541-59ab5db2c4e7 tempest-VolumesSnapshotTestJSON-1753826991 tempest-VolumesSnapshotTestJSON-1753826991-project] Lock "1daf4f4c-0e4a-4779-b53a-78c48397ea2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120741) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 18:10:32.560008 dv-cinder-852009-8-iscsi devstack@n-api.service[120741]: DEBUG oslo_concurrency.lockutils [None req-6f0caa71-d2cf-447a-9541-59ab5db2c4e7 tempest-VolumesSnapshotTestJSON-1753826991 tempest-VolumesSnapshotTestJSON-1753826991-project] Acquiring lock "1daf4f4c-0e4a-4779-b53a-78c48397ea2f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120741) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 18:10:32.560472 dv-cinder-852009-8-iscsi devstack@n-api.service[120741]: DEBUG oslo_concurrency.lockutils [None req-6f0caa71-d2cf-447a-9541-59ab5db2c4e7 tempest-VolumesSnapshotTestJSON-1753826991 tempest-VolumesSnapshotTestJSON-1753826991-project] Lock "1daf4f4c-0e4a-4779-b53a-78c48397ea2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120741) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 18:10:32.560891 dv-cinder-852009-8-iscsi devstack@n-api.service[120741]: DEBUG oslo_concurrency.lockutils [None req-6f0caa71-d2cf-447a-9541-59ab5db2c4e7 tempest-VolumesSnapshotTestJSON-1753826991 tempest-VolumesSnapshotTestJSON-1753826991-project] Lock "1daf4f4c-0e4a-4779-b53a-78c48397ea2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120741) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 18:10:32.700462 dv-cinder-852009-8-iscsi devstack@n-api.service[120741]: DEBUG nova.policy [None req-6f0caa71-d2cf-447a-9541-59ab5db2c4e7 tempest-VolumesSnapshotTestJSON-1753826991 tempest-VolumesSnapshotTestJSON-1753826991-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f379ce3f38fc41568493be7493e75736', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1271ab6e6c9b4c93b05aafddbdbf9afe', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120741) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 18:10:32.708313 dv-cinder-852009-8-iscsi devstack@n-api.service[120741]: INFO nova.api.openstack.requestlog [None req-6f0caa71-d2cf-447a-9541-59ab5db2c4e7 tempest-VolumesSnapshotTestJSON-1753826991 tempest-VolumesSnapshotTestJSON-1753826991-project] 10.222.0.43 "GET /compute/v2.1/servers/fee345c8-9135-4695-9164-ae5dbec8c25a" status: 200 len: 1512 microversion: 2.1 time: 0.162007 Sep 13 18:10:32.708886 dv-cinder-852009-8-iscsi devstack@n-api.service[120741]: [pid: 120741|app: 0|req: 393/796] 10.222.0.43 () {58 vars in 1236 bytes} [Tue Sep 13 18:10:32 2022] GET /compute/v2.1/servers/fee345c8-9135-4695-9164-ae5dbec8c25a => generated 1512 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 13 18:10:33.736889 dv-cinder-852009-8-iscsi devstack@n-api.service[120740]: DEBUG nova.api.openstack.wsgi [None req-aaadad0e-cde9-479e-890c-0fb0ec1e616a tempest-VolumesSnapshotTestJSON-1753826991 tempest-VolumesSnapshotTestJSON-1753826991-project] Calling method '>' {{(pid=120740) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 18:10:33.737597 dv-cinder-852009-8-iscsi devstack@n-api.service[120740]: DEBUG nova.compute.api [None req-aaadad0e-cde9-479e-890c-0fb0ec1e616a tempest-VolumesSnapshotTestJSON-1753826991 tempest-VolumesSnapshotTestJSON-1753826991-project] [instance: fee345c8-9135-4695-9164-ae5dbec8c25a] Fetching instance by UUID {{(pid=120740) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 18:10:33.746940 dv-cinder-852009-8-iscsi devstack@n-api.service[120740]: DEBUG oslo_concurrency.lockutils [None req-aaadad0e-cde9-479e-890c-0fb0ec1e616a tempest-VolumesSnapshotTestJSON-1753826991 tempest-VolumesSnapshotTestJSON-1753826991-project] Acquiring lock "1daf4f4c-0e4a-4779-b53a-78c48397ea2f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120740) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 18:10:33.747619 dv-cinder-852009-8-iscsi devstack@n-api.service[120740]: DEBUG oslo_concurrency.lockutils [None req-aaadad0e-cde9-479e-890c-0fb0ec1e616a tempest-VolumesSnapshotTestJSON-1753826991 tempest-VolumesSnapshotTestJSON-1753826991-project] Lock "1daf4f4c-0e4a-4779-b53a-78c48397ea2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120740) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 18:10:33.748238 dv-cinder-852009-8-iscsi devstack@n-api.service[120740]: DEBUG oslo_concurrency.lockutils [None req-aaadad0e-cde9-479e-890c-0fb0ec1e616a tempest-VolumesSnapshotTestJSON-1753826991 tempest-VolumesSnapshotTestJSON-1753826991-project] Lock "1daf4f4c-0e4a-4779-b53a-78c48397ea2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120740) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 18:10:33.749260 dv-cinder-852009-8-iscsi devstack@n-api.service[120740]: DEBUG oslo_concurrency.lockutils [None req-aaadad0e-cde9-479e-890c-0fb0ec1e616a tempest-VolumesSnapshotTestJSON-1753826991 tempest-VolumesSnapshotTestJSON-1753826991-project] Acquiring lock "1daf4f4c-0e4a-4779-b53a-78c48397ea2f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120740) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 18:10:33.749896 dv-cinder-852009-8-iscsi devstack@n-api.service[120740]: DEBUG oslo_concurrency.lockutils [None req-aaadad0e-cde9-479e-890c-0fb0ec1e616a tempest-VolumesSnapshotTestJSON-1753826991 tempest-VolumesSnapshotTestJSON-1753826991-project] Lock "1daf4f4c-0e4a-4779-b53a-78c48397ea2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120740) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 18:10:33.750497 dv-cinder-852009-8-iscsi devstack@n-api.service[120740]: DEBUG oslo_concurrency.lockutils [None req-aaadad0e-cde9-479e-890c-0fb0ec1e616a tempest-VolumesSnapshotTestJSON-1753826991 tempest-VolumesSnapshotTestJSON-1753826991-project] Lock "1daf4f4c-0e4a-4779-b53a-78c48397ea2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120740) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 18:10:33.884043 dv-cinder-852009-8-iscsi devstack@n-api.service[120740]: DEBUG nova.policy [None req-aaadad0e-cde9-479e-890c-0fb0ec1e616a tempest-VolumesSnapshotTestJSON-1753826991 tempest-VolumesSnapshotTestJSON-1753826991-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f379ce3f38fc41568493be7493e75736', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1271ab6e6c9b4c93b05aafddbdbf9afe', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120740) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 18:10:33.893542 dv-cinder-852009-8-iscsi devstack@n-api.service[120740]: INFO nova.api.openstack.requestlog [None req-aaadad0e-cde9-479e-890c-0fb0ec1e616a tempest-VolumesSnapshotTestJSON-1753826991 tempest-VolumesSnapshotTestJSON-1753826991-project] 10.222.0.43 "GET /compute/v2.1/servers/fee345c8-9135-4695-9164-ae5dbec8c25a" status: 200 len: 1512 microversion: 2.1 time: 0.163086 Sep 13 18:10:33.894129 dv-cinder-852009-8-iscsi devstack@n-api.service[120740]: [pid: 120740|app: 0|req: 404/797] 10.222.0.43 () {58 vars in 1236 bytes} [Tue Sep 13 18:10:33 2022] GET /compute/v2.1/servers/fee345c8-9135-4695-9164-ae5dbec8c25a => generated 1512 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 13 18:10:34.707997 dv-cinder-852009-8-iscsi devstack@n-api.service[120741]: DEBUG nova.api.openstack.wsgi [req-0b2abb56-ed92-4b0f-b421-631194e551f2 req-3919179d-c8d8-47ef-977c-3d1d952b4dac service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "fee345c8-9135-4695-9164-ae5dbec8c25a", "name": "network-vif-deleted", "tag": "a718647a-eef3-4710-ba86-75b348efd497"}]} {{(pid=120741) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 13 18:10:34.718388 dv-cinder-852009-8-iscsi devstack@n-api.service[120741]: DEBUG oslo_concurrency.lockutils [req-0b2abb56-ed92-4b0f-b421-631194e551f2 req-3919179d-c8d8-47ef-977c-3d1d952b4dac service nova] Acquiring lock "1daf4f4c-0e4a-4779-b53a-78c48397ea2f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120741) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 18:10:34.718849 dv-cinder-852009-8-iscsi devstack@n-api.service[120741]: DEBUG oslo_concurrency.lockutils [req-0b2abb56-ed92-4b0f-b421-631194e551f2 req-3919179d-c8d8-47ef-977c-3d1d952b4dac service nova] Lock "1daf4f4c-0e4a-4779-b53a-78c48397ea2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120741) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 18:10:34.719276 dv-cinder-852009-8-iscsi devstack@n-api.service[120741]: DEBUG oslo_concurrency.lockutils [req-0b2abb56-ed92-4b0f-b421-631194e551f2 req-3919179d-c8d8-47ef-977c-3d1d952b4dac service nova] Lock "1daf4f4c-0e4a-4779-b53a-78c48397ea2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120741) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 18:10:34.731155 dv-cinder-852009-8-iscsi devstack@n-api.service[120741]: INFO nova.api.openstack.compute.server_external_events [req-0b2abb56-ed92-4b0f-b421-631194e551f2 req-3919179d-c8d8-47ef-977c-3d1d952b4dac service nova] Creating event network-vif-deleted:a718647a-eef3-4710-ba86-75b348efd497 for instance fee345c8-9135-4695-9164-ae5dbec8c25a on hv-cinder-85200 Sep 13 18:10:34.736386 dv-cinder-852009-8-iscsi devstack@n-api.service[120741]: INFO nova.api.openstack.requestlog [req-0b2abb56-ed92-4b0f-b421-631194e551f2 req-3919179d-c8d8-47ef-977c-3d1d952b4dac service nova] 10.222.0.43 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.032031 Sep 13 18:10:34.737029 dv-cinder-852009-8-iscsi devstack@n-api.service[120741]: [pid: 120741|app: 0|req: 394/798] 10.222.0.43 () {64 vars in 1317 bytes} [Tue Sep 13 18:10:34 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 34 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 13 18:10:34.917423 dv-cinder-852009-8-iscsi devstack@n-api.service[120740]: DEBUG nova.api.openstack.wsgi [None req-c9f1f5ac-a0f5-44c6-9947-fa6549c2860b tempest-VolumesSnapshotTestJSON-1753826991 tempest-VolumesSnapshotTestJSON-1753826991-project] Calling method '>' {{(pid=120740) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 18:10:34.918029 dv-cinder-852009-8-iscsi devstack@n-api.service[120740]: DEBUG nova.compute.api [None req-c9f1f5ac-a0f5-44c6-9947-fa6549c2860b tempest-VolumesSnapshotTestJSON-1753826991 tempest-VolumesSnapshotTestJSON-1753826991-project] [instance: fee345c8-9135-4695-9164-ae5dbec8c25a] Fetching instance by UUID {{(pid=120740) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 18:10:34.924484 dv-cinder-852009-8-iscsi devstack@n-api.service[120740]: DEBUG oslo_concurrency.lockutils [None req-c9f1f5ac-a0f5-44c6-9947-fa6549c2860b tempest-VolumesSnapshotTestJSON-1753826991 tempest-VolumesSnapshotTestJSON-1753826991-project] Acquiring lock "1daf4f4c-0e4a-4779-b53a-78c48397ea2f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120740) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 18:10:34.924970 dv-cinder-852009-8-iscsi devstack@n-api.service[120740]: DEBUG oslo_concurrency.lockutils [None req-c9f1f5ac-a0f5-44c6-9947-fa6549c2860b tempest-VolumesSnapshotTestJSON-1753826991 tempest-VolumesSnapshotTestJSON-1753826991-project] Lock "1daf4f4c-0e4a-4779-b53a-78c48397ea2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120740) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 18:10:34.925402 dv-cinder-852009-8-iscsi devstack@n-api.service[120740]: DEBUG oslo_concurrency.lockutils [None req-c9f1f5ac-a0f5-44c6-9947-fa6549c2860b tempest-VolumesSnapshotTestJSON-1753826991 tempest-VolumesSnapshotTestJSON-1753826991-project] Lock "1daf4f4c-0e4a-4779-b53a-78c48397ea2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120740) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 18:10:34.926081 dv-cinder-852009-8-iscsi devstack@n-api.service[120740]: DEBUG oslo_concurrency.lockutils [None req-c9f1f5ac-a0f5-44c6-9947-fa6549c2860b tempest-VolumesSnapshotTestJSON-1753826991 tempest-VolumesSnapshotTestJSON-1753826991-project] Acquiring lock "1daf4f4c-0e4a-4779-b53a-78c48397ea2f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120740) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 18:10:34.926539 dv-cinder-852009-8-iscsi devstack@n-api.service[120740]: DEBUG oslo_concurrency.lockutils [None req-c9f1f5ac-a0f5-44c6-9947-fa6549c2860b tempest-VolumesSnapshotTestJSON-1753826991 tempest-VolumesSnapshotTestJSON-1753826991-project] Lock "1daf4f4c-0e4a-4779-b53a-78c48397ea2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120740) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 18:10:34.926933 dv-cinder-852009-8-iscsi devstack@n-api.service[120740]: DEBUG oslo_concurrency.lockutils [None req-c9f1f5ac-a0f5-44c6-9947-fa6549c2860b tempest-VolumesSnapshotTestJSON-1753826991 tempest-VolumesSnapshotTestJSON-1753826991-project] Lock "1daf4f4c-0e4a-4779-b53a-78c48397ea2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120740) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 18:10:34.957736 dv-cinder-852009-8-iscsi devstack@n-api.service[120740]: DEBUG oslo_concurrency.lockutils [None req-c9f1f5ac-a0f5-44c6-9947-fa6549c2860b tempest-VolumesSnapshotTestJSON-1753826991 tempest-VolumesSnapshotTestJSON-1753826991-project] Acquiring lock "1daf4f4c-0e4a-4779-b53a-78c48397ea2f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120740) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 18:10:34.958243 dv-cinder-852009-8-iscsi devstack@n-api.service[120740]: DEBUG oslo_concurrency.lockutils [None req-c9f1f5ac-a0f5-44c6-9947-fa6549c2860b tempest-VolumesSnapshotTestJSON-1753826991 tempest-VolumesSnapshotTestJSON-1753826991-project] Lock "1daf4f4c-0e4a-4779-b53a-78c48397ea2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120740) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 18:10:34.958606 dv-cinder-852009-8-iscsi devstack@n-api.service[120740]: DEBUG oslo_concurrency.lockutils [None req-c9f1f5ac-a0f5-44c6-9947-fa6549c2860b tempest-VolumesSnapshotTestJSON-1753826991 tempest-VolumesSnapshotTestJSON-1753826991-project] Lock "1daf4f4c-0e4a-4779-b53a-78c48397ea2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120740) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 18:10:34.959039 dv-cinder-852009-8-iscsi devstack@n-api.service[120740]: DEBUG nova.objects.instance [None req-c9f1f5ac-a0f5-44c6-9947-fa6549c2860b tempest-VolumesSnapshotTestJSON-1753826991 tempest-VolumesSnapshotTestJSON-1753826991-project] Lazy-loading 'fault' on Instance uuid fee345c8-9135-4695-9164-ae5dbec8c25a {{(pid=120740) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Sep 13 18:10:35.004179 dv-cinder-852009-8-iscsi devstack@n-api.service[120740]: DEBUG nova.policy [None req-c9f1f5ac-a0f5-44c6-9947-fa6549c2860b tempest-VolumesSnapshotTestJSON-1753826991 tempest-VolumesSnapshotTestJSON-1753826991-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f379ce3f38fc41568493be7493e75736', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1271ab6e6c9b4c93b05aafddbdbf9afe', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120740) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 18:10:35.012108 dv-cinder-852009-8-iscsi devstack@n-api.service[120740]: INFO nova.api.openstack.requestlog [None req-c9f1f5ac-a0f5-44c6-9947-fa6549c2860b tempest-VolumesSnapshotTestJSON-1753826991 tempest-VolumesSnapshotTestJSON-1753826991-project] 10.222.0.43 "GET /compute/v2.1/servers/fee345c8-9135-4695-9164-ae5dbec8c25a" status: 200 len: 1308 microversion: 2.1 time: 0.098613 Sep 13 18:10:35.012682 dv-cinder-852009-8-iscsi devstack@n-api.service[120740]: [pid: 120740|app: 0|req: 405/799] 10.222.0.43 () {58 vars in 1236 bytes} [Tue Sep 13 18:10:34 2022] GET /compute/v2.1/servers/fee345c8-9135-4695-9164-ae5dbec8c25a => generated 1308 bytes in 100 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 13 18:10:36.041140 dv-cinder-852009-8-iscsi devstack@n-api.service[120741]: DEBUG nova.api.openstack.wsgi [None req-3583803c-bf4e-40cd-93c0-a540ce69aeb5 tempest-VolumesSnapshotTestJSON-1753826991 tempest-VolumesSnapshotTestJSON-1753826991-project] Calling method '>' {{(pid=120741) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 18:10:36.042286 dv-cinder-852009-8-iscsi devstack@n-api.service[120741]: DEBUG nova.compute.api [None req-3583803c-bf4e-40cd-93c0-a540ce69aeb5 tempest-VolumesSnapshotTestJSON-1753826991 tempest-VolumesSnapshotTestJSON-1753826991-project] [instance: fee345c8-9135-4695-9164-ae5dbec8c25a] Fetching instance by UUID {{(pid=120741) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 18:10:36.049225 dv-cinder-852009-8-iscsi devstack@n-api.service[120741]: DEBUG oslo_concurrency.lockutils [None req-3583803c-bf4e-40cd-93c0-a540ce69aeb5 tempest-VolumesSnapshotTestJSON-1753826991 tempest-VolumesSnapshotTestJSON-1753826991-project] Acquiring lock "1daf4f4c-0e4a-4779-b53a-78c48397ea2f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120741) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 18:10:36.049725 dv-cinder-852009-8-iscsi devstack@n-api.service[120741]: DEBUG oslo_concurrency.lockutils [None req-3583803c-bf4e-40cd-93c0-a540ce69aeb5 tempest-VolumesSnapshotTestJSON-1753826991 tempest-VolumesSnapshotTestJSON-1753826991-project] Lock "1daf4f4c-0e4a-4779-b53a-78c48397ea2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120741) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 18:10:36.050188 dv-cinder-852009-8-iscsi devstack@n-api.service[120741]: DEBUG oslo_concurrency.lockutils [None req-3583803c-bf4e-40cd-93c0-a540ce69aeb5 tempest-VolumesSnapshotTestJSON-1753826991 tempest-VolumesSnapshotTestJSON-1753826991-project] Lock "1daf4f4c-0e4a-4779-b53a-78c48397ea2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120741) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 18:10:36.050911 dv-cinder-852009-8-iscsi devstack@n-api.service[120741]: DEBUG oslo_concurrency.lockutils [None req-3583803c-bf4e-40cd-93c0-a540ce69aeb5 tempest-VolumesSnapshotTestJSON-1753826991 tempest-VolumesSnapshotTestJSON-1753826991-project] Acquiring lock "1daf4f4c-0e4a-4779-b53a-78c48397ea2f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120741) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 18:10:36.051370 dv-cinder-852009-8-iscsi devstack@n-api.service[120741]: DEBUG oslo_concurrency.lockutils [None req-3583803c-bf4e-40cd-93c0-a540ce69aeb5 tempest-VolumesSnapshotTestJSON-1753826991 tempest-VolumesSnapshotTestJSON-1753826991-project] Lock "1daf4f4c-0e4a-4779-b53a-78c48397ea2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120741) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 18:10:36.051790 dv-cinder-852009-8-iscsi devstack@n-api.service[120741]: DEBUG oslo_concurrency.lockutils [None req-3583803c-bf4e-40cd-93c0-a540ce69aeb5 tempest-VolumesSnapshotTestJSON-1753826991 tempest-VolumesSnapshotTestJSON-1753826991-project] Lock "1daf4f4c-0e4a-4779-b53a-78c48397ea2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120741) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 18:10:36.072026 dv-cinder-852009-8-iscsi devstack@n-api.service[120741]: INFO nova.api.openstack.wsgi [None req-3583803c-bf4e-40cd-93c0-a540ce69aeb5 tempest-VolumesSnapshotTestJSON-1753826991 tempest-VolumesSnapshotTestJSON-1753826991-project] HTTP exception thrown: Instance fee345c8-9135-4695-9164-ae5dbec8c25a could not be found. Sep 13 18:10:36.074410 dv-cinder-852009-8-iscsi devstack@n-api.service[120741]: DEBUG nova.api.openstack.wsgi [None req-3583803c-bf4e-40cd-93c0-a540ce69aeb5 tempest-VolumesSnapshotTestJSON-1753826991 tempest-VolumesSnapshotTestJSON-1753826991-project] Request method failure captured: Sep 13 18:10:36.074410 dv-cinder-852009-8-iscsi devstack@n-api.service[120741]: request: GET /compute/v2.1/servers/fee345c8-9135-4695-9164-ae5dbec8c25a HTTP/1.1 Sep 13 18:10:36.074410 dv-cinder-852009-8-iscsi devstack@n-api.service[120741]: Accept: application/json Sep 13 18:10:36.074410 dv-cinder-852009-8-iscsi devstack@n-api.service[120741]: Accept-Encoding: identity Sep 13 18:10:36.074410 dv-cinder-852009-8-iscsi devstack@n-api.service[120741]: Connection: close Sep 13 18:10:36.074410 dv-cinder-852009-8-iscsi devstack@n-api.service[120741]: Content-Length: 0 Sep 13 18:10:36.074410 dv-cinder-852009-8-iscsi devstack@n-api.service[120741]: Content-Type: application/json Sep 13 18:10:36.074410 dv-cinder-852009-8-iscsi devstack@n-api.service[120741]: Host: 10.222.0.43 Sep 13 18:10:36.074410 dv-cinder-852009-8-iscsi devstack@n-api.service[120741]: Openstack-System-Scope: None Sep 13 18:10:36.074410 dv-cinder-852009-8-iscsi devstack@n-api.service[120741]: User-Agent: python-urllib3/1.26.12 Sep 13 18:10:36.074410 dv-cinder-852009-8-iscsi devstack@n-api.service[120741]: X-Auth-Token: gAAAAABjIMc9u3JWOVQRO_PZplbBVSAng20bosEyqjXay_6XkiDTqaSfsjTyQyz4fI14Dsyk9Wy6VsWU9rrzMuADvTWZ0FTg8li9ukjuRJ6WcKqm2qjdY2iMI9z33xyju26Bd2dz2Uc3fcmsAciv6Ht3FQN8scDWeXC7445Fhk09XlgqWAno8nw Sep 13 18:10:36.074410 dv-cinder-852009-8-iscsi devstack@n-api.service[120741]: X-Domain-Id: None Sep 13 18:10:36.074410 dv-cinder-852009-8-iscsi devstack@n-api.service[120741]: X-Domain-Name: None Sep 13 18:10:36.074410 dv-cinder-852009-8-iscsi devstack@n-api.service[120741]: X-Identity-Status: Confirmed Sep 13 18:10:36.074410 dv-cinder-852009-8-iscsi devstack@n-api.service[120741]: X-Is-Admin-Project: True Sep 13 18:10:36.074410 dv-cinder-852009-8-iscsi devstack@n-api.service[120741]: X-Project-Domain-Id: default Sep 13 18:10:36.074410 dv-cinder-852009-8-iscsi devstack@n-api.service[120741]: X-Project-Domain-Name: Default Sep 13 18:10:36.074410 dv-cinder-852009-8-iscsi devstack@n-api.service[120741]: X-Project-Id: 1271ab6e6c9b4c93b05aafddbdbf9afe Sep 13 18:10:36.074410 dv-cinder-852009-8-iscsi devstack@n-api.service[120741]: X-Project-Name: tempest-VolumesSnapshotTestJSON-1753826991 Sep 13 18:10:36.074410 dv-cinder-852009-8-iscsi devstack@n-api.service[120741]: X-Role: reader,member Sep 13 18:10:36.074410 dv-cinder-852009-8-iscsi devstack@n-api.service[120741]: X-Roles: reader,member Sep 13 18:10:36.076016 dv-cinder-852009-8-iscsi devstack@n-api.service[120741]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/identity"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/compute/v2/1271ab6e6c9b4c93b05aafddbdbf9afe"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.43:8080", "publicURL": "http://10.222.0.43:8080/v1/AUTH_1271ab6e6c9b4c93b05aafddbdbf9afe"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43:9696/networking"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/volume/v3/1271ab6e6c9b4c93b05aafddbdbf9afe"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/compute/v2.1"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/placement"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/volume/v3/1271ab6e6c9b4c93b05aafddbdbf9afe"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/image"}]}] Sep 13 18:10:36.076016 dv-cinder-852009-8-iscsi devstack@n-api.service[120741]: X-Tenant: tempest-VolumesSnapshotTestJSON-1753826991 Sep 13 18:10:36.076016 dv-cinder-852009-8-iscsi devstack@n-api.service[120741]: X-Tenant-Id: 1271ab6e6c9b4c93b05aafddbdbf9afe Sep 13 18:10:36.076016 dv-cinder-852009-8-iscsi devstack@n-api.service[120741]: X-Tenant-Name: tempest-VolumesSnapshotTestJSON-1753826991 Sep 13 18:10:36.076016 dv-cinder-852009-8-iscsi devstack@n-api.service[120741]: X-User: tempest-VolumesSnapshotTestJSON-1753826991-project Sep 13 18:10:36.076016 dv-cinder-852009-8-iscsi devstack@n-api.service[120741]: X-User-Domain-Id: default Sep 13 18:10:36.076016 dv-cinder-852009-8-iscsi devstack@n-api.service[120741]: X-User-Domain-Name: Default Sep 13 18:10:36.076016 dv-cinder-852009-8-iscsi devstack@n-api.service[120741]: X-User-Id: f379ce3f38fc41568493be7493e75736 Sep 13 18:10:36.076016 dv-cinder-852009-8-iscsi devstack@n-api.service[120741]: X-User-Name: tempest-VolumesSnapshotTestJSON-1753826991-project Sep 13 18:10:36.076016 dv-cinder-852009-8-iscsi devstack@n-api.service[120741]: method: > Sep 13 18:10:36.076016 dv-cinder-852009-8-iscsi devstack@n-api.service[120741]: exception: Instance fee345c8-9135-4695-9164-ae5dbec8c25a could not be found. Sep 13 18:10:36.076016 dv-cinder-852009-8-iscsi devstack@n-api.service[120741]: action_args: {'id': 'fee345c8-9135-4695-9164-ae5dbec8c25a'} Sep 13 18:10:36.077024 dv-cinder-852009-8-iscsi devstack@n-api.service[120741]: {{(pid=120741) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 13 18:10:36.077024 dv-cinder-852009-8-iscsi devstack@n-api.service[120741]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 13 18:10:36.077024 dv-cinder-852009-8-iscsi devstack@n-api.service[120741]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Sep 13 18:10:36.077024 dv-cinder-852009-8-iscsi devstack@n-api.service[120741]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Sep 13 18:10:36.077024 dv-cinder-852009-8-iscsi devstack@n-api.service[120741]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Sep 13 18:10:36.077024 dv-cinder-852009-8-iscsi devstack@n-api.service[120741]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Sep 13 18:10:36.077024 dv-cinder-852009-8-iscsi devstack@n-api.service[120741]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Sep 13 18:10:36.077024 dv-cinder-852009-8-iscsi devstack@n-api.service[120741]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Sep 13 18:10:36.077024 dv-cinder-852009-8-iscsi devstack@n-api.service[120741]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Sep 13 18:10:36.077024 dv-cinder-852009-8-iscsi devstack@n-api.service[120741]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Sep 13 18:10:36.077024 dv-cinder-852009-8-iscsi devstack@n-api.service[120741]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance fee345c8-9135-4695-9164-ae5dbec8c25a could not be found. Sep 13 18:10:36.077024 dv-cinder-852009-8-iscsi devstack@n-api.service[120741]: ERROR nova.api.openstack.wsgi Sep 13 18:10:36.077024 dv-cinder-852009-8-iscsi devstack@n-api.service[120741]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 13 18:10:36.077024 dv-cinder-852009-8-iscsi devstack@n-api.service[120741]: ERROR nova.api.openstack.wsgi Sep 13 18:10:36.077024 dv-cinder-852009-8-iscsi devstack@n-api.service[120741]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 13 18:10:36.077024 dv-cinder-852009-8-iscsi devstack@n-api.service[120741]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 13 18:10:36.077024 dv-cinder-852009-8-iscsi devstack@n-api.service[120741]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 13 18:10:36.077024 dv-cinder-852009-8-iscsi devstack@n-api.service[120741]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 13 18:10:36.077024 dv-cinder-852009-8-iscsi devstack@n-api.service[120741]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 13 18:10:36.077024 dv-cinder-852009-8-iscsi devstack@n-api.service[120741]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 13 18:10:36.078802 dv-cinder-852009-8-iscsi devstack@n-api.service[120741]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 13 18:10:36.078802 dv-cinder-852009-8-iscsi devstack@n-api.service[120741]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Sep 13 18:10:36.078802 dv-cinder-852009-8-iscsi devstack@n-api.service[120741]: ERROR nova.api.openstack.wsgi instance = self._get_server( Sep 13 18:10:36.078802 dv-cinder-852009-8-iscsi devstack@n-api.service[120741]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Sep 13 18:10:36.078802 dv-cinder-852009-8-iscsi devstack@n-api.service[120741]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Sep 13 18:10:36.078802 dv-cinder-852009-8-iscsi devstack@n-api.service[120741]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Sep 13 18:10:36.078802 dv-cinder-852009-8-iscsi devstack@n-api.service[120741]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Sep 13 18:10:36.078802 dv-cinder-852009-8-iscsi devstack@n-api.service[120741]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance fee345c8-9135-4695-9164-ae5dbec8c25a could not be found. Sep 13 18:10:36.078802 dv-cinder-852009-8-iscsi devstack@n-api.service[120741]: ERROR nova.api.openstack.wsgi Sep 13 18:10:36.078802 dv-cinder-852009-8-iscsi devstack@n-api.service[120741]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 13 18:10:36.078802 dv-cinder-852009-8-iscsi devstack@n-api.service[120741]: ERROR nova.api.openstack.wsgi Sep 13 18:10:36.078802 dv-cinder-852009-8-iscsi devstack@n-api.service[120741]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 13 18:10:36.078802 dv-cinder-852009-8-iscsi devstack@n-api.service[120741]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 13 18:10:36.078802 dv-cinder-852009-8-iscsi devstack@n-api.service[120741]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 13 18:10:36.078802 dv-cinder-852009-8-iscsi devstack@n-api.service[120741]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 13 18:10:36.078802 dv-cinder-852009-8-iscsi devstack@n-api.service[120741]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 13 18:10:36.078802 dv-cinder-852009-8-iscsi devstack@n-api.service[120741]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance fee345c8-9135-4695-9164-ae5dbec8c25a could not be found. Sep 13 18:10:36.078802 dv-cinder-852009-8-iscsi devstack@n-api.service[120741]: ERROR nova.api.openstack.wsgi Sep 13 18:10:36.080166 dv-cinder-852009-8-iscsi devstack@n-api.service[120741]: DEBUG nova.api.openstack.wsgi [None req-3583803c-bf4e-40cd-93c0-a540ce69aeb5 tempest-VolumesSnapshotTestJSON-1753826991 tempest-VolumesSnapshotTestJSON-1753826991-project] Returning 404 to user: Instance fee345c8-9135-4695-9164-ae5dbec8c25a could not be found. {{(pid=120741) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 13 18:10:36.080166 dv-cinder-852009-8-iscsi devstack@n-api.service[120741]: INFO nova.api.openstack.requestlog [None req-3583803c-bf4e-40cd-93c0-a540ce69aeb5 tempest-VolumesSnapshotTestJSON-1753826991 tempest-VolumesSnapshotTestJSON-1753826991-project] 10.222.0.43 "GET /compute/v2.1/servers/fee345c8-9135-4695-9164-ae5dbec8c25a" status: 404 len: 111 microversion: 2.1 time: 0.042588 Sep 13 18:10:36.080166 dv-cinder-852009-8-iscsi devstack@n-api.service[120741]: [pid: 120741|app: 0|req: 395/800] 10.222.0.43 () {58 vars in 1236 bytes} [Tue Sep 13 18:10:36 2022] GET /compute/v2.1/servers/fee345c8-9135-4695-9164-ae5dbec8c25a => generated 111 bytes in 44 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Sep 13 18:10:38.270338 dv-cinder-852009-8-iscsi devstack@n-api.service[120740]: DEBUG nova.api.openstack.wsgi [None req-f7d0138f-6e34-444a-9988-590d4c1df46f tempest-AttachVolumeNegativeTest-1378806597 tempest-AttachVolumeNegativeTest-1378806597-project] Calling method '>' {{(pid=120740) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 18:10:38.270853 dv-cinder-852009-8-iscsi devstack@n-api.service[120740]: DEBUG nova.compute.api [None req-f7d0138f-6e34-444a-9988-590d4c1df46f tempest-AttachVolumeNegativeTest-1378806597 tempest-AttachVolumeNegativeTest-1378806597-project] [instance: b6be21a8-a1fd-44ff-9fca-88e979974510] Fetching instance by UUID {{(pid=120740) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 18:10:38.277588 dv-cinder-852009-8-iscsi devstack@n-api.service[120740]: DEBUG oslo_concurrency.lockutils [None req-f7d0138f-6e34-444a-9988-590d4c1df46f tempest-AttachVolumeNegativeTest-1378806597 tempest-AttachVolumeNegativeTest-1378806597-project] Acquiring lock "1daf4f4c-0e4a-4779-b53a-78c48397ea2f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120740) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 18:10:38.278066 dv-cinder-852009-8-iscsi devstack@n-api.service[120740]: DEBUG oslo_concurrency.lockutils [None req-f7d0138f-6e34-444a-9988-590d4c1df46f tempest-AttachVolumeNegativeTest-1378806597 tempest-AttachVolumeNegativeTest-1378806597-project] Lock "1daf4f4c-0e4a-4779-b53a-78c48397ea2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120740) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 18:10:38.278490 dv-cinder-852009-8-iscsi devstack@n-api.service[120740]: DEBUG oslo_concurrency.lockutils [None req-f7d0138f-6e34-444a-9988-590d4c1df46f tempest-AttachVolumeNegativeTest-1378806597 tempest-AttachVolumeNegativeTest-1378806597-project] Lock "1daf4f4c-0e4a-4779-b53a-78c48397ea2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120740) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 18:10:38.279171 dv-cinder-852009-8-iscsi devstack@n-api.service[120740]: DEBUG oslo_concurrency.lockutils [None req-f7d0138f-6e34-444a-9988-590d4c1df46f tempest-AttachVolumeNegativeTest-1378806597 tempest-AttachVolumeNegativeTest-1378806597-project] Acquiring lock "1daf4f4c-0e4a-4779-b53a-78c48397ea2f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120740) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 18:10:38.279644 dv-cinder-852009-8-iscsi devstack@n-api.service[120740]: DEBUG oslo_concurrency.lockutils [None req-f7d0138f-6e34-444a-9988-590d4c1df46f tempest-AttachVolumeNegativeTest-1378806597 tempest-AttachVolumeNegativeTest-1378806597-project] Lock "1daf4f4c-0e4a-4779-b53a-78c48397ea2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120740) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 18:10:38.280056 dv-cinder-852009-8-iscsi devstack@n-api.service[120740]: DEBUG oslo_concurrency.lockutils [None req-f7d0138f-6e34-444a-9988-590d4c1df46f tempest-AttachVolumeNegativeTest-1378806597 tempest-AttachVolumeNegativeTest-1378806597-project] Lock "1daf4f4c-0e4a-4779-b53a-78c48397ea2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120740) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 18:10:38.303074 dv-cinder-852009-8-iscsi devstack@n-api.service[120740]: INFO nova.api.openstack.requestlog [None req-f7d0138f-6e34-444a-9988-590d4c1df46f tempest-AttachVolumeNegativeTest-1378806597 tempest-AttachVolumeNegativeTest-1378806597-project] 10.222.0.43 "GET /compute/v2.1/servers/b6be21a8-a1fd-44ff-9fca-88e979974510/ips" status: 200 len: 149 microversion: 2.1 time: 0.036717 Sep 13 18:10:38.303640 dv-cinder-852009-8-iscsi devstack@n-api.service[120740]: [pid: 120740|app: 0|req: 406/801] 10.222.0.43 () {58 vars in 1248 bytes} [Tue Sep 13 18:10:38 2022] GET /compute/v2.1/servers/b6be21a8-a1fd-44ff-9fca-88e979974510/ips => generated 149 bytes in 38 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 13 18:10:38.315698 dv-cinder-852009-8-iscsi devstack@n-api.service[120741]: DEBUG nova.api.openstack.wsgi [None req-ec7d94c1-1c29-4b1e-93b7-9901985ff46d tempest-AttachVolumeNegativeTest-1378806597 tempest-AttachVolumeNegativeTest-1378806597-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "e32c0df2-e306-4d0e-a551-0fbeaed724e7"}} {{(pid=120741) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 13 18:10:38.318175 dv-cinder-852009-8-iscsi devstack@n-api.service[120741]: DEBUG nova.compute.api [None req-ec7d94c1-1c29-4b1e-93b7-9901985ff46d tempest-AttachVolumeNegativeTest-1378806597 tempest-AttachVolumeNegativeTest-1378806597-project] [instance: b6be21a8-a1fd-44ff-9fca-88e979974510] Fetching instance by UUID {{(pid=120741) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 18:10:38.325069 dv-cinder-852009-8-iscsi devstack@n-api.service[120741]: DEBUG oslo_concurrency.lockutils [None req-ec7d94c1-1c29-4b1e-93b7-9901985ff46d tempest-AttachVolumeNegativeTest-1378806597 tempest-AttachVolumeNegativeTest-1378806597-project] Acquiring lock "1daf4f4c-0e4a-4779-b53a-78c48397ea2f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120741) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 18:10:38.325543 dv-cinder-852009-8-iscsi devstack@n-api.service[120741]: DEBUG oslo_concurrency.lockutils [None req-ec7d94c1-1c29-4b1e-93b7-9901985ff46d tempest-AttachVolumeNegativeTest-1378806597 tempest-AttachVolumeNegativeTest-1378806597-project] Lock "1daf4f4c-0e4a-4779-b53a-78c48397ea2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120741) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 18:10:38.325970 dv-cinder-852009-8-iscsi devstack@n-api.service[120741]: DEBUG oslo_concurrency.lockutils [None req-ec7d94c1-1c29-4b1e-93b7-9901985ff46d tempest-AttachVolumeNegativeTest-1378806597 tempest-AttachVolumeNegativeTest-1378806597-project] Lock "1daf4f4c-0e4a-4779-b53a-78c48397ea2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120741) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 18:10:38.326695 dv-cinder-852009-8-iscsi devstack@n-api.service[120741]: DEBUG oslo_concurrency.lockutils [None req-ec7d94c1-1c29-4b1e-93b7-9901985ff46d tempest-AttachVolumeNegativeTest-1378806597 tempest-AttachVolumeNegativeTest-1378806597-project] Acquiring lock "1daf4f4c-0e4a-4779-b53a-78c48397ea2f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120741) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 18:10:38.327147 dv-cinder-852009-8-iscsi devstack@n-api.service[120741]: DEBUG oslo_concurrency.lockutils [None req-ec7d94c1-1c29-4b1e-93b7-9901985ff46d tempest-AttachVolumeNegativeTest-1378806597 tempest-AttachVolumeNegativeTest-1378806597-project] Lock "1daf4f4c-0e4a-4779-b53a-78c48397ea2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120741) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 18:10:38.327577 dv-cinder-852009-8-iscsi devstack@n-api.service[120741]: DEBUG oslo_concurrency.lockutils [None req-ec7d94c1-1c29-4b1e-93b7-9901985ff46d tempest-AttachVolumeNegativeTest-1378806597 tempest-AttachVolumeNegativeTest-1378806597-project] Lock "1daf4f4c-0e4a-4779-b53a-78c48397ea2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120741) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 18:10:38.412637 dv-cinder-852009-8-iscsi devstack@n-api.service[120741]: INFO nova.api.openstack.wsgi [None req-ec7d94c1-1c29-4b1e-93b7-9901985ff46d tempest-AttachVolumeNegativeTest-1378806597 tempest-AttachVolumeNegativeTest-1378806597-project] HTTP exception thrown: Invalid volume: volume e32c0df2-e306-4d0e-a551-0fbeaed724e7 is already attached to instances: 75289327-97d1-42bd-a6c7-6f2b1aa3236a Sep 13 18:10:38.414548 dv-cinder-852009-8-iscsi devstack@n-api.service[120741]: DEBUG nova.api.openstack.wsgi [None req-ec7d94c1-1c29-4b1e-93b7-9901985ff46d tempest-AttachVolumeNegativeTest-1378806597 tempest-AttachVolumeNegativeTest-1378806597-project] Request method failure captured: Sep 13 18:10:38.414548 dv-cinder-852009-8-iscsi devstack@n-api.service[120741]: request: POST /compute/v2.1/servers/b6be21a8-a1fd-44ff-9fca-88e979974510/os-volume_attachments HTTP/1.1 Sep 13 18:10:38.414548 dv-cinder-852009-8-iscsi devstack@n-api.service[120741]: Accept: application/json Sep 13 18:10:38.414548 dv-cinder-852009-8-iscsi devstack@n-api.service[120741]: Accept-Encoding: identity Sep 13 18:10:38.414548 dv-cinder-852009-8-iscsi devstack@n-api.service[120741]: Connection: close Sep 13 18:10:38.414548 dv-cinder-852009-8-iscsi devstack@n-api.service[120741]: Content-Length: 74 Sep 13 18:10:38.414548 dv-cinder-852009-8-iscsi devstack@n-api.service[120741]: Content-Type: application/json Sep 13 18:10:38.414548 dv-cinder-852009-8-iscsi devstack@n-api.service[120741]: Host: 10.222.0.43 Sep 13 18:10:38.414548 dv-cinder-852009-8-iscsi devstack@n-api.service[120741]: Openstack-System-Scope: None Sep 13 18:10:38.414548 dv-cinder-852009-8-iscsi devstack@n-api.service[120741]: User-Agent: python-urllib3/1.26.12 Sep 13 18:10:38.414548 dv-cinder-852009-8-iscsi devstack@n-api.service[120741]: X-Auth-Token: gAAAAABjIMciYi08KSU35iQHMuJ1d9BLU6OdnvTV0lQhD4NCYaw8no8S5_0xWB47N9lmu7akofQLpLV68heC7pPUCZsTXqIq6Y42WLp6VXHhyQNxgHSYkPKRLV6tG6CCOIlPDetRfNDVZw3BkXYviJ38fOivAdsSaqCGCQ-A5bO5QGkWPiqoF58 Sep 13 18:10:38.414548 dv-cinder-852009-8-iscsi devstack@n-api.service[120741]: X-Domain-Id: None Sep 13 18:10:38.414548 dv-cinder-852009-8-iscsi devstack@n-api.service[120741]: X-Domain-Name: None Sep 13 18:10:38.414548 dv-cinder-852009-8-iscsi devstack@n-api.service[120741]: X-Identity-Status: Confirmed Sep 13 18:10:38.414548 dv-cinder-852009-8-iscsi devstack@n-api.service[120741]: X-Is-Admin-Project: True Sep 13 18:10:38.414548 dv-cinder-852009-8-iscsi devstack@n-api.service[120741]: X-Project-Domain-Id: default Sep 13 18:10:38.414548 dv-cinder-852009-8-iscsi devstack@n-api.service[120741]: X-Project-Domain-Name: Default Sep 13 18:10:38.414548 dv-cinder-852009-8-iscsi devstack@n-api.service[120741]: X-Project-Id: 629311eda0584a5fbb7d8995cf27540c Sep 13 18:10:38.414548 dv-cinder-852009-8-iscsi devstack@n-api.service[120741]: X-Project-Name: tempest-AttachVolumeNegativeTest-1378806597 Sep 13 18:10:38.414548 dv-cinder-852009-8-iscsi devstack@n-api.service[120741]: X-Role: reader,member Sep 13 18:10:38.414548 dv-cinder-852009-8-iscsi devstack@n-api.service[120741]: X-Roles: reader,member Sep 13 18:10:38.416204 dv-cinder-852009-8-iscsi devstack@n-api.service[120741]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/identity"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/compute/v2/629311eda0584a5fbb7d8995cf27540c"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.43:8080", "publicURL": "http://10.222.0.43:8080/v1/AUTH_629311eda0584a5fbb7d8995cf27540c"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43:9696/networking"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/volume/v3/629311eda0584a5fbb7d8995cf27540c"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/compute/v2.1"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/placement"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/volume/v3/629311eda0584a5fbb7d8995cf27540c"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/image"}]}] Sep 13 18:10:38.416204 dv-cinder-852009-8-iscsi devstack@n-api.service[120741]: X-Tenant: tempest-AttachVolumeNegativeTest-1378806597 Sep 13 18:10:38.416204 dv-cinder-852009-8-iscsi devstack@n-api.service[120741]: X-Tenant-Id: 629311eda0584a5fbb7d8995cf27540c Sep 13 18:10:38.416204 dv-cinder-852009-8-iscsi devstack@n-api.service[120741]: X-Tenant-Name: tempest-AttachVolumeNegativeTest-1378806597 Sep 13 18:10:38.416204 dv-cinder-852009-8-iscsi devstack@n-api.service[120741]: X-User: tempest-AttachVolumeNegativeTest-1378806597-project Sep 13 18:10:38.416204 dv-cinder-852009-8-iscsi devstack@n-api.service[120741]: X-User-Domain-Id: default Sep 13 18:10:38.416204 dv-cinder-852009-8-iscsi devstack@n-api.service[120741]: X-User-Domain-Name: Default Sep 13 18:10:38.416204 dv-cinder-852009-8-iscsi devstack@n-api.service[120741]: X-User-Id: 714cd09ba19b492f9a8c80343abcf6b9 Sep 13 18:10:38.416204 dv-cinder-852009-8-iscsi devstack@n-api.service[120741]: X-User-Name: tempest-AttachVolumeNegativeTest-1378806597-project Sep 13 18:10:38.416204 dv-cinder-852009-8-iscsi devstack@n-api.service[120741]: Sep 13 18:10:38.416204 dv-cinder-852009-8-iscsi devstack@n-api.service[120741]: {"volumeAttachment": {"volumeId": "e32c0df2-e306-4d0e-a551-0fbeaed724e7"}} Sep 13 18:10:38.416204 dv-cinder-852009-8-iscsi devstack@n-api.service[120741]: method: > Sep 13 18:10:38.417189 dv-cinder-852009-8-iscsi devstack@n-api.service[120741]: exception: Invalid volume: volume e32c0df2-e306-4d0e-a551-0fbeaed724e7 is already attached to instances: 75289327-97d1-42bd-a6c7-6f2b1aa3236a Sep 13 18:10:38.417189 dv-cinder-852009-8-iscsi devstack@n-api.service[120741]: action_args: {'server_id': 'b6be21a8-a1fd-44ff-9fca-88e979974510', 'body': {'volumeAttachment': {'volumeId': 'e32c0df2-e306-4d0e-a551-0fbeaed724e7'}}} Sep 13 18:10:38.417189 dv-cinder-852009-8-iscsi devstack@n-api.service[120741]: {{(pid=120741) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 13 18:10:38.417189 dv-cinder-852009-8-iscsi devstack@n-api.service[120741]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 13 18:10:38.417189 dv-cinder-852009-8-iscsi devstack@n-api.service[120741]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 388, in create Sep 13 18:10:38.417189 dv-cinder-852009-8-iscsi devstack@n-api.service[120741]: ERROR nova.api.openstack.wsgi device = self.compute_api.attach_volume( Sep 13 18:10:38.417189 dv-cinder-852009-8-iscsi devstack@n-api.service[120741]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 241, in inner Sep 13 18:10:38.417189 dv-cinder-852009-8-iscsi devstack@n-api.service[120741]: ERROR nova.api.openstack.wsgi return function(self, context, instance, *args, **kwargs) Sep 13 18:10:38.417189 dv-cinder-852009-8-iscsi devstack@n-api.service[120741]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 167, in inner Sep 13 18:10:38.417189 dv-cinder-852009-8-iscsi devstack@n-api.service[120741]: ERROR nova.api.openstack.wsgi return f(self, context, instance, *args, **kw) Sep 13 18:10:38.417189 dv-cinder-852009-8-iscsi devstack@n-api.service[120741]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 5130, in attach_volume Sep 13 18:10:38.417189 dv-cinder-852009-8-iscsi devstack@n-api.service[120741]: ERROR nova.api.openstack.wsgi self._check_volume_already_attached(context, instance, volume) Sep 13 18:10:38.417189 dv-cinder-852009-8-iscsi devstack@n-api.service[120741]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 4970, in _check_volume_already_attached Sep 13 18:10:38.417189 dv-cinder-852009-8-iscsi devstack@n-api.service[120741]: ERROR nova.api.openstack.wsgi raise exception.InvalidVolume(reason=msg) Sep 13 18:10:38.417189 dv-cinder-852009-8-iscsi devstack@n-api.service[120741]: ERROR nova.api.openstack.wsgi nova.exception.InvalidVolume: Invalid volume: volume e32c0df2-e306-4d0e-a551-0fbeaed724e7 is already attached to instances: 75289327-97d1-42bd-a6c7-6f2b1aa3236a Sep 13 18:10:38.417189 dv-cinder-852009-8-iscsi devstack@n-api.service[120741]: ERROR nova.api.openstack.wsgi Sep 13 18:10:38.417189 dv-cinder-852009-8-iscsi devstack@n-api.service[120741]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 13 18:10:38.417189 dv-cinder-852009-8-iscsi devstack@n-api.service[120741]: ERROR nova.api.openstack.wsgi Sep 13 18:10:38.417189 dv-cinder-852009-8-iscsi devstack@n-api.service[120741]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 13 18:10:38.419169 dv-cinder-852009-8-iscsi devstack@n-api.service[120741]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 13 18:10:38.419169 dv-cinder-852009-8-iscsi devstack@n-api.service[120741]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 13 18:10:38.419169 dv-cinder-852009-8-iscsi devstack@n-api.service[120741]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 13 18:10:38.419169 dv-cinder-852009-8-iscsi devstack@n-api.service[120741]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 13 18:10:38.419169 dv-cinder-852009-8-iscsi devstack@n-api.service[120741]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 13 18:10:38.419169 dv-cinder-852009-8-iscsi devstack@n-api.service[120741]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 13 18:10:38.419169 dv-cinder-852009-8-iscsi devstack@n-api.service[120741]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Sep 13 18:10:38.419169 dv-cinder-852009-8-iscsi devstack@n-api.service[120741]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Sep 13 18:10:38.419169 dv-cinder-852009-8-iscsi devstack@n-api.service[120741]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Sep 13 18:10:38.419169 dv-cinder-852009-8-iscsi devstack@n-api.service[120741]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Sep 13 18:10:38.419169 dv-cinder-852009-8-iscsi devstack@n-api.service[120741]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Sep 13 18:10:38.419169 dv-cinder-852009-8-iscsi devstack@n-api.service[120741]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Sep 13 18:10:38.419169 dv-cinder-852009-8-iscsi devstack@n-api.service[120741]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 406, in create Sep 13 18:10:38.419169 dv-cinder-852009-8-iscsi devstack@n-api.service[120741]: ERROR nova.api.openstack.wsgi raise exc.HTTPBadRequest(explanation=e.format_message()) Sep 13 18:10:38.419169 dv-cinder-852009-8-iscsi devstack@n-api.service[120741]: ERROR nova.api.openstack.wsgi webob.exc.HTTPBadRequest: Invalid volume: volume e32c0df2-e306-4d0e-a551-0fbeaed724e7 is already attached to instances: 75289327-97d1-42bd-a6c7-6f2b1aa3236a Sep 13 18:10:38.419169 dv-cinder-852009-8-iscsi devstack@n-api.service[120741]: ERROR nova.api.openstack.wsgi Sep 13 18:10:38.419169 dv-cinder-852009-8-iscsi devstack@n-api.service[120741]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 13 18:10:38.419169 dv-cinder-852009-8-iscsi devstack@n-api.service[120741]: ERROR nova.api.openstack.wsgi Sep 13 18:10:38.419169 dv-cinder-852009-8-iscsi devstack@n-api.service[120741]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 13 18:10:38.419169 dv-cinder-852009-8-iscsi devstack@n-api.service[120741]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 13 18:10:38.420639 dv-cinder-852009-8-iscsi devstack@n-api.service[120741]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 13 18:10:38.420639 dv-cinder-852009-8-iscsi devstack@n-api.service[120741]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 13 18:10:38.420639 dv-cinder-852009-8-iscsi devstack@n-api.service[120741]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 13 18:10:38.420639 dv-cinder-852009-8-iscsi devstack@n-api.service[120741]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Invalid volume: volume e32c0df2-e306-4d0e-a551-0fbeaed724e7 is already attached to instances: 75289327-97d1-42bd-a6c7-6f2b1aa3236a Sep 13 18:10:38.420639 dv-cinder-852009-8-iscsi devstack@n-api.service[120741]: ERROR nova.api.openstack.wsgi Sep 13 18:10:38.420639 dv-cinder-852009-8-iscsi devstack@n-api.service[120741]: DEBUG nova.api.openstack.wsgi [None req-ec7d94c1-1c29-4b1e-93b7-9901985ff46d tempest-AttachVolumeNegativeTest-1378806597 tempest-AttachVolumeNegativeTest-1378806597-project] Returning 400 to user: Invalid volume: volume e32c0df2-e306-4d0e-a551-0fbeaed724e7 is already attached to instances: 75289327-97d1-42bd-a6c7-6f2b1aa3236a {{(pid=120741) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 13 18:10:38.420639 dv-cinder-852009-8-iscsi devstack@n-api.service[120741]: INFO nova.api.openstack.requestlog [None req-ec7d94c1-1c29-4b1e-93b7-9901985ff46d tempest-AttachVolumeNegativeTest-1378806597 tempest-AttachVolumeNegativeTest-1378806597-project] 10.222.0.43 "POST /compute/v2.1/servers/b6be21a8-a1fd-44ff-9fca-88e979974510/os-volume_attachments" status: 400 len: 174 microversion: 2.1 time: 0.104392 Sep 13 18:10:38.420639 dv-cinder-852009-8-iscsi devstack@n-api.service[120741]: [pid: 120741|app: 0|req: 396/802] 10.222.0.43 () {60 vars in 1323 bytes} [Tue Sep 13 18:10:38 2022] POST /compute/v2.1/servers/b6be21a8-a1fd-44ff-9fca-88e979974510/os-volume_attachments => generated 174 bytes in 105 msecs (HTTP/1.1 400) 9 headers in 381 bytes (1 switches on core 0) Sep 13 18:10:38.424971 dv-cinder-852009-8-iscsi devstack@n-api.service[120740]: DEBUG nova.api.openstack.wsgi [None req-dd38bf01-d697-4ab6-8528-96fab510615f tempest-AttachVolumeNegativeTest-1378806597 tempest-AttachVolumeNegativeTest-1378806597-project] Calling method '>' {{(pid=120740) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 18:10:38.425457 dv-cinder-852009-8-iscsi devstack@n-api.service[120740]: DEBUG nova.compute.api [None req-dd38bf01-d697-4ab6-8528-96fab510615f tempest-AttachVolumeNegativeTest-1378806597 tempest-AttachVolumeNegativeTest-1378806597-project] [instance: b6be21a8-a1fd-44ff-9fca-88e979974510] Fetching instance by UUID {{(pid=120740) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 18:10:38.432057 dv-cinder-852009-8-iscsi devstack@n-api.service[120740]: DEBUG oslo_concurrency.lockutils [None req-dd38bf01-d697-4ab6-8528-96fab510615f tempest-AttachVolumeNegativeTest-1378806597 tempest-AttachVolumeNegativeTest-1378806597-project] Acquiring lock "1daf4f4c-0e4a-4779-b53a-78c48397ea2f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120740) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 18:10:38.432605 dv-cinder-852009-8-iscsi devstack@n-api.service[120740]: DEBUG oslo_concurrency.lockutils [None req-dd38bf01-d697-4ab6-8528-96fab510615f tempest-AttachVolumeNegativeTest-1378806597 tempest-AttachVolumeNegativeTest-1378806597-project] Lock "1daf4f4c-0e4a-4779-b53a-78c48397ea2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120740) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 18:10:38.433036 dv-cinder-852009-8-iscsi devstack@n-api.service[120740]: DEBUG oslo_concurrency.lockutils [None req-dd38bf01-d697-4ab6-8528-96fab510615f tempest-AttachVolumeNegativeTest-1378806597 tempest-AttachVolumeNegativeTest-1378806597-project] Lock "1daf4f4c-0e4a-4779-b53a-78c48397ea2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120740) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 18:10:38.433735 dv-cinder-852009-8-iscsi devstack@n-api.service[120740]: DEBUG oslo_concurrency.lockutils [None req-dd38bf01-d697-4ab6-8528-96fab510615f tempest-AttachVolumeNegativeTest-1378806597 tempest-AttachVolumeNegativeTest-1378806597-project] Acquiring lock "1daf4f4c-0e4a-4779-b53a-78c48397ea2f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120740) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 18:10:38.434177 dv-cinder-852009-8-iscsi devstack@n-api.service[120740]: DEBUG oslo_concurrency.lockutils [None req-dd38bf01-d697-4ab6-8528-96fab510615f tempest-AttachVolumeNegativeTest-1378806597 tempest-AttachVolumeNegativeTest-1378806597-project] Lock "1daf4f4c-0e4a-4779-b53a-78c48397ea2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120740) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 18:10:38.434587 dv-cinder-852009-8-iscsi devstack@n-api.service[120740]: DEBUG oslo_concurrency.lockutils [None req-dd38bf01-d697-4ab6-8528-96fab510615f tempest-AttachVolumeNegativeTest-1378806597 tempest-AttachVolumeNegativeTest-1378806597-project] Lock "1daf4f4c-0e4a-4779-b53a-78c48397ea2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120740) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 18:10:38.461128 dv-cinder-852009-8-iscsi devstack@n-api.service[120740]: DEBUG nova.compute.api [None req-dd38bf01-d697-4ab6-8528-96fab510615f tempest-AttachVolumeNegativeTest-1378806597 tempest-AttachVolumeNegativeTest-1378806597-project] [instance: b6be21a8-a1fd-44ff-9fca-88e979974510] Going to try to terminate instance {{(pid=120740) delete /opt/stack/nova/nova/compute/api.py:2719}} Sep 13 18:10:38.546777 dv-cinder-852009-8-iscsi devstack@n-api.service[120740]: INFO nova.api.openstack.requestlog [None req-dd38bf01-d697-4ab6-8528-96fab510615f tempest-AttachVolumeNegativeTest-1378806597 tempest-AttachVolumeNegativeTest-1378806597-project] 10.222.0.43 "DELETE /compute/v2.1/servers/b6be21a8-a1fd-44ff-9fca-88e979974510" status: 204 len: 0 microversion: 2.1 time: 0.125362 Sep 13 18:10:38.547565 dv-cinder-852009-8-iscsi devstack@n-api.service[120740]: [pid: 120740|app: 0|req: 407/803] 10.222.0.43 () {58 vars in 1239 bytes} [Tue Sep 13 18:10:38 2022] DELETE /compute/v2.1/servers/b6be21a8-a1fd-44ff-9fca-88e979974510 => generated 0 bytes in 127 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Sep 13 18:10:38.556192 dv-cinder-852009-8-iscsi devstack@n-api.service[120741]: DEBUG nova.api.openstack.wsgi [None req-46b1eff1-b125-4c97-aa7a-9747395caced tempest-AttachVolumeNegativeTest-1378806597 tempest-AttachVolumeNegativeTest-1378806597-project] Calling method '>' {{(pid=120741) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 18:10:38.556819 dv-cinder-852009-8-iscsi devstack@n-api.service[120741]: DEBUG nova.compute.api [None req-46b1eff1-b125-4c97-aa7a-9747395caced tempest-AttachVolumeNegativeTest-1378806597 tempest-AttachVolumeNegativeTest-1378806597-project] [instance: b6be21a8-a1fd-44ff-9fca-88e979974510] Fetching instance by UUID {{(pid=120741) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 18:10:38.563399 dv-cinder-852009-8-iscsi devstack@n-api.service[120741]: DEBUG oslo_concurrency.lockutils [None req-46b1eff1-b125-4c97-aa7a-9747395caced tempest-AttachVolumeNegativeTest-1378806597 tempest-AttachVolumeNegativeTest-1378806597-project] Acquiring lock "1daf4f4c-0e4a-4779-b53a-78c48397ea2f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120741) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 18:10:38.563872 dv-cinder-852009-8-iscsi devstack@n-api.service[120741]: DEBUG oslo_concurrency.lockutils [None req-46b1eff1-b125-4c97-aa7a-9747395caced tempest-AttachVolumeNegativeTest-1378806597 tempest-AttachVolumeNegativeTest-1378806597-project] Lock "1daf4f4c-0e4a-4779-b53a-78c48397ea2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120741) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 18:10:38.564292 dv-cinder-852009-8-iscsi devstack@n-api.service[120741]: DEBUG oslo_concurrency.lockutils [None req-46b1eff1-b125-4c97-aa7a-9747395caced tempest-AttachVolumeNegativeTest-1378806597 tempest-AttachVolumeNegativeTest-1378806597-project] Lock "1daf4f4c-0e4a-4779-b53a-78c48397ea2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120741) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 18:10:38.565002 dv-cinder-852009-8-iscsi devstack@n-api.service[120741]: DEBUG oslo_concurrency.lockutils [None req-46b1eff1-b125-4c97-aa7a-9747395caced tempest-AttachVolumeNegativeTest-1378806597 tempest-AttachVolumeNegativeTest-1378806597-project] Acquiring lock "1daf4f4c-0e4a-4779-b53a-78c48397ea2f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120741) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 18:10:38.565446 dv-cinder-852009-8-iscsi devstack@n-api.service[120741]: DEBUG oslo_concurrency.lockutils [None req-46b1eff1-b125-4c97-aa7a-9747395caced tempest-AttachVolumeNegativeTest-1378806597 tempest-AttachVolumeNegativeTest-1378806597-project] Lock "1daf4f4c-0e4a-4779-b53a-78c48397ea2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120741) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 18:10:38.565856 dv-cinder-852009-8-iscsi devstack@n-api.service[120741]: DEBUG oslo_concurrency.lockutils [None req-46b1eff1-b125-4c97-aa7a-9747395caced tempest-AttachVolumeNegativeTest-1378806597 tempest-AttachVolumeNegativeTest-1378806597-project] Lock "1daf4f4c-0e4a-4779-b53a-78c48397ea2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120741) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 18:10:38.696890 dv-cinder-852009-8-iscsi devstack@n-api.service[120741]: DEBUG nova.policy [None req-46b1eff1-b125-4c97-aa7a-9747395caced tempest-AttachVolumeNegativeTest-1378806597 tempest-AttachVolumeNegativeTest-1378806597-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '714cd09ba19b492f9a8c80343abcf6b9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '629311eda0584a5fbb7d8995cf27540c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120741) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 18:10:38.704961 dv-cinder-852009-8-iscsi devstack@n-api.service[120741]: INFO nova.api.openstack.requestlog [None req-46b1eff1-b125-4c97-aa7a-9747395caced tempest-AttachVolumeNegativeTest-1378806597 tempest-AttachVolumeNegativeTest-1378806597-project] 10.222.0.43 "GET /compute/v2.1/servers/b6be21a8-a1fd-44ff-9fca-88e979974510" status: 200 len: 1682 microversion: 2.1 time: 0.152646 Sep 13 18:10:38.705520 dv-cinder-852009-8-iscsi devstack@n-api.service[120741]: [pid: 120741|app: 0|req: 397/804] 10.222.0.43 () {58 vars in 1236 bytes} [Tue Sep 13 18:10:38 2022] GET /compute/v2.1/servers/b6be21a8-a1fd-44ff-9fca-88e979974510 => generated 1682 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 13 18:10:39.729430 dv-cinder-852009-8-iscsi devstack@n-api.service[120740]: DEBUG nova.api.openstack.wsgi [None req-c42481df-ef1c-4771-a2b6-1c018b6e3afd tempest-AttachVolumeNegativeTest-1378806597 tempest-AttachVolumeNegativeTest-1378806597-project] Calling method '>' {{(pid=120740) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 18:10:39.730268 dv-cinder-852009-8-iscsi devstack@n-api.service[120740]: DEBUG nova.compute.api [None req-c42481df-ef1c-4771-a2b6-1c018b6e3afd tempest-AttachVolumeNegativeTest-1378806597 tempest-AttachVolumeNegativeTest-1378806597-project] [instance: b6be21a8-a1fd-44ff-9fca-88e979974510] Fetching instance by UUID {{(pid=120740) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 18:10:39.737308 dv-cinder-852009-8-iscsi devstack@n-api.service[120740]: DEBUG oslo_concurrency.lockutils [None req-c42481df-ef1c-4771-a2b6-1c018b6e3afd tempest-AttachVolumeNegativeTest-1378806597 tempest-AttachVolumeNegativeTest-1378806597-project] Acquiring lock "1daf4f4c-0e4a-4779-b53a-78c48397ea2f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120740) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 18:10:39.737799 dv-cinder-852009-8-iscsi devstack@n-api.service[120740]: DEBUG oslo_concurrency.lockutils [None req-c42481df-ef1c-4771-a2b6-1c018b6e3afd tempest-AttachVolumeNegativeTest-1378806597 tempest-AttachVolumeNegativeTest-1378806597-project] Lock "1daf4f4c-0e4a-4779-b53a-78c48397ea2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120740) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 18:10:39.738232 dv-cinder-852009-8-iscsi devstack@n-api.service[120740]: DEBUG oslo_concurrency.lockutils [None req-c42481df-ef1c-4771-a2b6-1c018b6e3afd tempest-AttachVolumeNegativeTest-1378806597 tempest-AttachVolumeNegativeTest-1378806597-project] Lock "1daf4f4c-0e4a-4779-b53a-78c48397ea2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120740) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 18:10:39.738932 dv-cinder-852009-8-iscsi devstack@n-api.service[120740]: DEBUG oslo_concurrency.lockutils [None req-c42481df-ef1c-4771-a2b6-1c018b6e3afd tempest-AttachVolumeNegativeTest-1378806597 tempest-AttachVolumeNegativeTest-1378806597-project] Acquiring lock "1daf4f4c-0e4a-4779-b53a-78c48397ea2f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120740) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 18:10:39.739383 dv-cinder-852009-8-iscsi devstack@n-api.service[120740]: DEBUG oslo_concurrency.lockutils [None req-c42481df-ef1c-4771-a2b6-1c018b6e3afd tempest-AttachVolumeNegativeTest-1378806597 tempest-AttachVolumeNegativeTest-1378806597-project] Lock "1daf4f4c-0e4a-4779-b53a-78c48397ea2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120740) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 18:10:39.739803 dv-cinder-852009-8-iscsi devstack@n-api.service[120740]: DEBUG oslo_concurrency.lockutils [None req-c42481df-ef1c-4771-a2b6-1c018b6e3afd tempest-AttachVolumeNegativeTest-1378806597 tempest-AttachVolumeNegativeTest-1378806597-project] Lock "1daf4f4c-0e4a-4779-b53a-78c48397ea2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120740) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 18:10:39.872818 dv-cinder-852009-8-iscsi devstack@n-api.service[120740]: DEBUG nova.policy [None req-c42481df-ef1c-4771-a2b6-1c018b6e3afd tempest-AttachVolumeNegativeTest-1378806597 tempest-AttachVolumeNegativeTest-1378806597-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '714cd09ba19b492f9a8c80343abcf6b9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '629311eda0584a5fbb7d8995cf27540c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120740) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 18:10:39.884186 dv-cinder-852009-8-iscsi devstack@n-api.service[120740]: INFO nova.api.openstack.requestlog [None req-c42481df-ef1c-4771-a2b6-1c018b6e3afd tempest-AttachVolumeNegativeTest-1378806597 tempest-AttachVolumeNegativeTest-1378806597-project] 10.222.0.43 "GET /compute/v2.1/servers/b6be21a8-a1fd-44ff-9fca-88e979974510" status: 200 len: 1682 microversion: 2.1 time: 0.158826 Sep 13 18:10:39.884961 dv-cinder-852009-8-iscsi devstack@n-api.service[120740]: [pid: 120740|app: 0|req: 408/805] 10.222.0.43 () {58 vars in 1236 bytes} [Tue Sep 13 18:10:39 2022] GET /compute/v2.1/servers/b6be21a8-a1fd-44ff-9fca-88e979974510 => generated 1682 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 13 18:10:40.909296 dv-cinder-852009-8-iscsi devstack@n-api.service[120741]: DEBUG nova.api.openstack.wsgi [None req-35f6755a-4031-4772-881e-cb879af79568 tempest-AttachVolumeNegativeTest-1378806597 tempest-AttachVolumeNegativeTest-1378806597-project] Calling method '>' {{(pid=120741) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 18:10:40.909932 dv-cinder-852009-8-iscsi devstack@n-api.service[120741]: DEBUG nova.compute.api [None req-35f6755a-4031-4772-881e-cb879af79568 tempest-AttachVolumeNegativeTest-1378806597 tempest-AttachVolumeNegativeTest-1378806597-project] [instance: b6be21a8-a1fd-44ff-9fca-88e979974510] Fetching instance by UUID {{(pid=120741) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 18:10:40.916732 dv-cinder-852009-8-iscsi devstack@n-api.service[120741]: DEBUG oslo_concurrency.lockutils [None req-35f6755a-4031-4772-881e-cb879af79568 tempest-AttachVolumeNegativeTest-1378806597 tempest-AttachVolumeNegativeTest-1378806597-project] Acquiring lock "1daf4f4c-0e4a-4779-b53a-78c48397ea2f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120741) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 18:10:40.917373 dv-cinder-852009-8-iscsi devstack@n-api.service[120741]: DEBUG oslo_concurrency.lockutils [None req-35f6755a-4031-4772-881e-cb879af79568 tempest-AttachVolumeNegativeTest-1378806597 tempest-AttachVolumeNegativeTest-1378806597-project] Lock "1daf4f4c-0e4a-4779-b53a-78c48397ea2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120741) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 18:10:40.917849 dv-cinder-852009-8-iscsi devstack@n-api.service[120741]: DEBUG oslo_concurrency.lockutils [None req-35f6755a-4031-4772-881e-cb879af79568 tempest-AttachVolumeNegativeTest-1378806597 tempest-AttachVolumeNegativeTest-1378806597-project] Lock "1daf4f4c-0e4a-4779-b53a-78c48397ea2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120741) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 18:10:40.918807 dv-cinder-852009-8-iscsi devstack@n-api.service[120741]: DEBUG oslo_concurrency.lockutils [None req-35f6755a-4031-4772-881e-cb879af79568 tempest-AttachVolumeNegativeTest-1378806597 tempest-AttachVolumeNegativeTest-1378806597-project] Acquiring lock "1daf4f4c-0e4a-4779-b53a-78c48397ea2f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120741) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 18:10:40.919284 dv-cinder-852009-8-iscsi devstack@n-api.service[120741]: DEBUG oslo_concurrency.lockutils [None req-35f6755a-4031-4772-881e-cb879af79568 tempest-AttachVolumeNegativeTest-1378806597 tempest-AttachVolumeNegativeTest-1378806597-project] Lock "1daf4f4c-0e4a-4779-b53a-78c48397ea2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120741) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 18:10:40.919901 dv-cinder-852009-8-iscsi devstack@n-api.service[120741]: DEBUG oslo_concurrency.lockutils [None req-35f6755a-4031-4772-881e-cb879af79568 tempest-AttachVolumeNegativeTest-1378806597 tempest-AttachVolumeNegativeTest-1378806597-project] Lock "1daf4f4c-0e4a-4779-b53a-78c48397ea2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120741) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 18:10:41.051152 dv-cinder-852009-8-iscsi devstack@n-api.service[120741]: DEBUG nova.policy [None req-35f6755a-4031-4772-881e-cb879af79568 tempest-AttachVolumeNegativeTest-1378806597 tempest-AttachVolumeNegativeTest-1378806597-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '714cd09ba19b492f9a8c80343abcf6b9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '629311eda0584a5fbb7d8995cf27540c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120741) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 18:10:41.060564 dv-cinder-852009-8-iscsi devstack@n-api.service[120741]: INFO nova.api.openstack.requestlog [None req-35f6755a-4031-4772-881e-cb879af79568 tempest-AttachVolumeNegativeTest-1378806597 tempest-AttachVolumeNegativeTest-1378806597-project] 10.222.0.43 "GET /compute/v2.1/servers/b6be21a8-a1fd-44ff-9fca-88e979974510" status: 200 len: 1682 microversion: 2.1 time: 0.155042 Sep 13 18:10:41.065076 dv-cinder-852009-8-iscsi devstack@n-api.service[120741]: [pid: 120741|app: 0|req: 398/806] 10.222.0.43 () {58 vars in 1236 bytes} [Tue Sep 13 18:10:40 2022] GET /compute/v2.1/servers/b6be21a8-a1fd-44ff-9fca-88e979974510 => generated 1682 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 13 18:10:42.087698 dv-cinder-852009-8-iscsi devstack@n-api.service[120740]: DEBUG nova.api.openstack.wsgi [None req-02809978-e892-434f-ac50-3bd732480f36 tempest-AttachVolumeNegativeTest-1378806597 tempest-AttachVolumeNegativeTest-1378806597-project] Calling method '>' {{(pid=120740) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 18:10:42.088903 dv-cinder-852009-8-iscsi devstack@n-api.service[120740]: DEBUG nova.compute.api [None req-02809978-e892-434f-ac50-3bd732480f36 tempest-AttachVolumeNegativeTest-1378806597 tempest-AttachVolumeNegativeTest-1378806597-project] [instance: b6be21a8-a1fd-44ff-9fca-88e979974510] Fetching instance by UUID {{(pid=120740) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 18:10:42.095543 dv-cinder-852009-8-iscsi devstack@n-api.service[120740]: DEBUG oslo_concurrency.lockutils [None req-02809978-e892-434f-ac50-3bd732480f36 tempest-AttachVolumeNegativeTest-1378806597 tempest-AttachVolumeNegativeTest-1378806597-project] Acquiring lock "1daf4f4c-0e4a-4779-b53a-78c48397ea2f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120740) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 18:10:42.096338 dv-cinder-852009-8-iscsi devstack@n-api.service[120740]: DEBUG oslo_concurrency.lockutils [None req-02809978-e892-434f-ac50-3bd732480f36 tempest-AttachVolumeNegativeTest-1378806597 tempest-AttachVolumeNegativeTest-1378806597-project] Lock "1daf4f4c-0e4a-4779-b53a-78c48397ea2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120740) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 18:10:42.096797 dv-cinder-852009-8-iscsi devstack@n-api.service[120740]: DEBUG oslo_concurrency.lockutils [None req-02809978-e892-434f-ac50-3bd732480f36 tempest-AttachVolumeNegativeTest-1378806597 tempest-AttachVolumeNegativeTest-1378806597-project] Lock "1daf4f4c-0e4a-4779-b53a-78c48397ea2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120740) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 18:10:42.097502 dv-cinder-852009-8-iscsi devstack@n-api.service[120740]: DEBUG oslo_concurrency.lockutils [None req-02809978-e892-434f-ac50-3bd732480f36 tempest-AttachVolumeNegativeTest-1378806597 tempest-AttachVolumeNegativeTest-1378806597-project] Acquiring lock "1daf4f4c-0e4a-4779-b53a-78c48397ea2f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120740) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 18:10:42.097942 dv-cinder-852009-8-iscsi devstack@n-api.service[120740]: DEBUG oslo_concurrency.lockutils [None req-02809978-e892-434f-ac50-3bd732480f36 tempest-AttachVolumeNegativeTest-1378806597 tempest-AttachVolumeNegativeTest-1378806597-project] Lock "1daf4f4c-0e4a-4779-b53a-78c48397ea2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120740) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 18:10:42.098340 dv-cinder-852009-8-iscsi devstack@n-api.service[120740]: DEBUG oslo_concurrency.lockutils [None req-02809978-e892-434f-ac50-3bd732480f36 tempest-AttachVolumeNegativeTest-1378806597 tempest-AttachVolumeNegativeTest-1378806597-project] Lock "1daf4f4c-0e4a-4779-b53a-78c48397ea2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120740) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 18:10:42.257264 dv-cinder-852009-8-iscsi devstack@n-api.service[120740]: DEBUG nova.policy [None req-02809978-e892-434f-ac50-3bd732480f36 tempest-AttachVolumeNegativeTest-1378806597 tempest-AttachVolumeNegativeTest-1378806597-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '714cd09ba19b492f9a8c80343abcf6b9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '629311eda0584a5fbb7d8995cf27540c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120740) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 18:10:42.267527 dv-cinder-852009-8-iscsi devstack@n-api.service[120740]: INFO nova.api.openstack.requestlog [None req-02809978-e892-434f-ac50-3bd732480f36 tempest-AttachVolumeNegativeTest-1378806597 tempest-AttachVolumeNegativeTest-1378806597-project] 10.222.0.43 "GET /compute/v2.1/servers/b6be21a8-a1fd-44ff-9fca-88e979974510" status: 200 len: 1682 microversion: 2.1 time: 0.183595 Sep 13 18:10:42.268937 dv-cinder-852009-8-iscsi devstack@n-api.service[120740]: [pid: 120740|app: 0|req: 409/807] 10.222.0.43 () {58 vars in 1236 bytes} [Tue Sep 13 18:10:42 2022] GET /compute/v2.1/servers/b6be21a8-a1fd-44ff-9fca-88e979974510 => generated 1682 bytes in 186 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 13 18:10:42.498598 dv-cinder-852009-8-iscsi devstack@n-api.service[120741]: DEBUG nova.api.openstack.wsgi [req-d7abc58b-247d-4804-8a09-69f99f4d0c62 req-41a9b17e-99c5-480b-b65c-14956c50e546 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "b6be21a8-a1fd-44ff-9fca-88e979974510", "name": "network-vif-deleted", "tag": "25936ca7-0cd8-4855-af50-f4d7dc68d8f0"}]} {{(pid=120741) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 13 18:10:42.510233 dv-cinder-852009-8-iscsi devstack@n-api.service[120741]: DEBUG oslo_concurrency.lockutils [req-d7abc58b-247d-4804-8a09-69f99f4d0c62 req-41a9b17e-99c5-480b-b65c-14956c50e546 service nova] Acquiring lock "1daf4f4c-0e4a-4779-b53a-78c48397ea2f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120741) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 18:10:42.510713 dv-cinder-852009-8-iscsi devstack@n-api.service[120741]: DEBUG oslo_concurrency.lockutils [req-d7abc58b-247d-4804-8a09-69f99f4d0c62 req-41a9b17e-99c5-480b-b65c-14956c50e546 service nova] Lock "1daf4f4c-0e4a-4779-b53a-78c48397ea2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120741) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 18:10:42.511135 dv-cinder-852009-8-iscsi devstack@n-api.service[120741]: DEBUG oslo_concurrency.lockutils [req-d7abc58b-247d-4804-8a09-69f99f4d0c62 req-41a9b17e-99c5-480b-b65c-14956c50e546 service nova] Lock "1daf4f4c-0e4a-4779-b53a-78c48397ea2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120741) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 18:10:42.524851 dv-cinder-852009-8-iscsi devstack@n-api.service[120741]: INFO nova.api.openstack.compute.server_external_events [req-d7abc58b-247d-4804-8a09-69f99f4d0c62 req-41a9b17e-99c5-480b-b65c-14956c50e546 service nova] Creating event network-vif-deleted:25936ca7-0cd8-4855-af50-f4d7dc68d8f0 for instance b6be21a8-a1fd-44ff-9fca-88e979974510 on hv-cinder-85200 Sep 13 18:10:42.530650 dv-cinder-852009-8-iscsi devstack@n-api.service[120741]: INFO nova.api.openstack.requestlog [req-d7abc58b-247d-4804-8a09-69f99f4d0c62 req-41a9b17e-99c5-480b-b65c-14956c50e546 service nova] 10.222.0.43 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.036396 Sep 13 18:10:42.531627 dv-cinder-852009-8-iscsi devstack@n-api.service[120741]: [pid: 120741|app: 0|req: 399/808] 10.222.0.43 () {64 vars in 1317 bytes} [Tue Sep 13 18:10:42 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 38 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 13 18:10:43.291351 dv-cinder-852009-8-iscsi devstack@n-api.service[120740]: DEBUG nova.api.openstack.wsgi [None req-f3d08b83-3b96-4706-a39a-e2d87acb865b tempest-AttachVolumeNegativeTest-1378806597 tempest-AttachVolumeNegativeTest-1378806597-project] Calling method '>' {{(pid=120740) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 18:10:43.291959 dv-cinder-852009-8-iscsi devstack@n-api.service[120740]: DEBUG nova.compute.api [None req-f3d08b83-3b96-4706-a39a-e2d87acb865b tempest-AttachVolumeNegativeTest-1378806597 tempest-AttachVolumeNegativeTest-1378806597-project] [instance: b6be21a8-a1fd-44ff-9fca-88e979974510] Fetching instance by UUID {{(pid=120740) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 18:10:43.299004 dv-cinder-852009-8-iscsi devstack@n-api.service[120740]: DEBUG oslo_concurrency.lockutils [None req-f3d08b83-3b96-4706-a39a-e2d87acb865b tempest-AttachVolumeNegativeTest-1378806597 tempest-AttachVolumeNegativeTest-1378806597-project] Acquiring lock "1daf4f4c-0e4a-4779-b53a-78c48397ea2f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120740) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 18:10:43.299485 dv-cinder-852009-8-iscsi devstack@n-api.service[120740]: DEBUG oslo_concurrency.lockutils [None req-f3d08b83-3b96-4706-a39a-e2d87acb865b tempest-AttachVolumeNegativeTest-1378806597 tempest-AttachVolumeNegativeTest-1378806597-project] Lock "1daf4f4c-0e4a-4779-b53a-78c48397ea2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120740) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 18:10:43.299914 dv-cinder-852009-8-iscsi devstack@n-api.service[120740]: DEBUG oslo_concurrency.lockutils [None req-f3d08b83-3b96-4706-a39a-e2d87acb865b tempest-AttachVolumeNegativeTest-1378806597 tempest-AttachVolumeNegativeTest-1378806597-project] Lock "1daf4f4c-0e4a-4779-b53a-78c48397ea2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120740) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 18:10:43.300641 dv-cinder-852009-8-iscsi devstack@n-api.service[120740]: DEBUG oslo_concurrency.lockutils [None req-f3d08b83-3b96-4706-a39a-e2d87acb865b tempest-AttachVolumeNegativeTest-1378806597 tempest-AttachVolumeNegativeTest-1378806597-project] Acquiring lock "1daf4f4c-0e4a-4779-b53a-78c48397ea2f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120740) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 18:10:43.301088 dv-cinder-852009-8-iscsi devstack@n-api.service[120740]: DEBUG oslo_concurrency.lockutils [None req-f3d08b83-3b96-4706-a39a-e2d87acb865b tempest-AttachVolumeNegativeTest-1378806597 tempest-AttachVolumeNegativeTest-1378806597-project] Lock "1daf4f4c-0e4a-4779-b53a-78c48397ea2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120740) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 18:10:43.301504 dv-cinder-852009-8-iscsi devstack@n-api.service[120740]: DEBUG oslo_concurrency.lockutils [None req-f3d08b83-3b96-4706-a39a-e2d87acb865b tempest-AttachVolumeNegativeTest-1378806597 tempest-AttachVolumeNegativeTest-1378806597-project] Lock "1daf4f4c-0e4a-4779-b53a-78c48397ea2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120740) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 18:10:43.315280 dv-cinder-852009-8-iscsi devstack@n-api.service[120740]: INFO nova.api.openstack.wsgi [None req-f3d08b83-3b96-4706-a39a-e2d87acb865b tempest-AttachVolumeNegativeTest-1378806597 tempest-AttachVolumeNegativeTest-1378806597-project] HTTP exception thrown: Instance b6be21a8-a1fd-44ff-9fca-88e979974510 could not be found. Sep 13 18:10:43.318136 dv-cinder-852009-8-iscsi devstack@n-api.service[120740]: DEBUG nova.api.openstack.wsgi [None req-f3d08b83-3b96-4706-a39a-e2d87acb865b tempest-AttachVolumeNegativeTest-1378806597 tempest-AttachVolumeNegativeTest-1378806597-project] Request method failure captured: Sep 13 18:10:43.318136 dv-cinder-852009-8-iscsi devstack@n-api.service[120740]: request: GET /compute/v2.1/servers/b6be21a8-a1fd-44ff-9fca-88e979974510 HTTP/1.1 Sep 13 18:10:43.318136 dv-cinder-852009-8-iscsi devstack@n-api.service[120740]: Accept: application/json Sep 13 18:10:43.318136 dv-cinder-852009-8-iscsi devstack@n-api.service[120740]: Accept-Encoding: identity Sep 13 18:10:43.318136 dv-cinder-852009-8-iscsi devstack@n-api.service[120740]: Connection: close Sep 13 18:10:43.318136 dv-cinder-852009-8-iscsi devstack@n-api.service[120740]: Content-Length: 0 Sep 13 18:10:43.318136 dv-cinder-852009-8-iscsi devstack@n-api.service[120740]: Content-Type: application/json Sep 13 18:10:43.318136 dv-cinder-852009-8-iscsi devstack@n-api.service[120740]: Host: 10.222.0.43 Sep 13 18:10:43.318136 dv-cinder-852009-8-iscsi devstack@n-api.service[120740]: Openstack-System-Scope: None Sep 13 18:10:43.318136 dv-cinder-852009-8-iscsi devstack@n-api.service[120740]: User-Agent: python-urllib3/1.26.12 Sep 13 18:10:43.318136 dv-cinder-852009-8-iscsi devstack@n-api.service[120740]: X-Auth-Token: gAAAAABjIMciYi08KSU35iQHMuJ1d9BLU6OdnvTV0lQhD4NCYaw8no8S5_0xWB47N9lmu7akofQLpLV68heC7pPUCZsTXqIq6Y42WLp6VXHhyQNxgHSYkPKRLV6tG6CCOIlPDetRfNDVZw3BkXYviJ38fOivAdsSaqCGCQ-A5bO5QGkWPiqoF58 Sep 13 18:10:43.318136 dv-cinder-852009-8-iscsi devstack@n-api.service[120740]: X-Domain-Id: None Sep 13 18:10:43.318136 dv-cinder-852009-8-iscsi devstack@n-api.service[120740]: X-Domain-Name: None Sep 13 18:10:43.318136 dv-cinder-852009-8-iscsi devstack@n-api.service[120740]: X-Identity-Status: Confirmed Sep 13 18:10:43.318136 dv-cinder-852009-8-iscsi devstack@n-api.service[120740]: X-Is-Admin-Project: True Sep 13 18:10:43.318136 dv-cinder-852009-8-iscsi devstack@n-api.service[120740]: X-Project-Domain-Id: default Sep 13 18:10:43.318136 dv-cinder-852009-8-iscsi devstack@n-api.service[120740]: X-Project-Domain-Name: Default Sep 13 18:10:43.318136 dv-cinder-852009-8-iscsi devstack@n-api.service[120740]: X-Project-Id: 629311eda0584a5fbb7d8995cf27540c Sep 13 18:10:43.318136 dv-cinder-852009-8-iscsi devstack@n-api.service[120740]: X-Project-Name: tempest-AttachVolumeNegativeTest-1378806597 Sep 13 18:10:43.318136 dv-cinder-852009-8-iscsi devstack@n-api.service[120740]: X-Role: reader,member Sep 13 18:10:43.318136 dv-cinder-852009-8-iscsi devstack@n-api.service[120740]: X-Roles: reader,member Sep 13 18:10:43.319785 dv-cinder-852009-8-iscsi devstack@n-api.service[120740]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/identity"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/compute/v2/629311eda0584a5fbb7d8995cf27540c"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.43:8080", "publicURL": "http://10.222.0.43:8080/v1/AUTH_629311eda0584a5fbb7d8995cf27540c"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43:9696/networking"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/volume/v3/629311eda0584a5fbb7d8995cf27540c"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/compute/v2.1"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/placement"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/volume/v3/629311eda0584a5fbb7d8995cf27540c"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/image"}]}] Sep 13 18:10:43.319785 dv-cinder-852009-8-iscsi devstack@n-api.service[120740]: X-Tenant: tempest-AttachVolumeNegativeTest-1378806597 Sep 13 18:10:43.319785 dv-cinder-852009-8-iscsi devstack@n-api.service[120740]: X-Tenant-Id: 629311eda0584a5fbb7d8995cf27540c Sep 13 18:10:43.319785 dv-cinder-852009-8-iscsi devstack@n-api.service[120740]: X-Tenant-Name: tempest-AttachVolumeNegativeTest-1378806597 Sep 13 18:10:43.319785 dv-cinder-852009-8-iscsi devstack@n-api.service[120740]: X-User: tempest-AttachVolumeNegativeTest-1378806597-project Sep 13 18:10:43.319785 dv-cinder-852009-8-iscsi devstack@n-api.service[120740]: X-User-Domain-Id: default Sep 13 18:10:43.319785 dv-cinder-852009-8-iscsi devstack@n-api.service[120740]: X-User-Domain-Name: Default Sep 13 18:10:43.319785 dv-cinder-852009-8-iscsi devstack@n-api.service[120740]: X-User-Id: 714cd09ba19b492f9a8c80343abcf6b9 Sep 13 18:10:43.319785 dv-cinder-852009-8-iscsi devstack@n-api.service[120740]: X-User-Name: tempest-AttachVolumeNegativeTest-1378806597-project Sep 13 18:10:43.319785 dv-cinder-852009-8-iscsi devstack@n-api.service[120740]: method: > Sep 13 18:10:43.319785 dv-cinder-852009-8-iscsi devstack@n-api.service[120740]: exception: Instance b6be21a8-a1fd-44ff-9fca-88e979974510 could not be found. Sep 13 18:10:43.319785 dv-cinder-852009-8-iscsi devstack@n-api.service[120740]: action_args: {'id': 'b6be21a8-a1fd-44ff-9fca-88e979974510'} Sep 13 18:10:43.320730 dv-cinder-852009-8-iscsi devstack@n-api.service[120740]: {{(pid=120740) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 13 18:10:43.320730 dv-cinder-852009-8-iscsi devstack@n-api.service[120740]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 13 18:10:43.320730 dv-cinder-852009-8-iscsi devstack@n-api.service[120740]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Sep 13 18:10:43.320730 dv-cinder-852009-8-iscsi devstack@n-api.service[120740]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Sep 13 18:10:43.320730 dv-cinder-852009-8-iscsi devstack@n-api.service[120740]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Sep 13 18:10:43.320730 dv-cinder-852009-8-iscsi devstack@n-api.service[120740]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Sep 13 18:10:43.320730 dv-cinder-852009-8-iscsi devstack@n-api.service[120740]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Sep 13 18:10:43.320730 dv-cinder-852009-8-iscsi devstack@n-api.service[120740]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Sep 13 18:10:43.320730 dv-cinder-852009-8-iscsi devstack@n-api.service[120740]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Sep 13 18:10:43.320730 dv-cinder-852009-8-iscsi devstack@n-api.service[120740]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Sep 13 18:10:43.320730 dv-cinder-852009-8-iscsi devstack@n-api.service[120740]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance b6be21a8-a1fd-44ff-9fca-88e979974510 could not be found. Sep 13 18:10:43.320730 dv-cinder-852009-8-iscsi devstack@n-api.service[120740]: ERROR nova.api.openstack.wsgi Sep 13 18:10:43.320730 dv-cinder-852009-8-iscsi devstack@n-api.service[120740]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 13 18:10:43.320730 dv-cinder-852009-8-iscsi devstack@n-api.service[120740]: ERROR nova.api.openstack.wsgi Sep 13 18:10:43.320730 dv-cinder-852009-8-iscsi devstack@n-api.service[120740]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 13 18:10:43.320730 dv-cinder-852009-8-iscsi devstack@n-api.service[120740]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 13 18:10:43.320730 dv-cinder-852009-8-iscsi devstack@n-api.service[120740]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 13 18:10:43.320730 dv-cinder-852009-8-iscsi devstack@n-api.service[120740]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 13 18:10:43.320730 dv-cinder-852009-8-iscsi devstack@n-api.service[120740]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 13 18:10:43.320730 dv-cinder-852009-8-iscsi devstack@n-api.service[120740]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 13 18:10:43.322209 dv-cinder-852009-8-iscsi devstack@n-api.service[120740]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 13 18:10:43.322209 dv-cinder-852009-8-iscsi devstack@n-api.service[120740]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Sep 13 18:10:43.322209 dv-cinder-852009-8-iscsi devstack@n-api.service[120740]: ERROR nova.api.openstack.wsgi instance = self._get_server( Sep 13 18:10:43.322209 dv-cinder-852009-8-iscsi devstack@n-api.service[120740]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Sep 13 18:10:43.322209 dv-cinder-852009-8-iscsi devstack@n-api.service[120740]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Sep 13 18:10:43.322209 dv-cinder-852009-8-iscsi devstack@n-api.service[120740]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Sep 13 18:10:43.322209 dv-cinder-852009-8-iscsi devstack@n-api.service[120740]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Sep 13 18:10:43.322209 dv-cinder-852009-8-iscsi devstack@n-api.service[120740]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance b6be21a8-a1fd-44ff-9fca-88e979974510 could not be found. Sep 13 18:10:43.322209 dv-cinder-852009-8-iscsi devstack@n-api.service[120740]: ERROR nova.api.openstack.wsgi Sep 13 18:10:43.322209 dv-cinder-852009-8-iscsi devstack@n-api.service[120740]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 13 18:10:43.322209 dv-cinder-852009-8-iscsi devstack@n-api.service[120740]: ERROR nova.api.openstack.wsgi Sep 13 18:10:43.322209 dv-cinder-852009-8-iscsi devstack@n-api.service[120740]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 13 18:10:43.322209 dv-cinder-852009-8-iscsi devstack@n-api.service[120740]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 13 18:10:43.322209 dv-cinder-852009-8-iscsi devstack@n-api.service[120740]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 13 18:10:43.322209 dv-cinder-852009-8-iscsi devstack@n-api.service[120740]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 13 18:10:43.322209 dv-cinder-852009-8-iscsi devstack@n-api.service[120740]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 13 18:10:43.322209 dv-cinder-852009-8-iscsi devstack@n-api.service[120740]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance b6be21a8-a1fd-44ff-9fca-88e979974510 could not be found. Sep 13 18:10:43.322209 dv-cinder-852009-8-iscsi devstack@n-api.service[120740]: ERROR nova.api.openstack.wsgi Sep 13 18:10:43.323540 dv-cinder-852009-8-iscsi devstack@n-api.service[120740]: DEBUG nova.api.openstack.wsgi [None req-f3d08b83-3b96-4706-a39a-e2d87acb865b tempest-AttachVolumeNegativeTest-1378806597 tempest-AttachVolumeNegativeTest-1378806597-project] Returning 404 to user: Instance b6be21a8-a1fd-44ff-9fca-88e979974510 could not be found. {{(pid=120740) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 13 18:10:43.323540 dv-cinder-852009-8-iscsi devstack@n-api.service[120740]: INFO nova.api.openstack.requestlog [None req-f3d08b83-3b96-4706-a39a-e2d87acb865b tempest-AttachVolumeNegativeTest-1378806597 tempest-AttachVolumeNegativeTest-1378806597-project] 10.222.0.43 "GET /compute/v2.1/servers/b6be21a8-a1fd-44ff-9fca-88e979974510" status: 404 len: 111 microversion: 2.1 time: 0.032226 Sep 13 18:10:43.323540 dv-cinder-852009-8-iscsi devstack@n-api.service[120740]: [pid: 120740|app: 0|req: 410/809] 10.222.0.43 () {58 vars in 1236 bytes} [Tue Sep 13 18:10:43 2022] GET /compute/v2.1/servers/b6be21a8-a1fd-44ff-9fca-88e979974510 => generated 111 bytes in 34 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Sep 13 18:10:43.333398 dv-cinder-852009-8-iscsi devstack@n-api.service[120741]: DEBUG nova.api.openstack.wsgi [None req-b3114cae-a3f4-4701-8a98-7aadfaf8a2fb tempest-AttachVolumeNegativeTest-1378806597 tempest-AttachVolumeNegativeTest-1378806597-project] Calling method '.version_select at 0x7fa6269141f0>' {{(pid=120741) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 18:10:43.355345 dv-cinder-852009-8-iscsi devstack@n-api.service[120741]: INFO nova.api.openstack.requestlog [None req-b3114cae-a3f4-4701-8a98-7aadfaf8a2fb tempest-AttachVolumeNegativeTest-1378806597 tempest-AttachVolumeNegativeTest-1378806597-project] 10.222.0.43 "DELETE /compute/v2.1/os-keypairs/tempest-keypair-1906429670" status: 202 len: 0 microversion: 2.1 time: 0.026225 Sep 13 18:10:43.360155 dv-cinder-852009-8-iscsi devstack@n-api.service[120741]: [pid: 120741|app: 0|req: 400/810] 10.222.0.43 () {58 vars in 1221 bytes} [Tue Sep 13 18:10:43 2022] DELETE /compute/v2.1/os-keypairs/tempest-keypair-1906429670 => generated 0 bytes in 32 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Sep 13 18:10:44.078365 dv-cinder-852009-8-iscsi devstack@n-api.service[120740]: DEBUG nova.api.openstack.wsgi [None req-146ca9d5-33fc-4359-919d-eaf0dd598f14 tempest-AttachVolumeNegativeTest-1378806597 tempest-AttachVolumeNegativeTest-1378806597-project] Calling method '>' {{(pid=120740) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 18:10:44.078847 dv-cinder-852009-8-iscsi devstack@n-api.service[120740]: DEBUG nova.compute.api [None req-146ca9d5-33fc-4359-919d-eaf0dd598f14 tempest-AttachVolumeNegativeTest-1378806597 tempest-AttachVolumeNegativeTest-1378806597-project] [instance: 75289327-97d1-42bd-a6c7-6f2b1aa3236a] Fetching instance by UUID {{(pid=120740) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 18:10:44.084931 dv-cinder-852009-8-iscsi devstack@n-api.service[120740]: DEBUG oslo_concurrency.lockutils [None req-146ca9d5-33fc-4359-919d-eaf0dd598f14 tempest-AttachVolumeNegativeTest-1378806597 tempest-AttachVolumeNegativeTest-1378806597-project] Acquiring lock "1daf4f4c-0e4a-4779-b53a-78c48397ea2f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120740) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 18:10:44.085366 dv-cinder-852009-8-iscsi devstack@n-api.service[120740]: DEBUG oslo_concurrency.lockutils [None req-146ca9d5-33fc-4359-919d-eaf0dd598f14 tempest-AttachVolumeNegativeTest-1378806597 tempest-AttachVolumeNegativeTest-1378806597-project] Lock "1daf4f4c-0e4a-4779-b53a-78c48397ea2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120740) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 18:10:44.085971 dv-cinder-852009-8-iscsi devstack@n-api.service[120740]: DEBUG oslo_concurrency.lockutils [None req-146ca9d5-33fc-4359-919d-eaf0dd598f14 tempest-AttachVolumeNegativeTest-1378806597 tempest-AttachVolumeNegativeTest-1378806597-project] Lock "1daf4f4c-0e4a-4779-b53a-78c48397ea2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120740) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 18:10:44.086663 dv-cinder-852009-8-iscsi devstack@n-api.service[120740]: DEBUG oslo_concurrency.lockutils [None req-146ca9d5-33fc-4359-919d-eaf0dd598f14 tempest-AttachVolumeNegativeTest-1378806597 tempest-AttachVolumeNegativeTest-1378806597-project] Acquiring lock "1daf4f4c-0e4a-4779-b53a-78c48397ea2f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120740) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 18:10:44.087103 dv-cinder-852009-8-iscsi devstack@n-api.service[120740]: DEBUG oslo_concurrency.lockutils [None req-146ca9d5-33fc-4359-919d-eaf0dd598f14 tempest-AttachVolumeNegativeTest-1378806597 tempest-AttachVolumeNegativeTest-1378806597-project] Lock "1daf4f4c-0e4a-4779-b53a-78c48397ea2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120740) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 18:10:44.087506 dv-cinder-852009-8-iscsi devstack@n-api.service[120740]: DEBUG oslo_concurrency.lockutils [None req-146ca9d5-33fc-4359-919d-eaf0dd598f14 tempest-AttachVolumeNegativeTest-1378806597 tempest-AttachVolumeNegativeTest-1378806597-project] Lock "1daf4f4c-0e4a-4779-b53a-78c48397ea2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120740) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 18:10:44.169374 dv-cinder-852009-8-iscsi devstack@n-api.service[120740]: DEBUG nova.objects.instance [None req-146ca9d5-33fc-4359-919d-eaf0dd598f14 tempest-AttachVolumeNegativeTest-1378806597 tempest-AttachVolumeNegativeTest-1378806597-project] Lazy-loading 'services' on Instance uuid 75289327-97d1-42bd-a6c7-6f2b1aa3236a {{(pid=120740) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Sep 13 18:10:44.256089 dv-cinder-852009-8-iscsi devstack@n-api.service[120740]: INFO nova.api.openstack.requestlog [None req-146ca9d5-33fc-4359-919d-eaf0dd598f14 tempest-AttachVolumeNegativeTest-1378806597 tempest-AttachVolumeNegativeTest-1378806597-project] 10.222.0.43 "DELETE /compute/v2.1/servers/75289327-97d1-42bd-a6c7-6f2b1aa3236a/os-volume_attachments/e32c0df2-e306-4d0e-a551-0fbeaed724e7" status: 202 len: 0 microversion: 2.1 time: 0.181619 Sep 13 18:10:44.256917 dv-cinder-852009-8-iscsi devstack@n-api.service[120740]: [pid: 120740|app: 0|req: 411/811] 10.222.0.43 () {58 vars in 1416 bytes} [Tue Sep 13 18:10:44 2022] DELETE /compute/v2.1/servers/75289327-97d1-42bd-a6c7-6f2b1aa3236a/os-volume_attachments/e32c0df2-e306-4d0e-a551-0fbeaed724e7 => generated 0 bytes in 183 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Sep 13 18:10:44.266509 dv-cinder-852009-8-iscsi devstack@n-api.service[120741]: DEBUG nova.api.openstack.wsgi [None req-8bfdcb72-35e9-4f54-b7d7-a33df741c40d tempest-AttachVolumeNegativeTest-1378806597 tempest-AttachVolumeNegativeTest-1378806597-project] Calling method '>' {{(pid=120741) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 18:10:44.269112 dv-cinder-852009-8-iscsi devstack@n-api.service[120741]: DEBUG nova.compute.api [None req-8bfdcb72-35e9-4f54-b7d7-a33df741c40d tempest-AttachVolumeNegativeTest-1378806597 tempest-AttachVolumeNegativeTest-1378806597-project] [instance: 75289327-97d1-42bd-a6c7-6f2b1aa3236a] Fetching instance by UUID {{(pid=120741) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 18:10:44.277910 dv-cinder-852009-8-iscsi devstack@n-api.service[120741]: DEBUG oslo_concurrency.lockutils [None req-8bfdcb72-35e9-4f54-b7d7-a33df741c40d tempest-AttachVolumeNegativeTest-1378806597 tempest-AttachVolumeNegativeTest-1378806597-project] Acquiring lock "1daf4f4c-0e4a-4779-b53a-78c48397ea2f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120741) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 18:10:44.278397 dv-cinder-852009-8-iscsi devstack@n-api.service[120741]: DEBUG oslo_concurrency.lockutils [None req-8bfdcb72-35e9-4f54-b7d7-a33df741c40d tempest-AttachVolumeNegativeTest-1378806597 tempest-AttachVolumeNegativeTest-1378806597-project] Lock "1daf4f4c-0e4a-4779-b53a-78c48397ea2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120741) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 18:10:44.279054 dv-cinder-852009-8-iscsi devstack@n-api.service[120741]: DEBUG oslo_concurrency.lockutils [None req-8bfdcb72-35e9-4f54-b7d7-a33df741c40d tempest-AttachVolumeNegativeTest-1378806597 tempest-AttachVolumeNegativeTest-1378806597-project] Lock "1daf4f4c-0e4a-4779-b53a-78c48397ea2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120741) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 18:10:44.279762 dv-cinder-852009-8-iscsi devstack@n-api.service[120741]: DEBUG oslo_concurrency.lockutils [None req-8bfdcb72-35e9-4f54-b7d7-a33df741c40d tempest-AttachVolumeNegativeTest-1378806597 tempest-AttachVolumeNegativeTest-1378806597-project] Acquiring lock "1daf4f4c-0e4a-4779-b53a-78c48397ea2f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120741) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 18:10:44.280212 dv-cinder-852009-8-iscsi devstack@n-api.service[120741]: DEBUG oslo_concurrency.lockutils [None req-8bfdcb72-35e9-4f54-b7d7-a33df741c40d tempest-AttachVolumeNegativeTest-1378806597 tempest-AttachVolumeNegativeTest-1378806597-project] Lock "1daf4f4c-0e4a-4779-b53a-78c48397ea2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120741) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 18:10:44.280664 dv-cinder-852009-8-iscsi devstack@n-api.service[120741]: DEBUG oslo_concurrency.lockutils [None req-8bfdcb72-35e9-4f54-b7d7-a33df741c40d tempest-AttachVolumeNegativeTest-1378806597 tempest-AttachVolumeNegativeTest-1378806597-project] Lock "1daf4f4c-0e4a-4779-b53a-78c48397ea2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120741) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 18:10:44.312175 dv-cinder-852009-8-iscsi devstack@n-api.service[120741]: INFO nova.api.openstack.requestlog [None req-8bfdcb72-35e9-4f54-b7d7-a33df741c40d tempest-AttachVolumeNegativeTest-1378806597 tempest-AttachVolumeNegativeTest-1378806597-project] 10.222.0.43 "GET /compute/v2.1/servers/75289327-97d1-42bd-a6c7-6f2b1aa3236a/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.049882 Sep 13 18:10:44.313012 dv-cinder-852009-8-iscsi devstack@n-api.service[120741]: [pid: 120741|app: 0|req: 401/812] 10.222.0.43 () {58 vars in 1302 bytes} [Tue Sep 13 18:10:44 2022] GET /compute/v2.1/servers/75289327-97d1-42bd-a6c7-6f2b1aa3236a/os-volume_attachments => generated 197 bytes in 52 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 13 18:10:45.329879 dv-cinder-852009-8-iscsi devstack@n-api.service[120740]: DEBUG nova.api.openstack.wsgi [None req-430e942a-d2fe-4b92-b655-210783c42e58 tempest-AttachVolumeNegativeTest-1378806597 tempest-AttachVolumeNegativeTest-1378806597-project] Calling method '>' {{(pid=120740) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 18:10:45.332951 dv-cinder-852009-8-iscsi devstack@n-api.service[120740]: DEBUG nova.compute.api [None req-430e942a-d2fe-4b92-b655-210783c42e58 tempest-AttachVolumeNegativeTest-1378806597 tempest-AttachVolumeNegativeTest-1378806597-project] [instance: 75289327-97d1-42bd-a6c7-6f2b1aa3236a] Fetching instance by UUID {{(pid=120740) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 18:10:45.342229 dv-cinder-852009-8-iscsi devstack@n-api.service[120740]: DEBUG oslo_concurrency.lockutils [None req-430e942a-d2fe-4b92-b655-210783c42e58 tempest-AttachVolumeNegativeTest-1378806597 tempest-AttachVolumeNegativeTest-1378806597-project] Acquiring lock "1daf4f4c-0e4a-4779-b53a-78c48397ea2f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120740) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 18:10:45.342870 dv-cinder-852009-8-iscsi devstack@n-api.service[120740]: DEBUG oslo_concurrency.lockutils [None req-430e942a-d2fe-4b92-b655-210783c42e58 tempest-AttachVolumeNegativeTest-1378806597 tempest-AttachVolumeNegativeTest-1378806597-project] Lock "1daf4f4c-0e4a-4779-b53a-78c48397ea2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120740) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 18:10:45.343445 dv-cinder-852009-8-iscsi devstack@n-api.service[120740]: DEBUG oslo_concurrency.lockutils [None req-430e942a-d2fe-4b92-b655-210783c42e58 tempest-AttachVolumeNegativeTest-1378806597 tempest-AttachVolumeNegativeTest-1378806597-project] Lock "1daf4f4c-0e4a-4779-b53a-78c48397ea2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120740) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 18:10:45.344395 dv-cinder-852009-8-iscsi devstack@n-api.service[120740]: DEBUG oslo_concurrency.lockutils [None req-430e942a-d2fe-4b92-b655-210783c42e58 tempest-AttachVolumeNegativeTest-1378806597 tempest-AttachVolumeNegativeTest-1378806597-project] Acquiring lock "1daf4f4c-0e4a-4779-b53a-78c48397ea2f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120740) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 18:10:45.345116 dv-cinder-852009-8-iscsi devstack@n-api.service[120740]: DEBUG oslo_concurrency.lockutils [None req-430e942a-d2fe-4b92-b655-210783c42e58 tempest-AttachVolumeNegativeTest-1378806597 tempest-AttachVolumeNegativeTest-1378806597-project] Lock "1daf4f4c-0e4a-4779-b53a-78c48397ea2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120740) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 18:10:45.345676 dv-cinder-852009-8-iscsi devstack@n-api.service[120740]: DEBUG oslo_concurrency.lockutils [None req-430e942a-d2fe-4b92-b655-210783c42e58 tempest-AttachVolumeNegativeTest-1378806597 tempest-AttachVolumeNegativeTest-1378806597-project] Lock "1daf4f4c-0e4a-4779-b53a-78c48397ea2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120740) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 18:10:45.379523 dv-cinder-852009-8-iscsi devstack@n-api.service[120740]: INFO nova.api.openstack.requestlog [None req-430e942a-d2fe-4b92-b655-210783c42e58 tempest-AttachVolumeNegativeTest-1378806597 tempest-AttachVolumeNegativeTest-1378806597-project] 10.222.0.43 "GET /compute/v2.1/servers/75289327-97d1-42bd-a6c7-6f2b1aa3236a/os-volume_attachments" status: 200 len: 25 microversion: 2.1 time: 0.056664 Sep 13 18:10:45.380067 dv-cinder-852009-8-iscsi devstack@n-api.service[120740]: [pid: 120740|app: 0|req: 412/813] 10.222.0.43 () {58 vars in 1302 bytes} [Tue Sep 13 18:10:45 2022] GET /compute/v2.1/servers/75289327-97d1-42bd-a6c7-6f2b1aa3236a/os-volume_attachments => generated 25 bytes in 59 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Sep 13 18:10:45.453991 dv-cinder-852009-8-iscsi devstack@n-api.service[120741]: DEBUG nova.api.openstack.wsgi [None req-78b7bce6-ae4c-43d4-b817-a52ff6f8efc8 tempest-AttachVolumeNegativeTest-1378806597 tempest-AttachVolumeNegativeTest-1378806597-project] Calling method '>' {{(pid=120741) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 18:10:45.454522 dv-cinder-852009-8-iscsi devstack@n-api.service[120741]: DEBUG nova.compute.api [None req-78b7bce6-ae4c-43d4-b817-a52ff6f8efc8 tempest-AttachVolumeNegativeTest-1378806597 tempest-AttachVolumeNegativeTest-1378806597-project] [instance: 75289327-97d1-42bd-a6c7-6f2b1aa3236a] Fetching instance by UUID {{(pid=120741) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 18:10:45.461538 dv-cinder-852009-8-iscsi devstack@n-api.service[120741]: DEBUG oslo_concurrency.lockutils [None req-78b7bce6-ae4c-43d4-b817-a52ff6f8efc8 tempest-AttachVolumeNegativeTest-1378806597 tempest-AttachVolumeNegativeTest-1378806597-project] Acquiring lock "1daf4f4c-0e4a-4779-b53a-78c48397ea2f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120741) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 18:10:45.462024 dv-cinder-852009-8-iscsi devstack@n-api.service[120741]: DEBUG oslo_concurrency.lockutils [None req-78b7bce6-ae4c-43d4-b817-a52ff6f8efc8 tempest-AttachVolumeNegativeTest-1378806597 tempest-AttachVolumeNegativeTest-1378806597-project] Lock "1daf4f4c-0e4a-4779-b53a-78c48397ea2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120741) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 18:10:45.462458 dv-cinder-852009-8-iscsi devstack@n-api.service[120741]: DEBUG oslo_concurrency.lockutils [None req-78b7bce6-ae4c-43d4-b817-a52ff6f8efc8 tempest-AttachVolumeNegativeTest-1378806597 tempest-AttachVolumeNegativeTest-1378806597-project] Lock "1daf4f4c-0e4a-4779-b53a-78c48397ea2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120741) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 18:10:45.463156 dv-cinder-852009-8-iscsi devstack@n-api.service[120741]: DEBUG oslo_concurrency.lockutils [None req-78b7bce6-ae4c-43d4-b817-a52ff6f8efc8 tempest-AttachVolumeNegativeTest-1378806597 tempest-AttachVolumeNegativeTest-1378806597-project] Acquiring lock "1daf4f4c-0e4a-4779-b53a-78c48397ea2f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120741) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 18:10:45.463605 dv-cinder-852009-8-iscsi devstack@n-api.service[120741]: DEBUG oslo_concurrency.lockutils [None req-78b7bce6-ae4c-43d4-b817-a52ff6f8efc8 tempest-AttachVolumeNegativeTest-1378806597 tempest-AttachVolumeNegativeTest-1378806597-project] Lock "1daf4f4c-0e4a-4779-b53a-78c48397ea2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120741) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 18:10:45.464027 dv-cinder-852009-8-iscsi devstack@n-api.service[120741]: DEBUG oslo_concurrency.lockutils [None req-78b7bce6-ae4c-43d4-b817-a52ff6f8efc8 tempest-AttachVolumeNegativeTest-1378806597 tempest-AttachVolumeNegativeTest-1378806597-project] Lock "1daf4f4c-0e4a-4779-b53a-78c48397ea2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120741) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 18:10:45.490461 dv-cinder-852009-8-iscsi devstack@n-api.service[120741]: DEBUG nova.compute.api [None req-78b7bce6-ae4c-43d4-b817-a52ff6f8efc8 tempest-AttachVolumeNegativeTest-1378806597 tempest-AttachVolumeNegativeTest-1378806597-project] [instance: 75289327-97d1-42bd-a6c7-6f2b1aa3236a] Going to try to terminate instance {{(pid=120741) delete /opt/stack/nova/nova/compute/api.py:2719}} Sep 13 18:10:45.575491 dv-cinder-852009-8-iscsi devstack@n-api.service[120741]: INFO nova.api.openstack.requestlog [None req-78b7bce6-ae4c-43d4-b817-a52ff6f8efc8 tempest-AttachVolumeNegativeTest-1378806597 tempest-AttachVolumeNegativeTest-1378806597-project] 10.222.0.43 "DELETE /compute/v2.1/servers/75289327-97d1-42bd-a6c7-6f2b1aa3236a" status: 204 len: 0 microversion: 2.1 time: 0.126400 Sep 13 18:10:45.576115 dv-cinder-852009-8-iscsi devstack@n-api.service[120741]: [pid: 120741|app: 0|req: 402/814] 10.222.0.43 () {58 vars in 1239 bytes} [Tue Sep 13 18:10:45 2022] DELETE /compute/v2.1/servers/75289327-97d1-42bd-a6c7-6f2b1aa3236a => generated 0 bytes in 128 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Sep 13 18:10:45.584726 dv-cinder-852009-8-iscsi devstack@n-api.service[120740]: DEBUG nova.api.openstack.wsgi [None req-3dcc4276-6f85-420f-9831-77b70e0aafac tempest-AttachVolumeNegativeTest-1378806597 tempest-AttachVolumeNegativeTest-1378806597-project] Calling method '>' {{(pid=120740) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 18:10:45.585262 dv-cinder-852009-8-iscsi devstack@n-api.service[120740]: DEBUG nova.compute.api [None req-3dcc4276-6f85-420f-9831-77b70e0aafac tempest-AttachVolumeNegativeTest-1378806597 tempest-AttachVolumeNegativeTest-1378806597-project] [instance: 75289327-97d1-42bd-a6c7-6f2b1aa3236a] Fetching instance by UUID {{(pid=120740) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 18:10:45.591539 dv-cinder-852009-8-iscsi devstack@n-api.service[120740]: DEBUG oslo_concurrency.lockutils [None req-3dcc4276-6f85-420f-9831-77b70e0aafac tempest-AttachVolumeNegativeTest-1378806597 tempest-AttachVolumeNegativeTest-1378806597-project] Acquiring lock "1daf4f4c-0e4a-4779-b53a-78c48397ea2f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120740) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 18:10:45.592023 dv-cinder-852009-8-iscsi devstack@n-api.service[120740]: DEBUG oslo_concurrency.lockutils [None req-3dcc4276-6f85-420f-9831-77b70e0aafac tempest-AttachVolumeNegativeTest-1378806597 tempest-AttachVolumeNegativeTest-1378806597-project] Lock "1daf4f4c-0e4a-4779-b53a-78c48397ea2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120740) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 18:10:45.592525 dv-cinder-852009-8-iscsi devstack@n-api.service[120740]: DEBUG oslo_concurrency.lockutils [None req-3dcc4276-6f85-420f-9831-77b70e0aafac tempest-AttachVolumeNegativeTest-1378806597 tempest-AttachVolumeNegativeTest-1378806597-project] Lock "1daf4f4c-0e4a-4779-b53a-78c48397ea2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120740) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 18:10:45.593214 dv-cinder-852009-8-iscsi devstack@n-api.service[120740]: DEBUG oslo_concurrency.lockutils [None req-3dcc4276-6f85-420f-9831-77b70e0aafac tempest-AttachVolumeNegativeTest-1378806597 tempest-AttachVolumeNegativeTest-1378806597-project] Acquiring lock "1daf4f4c-0e4a-4779-b53a-78c48397ea2f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120740) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 18:10:45.593701 dv-cinder-852009-8-iscsi devstack@n-api.service[120740]: DEBUG oslo_concurrency.lockutils [None req-3dcc4276-6f85-420f-9831-77b70e0aafac tempest-AttachVolumeNegativeTest-1378806597 tempest-AttachVolumeNegativeTest-1378806597-project] Lock "1daf4f4c-0e4a-4779-b53a-78c48397ea2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120740) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 18:10:45.594120 dv-cinder-852009-8-iscsi devstack@n-api.service[120740]: DEBUG oslo_concurrency.lockutils [None req-3dcc4276-6f85-420f-9831-77b70e0aafac tempest-AttachVolumeNegativeTest-1378806597 tempest-AttachVolumeNegativeTest-1378806597-project] Lock "1daf4f4c-0e4a-4779-b53a-78c48397ea2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120740) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 18:10:45.735081 dv-cinder-852009-8-iscsi devstack@n-api.service[120740]: DEBUG nova.policy [None req-3dcc4276-6f85-420f-9831-77b70e0aafac tempest-AttachVolumeNegativeTest-1378806597 tempest-AttachVolumeNegativeTest-1378806597-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '714cd09ba19b492f9a8c80343abcf6b9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '629311eda0584a5fbb7d8995cf27540c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120740) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 18:10:45.743128 dv-cinder-852009-8-iscsi devstack@n-api.service[120740]: INFO nova.api.openstack.requestlog [None req-3dcc4276-6f85-420f-9831-77b70e0aafac tempest-AttachVolumeNegativeTest-1378806597 tempest-AttachVolumeNegativeTest-1378806597-project] 10.222.0.43 "GET /compute/v2.1/servers/75289327-97d1-42bd-a6c7-6f2b1aa3236a" status: 200 len: 1682 microversion: 2.1 time: 0.162472 Sep 13 18:10:45.743681 dv-cinder-852009-8-iscsi devstack@n-api.service[120740]: [pid: 120740|app: 0|req: 413/815] 10.222.0.43 () {58 vars in 1236 bytes} [Tue Sep 13 18:10:45 2022] GET /compute/v2.1/servers/75289327-97d1-42bd-a6c7-6f2b1aa3236a => generated 1682 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 13 18:10:46.770667 dv-cinder-852009-8-iscsi devstack@n-api.service[120741]: DEBUG nova.api.openstack.wsgi [None req-b18fa773-3740-4521-8a3a-885cc727bb00 tempest-AttachVolumeNegativeTest-1378806597 tempest-AttachVolumeNegativeTest-1378806597-project] Calling method '>' {{(pid=120741) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 18:10:46.771523 dv-cinder-852009-8-iscsi devstack@n-api.service[120741]: DEBUG nova.compute.api [None req-b18fa773-3740-4521-8a3a-885cc727bb00 tempest-AttachVolumeNegativeTest-1378806597 tempest-AttachVolumeNegativeTest-1378806597-project] [instance: 75289327-97d1-42bd-a6c7-6f2b1aa3236a] Fetching instance by UUID {{(pid=120741) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 18:10:46.779848 dv-cinder-852009-8-iscsi devstack@n-api.service[120741]: DEBUG oslo_concurrency.lockutils [None req-b18fa773-3740-4521-8a3a-885cc727bb00 tempest-AttachVolumeNegativeTest-1378806597 tempest-AttachVolumeNegativeTest-1378806597-project] Acquiring lock "1daf4f4c-0e4a-4779-b53a-78c48397ea2f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120741) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 18:10:46.780468 dv-cinder-852009-8-iscsi devstack@n-api.service[120741]: DEBUG oslo_concurrency.lockutils [None req-b18fa773-3740-4521-8a3a-885cc727bb00 tempest-AttachVolumeNegativeTest-1378806597 tempest-AttachVolumeNegativeTest-1378806597-project] Lock "1daf4f4c-0e4a-4779-b53a-78c48397ea2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120741) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 18:10:46.781013 dv-cinder-852009-8-iscsi devstack@n-api.service[120741]: DEBUG oslo_concurrency.lockutils [None req-b18fa773-3740-4521-8a3a-885cc727bb00 tempest-AttachVolumeNegativeTest-1378806597 tempest-AttachVolumeNegativeTest-1378806597-project] Lock "1daf4f4c-0e4a-4779-b53a-78c48397ea2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120741) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 18:10:46.781860 dv-cinder-852009-8-iscsi devstack@n-api.service[120741]: DEBUG oslo_concurrency.lockutils [None req-b18fa773-3740-4521-8a3a-885cc727bb00 tempest-AttachVolumeNegativeTest-1378806597 tempest-AttachVolumeNegativeTest-1378806597-project] Acquiring lock "1daf4f4c-0e4a-4779-b53a-78c48397ea2f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120741) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 18:10:46.782413 dv-cinder-852009-8-iscsi devstack@n-api.service[120741]: DEBUG oslo_concurrency.lockutils [None req-b18fa773-3740-4521-8a3a-885cc727bb00 tempest-AttachVolumeNegativeTest-1378806597 tempest-AttachVolumeNegativeTest-1378806597-project] Lock "1daf4f4c-0e4a-4779-b53a-78c48397ea2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120741) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 18:10:46.782940 dv-cinder-852009-8-iscsi devstack@n-api.service[120741]: DEBUG oslo_concurrency.lockutils [None req-b18fa773-3740-4521-8a3a-885cc727bb00 tempest-AttachVolumeNegativeTest-1378806597 tempest-AttachVolumeNegativeTest-1378806597-project] Lock "1daf4f4c-0e4a-4779-b53a-78c48397ea2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120741) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 18:10:46.924824 dv-cinder-852009-8-iscsi devstack@n-api.service[120741]: DEBUG nova.policy [None req-b18fa773-3740-4521-8a3a-885cc727bb00 tempest-AttachVolumeNegativeTest-1378806597 tempest-AttachVolumeNegativeTest-1378806597-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '714cd09ba19b492f9a8c80343abcf6b9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '629311eda0584a5fbb7d8995cf27540c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120741) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 18:10:46.932927 dv-cinder-852009-8-iscsi devstack@n-api.service[120741]: INFO nova.api.openstack.requestlog [None req-b18fa773-3740-4521-8a3a-885cc727bb00 tempest-AttachVolumeNegativeTest-1378806597 tempest-AttachVolumeNegativeTest-1378806597-project] 10.222.0.43 "GET /compute/v2.1/servers/75289327-97d1-42bd-a6c7-6f2b1aa3236a" status: 200 len: 1682 microversion: 2.1 time: 0.167928 Sep 13 18:10:46.933469 dv-cinder-852009-8-iscsi devstack@n-api.service[120741]: [pid: 120741|app: 0|req: 403/816] 10.222.0.43 () {58 vars in 1236 bytes} [Tue Sep 13 18:10:46 2022] GET /compute/v2.1/servers/75289327-97d1-42bd-a6c7-6f2b1aa3236a => generated 1682 bytes in 170 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 13 18:10:47.959451 dv-cinder-852009-8-iscsi devstack@n-api.service[120740]: DEBUG nova.api.openstack.wsgi [None req-0675219a-9024-4d60-97a5-789ac9a435e5 tempest-AttachVolumeNegativeTest-1378806597 tempest-AttachVolumeNegativeTest-1378806597-project] Calling method '>' {{(pid=120740) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 18:10:47.960320 dv-cinder-852009-8-iscsi devstack@n-api.service[120740]: DEBUG nova.compute.api [None req-0675219a-9024-4d60-97a5-789ac9a435e5 tempest-AttachVolumeNegativeTest-1378806597 tempest-AttachVolumeNegativeTest-1378806597-project] [instance: 75289327-97d1-42bd-a6c7-6f2b1aa3236a] Fetching instance by UUID {{(pid=120740) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 18:10:47.969472 dv-cinder-852009-8-iscsi devstack@n-api.service[120740]: DEBUG oslo_concurrency.lockutils [None req-0675219a-9024-4d60-97a5-789ac9a435e5 tempest-AttachVolumeNegativeTest-1378806597 tempest-AttachVolumeNegativeTest-1378806597-project] Acquiring lock "1daf4f4c-0e4a-4779-b53a-78c48397ea2f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120740) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 18:10:47.970168 dv-cinder-852009-8-iscsi devstack@n-api.service[120740]: DEBUG oslo_concurrency.lockutils [None req-0675219a-9024-4d60-97a5-789ac9a435e5 tempest-AttachVolumeNegativeTest-1378806597 tempest-AttachVolumeNegativeTest-1378806597-project] Lock "1daf4f4c-0e4a-4779-b53a-78c48397ea2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120740) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 18:10:47.970805 dv-cinder-852009-8-iscsi devstack@n-api.service[120740]: DEBUG oslo_concurrency.lockutils [None req-0675219a-9024-4d60-97a5-789ac9a435e5 tempest-AttachVolumeNegativeTest-1378806597 tempest-AttachVolumeNegativeTest-1378806597-project] Lock "1daf4f4c-0e4a-4779-b53a-78c48397ea2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120740) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 18:10:47.971718 dv-cinder-852009-8-iscsi devstack@n-api.service[120740]: DEBUG oslo_concurrency.lockutils [None req-0675219a-9024-4d60-97a5-789ac9a435e5 tempest-AttachVolumeNegativeTest-1378806597 tempest-AttachVolumeNegativeTest-1378806597-project] Acquiring lock "1daf4f4c-0e4a-4779-b53a-78c48397ea2f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120740) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 18:10:47.972176 dv-cinder-852009-8-iscsi devstack@n-api.service[120740]: DEBUG oslo_concurrency.lockutils [None req-0675219a-9024-4d60-97a5-789ac9a435e5 tempest-AttachVolumeNegativeTest-1378806597 tempest-AttachVolumeNegativeTest-1378806597-project] Lock "1daf4f4c-0e4a-4779-b53a-78c48397ea2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120740) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 18:10:47.972617 dv-cinder-852009-8-iscsi devstack@n-api.service[120740]: DEBUG oslo_concurrency.lockutils [None req-0675219a-9024-4d60-97a5-789ac9a435e5 tempest-AttachVolumeNegativeTest-1378806597 tempest-AttachVolumeNegativeTest-1378806597-project] Lock "1daf4f4c-0e4a-4779-b53a-78c48397ea2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120740) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 18:10:48.103474 dv-cinder-852009-8-iscsi devstack@n-api.service[120740]: DEBUG nova.policy [None req-0675219a-9024-4d60-97a5-789ac9a435e5 tempest-AttachVolumeNegativeTest-1378806597 tempest-AttachVolumeNegativeTest-1378806597-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '714cd09ba19b492f9a8c80343abcf6b9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '629311eda0584a5fbb7d8995cf27540c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120740) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 18:10:48.111300 dv-cinder-852009-8-iscsi devstack@n-api.service[120740]: INFO nova.api.openstack.requestlog [None req-0675219a-9024-4d60-97a5-789ac9a435e5 tempest-AttachVolumeNegativeTest-1378806597 tempest-AttachVolumeNegativeTest-1378806597-project] 10.222.0.43 "GET /compute/v2.1/servers/75289327-97d1-42bd-a6c7-6f2b1aa3236a" status: 200 len: 1682 microversion: 2.1 time: 0.157429 Sep 13 18:10:48.112002 dv-cinder-852009-8-iscsi devstack@n-api.service[120740]: [pid: 120740|app: 0|req: 414/817] 10.222.0.43 () {58 vars in 1236 bytes} [Tue Sep 13 18:10:47 2022] GET /compute/v2.1/servers/75289327-97d1-42bd-a6c7-6f2b1aa3236a => generated 1682 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 13 18:10:49.139356 dv-cinder-852009-8-iscsi devstack@n-api.service[120741]: DEBUG nova.api.openstack.wsgi [None req-8d42d2b9-878d-4443-9f4b-0c8bb6e24ae6 tempest-AttachVolumeNegativeTest-1378806597 tempest-AttachVolumeNegativeTest-1378806597-project] Calling method '>' {{(pid=120741) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 18:10:49.140328 dv-cinder-852009-8-iscsi devstack@n-api.service[120741]: DEBUG nova.compute.api [None req-8d42d2b9-878d-4443-9f4b-0c8bb6e24ae6 tempest-AttachVolumeNegativeTest-1378806597 tempest-AttachVolumeNegativeTest-1378806597-project] [instance: 75289327-97d1-42bd-a6c7-6f2b1aa3236a] Fetching instance by UUID {{(pid=120741) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 18:10:49.148740 dv-cinder-852009-8-iscsi devstack@n-api.service[120741]: DEBUG oslo_concurrency.lockutils [None req-8d42d2b9-878d-4443-9f4b-0c8bb6e24ae6 tempest-AttachVolumeNegativeTest-1378806597 tempest-AttachVolumeNegativeTest-1378806597-project] Acquiring lock "1daf4f4c-0e4a-4779-b53a-78c48397ea2f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120741) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 18:10:49.149231 dv-cinder-852009-8-iscsi devstack@n-api.service[120741]: DEBUG oslo_concurrency.lockutils [None req-8d42d2b9-878d-4443-9f4b-0c8bb6e24ae6 tempest-AttachVolumeNegativeTest-1378806597 tempest-AttachVolumeNegativeTest-1378806597-project] Lock "1daf4f4c-0e4a-4779-b53a-78c48397ea2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120741) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 18:10:49.149665 dv-cinder-852009-8-iscsi devstack@n-api.service[120741]: DEBUG oslo_concurrency.lockutils [None req-8d42d2b9-878d-4443-9f4b-0c8bb6e24ae6 tempest-AttachVolumeNegativeTest-1378806597 tempest-AttachVolumeNegativeTest-1378806597-project] Lock "1daf4f4c-0e4a-4779-b53a-78c48397ea2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120741) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 18:10:49.150363 dv-cinder-852009-8-iscsi devstack@n-api.service[120741]: DEBUG oslo_concurrency.lockutils [None req-8d42d2b9-878d-4443-9f4b-0c8bb6e24ae6 tempest-AttachVolumeNegativeTest-1378806597 tempest-AttachVolumeNegativeTest-1378806597-project] Acquiring lock "1daf4f4c-0e4a-4779-b53a-78c48397ea2f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120741) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 18:10:49.150817 dv-cinder-852009-8-iscsi devstack@n-api.service[120741]: DEBUG oslo_concurrency.lockutils [None req-8d42d2b9-878d-4443-9f4b-0c8bb6e24ae6 tempest-AttachVolumeNegativeTest-1378806597 tempest-AttachVolumeNegativeTest-1378806597-project] Lock "1daf4f4c-0e4a-4779-b53a-78c48397ea2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120741) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 18:10:49.151252 dv-cinder-852009-8-iscsi devstack@n-api.service[120741]: DEBUG oslo_concurrency.lockutils [None req-8d42d2b9-878d-4443-9f4b-0c8bb6e24ae6 tempest-AttachVolumeNegativeTest-1378806597 tempest-AttachVolumeNegativeTest-1378806597-project] Lock "1daf4f4c-0e4a-4779-b53a-78c48397ea2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120741) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 18:10:49.286722 dv-cinder-852009-8-iscsi devstack@n-api.service[120741]: DEBUG nova.policy [None req-8d42d2b9-878d-4443-9f4b-0c8bb6e24ae6 tempest-AttachVolumeNegativeTest-1378806597 tempest-AttachVolumeNegativeTest-1378806597-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '714cd09ba19b492f9a8c80343abcf6b9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '629311eda0584a5fbb7d8995cf27540c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120741) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 18:10:49.295530 dv-cinder-852009-8-iscsi devstack@n-api.service[120741]: INFO nova.api.openstack.requestlog [None req-8d42d2b9-878d-4443-9f4b-0c8bb6e24ae6 tempest-AttachVolumeNegativeTest-1378806597 tempest-AttachVolumeNegativeTest-1378806597-project] 10.222.0.43 "GET /compute/v2.1/servers/75289327-97d1-42bd-a6c7-6f2b1aa3236a" status: 200 len: 1682 microversion: 2.1 time: 0.162651 Sep 13 18:10:49.296367 dv-cinder-852009-8-iscsi devstack@n-api.service[120741]: [pid: 120741|app: 0|req: 404/818] 10.222.0.43 () {58 vars in 1236 bytes} [Tue Sep 13 18:10:49 2022] GET /compute/v2.1/servers/75289327-97d1-42bd-a6c7-6f2b1aa3236a => generated 1682 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 13 18:10:50.275751 dv-cinder-852009-8-iscsi devstack@n-api.service[120740]: DEBUG nova.api.openstack.wsgi [req-4586e7b3-5a3b-4666-9477-4fa4b3ddb144 req-5a3c8e95-f6d3-47e8-8683-e7c5d363f82b service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "75289327-97d1-42bd-a6c7-6f2b1aa3236a", "name": "network-vif-deleted", "tag": "4df04d71-3866-4544-aec1-8f254829f81c"}]} {{(pid=120740) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 13 18:10:50.286194 dv-cinder-852009-8-iscsi devstack@n-api.service[120740]: DEBUG oslo_concurrency.lockutils [req-4586e7b3-5a3b-4666-9477-4fa4b3ddb144 req-5a3c8e95-f6d3-47e8-8683-e7c5d363f82b service nova] Acquiring lock "1daf4f4c-0e4a-4779-b53a-78c48397ea2f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120740) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 18:10:50.286758 dv-cinder-852009-8-iscsi devstack@n-api.service[120740]: DEBUG oslo_concurrency.lockutils [req-4586e7b3-5a3b-4666-9477-4fa4b3ddb144 req-5a3c8e95-f6d3-47e8-8683-e7c5d363f82b service nova] Lock "1daf4f4c-0e4a-4779-b53a-78c48397ea2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120740) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 18:10:50.287452 dv-cinder-852009-8-iscsi devstack@n-api.service[120740]: DEBUG oslo_concurrency.lockutils [req-4586e7b3-5a3b-4666-9477-4fa4b3ddb144 req-5a3c8e95-f6d3-47e8-8683-e7c5d363f82b service nova] Lock "1daf4f4c-0e4a-4779-b53a-78c48397ea2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120740) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 18:10:50.300167 dv-cinder-852009-8-iscsi devstack@n-api.service[120740]: INFO nova.api.openstack.compute.server_external_events [req-4586e7b3-5a3b-4666-9477-4fa4b3ddb144 req-5a3c8e95-f6d3-47e8-8683-e7c5d363f82b service nova] Creating event network-vif-deleted:4df04d71-3866-4544-aec1-8f254829f81c for instance 75289327-97d1-42bd-a6c7-6f2b1aa3236a on hv-cinder-85200 Sep 13 18:10:50.305847 dv-cinder-852009-8-iscsi devstack@n-api.service[120740]: INFO nova.api.openstack.requestlog [req-4586e7b3-5a3b-4666-9477-4fa4b3ddb144 req-5a3c8e95-f6d3-47e8-8683-e7c5d363f82b service nova] 10.222.0.43 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.034292 Sep 13 18:10:50.306458 dv-cinder-852009-8-iscsi devstack@n-api.service[120740]: [pid: 120740|app: 0|req: 415/819] 10.222.0.43 () {64 vars in 1317 bytes} [Tue Sep 13 18:10:50 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 36 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 13 18:10:50.322127 dv-cinder-852009-8-iscsi devstack@n-api.service[120741]: DEBUG nova.api.openstack.wsgi [None req-0d675542-0817-417a-ad03-376e74e11ddb tempest-AttachVolumeNegativeTest-1378806597 tempest-AttachVolumeNegativeTest-1378806597-project] Calling method '>' {{(pid=120741) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 18:10:50.323794 dv-cinder-852009-8-iscsi devstack@n-api.service[120741]: DEBUG nova.compute.api [None req-0d675542-0817-417a-ad03-376e74e11ddb tempest-AttachVolumeNegativeTest-1378806597 tempest-AttachVolumeNegativeTest-1378806597-project] [instance: 75289327-97d1-42bd-a6c7-6f2b1aa3236a] Fetching instance by UUID {{(pid=120741) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 18:10:50.332246 dv-cinder-852009-8-iscsi devstack@n-api.service[120741]: DEBUG oslo_concurrency.lockutils [None req-0d675542-0817-417a-ad03-376e74e11ddb tempest-AttachVolumeNegativeTest-1378806597 tempest-AttachVolumeNegativeTest-1378806597-project] Acquiring lock "1daf4f4c-0e4a-4779-b53a-78c48397ea2f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120741) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 18:10:50.333108 dv-cinder-852009-8-iscsi devstack@n-api.service[120741]: DEBUG oslo_concurrency.lockutils [None req-0d675542-0817-417a-ad03-376e74e11ddb tempest-AttachVolumeNegativeTest-1378806597 tempest-AttachVolumeNegativeTest-1378806597-project] Lock "1daf4f4c-0e4a-4779-b53a-78c48397ea2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120741) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 18:10:50.333788 dv-cinder-852009-8-iscsi devstack@n-api.service[120741]: DEBUG oslo_concurrency.lockutils [None req-0d675542-0817-417a-ad03-376e74e11ddb tempest-AttachVolumeNegativeTest-1378806597 tempest-AttachVolumeNegativeTest-1378806597-project] Lock "1daf4f4c-0e4a-4779-b53a-78c48397ea2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120741) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 18:10:50.334557 dv-cinder-852009-8-iscsi devstack@n-api.service[120741]: DEBUG oslo_concurrency.lockutils [None req-0d675542-0817-417a-ad03-376e74e11ddb tempest-AttachVolumeNegativeTest-1378806597 tempest-AttachVolumeNegativeTest-1378806597-project] Acquiring lock "1daf4f4c-0e4a-4779-b53a-78c48397ea2f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120741) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 18:10:50.335641 dv-cinder-852009-8-iscsi devstack@n-api.service[120741]: DEBUG oslo_concurrency.lockutils [None req-0d675542-0817-417a-ad03-376e74e11ddb tempest-AttachVolumeNegativeTest-1378806597 tempest-AttachVolumeNegativeTest-1378806597-project] Lock "1daf4f4c-0e4a-4779-b53a-78c48397ea2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120741) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 18:10:50.336161 dv-cinder-852009-8-iscsi devstack@n-api.service[120741]: DEBUG oslo_concurrency.lockutils [None req-0d675542-0817-417a-ad03-376e74e11ddb tempest-AttachVolumeNegativeTest-1378806597 tempest-AttachVolumeNegativeTest-1378806597-project] Lock "1daf4f4c-0e4a-4779-b53a-78c48397ea2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120741) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 18:10:50.402130 dv-cinder-852009-8-iscsi devstack@n-api.service[120741]: DEBUG nova.policy [None req-0d675542-0817-417a-ad03-376e74e11ddb tempest-AttachVolumeNegativeTest-1378806597 tempest-AttachVolumeNegativeTest-1378806597-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '714cd09ba19b492f9a8c80343abcf6b9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '629311eda0584a5fbb7d8995cf27540c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120741) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 18:10:50.410645 dv-cinder-852009-8-iscsi devstack@n-api.service[120741]: INFO nova.api.openstack.requestlog [None req-0d675542-0817-417a-ad03-376e74e11ddb tempest-AttachVolumeNegativeTest-1378806597 tempest-AttachVolumeNegativeTest-1378806597-project] 10.222.0.43 "GET /compute/v2.1/servers/75289327-97d1-42bd-a6c7-6f2b1aa3236a" status: 200 len: 1326 microversion: 2.1 time: 0.092516 Sep 13 18:10:50.411227 dv-cinder-852009-8-iscsi devstack@n-api.service[120741]: [pid: 120741|app: 0|req: 405/820] 10.222.0.43 () {58 vars in 1236 bytes} [Tue Sep 13 18:10:50 2022] GET /compute/v2.1/servers/75289327-97d1-42bd-a6c7-6f2b1aa3236a => generated 1326 bytes in 94 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 13 18:10:51.439543 dv-cinder-852009-8-iscsi devstack@n-api.service[120740]: DEBUG nova.api.openstack.wsgi [None req-4839e583-3474-401a-8bfb-e58e15b1d1be tempest-AttachVolumeNegativeTest-1378806597 tempest-AttachVolumeNegativeTest-1378806597-project] Calling method '>' {{(pid=120740) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 18:10:51.440725 dv-cinder-852009-8-iscsi devstack@n-api.service[120740]: DEBUG nova.compute.api [None req-4839e583-3474-401a-8bfb-e58e15b1d1be tempest-AttachVolumeNegativeTest-1378806597 tempest-AttachVolumeNegativeTest-1378806597-project] [instance: 75289327-97d1-42bd-a6c7-6f2b1aa3236a] Fetching instance by UUID {{(pid=120740) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 18:10:51.447406 dv-cinder-852009-8-iscsi devstack@n-api.service[120740]: DEBUG oslo_concurrency.lockutils [None req-4839e583-3474-401a-8bfb-e58e15b1d1be tempest-AttachVolumeNegativeTest-1378806597 tempest-AttachVolumeNegativeTest-1378806597-project] Acquiring lock "1daf4f4c-0e4a-4779-b53a-78c48397ea2f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120740) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 18:10:51.447898 dv-cinder-852009-8-iscsi devstack@n-api.service[120740]: DEBUG oslo_concurrency.lockutils [None req-4839e583-3474-401a-8bfb-e58e15b1d1be tempest-AttachVolumeNegativeTest-1378806597 tempest-AttachVolumeNegativeTest-1378806597-project] Lock "1daf4f4c-0e4a-4779-b53a-78c48397ea2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120740) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 18:10:51.448321 dv-cinder-852009-8-iscsi devstack@n-api.service[120740]: DEBUG oslo_concurrency.lockutils [None req-4839e583-3474-401a-8bfb-e58e15b1d1be tempest-AttachVolumeNegativeTest-1378806597 tempest-AttachVolumeNegativeTest-1378806597-project] Lock "1daf4f4c-0e4a-4779-b53a-78c48397ea2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120740) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 18:10:51.449038 dv-cinder-852009-8-iscsi devstack@n-api.service[120740]: DEBUG oslo_concurrency.lockutils [None req-4839e583-3474-401a-8bfb-e58e15b1d1be tempest-AttachVolumeNegativeTest-1378806597 tempest-AttachVolumeNegativeTest-1378806597-project] Acquiring lock "1daf4f4c-0e4a-4779-b53a-78c48397ea2f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120740) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 18:10:51.449478 dv-cinder-852009-8-iscsi devstack@n-api.service[120740]: DEBUG oslo_concurrency.lockutils [None req-4839e583-3474-401a-8bfb-e58e15b1d1be tempest-AttachVolumeNegativeTest-1378806597 tempest-AttachVolumeNegativeTest-1378806597-project] Lock "1daf4f4c-0e4a-4779-b53a-78c48397ea2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120740) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 18:10:51.449890 dv-cinder-852009-8-iscsi devstack@n-api.service[120740]: DEBUG oslo_concurrency.lockutils [None req-4839e583-3474-401a-8bfb-e58e15b1d1be tempest-AttachVolumeNegativeTest-1378806597 tempest-AttachVolumeNegativeTest-1378806597-project] Lock "1daf4f4c-0e4a-4779-b53a-78c48397ea2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120740) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 18:10:51.463261 dv-cinder-852009-8-iscsi devstack@n-api.service[120740]: INFO nova.api.openstack.wsgi [None req-4839e583-3474-401a-8bfb-e58e15b1d1be tempest-AttachVolumeNegativeTest-1378806597 tempest-AttachVolumeNegativeTest-1378806597-project] HTTP exception thrown: Instance 75289327-97d1-42bd-a6c7-6f2b1aa3236a could not be found. Sep 13 18:10:51.464899 dv-cinder-852009-8-iscsi devstack@n-api.service[120740]: DEBUG nova.api.openstack.wsgi [None req-4839e583-3474-401a-8bfb-e58e15b1d1be tempest-AttachVolumeNegativeTest-1378806597 tempest-AttachVolumeNegativeTest-1378806597-project] Request method failure captured: Sep 13 18:10:51.464899 dv-cinder-852009-8-iscsi devstack@n-api.service[120740]: request: GET /compute/v2.1/servers/75289327-97d1-42bd-a6c7-6f2b1aa3236a HTTP/1.1 Sep 13 18:10:51.464899 dv-cinder-852009-8-iscsi devstack@n-api.service[120740]: Accept: application/json Sep 13 18:10:51.464899 dv-cinder-852009-8-iscsi devstack@n-api.service[120740]: Accept-Encoding: identity Sep 13 18:10:51.464899 dv-cinder-852009-8-iscsi devstack@n-api.service[120740]: Connection: close Sep 13 18:10:51.464899 dv-cinder-852009-8-iscsi devstack@n-api.service[120740]: Content-Length: 0 Sep 13 18:10:51.464899 dv-cinder-852009-8-iscsi devstack@n-api.service[120740]: Content-Type: application/json Sep 13 18:10:51.464899 dv-cinder-852009-8-iscsi devstack@n-api.service[120740]: Host: 10.222.0.43 Sep 13 18:10:51.464899 dv-cinder-852009-8-iscsi devstack@n-api.service[120740]: Openstack-System-Scope: None Sep 13 18:10:51.464899 dv-cinder-852009-8-iscsi devstack@n-api.service[120740]: User-Agent: python-urllib3/1.26.12 Sep 13 18:10:51.464899 dv-cinder-852009-8-iscsi devstack@n-api.service[120740]: X-Auth-Token: gAAAAABjIMciYi08KSU35iQHMuJ1d9BLU6OdnvTV0lQhD4NCYaw8no8S5_0xWB47N9lmu7akofQLpLV68heC7pPUCZsTXqIq6Y42WLp6VXHhyQNxgHSYkPKRLV6tG6CCOIlPDetRfNDVZw3BkXYviJ38fOivAdsSaqCGCQ-A5bO5QGkWPiqoF58 Sep 13 18:10:51.464899 dv-cinder-852009-8-iscsi devstack@n-api.service[120740]: X-Domain-Id: None Sep 13 18:10:51.464899 dv-cinder-852009-8-iscsi devstack@n-api.service[120740]: X-Domain-Name: None Sep 13 18:10:51.464899 dv-cinder-852009-8-iscsi devstack@n-api.service[120740]: X-Identity-Status: Confirmed Sep 13 18:10:51.464899 dv-cinder-852009-8-iscsi devstack@n-api.service[120740]: X-Is-Admin-Project: True Sep 13 18:10:51.464899 dv-cinder-852009-8-iscsi devstack@n-api.service[120740]: X-Project-Domain-Id: default Sep 13 18:10:51.464899 dv-cinder-852009-8-iscsi devstack@n-api.service[120740]: X-Project-Domain-Name: Default Sep 13 18:10:51.464899 dv-cinder-852009-8-iscsi devstack@n-api.service[120740]: X-Project-Id: 629311eda0584a5fbb7d8995cf27540c Sep 13 18:10:51.464899 dv-cinder-852009-8-iscsi devstack@n-api.service[120740]: X-Project-Name: tempest-AttachVolumeNegativeTest-1378806597 Sep 13 18:10:51.464899 dv-cinder-852009-8-iscsi devstack@n-api.service[120740]: X-Role: reader,member Sep 13 18:10:51.464899 dv-cinder-852009-8-iscsi devstack@n-api.service[120740]: X-Roles: reader,member Sep 13 18:10:51.466526 dv-cinder-852009-8-iscsi devstack@n-api.service[120740]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/identity"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/compute/v2/629311eda0584a5fbb7d8995cf27540c"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.43:8080", "publicURL": "http://10.222.0.43:8080/v1/AUTH_629311eda0584a5fbb7d8995cf27540c"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43:9696/networking"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/volume/v3/629311eda0584a5fbb7d8995cf27540c"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/compute/v2.1"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/placement"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/volume/v3/629311eda0584a5fbb7d8995cf27540c"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/image"}]}] Sep 13 18:10:51.466526 dv-cinder-852009-8-iscsi devstack@n-api.service[120740]: X-Tenant: tempest-AttachVolumeNegativeTest-1378806597 Sep 13 18:10:51.466526 dv-cinder-852009-8-iscsi devstack@n-api.service[120740]: X-Tenant-Id: 629311eda0584a5fbb7d8995cf27540c Sep 13 18:10:51.466526 dv-cinder-852009-8-iscsi devstack@n-api.service[120740]: X-Tenant-Name: tempest-AttachVolumeNegativeTest-1378806597 Sep 13 18:10:51.466526 dv-cinder-852009-8-iscsi devstack@n-api.service[120740]: X-User: tempest-AttachVolumeNegativeTest-1378806597-project Sep 13 18:10:51.466526 dv-cinder-852009-8-iscsi devstack@n-api.service[120740]: X-User-Domain-Id: default Sep 13 18:10:51.466526 dv-cinder-852009-8-iscsi devstack@n-api.service[120740]: X-User-Domain-Name: Default Sep 13 18:10:51.466526 dv-cinder-852009-8-iscsi devstack@n-api.service[120740]: X-User-Id: 714cd09ba19b492f9a8c80343abcf6b9 Sep 13 18:10:51.466526 dv-cinder-852009-8-iscsi devstack@n-api.service[120740]: X-User-Name: tempest-AttachVolumeNegativeTest-1378806597-project Sep 13 18:10:51.466526 dv-cinder-852009-8-iscsi devstack@n-api.service[120740]: method: > Sep 13 18:10:51.466526 dv-cinder-852009-8-iscsi devstack@n-api.service[120740]: exception: Instance 75289327-97d1-42bd-a6c7-6f2b1aa3236a could not be found. Sep 13 18:10:51.466526 dv-cinder-852009-8-iscsi devstack@n-api.service[120740]: action_args: {'id': '75289327-97d1-42bd-a6c7-6f2b1aa3236a'} Sep 13 18:10:51.467445 dv-cinder-852009-8-iscsi devstack@n-api.service[120740]: {{(pid=120740) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 13 18:10:51.467445 dv-cinder-852009-8-iscsi devstack@n-api.service[120740]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 13 18:10:51.467445 dv-cinder-852009-8-iscsi devstack@n-api.service[120740]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Sep 13 18:10:51.467445 dv-cinder-852009-8-iscsi devstack@n-api.service[120740]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Sep 13 18:10:51.467445 dv-cinder-852009-8-iscsi devstack@n-api.service[120740]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Sep 13 18:10:51.467445 dv-cinder-852009-8-iscsi devstack@n-api.service[120740]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Sep 13 18:10:51.467445 dv-cinder-852009-8-iscsi devstack@n-api.service[120740]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Sep 13 18:10:51.467445 dv-cinder-852009-8-iscsi devstack@n-api.service[120740]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Sep 13 18:10:51.467445 dv-cinder-852009-8-iscsi devstack@n-api.service[120740]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Sep 13 18:10:51.467445 dv-cinder-852009-8-iscsi devstack@n-api.service[120740]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Sep 13 18:10:51.467445 dv-cinder-852009-8-iscsi devstack@n-api.service[120740]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 75289327-97d1-42bd-a6c7-6f2b1aa3236a could not be found. Sep 13 18:10:51.467445 dv-cinder-852009-8-iscsi devstack@n-api.service[120740]: ERROR nova.api.openstack.wsgi Sep 13 18:10:51.467445 dv-cinder-852009-8-iscsi devstack@n-api.service[120740]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 13 18:10:51.467445 dv-cinder-852009-8-iscsi devstack@n-api.service[120740]: ERROR nova.api.openstack.wsgi Sep 13 18:10:51.467445 dv-cinder-852009-8-iscsi devstack@n-api.service[120740]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 13 18:10:51.467445 dv-cinder-852009-8-iscsi devstack@n-api.service[120740]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 13 18:10:51.467445 dv-cinder-852009-8-iscsi devstack@n-api.service[120740]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 13 18:10:51.467445 dv-cinder-852009-8-iscsi devstack@n-api.service[120740]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 13 18:10:51.467445 dv-cinder-852009-8-iscsi devstack@n-api.service[120740]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 13 18:10:51.467445 dv-cinder-852009-8-iscsi devstack@n-api.service[120740]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 13 18:10:51.468958 dv-cinder-852009-8-iscsi devstack@n-api.service[120740]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 13 18:10:51.468958 dv-cinder-852009-8-iscsi devstack@n-api.service[120740]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Sep 13 18:10:51.468958 dv-cinder-852009-8-iscsi devstack@n-api.service[120740]: ERROR nova.api.openstack.wsgi instance = self._get_server( Sep 13 18:10:51.468958 dv-cinder-852009-8-iscsi devstack@n-api.service[120740]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Sep 13 18:10:51.468958 dv-cinder-852009-8-iscsi devstack@n-api.service[120740]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Sep 13 18:10:51.468958 dv-cinder-852009-8-iscsi devstack@n-api.service[120740]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Sep 13 18:10:51.468958 dv-cinder-852009-8-iscsi devstack@n-api.service[120740]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Sep 13 18:10:51.468958 dv-cinder-852009-8-iscsi devstack@n-api.service[120740]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 75289327-97d1-42bd-a6c7-6f2b1aa3236a could not be found. Sep 13 18:10:51.468958 dv-cinder-852009-8-iscsi devstack@n-api.service[120740]: ERROR nova.api.openstack.wsgi Sep 13 18:10:51.468958 dv-cinder-852009-8-iscsi devstack@n-api.service[120740]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 13 18:10:51.468958 dv-cinder-852009-8-iscsi devstack@n-api.service[120740]: ERROR nova.api.openstack.wsgi Sep 13 18:10:51.468958 dv-cinder-852009-8-iscsi devstack@n-api.service[120740]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 13 18:10:51.468958 dv-cinder-852009-8-iscsi devstack@n-api.service[120740]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 13 18:10:51.468958 dv-cinder-852009-8-iscsi devstack@n-api.service[120740]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 13 18:10:51.468958 dv-cinder-852009-8-iscsi devstack@n-api.service[120740]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 13 18:10:51.468958 dv-cinder-852009-8-iscsi devstack@n-api.service[120740]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 13 18:10:51.468958 dv-cinder-852009-8-iscsi devstack@n-api.service[120740]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 75289327-97d1-42bd-a6c7-6f2b1aa3236a could not be found. Sep 13 18:10:51.468958 dv-cinder-852009-8-iscsi devstack@n-api.service[120740]: ERROR nova.api.openstack.wsgi Sep 13 18:10:51.470327 dv-cinder-852009-8-iscsi devstack@n-api.service[120740]: DEBUG nova.api.openstack.wsgi [None req-4839e583-3474-401a-8bfb-e58e15b1d1be tempest-AttachVolumeNegativeTest-1378806597 tempest-AttachVolumeNegativeTest-1378806597-project] Returning 404 to user: Instance 75289327-97d1-42bd-a6c7-6f2b1aa3236a could not be found. {{(pid=120740) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 13 18:10:51.470327 dv-cinder-852009-8-iscsi devstack@n-api.service[120740]: INFO nova.api.openstack.requestlog [None req-4839e583-3474-401a-8bfb-e58e15b1d1be tempest-AttachVolumeNegativeTest-1378806597 tempest-AttachVolumeNegativeTest-1378806597-project] 10.222.0.43 "GET /compute/v2.1/servers/75289327-97d1-42bd-a6c7-6f2b1aa3236a" status: 404 len: 111 microversion: 2.1 time: 0.034488 Sep 13 18:10:51.470327 dv-cinder-852009-8-iscsi devstack@n-api.service[120740]: [pid: 120740|app: 0|req: 416/821] 10.222.0.43 () {58 vars in 1236 bytes} [Tue Sep 13 18:10:51 2022] GET /compute/v2.1/servers/75289327-97d1-42bd-a6c7-6f2b1aa3236a => generated 111 bytes in 36 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Sep 13 18:10:51.475246 dv-cinder-852009-8-iscsi devstack@n-api.service[120741]: DEBUG nova.api.openstack.wsgi [None req-842faf17-8d7d-4417-b664-d0cd294a57c1 tempest-AttachVolumeNegativeTest-1378806597 tempest-AttachVolumeNegativeTest-1378806597-project] Calling method '.version_select at 0x7fa6269d3940>' {{(pid=120741) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 18:10:51.496153 dv-cinder-852009-8-iscsi devstack@n-api.service[120741]: INFO nova.api.openstack.requestlog [None req-842faf17-8d7d-4417-b664-d0cd294a57c1 tempest-AttachVolumeNegativeTest-1378806597 tempest-AttachVolumeNegativeTest-1378806597-project] 10.222.0.43 "DELETE /compute/v2.1/os-keypairs/tempest-keypair-695244385" status: 202 len: 0 microversion: 2.1 time: 0.024685 Sep 13 18:10:51.496646 dv-cinder-852009-8-iscsi devstack@n-api.service[120741]: [pid: 120741|app: 0|req: 406/822] 10.222.0.43 () {58 vars in 1218 bytes} [Tue Sep 13 18:10:51 2022] DELETE /compute/v2.1/os-keypairs/tempest-keypair-695244385 => generated 0 bytes in 26 msecs (HTTP/1.1 202) 9 headers in 361 bytes (2 switches on core 0) Sep 13 18:10:52.144800 dv-cinder-852009-8-iscsi devstack@n-api.service[120740]: DEBUG nova.api.openstack.wsgi [None req-05eab417-e81c-46c2-8c1f-19b1e8f6abb1 tempest-AttachVolumeNegativeTest-1378806597 tempest-AttachVolumeNegativeTest-1378806597-project] Action: 'create', calling method: .version_select at 0x7fa62695f1f0>, body: {"keypair": {"name": "tempest-keypair-1779374111", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBIXvt35rnc/MkYhyaClpbGE/Gan+qPqthafdsk3ft0LZSoe0YHJWCHpMyfo6nQgY4xOtFQBKfU99Zloa0DSS8dBQO6tCcC4k9DJyxjphBUgmVj0d4g6wZKvc8j98GY/NeA=="}} {{(pid=120740) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 13 18:10:52.160642 dv-cinder-852009-8-iscsi devstack@n-api.service[120740]: DEBUG nova.quota [None req-05eab417-e81c-46c2-8c1f-19b1e8f6abb1 tempest-AttachVolumeNegativeTest-1378806597 tempest-AttachVolumeNegativeTest-1378806597-project] Getting quotas for project 629311eda0584a5fbb7d8995cf27540c. Resources: {'key_pairs'} {{(pid=120740) _get_quotas /opt/stack/nova/nova/quota.py:393}} Sep 13 18:10:52.164896 dv-cinder-852009-8-iscsi devstack@n-api.service[120740]: DEBUG nova.quota [None req-05eab417-e81c-46c2-8c1f-19b1e8f6abb1 tempest-AttachVolumeNegativeTest-1378806597 tempest-AttachVolumeNegativeTest-1378806597-project] Getting quotas for user 714cd09ba19b492f9a8c80343abcf6b9 and project 629311eda0584a5fbb7d8995cf27540c. Resources: {'key_pairs'} {{(pid=120740) _get_quotas /opt/stack/nova/nova/quota.py:383}} Sep 13 18:10:52.189228 dv-cinder-852009-8-iscsi devstack@n-api.service[120740]: INFO nova.api.openstack.requestlog [None req-05eab417-e81c-46c2-8c1f-19b1e8f6abb1 tempest-AttachVolumeNegativeTest-1378806597 tempest-AttachVolumeNegativeTest-1378806597-project] 10.222.0.43 "POST /compute/v2.1/os-keypairs" status: 200 len: 386 microversion: 2.1 time: 0.050460 Sep 13 18:10:52.189824 dv-cinder-852009-8-iscsi devstack@n-api.service[120740]: [pid: 120740|app: 0|req: 417/823] 10.222.0.43 () {60 vars in 1159 bytes} [Tue Sep 13 18:10:52 2022] POST /compute/v2.1/os-keypairs => generated 386 bytes in 52 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 13 18:10:53.492970 dv-cinder-852009-8-iscsi devstack@n-api.service[120741]: DEBUG nova.api.openstack.wsgi [None req-4f56fd80-5f59-406b-8bef-0f70ab829a06 tempest-AttachVolumeNegativeTest-1378806597 tempest-AttachVolumeNegativeTest-1378806597-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-AttachVolumeNegativeTest-server-538474916", "imageRef": "33034e36-e6b2-4847-92a1-ff3188c05a4a", "flavorRef": "452", "adminPass": "***", "networks": [{"uuid": "e19c1043-1c23-4c64-9720-4320d6d11eef"}], "security_groups": [{"name": "tempest-securitygroup--44277507"}], "key_name": "tempest-keypair-1779374111", "user_data": "}} {{(pid=120741) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 13 18:10:53.597874 dv-cinder-852009-8-iscsi devstack@n-api.service[120741]: DEBUG nova.network.neutron [None req-4f56fd80-5f59-406b-8bef-0f70ab829a06 tempest-AttachVolumeNegativeTest-1378806597 tempest-AttachVolumeNegativeTest-1378806597-project] validate_networks() for [('e19c1043-1c23-4c64-9720-4320d6d11eef', None, None, None, None, None)] {{(pid=120741) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Sep 13 18:10:54.222283 dv-cinder-852009-8-iscsi devstack@n-api.service[120741]: DEBUG nova.virt.hardware [None req-4f56fd80-5f59-406b-8bef-0f70ab829a06 tempest-AttachVolumeNegativeTest-1378806597 tempest-AttachVolumeNegativeTest-1378806597-project] Flavor limits 0:0:0 {{(pid=120741) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Sep 13 18:10:54.222990 dv-cinder-852009-8-iscsi devstack@n-api.service[120741]: DEBUG nova.virt.hardware [None req-4f56fd80-5f59-406b-8bef-0f70ab829a06 tempest-AttachVolumeNegativeTest-1378806597 tempest-AttachVolumeNegativeTest-1378806597-project] Image limits 0:0:0 {{(pid=120741) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Sep 13 18:10:54.223664 dv-cinder-852009-8-iscsi devstack@n-api.service[120741]: DEBUG nova.virt.hardware [None req-4f56fd80-5f59-406b-8bef-0f70ab829a06 tempest-AttachVolumeNegativeTest-1378806597 tempest-AttachVolumeNegativeTest-1378806597-project] Flavor pref 0:0:0 {{(pid=120741) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Sep 13 18:10:54.224349 dv-cinder-852009-8-iscsi devstack@n-api.service[120741]: DEBUG nova.virt.hardware [None req-4f56fd80-5f59-406b-8bef-0f70ab829a06 tempest-AttachVolumeNegativeTest-1378806597 tempest-AttachVolumeNegativeTest-1378806597-project] Image pref 0:0:0 {{(pid=120741) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Sep 13 18:10:54.224934 dv-cinder-852009-8-iscsi devstack@n-api.service[120741]: DEBUG nova.virt.hardware [None req-4f56fd80-5f59-406b-8bef-0f70ab829a06 tempest-AttachVolumeNegativeTest-1378806597 tempest-AttachVolumeNegativeTest-1378806597-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=120741) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Sep 13 18:10:54.236289 dv-cinder-852009-8-iscsi devstack@n-api.service[120741]: DEBUG oslo_concurrency.lockutils [None req-4f56fd80-5f59-406b-8bef-0f70ab829a06 tempest-AttachVolumeNegativeTest-1378806597 tempest-AttachVolumeNegativeTest-1378806597-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120741) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 18:10:54.236982 dv-cinder-852009-8-iscsi devstack@n-api.service[120741]: DEBUG oslo_concurrency.lockutils [None req-4f56fd80-5f59-406b-8bef-0f70ab829a06 tempest-AttachVolumeNegativeTest-1378806597 tempest-AttachVolumeNegativeTest-1378806597-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120741) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 18:10:54.237233 dv-cinder-852009-8-iscsi devstack@n-api.service[120741]: DEBUG oslo_concurrency.lockutils [None req-4f56fd80-5f59-406b-8bef-0f70ab829a06 tempest-AttachVolumeNegativeTest-1378806597 tempest-AttachVolumeNegativeTest-1378806597-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120741) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 18:10:54.238764 dv-cinder-852009-8-iscsi devstack@n-api.service[120741]: DEBUG oslo_concurrency.lockutils [None req-4f56fd80-5f59-406b-8bef-0f70ab829a06 tempest-AttachVolumeNegativeTest-1378806597 tempest-AttachVolumeNegativeTest-1378806597-project] Acquiring lock "1daf4f4c-0e4a-4779-b53a-78c48397ea2f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120741) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 18:10:54.239504 dv-cinder-852009-8-iscsi devstack@n-api.service[120741]: DEBUG oslo_concurrency.lockutils [None req-4f56fd80-5f59-406b-8bef-0f70ab829a06 tempest-AttachVolumeNegativeTest-1378806597 tempest-AttachVolumeNegativeTest-1378806597-project] Lock "1daf4f4c-0e4a-4779-b53a-78c48397ea2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120741) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 18:10:54.239822 dv-cinder-852009-8-iscsi devstack@n-api.service[120741]: DEBUG oslo_concurrency.lockutils [None req-4f56fd80-5f59-406b-8bef-0f70ab829a06 tempest-AttachVolumeNegativeTest-1378806597 tempest-AttachVolumeNegativeTest-1378806597-project] Lock "1daf4f4c-0e4a-4779-b53a-78c48397ea2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120741) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 18:10:54.259543 dv-cinder-852009-8-iscsi devstack@n-api.service[120741]: DEBUG nova.quota [None req-4f56fd80-5f59-406b-8bef-0f70ab829a06 tempest-AttachVolumeNegativeTest-1378806597 tempest-AttachVolumeNegativeTest-1378806597-project] Getting quotas for project 629311eda0584a5fbb7d8995cf27540c. Resources: {'cores', 'ram', 'instances'} {{(pid=120741) _get_quotas /opt/stack/nova/nova/quota.py:393}} Sep 13 18:10:54.263513 dv-cinder-852009-8-iscsi devstack@n-api.service[120741]: DEBUG nova.quota [None req-4f56fd80-5f59-406b-8bef-0f70ab829a06 tempest-AttachVolumeNegativeTest-1378806597 tempest-AttachVolumeNegativeTest-1378806597-project] Getting quotas for user 714cd09ba19b492f9a8c80343abcf6b9 and project 629311eda0584a5fbb7d8995cf27540c. Resources: {'cores', 'ram', 'instances'} {{(pid=120741) _get_quotas /opt/stack/nova/nova/quota.py:383}} Sep 13 18:10:54.275551 dv-cinder-852009-8-iscsi devstack@n-api.service[120741]: DEBUG nova.compute.api [None req-4f56fd80-5f59-406b-8bef-0f70ab829a06 tempest-AttachVolumeNegativeTest-1378806597 tempest-AttachVolumeNegativeTest-1378806597-project] Going to run 1 instances... {{(pid=120741) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Sep 13 18:10:54.278095 dv-cinder-852009-8-iscsi devstack@n-api.service[120741]: DEBUG nova.compute.api [None req-4f56fd80-5f59-406b-8bef-0f70ab829a06 tempest-AttachVolumeNegativeTest-1378806597 tempest-AttachVolumeNegativeTest-1378806597-project] [instance: ed450488-2c80-4d82-8621-b55727628db1] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='33034e36-e6b2-4847-92a1-ff3188c05a4a',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=120741) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Sep 13 18:10:54.328295 dv-cinder-852009-8-iscsi devstack@n-api.service[120741]: INFO nova.api.openstack.requestlog [None req-4f56fd80-5f59-406b-8bef-0f70ab829a06 tempest-AttachVolumeNegativeTest-1378806597 tempest-AttachVolumeNegativeTest-1378806597-project] 10.222.0.43 "POST /compute/v2.1/servers" status: 202 len: 400 microversion: 2.1 time: 0.840674 Sep 13 18:10:54.328985 dv-cinder-852009-8-iscsi devstack@n-api.service[120741]: [pid: 120741|app: 0|req: 407/824] 10.222.0.43 () {60 vars in 1147 bytes} [Tue Sep 13 18:10:53 2022] POST /compute/v2.1/servers => generated 400 bytes in 842 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Sep 13 18:10:54.341070 dv-cinder-852009-8-iscsi devstack@n-api.service[120740]: DEBUG nova.api.openstack.wsgi [None req-3b3ed207-9c31-495f-accd-296de86ca6df tempest-AttachVolumeNegativeTest-1378806597 tempest-AttachVolumeNegativeTest-1378806597-project] Calling method '>' {{(pid=120740) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 18:10:54.341758 dv-cinder-852009-8-iscsi devstack@n-api.service[120740]: DEBUG nova.compute.api [None req-3b3ed207-9c31-495f-accd-296de86ca6df tempest-AttachVolumeNegativeTest-1378806597 tempest-AttachVolumeNegativeTest-1378806597-project] [instance: ed450488-2c80-4d82-8621-b55727628db1] Fetching instance by UUID {{(pid=120740) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 18:10:54.400739 dv-cinder-852009-8-iscsi devstack@n-api.service[120740]: DEBUG nova.policy [None req-3b3ed207-9c31-495f-accd-296de86ca6df tempest-AttachVolumeNegativeTest-1378806597 tempest-AttachVolumeNegativeTest-1378806597-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '714cd09ba19b492f9a8c80343abcf6b9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '629311eda0584a5fbb7d8995cf27540c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120740) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 18:10:54.407895 dv-cinder-852009-8-iscsi devstack@n-api.service[120740]: INFO nova.api.openstack.requestlog [None req-3b3ed207-9c31-495f-accd-296de86ca6df tempest-AttachVolumeNegativeTest-1378806597 tempest-AttachVolumeNegativeTest-1378806597-project] 10.222.0.43 "GET /compute/v2.1/servers/ed450488-2c80-4d82-8621-b55727628db1" status: 200 len: 1241 microversion: 2.1 time: 0.071431 Sep 13 18:10:54.408583 dv-cinder-852009-8-iscsi devstack@n-api.service[120740]: [pid: 120740|app: 0|req: 418/825] 10.222.0.43 () {58 vars in 1236 bytes} [Tue Sep 13 18:10:54 2022] GET /compute/v2.1/servers/ed450488-2c80-4d82-8621-b55727628db1 => generated 1241 bytes in 73 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 13 18:10:55.431570 dv-cinder-852009-8-iscsi devstack@n-api.service[120741]: DEBUG nova.api.openstack.wsgi [None req-84b9fd5e-ee79-4108-a846-f22b5e37ec32 tempest-AttachVolumeNegativeTest-1378806597 tempest-AttachVolumeNegativeTest-1378806597-project] Calling method '>' {{(pid=120741) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 18:10:55.432178 dv-cinder-852009-8-iscsi devstack@n-api.service[120741]: DEBUG nova.compute.api [None req-84b9fd5e-ee79-4108-a846-f22b5e37ec32 tempest-AttachVolumeNegativeTest-1378806597 tempest-AttachVolumeNegativeTest-1378806597-project] [instance: ed450488-2c80-4d82-8621-b55727628db1] Fetching instance by UUID {{(pid=120741) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 18:10:55.440089 dv-cinder-852009-8-iscsi devstack@n-api.service[120741]: DEBUG oslo_concurrency.lockutils [None req-84b9fd5e-ee79-4108-a846-f22b5e37ec32 tempest-AttachVolumeNegativeTest-1378806597 tempest-AttachVolumeNegativeTest-1378806597-project] Acquiring lock "1daf4f4c-0e4a-4779-b53a-78c48397ea2f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120741) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 18:10:55.440601 dv-cinder-852009-8-iscsi devstack@n-api.service[120741]: DEBUG oslo_concurrency.lockutils [None req-84b9fd5e-ee79-4108-a846-f22b5e37ec32 tempest-AttachVolumeNegativeTest-1378806597 tempest-AttachVolumeNegativeTest-1378806597-project] Lock "1daf4f4c-0e4a-4779-b53a-78c48397ea2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120741) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 18:10:55.441163 dv-cinder-852009-8-iscsi devstack@n-api.service[120741]: DEBUG oslo_concurrency.lockutils [None req-84b9fd5e-ee79-4108-a846-f22b5e37ec32 tempest-AttachVolumeNegativeTest-1378806597 tempest-AttachVolumeNegativeTest-1378806597-project] Lock "1daf4f4c-0e4a-4779-b53a-78c48397ea2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120741) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 18:10:55.441867 dv-cinder-852009-8-iscsi devstack@n-api.service[120741]: DEBUG oslo_concurrency.lockutils [None req-84b9fd5e-ee79-4108-a846-f22b5e37ec32 tempest-AttachVolumeNegativeTest-1378806597 tempest-AttachVolumeNegativeTest-1378806597-project] Acquiring lock "1daf4f4c-0e4a-4779-b53a-78c48397ea2f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120741) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 18:10:55.442319 dv-cinder-852009-8-iscsi devstack@n-api.service[120741]: DEBUG oslo_concurrency.lockutils [None req-84b9fd5e-ee79-4108-a846-f22b5e37ec32 tempest-AttachVolumeNegativeTest-1378806597 tempest-AttachVolumeNegativeTest-1378806597-project] Lock "1daf4f4c-0e4a-4779-b53a-78c48397ea2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120741) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 18:10:55.442757 dv-cinder-852009-8-iscsi devstack@n-api.service[120741]: DEBUG oslo_concurrency.lockutils [None req-84b9fd5e-ee79-4108-a846-f22b5e37ec32 tempest-AttachVolumeNegativeTest-1378806597 tempest-AttachVolumeNegativeTest-1378806597-project] Lock "1daf4f4c-0e4a-4779-b53a-78c48397ea2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120741) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 18:10:55.508317 dv-cinder-852009-8-iscsi devstack@n-api.service[120741]: DEBUG nova.policy [None req-84b9fd5e-ee79-4108-a846-f22b5e37ec32 tempest-AttachVolumeNegativeTest-1378806597 tempest-AttachVolumeNegativeTest-1378806597-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '714cd09ba19b492f9a8c80343abcf6b9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '629311eda0584a5fbb7d8995cf27540c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120741) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 18:10:55.518426 dv-cinder-852009-8-iscsi devstack@n-api.service[120741]: INFO nova.api.openstack.requestlog [None req-84b9fd5e-ee79-4108-a846-f22b5e37ec32 tempest-AttachVolumeNegativeTest-1378806597 tempest-AttachVolumeNegativeTest-1378806597-project] 10.222.0.43 "GET /compute/v2.1/servers/ed450488-2c80-4d82-8621-b55727628db1" status: 200 len: 1311 microversion: 2.1 time: 0.090733 Sep 13 18:10:55.519416 dv-cinder-852009-8-iscsi devstack@n-api.service[120741]: [pid: 120741|app: 0|req: 408/826] 10.222.0.43 () {58 vars in 1236 bytes} [Tue Sep 13 18:10:55 2022] GET /compute/v2.1/servers/ed450488-2c80-4d82-8621-b55727628db1 => generated 1311 bytes in 93 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 13 18:10:56.543412 dv-cinder-852009-8-iscsi devstack@n-api.service[120740]: DEBUG nova.api.openstack.wsgi [None req-2fcbc9ea-7013-4d83-8523-ca569cd7f1a4 tempest-AttachVolumeNegativeTest-1378806597 tempest-AttachVolumeNegativeTest-1378806597-project] Calling method '>' {{(pid=120740) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 18:10:56.544193 dv-cinder-852009-8-iscsi devstack@n-api.service[120740]: DEBUG nova.compute.api [None req-2fcbc9ea-7013-4d83-8523-ca569cd7f1a4 tempest-AttachVolumeNegativeTest-1378806597 tempest-AttachVolumeNegativeTest-1378806597-project] [instance: ed450488-2c80-4d82-8621-b55727628db1] Fetching instance by UUID {{(pid=120740) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 18:10:56.551365 dv-cinder-852009-8-iscsi devstack@n-api.service[120740]: DEBUG oslo_concurrency.lockutils [None req-2fcbc9ea-7013-4d83-8523-ca569cd7f1a4 tempest-AttachVolumeNegativeTest-1378806597 tempest-AttachVolumeNegativeTest-1378806597-project] Acquiring lock "1daf4f4c-0e4a-4779-b53a-78c48397ea2f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120740) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 18:10:56.551938 dv-cinder-852009-8-iscsi devstack@n-api.service[120740]: DEBUG oslo_concurrency.lockutils [None req-2fcbc9ea-7013-4d83-8523-ca569cd7f1a4 tempest-AttachVolumeNegativeTest-1378806597 tempest-AttachVolumeNegativeTest-1378806597-project] Lock "1daf4f4c-0e4a-4779-b53a-78c48397ea2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120740) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 18:10:56.552452 dv-cinder-852009-8-iscsi devstack@n-api.service[120740]: DEBUG oslo_concurrency.lockutils [None req-2fcbc9ea-7013-4d83-8523-ca569cd7f1a4 tempest-AttachVolumeNegativeTest-1378806597 tempest-AttachVolumeNegativeTest-1378806597-project] Lock "1daf4f4c-0e4a-4779-b53a-78c48397ea2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120740) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 18:10:56.553182 dv-cinder-852009-8-iscsi devstack@n-api.service[120740]: DEBUG oslo_concurrency.lockutils [None req-2fcbc9ea-7013-4d83-8523-ca569cd7f1a4 tempest-AttachVolumeNegativeTest-1378806597 tempest-AttachVolumeNegativeTest-1378806597-project] Acquiring lock "1daf4f4c-0e4a-4779-b53a-78c48397ea2f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120740) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 18:10:56.553635 dv-cinder-852009-8-iscsi devstack@n-api.service[120740]: DEBUG oslo_concurrency.lockutils [None req-2fcbc9ea-7013-4d83-8523-ca569cd7f1a4 tempest-AttachVolumeNegativeTest-1378806597 tempest-AttachVolumeNegativeTest-1378806597-project] Lock "1daf4f4c-0e4a-4779-b53a-78c48397ea2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120740) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 18:10:56.554100 dv-cinder-852009-8-iscsi devstack@n-api.service[120740]: DEBUG oslo_concurrency.lockutils [None req-2fcbc9ea-7013-4d83-8523-ca569cd7f1a4 tempest-AttachVolumeNegativeTest-1378806597 tempest-AttachVolumeNegativeTest-1378806597-project] Lock "1daf4f4c-0e4a-4779-b53a-78c48397ea2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120740) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 18:10:56.572788 dv-cinder-852009-8-iscsi devstack@n-api.service[120740]: DEBUG dbcounter [-] [120740] Writing DB stats nova_cell1:SELECT=95,nova_cell1:UPDATE=2,nova_cell1:INSERT=3 {{(pid=120740) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 18:10:56.696679 dv-cinder-852009-8-iscsi devstack@n-api.service[120740]: DEBUG nova.policy [None req-2fcbc9ea-7013-4d83-8523-ca569cd7f1a4 tempest-AttachVolumeNegativeTest-1378806597 tempest-AttachVolumeNegativeTest-1378806597-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '714cd09ba19b492f9a8c80343abcf6b9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '629311eda0584a5fbb7d8995cf27540c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120740) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 18:10:56.704642 dv-cinder-852009-8-iscsi devstack@n-api.service[120740]: INFO nova.api.openstack.requestlog [None req-2fcbc9ea-7013-4d83-8523-ca569cd7f1a4 tempest-AttachVolumeNegativeTest-1378806597 tempest-AttachVolumeNegativeTest-1378806597-project] 10.222.0.43 "GET /compute/v2.1/servers/ed450488-2c80-4d82-8621-b55727628db1" status: 200 len: 1365 microversion: 2.1 time: 0.165160 Sep 13 18:10:56.705223 dv-cinder-852009-8-iscsi devstack@n-api.service[120740]: [pid: 120740|app: 0|req: 419/827] 10.222.0.43 () {58 vars in 1236 bytes} [Tue Sep 13 18:10:56 2022] GET /compute/v2.1/servers/ed450488-2c80-4d82-8621-b55727628db1 => generated 1365 bytes in 166 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 13 18:10:56.752714 dv-cinder-852009-8-iscsi devstack@n-api.service[120741]: DEBUG nova.api.openstack.wsgi [req-7d5bf53e-23ec-4e4d-88f8-673e18574c55 req-8516b01e-24c7-4bfc-858e-59a52d5b6711 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "ed450488-2c80-4d82-8621-b55727628db1", "tag": "3d065c9a-0e6e-4104-9f7a-99af060b5230"}]} {{(pid=120741) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 13 18:10:56.772170 dv-cinder-852009-8-iscsi devstack@n-api.service[120741]: DEBUG oslo_concurrency.lockutils [req-7d5bf53e-23ec-4e4d-88f8-673e18574c55 req-8516b01e-24c7-4bfc-858e-59a52d5b6711 service nova] Acquiring lock "1daf4f4c-0e4a-4779-b53a-78c48397ea2f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120741) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 18:10:56.772776 dv-cinder-852009-8-iscsi devstack@n-api.service[120741]: DEBUG oslo_concurrency.lockutils [req-7d5bf53e-23ec-4e4d-88f8-673e18574c55 req-8516b01e-24c7-4bfc-858e-59a52d5b6711 service nova] Lock "1daf4f4c-0e4a-4779-b53a-78c48397ea2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120741) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 18:10:56.773060 dv-cinder-852009-8-iscsi devstack@n-api.service[120741]: DEBUG oslo_concurrency.lockutils [req-7d5bf53e-23ec-4e4d-88f8-673e18574c55 req-8516b01e-24c7-4bfc-858e-59a52d5b6711 service nova] Lock "1daf4f4c-0e4a-4779-b53a-78c48397ea2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120741) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 18:10:56.788212 dv-cinder-852009-8-iscsi devstack@n-api.service[120741]: INFO nova.api.openstack.compute.server_external_events [req-7d5bf53e-23ec-4e4d-88f8-673e18574c55 req-8516b01e-24c7-4bfc-858e-59a52d5b6711 service nova] Creating event network-changed:3d065c9a-0e6e-4104-9f7a-99af060b5230 for instance ed450488-2c80-4d82-8621-b55727628db1 on hv-cinder-85200 Sep 13 18:10:56.794363 dv-cinder-852009-8-iscsi devstack@n-api.service[120741]: INFO nova.api.openstack.requestlog [req-7d5bf53e-23ec-4e4d-88f8-673e18574c55 req-8516b01e-24c7-4bfc-858e-59a52d5b6711 service nova] 10.222.0.43 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.046105 Sep 13 18:10:56.795033 dv-cinder-852009-8-iscsi devstack@n-api.service[120741]: [pid: 120741|app: 0|req: 409/828] 10.222.0.43 () {64 vars in 1317 bytes} [Tue Sep 13 18:10:56 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 48 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 13 18:10:57.728753 dv-cinder-852009-8-iscsi devstack@n-api.service[120740]: DEBUG nova.api.openstack.wsgi [None req-de860cdf-cf70-4e88-970d-ae901d809193 tempest-AttachVolumeNegativeTest-1378806597 tempest-AttachVolumeNegativeTest-1378806597-project] Calling method '>' {{(pid=120740) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 18:10:57.729410 dv-cinder-852009-8-iscsi devstack@n-api.service[120740]: DEBUG nova.compute.api [None req-de860cdf-cf70-4e88-970d-ae901d809193 tempest-AttachVolumeNegativeTest-1378806597 tempest-AttachVolumeNegativeTest-1378806597-project] [instance: ed450488-2c80-4d82-8621-b55727628db1] Fetching instance by UUID {{(pid=120740) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 18:10:57.735885 dv-cinder-852009-8-iscsi devstack@n-api.service[120740]: DEBUG oslo_concurrency.lockutils [None req-de860cdf-cf70-4e88-970d-ae901d809193 tempest-AttachVolumeNegativeTest-1378806597 tempest-AttachVolumeNegativeTest-1378806597-project] Acquiring lock "1daf4f4c-0e4a-4779-b53a-78c48397ea2f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120740) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 18:10:57.736653 dv-cinder-852009-8-iscsi devstack@n-api.service[120740]: DEBUG oslo_concurrency.lockutils [None req-de860cdf-cf70-4e88-970d-ae901d809193 tempest-AttachVolumeNegativeTest-1378806597 tempest-AttachVolumeNegativeTest-1378806597-project] Lock "1daf4f4c-0e4a-4779-b53a-78c48397ea2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120740) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 18:10:57.737183 dv-cinder-852009-8-iscsi devstack@n-api.service[120740]: DEBUG oslo_concurrency.lockutils [None req-de860cdf-cf70-4e88-970d-ae901d809193 tempest-AttachVolumeNegativeTest-1378806597 tempest-AttachVolumeNegativeTest-1378806597-project] Lock "1daf4f4c-0e4a-4779-b53a-78c48397ea2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120740) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 18:10:57.738450 dv-cinder-852009-8-iscsi devstack@n-api.service[120740]: DEBUG oslo_concurrency.lockutils [None req-de860cdf-cf70-4e88-970d-ae901d809193 tempest-AttachVolumeNegativeTest-1378806597 tempest-AttachVolumeNegativeTest-1378806597-project] Acquiring lock "1daf4f4c-0e4a-4779-b53a-78c48397ea2f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120740) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 18:10:57.738868 dv-cinder-852009-8-iscsi devstack@n-api.service[120740]: DEBUG oslo_concurrency.lockutils [None req-de860cdf-cf70-4e88-970d-ae901d809193 tempest-AttachVolumeNegativeTest-1378806597 tempest-AttachVolumeNegativeTest-1378806597-project] Lock "1daf4f4c-0e4a-4779-b53a-78c48397ea2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120740) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 18:10:57.739292 dv-cinder-852009-8-iscsi devstack@n-api.service[120740]: DEBUG oslo_concurrency.lockutils [None req-de860cdf-cf70-4e88-970d-ae901d809193 tempest-AttachVolumeNegativeTest-1378806597 tempest-AttachVolumeNegativeTest-1378806597-project] Lock "1daf4f4c-0e4a-4779-b53a-78c48397ea2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120740) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 18:10:57.878939 dv-cinder-852009-8-iscsi devstack@n-api.service[120740]: DEBUG nova.policy [None req-de860cdf-cf70-4e88-970d-ae901d809193 tempest-AttachVolumeNegativeTest-1378806597 tempest-AttachVolumeNegativeTest-1378806597-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '714cd09ba19b492f9a8c80343abcf6b9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '629311eda0584a5fbb7d8995cf27540c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120740) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 18:10:57.887231 dv-cinder-852009-8-iscsi devstack@n-api.service[120740]: INFO nova.api.openstack.requestlog [None req-de860cdf-cf70-4e88-970d-ae901d809193 tempest-AttachVolumeNegativeTest-1378806597 tempest-AttachVolumeNegativeTest-1378806597-project] 10.222.0.43 "GET /compute/v2.1/servers/ed450488-2c80-4d82-8621-b55727628db1" status: 200 len: 1365 microversion: 2.1 time: 0.162807 Sep 13 18:10:57.887848 dv-cinder-852009-8-iscsi devstack@n-api.service[120740]: [pid: 120740|app: 0|req: 420/829] 10.222.0.43 () {58 vars in 1236 bytes} [Tue Sep 13 18:10:57 2022] GET /compute/v2.1/servers/ed450488-2c80-4d82-8621-b55727628db1 => generated 1365 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 13 18:10:58.917776 dv-cinder-852009-8-iscsi devstack@n-api.service[120741]: DEBUG nova.api.openstack.wsgi [None req-ff419b5e-bbda-42c8-87ac-8fd365b52918 tempest-AttachVolumeNegativeTest-1378806597 tempest-AttachVolumeNegativeTest-1378806597-project] Calling method '>' {{(pid=120741) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 18:10:58.918636 dv-cinder-852009-8-iscsi devstack@n-api.service[120741]: DEBUG nova.compute.api [None req-ff419b5e-bbda-42c8-87ac-8fd365b52918 tempest-AttachVolumeNegativeTest-1378806597 tempest-AttachVolumeNegativeTest-1378806597-project] [instance: ed450488-2c80-4d82-8621-b55727628db1] Fetching instance by UUID {{(pid=120741) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 18:10:58.926014 dv-cinder-852009-8-iscsi devstack@n-api.service[120741]: DEBUG oslo_concurrency.lockutils [None req-ff419b5e-bbda-42c8-87ac-8fd365b52918 tempest-AttachVolumeNegativeTest-1378806597 tempest-AttachVolumeNegativeTest-1378806597-project] Acquiring lock "1daf4f4c-0e4a-4779-b53a-78c48397ea2f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120741) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 18:10:58.926505 dv-cinder-852009-8-iscsi devstack@n-api.service[120741]: DEBUG oslo_concurrency.lockutils [None req-ff419b5e-bbda-42c8-87ac-8fd365b52918 tempest-AttachVolumeNegativeTest-1378806597 tempest-AttachVolumeNegativeTest-1378806597-project] Lock "1daf4f4c-0e4a-4779-b53a-78c48397ea2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120741) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 18:10:58.926943 dv-cinder-852009-8-iscsi devstack@n-api.service[120741]: DEBUG oslo_concurrency.lockutils [None req-ff419b5e-bbda-42c8-87ac-8fd365b52918 tempest-AttachVolumeNegativeTest-1378806597 tempest-AttachVolumeNegativeTest-1378806597-project] Lock "1daf4f4c-0e4a-4779-b53a-78c48397ea2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120741) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 18:10:58.927651 dv-cinder-852009-8-iscsi devstack@n-api.service[120741]: DEBUG oslo_concurrency.lockutils [None req-ff419b5e-bbda-42c8-87ac-8fd365b52918 tempest-AttachVolumeNegativeTest-1378806597 tempest-AttachVolumeNegativeTest-1378806597-project] Acquiring lock "1daf4f4c-0e4a-4779-b53a-78c48397ea2f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120741) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 18:10:58.928107 dv-cinder-852009-8-iscsi devstack@n-api.service[120741]: DEBUG oslo_concurrency.lockutils [None req-ff419b5e-bbda-42c8-87ac-8fd365b52918 tempest-AttachVolumeNegativeTest-1378806597 tempest-AttachVolumeNegativeTest-1378806597-project] Lock "1daf4f4c-0e4a-4779-b53a-78c48397ea2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120741) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 18:10:58.928549 dv-cinder-852009-8-iscsi devstack@n-api.service[120741]: DEBUG oslo_concurrency.lockutils [None req-ff419b5e-bbda-42c8-87ac-8fd365b52918 tempest-AttachVolumeNegativeTest-1378806597 tempest-AttachVolumeNegativeTest-1378806597-project] Lock "1daf4f4c-0e4a-4779-b53a-78c48397ea2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120741) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 18:10:59.066630 dv-cinder-852009-8-iscsi devstack@n-api.service[120741]: DEBUG nova.policy [None req-ff419b5e-bbda-42c8-87ac-8fd365b52918 tempest-AttachVolumeNegativeTest-1378806597 tempest-AttachVolumeNegativeTest-1378806597-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '714cd09ba19b492f9a8c80343abcf6b9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '629311eda0584a5fbb7d8995cf27540c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120741) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 18:10:59.075177 dv-cinder-852009-8-iscsi devstack@n-api.service[120741]: INFO nova.api.openstack.requestlog [None req-ff419b5e-bbda-42c8-87ac-8fd365b52918 tempest-AttachVolumeNegativeTest-1378806597 tempest-AttachVolumeNegativeTest-1378806597-project] 10.222.0.43 "GET /compute/v2.1/servers/ed450488-2c80-4d82-8621-b55727628db1" status: 200 len: 1365 microversion: 2.1 time: 0.161696 Sep 13 18:10:59.075819 dv-cinder-852009-8-iscsi devstack@n-api.service[120741]: [pid: 120741|app: 0|req: 410/830] 10.222.0.43 () {58 vars in 1236 bytes} [Tue Sep 13 18:10:58 2022] GET /compute/v2.1/servers/ed450488-2c80-4d82-8621-b55727628db1 => generated 1365 bytes in 169 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 13 18:11:00.102957 dv-cinder-852009-8-iscsi devstack@n-api.service[120740]: DEBUG nova.api.openstack.wsgi [None req-c623ed9c-72d8-476c-a136-662b9397af34 tempest-AttachVolumeNegativeTest-1378806597 tempest-AttachVolumeNegativeTest-1378806597-project] Calling method '>' {{(pid=120740) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 18:11:00.103901 dv-cinder-852009-8-iscsi devstack@n-api.service[120740]: DEBUG nova.compute.api [None req-c623ed9c-72d8-476c-a136-662b9397af34 tempest-AttachVolumeNegativeTest-1378806597 tempest-AttachVolumeNegativeTest-1378806597-project] [instance: ed450488-2c80-4d82-8621-b55727628db1] Fetching instance by UUID {{(pid=120740) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 18:11:00.114288 dv-cinder-852009-8-iscsi devstack@n-api.service[120740]: DEBUG oslo_concurrency.lockutils [None req-c623ed9c-72d8-476c-a136-662b9397af34 tempest-AttachVolumeNegativeTest-1378806597 tempest-AttachVolumeNegativeTest-1378806597-project] Acquiring lock "1daf4f4c-0e4a-4779-b53a-78c48397ea2f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120740) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 18:11:00.114776 dv-cinder-852009-8-iscsi devstack@n-api.service[120740]: DEBUG oslo_concurrency.lockutils [None req-c623ed9c-72d8-476c-a136-662b9397af34 tempest-AttachVolumeNegativeTest-1378806597 tempest-AttachVolumeNegativeTest-1378806597-project] Lock "1daf4f4c-0e4a-4779-b53a-78c48397ea2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120740) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 18:11:00.115239 dv-cinder-852009-8-iscsi devstack@n-api.service[120740]: DEBUG oslo_concurrency.lockutils [None req-c623ed9c-72d8-476c-a136-662b9397af34 tempest-AttachVolumeNegativeTest-1378806597 tempest-AttachVolumeNegativeTest-1378806597-project] Lock "1daf4f4c-0e4a-4779-b53a-78c48397ea2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120740) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 18:11:00.115914 dv-cinder-852009-8-iscsi devstack@n-api.service[120740]: DEBUG oslo_concurrency.lockutils [None req-c623ed9c-72d8-476c-a136-662b9397af34 tempest-AttachVolumeNegativeTest-1378806597 tempest-AttachVolumeNegativeTest-1378806597-project] Acquiring lock "1daf4f4c-0e4a-4779-b53a-78c48397ea2f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120740) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 18:11:00.116356 dv-cinder-852009-8-iscsi devstack@n-api.service[120740]: DEBUG oslo_concurrency.lockutils [None req-c623ed9c-72d8-476c-a136-662b9397af34 tempest-AttachVolumeNegativeTest-1378806597 tempest-AttachVolumeNegativeTest-1378806597-project] Lock "1daf4f4c-0e4a-4779-b53a-78c48397ea2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120740) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 18:11:00.116802 dv-cinder-852009-8-iscsi devstack@n-api.service[120740]: DEBUG oslo_concurrency.lockutils [None req-c623ed9c-72d8-476c-a136-662b9397af34 tempest-AttachVolumeNegativeTest-1378806597 tempest-AttachVolumeNegativeTest-1378806597-project] Lock "1daf4f4c-0e4a-4779-b53a-78c48397ea2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120740) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 18:11:00.254837 dv-cinder-852009-8-iscsi devstack@n-api.service[120740]: DEBUG nova.policy [None req-c623ed9c-72d8-476c-a136-662b9397af34 tempest-AttachVolumeNegativeTest-1378806597 tempest-AttachVolumeNegativeTest-1378806597-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '714cd09ba19b492f9a8c80343abcf6b9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '629311eda0584a5fbb7d8995cf27540c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120740) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 18:11:00.263725 dv-cinder-852009-8-iscsi devstack@n-api.service[120740]: INFO nova.api.openstack.requestlog [None req-c623ed9c-72d8-476c-a136-662b9397af34 tempest-AttachVolumeNegativeTest-1378806597 tempest-AttachVolumeNegativeTest-1378806597-project] 10.222.0.43 "GET /compute/v2.1/servers/ed450488-2c80-4d82-8621-b55727628db1" status: 200 len: 1365 microversion: 2.1 time: 0.167280 Sep 13 18:11:00.264363 dv-cinder-852009-8-iscsi devstack@n-api.service[120740]: [pid: 120740|app: 0|req: 421/831] 10.222.0.43 () {58 vars in 1236 bytes} [Tue Sep 13 18:11:00 2022] GET /compute/v2.1/servers/ed450488-2c80-4d82-8621-b55727628db1 => generated 1365 bytes in 169 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 13 18:11:01.067379 dv-cinder-852009-8-iscsi devstack@n-api.service[120741]: DEBUG nova.api.openstack.wsgi [req-94654cf5-f2c0-4bc1-ac11-9b47a297809c req-5038d212-7d01-43f0-905e-884dec3c16cf service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "ed450488-2c80-4d82-8621-b55727628db1", "name": "network-vif-plugged", "status": "completed", "tag": "3d065c9a-0e6e-4104-9f7a-99af060b5230"}]} {{(pid=120741) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 13 18:11:01.078423 dv-cinder-852009-8-iscsi devstack@n-api.service[120741]: DEBUG oslo_concurrency.lockutils [req-94654cf5-f2c0-4bc1-ac11-9b47a297809c req-5038d212-7d01-43f0-905e-884dec3c16cf service nova] Acquiring lock "1daf4f4c-0e4a-4779-b53a-78c48397ea2f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120741) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 18:11:01.079086 dv-cinder-852009-8-iscsi devstack@n-api.service[120741]: DEBUG oslo_concurrency.lockutils [req-94654cf5-f2c0-4bc1-ac11-9b47a297809c req-5038d212-7d01-43f0-905e-884dec3c16cf service nova] Lock "1daf4f4c-0e4a-4779-b53a-78c48397ea2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120741) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 18:11:01.079732 dv-cinder-852009-8-iscsi devstack@n-api.service[120741]: DEBUG oslo_concurrency.lockutils [req-94654cf5-f2c0-4bc1-ac11-9b47a297809c req-5038d212-7d01-43f0-905e-884dec3c16cf service nova] Lock "1daf4f4c-0e4a-4779-b53a-78c48397ea2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120741) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 18:11:01.091495 dv-cinder-852009-8-iscsi devstack@n-api.service[120741]: INFO nova.api.openstack.compute.server_external_events [req-94654cf5-f2c0-4bc1-ac11-9b47a297809c req-5038d212-7d01-43f0-905e-884dec3c16cf service nova] Creating event network-vif-plugged:3d065c9a-0e6e-4104-9f7a-99af060b5230 for instance ed450488-2c80-4d82-8621-b55727628db1 on hv-cinder-85200 Sep 13 18:11:01.096218 dv-cinder-852009-8-iscsi devstack@n-api.service[120741]: INFO nova.api.openstack.requestlog [req-94654cf5-f2c0-4bc1-ac11-9b47a297809c req-5038d212-7d01-43f0-905e-884dec3c16cf service nova] 10.222.0.43 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.032810 Sep 13 18:11:01.096883 dv-cinder-852009-8-iscsi devstack@n-api.service[120741]: [pid: 120741|app: 0|req: 411/832] 10.222.0.43 () {64 vars in 1317 bytes} [Tue Sep 13 18:11:01 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 34 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 13 18:11:01.287730 dv-cinder-852009-8-iscsi devstack@n-api.service[120740]: DEBUG nova.api.openstack.wsgi [None req-25c168d2-7d44-4760-9a7e-9647adf2da15 tempest-AttachVolumeNegativeTest-1378806597 tempest-AttachVolumeNegativeTest-1378806597-project] Calling method '>' {{(pid=120740) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 18:11:01.288320 dv-cinder-852009-8-iscsi devstack@n-api.service[120740]: DEBUG nova.compute.api [None req-25c168d2-7d44-4760-9a7e-9647adf2da15 tempest-AttachVolumeNegativeTest-1378806597 tempest-AttachVolumeNegativeTest-1378806597-project] [instance: ed450488-2c80-4d82-8621-b55727628db1] Fetching instance by UUID {{(pid=120740) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 18:11:01.294698 dv-cinder-852009-8-iscsi devstack@n-api.service[120740]: DEBUG oslo_concurrency.lockutils [None req-25c168d2-7d44-4760-9a7e-9647adf2da15 tempest-AttachVolumeNegativeTest-1378806597 tempest-AttachVolumeNegativeTest-1378806597-project] Acquiring lock "1daf4f4c-0e4a-4779-b53a-78c48397ea2f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120740) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 18:11:01.295422 dv-cinder-852009-8-iscsi devstack@n-api.service[120740]: DEBUG oslo_concurrency.lockutils [None req-25c168d2-7d44-4760-9a7e-9647adf2da15 tempest-AttachVolumeNegativeTest-1378806597 tempest-AttachVolumeNegativeTest-1378806597-project] Lock "1daf4f4c-0e4a-4779-b53a-78c48397ea2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120740) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 18:11:01.295846 dv-cinder-852009-8-iscsi devstack@n-api.service[120740]: DEBUG oslo_concurrency.lockutils [None req-25c168d2-7d44-4760-9a7e-9647adf2da15 tempest-AttachVolumeNegativeTest-1378806597 tempest-AttachVolumeNegativeTest-1378806597-project] Lock "1daf4f4c-0e4a-4779-b53a-78c48397ea2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120740) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 18:11:01.296550 dv-cinder-852009-8-iscsi devstack@n-api.service[120740]: DEBUG oslo_concurrency.lockutils [None req-25c168d2-7d44-4760-9a7e-9647adf2da15 tempest-AttachVolumeNegativeTest-1378806597 tempest-AttachVolumeNegativeTest-1378806597-project] Acquiring lock "1daf4f4c-0e4a-4779-b53a-78c48397ea2f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120740) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 18:11:01.296995 dv-cinder-852009-8-iscsi devstack@n-api.service[120740]: DEBUG oslo_concurrency.lockutils [None req-25c168d2-7d44-4760-9a7e-9647adf2da15 tempest-AttachVolumeNegativeTest-1378806597 tempest-AttachVolumeNegativeTest-1378806597-project] Lock "1daf4f4c-0e4a-4779-b53a-78c48397ea2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120740) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 18:11:01.297408 dv-cinder-852009-8-iscsi devstack@n-api.service[120740]: DEBUG oslo_concurrency.lockutils [None req-25c168d2-7d44-4760-9a7e-9647adf2da15 tempest-AttachVolumeNegativeTest-1378806597 tempest-AttachVolumeNegativeTest-1378806597-project] Lock "1daf4f4c-0e4a-4779-b53a-78c48397ea2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120740) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 18:11:01.430741 dv-cinder-852009-8-iscsi devstack@n-api.service[120740]: DEBUG nova.policy [None req-25c168d2-7d44-4760-9a7e-9647adf2da15 tempest-AttachVolumeNegativeTest-1378806597 tempest-AttachVolumeNegativeTest-1378806597-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '714cd09ba19b492f9a8c80343abcf6b9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '629311eda0584a5fbb7d8995cf27540c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120740) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 18:11:01.438820 dv-cinder-852009-8-iscsi devstack@n-api.service[120740]: INFO nova.api.openstack.requestlog [None req-25c168d2-7d44-4760-9a7e-9647adf2da15 tempest-AttachVolumeNegativeTest-1378806597 tempest-AttachVolumeNegativeTest-1378806597-project] 10.222.0.43 "GET /compute/v2.1/servers/ed450488-2c80-4d82-8621-b55727628db1" status: 200 len: 1365 microversion: 2.1 time: 0.155453 Sep 13 18:11:01.439385 dv-cinder-852009-8-iscsi devstack@n-api.service[120740]: [pid: 120740|app: 0|req: 422/833] 10.222.0.43 () {58 vars in 1236 bytes} [Tue Sep 13 18:11:01 2022] GET /compute/v2.1/servers/ed450488-2c80-4d82-8621-b55727628db1 => generated 1365 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 13 18:11:02.467562 dv-cinder-852009-8-iscsi devstack@n-api.service[120741]: DEBUG nova.api.openstack.wsgi [None req-913dbe79-53ce-4e47-93ea-bc3071afb882 tempest-AttachVolumeNegativeTest-1378806597 tempest-AttachVolumeNegativeTest-1378806597-project] Calling method '>' {{(pid=120741) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 18:11:02.468759 dv-cinder-852009-8-iscsi devstack@n-api.service[120741]: DEBUG nova.compute.api [None req-913dbe79-53ce-4e47-93ea-bc3071afb882 tempest-AttachVolumeNegativeTest-1378806597 tempest-AttachVolumeNegativeTest-1378806597-project] [instance: ed450488-2c80-4d82-8621-b55727628db1] Fetching instance by UUID {{(pid=120741) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 18:11:02.471768 dv-cinder-852009-8-iscsi devstack@n-api.service[120741]: DEBUG dbcounter [-] [120741] Writing DB stats nova_api:SELECT=61,nova_api:DELETE=2,nova_api:UPDATE=1,nova_api:INSERT=3 {{(pid=120741) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 18:11:02.481381 dv-cinder-852009-8-iscsi devstack@n-api.service[120741]: DEBUG oslo_concurrency.lockutils [None req-913dbe79-53ce-4e47-93ea-bc3071afb882 tempest-AttachVolumeNegativeTest-1378806597 tempest-AttachVolumeNegativeTest-1378806597-project] Acquiring lock "1daf4f4c-0e4a-4779-b53a-78c48397ea2f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120741) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 18:11:02.482175 dv-cinder-852009-8-iscsi devstack@n-api.service[120741]: DEBUG oslo_concurrency.lockutils [None req-913dbe79-53ce-4e47-93ea-bc3071afb882 tempest-AttachVolumeNegativeTest-1378806597 tempest-AttachVolumeNegativeTest-1378806597-project] Lock "1daf4f4c-0e4a-4779-b53a-78c48397ea2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120741) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 18:11:02.482908 dv-cinder-852009-8-iscsi devstack@n-api.service[120741]: DEBUG oslo_concurrency.lockutils [None req-913dbe79-53ce-4e47-93ea-bc3071afb882 tempest-AttachVolumeNegativeTest-1378806597 tempest-AttachVolumeNegativeTest-1378806597-project] Lock "1daf4f4c-0e4a-4779-b53a-78c48397ea2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120741) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 18:11:02.484054 dv-cinder-852009-8-iscsi devstack@n-api.service[120741]: DEBUG oslo_concurrency.lockutils [None req-913dbe79-53ce-4e47-93ea-bc3071afb882 tempest-AttachVolumeNegativeTest-1378806597 tempest-AttachVolumeNegativeTest-1378806597-project] Acquiring lock "1daf4f4c-0e4a-4779-b53a-78c48397ea2f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120741) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 18:11:02.484867 dv-cinder-852009-8-iscsi devstack@n-api.service[120741]: DEBUG oslo_concurrency.lockutils [None req-913dbe79-53ce-4e47-93ea-bc3071afb882 tempest-AttachVolumeNegativeTest-1378806597 tempest-AttachVolumeNegativeTest-1378806597-project] Lock "1daf4f4c-0e4a-4779-b53a-78c48397ea2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120741) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 18:11:02.485561 dv-cinder-852009-8-iscsi devstack@n-api.service[120741]: DEBUG oslo_concurrency.lockutils [None req-913dbe79-53ce-4e47-93ea-bc3071afb882 tempest-AttachVolumeNegativeTest-1378806597 tempest-AttachVolumeNegativeTest-1378806597-project] Lock "1daf4f4c-0e4a-4779-b53a-78c48397ea2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120741) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 18:11:02.490417 dv-cinder-852009-8-iscsi devstack@n-api.service[120741]: DEBUG dbcounter [-] [120741] Writing DB stats nova_cell1:SELECT=96,nova_cell1:INSERT=2,nova_cell1:UPDATE=1 {{(pid=120741) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 18:11:02.620952 dv-cinder-852009-8-iscsi devstack@n-api.service[120741]: DEBUG nova.policy [None req-913dbe79-53ce-4e47-93ea-bc3071afb882 tempest-AttachVolumeNegativeTest-1378806597 tempest-AttachVolumeNegativeTest-1378806597-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '714cd09ba19b492f9a8c80343abcf6b9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '629311eda0584a5fbb7d8995cf27540c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120741) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 18:11:02.629157 dv-cinder-852009-8-iscsi devstack@n-api.service[120741]: INFO nova.api.openstack.requestlog [None req-913dbe79-53ce-4e47-93ea-bc3071afb882 tempest-AttachVolumeNegativeTest-1378806597 tempest-AttachVolumeNegativeTest-1378806597-project] 10.222.0.43 "GET /compute/v2.1/servers/ed450488-2c80-4d82-8621-b55727628db1" status: 200 len: 1556 microversion: 2.1 time: 0.169668 Sep 13 18:11:02.629728 dv-cinder-852009-8-iscsi devstack@n-api.service[120741]: [pid: 120741|app: 0|req: 412/834] 10.222.0.43 () {58 vars in 1236 bytes} [Tue Sep 13 18:11:02 2022] GET /compute/v2.1/servers/ed450488-2c80-4d82-8621-b55727628db1 => generated 1556 bytes in 172 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 13 18:11:02.651816 dv-cinder-852009-8-iscsi devstack@n-api.service[120740]: DEBUG nova.api.openstack.wsgi [None req-9b799215-7221-4649-aa58-c2c20d6ae45d tempest-AttachVolumeNegativeTest-1378806597 tempest-AttachVolumeNegativeTest-1378806597-project] Calling method '>' {{(pid=120740) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 18:11:02.652363 dv-cinder-852009-8-iscsi devstack@n-api.service[120740]: DEBUG nova.compute.api [None req-9b799215-7221-4649-aa58-c2c20d6ae45d tempest-AttachVolumeNegativeTest-1378806597 tempest-AttachVolumeNegativeTest-1378806597-project] [instance: ed450488-2c80-4d82-8621-b55727628db1] Fetching instance by UUID {{(pid=120740) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 18:11:02.654694 dv-cinder-852009-8-iscsi devstack@n-api.service[120740]: DEBUG dbcounter [-] [120740] Writing DB stats nova_api:SELECT=64,nova_api:UPDATE=2,nova_api:INSERT=1 {{(pid=120740) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 18:11:02.659828 dv-cinder-852009-8-iscsi devstack@n-api.service[120740]: DEBUG oslo_concurrency.lockutils [None req-9b799215-7221-4649-aa58-c2c20d6ae45d tempest-AttachVolumeNegativeTest-1378806597 tempest-AttachVolumeNegativeTest-1378806597-project] Acquiring lock "1daf4f4c-0e4a-4779-b53a-78c48397ea2f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120740) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 18:11:02.660295 dv-cinder-852009-8-iscsi devstack@n-api.service[120740]: DEBUG oslo_concurrency.lockutils [None req-9b799215-7221-4649-aa58-c2c20d6ae45d tempest-AttachVolumeNegativeTest-1378806597 tempest-AttachVolumeNegativeTest-1378806597-project] Lock "1daf4f4c-0e4a-4779-b53a-78c48397ea2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120740) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 18:11:02.660823 dv-cinder-852009-8-iscsi devstack@n-api.service[120740]: DEBUG oslo_concurrency.lockutils [None req-9b799215-7221-4649-aa58-c2c20d6ae45d tempest-AttachVolumeNegativeTest-1378806597 tempest-AttachVolumeNegativeTest-1378806597-project] Lock "1daf4f4c-0e4a-4779-b53a-78c48397ea2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120740) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 18:11:02.661502 dv-cinder-852009-8-iscsi devstack@n-api.service[120740]: DEBUG oslo_concurrency.lockutils [None req-9b799215-7221-4649-aa58-c2c20d6ae45d tempest-AttachVolumeNegativeTest-1378806597 tempest-AttachVolumeNegativeTest-1378806597-project] Acquiring lock "1daf4f4c-0e4a-4779-b53a-78c48397ea2f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120740) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 18:11:02.661943 dv-cinder-852009-8-iscsi devstack@n-api.service[120740]: DEBUG oslo_concurrency.lockutils [None req-9b799215-7221-4649-aa58-c2c20d6ae45d tempest-AttachVolumeNegativeTest-1378806597 tempest-AttachVolumeNegativeTest-1378806597-project] Lock "1daf4f4c-0e4a-4779-b53a-78c48397ea2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120740) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 18:11:02.662353 dv-cinder-852009-8-iscsi devstack@n-api.service[120740]: DEBUG oslo_concurrency.lockutils [None req-9b799215-7221-4649-aa58-c2c20d6ae45d tempest-AttachVolumeNegativeTest-1378806597 tempest-AttachVolumeNegativeTest-1378806597-project] Lock "1daf4f4c-0e4a-4779-b53a-78c48397ea2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120740) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 18:11:02.740926 dv-cinder-852009-8-iscsi devstack@n-api.service[120740]: INFO nova.api.openstack.requestlog [None req-9b799215-7221-4649-aa58-c2c20d6ae45d tempest-AttachVolumeNegativeTest-1378806597 tempest-AttachVolumeNegativeTest-1378806597-project] 10.222.0.43 "GET /compute/v2.1/servers/ed450488-2c80-4d82-8621-b55727628db1/os-interface" status: 200 len: 285 microversion: 2.1 time: 0.092553 Sep 13 18:11:02.741580 dv-cinder-852009-8-iscsi devstack@n-api.service[120740]: [pid: 120740|app: 0|req: 423/835] 10.222.0.43 () {58 vars in 1275 bytes} [Tue Sep 13 18:11:02 2022] GET /compute/v2.1/servers/ed450488-2c80-4d82-8621-b55727628db1/os-interface => generated 285 bytes in 94 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Sep 13 18:11:03.719851 dv-cinder-852009-8-iscsi devstack@n-api.service[120741]: DEBUG nova.api.openstack.wsgi [req-56618b1b-b856-49a3-8b63-13975d999cf6 req-6aac0030-9f7e-4062-bf3d-e0b349e6c9a1 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "ed450488-2c80-4d82-8621-b55727628db1", "tag": "3d065c9a-0e6e-4104-9f7a-99af060b5230"}]} {{(pid=120741) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 13 18:11:03.735713 dv-cinder-852009-8-iscsi devstack@n-api.service[120741]: DEBUG oslo_concurrency.lockutils [req-56618b1b-b856-49a3-8b63-13975d999cf6 req-6aac0030-9f7e-4062-bf3d-e0b349e6c9a1 service nova] Acquiring lock "1daf4f4c-0e4a-4779-b53a-78c48397ea2f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120741) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 18:11:03.736194 dv-cinder-852009-8-iscsi devstack@n-api.service[120741]: DEBUG oslo_concurrency.lockutils [req-56618b1b-b856-49a3-8b63-13975d999cf6 req-6aac0030-9f7e-4062-bf3d-e0b349e6c9a1 service nova] Lock "1daf4f4c-0e4a-4779-b53a-78c48397ea2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120741) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 18:11:03.736667 dv-cinder-852009-8-iscsi devstack@n-api.service[120741]: DEBUG oslo_concurrency.lockutils [req-56618b1b-b856-49a3-8b63-13975d999cf6 req-6aac0030-9f7e-4062-bf3d-e0b349e6c9a1 service nova] Lock "1daf4f4c-0e4a-4779-b53a-78c48397ea2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120741) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 18:11:03.748031 dv-cinder-852009-8-iscsi devstack@n-api.service[120741]: INFO nova.api.openstack.compute.server_external_events [req-56618b1b-b856-49a3-8b63-13975d999cf6 req-6aac0030-9f7e-4062-bf3d-e0b349e6c9a1 service nova] Creating event network-changed:3d065c9a-0e6e-4104-9f7a-99af060b5230 for instance ed450488-2c80-4d82-8621-b55727628db1 on hv-cinder-85200 Sep 13 18:11:03.753468 dv-cinder-852009-8-iscsi devstack@n-api.service[120741]: INFO nova.api.openstack.requestlog [req-56618b1b-b856-49a3-8b63-13975d999cf6 req-6aac0030-9f7e-4062-bf3d-e0b349e6c9a1 service nova] 10.222.0.43 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.037313 Sep 13 18:11:03.754117 dv-cinder-852009-8-iscsi devstack@n-api.service[120741]: [pid: 120741|app: 0|req: 413/836] 10.222.0.43 () {64 vars in 1317 bytes} [Tue Sep 13 18:11:03 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 39 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 13 18:11:39.903849 dv-cinder-852009-8-iscsi devstack@n-api.service[120740]: DEBUG dbcounter [-] [120740] Writing DB stats nova_cell0:SELECT=6 {{(pid=120740) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 18:11:39.904955 dv-cinder-852009-8-iscsi devstack@n-api.service[120740]: DEBUG dbcounter [-] [120740] Writing DB stats nova_api:SELECT=1 {{(pid=120740) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 18:11:39.905867 dv-cinder-852009-8-iscsi devstack@n-api.service[120740]: DEBUG dbcounter [-] [120740] Writing DB stats nova_cell1:SELECT=24 {{(pid=120740) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 18:11:39.911133 dv-cinder-852009-8-iscsi devstack@n-api.service[120740]: DEBUG nova.api.openstack.wsgi [None req-30ec777b-653a-4f04-9be6-8a7e03ad8621 tempest-AttachVolumeNegativeTest-1378806597 tempest-AttachVolumeNegativeTest-1378806597-project] Calling method '>' {{(pid=120740) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 18:11:39.911730 dv-cinder-852009-8-iscsi devstack@n-api.service[120740]: DEBUG nova.compute.api [None req-30ec777b-653a-4f04-9be6-8a7e03ad8621 tempest-AttachVolumeNegativeTest-1378806597 tempest-AttachVolumeNegativeTest-1378806597-project] [instance: ed450488-2c80-4d82-8621-b55727628db1] Fetching instance by UUID {{(pid=120740) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 18:11:39.921328 dv-cinder-852009-8-iscsi devstack@n-api.service[120740]: DEBUG oslo_concurrency.lockutils [None req-30ec777b-653a-4f04-9be6-8a7e03ad8621 tempest-AttachVolumeNegativeTest-1378806597 tempest-AttachVolumeNegativeTest-1378806597-project] Acquiring lock "1daf4f4c-0e4a-4779-b53a-78c48397ea2f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120740) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 18:11:39.921969 dv-cinder-852009-8-iscsi devstack@n-api.service[120740]: DEBUG oslo_concurrency.lockutils [None req-30ec777b-653a-4f04-9be6-8a7e03ad8621 tempest-AttachVolumeNegativeTest-1378806597 tempest-AttachVolumeNegativeTest-1378806597-project] Lock "1daf4f4c-0e4a-4779-b53a-78c48397ea2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120740) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 18:11:39.922529 dv-cinder-852009-8-iscsi devstack@n-api.service[120740]: DEBUG oslo_concurrency.lockutils [None req-30ec777b-653a-4f04-9be6-8a7e03ad8621 tempest-AttachVolumeNegativeTest-1378806597 tempest-AttachVolumeNegativeTest-1378806597-project] Lock "1daf4f4c-0e4a-4779-b53a-78c48397ea2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120740) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 18:11:39.923431 dv-cinder-852009-8-iscsi devstack@n-api.service[120740]: DEBUG oslo_concurrency.lockutils [None req-30ec777b-653a-4f04-9be6-8a7e03ad8621 tempest-AttachVolumeNegativeTest-1378806597 tempest-AttachVolumeNegativeTest-1378806597-project] Acquiring lock "1daf4f4c-0e4a-4779-b53a-78c48397ea2f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120740) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 18:11:39.924020 dv-cinder-852009-8-iscsi devstack@n-api.service[120740]: DEBUG oslo_concurrency.lockutils [None req-30ec777b-653a-4f04-9be6-8a7e03ad8621 tempest-AttachVolumeNegativeTest-1378806597 tempest-AttachVolumeNegativeTest-1378806597-project] Lock "1daf4f4c-0e4a-4779-b53a-78c48397ea2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120740) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 18:11:39.924617 dv-cinder-852009-8-iscsi devstack@n-api.service[120740]: DEBUG oslo_concurrency.lockutils [None req-30ec777b-653a-4f04-9be6-8a7e03ad8621 tempest-AttachVolumeNegativeTest-1378806597 tempest-AttachVolumeNegativeTest-1378806597-project] Lock "1daf4f4c-0e4a-4779-b53a-78c48397ea2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120740) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 18:11:39.949472 dv-cinder-852009-8-iscsi devstack@n-api.service[120740]: INFO nova.api.openstack.requestlog [None req-30ec777b-653a-4f04-9be6-8a7e03ad8621 tempest-AttachVolumeNegativeTest-1378806597 tempest-AttachVolumeNegativeTest-1378806597-project] 10.222.0.43 "GET /compute/v2.1/servers/ed450488-2c80-4d82-8621-b55727628db1/ips" status: 200 len: 150 microversion: 2.1 time: 0.047553 Sep 13 18:11:39.950016 dv-cinder-852009-8-iscsi devstack@n-api.service[120740]: [pid: 120740|app: 0|req: 424/837] 10.222.0.43 () {58 vars in 1248 bytes} [Tue Sep 13 18:11:39 2022] GET /compute/v2.1/servers/ed450488-2c80-4d82-8621-b55727628db1/ips => generated 150 bytes in 49 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 13 18:11:41.317672 dv-cinder-852009-8-iscsi devstack@n-api.service[120741]: DEBUG dbcounter [-] [120741] Writing DB stats nova_cell0:SELECT=2 {{(pid=120741) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 18:11:41.318450 dv-cinder-852009-8-iscsi devstack@n-api.service[120741]: DEBUG dbcounter [-] [120741] Writing DB stats nova_cell0:SELECT=6 {{(pid=120741) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 18:11:41.320231 dv-cinder-852009-8-iscsi devstack@n-api.service[120741]: DEBUG dbcounter [-] [120741] Writing DB stats nova_api:SELECT=3 {{(pid=120741) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 18:11:41.320938 dv-cinder-852009-8-iscsi devstack@n-api.service[120741]: DEBUG dbcounter [-] [120741] Writing DB stats nova_cell1:SELECT=7 {{(pid=120741) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 18:11:41.326250 dv-cinder-852009-8-iscsi devstack@n-api.service[120741]: DEBUG nova.api.openstack.wsgi [None req-29c349ff-3a9b-471e-b920-78995a544d6c tempest-AttachVolumeNegativeTest-1378806597 tempest-AttachVolumeNegativeTest-1378806597-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "8eb9c4ad-89b2-4f79-ab6f-b8790f8f591c"}} {{(pid=120741) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 13 18:11:41.328720 dv-cinder-852009-8-iscsi devstack@n-api.service[120741]: DEBUG nova.compute.api [None req-29c349ff-3a9b-471e-b920-78995a544d6c tempest-AttachVolumeNegativeTest-1378806597 tempest-AttachVolumeNegativeTest-1378806597-project] [instance: ed450488-2c80-4d82-8621-b55727628db1] Fetching instance by UUID {{(pid=120741) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 18:11:41.336653 dv-cinder-852009-8-iscsi devstack@n-api.service[120741]: DEBUG oslo_concurrency.lockutils [None req-29c349ff-3a9b-471e-b920-78995a544d6c tempest-AttachVolumeNegativeTest-1378806597 tempest-AttachVolumeNegativeTest-1378806597-project] Acquiring lock "1daf4f4c-0e4a-4779-b53a-78c48397ea2f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120741) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 18:11:41.337132 dv-cinder-852009-8-iscsi devstack@n-api.service[120741]: DEBUG oslo_concurrency.lockutils [None req-29c349ff-3a9b-471e-b920-78995a544d6c tempest-AttachVolumeNegativeTest-1378806597 tempest-AttachVolumeNegativeTest-1378806597-project] Lock "1daf4f4c-0e4a-4779-b53a-78c48397ea2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120741) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 18:11:41.337566 dv-cinder-852009-8-iscsi devstack@n-api.service[120741]: DEBUG oslo_concurrency.lockutils [None req-29c349ff-3a9b-471e-b920-78995a544d6c tempest-AttachVolumeNegativeTest-1378806597 tempest-AttachVolumeNegativeTest-1378806597-project] Lock "1daf4f4c-0e4a-4779-b53a-78c48397ea2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120741) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 18:11:41.338286 dv-cinder-852009-8-iscsi devstack@n-api.service[120741]: DEBUG oslo_concurrency.lockutils [None req-29c349ff-3a9b-471e-b920-78995a544d6c tempest-AttachVolumeNegativeTest-1378806597 tempest-AttachVolumeNegativeTest-1378806597-project] Acquiring lock "1daf4f4c-0e4a-4779-b53a-78c48397ea2f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120741) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 18:11:41.338741 dv-cinder-852009-8-iscsi devstack@n-api.service[120741]: DEBUG oslo_concurrency.lockutils [None req-29c349ff-3a9b-471e-b920-78995a544d6c tempest-AttachVolumeNegativeTest-1378806597 tempest-AttachVolumeNegativeTest-1378806597-project] Lock "1daf4f4c-0e4a-4779-b53a-78c48397ea2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120741) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 18:11:41.339145 dv-cinder-852009-8-iscsi devstack@n-api.service[120741]: DEBUG oslo_concurrency.lockutils [None req-29c349ff-3a9b-471e-b920-78995a544d6c tempest-AttachVolumeNegativeTest-1378806597 tempest-AttachVolumeNegativeTest-1378806597-project] Lock "1daf4f4c-0e4a-4779-b53a-78c48397ea2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120741) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 18:11:41.610310 dv-cinder-852009-8-iscsi devstack@n-api.service[120741]: INFO nova.api.openstack.requestlog [None req-29c349ff-3a9b-471e-b920-78995a544d6c tempest-AttachVolumeNegativeTest-1378806597 tempest-AttachVolumeNegativeTest-1378806597-project] 10.222.0.43 "POST /compute/v2.1/servers/ed450488-2c80-4d82-8621-b55727628db1/os-volume_attachments" status: 200 len: 194 microversion: 2.1 time: 0.293369 Sep 13 18:11:41.610926 dv-cinder-852009-8-iscsi devstack@n-api.service[120741]: [pid: 120741|app: 0|req: 414/838] 10.222.0.43 () {60 vars in 1323 bytes} [Tue Sep 13 18:11:41 2022] POST /compute/v2.1/servers/ed450488-2c80-4d82-8621-b55727628db1/os-volume_attachments => generated 194 bytes in 295 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 13 18:11:48.131843 dv-cinder-852009-8-iscsi devstack@n-api.service[120740]: DEBUG nova.api.openstack.wsgi [None req-5d3daee2-118a-463c-b6cb-52db911d32bd tempest-AttachVolumeNegativeTest-1378806597 tempest-AttachVolumeNegativeTest-1378806597-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "8eb9c4ad-89b2-4f79-ab6f-b8790f8f591c"}} {{(pid=120740) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 13 18:11:48.134317 dv-cinder-852009-8-iscsi devstack@n-api.service[120740]: DEBUG nova.compute.api [None req-5d3daee2-118a-463c-b6cb-52db911d32bd tempest-AttachVolumeNegativeTest-1378806597 tempest-AttachVolumeNegativeTest-1378806597-project] [instance: ed450488-2c80-4d82-8621-b55727628db1] Fetching instance by UUID {{(pid=120740) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 18:11:48.141220 dv-cinder-852009-8-iscsi devstack@n-api.service[120740]: DEBUG oslo_concurrency.lockutils [None req-5d3daee2-118a-463c-b6cb-52db911d32bd tempest-AttachVolumeNegativeTest-1378806597 tempest-AttachVolumeNegativeTest-1378806597-project] Acquiring lock "1daf4f4c-0e4a-4779-b53a-78c48397ea2f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120740) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 18:11:48.141712 dv-cinder-852009-8-iscsi devstack@n-api.service[120740]: DEBUG oslo_concurrency.lockutils [None req-5d3daee2-118a-463c-b6cb-52db911d32bd tempest-AttachVolumeNegativeTest-1378806597 tempest-AttachVolumeNegativeTest-1378806597-project] Lock "1daf4f4c-0e4a-4779-b53a-78c48397ea2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120740) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 18:11:48.142145 dv-cinder-852009-8-iscsi devstack@n-api.service[120740]: DEBUG oslo_concurrency.lockutils [None req-5d3daee2-118a-463c-b6cb-52db911d32bd tempest-AttachVolumeNegativeTest-1378806597 tempest-AttachVolumeNegativeTest-1378806597-project] Lock "1daf4f4c-0e4a-4779-b53a-78c48397ea2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120740) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 18:11:48.142841 dv-cinder-852009-8-iscsi devstack@n-api.service[120740]: DEBUG oslo_concurrency.lockutils [None req-5d3daee2-118a-463c-b6cb-52db911d32bd tempest-AttachVolumeNegativeTest-1378806597 tempest-AttachVolumeNegativeTest-1378806597-project] Acquiring lock "1daf4f4c-0e4a-4779-b53a-78c48397ea2f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120740) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 18:11:48.143286 dv-cinder-852009-8-iscsi devstack@n-api.service[120740]: DEBUG oslo_concurrency.lockutils [None req-5d3daee2-118a-463c-b6cb-52db911d32bd tempest-AttachVolumeNegativeTest-1378806597 tempest-AttachVolumeNegativeTest-1378806597-project] Lock "1daf4f4c-0e4a-4779-b53a-78c48397ea2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120740) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 18:11:48.143702 dv-cinder-852009-8-iscsi devstack@n-api.service[120740]: DEBUG oslo_concurrency.lockutils [None req-5d3daee2-118a-463c-b6cb-52db911d32bd tempest-AttachVolumeNegativeTest-1378806597 tempest-AttachVolumeNegativeTest-1378806597-project] Lock "1daf4f4c-0e4a-4779-b53a-78c48397ea2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120740) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 18:11:48.223900 dv-cinder-852009-8-iscsi devstack@n-api.service[120740]: INFO nova.api.openstack.wsgi [None req-5d3daee2-118a-463c-b6cb-52db911d32bd tempest-AttachVolumeNegativeTest-1378806597 tempest-AttachVolumeNegativeTest-1378806597-project] HTTP exception thrown: Invalid volume: volume 8eb9c4ad-89b2-4f79-ab6f-b8790f8f591c is already attached to instances: ed450488-2c80-4d82-8621-b55727628db1 Sep 13 18:11:48.225619 dv-cinder-852009-8-iscsi devstack@n-api.service[120740]: DEBUG nova.api.openstack.wsgi [None req-5d3daee2-118a-463c-b6cb-52db911d32bd tempest-AttachVolumeNegativeTest-1378806597 tempest-AttachVolumeNegativeTest-1378806597-project] Request method failure captured: Sep 13 18:11:48.225619 dv-cinder-852009-8-iscsi devstack@n-api.service[120740]: request: POST /compute/v2.1/servers/ed450488-2c80-4d82-8621-b55727628db1/os-volume_attachments HTTP/1.1 Sep 13 18:11:48.225619 dv-cinder-852009-8-iscsi devstack@n-api.service[120740]: Accept: application/json Sep 13 18:11:48.225619 dv-cinder-852009-8-iscsi devstack@n-api.service[120740]: Accept-Encoding: identity Sep 13 18:11:48.225619 dv-cinder-852009-8-iscsi devstack@n-api.service[120740]: Connection: close Sep 13 18:11:48.225619 dv-cinder-852009-8-iscsi devstack@n-api.service[120740]: Content-Length: 74 Sep 13 18:11:48.225619 dv-cinder-852009-8-iscsi devstack@n-api.service[120740]: Content-Type: application/json Sep 13 18:11:48.225619 dv-cinder-852009-8-iscsi devstack@n-api.service[120740]: Host: 10.222.0.43 Sep 13 18:11:48.225619 dv-cinder-852009-8-iscsi devstack@n-api.service[120740]: Openstack-System-Scope: None Sep 13 18:11:48.225619 dv-cinder-852009-8-iscsi devstack@n-api.service[120740]: User-Agent: python-urllib3/1.26.12 Sep 13 18:11:48.225619 dv-cinder-852009-8-iscsi devstack@n-api.service[120740]: X-Auth-Token: gAAAAABjIMciYi08KSU35iQHMuJ1d9BLU6OdnvTV0lQhD4NCYaw8no8S5_0xWB47N9lmu7akofQLpLV68heC7pPUCZsTXqIq6Y42WLp6VXHhyQNxgHSYkPKRLV6tG6CCOIlPDetRfNDVZw3BkXYviJ38fOivAdsSaqCGCQ-A5bO5QGkWPiqoF58 Sep 13 18:11:48.225619 dv-cinder-852009-8-iscsi devstack@n-api.service[120740]: X-Domain-Id: None Sep 13 18:11:48.225619 dv-cinder-852009-8-iscsi devstack@n-api.service[120740]: X-Domain-Name: None Sep 13 18:11:48.225619 dv-cinder-852009-8-iscsi devstack@n-api.service[120740]: X-Identity-Status: Confirmed Sep 13 18:11:48.225619 dv-cinder-852009-8-iscsi devstack@n-api.service[120740]: X-Is-Admin-Project: True Sep 13 18:11:48.225619 dv-cinder-852009-8-iscsi devstack@n-api.service[120740]: X-Project-Domain-Id: default Sep 13 18:11:48.225619 dv-cinder-852009-8-iscsi devstack@n-api.service[120740]: X-Project-Domain-Name: Default Sep 13 18:11:48.225619 dv-cinder-852009-8-iscsi devstack@n-api.service[120740]: X-Project-Id: 629311eda0584a5fbb7d8995cf27540c Sep 13 18:11:48.225619 dv-cinder-852009-8-iscsi devstack@n-api.service[120740]: X-Project-Name: tempest-AttachVolumeNegativeTest-1378806597 Sep 13 18:11:48.225619 dv-cinder-852009-8-iscsi devstack@n-api.service[120740]: X-Role: reader,member Sep 13 18:11:48.225619 dv-cinder-852009-8-iscsi devstack@n-api.service[120740]: X-Roles: reader,member Sep 13 18:11:48.227305 dv-cinder-852009-8-iscsi devstack@n-api.service[120740]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/identity"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/compute/v2/629311eda0584a5fbb7d8995cf27540c"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.43:8080", "publicURL": "http://10.222.0.43:8080/v1/AUTH_629311eda0584a5fbb7d8995cf27540c"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43:9696/networking"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/volume/v3/629311eda0584a5fbb7d8995cf27540c"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/compute/v2.1"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/placement"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/volume/v3/629311eda0584a5fbb7d8995cf27540c"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/image"}]}] Sep 13 18:11:48.227305 dv-cinder-852009-8-iscsi devstack@n-api.service[120740]: X-Tenant: tempest-AttachVolumeNegativeTest-1378806597 Sep 13 18:11:48.227305 dv-cinder-852009-8-iscsi devstack@n-api.service[120740]: X-Tenant-Id: 629311eda0584a5fbb7d8995cf27540c Sep 13 18:11:48.227305 dv-cinder-852009-8-iscsi devstack@n-api.service[120740]: X-Tenant-Name: tempest-AttachVolumeNegativeTest-1378806597 Sep 13 18:11:48.227305 dv-cinder-852009-8-iscsi devstack@n-api.service[120740]: X-User: tempest-AttachVolumeNegativeTest-1378806597-project Sep 13 18:11:48.227305 dv-cinder-852009-8-iscsi devstack@n-api.service[120740]: X-User-Domain-Id: default Sep 13 18:11:48.227305 dv-cinder-852009-8-iscsi devstack@n-api.service[120740]: X-User-Domain-Name: Default Sep 13 18:11:48.227305 dv-cinder-852009-8-iscsi devstack@n-api.service[120740]: X-User-Id: 714cd09ba19b492f9a8c80343abcf6b9 Sep 13 18:11:48.227305 dv-cinder-852009-8-iscsi devstack@n-api.service[120740]: X-User-Name: tempest-AttachVolumeNegativeTest-1378806597-project Sep 13 18:11:48.227305 dv-cinder-852009-8-iscsi devstack@n-api.service[120740]: Sep 13 18:11:48.227305 dv-cinder-852009-8-iscsi devstack@n-api.service[120740]: {"volumeAttachment": {"volumeId": "8eb9c4ad-89b2-4f79-ab6f-b8790f8f591c"}} Sep 13 18:11:48.227305 dv-cinder-852009-8-iscsi devstack@n-api.service[120740]: method: > Sep 13 18:11:48.231482 dv-cinder-852009-8-iscsi devstack@n-api.service[120740]: exception: Invalid volume: volume 8eb9c4ad-89b2-4f79-ab6f-b8790f8f591c is already attached to instances: ed450488-2c80-4d82-8621-b55727628db1 Sep 13 18:11:48.231482 dv-cinder-852009-8-iscsi devstack@n-api.service[120740]: action_args: {'server_id': 'ed450488-2c80-4d82-8621-b55727628db1', 'body': {'volumeAttachment': {'volumeId': '8eb9c4ad-89b2-4f79-ab6f-b8790f8f591c'}}} Sep 13 18:11:48.231482 dv-cinder-852009-8-iscsi devstack@n-api.service[120740]: {{(pid=120740) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 13 18:11:48.231482 dv-cinder-852009-8-iscsi devstack@n-api.service[120740]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 13 18:11:48.231482 dv-cinder-852009-8-iscsi devstack@n-api.service[120740]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 388, in create Sep 13 18:11:48.231482 dv-cinder-852009-8-iscsi devstack@n-api.service[120740]: ERROR nova.api.openstack.wsgi device = self.compute_api.attach_volume( Sep 13 18:11:48.231482 dv-cinder-852009-8-iscsi devstack@n-api.service[120740]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 241, in inner Sep 13 18:11:48.231482 dv-cinder-852009-8-iscsi devstack@n-api.service[120740]: ERROR nova.api.openstack.wsgi return function(self, context, instance, *args, **kwargs) Sep 13 18:11:48.231482 dv-cinder-852009-8-iscsi devstack@n-api.service[120740]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 167, in inner Sep 13 18:11:48.231482 dv-cinder-852009-8-iscsi devstack@n-api.service[120740]: ERROR nova.api.openstack.wsgi return f(self, context, instance, *args, **kw) Sep 13 18:11:48.231482 dv-cinder-852009-8-iscsi devstack@n-api.service[120740]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 5130, in attach_volume Sep 13 18:11:48.231482 dv-cinder-852009-8-iscsi devstack@n-api.service[120740]: ERROR nova.api.openstack.wsgi self._check_volume_already_attached(context, instance, volume) Sep 13 18:11:48.231482 dv-cinder-852009-8-iscsi devstack@n-api.service[120740]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 4970, in _check_volume_already_attached Sep 13 18:11:48.231482 dv-cinder-852009-8-iscsi devstack@n-api.service[120740]: ERROR nova.api.openstack.wsgi raise exception.InvalidVolume(reason=msg) Sep 13 18:11:48.231482 dv-cinder-852009-8-iscsi devstack@n-api.service[120740]: ERROR nova.api.openstack.wsgi nova.exception.InvalidVolume: Invalid volume: volume 8eb9c4ad-89b2-4f79-ab6f-b8790f8f591c is already attached to instances: ed450488-2c80-4d82-8621-b55727628db1 Sep 13 18:11:48.231482 dv-cinder-852009-8-iscsi devstack@n-api.service[120740]: ERROR nova.api.openstack.wsgi Sep 13 18:11:48.231482 dv-cinder-852009-8-iscsi devstack@n-api.service[120740]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 13 18:11:48.231482 dv-cinder-852009-8-iscsi devstack@n-api.service[120740]: ERROR nova.api.openstack.wsgi Sep 13 18:11:48.231482 dv-cinder-852009-8-iscsi devstack@n-api.service[120740]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 13 18:11:48.232793 dv-cinder-852009-8-iscsi devstack@n-api.service[120740]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 13 18:11:48.232793 dv-cinder-852009-8-iscsi devstack@n-api.service[120740]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 13 18:11:48.232793 dv-cinder-852009-8-iscsi devstack@n-api.service[120740]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 13 18:11:48.232793 dv-cinder-852009-8-iscsi devstack@n-api.service[120740]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 13 18:11:48.232793 dv-cinder-852009-8-iscsi devstack@n-api.service[120740]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 13 18:11:48.232793 dv-cinder-852009-8-iscsi devstack@n-api.service[120740]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 13 18:11:48.232793 dv-cinder-852009-8-iscsi devstack@n-api.service[120740]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Sep 13 18:11:48.232793 dv-cinder-852009-8-iscsi devstack@n-api.service[120740]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Sep 13 18:11:48.232793 dv-cinder-852009-8-iscsi devstack@n-api.service[120740]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Sep 13 18:11:48.232793 dv-cinder-852009-8-iscsi devstack@n-api.service[120740]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Sep 13 18:11:48.232793 dv-cinder-852009-8-iscsi devstack@n-api.service[120740]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Sep 13 18:11:48.232793 dv-cinder-852009-8-iscsi devstack@n-api.service[120740]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Sep 13 18:11:48.232793 dv-cinder-852009-8-iscsi devstack@n-api.service[120740]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 406, in create Sep 13 18:11:48.232793 dv-cinder-852009-8-iscsi devstack@n-api.service[120740]: ERROR nova.api.openstack.wsgi raise exc.HTTPBadRequest(explanation=e.format_message()) Sep 13 18:11:48.232793 dv-cinder-852009-8-iscsi devstack@n-api.service[120740]: ERROR nova.api.openstack.wsgi webob.exc.HTTPBadRequest: Invalid volume: volume 8eb9c4ad-89b2-4f79-ab6f-b8790f8f591c is already attached to instances: ed450488-2c80-4d82-8621-b55727628db1 Sep 13 18:11:48.232793 dv-cinder-852009-8-iscsi devstack@n-api.service[120740]: ERROR nova.api.openstack.wsgi Sep 13 18:11:48.232793 dv-cinder-852009-8-iscsi devstack@n-api.service[120740]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 13 18:11:48.232793 dv-cinder-852009-8-iscsi devstack@n-api.service[120740]: ERROR nova.api.openstack.wsgi Sep 13 18:11:48.232793 dv-cinder-852009-8-iscsi devstack@n-api.service[120740]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 13 18:11:48.232793 dv-cinder-852009-8-iscsi devstack@n-api.service[120740]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 13 18:11:48.234197 dv-cinder-852009-8-iscsi devstack@n-api.service[120740]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 13 18:11:48.234197 dv-cinder-852009-8-iscsi devstack@n-api.service[120740]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 13 18:11:48.234197 dv-cinder-852009-8-iscsi devstack@n-api.service[120740]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 13 18:11:48.234197 dv-cinder-852009-8-iscsi devstack@n-api.service[120740]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Invalid volume: volume 8eb9c4ad-89b2-4f79-ab6f-b8790f8f591c is already attached to instances: ed450488-2c80-4d82-8621-b55727628db1 Sep 13 18:11:48.234197 dv-cinder-852009-8-iscsi devstack@n-api.service[120740]: ERROR nova.api.openstack.wsgi Sep 13 18:11:48.234197 dv-cinder-852009-8-iscsi devstack@n-api.service[120740]: DEBUG nova.api.openstack.wsgi [None req-5d3daee2-118a-463c-b6cb-52db911d32bd tempest-AttachVolumeNegativeTest-1378806597 tempest-AttachVolumeNegativeTest-1378806597-project] Returning 400 to user: Invalid volume: volume 8eb9c4ad-89b2-4f79-ab6f-b8790f8f591c is already attached to instances: ed450488-2c80-4d82-8621-b55727628db1 {{(pid=120740) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 13 18:11:48.234197 dv-cinder-852009-8-iscsi devstack@n-api.service[120740]: INFO nova.api.openstack.requestlog [None req-5d3daee2-118a-463c-b6cb-52db911d32bd tempest-AttachVolumeNegativeTest-1378806597 tempest-AttachVolumeNegativeTest-1378806597-project] 10.222.0.43 "POST /compute/v2.1/servers/ed450488-2c80-4d82-8621-b55727628db1/os-volume_attachments" status: 400 len: 174 microversion: 2.1 time: 0.099368 Sep 13 18:11:48.234197 dv-cinder-852009-8-iscsi devstack@n-api.service[120740]: [pid: 120740|app: 0|req: 425/839] 10.222.0.43 () {60 vars in 1323 bytes} [Tue Sep 13 18:11:48 2022] POST /compute/v2.1/servers/ed450488-2c80-4d82-8621-b55727628db1/os-volume_attachments => generated 174 bytes in 101 msecs (HTTP/1.1 400) 9 headers in 381 bytes (1 switches on core 0) Sep 13 18:11:48.296110 dv-cinder-852009-8-iscsi devstack@n-api.service[120741]: DEBUG nova.api.openstack.wsgi [None req-4737302a-a5c8-47f5-9c8f-a99c7a0ef568 tempest-AttachVolumeNegativeTest-1378806597 tempest-AttachVolumeNegativeTest-1378806597-project] Calling method '>' {{(pid=120741) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 18:11:48.296731 dv-cinder-852009-8-iscsi devstack@n-api.service[120741]: DEBUG nova.compute.api [None req-4737302a-a5c8-47f5-9c8f-a99c7a0ef568 tempest-AttachVolumeNegativeTest-1378806597 tempest-AttachVolumeNegativeTest-1378806597-project] [instance: ed450488-2c80-4d82-8621-b55727628db1] Fetching instance by UUID {{(pid=120741) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 18:11:48.303364 dv-cinder-852009-8-iscsi devstack@n-api.service[120741]: DEBUG oslo_concurrency.lockutils [None req-4737302a-a5c8-47f5-9c8f-a99c7a0ef568 tempest-AttachVolumeNegativeTest-1378806597 tempest-AttachVolumeNegativeTest-1378806597-project] Acquiring lock "1daf4f4c-0e4a-4779-b53a-78c48397ea2f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120741) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 18:11:48.303850 dv-cinder-852009-8-iscsi devstack@n-api.service[120741]: DEBUG oslo_concurrency.lockutils [None req-4737302a-a5c8-47f5-9c8f-a99c7a0ef568 tempest-AttachVolumeNegativeTest-1378806597 tempest-AttachVolumeNegativeTest-1378806597-project] Lock "1daf4f4c-0e4a-4779-b53a-78c48397ea2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120741) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 18:11:48.304286 dv-cinder-852009-8-iscsi devstack@n-api.service[120741]: DEBUG oslo_concurrency.lockutils [None req-4737302a-a5c8-47f5-9c8f-a99c7a0ef568 tempest-AttachVolumeNegativeTest-1378806597 tempest-AttachVolumeNegativeTest-1378806597-project] Lock "1daf4f4c-0e4a-4779-b53a-78c48397ea2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120741) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 18:11:48.305024 dv-cinder-852009-8-iscsi devstack@n-api.service[120741]: DEBUG oslo_concurrency.lockutils [None req-4737302a-a5c8-47f5-9c8f-a99c7a0ef568 tempest-AttachVolumeNegativeTest-1378806597 tempest-AttachVolumeNegativeTest-1378806597-project] Acquiring lock "1daf4f4c-0e4a-4779-b53a-78c48397ea2f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120741) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 18:11:48.305480 dv-cinder-852009-8-iscsi devstack@n-api.service[120741]: DEBUG oslo_concurrency.lockutils [None req-4737302a-a5c8-47f5-9c8f-a99c7a0ef568 tempest-AttachVolumeNegativeTest-1378806597 tempest-AttachVolumeNegativeTest-1378806597-project] Lock "1daf4f4c-0e4a-4779-b53a-78c48397ea2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120741) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 18:11:48.305904 dv-cinder-852009-8-iscsi devstack@n-api.service[120741]: DEBUG oslo_concurrency.lockutils [None req-4737302a-a5c8-47f5-9c8f-a99c7a0ef568 tempest-AttachVolumeNegativeTest-1378806597 tempest-AttachVolumeNegativeTest-1378806597-project] Lock "1daf4f4c-0e4a-4779-b53a-78c48397ea2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120741) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 18:11:48.659876 dv-cinder-852009-8-iscsi devstack@n-api.service[120741]: DEBUG nova.objects.instance [None req-4737302a-a5c8-47f5-9c8f-a99c7a0ef568 tempest-AttachVolumeNegativeTest-1378806597 tempest-AttachVolumeNegativeTest-1378806597-project] Lazy-loading 'services' on Instance uuid ed450488-2c80-4d82-8621-b55727628db1 {{(pid=120741) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Sep 13 18:11:48.733906 dv-cinder-852009-8-iscsi devstack@n-api.service[120741]: INFO nova.api.openstack.requestlog [None req-4737302a-a5c8-47f5-9c8f-a99c7a0ef568 tempest-AttachVolumeNegativeTest-1378806597 tempest-AttachVolumeNegativeTest-1378806597-project] 10.222.0.43 "DELETE /compute/v2.1/servers/ed450488-2c80-4d82-8621-b55727628db1/os-volume_attachments/8eb9c4ad-89b2-4f79-ab6f-b8790f8f591c" status: 202 len: 0 microversion: 2.1 time: 0.442419 Sep 13 18:11:48.734702 dv-cinder-852009-8-iscsi devstack@n-api.service[120741]: [pid: 120741|app: 0|req: 415/840] 10.222.0.43 () {58 vars in 1416 bytes} [Tue Sep 13 18:11:48 2022] DELETE /compute/v2.1/servers/ed450488-2c80-4d82-8621-b55727628db1/os-volume_attachments/8eb9c4ad-89b2-4f79-ab6f-b8790f8f591c => generated 0 bytes in 444 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Sep 13 18:11:48.743782 dv-cinder-852009-8-iscsi devstack@n-api.service[120740]: DEBUG nova.api.openstack.wsgi [None req-35ef7875-af14-4d94-b7e6-e9bfa7bd36a6 tempest-AttachVolumeNegativeTest-1378806597 tempest-AttachVolumeNegativeTest-1378806597-project] Calling method '>' {{(pid=120740) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 18:11:48.746499 dv-cinder-852009-8-iscsi devstack@n-api.service[120740]: DEBUG nova.compute.api [None req-35ef7875-af14-4d94-b7e6-e9bfa7bd36a6 tempest-AttachVolumeNegativeTest-1378806597 tempest-AttachVolumeNegativeTest-1378806597-project] [instance: ed450488-2c80-4d82-8621-b55727628db1] Fetching instance by UUID {{(pid=120740) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 18:11:48.755086 dv-cinder-852009-8-iscsi devstack@n-api.service[120740]: DEBUG oslo_concurrency.lockutils [None req-35ef7875-af14-4d94-b7e6-e9bfa7bd36a6 tempest-AttachVolumeNegativeTest-1378806597 tempest-AttachVolumeNegativeTest-1378806597-project] Acquiring lock "1daf4f4c-0e4a-4779-b53a-78c48397ea2f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120740) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 18:11:48.755771 dv-cinder-852009-8-iscsi devstack@n-api.service[120740]: DEBUG oslo_concurrency.lockutils [None req-35ef7875-af14-4d94-b7e6-e9bfa7bd36a6 tempest-AttachVolumeNegativeTest-1378806597 tempest-AttachVolumeNegativeTest-1378806597-project] Lock "1daf4f4c-0e4a-4779-b53a-78c48397ea2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120740) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 18:11:48.756109 dv-cinder-852009-8-iscsi devstack@n-api.service[120740]: DEBUG oslo_concurrency.lockutils [None req-35ef7875-af14-4d94-b7e6-e9bfa7bd36a6 tempest-AttachVolumeNegativeTest-1378806597 tempest-AttachVolumeNegativeTest-1378806597-project] Lock "1daf4f4c-0e4a-4779-b53a-78c48397ea2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120740) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 18:11:48.756875 dv-cinder-852009-8-iscsi devstack@n-api.service[120740]: DEBUG oslo_concurrency.lockutils [None req-35ef7875-af14-4d94-b7e6-e9bfa7bd36a6 tempest-AttachVolumeNegativeTest-1378806597 tempest-AttachVolumeNegativeTest-1378806597-project] Acquiring lock "1daf4f4c-0e4a-4779-b53a-78c48397ea2f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120740) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 18:11:48.757324 dv-cinder-852009-8-iscsi devstack@n-api.service[120740]: DEBUG oslo_concurrency.lockutils [None req-35ef7875-af14-4d94-b7e6-e9bfa7bd36a6 tempest-AttachVolumeNegativeTest-1378806597 tempest-AttachVolumeNegativeTest-1378806597-project] Lock "1daf4f4c-0e4a-4779-b53a-78c48397ea2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120740) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 18:11:48.757742 dv-cinder-852009-8-iscsi devstack@n-api.service[120740]: DEBUG oslo_concurrency.lockutils [None req-35ef7875-af14-4d94-b7e6-e9bfa7bd36a6 tempest-AttachVolumeNegativeTest-1378806597 tempest-AttachVolumeNegativeTest-1378806597-project] Lock "1daf4f4c-0e4a-4779-b53a-78c48397ea2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120740) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 18:11:48.787997 dv-cinder-852009-8-iscsi devstack@n-api.service[120740]: INFO nova.api.openstack.requestlog [None req-35ef7875-af14-4d94-b7e6-e9bfa7bd36a6 tempest-AttachVolumeNegativeTest-1378806597 tempest-AttachVolumeNegativeTest-1378806597-project] 10.222.0.43 "GET /compute/v2.1/servers/ed450488-2c80-4d82-8621-b55727628db1/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.048500 Sep 13 18:11:48.788569 dv-cinder-852009-8-iscsi devstack@n-api.service[120740]: [pid: 120740|app: 0|req: 426/841] 10.222.0.43 () {58 vars in 1302 bytes} [Tue Sep 13 18:11:48 2022] GET /compute/v2.1/servers/ed450488-2c80-4d82-8621-b55727628db1/os-volume_attachments => generated 197 bytes in 50 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 13 18:11:49.806534 dv-cinder-852009-8-iscsi devstack@n-api.service[120741]: DEBUG nova.api.openstack.wsgi [None req-1c2492ea-c6e8-4b39-8daf-059f2107bbc2 tempest-AttachVolumeNegativeTest-1378806597 tempest-AttachVolumeNegativeTest-1378806597-project] Calling method '>' {{(pid=120741) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 18:11:49.809267 dv-cinder-852009-8-iscsi devstack@n-api.service[120741]: DEBUG nova.compute.api [None req-1c2492ea-c6e8-4b39-8daf-059f2107bbc2 tempest-AttachVolumeNegativeTest-1378806597 tempest-AttachVolumeNegativeTest-1378806597-project] [instance: ed450488-2c80-4d82-8621-b55727628db1] Fetching instance by UUID {{(pid=120741) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 18:11:49.816849 dv-cinder-852009-8-iscsi devstack@n-api.service[120741]: DEBUG oslo_concurrency.lockutils [None req-1c2492ea-c6e8-4b39-8daf-059f2107bbc2 tempest-AttachVolumeNegativeTest-1378806597 tempest-AttachVolumeNegativeTest-1378806597-project] Acquiring lock "1daf4f4c-0e4a-4779-b53a-78c48397ea2f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120741) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 18:11:49.817436 dv-cinder-852009-8-iscsi devstack@n-api.service[120741]: DEBUG oslo_concurrency.lockutils [None req-1c2492ea-c6e8-4b39-8daf-059f2107bbc2 tempest-AttachVolumeNegativeTest-1378806597 tempest-AttachVolumeNegativeTest-1378806597-project] Lock "1daf4f4c-0e4a-4779-b53a-78c48397ea2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120741) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 18:11:49.817965 dv-cinder-852009-8-iscsi devstack@n-api.service[120741]: DEBUG oslo_concurrency.lockutils [None req-1c2492ea-c6e8-4b39-8daf-059f2107bbc2 tempest-AttachVolumeNegativeTest-1378806597 tempest-AttachVolumeNegativeTest-1378806597-project] Lock "1daf4f4c-0e4a-4779-b53a-78c48397ea2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120741) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 18:11:49.818721 dv-cinder-852009-8-iscsi devstack@n-api.service[120741]: DEBUG oslo_concurrency.lockutils [None req-1c2492ea-c6e8-4b39-8daf-059f2107bbc2 tempest-AttachVolumeNegativeTest-1378806597 tempest-AttachVolumeNegativeTest-1378806597-project] Acquiring lock "1daf4f4c-0e4a-4779-b53a-78c48397ea2f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120741) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 18:11:49.819238 dv-cinder-852009-8-iscsi devstack@n-api.service[120741]: DEBUG oslo_concurrency.lockutils [None req-1c2492ea-c6e8-4b39-8daf-059f2107bbc2 tempest-AttachVolumeNegativeTest-1378806597 tempest-AttachVolumeNegativeTest-1378806597-project] Lock "1daf4f4c-0e4a-4779-b53a-78c48397ea2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120741) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 18:11:49.819752 dv-cinder-852009-8-iscsi devstack@n-api.service[120741]: DEBUG oslo_concurrency.lockutils [None req-1c2492ea-c6e8-4b39-8daf-059f2107bbc2 tempest-AttachVolumeNegativeTest-1378806597 tempest-AttachVolumeNegativeTest-1378806597-project] Lock "1daf4f4c-0e4a-4779-b53a-78c48397ea2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120741) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 18:11:49.851584 dv-cinder-852009-8-iscsi devstack@n-api.service[120741]: INFO nova.api.openstack.requestlog [None req-1c2492ea-c6e8-4b39-8daf-059f2107bbc2 tempest-AttachVolumeNegativeTest-1378806597 tempest-AttachVolumeNegativeTest-1378806597-project] 10.222.0.43 "GET /compute/v2.1/servers/ed450488-2c80-4d82-8621-b55727628db1/os-volume_attachments" status: 200 len: 25 microversion: 2.1 time: 0.053193 Sep 13 18:11:49.852120 dv-cinder-852009-8-iscsi devstack@n-api.service[120741]: [pid: 120741|app: 0|req: 416/842] 10.222.0.43 () {58 vars in 1302 bytes} [Tue Sep 13 18:11:49 2022] GET /compute/v2.1/servers/ed450488-2c80-4d82-8621-b55727628db1/os-volume_attachments => generated 25 bytes in 55 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Sep 13 18:11:49.922269 dv-cinder-852009-8-iscsi devstack@n-api.service[120740]: DEBUG nova.api.openstack.wsgi [None req-6fbeaf73-7cd7-4dc3-b738-74fb8c2e89bb tempest-AttachVolumeNegativeTest-1378806597 tempest-AttachVolumeNegativeTest-1378806597-project] Calling method '>' {{(pid=120740) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 18:11:49.922770 dv-cinder-852009-8-iscsi devstack@n-api.service[120740]: DEBUG nova.compute.api [None req-6fbeaf73-7cd7-4dc3-b738-74fb8c2e89bb tempest-AttachVolumeNegativeTest-1378806597 tempest-AttachVolumeNegativeTest-1378806597-project] [instance: ed450488-2c80-4d82-8621-b55727628db1] Fetching instance by UUID {{(pid=120740) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 18:11:49.932189 dv-cinder-852009-8-iscsi devstack@n-api.service[120740]: DEBUG oslo_concurrency.lockutils [None req-6fbeaf73-7cd7-4dc3-b738-74fb8c2e89bb tempest-AttachVolumeNegativeTest-1378806597 tempest-AttachVolumeNegativeTest-1378806597-project] Acquiring lock "1daf4f4c-0e4a-4779-b53a-78c48397ea2f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120740) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 18:11:49.932711 dv-cinder-852009-8-iscsi devstack@n-api.service[120740]: DEBUG oslo_concurrency.lockutils [None req-6fbeaf73-7cd7-4dc3-b738-74fb8c2e89bb tempest-AttachVolumeNegativeTest-1378806597 tempest-AttachVolumeNegativeTest-1378806597-project] Lock "1daf4f4c-0e4a-4779-b53a-78c48397ea2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120740) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 18:11:49.933147 dv-cinder-852009-8-iscsi devstack@n-api.service[120740]: DEBUG oslo_concurrency.lockutils [None req-6fbeaf73-7cd7-4dc3-b738-74fb8c2e89bb tempest-AttachVolumeNegativeTest-1378806597 tempest-AttachVolumeNegativeTest-1378806597-project] Lock "1daf4f4c-0e4a-4779-b53a-78c48397ea2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120740) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 18:11:49.933838 dv-cinder-852009-8-iscsi devstack@n-api.service[120740]: DEBUG oslo_concurrency.lockutils [None req-6fbeaf73-7cd7-4dc3-b738-74fb8c2e89bb tempest-AttachVolumeNegativeTest-1378806597 tempest-AttachVolumeNegativeTest-1378806597-project] Acquiring lock "1daf4f4c-0e4a-4779-b53a-78c48397ea2f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120740) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 18:11:49.934284 dv-cinder-852009-8-iscsi devstack@n-api.service[120740]: DEBUG oslo_concurrency.lockutils [None req-6fbeaf73-7cd7-4dc3-b738-74fb8c2e89bb tempest-AttachVolumeNegativeTest-1378806597 tempest-AttachVolumeNegativeTest-1378806597-project] Lock "1daf4f4c-0e4a-4779-b53a-78c48397ea2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120740) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 18:11:49.934702 dv-cinder-852009-8-iscsi devstack@n-api.service[120740]: DEBUG oslo_concurrency.lockutils [None req-6fbeaf73-7cd7-4dc3-b738-74fb8c2e89bb tempest-AttachVolumeNegativeTest-1378806597 tempest-AttachVolumeNegativeTest-1378806597-project] Lock "1daf4f4c-0e4a-4779-b53a-78c48397ea2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120740) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 18:11:49.961026 dv-cinder-852009-8-iscsi devstack@n-api.service[120740]: DEBUG nova.compute.api [None req-6fbeaf73-7cd7-4dc3-b738-74fb8c2e89bb tempest-AttachVolumeNegativeTest-1378806597 tempest-AttachVolumeNegativeTest-1378806597-project] [instance: ed450488-2c80-4d82-8621-b55727628db1] Going to try to terminate instance {{(pid=120740) delete /opt/stack/nova/nova/compute/api.py:2719}} Sep 13 18:11:50.040479 dv-cinder-852009-8-iscsi devstack@n-api.service[120740]: INFO nova.api.openstack.requestlog [None req-6fbeaf73-7cd7-4dc3-b738-74fb8c2e89bb tempest-AttachVolumeNegativeTest-1378806597 tempest-AttachVolumeNegativeTest-1378806597-project] 10.222.0.43 "DELETE /compute/v2.1/servers/ed450488-2c80-4d82-8621-b55727628db1" status: 204 len: 0 microversion: 2.1 time: 0.124211 Sep 13 18:11:50.041196 dv-cinder-852009-8-iscsi devstack@n-api.service[120740]: [pid: 120740|app: 0|req: 427/843] 10.222.0.43 () {58 vars in 1239 bytes} [Tue Sep 13 18:11:49 2022] DELETE /compute/v2.1/servers/ed450488-2c80-4d82-8621-b55727628db1 => generated 0 bytes in 126 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Sep 13 18:11:50.049710 dv-cinder-852009-8-iscsi devstack@n-api.service[120741]: DEBUG nova.api.openstack.wsgi [None req-576b97d2-add8-4412-90c8-1748f59efcd4 tempest-AttachVolumeNegativeTest-1378806597 tempest-AttachVolumeNegativeTest-1378806597-project] Calling method '>' {{(pid=120741) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 18:11:50.050330 dv-cinder-852009-8-iscsi devstack@n-api.service[120741]: DEBUG nova.compute.api [None req-576b97d2-add8-4412-90c8-1748f59efcd4 tempest-AttachVolumeNegativeTest-1378806597 tempest-AttachVolumeNegativeTest-1378806597-project] [instance: ed450488-2c80-4d82-8621-b55727628db1] Fetching instance by UUID {{(pid=120741) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 18:11:50.056537 dv-cinder-852009-8-iscsi devstack@n-api.service[120741]: DEBUG oslo_concurrency.lockutils [None req-576b97d2-add8-4412-90c8-1748f59efcd4 tempest-AttachVolumeNegativeTest-1378806597 tempest-AttachVolumeNegativeTest-1378806597-project] Acquiring lock "1daf4f4c-0e4a-4779-b53a-78c48397ea2f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120741) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 18:11:50.057041 dv-cinder-852009-8-iscsi devstack@n-api.service[120741]: DEBUG oslo_concurrency.lockutils [None req-576b97d2-add8-4412-90c8-1748f59efcd4 tempest-AttachVolumeNegativeTest-1378806597 tempest-AttachVolumeNegativeTest-1378806597-project] Lock "1daf4f4c-0e4a-4779-b53a-78c48397ea2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120741) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 18:11:50.057459 dv-cinder-852009-8-iscsi devstack@n-api.service[120741]: DEBUG oslo_concurrency.lockutils [None req-576b97d2-add8-4412-90c8-1748f59efcd4 tempest-AttachVolumeNegativeTest-1378806597 tempest-AttachVolumeNegativeTest-1378806597-project] Lock "1daf4f4c-0e4a-4779-b53a-78c48397ea2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120741) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 18:11:50.058151 dv-cinder-852009-8-iscsi devstack@n-api.service[120741]: DEBUG oslo_concurrency.lockutils [None req-576b97d2-add8-4412-90c8-1748f59efcd4 tempest-AttachVolumeNegativeTest-1378806597 tempest-AttachVolumeNegativeTest-1378806597-project] Acquiring lock "1daf4f4c-0e4a-4779-b53a-78c48397ea2f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120741) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 18:11:50.058601 dv-cinder-852009-8-iscsi devstack@n-api.service[120741]: DEBUG oslo_concurrency.lockutils [None req-576b97d2-add8-4412-90c8-1748f59efcd4 tempest-AttachVolumeNegativeTest-1378806597 tempest-AttachVolumeNegativeTest-1378806597-project] Lock "1daf4f4c-0e4a-4779-b53a-78c48397ea2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120741) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 18:11:50.059021 dv-cinder-852009-8-iscsi devstack@n-api.service[120741]: DEBUG oslo_concurrency.lockutils [None req-576b97d2-add8-4412-90c8-1748f59efcd4 tempest-AttachVolumeNegativeTest-1378806597 tempest-AttachVolumeNegativeTest-1378806597-project] Lock "1daf4f4c-0e4a-4779-b53a-78c48397ea2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120741) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 18:11:50.207249 dv-cinder-852009-8-iscsi devstack@n-api.service[120741]: DEBUG nova.policy [None req-576b97d2-add8-4412-90c8-1748f59efcd4 tempest-AttachVolumeNegativeTest-1378806597 tempest-AttachVolumeNegativeTest-1378806597-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '714cd09ba19b492f9a8c80343abcf6b9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '629311eda0584a5fbb7d8995cf27540c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120741) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 18:11:50.219770 dv-cinder-852009-8-iscsi devstack@n-api.service[120741]: INFO nova.api.openstack.requestlog [None req-576b97d2-add8-4412-90c8-1748f59efcd4 tempest-AttachVolumeNegativeTest-1378806597 tempest-AttachVolumeNegativeTest-1378806597-project] 10.222.0.43 "GET /compute/v2.1/servers/ed450488-2c80-4d82-8621-b55727628db1" status: 200 len: 1680 microversion: 2.1 time: 0.173676 Sep 13 18:11:50.220580 dv-cinder-852009-8-iscsi devstack@n-api.service[120741]: [pid: 120741|app: 0|req: 417/844] 10.222.0.43 () {58 vars in 1236 bytes} [Tue Sep 13 18:11:50 2022] GET /compute/v2.1/servers/ed450488-2c80-4d82-8621-b55727628db1 => generated 1680 bytes in 175 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 13 18:11:51.247488 dv-cinder-852009-8-iscsi devstack@n-api.service[120740]: DEBUG nova.api.openstack.wsgi [None req-4a5f966b-7fd6-4def-b112-35bcea610107 tempest-AttachVolumeNegativeTest-1378806597 tempest-AttachVolumeNegativeTest-1378806597-project] Calling method '>' {{(pid=120740) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 18:11:51.248156 dv-cinder-852009-8-iscsi devstack@n-api.service[120740]: DEBUG nova.compute.api [None req-4a5f966b-7fd6-4def-b112-35bcea610107 tempest-AttachVolumeNegativeTest-1378806597 tempest-AttachVolumeNegativeTest-1378806597-project] [instance: ed450488-2c80-4d82-8621-b55727628db1] Fetching instance by UUID {{(pid=120740) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 18:11:51.255364 dv-cinder-852009-8-iscsi devstack@n-api.service[120740]: DEBUG oslo_concurrency.lockutils [None req-4a5f966b-7fd6-4def-b112-35bcea610107 tempest-AttachVolumeNegativeTest-1378806597 tempest-AttachVolumeNegativeTest-1378806597-project] Acquiring lock "1daf4f4c-0e4a-4779-b53a-78c48397ea2f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120740) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 18:11:51.255868 dv-cinder-852009-8-iscsi devstack@n-api.service[120740]: DEBUG oslo_concurrency.lockutils [None req-4a5f966b-7fd6-4def-b112-35bcea610107 tempest-AttachVolumeNegativeTest-1378806597 tempest-AttachVolumeNegativeTest-1378806597-project] Lock "1daf4f4c-0e4a-4779-b53a-78c48397ea2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120740) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 18:11:51.256300 dv-cinder-852009-8-iscsi devstack@n-api.service[120740]: DEBUG oslo_concurrency.lockutils [None req-4a5f966b-7fd6-4def-b112-35bcea610107 tempest-AttachVolumeNegativeTest-1378806597 tempest-AttachVolumeNegativeTest-1378806597-project] Lock "1daf4f4c-0e4a-4779-b53a-78c48397ea2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120740) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 18:11:51.257043 dv-cinder-852009-8-iscsi devstack@n-api.service[120740]: DEBUG oslo_concurrency.lockutils [None req-4a5f966b-7fd6-4def-b112-35bcea610107 tempest-AttachVolumeNegativeTest-1378806597 tempest-AttachVolumeNegativeTest-1378806597-project] Acquiring lock "1daf4f4c-0e4a-4779-b53a-78c48397ea2f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120740) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 18:11:51.257495 dv-cinder-852009-8-iscsi devstack@n-api.service[120740]: DEBUG oslo_concurrency.lockutils [None req-4a5f966b-7fd6-4def-b112-35bcea610107 tempest-AttachVolumeNegativeTest-1378806597 tempest-AttachVolumeNegativeTest-1378806597-project] Lock "1daf4f4c-0e4a-4779-b53a-78c48397ea2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120740) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 18:11:51.257920 dv-cinder-852009-8-iscsi devstack@n-api.service[120740]: DEBUG oslo_concurrency.lockutils [None req-4a5f966b-7fd6-4def-b112-35bcea610107 tempest-AttachVolumeNegativeTest-1378806597 tempest-AttachVolumeNegativeTest-1378806597-project] Lock "1daf4f4c-0e4a-4779-b53a-78c48397ea2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120740) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 18:11:51.389005 dv-cinder-852009-8-iscsi devstack@n-api.service[120740]: DEBUG nova.policy [None req-4a5f966b-7fd6-4def-b112-35bcea610107 tempest-AttachVolumeNegativeTest-1378806597 tempest-AttachVolumeNegativeTest-1378806597-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '714cd09ba19b492f9a8c80343abcf6b9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '629311eda0584a5fbb7d8995cf27540c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120740) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 18:11:51.397158 dv-cinder-852009-8-iscsi devstack@n-api.service[120740]: INFO nova.api.openstack.requestlog [None req-4a5f966b-7fd6-4def-b112-35bcea610107 tempest-AttachVolumeNegativeTest-1378806597 tempest-AttachVolumeNegativeTest-1378806597-project] 10.222.0.43 "GET /compute/v2.1/servers/ed450488-2c80-4d82-8621-b55727628db1" status: 200 len: 1680 microversion: 2.1 time: 0.153998 Sep 13 18:11:51.397729 dv-cinder-852009-8-iscsi devstack@n-api.service[120740]: [pid: 120740|app: 0|req: 428/845] 10.222.0.43 () {58 vars in 1236 bytes} [Tue Sep 13 18:11:51 2022] GET /compute/v2.1/servers/ed450488-2c80-4d82-8621-b55727628db1 => generated 1680 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 13 18:11:52.421229 dv-cinder-852009-8-iscsi devstack@n-api.service[120741]: DEBUG nova.api.openstack.wsgi [None req-d892d5c3-f60e-4d8e-adb1-e59a0375c1d8 tempest-AttachVolumeNegativeTest-1378806597 tempest-AttachVolumeNegativeTest-1378806597-project] Calling method '>' {{(pid=120741) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 18:11:52.421990 dv-cinder-852009-8-iscsi devstack@n-api.service[120741]: DEBUG nova.compute.api [None req-d892d5c3-f60e-4d8e-adb1-e59a0375c1d8 tempest-AttachVolumeNegativeTest-1378806597 tempest-AttachVolumeNegativeTest-1378806597-project] [instance: ed450488-2c80-4d82-8621-b55727628db1] Fetching instance by UUID {{(pid=120741) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 18:11:52.432252 dv-cinder-852009-8-iscsi devstack@n-api.service[120741]: DEBUG oslo_concurrency.lockutils [None req-d892d5c3-f60e-4d8e-adb1-e59a0375c1d8 tempest-AttachVolumeNegativeTest-1378806597 tempest-AttachVolumeNegativeTest-1378806597-project] Acquiring lock "1daf4f4c-0e4a-4779-b53a-78c48397ea2f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120741) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 18:11:52.433145 dv-cinder-852009-8-iscsi devstack@n-api.service[120741]: DEBUG oslo_concurrency.lockutils [None req-d892d5c3-f60e-4d8e-adb1-e59a0375c1d8 tempest-AttachVolumeNegativeTest-1378806597 tempest-AttachVolumeNegativeTest-1378806597-project] Lock "1daf4f4c-0e4a-4779-b53a-78c48397ea2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120741) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 18:11:52.433655 dv-cinder-852009-8-iscsi devstack@n-api.service[120741]: DEBUG oslo_concurrency.lockutils [None req-d892d5c3-f60e-4d8e-adb1-e59a0375c1d8 tempest-AttachVolumeNegativeTest-1378806597 tempest-AttachVolumeNegativeTest-1378806597-project] Lock "1daf4f4c-0e4a-4779-b53a-78c48397ea2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120741) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 18:11:52.434509 dv-cinder-852009-8-iscsi devstack@n-api.service[120741]: DEBUG oslo_concurrency.lockutils [None req-d892d5c3-f60e-4d8e-adb1-e59a0375c1d8 tempest-AttachVolumeNegativeTest-1378806597 tempest-AttachVolumeNegativeTest-1378806597-project] Acquiring lock "1daf4f4c-0e4a-4779-b53a-78c48397ea2f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120741) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 18:11:52.435177 dv-cinder-852009-8-iscsi devstack@n-api.service[120741]: DEBUG oslo_concurrency.lockutils [None req-d892d5c3-f60e-4d8e-adb1-e59a0375c1d8 tempest-AttachVolumeNegativeTest-1378806597 tempest-AttachVolumeNegativeTest-1378806597-project] Lock "1daf4f4c-0e4a-4779-b53a-78c48397ea2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120741) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 18:11:52.435685 dv-cinder-852009-8-iscsi devstack@n-api.service[120741]: DEBUG oslo_concurrency.lockutils [None req-d892d5c3-f60e-4d8e-adb1-e59a0375c1d8 tempest-AttachVolumeNegativeTest-1378806597 tempest-AttachVolumeNegativeTest-1378806597-project] Lock "1daf4f4c-0e4a-4779-b53a-78c48397ea2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120741) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 18:11:52.503597 dv-cinder-852009-8-iscsi devstack@n-api.service[120741]: DEBUG nova.policy [None req-d892d5c3-f60e-4d8e-adb1-e59a0375c1d8 tempest-AttachVolumeNegativeTest-1378806597 tempest-AttachVolumeNegativeTest-1378806597-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '714cd09ba19b492f9a8c80343abcf6b9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '629311eda0584a5fbb7d8995cf27540c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120741) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 18:11:52.511813 dv-cinder-852009-8-iscsi devstack@n-api.service[120741]: INFO nova.api.openstack.requestlog [None req-d892d5c3-f60e-4d8e-adb1-e59a0375c1d8 tempest-AttachVolumeNegativeTest-1378806597 tempest-AttachVolumeNegativeTest-1378806597-project] 10.222.0.43 "GET /compute/v2.1/servers/ed450488-2c80-4d82-8621-b55727628db1" status: 200 len: 1614 microversion: 2.1 time: 0.094477 Sep 13 18:11:52.512385 dv-cinder-852009-8-iscsi devstack@n-api.service[120741]: [pid: 120741|app: 0|req: 418/846] 10.222.0.43 () {58 vars in 1236 bytes} [Tue Sep 13 18:11:52 2022] GET /compute/v2.1/servers/ed450488-2c80-4d82-8621-b55727628db1 => generated 1614 bytes in 96 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 13 18:11:52.646246 dv-cinder-852009-8-iscsi devstack@n-api.service[120740]: DEBUG nova.api.openstack.wsgi [req-f31c648d-c2d2-4d9a-abb8-643fe1305367 req-d5d26e72-cd3b-48bc-8f2b-2f3c7fe3fb0e service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "ed450488-2c80-4d82-8621-b55727628db1", "name": "network-vif-deleted", "tag": "3d065c9a-0e6e-4104-9f7a-99af060b5230"}]} {{(pid=120740) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 13 18:11:52.657982 dv-cinder-852009-8-iscsi devstack@n-api.service[120740]: DEBUG oslo_concurrency.lockutils [req-f31c648d-c2d2-4d9a-abb8-643fe1305367 req-d5d26e72-cd3b-48bc-8f2b-2f3c7fe3fb0e service nova] Acquiring lock "1daf4f4c-0e4a-4779-b53a-78c48397ea2f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120740) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 18:11:52.658466 dv-cinder-852009-8-iscsi devstack@n-api.service[120740]: DEBUG oslo_concurrency.lockutils [req-f31c648d-c2d2-4d9a-abb8-643fe1305367 req-d5d26e72-cd3b-48bc-8f2b-2f3c7fe3fb0e service nova] Lock "1daf4f4c-0e4a-4779-b53a-78c48397ea2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120740) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 18:11:52.658870 dv-cinder-852009-8-iscsi devstack@n-api.service[120740]: DEBUG oslo_concurrency.lockutils [req-f31c648d-c2d2-4d9a-abb8-643fe1305367 req-d5d26e72-cd3b-48bc-8f2b-2f3c7fe3fb0e service nova] Lock "1daf4f4c-0e4a-4779-b53a-78c48397ea2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120740) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 18:11:52.671514 dv-cinder-852009-8-iscsi devstack@n-api.service[120740]: INFO nova.api.openstack.compute.server_external_events [req-f31c648d-c2d2-4d9a-abb8-643fe1305367 req-d5d26e72-cd3b-48bc-8f2b-2f3c7fe3fb0e service nova] Creating event network-vif-deleted:3d065c9a-0e6e-4104-9f7a-99af060b5230 for instance ed450488-2c80-4d82-8621-b55727628db1 on hv-cinder-85200 Sep 13 18:11:52.677445 dv-cinder-852009-8-iscsi devstack@n-api.service[120740]: INFO nova.api.openstack.requestlog [req-f31c648d-c2d2-4d9a-abb8-643fe1305367 req-d5d26e72-cd3b-48bc-8f2b-2f3c7fe3fb0e service nova] 10.222.0.43 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.035115 Sep 13 18:11:52.678045 dv-cinder-852009-8-iscsi devstack@n-api.service[120740]: [pid: 120740|app: 0|req: 429/847] 10.222.0.43 () {64 vars in 1317 bytes} [Tue Sep 13 18:11:52 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 37 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 13 18:11:53.536009 dv-cinder-852009-8-iscsi devstack@n-api.service[120741]: DEBUG nova.api.openstack.wsgi [None req-006379d2-4240-4fd9-82ce-a7ae6364d77e tempest-AttachVolumeNegativeTest-1378806597 tempest-AttachVolumeNegativeTest-1378806597-project] Calling method '>' {{(pid=120741) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 18:11:53.536742 dv-cinder-852009-8-iscsi devstack@n-api.service[120741]: DEBUG nova.compute.api [None req-006379d2-4240-4fd9-82ce-a7ae6364d77e tempest-AttachVolumeNegativeTest-1378806597 tempest-AttachVolumeNegativeTest-1378806597-project] [instance: ed450488-2c80-4d82-8621-b55727628db1] Fetching instance by UUID {{(pid=120741) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 18:11:53.543910 dv-cinder-852009-8-iscsi devstack@n-api.service[120741]: DEBUG oslo_concurrency.lockutils [None req-006379d2-4240-4fd9-82ce-a7ae6364d77e tempest-AttachVolumeNegativeTest-1378806597 tempest-AttachVolumeNegativeTest-1378806597-project] Acquiring lock "1daf4f4c-0e4a-4779-b53a-78c48397ea2f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120741) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 18:11:53.544476 dv-cinder-852009-8-iscsi devstack@n-api.service[120741]: DEBUG oslo_concurrency.lockutils [None req-006379d2-4240-4fd9-82ce-a7ae6364d77e tempest-AttachVolumeNegativeTest-1378806597 tempest-AttachVolumeNegativeTest-1378806597-project] Lock "1daf4f4c-0e4a-4779-b53a-78c48397ea2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120741) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 18:11:53.545070 dv-cinder-852009-8-iscsi devstack@n-api.service[120741]: DEBUG oslo_concurrency.lockutils [None req-006379d2-4240-4fd9-82ce-a7ae6364d77e tempest-AttachVolumeNegativeTest-1378806597 tempest-AttachVolumeNegativeTest-1378806597-project] Lock "1daf4f4c-0e4a-4779-b53a-78c48397ea2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120741) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 18:11:53.545769 dv-cinder-852009-8-iscsi devstack@n-api.service[120741]: DEBUG oslo_concurrency.lockutils [None req-006379d2-4240-4fd9-82ce-a7ae6364d77e tempest-AttachVolumeNegativeTest-1378806597 tempest-AttachVolumeNegativeTest-1378806597-project] Acquiring lock "1daf4f4c-0e4a-4779-b53a-78c48397ea2f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120741) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 18:11:53.546230 dv-cinder-852009-8-iscsi devstack@n-api.service[120741]: DEBUG oslo_concurrency.lockutils [None req-006379d2-4240-4fd9-82ce-a7ae6364d77e tempest-AttachVolumeNegativeTest-1378806597 tempest-AttachVolumeNegativeTest-1378806597-project] Lock "1daf4f4c-0e4a-4779-b53a-78c48397ea2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120741) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 18:11:53.546654 dv-cinder-852009-8-iscsi devstack@n-api.service[120741]: DEBUG oslo_concurrency.lockutils [None req-006379d2-4240-4fd9-82ce-a7ae6364d77e tempest-AttachVolumeNegativeTest-1378806597 tempest-AttachVolumeNegativeTest-1378806597-project] Lock "1daf4f4c-0e4a-4779-b53a-78c48397ea2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120741) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 18:11:53.560895 dv-cinder-852009-8-iscsi devstack@n-api.service[120741]: INFO nova.api.openstack.wsgi [None req-006379d2-4240-4fd9-82ce-a7ae6364d77e tempest-AttachVolumeNegativeTest-1378806597 tempest-AttachVolumeNegativeTest-1378806597-project] HTTP exception thrown: Instance ed450488-2c80-4d82-8621-b55727628db1 could not be found. Sep 13 18:11:53.563476 dv-cinder-852009-8-iscsi devstack@n-api.service[120741]: DEBUG nova.api.openstack.wsgi [None req-006379d2-4240-4fd9-82ce-a7ae6364d77e tempest-AttachVolumeNegativeTest-1378806597 tempest-AttachVolumeNegativeTest-1378806597-project] Request method failure captured: Sep 13 18:11:53.563476 dv-cinder-852009-8-iscsi devstack@n-api.service[120741]: request: GET /compute/v2.1/servers/ed450488-2c80-4d82-8621-b55727628db1 HTTP/1.1 Sep 13 18:11:53.563476 dv-cinder-852009-8-iscsi devstack@n-api.service[120741]: Accept: application/json Sep 13 18:11:53.563476 dv-cinder-852009-8-iscsi devstack@n-api.service[120741]: Accept-Encoding: identity Sep 13 18:11:53.563476 dv-cinder-852009-8-iscsi devstack@n-api.service[120741]: Connection: close Sep 13 18:11:53.563476 dv-cinder-852009-8-iscsi devstack@n-api.service[120741]: Content-Length: 0 Sep 13 18:11:53.563476 dv-cinder-852009-8-iscsi devstack@n-api.service[120741]: Content-Type: application/json Sep 13 18:11:53.563476 dv-cinder-852009-8-iscsi devstack@n-api.service[120741]: Host: 10.222.0.43 Sep 13 18:11:53.563476 dv-cinder-852009-8-iscsi devstack@n-api.service[120741]: Openstack-System-Scope: None Sep 13 18:11:53.563476 dv-cinder-852009-8-iscsi devstack@n-api.service[120741]: User-Agent: python-urllib3/1.26.12 Sep 13 18:11:53.563476 dv-cinder-852009-8-iscsi devstack@n-api.service[120741]: X-Auth-Token: gAAAAABjIMciYi08KSU35iQHMuJ1d9BLU6OdnvTV0lQhD4NCYaw8no8S5_0xWB47N9lmu7akofQLpLV68heC7pPUCZsTXqIq6Y42WLp6VXHhyQNxgHSYkPKRLV6tG6CCOIlPDetRfNDVZw3BkXYviJ38fOivAdsSaqCGCQ-A5bO5QGkWPiqoF58 Sep 13 18:11:53.563476 dv-cinder-852009-8-iscsi devstack@n-api.service[120741]: X-Domain-Id: None Sep 13 18:11:53.563476 dv-cinder-852009-8-iscsi devstack@n-api.service[120741]: X-Domain-Name: None Sep 13 18:11:53.563476 dv-cinder-852009-8-iscsi devstack@n-api.service[120741]: X-Identity-Status: Confirmed Sep 13 18:11:53.563476 dv-cinder-852009-8-iscsi devstack@n-api.service[120741]: X-Is-Admin-Project: True Sep 13 18:11:53.563476 dv-cinder-852009-8-iscsi devstack@n-api.service[120741]: X-Project-Domain-Id: default Sep 13 18:11:53.563476 dv-cinder-852009-8-iscsi devstack@n-api.service[120741]: X-Project-Domain-Name: Default Sep 13 18:11:53.563476 dv-cinder-852009-8-iscsi devstack@n-api.service[120741]: X-Project-Id: 629311eda0584a5fbb7d8995cf27540c Sep 13 18:11:53.563476 dv-cinder-852009-8-iscsi devstack@n-api.service[120741]: X-Project-Name: tempest-AttachVolumeNegativeTest-1378806597 Sep 13 18:11:53.563476 dv-cinder-852009-8-iscsi devstack@n-api.service[120741]: X-Role: reader,member Sep 13 18:11:53.563476 dv-cinder-852009-8-iscsi devstack@n-api.service[120741]: X-Roles: reader,member Sep 13 18:11:53.565215 dv-cinder-852009-8-iscsi devstack@n-api.service[120741]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/identity"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/compute/v2/629311eda0584a5fbb7d8995cf27540c"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.43:8080", "publicURL": "http://10.222.0.43:8080/v1/AUTH_629311eda0584a5fbb7d8995cf27540c"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43:9696/networking"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/volume/v3/629311eda0584a5fbb7d8995cf27540c"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/compute/v2.1"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/placement"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/volume/v3/629311eda0584a5fbb7d8995cf27540c"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/image"}]}] Sep 13 18:11:53.565215 dv-cinder-852009-8-iscsi devstack@n-api.service[120741]: X-Tenant: tempest-AttachVolumeNegativeTest-1378806597 Sep 13 18:11:53.565215 dv-cinder-852009-8-iscsi devstack@n-api.service[120741]: X-Tenant-Id: 629311eda0584a5fbb7d8995cf27540c Sep 13 18:11:53.565215 dv-cinder-852009-8-iscsi devstack@n-api.service[120741]: X-Tenant-Name: tempest-AttachVolumeNegativeTest-1378806597 Sep 13 18:11:53.565215 dv-cinder-852009-8-iscsi devstack@n-api.service[120741]: X-User: tempest-AttachVolumeNegativeTest-1378806597-project Sep 13 18:11:53.565215 dv-cinder-852009-8-iscsi devstack@n-api.service[120741]: X-User-Domain-Id: default Sep 13 18:11:53.565215 dv-cinder-852009-8-iscsi devstack@n-api.service[120741]: X-User-Domain-Name: Default Sep 13 18:11:53.565215 dv-cinder-852009-8-iscsi devstack@n-api.service[120741]: X-User-Id: 714cd09ba19b492f9a8c80343abcf6b9 Sep 13 18:11:53.565215 dv-cinder-852009-8-iscsi devstack@n-api.service[120741]: X-User-Name: tempest-AttachVolumeNegativeTest-1378806597-project Sep 13 18:11:53.565215 dv-cinder-852009-8-iscsi devstack@n-api.service[120741]: method: > Sep 13 18:11:53.565215 dv-cinder-852009-8-iscsi devstack@n-api.service[120741]: exception: Instance ed450488-2c80-4d82-8621-b55727628db1 could not be found. Sep 13 18:11:53.565215 dv-cinder-852009-8-iscsi devstack@n-api.service[120741]: action_args: {'id': 'ed450488-2c80-4d82-8621-b55727628db1'} Sep 13 18:11:53.566112 dv-cinder-852009-8-iscsi devstack@n-api.service[120741]: {{(pid=120741) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 13 18:11:53.566112 dv-cinder-852009-8-iscsi devstack@n-api.service[120741]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 13 18:11:53.566112 dv-cinder-852009-8-iscsi devstack@n-api.service[120741]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Sep 13 18:11:53.566112 dv-cinder-852009-8-iscsi devstack@n-api.service[120741]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Sep 13 18:11:53.566112 dv-cinder-852009-8-iscsi devstack@n-api.service[120741]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Sep 13 18:11:53.566112 dv-cinder-852009-8-iscsi devstack@n-api.service[120741]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Sep 13 18:11:53.566112 dv-cinder-852009-8-iscsi devstack@n-api.service[120741]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Sep 13 18:11:53.566112 dv-cinder-852009-8-iscsi devstack@n-api.service[120741]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Sep 13 18:11:53.566112 dv-cinder-852009-8-iscsi devstack@n-api.service[120741]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Sep 13 18:11:53.566112 dv-cinder-852009-8-iscsi devstack@n-api.service[120741]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Sep 13 18:11:53.566112 dv-cinder-852009-8-iscsi devstack@n-api.service[120741]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance ed450488-2c80-4d82-8621-b55727628db1 could not be found. Sep 13 18:11:53.566112 dv-cinder-852009-8-iscsi devstack@n-api.service[120741]: ERROR nova.api.openstack.wsgi Sep 13 18:11:53.566112 dv-cinder-852009-8-iscsi devstack@n-api.service[120741]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 13 18:11:53.566112 dv-cinder-852009-8-iscsi devstack@n-api.service[120741]: ERROR nova.api.openstack.wsgi Sep 13 18:11:53.566112 dv-cinder-852009-8-iscsi devstack@n-api.service[120741]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 13 18:11:53.566112 dv-cinder-852009-8-iscsi devstack@n-api.service[120741]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 13 18:11:53.566112 dv-cinder-852009-8-iscsi devstack@n-api.service[120741]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 13 18:11:53.566112 dv-cinder-852009-8-iscsi devstack@n-api.service[120741]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 13 18:11:53.566112 dv-cinder-852009-8-iscsi devstack@n-api.service[120741]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 13 18:11:53.566112 dv-cinder-852009-8-iscsi devstack@n-api.service[120741]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 13 18:11:53.567385 dv-cinder-852009-8-iscsi devstack@n-api.service[120741]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 13 18:11:53.567385 dv-cinder-852009-8-iscsi devstack@n-api.service[120741]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Sep 13 18:11:53.567385 dv-cinder-852009-8-iscsi devstack@n-api.service[120741]: ERROR nova.api.openstack.wsgi instance = self._get_server( Sep 13 18:11:53.567385 dv-cinder-852009-8-iscsi devstack@n-api.service[120741]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Sep 13 18:11:53.567385 dv-cinder-852009-8-iscsi devstack@n-api.service[120741]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Sep 13 18:11:53.567385 dv-cinder-852009-8-iscsi devstack@n-api.service[120741]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Sep 13 18:11:53.567385 dv-cinder-852009-8-iscsi devstack@n-api.service[120741]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Sep 13 18:11:53.567385 dv-cinder-852009-8-iscsi devstack@n-api.service[120741]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance ed450488-2c80-4d82-8621-b55727628db1 could not be found. Sep 13 18:11:53.567385 dv-cinder-852009-8-iscsi devstack@n-api.service[120741]: ERROR nova.api.openstack.wsgi Sep 13 18:11:53.567385 dv-cinder-852009-8-iscsi devstack@n-api.service[120741]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 13 18:11:53.567385 dv-cinder-852009-8-iscsi devstack@n-api.service[120741]: ERROR nova.api.openstack.wsgi Sep 13 18:11:53.567385 dv-cinder-852009-8-iscsi devstack@n-api.service[120741]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 13 18:11:53.567385 dv-cinder-852009-8-iscsi devstack@n-api.service[120741]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 13 18:11:53.567385 dv-cinder-852009-8-iscsi devstack@n-api.service[120741]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 13 18:11:53.567385 dv-cinder-852009-8-iscsi devstack@n-api.service[120741]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 13 18:11:53.567385 dv-cinder-852009-8-iscsi devstack@n-api.service[120741]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 13 18:11:53.567385 dv-cinder-852009-8-iscsi devstack@n-api.service[120741]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance ed450488-2c80-4d82-8621-b55727628db1 could not be found. Sep 13 18:11:53.567385 dv-cinder-852009-8-iscsi devstack@n-api.service[120741]: ERROR nova.api.openstack.wsgi Sep 13 18:11:53.568918 dv-cinder-852009-8-iscsi devstack@n-api.service[120741]: DEBUG nova.api.openstack.wsgi [None req-006379d2-4240-4fd9-82ce-a7ae6364d77e tempest-AttachVolumeNegativeTest-1378806597 tempest-AttachVolumeNegativeTest-1378806597-project] Returning 404 to user: Instance ed450488-2c80-4d82-8621-b55727628db1 could not be found. {{(pid=120741) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 13 18:11:53.568918 dv-cinder-852009-8-iscsi devstack@n-api.service[120741]: INFO nova.api.openstack.requestlog [None req-006379d2-4240-4fd9-82ce-a7ae6364d77e tempest-AttachVolumeNegativeTest-1378806597 tempest-AttachVolumeNegativeTest-1378806597-project] 10.222.0.43 "GET /compute/v2.1/servers/ed450488-2c80-4d82-8621-b55727628db1" status: 404 len: 111 microversion: 2.1 time: 0.032114 Sep 13 18:11:53.568918 dv-cinder-852009-8-iscsi devstack@n-api.service[120741]: [pid: 120741|app: 0|req: 419/848] 10.222.0.43 () {58 vars in 1236 bytes} [Tue Sep 13 18:11:53 2022] GET /compute/v2.1/servers/ed450488-2c80-4d82-8621-b55727628db1 => generated 111 bytes in 34 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Sep 13 18:11:53.577021 dv-cinder-852009-8-iscsi devstack@n-api.service[120740]: DEBUG nova.api.openstack.wsgi [None req-58bec2c2-b906-44d9-9e28-4aad3f349e26 tempest-AttachVolumeNegativeTest-1378806597 tempest-AttachVolumeNegativeTest-1378806597-project] Calling method '.version_select at 0x7fa626a0e700>' {{(pid=120740) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 18:11:53.597671 dv-cinder-852009-8-iscsi devstack@n-api.service[120740]: INFO nova.api.openstack.requestlog [None req-58bec2c2-b906-44d9-9e28-4aad3f349e26 tempest-AttachVolumeNegativeTest-1378806597 tempest-AttachVolumeNegativeTest-1378806597-project] 10.222.0.43 "DELETE /compute/v2.1/os-keypairs/tempest-keypair-1779374111" status: 202 len: 0 microversion: 2.1 time: 0.024915 Sep 13 18:11:53.598291 dv-cinder-852009-8-iscsi devstack@n-api.service[120740]: [pid: 120740|app: 0|req: 430/849] 10.222.0.43 () {58 vars in 1221 bytes} [Tue Sep 13 18:11:53 2022] DELETE /compute/v2.1/os-keypairs/tempest-keypair-1779374111 => generated 0 bytes in 26 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Sep 13 18:11:54.217545 dv-cinder-852009-8-iscsi devstack@n-api.service[120741]: DEBUG nova.api.openstack.wsgi [None req-af00d3d6-edd2-4b18-a21b-3119e26fb66b tempest-AttachVolumeNegativeTest-1378806597 tempest-AttachVolumeNegativeTest-1378806597-project] Action: 'create', calling method: .version_select at 0x7fa626994dc0>, body: {"keypair": {"name": "tempest-keypair-284252898", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBH/3bVDqakEkDT8SOP9ucC2M5ie5/YfFS5eSouD8l4gDut24VuvVHZezgad/+Nr8r1rnRlJm/9qcBm8JyClOx3KDcrcJDUVqF8MxQqnkNE8blIGnBnf+FAzIxoXh+dTH1A=="}} {{(pid=120741) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 13 18:11:54.236908 dv-cinder-852009-8-iscsi devstack@n-api.service[120741]: DEBUG nova.quota [None req-af00d3d6-edd2-4b18-a21b-3119e26fb66b tempest-AttachVolumeNegativeTest-1378806597 tempest-AttachVolumeNegativeTest-1378806597-project] Getting quotas for project 629311eda0584a5fbb7d8995cf27540c. Resources: {'key_pairs'} {{(pid=120741) _get_quotas /opt/stack/nova/nova/quota.py:393}} Sep 13 18:11:54.241177 dv-cinder-852009-8-iscsi devstack@n-api.service[120741]: DEBUG nova.quota [None req-af00d3d6-edd2-4b18-a21b-3119e26fb66b tempest-AttachVolumeNegativeTest-1378806597 tempest-AttachVolumeNegativeTest-1378806597-project] Getting quotas for user 714cd09ba19b492f9a8c80343abcf6b9 and project 629311eda0584a5fbb7d8995cf27540c. Resources: {'key_pairs'} {{(pid=120741) _get_quotas /opt/stack/nova/nova/quota.py:383}} Sep 13 18:11:54.267216 dv-cinder-852009-8-iscsi devstack@n-api.service[120741]: INFO nova.api.openstack.requestlog [None req-af00d3d6-edd2-4b18-a21b-3119e26fb66b tempest-AttachVolumeNegativeTest-1378806597 tempest-AttachVolumeNegativeTest-1378806597-project] 10.222.0.43 "POST /compute/v2.1/os-keypairs" status: 200 len: 385 microversion: 2.1 time: 0.056111 Sep 13 18:11:54.267823 dv-cinder-852009-8-iscsi devstack@n-api.service[120741]: [pid: 120741|app: 0|req: 420/850] 10.222.0.43 () {60 vars in 1159 bytes} [Tue Sep 13 18:11:54 2022] POST /compute/v2.1/os-keypairs => generated 385 bytes in 58 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 13 18:11:55.594247 dv-cinder-852009-8-iscsi devstack@n-api.service[120740]: DEBUG nova.api.openstack.wsgi [None req-7d9a02c3-4125-4624-9c52-fe52a08fecd4 tempest-AttachVolumeNegativeTest-1378806597 tempest-AttachVolumeNegativeTest-1378806597-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-AttachVolumeNegativeTest-server-1587666664", "imageRef": "33034e36-e6b2-4847-92a1-ff3188c05a4a", "flavorRef": "452", "adminPass": "***", "networks": [{"uuid": "e19c1043-1c23-4c64-9720-4320d6d11eef"}], "security_groups": [{"name": "tempest-securitygroup--189225284"}], "key_name": "tempest-keypair-284252898", "user_data": "}} {{(pid=120740) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 13 18:11:55.831832 dv-cinder-852009-8-iscsi devstack@n-api.service[120740]: DEBUG nova.network.neutron [None req-7d9a02c3-4125-4624-9c52-fe52a08fecd4 tempest-AttachVolumeNegativeTest-1378806597 tempest-AttachVolumeNegativeTest-1378806597-project] validate_networks() for [('e19c1043-1c23-4c64-9720-4320d6d11eef', None, None, None, None, None)] {{(pid=120740) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Sep 13 18:11:56.258301 dv-cinder-852009-8-iscsi devstack@n-api.service[120740]: DEBUG nova.virt.hardware [None req-7d9a02c3-4125-4624-9c52-fe52a08fecd4 tempest-AttachVolumeNegativeTest-1378806597 tempest-AttachVolumeNegativeTest-1378806597-project] Flavor limits 0:0:0 {{(pid=120740) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Sep 13 18:11:56.258720 dv-cinder-852009-8-iscsi devstack@n-api.service[120740]: DEBUG nova.virt.hardware [None req-7d9a02c3-4125-4624-9c52-fe52a08fecd4 tempest-AttachVolumeNegativeTest-1378806597 tempest-AttachVolumeNegativeTest-1378806597-project] Image limits 0:0:0 {{(pid=120740) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Sep 13 18:11:56.259192 dv-cinder-852009-8-iscsi devstack@n-api.service[120740]: DEBUG nova.virt.hardware [None req-7d9a02c3-4125-4624-9c52-fe52a08fecd4 tempest-AttachVolumeNegativeTest-1378806597 tempest-AttachVolumeNegativeTest-1378806597-project] Flavor pref 0:0:0 {{(pid=120740) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Sep 13 18:11:56.259600 dv-cinder-852009-8-iscsi devstack@n-api.service[120740]: DEBUG nova.virt.hardware [None req-7d9a02c3-4125-4624-9c52-fe52a08fecd4 tempest-AttachVolumeNegativeTest-1378806597 tempest-AttachVolumeNegativeTest-1378806597-project] Image pref 0:0:0 {{(pid=120740) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Sep 13 18:11:56.260013 dv-cinder-852009-8-iscsi devstack@n-api.service[120740]: DEBUG nova.virt.hardware [None req-7d9a02c3-4125-4624-9c52-fe52a08fecd4 tempest-AttachVolumeNegativeTest-1378806597 tempest-AttachVolumeNegativeTest-1378806597-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=120740) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Sep 13 18:11:56.271415 dv-cinder-852009-8-iscsi devstack@n-api.service[120740]: DEBUG oslo_concurrency.lockutils [None req-7d9a02c3-4125-4624-9c52-fe52a08fecd4 tempest-AttachVolumeNegativeTest-1378806597 tempest-AttachVolumeNegativeTest-1378806597-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120740) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 18:11:56.271896 dv-cinder-852009-8-iscsi devstack@n-api.service[120740]: DEBUG oslo_concurrency.lockutils [None req-7d9a02c3-4125-4624-9c52-fe52a08fecd4 tempest-AttachVolumeNegativeTest-1378806597 tempest-AttachVolumeNegativeTest-1378806597-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120740) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 18:11:56.272327 dv-cinder-852009-8-iscsi devstack@n-api.service[120740]: DEBUG oslo_concurrency.lockutils [None req-7d9a02c3-4125-4624-9c52-fe52a08fecd4 tempest-AttachVolumeNegativeTest-1378806597 tempest-AttachVolumeNegativeTest-1378806597-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120740) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 18:11:56.273090 dv-cinder-852009-8-iscsi devstack@n-api.service[120740]: DEBUG oslo_concurrency.lockutils [None req-7d9a02c3-4125-4624-9c52-fe52a08fecd4 tempest-AttachVolumeNegativeTest-1378806597 tempest-AttachVolumeNegativeTest-1378806597-project] Acquiring lock "1daf4f4c-0e4a-4779-b53a-78c48397ea2f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120740) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 18:11:56.273899 dv-cinder-852009-8-iscsi devstack@n-api.service[120740]: DEBUG oslo_concurrency.lockutils [None req-7d9a02c3-4125-4624-9c52-fe52a08fecd4 tempest-AttachVolumeNegativeTest-1378806597 tempest-AttachVolumeNegativeTest-1378806597-project] Lock "1daf4f4c-0e4a-4779-b53a-78c48397ea2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120740) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 18:11:56.274111 dv-cinder-852009-8-iscsi devstack@n-api.service[120740]: DEBUG oslo_concurrency.lockutils [None req-7d9a02c3-4125-4624-9c52-fe52a08fecd4 tempest-AttachVolumeNegativeTest-1378806597 tempest-AttachVolumeNegativeTest-1378806597-project] Lock "1daf4f4c-0e4a-4779-b53a-78c48397ea2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120740) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 18:11:56.294110 dv-cinder-852009-8-iscsi devstack@n-api.service[120740]: DEBUG nova.quota [None req-7d9a02c3-4125-4624-9c52-fe52a08fecd4 tempest-AttachVolumeNegativeTest-1378806597 tempest-AttachVolumeNegativeTest-1378806597-project] Getting quotas for project 629311eda0584a5fbb7d8995cf27540c. Resources: {'cores', 'ram', 'instances'} {{(pid=120740) _get_quotas /opt/stack/nova/nova/quota.py:393}} Sep 13 18:11:56.298261 dv-cinder-852009-8-iscsi devstack@n-api.service[120740]: DEBUG nova.quota [None req-7d9a02c3-4125-4624-9c52-fe52a08fecd4 tempest-AttachVolumeNegativeTest-1378806597 tempest-AttachVolumeNegativeTest-1378806597-project] Getting quotas for user 714cd09ba19b492f9a8c80343abcf6b9 and project 629311eda0584a5fbb7d8995cf27540c. Resources: {'cores', 'ram', 'instances'} {{(pid=120740) _get_quotas /opt/stack/nova/nova/quota.py:383}} Sep 13 18:11:56.309967 dv-cinder-852009-8-iscsi devstack@n-api.service[120740]: DEBUG nova.compute.api [None req-7d9a02c3-4125-4624-9c52-fe52a08fecd4 tempest-AttachVolumeNegativeTest-1378806597 tempest-AttachVolumeNegativeTest-1378806597-project] Going to run 1 instances... {{(pid=120740) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Sep 13 18:11:56.312406 dv-cinder-852009-8-iscsi devstack@n-api.service[120740]: DEBUG nova.compute.api [None req-7d9a02c3-4125-4624-9c52-fe52a08fecd4 tempest-AttachVolumeNegativeTest-1378806597 tempest-AttachVolumeNegativeTest-1378806597-project] [instance: 1ad76e39-3a52-4014-8206-2b3863bce8b7] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='33034e36-e6b2-4847-92a1-ff3188c05a4a',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=120740) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Sep 13 18:11:56.366086 dv-cinder-852009-8-iscsi devstack@n-api.service[120740]: ERROR oslo.messaging._drivers.impl_rabbit [None req-7d9a02c3-4125-4624-9c52-fe52a08fecd4 tempest-AttachVolumeNegativeTest-1378806597 tempest-AttachVolumeNegativeTest-1378806597-project] [67d1759e-0fea-43f0-aa12-11b7c82f6bd2] AMQP server on 10.222.0.43:5672 is unreachable: [Errno 104] Connection reset by peer. Trying again in 1 seconds.: ConnectionResetError: [Errno 104] Connection reset by peer Sep 13 18:11:57.379220 dv-cinder-852009-8-iscsi devstack@n-api.service[120740]: INFO oslo.messaging._drivers.impl_rabbit [None req-7d9a02c3-4125-4624-9c52-fe52a08fecd4 tempest-AttachVolumeNegativeTest-1378806597 tempest-AttachVolumeNegativeTest-1378806597-project] [67d1759e-0fea-43f0-aa12-11b7c82f6bd2] Reconnected to AMQP server on 10.222.0.43:5672 via [amqp] client with port 56044. Sep 13 18:11:57.387332 dv-cinder-852009-8-iscsi devstack@n-api.service[120740]: INFO nova.api.openstack.requestlog [None req-7d9a02c3-4125-4624-9c52-fe52a08fecd4 tempest-AttachVolumeNegativeTest-1378806597 tempest-AttachVolumeNegativeTest-1378806597-project] 10.222.0.43 "POST /compute/v2.1/servers" status: 202 len: 401 microversion: 2.1 time: 1.797724 Sep 13 18:11:57.388415 dv-cinder-852009-8-iscsi devstack@n-api.service[120740]: [pid: 120740|app: 0|req: 431/851] 10.222.0.43 () {60 vars in 1147 bytes} [Tue Sep 13 18:11:55 2022] POST /compute/v2.1/servers => generated 401 bytes in 1800 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Sep 13 18:11:57.406131 dv-cinder-852009-8-iscsi devstack@n-api.service[120741]: DEBUG nova.api.openstack.wsgi [None req-88c3805f-1600-4cb2-bfa6-c2998cbff970 tempest-AttachVolumeNegativeTest-1378806597 tempest-AttachVolumeNegativeTest-1378806597-project] Calling method '>' {{(pid=120741) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 18:11:57.406719 dv-cinder-852009-8-iscsi devstack@n-api.service[120741]: DEBUG nova.compute.api [None req-88c3805f-1600-4cb2-bfa6-c2998cbff970 tempest-AttachVolumeNegativeTest-1378806597 tempest-AttachVolumeNegativeTest-1378806597-project] [instance: 1ad76e39-3a52-4014-8206-2b3863bce8b7] Fetching instance by UUID {{(pid=120741) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 18:11:57.460764 dv-cinder-852009-8-iscsi devstack@n-api.service[120741]: DEBUG nova.policy [None req-88c3805f-1600-4cb2-bfa6-c2998cbff970 tempest-AttachVolumeNegativeTest-1378806597 tempest-AttachVolumeNegativeTest-1378806597-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '714cd09ba19b492f9a8c80343abcf6b9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '629311eda0584a5fbb7d8995cf27540c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120741) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 18:11:57.467987 dv-cinder-852009-8-iscsi devstack@n-api.service[120741]: INFO nova.api.openstack.requestlog [None req-88c3805f-1600-4cb2-bfa6-c2998cbff970 tempest-AttachVolumeNegativeTest-1378806597 tempest-AttachVolumeNegativeTest-1378806597-project] 10.222.0.43 "GET /compute/v2.1/servers/1ad76e39-3a52-4014-8206-2b3863bce8b7" status: 200 len: 1241 microversion: 2.1 time: 0.067777 Sep 13 18:11:57.468591 dv-cinder-852009-8-iscsi devstack@n-api.service[120741]: [pid: 120741|app: 0|req: 421/852] 10.222.0.43 () {58 vars in 1236 bytes} [Tue Sep 13 18:11:57 2022] GET /compute/v2.1/servers/1ad76e39-3a52-4014-8206-2b3863bce8b7 => generated 1241 bytes in 69 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 13 18:11:58.491799 dv-cinder-852009-8-iscsi devstack@n-api.service[120740]: DEBUG nova.api.openstack.wsgi [None req-54e634d3-e50b-49f8-b389-8c19b16469f1 tempest-AttachVolumeNegativeTest-1378806597 tempest-AttachVolumeNegativeTest-1378806597-project] Calling method '>' {{(pid=120740) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 18:11:58.492411 dv-cinder-852009-8-iscsi devstack@n-api.service[120740]: DEBUG nova.compute.api [None req-54e634d3-e50b-49f8-b389-8c19b16469f1 tempest-AttachVolumeNegativeTest-1378806597 tempest-AttachVolumeNegativeTest-1378806597-project] [instance: 1ad76e39-3a52-4014-8206-2b3863bce8b7] Fetching instance by UUID {{(pid=120740) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 18:11:58.499385 dv-cinder-852009-8-iscsi devstack@n-api.service[120740]: DEBUG oslo_concurrency.lockutils [None req-54e634d3-e50b-49f8-b389-8c19b16469f1 tempest-AttachVolumeNegativeTest-1378806597 tempest-AttachVolumeNegativeTest-1378806597-project] Acquiring lock "1daf4f4c-0e4a-4779-b53a-78c48397ea2f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120740) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 18:11:58.499964 dv-cinder-852009-8-iscsi devstack@n-api.service[120740]: DEBUG oslo_concurrency.lockutils [None req-54e634d3-e50b-49f8-b389-8c19b16469f1 tempest-AttachVolumeNegativeTest-1378806597 tempest-AttachVolumeNegativeTest-1378806597-project] Lock "1daf4f4c-0e4a-4779-b53a-78c48397ea2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120740) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 18:11:58.500473 dv-cinder-852009-8-iscsi devstack@n-api.service[120740]: DEBUG oslo_concurrency.lockutils [None req-54e634d3-e50b-49f8-b389-8c19b16469f1 tempest-AttachVolumeNegativeTest-1378806597 tempest-AttachVolumeNegativeTest-1378806597-project] Lock "1daf4f4c-0e4a-4779-b53a-78c48397ea2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120740) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 18:11:58.501544 dv-cinder-852009-8-iscsi devstack@n-api.service[120740]: DEBUG oslo_concurrency.lockutils [None req-54e634d3-e50b-49f8-b389-8c19b16469f1 tempest-AttachVolumeNegativeTest-1378806597 tempest-AttachVolumeNegativeTest-1378806597-project] Acquiring lock "1daf4f4c-0e4a-4779-b53a-78c48397ea2f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120740) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 18:11:58.502063 dv-cinder-852009-8-iscsi devstack@n-api.service[120740]: DEBUG oslo_concurrency.lockutils [None req-54e634d3-e50b-49f8-b389-8c19b16469f1 tempest-AttachVolumeNegativeTest-1378806597 tempest-AttachVolumeNegativeTest-1378806597-project] Lock "1daf4f4c-0e4a-4779-b53a-78c48397ea2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120740) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 18:11:58.502575 dv-cinder-852009-8-iscsi devstack@n-api.service[120740]: DEBUG oslo_concurrency.lockutils [None req-54e634d3-e50b-49f8-b389-8c19b16469f1 tempest-AttachVolumeNegativeTest-1378806597 tempest-AttachVolumeNegativeTest-1378806597-project] Lock "1daf4f4c-0e4a-4779-b53a-78c48397ea2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120740) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 18:11:58.572132 dv-cinder-852009-8-iscsi devstack@n-api.service[120740]: DEBUG nova.policy [None req-54e634d3-e50b-49f8-b389-8c19b16469f1 tempest-AttachVolumeNegativeTest-1378806597 tempest-AttachVolumeNegativeTest-1378806597-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '714cd09ba19b492f9a8c80343abcf6b9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '629311eda0584a5fbb7d8995cf27540c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120740) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 18:11:58.579973 dv-cinder-852009-8-iscsi devstack@n-api.service[120740]: INFO nova.api.openstack.requestlog [None req-54e634d3-e50b-49f8-b389-8c19b16469f1 tempest-AttachVolumeNegativeTest-1378806597 tempest-AttachVolumeNegativeTest-1378806597-project] 10.222.0.43 "GET /compute/v2.1/servers/1ad76e39-3a52-4014-8206-2b3863bce8b7" status: 200 len: 1311 microversion: 2.1 time: 0.092742 Sep 13 18:11:58.580564 dv-cinder-852009-8-iscsi devstack@n-api.service[120740]: [pid: 120740|app: 0|req: 432/853] 10.222.0.43 () {58 vars in 1236 bytes} [Tue Sep 13 18:11:58 2022] GET /compute/v2.1/servers/1ad76e39-3a52-4014-8206-2b3863bce8b7 => generated 1311 bytes in 94 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 13 18:11:59.603167 dv-cinder-852009-8-iscsi devstack@n-api.service[120741]: DEBUG nova.api.openstack.wsgi [None req-37bca7e1-faca-4228-a6e6-ae653a5b70d6 tempest-AttachVolumeNegativeTest-1378806597 tempest-AttachVolumeNegativeTest-1378806597-project] Calling method '>' {{(pid=120741) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 18:11:59.603749 dv-cinder-852009-8-iscsi devstack@n-api.service[120741]: DEBUG nova.compute.api [None req-37bca7e1-faca-4228-a6e6-ae653a5b70d6 tempest-AttachVolumeNegativeTest-1378806597 tempest-AttachVolumeNegativeTest-1378806597-project] [instance: 1ad76e39-3a52-4014-8206-2b3863bce8b7] Fetching instance by UUID {{(pid=120741) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 18:11:59.610477 dv-cinder-852009-8-iscsi devstack@n-api.service[120741]: DEBUG oslo_concurrency.lockutils [None req-37bca7e1-faca-4228-a6e6-ae653a5b70d6 tempest-AttachVolumeNegativeTest-1378806597 tempest-AttachVolumeNegativeTest-1378806597-project] Acquiring lock "1daf4f4c-0e4a-4779-b53a-78c48397ea2f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120741) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 18:11:59.610962 dv-cinder-852009-8-iscsi devstack@n-api.service[120741]: DEBUG oslo_concurrency.lockutils [None req-37bca7e1-faca-4228-a6e6-ae653a5b70d6 tempest-AttachVolumeNegativeTest-1378806597 tempest-AttachVolumeNegativeTest-1378806597-project] Lock "1daf4f4c-0e4a-4779-b53a-78c48397ea2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120741) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 18:11:59.611397 dv-cinder-852009-8-iscsi devstack@n-api.service[120741]: DEBUG oslo_concurrency.lockutils [None req-37bca7e1-faca-4228-a6e6-ae653a5b70d6 tempest-AttachVolumeNegativeTest-1378806597 tempest-AttachVolumeNegativeTest-1378806597-project] Lock "1daf4f4c-0e4a-4779-b53a-78c48397ea2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120741) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 18:11:59.612124 dv-cinder-852009-8-iscsi devstack@n-api.service[120741]: DEBUG oslo_concurrency.lockutils [None req-37bca7e1-faca-4228-a6e6-ae653a5b70d6 tempest-AttachVolumeNegativeTest-1378806597 tempest-AttachVolumeNegativeTest-1378806597-project] Acquiring lock "1daf4f4c-0e4a-4779-b53a-78c48397ea2f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120741) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 18:11:59.612611 dv-cinder-852009-8-iscsi devstack@n-api.service[120741]: DEBUG oslo_concurrency.lockutils [None req-37bca7e1-faca-4228-a6e6-ae653a5b70d6 tempest-AttachVolumeNegativeTest-1378806597 tempest-AttachVolumeNegativeTest-1378806597-project] Lock "1daf4f4c-0e4a-4779-b53a-78c48397ea2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120741) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 18:11:59.613034 dv-cinder-852009-8-iscsi devstack@n-api.service[120741]: DEBUG oslo_concurrency.lockutils [None req-37bca7e1-faca-4228-a6e6-ae653a5b70d6 tempest-AttachVolumeNegativeTest-1378806597 tempest-AttachVolumeNegativeTest-1378806597-project] Lock "1daf4f4c-0e4a-4779-b53a-78c48397ea2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120741) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 18:11:59.745386 dv-cinder-852009-8-iscsi devstack@n-api.service[120741]: DEBUG nova.policy [None req-37bca7e1-faca-4228-a6e6-ae653a5b70d6 tempest-AttachVolumeNegativeTest-1378806597 tempest-AttachVolumeNegativeTest-1378806597-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '714cd09ba19b492f9a8c80343abcf6b9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '629311eda0584a5fbb7d8995cf27540c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120741) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 18:11:59.753591 dv-cinder-852009-8-iscsi devstack@n-api.service[120741]: INFO nova.api.openstack.requestlog [None req-37bca7e1-faca-4228-a6e6-ae653a5b70d6 tempest-AttachVolumeNegativeTest-1378806597 tempest-AttachVolumeNegativeTest-1378806597-project] 10.222.0.43 "GET /compute/v2.1/servers/1ad76e39-3a52-4014-8206-2b3863bce8b7" status: 200 len: 1366 microversion: 2.1 time: 0.154447 Sep 13 18:11:59.754494 dv-cinder-852009-8-iscsi devstack@n-api.service[120741]: [pid: 120741|app: 0|req: 422/854] 10.222.0.43 () {58 vars in 1236 bytes} [Tue Sep 13 18:11:59 2022] GET /compute/v2.1/servers/1ad76e39-3a52-4014-8206-2b3863bce8b7 => generated 1366 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 13 18:11:59.805335 dv-cinder-852009-8-iscsi devstack@n-api.service[120740]: DEBUG nova.api.openstack.wsgi [req-ee909e39-f34e-4a4b-bade-cf0edc26ec9e req-1d1271c1-3c23-450f-980c-21a487dca759 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "1ad76e39-3a52-4014-8206-2b3863bce8b7", "tag": "995ef904-eae3-4b2e-a0b6-78d0f33276af"}]} {{(pid=120740) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 13 18:11:59.815590 dv-cinder-852009-8-iscsi devstack@n-api.service[120740]: DEBUG oslo_concurrency.lockutils [req-ee909e39-f34e-4a4b-bade-cf0edc26ec9e req-1d1271c1-3c23-450f-980c-21a487dca759 service nova] Acquiring lock "1daf4f4c-0e4a-4779-b53a-78c48397ea2f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120740) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 18:11:59.816072 dv-cinder-852009-8-iscsi devstack@n-api.service[120740]: DEBUG oslo_concurrency.lockutils [req-ee909e39-f34e-4a4b-bade-cf0edc26ec9e req-1d1271c1-3c23-450f-980c-21a487dca759 service nova] Lock "1daf4f4c-0e4a-4779-b53a-78c48397ea2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120740) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 18:11:59.816519 dv-cinder-852009-8-iscsi devstack@n-api.service[120740]: DEBUG oslo_concurrency.lockutils [req-ee909e39-f34e-4a4b-bade-cf0edc26ec9e req-1d1271c1-3c23-450f-980c-21a487dca759 service nova] Lock "1daf4f4c-0e4a-4779-b53a-78c48397ea2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120740) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 18:11:59.827924 dv-cinder-852009-8-iscsi devstack@n-api.service[120740]: INFO nova.api.openstack.compute.server_external_events [req-ee909e39-f34e-4a4b-bade-cf0edc26ec9e req-1d1271c1-3c23-450f-980c-21a487dca759 service nova] Creating event network-changed:995ef904-eae3-4b2e-a0b6-78d0f33276af for instance 1ad76e39-3a52-4014-8206-2b3863bce8b7 on hv-cinder-85200 Sep 13 18:11:59.832831 dv-cinder-852009-8-iscsi devstack@n-api.service[120740]: INFO nova.api.openstack.requestlog [req-ee909e39-f34e-4a4b-bade-cf0edc26ec9e req-1d1271c1-3c23-450f-980c-21a487dca759 service nova] 10.222.0.43 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.031212 Sep 13 18:11:59.833434 dv-cinder-852009-8-iscsi devstack@n-api.service[120740]: [pid: 120740|app: 0|req: 433/855] 10.222.0.43 () {64 vars in 1317 bytes} [Tue Sep 13 18:11:59 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 33 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 13 18:12:00.780404 dv-cinder-852009-8-iscsi devstack@n-api.service[120741]: DEBUG nova.api.openstack.wsgi [None req-3ba6f91e-f9d3-4a34-961b-269a0a668b7f tempest-AttachVolumeNegativeTest-1378806597 tempest-AttachVolumeNegativeTest-1378806597-project] Calling method '>' {{(pid=120741) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 18:12:00.781436 dv-cinder-852009-8-iscsi devstack@n-api.service[120741]: DEBUG nova.compute.api [None req-3ba6f91e-f9d3-4a34-961b-269a0a668b7f tempest-AttachVolumeNegativeTest-1378806597 tempest-AttachVolumeNegativeTest-1378806597-project] [instance: 1ad76e39-3a52-4014-8206-2b3863bce8b7] Fetching instance by UUID {{(pid=120741) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 18:12:00.792331 dv-cinder-852009-8-iscsi devstack@n-api.service[120741]: DEBUG oslo_concurrency.lockutils [None req-3ba6f91e-f9d3-4a34-961b-269a0a668b7f tempest-AttachVolumeNegativeTest-1378806597 tempest-AttachVolumeNegativeTest-1378806597-project] Acquiring lock "1daf4f4c-0e4a-4779-b53a-78c48397ea2f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120741) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 18:12:00.793180 dv-cinder-852009-8-iscsi devstack@n-api.service[120741]: DEBUG oslo_concurrency.lockutils [None req-3ba6f91e-f9d3-4a34-961b-269a0a668b7f tempest-AttachVolumeNegativeTest-1378806597 tempest-AttachVolumeNegativeTest-1378806597-project] Lock "1daf4f4c-0e4a-4779-b53a-78c48397ea2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120741) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 18:12:00.793992 dv-cinder-852009-8-iscsi devstack@n-api.service[120741]: DEBUG oslo_concurrency.lockutils [None req-3ba6f91e-f9d3-4a34-961b-269a0a668b7f tempest-AttachVolumeNegativeTest-1378806597 tempest-AttachVolumeNegativeTest-1378806597-project] Lock "1daf4f4c-0e4a-4779-b53a-78c48397ea2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120741) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 18:12:00.794683 dv-cinder-852009-8-iscsi devstack@n-api.service[120741]: DEBUG oslo_concurrency.lockutils [None req-3ba6f91e-f9d3-4a34-961b-269a0a668b7f tempest-AttachVolumeNegativeTest-1378806597 tempest-AttachVolumeNegativeTest-1378806597-project] Acquiring lock "1daf4f4c-0e4a-4779-b53a-78c48397ea2f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120741) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 18:12:00.795142 dv-cinder-852009-8-iscsi devstack@n-api.service[120741]: DEBUG oslo_concurrency.lockutils [None req-3ba6f91e-f9d3-4a34-961b-269a0a668b7f tempest-AttachVolumeNegativeTest-1378806597 tempest-AttachVolumeNegativeTest-1378806597-project] Lock "1daf4f4c-0e4a-4779-b53a-78c48397ea2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120741) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 18:12:00.795563 dv-cinder-852009-8-iscsi devstack@n-api.service[120741]: DEBUG oslo_concurrency.lockutils [None req-3ba6f91e-f9d3-4a34-961b-269a0a668b7f tempest-AttachVolumeNegativeTest-1378806597 tempest-AttachVolumeNegativeTest-1378806597-project] Lock "1daf4f4c-0e4a-4779-b53a-78c48397ea2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120741) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 18:12:00.931941 dv-cinder-852009-8-iscsi devstack@n-api.service[120741]: DEBUG nova.policy [None req-3ba6f91e-f9d3-4a34-961b-269a0a668b7f tempest-AttachVolumeNegativeTest-1378806597 tempest-AttachVolumeNegativeTest-1378806597-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '714cd09ba19b492f9a8c80343abcf6b9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '629311eda0584a5fbb7d8995cf27540c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120741) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 18:12:00.939966 dv-cinder-852009-8-iscsi devstack@n-api.service[120741]: INFO nova.api.openstack.requestlog [None req-3ba6f91e-f9d3-4a34-961b-269a0a668b7f tempest-AttachVolumeNegativeTest-1378806597 tempest-AttachVolumeNegativeTest-1378806597-project] 10.222.0.43 "GET /compute/v2.1/servers/1ad76e39-3a52-4014-8206-2b3863bce8b7" status: 200 len: 1366 microversion: 2.1 time: 0.166244 Sep 13 18:12:00.940521 dv-cinder-852009-8-iscsi devstack@n-api.service[120741]: [pid: 120741|app: 0|req: 423/856] 10.222.0.43 () {58 vars in 1236 bytes} [Tue Sep 13 18:12:00 2022] GET /compute/v2.1/servers/1ad76e39-3a52-4014-8206-2b3863bce8b7 => generated 1366 bytes in 168 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 13 18:12:01.968576 dv-cinder-852009-8-iscsi devstack@n-api.service[120740]: DEBUG nova.api.openstack.wsgi [None req-e4d3b77f-3117-4a2b-8365-b681960f9c45 tempest-AttachVolumeNegativeTest-1378806597 tempest-AttachVolumeNegativeTest-1378806597-project] Calling method '>' {{(pid=120740) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 18:12:01.969506 dv-cinder-852009-8-iscsi devstack@n-api.service[120740]: DEBUG nova.compute.api [None req-e4d3b77f-3117-4a2b-8365-b681960f9c45 tempest-AttachVolumeNegativeTest-1378806597 tempest-AttachVolumeNegativeTest-1378806597-project] [instance: 1ad76e39-3a52-4014-8206-2b3863bce8b7] Fetching instance by UUID {{(pid=120740) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 18:12:01.978090 dv-cinder-852009-8-iscsi devstack@n-api.service[120740]: DEBUG oslo_concurrency.lockutils [None req-e4d3b77f-3117-4a2b-8365-b681960f9c45 tempest-AttachVolumeNegativeTest-1378806597 tempest-AttachVolumeNegativeTest-1378806597-project] Acquiring lock "1daf4f4c-0e4a-4779-b53a-78c48397ea2f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120740) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 18:12:01.978742 dv-cinder-852009-8-iscsi devstack@n-api.service[120740]: DEBUG oslo_concurrency.lockutils [None req-e4d3b77f-3117-4a2b-8365-b681960f9c45 tempest-AttachVolumeNegativeTest-1378806597 tempest-AttachVolumeNegativeTest-1378806597-project] Lock "1daf4f4c-0e4a-4779-b53a-78c48397ea2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120740) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 18:12:01.979316 dv-cinder-852009-8-iscsi devstack@n-api.service[120740]: DEBUG oslo_concurrency.lockutils [None req-e4d3b77f-3117-4a2b-8365-b681960f9c45 tempest-AttachVolumeNegativeTest-1378806597 tempest-AttachVolumeNegativeTest-1378806597-project] Lock "1daf4f4c-0e4a-4779-b53a-78c48397ea2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120740) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 18:12:01.980236 dv-cinder-852009-8-iscsi devstack@n-api.service[120740]: DEBUG oslo_concurrency.lockutils [None req-e4d3b77f-3117-4a2b-8365-b681960f9c45 tempest-AttachVolumeNegativeTest-1378806597 tempest-AttachVolumeNegativeTest-1378806597-project] Acquiring lock "1daf4f4c-0e4a-4779-b53a-78c48397ea2f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120740) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 18:12:01.980877 dv-cinder-852009-8-iscsi devstack@n-api.service[120740]: DEBUG oslo_concurrency.lockutils [None req-e4d3b77f-3117-4a2b-8365-b681960f9c45 tempest-AttachVolumeNegativeTest-1378806597 tempest-AttachVolumeNegativeTest-1378806597-project] Lock "1daf4f4c-0e4a-4779-b53a-78c48397ea2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120740) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 18:12:01.981442 dv-cinder-852009-8-iscsi devstack@n-api.service[120740]: DEBUG oslo_concurrency.lockutils [None req-e4d3b77f-3117-4a2b-8365-b681960f9c45 tempest-AttachVolumeNegativeTest-1378806597 tempest-AttachVolumeNegativeTest-1378806597-project] Lock "1daf4f4c-0e4a-4779-b53a-78c48397ea2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120740) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 18:12:02.118136 dv-cinder-852009-8-iscsi devstack@n-api.service[120740]: DEBUG nova.policy [None req-e4d3b77f-3117-4a2b-8365-b681960f9c45 tempest-AttachVolumeNegativeTest-1378806597 tempest-AttachVolumeNegativeTest-1378806597-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '714cd09ba19b492f9a8c80343abcf6b9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '629311eda0584a5fbb7d8995cf27540c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120740) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 18:12:02.126567 dv-cinder-852009-8-iscsi devstack@n-api.service[120740]: INFO nova.api.openstack.requestlog [None req-e4d3b77f-3117-4a2b-8365-b681960f9c45 tempest-AttachVolumeNegativeTest-1378806597 tempest-AttachVolumeNegativeTest-1378806597-project] 10.222.0.43 "GET /compute/v2.1/servers/1ad76e39-3a52-4014-8206-2b3863bce8b7" status: 200 len: 1366 microversion: 2.1 time: 0.165531 Sep 13 18:12:02.127144 dv-cinder-852009-8-iscsi devstack@n-api.service[120740]: [pid: 120740|app: 0|req: 434/857] 10.222.0.43 () {58 vars in 1236 bytes} [Tue Sep 13 18:12:01 2022] GET /compute/v2.1/servers/1ad76e39-3a52-4014-8206-2b3863bce8b7 => generated 1366 bytes in 167 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 13 18:12:03.153820 dv-cinder-852009-8-iscsi devstack@n-api.service[120741]: DEBUG nova.api.openstack.wsgi [None req-d71d013a-fb6d-407c-b418-cffb2181bb8c tempest-AttachVolumeNegativeTest-1378806597 tempest-AttachVolumeNegativeTest-1378806597-project] Calling method '>' {{(pid=120741) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 18:12:03.154897 dv-cinder-852009-8-iscsi devstack@n-api.service[120741]: DEBUG nova.compute.api [None req-d71d013a-fb6d-407c-b418-cffb2181bb8c tempest-AttachVolumeNegativeTest-1378806597 tempest-AttachVolumeNegativeTest-1378806597-project] [instance: 1ad76e39-3a52-4014-8206-2b3863bce8b7] Fetching instance by UUID {{(pid=120741) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 18:12:03.165827 dv-cinder-852009-8-iscsi devstack@n-api.service[120741]: DEBUG oslo_concurrency.lockutils [None req-d71d013a-fb6d-407c-b418-cffb2181bb8c tempest-AttachVolumeNegativeTest-1378806597 tempest-AttachVolumeNegativeTest-1378806597-project] Acquiring lock "1daf4f4c-0e4a-4779-b53a-78c48397ea2f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120741) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 18:12:03.166645 dv-cinder-852009-8-iscsi devstack@n-api.service[120741]: DEBUG oslo_concurrency.lockutils [None req-d71d013a-fb6d-407c-b418-cffb2181bb8c tempest-AttachVolumeNegativeTest-1378806597 tempest-AttachVolumeNegativeTest-1378806597-project] Lock "1daf4f4c-0e4a-4779-b53a-78c48397ea2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120741) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 18:12:03.167358 dv-cinder-852009-8-iscsi devstack@n-api.service[120741]: DEBUG oslo_concurrency.lockutils [None req-d71d013a-fb6d-407c-b418-cffb2181bb8c tempest-AttachVolumeNegativeTest-1378806597 tempest-AttachVolumeNegativeTest-1378806597-project] Lock "1daf4f4c-0e4a-4779-b53a-78c48397ea2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120741) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 18:12:03.168504 dv-cinder-852009-8-iscsi devstack@n-api.service[120741]: DEBUG oslo_concurrency.lockutils [None req-d71d013a-fb6d-407c-b418-cffb2181bb8c tempest-AttachVolumeNegativeTest-1378806597 tempest-AttachVolumeNegativeTest-1378806597-project] Acquiring lock "1daf4f4c-0e4a-4779-b53a-78c48397ea2f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120741) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 18:12:03.169209 dv-cinder-852009-8-iscsi devstack@n-api.service[120741]: DEBUG oslo_concurrency.lockutils [None req-d71d013a-fb6d-407c-b418-cffb2181bb8c tempest-AttachVolumeNegativeTest-1378806597 tempest-AttachVolumeNegativeTest-1378806597-project] Lock "1daf4f4c-0e4a-4779-b53a-78c48397ea2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120741) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 18:12:03.169632 dv-cinder-852009-8-iscsi devstack@n-api.service[120741]: DEBUG oslo_concurrency.lockutils [None req-d71d013a-fb6d-407c-b418-cffb2181bb8c tempest-AttachVolumeNegativeTest-1378806597 tempest-AttachVolumeNegativeTest-1378806597-project] Lock "1daf4f4c-0e4a-4779-b53a-78c48397ea2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120741) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 18:12:03.298597 dv-cinder-852009-8-iscsi devstack@n-api.service[120741]: DEBUG nova.policy [None req-d71d013a-fb6d-407c-b418-cffb2181bb8c tempest-AttachVolumeNegativeTest-1378806597 tempest-AttachVolumeNegativeTest-1378806597-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '714cd09ba19b492f9a8c80343abcf6b9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '629311eda0584a5fbb7d8995cf27540c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120741) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 18:12:03.306374 dv-cinder-852009-8-iscsi devstack@n-api.service[120741]: INFO nova.api.openstack.requestlog [None req-d71d013a-fb6d-407c-b418-cffb2181bb8c tempest-AttachVolumeNegativeTest-1378806597 tempest-AttachVolumeNegativeTest-1378806597-project] 10.222.0.43 "GET /compute/v2.1/servers/1ad76e39-3a52-4014-8206-2b3863bce8b7" status: 200 len: 1366 microversion: 2.1 time: 0.159180 Sep 13 18:12:03.306952 dv-cinder-852009-8-iscsi devstack@n-api.service[120741]: [pid: 120741|app: 0|req: 424/858] 10.222.0.43 () {58 vars in 1236 bytes} [Tue Sep 13 18:12:03 2022] GET /compute/v2.1/servers/1ad76e39-3a52-4014-8206-2b3863bce8b7 => generated 1366 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 13 18:12:04.330384 dv-cinder-852009-8-iscsi devstack@n-api.service[120740]: DEBUG nova.api.openstack.wsgi [None req-562dc311-5a7c-4c46-8be9-dc25b8bb1ffa tempest-AttachVolumeNegativeTest-1378806597 tempest-AttachVolumeNegativeTest-1378806597-project] Calling method '>' {{(pid=120740) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 18:12:04.331007 dv-cinder-852009-8-iscsi devstack@n-api.service[120740]: DEBUG nova.compute.api [None req-562dc311-5a7c-4c46-8be9-dc25b8bb1ffa tempest-AttachVolumeNegativeTest-1378806597 tempest-AttachVolumeNegativeTest-1378806597-project] [instance: 1ad76e39-3a52-4014-8206-2b3863bce8b7] Fetching instance by UUID {{(pid=120740) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 18:12:04.337498 dv-cinder-852009-8-iscsi devstack@n-api.service[120740]: DEBUG oslo_concurrency.lockutils [None req-562dc311-5a7c-4c46-8be9-dc25b8bb1ffa tempest-AttachVolumeNegativeTest-1378806597 tempest-AttachVolumeNegativeTest-1378806597-project] Acquiring lock "1daf4f4c-0e4a-4779-b53a-78c48397ea2f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120740) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 18:12:04.337969 dv-cinder-852009-8-iscsi devstack@n-api.service[120740]: DEBUG oslo_concurrency.lockutils [None req-562dc311-5a7c-4c46-8be9-dc25b8bb1ffa tempest-AttachVolumeNegativeTest-1378806597 tempest-AttachVolumeNegativeTest-1378806597-project] Lock "1daf4f4c-0e4a-4779-b53a-78c48397ea2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120740) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 18:12:04.338398 dv-cinder-852009-8-iscsi devstack@n-api.service[120740]: DEBUG oslo_concurrency.lockutils [None req-562dc311-5a7c-4c46-8be9-dc25b8bb1ffa tempest-AttachVolumeNegativeTest-1378806597 tempest-AttachVolumeNegativeTest-1378806597-project] Lock "1daf4f4c-0e4a-4779-b53a-78c48397ea2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120740) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 18:12:04.339062 dv-cinder-852009-8-iscsi devstack@n-api.service[120740]: DEBUG oslo_concurrency.lockutils [None req-562dc311-5a7c-4c46-8be9-dc25b8bb1ffa tempest-AttachVolumeNegativeTest-1378806597 tempest-AttachVolumeNegativeTest-1378806597-project] Acquiring lock "1daf4f4c-0e4a-4779-b53a-78c48397ea2f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120740) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 18:12:04.339500 dv-cinder-852009-8-iscsi devstack@n-api.service[120740]: DEBUG oslo_concurrency.lockutils [None req-562dc311-5a7c-4c46-8be9-dc25b8bb1ffa tempest-AttachVolumeNegativeTest-1378806597 tempest-AttachVolumeNegativeTest-1378806597-project] Lock "1daf4f4c-0e4a-4779-b53a-78c48397ea2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120740) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 18:12:04.339911 dv-cinder-852009-8-iscsi devstack@n-api.service[120740]: DEBUG oslo_concurrency.lockutils [None req-562dc311-5a7c-4c46-8be9-dc25b8bb1ffa tempest-AttachVolumeNegativeTest-1378806597 tempest-AttachVolumeNegativeTest-1378806597-project] Lock "1daf4f4c-0e4a-4779-b53a-78c48397ea2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120740) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 18:12:04.482040 dv-cinder-852009-8-iscsi devstack@n-api.service[120740]: DEBUG nova.policy [None req-562dc311-5a7c-4c46-8be9-dc25b8bb1ffa tempest-AttachVolumeNegativeTest-1378806597 tempest-AttachVolumeNegativeTest-1378806597-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '714cd09ba19b492f9a8c80343abcf6b9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '629311eda0584a5fbb7d8995cf27540c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120740) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 18:12:04.490122 dv-cinder-852009-8-iscsi devstack@n-api.service[120740]: INFO nova.api.openstack.requestlog [None req-562dc311-5a7c-4c46-8be9-dc25b8bb1ffa tempest-AttachVolumeNegativeTest-1378806597 tempest-AttachVolumeNegativeTest-1378806597-project] 10.222.0.43 "GET /compute/v2.1/servers/1ad76e39-3a52-4014-8206-2b3863bce8b7" status: 200 len: 1366 microversion: 2.1 time: 0.163642 Sep 13 18:12:04.490690 dv-cinder-852009-8-iscsi devstack@n-api.service[120740]: [pid: 120740|app: 0|req: 435/859] 10.222.0.43 () {58 vars in 1236 bytes} [Tue Sep 13 18:12:04 2022] GET /compute/v2.1/servers/1ad76e39-3a52-4014-8206-2b3863bce8b7 => generated 1366 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 13 18:12:05.411526 dv-cinder-852009-8-iscsi devstack@n-api.service[120741]: DEBUG nova.api.openstack.wsgi [req-b848f78f-7bfc-49f0-878b-ba4e7a9acf97 req-444badb6-413e-494f-a8c6-6ec8e6899d21 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "1ad76e39-3a52-4014-8206-2b3863bce8b7", "name": "network-vif-plugged", "status": "completed", "tag": "995ef904-eae3-4b2e-a0b6-78d0f33276af"}]} {{(pid=120741) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 13 18:12:05.422386 dv-cinder-852009-8-iscsi devstack@n-api.service[120741]: DEBUG oslo_concurrency.lockutils [req-b848f78f-7bfc-49f0-878b-ba4e7a9acf97 req-444badb6-413e-494f-a8c6-6ec8e6899d21 service nova] Acquiring lock "1daf4f4c-0e4a-4779-b53a-78c48397ea2f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120741) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 18:12:05.422895 dv-cinder-852009-8-iscsi devstack@n-api.service[120741]: DEBUG oslo_concurrency.lockutils [req-b848f78f-7bfc-49f0-878b-ba4e7a9acf97 req-444badb6-413e-494f-a8c6-6ec8e6899d21 service nova] Lock "1daf4f4c-0e4a-4779-b53a-78c48397ea2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120741) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 18:12:05.424025 dv-cinder-852009-8-iscsi devstack@n-api.service[120741]: DEBUG oslo_concurrency.lockutils [req-b848f78f-7bfc-49f0-878b-ba4e7a9acf97 req-444badb6-413e-494f-a8c6-6ec8e6899d21 service nova] Lock "1daf4f4c-0e4a-4779-b53a-78c48397ea2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120741) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 18:12:05.436027 dv-cinder-852009-8-iscsi devstack@n-api.service[120741]: INFO nova.api.openstack.compute.server_external_events [req-b848f78f-7bfc-49f0-878b-ba4e7a9acf97 req-444badb6-413e-494f-a8c6-6ec8e6899d21 service nova] Creating event network-vif-plugged:995ef904-eae3-4b2e-a0b6-78d0f33276af for instance 1ad76e39-3a52-4014-8206-2b3863bce8b7 on hv-cinder-85200 Sep 13 18:12:05.441364 dv-cinder-852009-8-iscsi devstack@n-api.service[120741]: INFO nova.api.openstack.requestlog [req-b848f78f-7bfc-49f0-878b-ba4e7a9acf97 req-444badb6-413e-494f-a8c6-6ec8e6899d21 service nova] 10.222.0.43 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.033609 Sep 13 18:12:05.441959 dv-cinder-852009-8-iscsi devstack@n-api.service[120741]: [pid: 120741|app: 0|req: 425/860] 10.222.0.43 () {64 vars in 1317 bytes} [Tue Sep 13 18:12:05 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 35 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 13 18:12:05.513244 dv-cinder-852009-8-iscsi devstack@n-api.service[120740]: DEBUG nova.api.openstack.wsgi [None req-aa60a1e0-245f-4222-99ac-c90bf457f8ad tempest-AttachVolumeNegativeTest-1378806597 tempest-AttachVolumeNegativeTest-1378806597-project] Calling method '>' {{(pid=120740) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 18:12:05.513902 dv-cinder-852009-8-iscsi devstack@n-api.service[120740]: DEBUG nova.compute.api [None req-aa60a1e0-245f-4222-99ac-c90bf457f8ad tempest-AttachVolumeNegativeTest-1378806597 tempest-AttachVolumeNegativeTest-1378806597-project] [instance: 1ad76e39-3a52-4014-8206-2b3863bce8b7] Fetching instance by UUID {{(pid=120740) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 18:12:05.520921 dv-cinder-852009-8-iscsi devstack@n-api.service[120740]: DEBUG oslo_concurrency.lockutils [None req-aa60a1e0-245f-4222-99ac-c90bf457f8ad tempest-AttachVolumeNegativeTest-1378806597 tempest-AttachVolumeNegativeTest-1378806597-project] Acquiring lock "1daf4f4c-0e4a-4779-b53a-78c48397ea2f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120740) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 18:12:05.521402 dv-cinder-852009-8-iscsi devstack@n-api.service[120740]: DEBUG oslo_concurrency.lockutils [None req-aa60a1e0-245f-4222-99ac-c90bf457f8ad tempest-AttachVolumeNegativeTest-1378806597 tempest-AttachVolumeNegativeTest-1378806597-project] Lock "1daf4f4c-0e4a-4779-b53a-78c48397ea2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120740) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 18:12:05.521827 dv-cinder-852009-8-iscsi devstack@n-api.service[120740]: DEBUG oslo_concurrency.lockutils [None req-aa60a1e0-245f-4222-99ac-c90bf457f8ad tempest-AttachVolumeNegativeTest-1378806597 tempest-AttachVolumeNegativeTest-1378806597-project] Lock "1daf4f4c-0e4a-4779-b53a-78c48397ea2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120740) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 18:12:05.522498 dv-cinder-852009-8-iscsi devstack@n-api.service[120740]: DEBUG oslo_concurrency.lockutils [None req-aa60a1e0-245f-4222-99ac-c90bf457f8ad tempest-AttachVolumeNegativeTest-1378806597 tempest-AttachVolumeNegativeTest-1378806597-project] Acquiring lock "1daf4f4c-0e4a-4779-b53a-78c48397ea2f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120740) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 18:12:05.523139 dv-cinder-852009-8-iscsi devstack@n-api.service[120740]: DEBUG oslo_concurrency.lockutils [None req-aa60a1e0-245f-4222-99ac-c90bf457f8ad tempest-AttachVolumeNegativeTest-1378806597 tempest-AttachVolumeNegativeTest-1378806597-project] Lock "1daf4f4c-0e4a-4779-b53a-78c48397ea2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120740) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 18:12:05.523579 dv-cinder-852009-8-iscsi devstack@n-api.service[120740]: DEBUG oslo_concurrency.lockutils [None req-aa60a1e0-245f-4222-99ac-c90bf457f8ad tempest-AttachVolumeNegativeTest-1378806597 tempest-AttachVolumeNegativeTest-1378806597-project] Lock "1daf4f4c-0e4a-4779-b53a-78c48397ea2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120740) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 18:12:05.655488 dv-cinder-852009-8-iscsi devstack@n-api.service[120740]: DEBUG nova.policy [None req-aa60a1e0-245f-4222-99ac-c90bf457f8ad tempest-AttachVolumeNegativeTest-1378806597 tempest-AttachVolumeNegativeTest-1378806597-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '714cd09ba19b492f9a8c80343abcf6b9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '629311eda0584a5fbb7d8995cf27540c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120740) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 18:12:05.664574 dv-cinder-852009-8-iscsi devstack@n-api.service[120740]: INFO nova.api.openstack.requestlog [None req-aa60a1e0-245f-4222-99ac-c90bf457f8ad tempest-AttachVolumeNegativeTest-1378806597 tempest-AttachVolumeNegativeTest-1378806597-project] 10.222.0.43 "GET /compute/v2.1/servers/1ad76e39-3a52-4014-8206-2b3863bce8b7" status: 200 len: 1366 microversion: 2.1 time: 0.155213 Sep 13 18:12:05.665151 dv-cinder-852009-8-iscsi devstack@n-api.service[120740]: [pid: 120740|app: 0|req: 436/861] 10.222.0.43 () {58 vars in 1236 bytes} [Tue Sep 13 18:12:05 2022] GET /compute/v2.1/servers/1ad76e39-3a52-4014-8206-2b3863bce8b7 => generated 1366 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 13 18:12:06.688212 dv-cinder-852009-8-iscsi devstack@n-api.service[120741]: DEBUG nova.api.openstack.wsgi [None req-ae46aa3b-9237-4242-91bb-25abc5f0fe80 tempest-AttachVolumeNegativeTest-1378806597 tempest-AttachVolumeNegativeTest-1378806597-project] Calling method '>' {{(pid=120741) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 18:12:06.688847 dv-cinder-852009-8-iscsi devstack@n-api.service[120741]: DEBUG nova.compute.api [None req-ae46aa3b-9237-4242-91bb-25abc5f0fe80 tempest-AttachVolumeNegativeTest-1378806597 tempest-AttachVolumeNegativeTest-1378806597-project] [instance: 1ad76e39-3a52-4014-8206-2b3863bce8b7] Fetching instance by UUID {{(pid=120741) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 18:12:06.695982 dv-cinder-852009-8-iscsi devstack@n-api.service[120741]: DEBUG oslo_concurrency.lockutils [None req-ae46aa3b-9237-4242-91bb-25abc5f0fe80 tempest-AttachVolumeNegativeTest-1378806597 tempest-AttachVolumeNegativeTest-1378806597-project] Acquiring lock "1daf4f4c-0e4a-4779-b53a-78c48397ea2f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120741) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 18:12:06.696456 dv-cinder-852009-8-iscsi devstack@n-api.service[120741]: DEBUG oslo_concurrency.lockutils [None req-ae46aa3b-9237-4242-91bb-25abc5f0fe80 tempest-AttachVolumeNegativeTest-1378806597 tempest-AttachVolumeNegativeTest-1378806597-project] Lock "1daf4f4c-0e4a-4779-b53a-78c48397ea2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120741) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 18:12:06.696945 dv-cinder-852009-8-iscsi devstack@n-api.service[120741]: DEBUG oslo_concurrency.lockutils [None req-ae46aa3b-9237-4242-91bb-25abc5f0fe80 tempest-AttachVolumeNegativeTest-1378806597 tempest-AttachVolumeNegativeTest-1378806597-project] Lock "1daf4f4c-0e4a-4779-b53a-78c48397ea2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120741) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 18:12:06.697630 dv-cinder-852009-8-iscsi devstack@n-api.service[120741]: DEBUG oslo_concurrency.lockutils [None req-ae46aa3b-9237-4242-91bb-25abc5f0fe80 tempest-AttachVolumeNegativeTest-1378806597 tempest-AttachVolumeNegativeTest-1378806597-project] Acquiring lock "1daf4f4c-0e4a-4779-b53a-78c48397ea2f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120741) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 18:12:06.698077 dv-cinder-852009-8-iscsi devstack@n-api.service[120741]: DEBUG oslo_concurrency.lockutils [None req-ae46aa3b-9237-4242-91bb-25abc5f0fe80 tempest-AttachVolumeNegativeTest-1378806597 tempest-AttachVolumeNegativeTest-1378806597-project] Lock "1daf4f4c-0e4a-4779-b53a-78c48397ea2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120741) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 18:12:06.698498 dv-cinder-852009-8-iscsi devstack@n-api.service[120741]: DEBUG oslo_concurrency.lockutils [None req-ae46aa3b-9237-4242-91bb-25abc5f0fe80 tempest-AttachVolumeNegativeTest-1378806597 tempest-AttachVolumeNegativeTest-1378806597-project] Lock "1daf4f4c-0e4a-4779-b53a-78c48397ea2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120741) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 18:12:06.840170 dv-cinder-852009-8-iscsi devstack@n-api.service[120741]: DEBUG nova.policy [None req-ae46aa3b-9237-4242-91bb-25abc5f0fe80 tempest-AttachVolumeNegativeTest-1378806597 tempest-AttachVolumeNegativeTest-1378806597-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '714cd09ba19b492f9a8c80343abcf6b9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '629311eda0584a5fbb7d8995cf27540c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120741) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 18:12:06.847913 dv-cinder-852009-8-iscsi devstack@n-api.service[120741]: INFO nova.api.openstack.requestlog [None req-ae46aa3b-9237-4242-91bb-25abc5f0fe80 tempest-AttachVolumeNegativeTest-1378806597 tempest-AttachVolumeNegativeTest-1378806597-project] 10.222.0.43 "GET /compute/v2.1/servers/1ad76e39-3a52-4014-8206-2b3863bce8b7" status: 200 len: 1366 microversion: 2.1 time: 0.164108 Sep 13 18:12:06.848479 dv-cinder-852009-8-iscsi devstack@n-api.service[120741]: [pid: 120741|app: 0|req: 426/862] 10.222.0.43 () {58 vars in 1236 bytes} [Tue Sep 13 18:12:06 2022] GET /compute/v2.1/servers/1ad76e39-3a52-4014-8206-2b3863bce8b7 => generated 1366 bytes in 166 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 13 18:12:07.872923 dv-cinder-852009-8-iscsi devstack@n-api.service[120740]: DEBUG nova.api.openstack.wsgi [None req-687f09dd-7c07-4dda-a2f4-baca082b4126 tempest-AttachVolumeNegativeTest-1378806597 tempest-AttachVolumeNegativeTest-1378806597-project] Calling method '>' {{(pid=120740) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 18:12:07.873890 dv-cinder-852009-8-iscsi devstack@n-api.service[120740]: DEBUG nova.compute.api [None req-687f09dd-7c07-4dda-a2f4-baca082b4126 tempest-AttachVolumeNegativeTest-1378806597 tempest-AttachVolumeNegativeTest-1378806597-project] [instance: 1ad76e39-3a52-4014-8206-2b3863bce8b7] Fetching instance by UUID {{(pid=120740) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 18:12:07.875856 dv-cinder-852009-8-iscsi devstack@n-api.service[120740]: DEBUG dbcounter [-] [120740] Writing DB stats nova_cell0:SELECT=2 {{(pid=120740) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 18:12:07.876549 dv-cinder-852009-8-iscsi devstack@n-api.service[120740]: DEBUG dbcounter [-] [120740] Writing DB stats nova_cell0:SELECT=6 {{(pid=120740) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 18:12:07.882933 dv-cinder-852009-8-iscsi devstack@n-api.service[120740]: DEBUG oslo_concurrency.lockutils [None req-687f09dd-7c07-4dda-a2f4-baca082b4126 tempest-AttachVolumeNegativeTest-1378806597 tempest-AttachVolumeNegativeTest-1378806597-project] Acquiring lock "1daf4f4c-0e4a-4779-b53a-78c48397ea2f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120740) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 18:12:07.883416 dv-cinder-852009-8-iscsi devstack@n-api.service[120740]: DEBUG oslo_concurrency.lockutils [None req-687f09dd-7c07-4dda-a2f4-baca082b4126 tempest-AttachVolumeNegativeTest-1378806597 tempest-AttachVolumeNegativeTest-1378806597-project] Lock "1daf4f4c-0e4a-4779-b53a-78c48397ea2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120740) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 18:12:07.883853 dv-cinder-852009-8-iscsi devstack@n-api.service[120740]: DEBUG oslo_concurrency.lockutils [None req-687f09dd-7c07-4dda-a2f4-baca082b4126 tempest-AttachVolumeNegativeTest-1378806597 tempest-AttachVolumeNegativeTest-1378806597-project] Lock "1daf4f4c-0e4a-4779-b53a-78c48397ea2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120740) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 18:12:07.884569 dv-cinder-852009-8-iscsi devstack@n-api.service[120740]: DEBUG oslo_concurrency.lockutils [None req-687f09dd-7c07-4dda-a2f4-baca082b4126 tempest-AttachVolumeNegativeTest-1378806597 tempest-AttachVolumeNegativeTest-1378806597-project] Acquiring lock "1daf4f4c-0e4a-4779-b53a-78c48397ea2f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120740) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 18:12:07.885019 dv-cinder-852009-8-iscsi devstack@n-api.service[120740]: DEBUG oslo_concurrency.lockutils [None req-687f09dd-7c07-4dda-a2f4-baca082b4126 tempest-AttachVolumeNegativeTest-1378806597 tempest-AttachVolumeNegativeTest-1378806597-project] Lock "1daf4f4c-0e4a-4779-b53a-78c48397ea2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120740) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 18:12:07.885441 dv-cinder-852009-8-iscsi devstack@n-api.service[120740]: DEBUG oslo_concurrency.lockutils [None req-687f09dd-7c07-4dda-a2f4-baca082b4126 tempest-AttachVolumeNegativeTest-1378806597 tempest-AttachVolumeNegativeTest-1378806597-project] Lock "1daf4f4c-0e4a-4779-b53a-78c48397ea2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120740) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 18:12:08.021306 dv-cinder-852009-8-iscsi devstack@n-api.service[120740]: DEBUG nova.policy [None req-687f09dd-7c07-4dda-a2f4-baca082b4126 tempest-AttachVolumeNegativeTest-1378806597 tempest-AttachVolumeNegativeTest-1378806597-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '714cd09ba19b492f9a8c80343abcf6b9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '629311eda0584a5fbb7d8995cf27540c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120740) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 18:12:08.031730 dv-cinder-852009-8-iscsi devstack@n-api.service[120740]: INFO nova.api.openstack.requestlog [None req-687f09dd-7c07-4dda-a2f4-baca082b4126 tempest-AttachVolumeNegativeTest-1378806597 tempest-AttachVolumeNegativeTest-1378806597-project] 10.222.0.43 "GET /compute/v2.1/servers/1ad76e39-3a52-4014-8206-2b3863bce8b7" status: 200 len: 1557 microversion: 2.1 time: 0.162877 Sep 13 18:12:08.032304 dv-cinder-852009-8-iscsi devstack@n-api.service[120740]: [pid: 120740|app: 0|req: 437/863] 10.222.0.43 () {58 vars in 1236 bytes} [Tue Sep 13 18:12:07 2022] GET /compute/v2.1/servers/1ad76e39-3a52-4014-8206-2b3863bce8b7 => generated 1557 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 13 18:12:08.054254 dv-cinder-852009-8-iscsi devstack@n-api.service[120741]: DEBUG nova.api.openstack.wsgi [None req-249749ca-1efd-4828-8af6-9e0912ca2aed tempest-AttachVolumeNegativeTest-1378806597 tempest-AttachVolumeNegativeTest-1378806597-project] Calling method '>' {{(pid=120741) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 18:12:08.054794 dv-cinder-852009-8-iscsi devstack@n-api.service[120741]: DEBUG nova.compute.api [None req-249749ca-1efd-4828-8af6-9e0912ca2aed tempest-AttachVolumeNegativeTest-1378806597 tempest-AttachVolumeNegativeTest-1378806597-project] [instance: 1ad76e39-3a52-4014-8206-2b3863bce8b7] Fetching instance by UUID {{(pid=120741) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 18:12:08.056633 dv-cinder-852009-8-iscsi devstack@n-api.service[120741]: DEBUG dbcounter [-] [120741] Writing DB stats nova_cell0:SELECT=6 {{(pid=120741) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 18:12:08.062361 dv-cinder-852009-8-iscsi devstack@n-api.service[120741]: DEBUG oslo_concurrency.lockutils [None req-249749ca-1efd-4828-8af6-9e0912ca2aed tempest-AttachVolumeNegativeTest-1378806597 tempest-AttachVolumeNegativeTest-1378806597-project] Acquiring lock "1daf4f4c-0e4a-4779-b53a-78c48397ea2f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120741) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 18:12:08.062883 dv-cinder-852009-8-iscsi devstack@n-api.service[120741]: DEBUG oslo_concurrency.lockutils [None req-249749ca-1efd-4828-8af6-9e0912ca2aed tempest-AttachVolumeNegativeTest-1378806597 tempest-AttachVolumeNegativeTest-1378806597-project] Lock "1daf4f4c-0e4a-4779-b53a-78c48397ea2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120741) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 18:12:08.063308 dv-cinder-852009-8-iscsi devstack@n-api.service[120741]: DEBUG oslo_concurrency.lockutils [None req-249749ca-1efd-4828-8af6-9e0912ca2aed tempest-AttachVolumeNegativeTest-1378806597 tempest-AttachVolumeNegativeTest-1378806597-project] Lock "1daf4f4c-0e4a-4779-b53a-78c48397ea2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120741) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 18:12:08.063990 dv-cinder-852009-8-iscsi devstack@n-api.service[120741]: DEBUG oslo_concurrency.lockutils [None req-249749ca-1efd-4828-8af6-9e0912ca2aed tempest-AttachVolumeNegativeTest-1378806597 tempest-AttachVolumeNegativeTest-1378806597-project] Acquiring lock "1daf4f4c-0e4a-4779-b53a-78c48397ea2f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120741) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 18:12:08.064455 dv-cinder-852009-8-iscsi devstack@n-api.service[120741]: DEBUG oslo_concurrency.lockutils [None req-249749ca-1efd-4828-8af6-9e0912ca2aed tempest-AttachVolumeNegativeTest-1378806597 tempest-AttachVolumeNegativeTest-1378806597-project] Lock "1daf4f4c-0e4a-4779-b53a-78c48397ea2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120741) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 18:12:08.064867 dv-cinder-852009-8-iscsi devstack@n-api.service[120741]: DEBUG oslo_concurrency.lockutils [None req-249749ca-1efd-4828-8af6-9e0912ca2aed tempest-AttachVolumeNegativeTest-1378806597 tempest-AttachVolumeNegativeTest-1378806597-project] Lock "1daf4f4c-0e4a-4779-b53a-78c48397ea2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120741) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 18:12:08.143842 dv-cinder-852009-8-iscsi devstack@n-api.service[120741]: INFO nova.api.openstack.requestlog [None req-249749ca-1efd-4828-8af6-9e0912ca2aed tempest-AttachVolumeNegativeTest-1378806597 tempest-AttachVolumeNegativeTest-1378806597-project] 10.222.0.43 "GET /compute/v2.1/servers/1ad76e39-3a52-4014-8206-2b3863bce8b7/os-interface" status: 200 len: 285 microversion: 2.1 time: 0.093185 Sep 13 18:12:08.144725 dv-cinder-852009-8-iscsi devstack@n-api.service[120741]: [pid: 120741|app: 0|req: 427/864] 10.222.0.43 () {58 vars in 1275 bytes} [Tue Sep 13 18:12:08 2022] GET /compute/v2.1/servers/1ad76e39-3a52-4014-8206-2b3863bce8b7/os-interface => generated 285 bytes in 95 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 13 18:12:09.336914 dv-cinder-852009-8-iscsi devstack@n-api.service[120740]: DEBUG nova.api.openstack.wsgi [req-d97824d6-9cb5-4e28-a1ae-9ac7aceb399f req-229cd891-1f33-45ac-8b12-6cd0b8ed44fa service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "1ad76e39-3a52-4014-8206-2b3863bce8b7", "tag": "995ef904-eae3-4b2e-a0b6-78d0f33276af"}]} {{(pid=120740) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 13 18:12:09.347252 dv-cinder-852009-8-iscsi devstack@n-api.service[120740]: DEBUG oslo_concurrency.lockutils [req-d97824d6-9cb5-4e28-a1ae-9ac7aceb399f req-229cd891-1f33-45ac-8b12-6cd0b8ed44fa service nova] Acquiring lock "1daf4f4c-0e4a-4779-b53a-78c48397ea2f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120740) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 18:12:09.347727 dv-cinder-852009-8-iscsi devstack@n-api.service[120740]: DEBUG oslo_concurrency.lockutils [req-d97824d6-9cb5-4e28-a1ae-9ac7aceb399f req-229cd891-1f33-45ac-8b12-6cd0b8ed44fa service nova] Lock "1daf4f4c-0e4a-4779-b53a-78c48397ea2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120740) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 18:12:09.348154 dv-cinder-852009-8-iscsi devstack@n-api.service[120740]: DEBUG oslo_concurrency.lockutils [req-d97824d6-9cb5-4e28-a1ae-9ac7aceb399f req-229cd891-1f33-45ac-8b12-6cd0b8ed44fa service nova] Lock "1daf4f4c-0e4a-4779-b53a-78c48397ea2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120740) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 18:12:09.359495 dv-cinder-852009-8-iscsi devstack@n-api.service[120740]: INFO nova.api.openstack.compute.server_external_events [req-d97824d6-9cb5-4e28-a1ae-9ac7aceb399f req-229cd891-1f33-45ac-8b12-6cd0b8ed44fa service nova] Creating event network-changed:995ef904-eae3-4b2e-a0b6-78d0f33276af for instance 1ad76e39-3a52-4014-8206-2b3863bce8b7 on hv-cinder-85200 Sep 13 18:12:09.364681 dv-cinder-852009-8-iscsi devstack@n-api.service[120740]: INFO nova.api.openstack.requestlog [req-d97824d6-9cb5-4e28-a1ae-9ac7aceb399f req-229cd891-1f33-45ac-8b12-6cd0b8ed44fa service nova] 10.222.0.43 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.031424 Sep 13 18:12:09.365425 dv-cinder-852009-8-iscsi devstack@n-api.service[120740]: [pid: 120740|app: 0|req: 438/865] 10.222.0.43 () {64 vars in 1317 bytes} [Tue Sep 13 18:12:09 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 33 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 13 18:12:38.619847 dv-cinder-852009-8-iscsi devstack@n-api.service[120741]: DEBUG dbcounter [-] [120741] Writing DB stats nova_api:SELECT=39,nova_api:INSERT=1 {{(pid=120741) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 18:12:38.621071 dv-cinder-852009-8-iscsi devstack@n-api.service[120741]: DEBUG dbcounter [-] [120741] Writing DB stats nova_cell1:SELECT=70,nova_cell1:UPDATE=2,nova_cell1:INSERT=2 {{(pid=120741) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 18:12:38.628393 dv-cinder-852009-8-iscsi devstack@n-api.service[120741]: DEBUG nova.api.openstack.wsgi [None req-e5093c0d-6632-473f-afc4-004b756cf8a3 tempest-AttachVolumeNegativeTest-1378806597 tempest-AttachVolumeNegativeTest-1378806597-project] Calling method '>' {{(pid=120741) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 18:12:38.628900 dv-cinder-852009-8-iscsi devstack@n-api.service[120741]: DEBUG nova.compute.api [None req-e5093c0d-6632-473f-afc4-004b756cf8a3 tempest-AttachVolumeNegativeTest-1378806597 tempest-AttachVolumeNegativeTest-1378806597-project] [instance: 1ad76e39-3a52-4014-8206-2b3863bce8b7] Fetching instance by UUID {{(pid=120741) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 18:12:38.637145 dv-cinder-852009-8-iscsi devstack@n-api.service[120741]: DEBUG oslo_concurrency.lockutils [None req-e5093c0d-6632-473f-afc4-004b756cf8a3 tempest-AttachVolumeNegativeTest-1378806597 tempest-AttachVolumeNegativeTest-1378806597-project] Acquiring lock "1daf4f4c-0e4a-4779-b53a-78c48397ea2f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120741) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 18:12:38.637616 dv-cinder-852009-8-iscsi devstack@n-api.service[120741]: DEBUG oslo_concurrency.lockutils [None req-e5093c0d-6632-473f-afc4-004b756cf8a3 tempest-AttachVolumeNegativeTest-1378806597 tempest-AttachVolumeNegativeTest-1378806597-project] Lock "1daf4f4c-0e4a-4779-b53a-78c48397ea2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120741) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 18:12:38.638041 dv-cinder-852009-8-iscsi devstack@n-api.service[120741]: DEBUG oslo_concurrency.lockutils [None req-e5093c0d-6632-473f-afc4-004b756cf8a3 tempest-AttachVolumeNegativeTest-1378806597 tempest-AttachVolumeNegativeTest-1378806597-project] Lock "1daf4f4c-0e4a-4779-b53a-78c48397ea2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120741) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 18:12:38.638717 dv-cinder-852009-8-iscsi devstack@n-api.service[120741]: DEBUG oslo_concurrency.lockutils [None req-e5093c0d-6632-473f-afc4-004b756cf8a3 tempest-AttachVolumeNegativeTest-1378806597 tempest-AttachVolumeNegativeTest-1378806597-project] Acquiring lock "1daf4f4c-0e4a-4779-b53a-78c48397ea2f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120741) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 18:12:38.639188 dv-cinder-852009-8-iscsi devstack@n-api.service[120741]: DEBUG oslo_concurrency.lockutils [None req-e5093c0d-6632-473f-afc4-004b756cf8a3 tempest-AttachVolumeNegativeTest-1378806597 tempest-AttachVolumeNegativeTest-1378806597-project] Lock "1daf4f4c-0e4a-4779-b53a-78c48397ea2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120741) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 18:12:38.639599 dv-cinder-852009-8-iscsi devstack@n-api.service[120741]: DEBUG oslo_concurrency.lockutils [None req-e5093c0d-6632-473f-afc4-004b756cf8a3 tempest-AttachVolumeNegativeTest-1378806597 tempest-AttachVolumeNegativeTest-1378806597-project] Lock "1daf4f4c-0e4a-4779-b53a-78c48397ea2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120741) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 18:12:38.664213 dv-cinder-852009-8-iscsi devstack@n-api.service[120741]: INFO nova.api.openstack.requestlog [None req-e5093c0d-6632-473f-afc4-004b756cf8a3 tempest-AttachVolumeNegativeTest-1378806597 tempest-AttachVolumeNegativeTest-1378806597-project] 10.222.0.43 "GET /compute/v2.1/servers/1ad76e39-3a52-4014-8206-2b3863bce8b7/ips" status: 200 len: 151 microversion: 2.1 time: 0.047545 Sep 13 18:12:38.664789 dv-cinder-852009-8-iscsi devstack@n-api.service[120741]: [pid: 120741|app: 0|req: 428/866] 10.222.0.43 () {58 vars in 1248 bytes} [Tue Sep 13 18:12:38 2022] GET /compute/v2.1/servers/1ad76e39-3a52-4014-8206-2b3863bce8b7/ips => generated 151 bytes in 49 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 13 18:12:40.016933 dv-cinder-852009-8-iscsi devstack@n-api.service[120740]: DEBUG dbcounter [-] [120740] Writing DB stats nova_api:SELECT=49,nova_api:UPDATE=1,nova_api:DELETE=1,nova_api:INSERT=3 {{(pid=120740) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 18:12:40.017695 dv-cinder-852009-8-iscsi devstack@n-api.service[120740]: DEBUG dbcounter [-] [120740] Writing DB stats nova_cell1:SELECT=74,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=120740) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 18:12:40.023932 dv-cinder-852009-8-iscsi devstack@n-api.service[120740]: DEBUG nova.api.openstack.wsgi [None req-b2f1e91e-abdb-4912-8631-cdd0d812ed0c tempest-AttachVolumeNegativeTest-1378806597 tempest-AttachVolumeNegativeTest-1378806597-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "e85a1763-5c5e-4594-add0-69e558d10dd1"}} {{(pid=120740) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 13 18:12:40.027592 dv-cinder-852009-8-iscsi devstack@n-api.service[120740]: DEBUG nova.compute.api [None req-b2f1e91e-abdb-4912-8631-cdd0d812ed0c tempest-AttachVolumeNegativeTest-1378806597 tempest-AttachVolumeNegativeTest-1378806597-project] [instance: 1ad76e39-3a52-4014-8206-2b3863bce8b7] Fetching instance by UUID {{(pid=120740) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 18:12:40.038353 dv-cinder-852009-8-iscsi devstack@n-api.service[120740]: DEBUG oslo_concurrency.lockutils [None req-b2f1e91e-abdb-4912-8631-cdd0d812ed0c tempest-AttachVolumeNegativeTest-1378806597 tempest-AttachVolumeNegativeTest-1378806597-project] Acquiring lock "1daf4f4c-0e4a-4779-b53a-78c48397ea2f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120740) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 18:12:40.038840 dv-cinder-852009-8-iscsi devstack@n-api.service[120740]: DEBUG oslo_concurrency.lockutils [None req-b2f1e91e-abdb-4912-8631-cdd0d812ed0c tempest-AttachVolumeNegativeTest-1378806597 tempest-AttachVolumeNegativeTest-1378806597-project] Lock "1daf4f4c-0e4a-4779-b53a-78c48397ea2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120740) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 18:12:40.039274 dv-cinder-852009-8-iscsi devstack@n-api.service[120740]: DEBUG oslo_concurrency.lockutils [None req-b2f1e91e-abdb-4912-8631-cdd0d812ed0c tempest-AttachVolumeNegativeTest-1378806597 tempest-AttachVolumeNegativeTest-1378806597-project] Lock "1daf4f4c-0e4a-4779-b53a-78c48397ea2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120740) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 18:12:40.039970 dv-cinder-852009-8-iscsi devstack@n-api.service[120740]: DEBUG oslo_concurrency.lockutils [None req-b2f1e91e-abdb-4912-8631-cdd0d812ed0c tempest-AttachVolumeNegativeTest-1378806597 tempest-AttachVolumeNegativeTest-1378806597-project] Acquiring lock "1daf4f4c-0e4a-4779-b53a-78c48397ea2f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120740) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 18:12:40.040435 dv-cinder-852009-8-iscsi devstack@n-api.service[120740]: DEBUG oslo_concurrency.lockutils [None req-b2f1e91e-abdb-4912-8631-cdd0d812ed0c tempest-AttachVolumeNegativeTest-1378806597 tempest-AttachVolumeNegativeTest-1378806597-project] Lock "1daf4f4c-0e4a-4779-b53a-78c48397ea2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120740) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 18:12:40.040883 dv-cinder-852009-8-iscsi devstack@n-api.service[120740]: DEBUG oslo_concurrency.lockutils [None req-b2f1e91e-abdb-4912-8631-cdd0d812ed0c tempest-AttachVolumeNegativeTest-1378806597 tempest-AttachVolumeNegativeTest-1378806597-project] Lock "1daf4f4c-0e4a-4779-b53a-78c48397ea2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120740) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 18:12:40.295833 dv-cinder-852009-8-iscsi devstack@n-api.service[120740]: INFO nova.api.openstack.requestlog [None req-b2f1e91e-abdb-4912-8631-cdd0d812ed0c tempest-AttachVolumeNegativeTest-1378806597 tempest-AttachVolumeNegativeTest-1378806597-project] 10.222.0.43 "POST /compute/v2.1/servers/1ad76e39-3a52-4014-8206-2b3863bce8b7/os-volume_attachments" status: 200 len: 194 microversion: 2.1 time: 0.282179 Sep 13 18:12:40.296466 dv-cinder-852009-8-iscsi devstack@n-api.service[120740]: [pid: 120740|app: 0|req: 439/867] 10.222.0.43 () {60 vars in 1323 bytes} [Tue Sep 13 18:12:40 2022] POST /compute/v2.1/servers/1ad76e39-3a52-4014-8206-2b3863bce8b7/os-volume_attachments => generated 194 bytes in 284 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 13 18:12:46.930483 dv-cinder-852009-8-iscsi devstack@n-api.service[120741]: DEBUG nova.api.openstack.wsgi [None req-708f12d5-ccd8-4e13-94e5-a00a740e92d7 tempest-AttachVolumeNegativeTest-1378806597 tempest-AttachVolumeNegativeTest-1378806597-project] Calling method '>' {{(pid=120741) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 18:12:46.931009 dv-cinder-852009-8-iscsi devstack@n-api.service[120741]: DEBUG nova.compute.api [None req-708f12d5-ccd8-4e13-94e5-a00a740e92d7 tempest-AttachVolumeNegativeTest-1378806597 tempest-AttachVolumeNegativeTest-1378806597-project] [instance: 1ad76e39-3a52-4014-8206-2b3863bce8b7] Fetching instance by UUID {{(pid=120741) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 18:12:46.937812 dv-cinder-852009-8-iscsi devstack@n-api.service[120741]: DEBUG oslo_concurrency.lockutils [None req-708f12d5-ccd8-4e13-94e5-a00a740e92d7 tempest-AttachVolumeNegativeTest-1378806597 tempest-AttachVolumeNegativeTest-1378806597-project] Acquiring lock "1daf4f4c-0e4a-4779-b53a-78c48397ea2f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120741) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 18:12:46.938295 dv-cinder-852009-8-iscsi devstack@n-api.service[120741]: DEBUG oslo_concurrency.lockutils [None req-708f12d5-ccd8-4e13-94e5-a00a740e92d7 tempest-AttachVolumeNegativeTest-1378806597 tempest-AttachVolumeNegativeTest-1378806597-project] Lock "1daf4f4c-0e4a-4779-b53a-78c48397ea2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120741) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 18:12:46.938720 dv-cinder-852009-8-iscsi devstack@n-api.service[120741]: DEBUG oslo_concurrency.lockutils [None req-708f12d5-ccd8-4e13-94e5-a00a740e92d7 tempest-AttachVolumeNegativeTest-1378806597 tempest-AttachVolumeNegativeTest-1378806597-project] Lock "1daf4f4c-0e4a-4779-b53a-78c48397ea2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120741) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 18:12:46.939412 dv-cinder-852009-8-iscsi devstack@n-api.service[120741]: DEBUG oslo_concurrency.lockutils [None req-708f12d5-ccd8-4e13-94e5-a00a740e92d7 tempest-AttachVolumeNegativeTest-1378806597 tempest-AttachVolumeNegativeTest-1378806597-project] Acquiring lock "1daf4f4c-0e4a-4779-b53a-78c48397ea2f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120741) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 18:12:46.939862 dv-cinder-852009-8-iscsi devstack@n-api.service[120741]: DEBUG oslo_concurrency.lockutils [None req-708f12d5-ccd8-4e13-94e5-a00a740e92d7 tempest-AttachVolumeNegativeTest-1378806597 tempest-AttachVolumeNegativeTest-1378806597-project] Lock "1daf4f4c-0e4a-4779-b53a-78c48397ea2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120741) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 18:12:46.940281 dv-cinder-852009-8-iscsi devstack@n-api.service[120741]: DEBUG oslo_concurrency.lockutils [None req-708f12d5-ccd8-4e13-94e5-a00a740e92d7 tempest-AttachVolumeNegativeTest-1378806597 tempest-AttachVolumeNegativeTest-1378806597-project] Lock "1daf4f4c-0e4a-4779-b53a-78c48397ea2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120741) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 18:12:47.024454 dv-cinder-852009-8-iscsi devstack@n-api.service[120741]: DEBUG nova.objects.instance [None req-708f12d5-ccd8-4e13-94e5-a00a740e92d7 tempest-AttachVolumeNegativeTest-1378806597 tempest-AttachVolumeNegativeTest-1378806597-project] Lazy-loading 'services' on Instance uuid 1ad76e39-3a52-4014-8206-2b3863bce8b7 {{(pid=120741) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Sep 13 18:12:47.099564 dv-cinder-852009-8-iscsi devstack@n-api.service[120741]: INFO nova.api.openstack.requestlog [None req-708f12d5-ccd8-4e13-94e5-a00a740e92d7 tempest-AttachVolumeNegativeTest-1378806597 tempest-AttachVolumeNegativeTest-1378806597-project] 10.222.0.43 "DELETE /compute/v2.1/servers/1ad76e39-3a52-4014-8206-2b3863bce8b7/os-volume_attachments/e85a1763-5c5e-4594-add0-69e558d10dd1" status: 202 len: 0 microversion: 2.1 time: 0.172968 Sep 13 18:12:47.100138 dv-cinder-852009-8-iscsi devstack@n-api.service[120741]: [pid: 120741|app: 0|req: 429/868] 10.222.0.43 () {58 vars in 1416 bytes} [Tue Sep 13 18:12:46 2022] DELETE /compute/v2.1/servers/1ad76e39-3a52-4014-8206-2b3863bce8b7/os-volume_attachments/e85a1763-5c5e-4594-add0-69e558d10dd1 => generated 0 bytes in 174 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Sep 13 18:12:47.110643 dv-cinder-852009-8-iscsi devstack@n-api.service[120740]: DEBUG nova.api.openstack.wsgi [None req-471f9a23-d3df-45c9-9ad6-800bb4da29d2 tempest-AttachVolumeNegativeTest-1378806597 tempest-AttachVolumeNegativeTest-1378806597-project] Calling method '>' {{(pid=120740) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 18:12:47.113070 dv-cinder-852009-8-iscsi devstack@n-api.service[120740]: DEBUG nova.compute.api [None req-471f9a23-d3df-45c9-9ad6-800bb4da29d2 tempest-AttachVolumeNegativeTest-1378806597 tempest-AttachVolumeNegativeTest-1378806597-project] [instance: 1ad76e39-3a52-4014-8206-2b3863bce8b7] Fetching instance by UUID {{(pid=120740) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 18:12:47.120203 dv-cinder-852009-8-iscsi devstack@n-api.service[120740]: DEBUG oslo_concurrency.lockutils [None req-471f9a23-d3df-45c9-9ad6-800bb4da29d2 tempest-AttachVolumeNegativeTest-1378806597 tempest-AttachVolumeNegativeTest-1378806597-project] Acquiring lock "1daf4f4c-0e4a-4779-b53a-78c48397ea2f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120740) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 18:12:47.120753 dv-cinder-852009-8-iscsi devstack@n-api.service[120740]: DEBUG oslo_concurrency.lockutils [None req-471f9a23-d3df-45c9-9ad6-800bb4da29d2 tempest-AttachVolumeNegativeTest-1378806597 tempest-AttachVolumeNegativeTest-1378806597-project] Lock "1daf4f4c-0e4a-4779-b53a-78c48397ea2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120740) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 18:12:47.121236 dv-cinder-852009-8-iscsi devstack@n-api.service[120740]: DEBUG oslo_concurrency.lockutils [None req-471f9a23-d3df-45c9-9ad6-800bb4da29d2 tempest-AttachVolumeNegativeTest-1378806597 tempest-AttachVolumeNegativeTest-1378806597-project] Lock "1daf4f4c-0e4a-4779-b53a-78c48397ea2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120740) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 18:12:47.122519 dv-cinder-852009-8-iscsi devstack@n-api.service[120740]: DEBUG oslo_concurrency.lockutils [None req-471f9a23-d3df-45c9-9ad6-800bb4da29d2 tempest-AttachVolumeNegativeTest-1378806597 tempest-AttachVolumeNegativeTest-1378806597-project] Acquiring lock "1daf4f4c-0e4a-4779-b53a-78c48397ea2f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120740) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 18:12:47.122990 dv-cinder-852009-8-iscsi devstack@n-api.service[120740]: DEBUG oslo_concurrency.lockutils [None req-471f9a23-d3df-45c9-9ad6-800bb4da29d2 tempest-AttachVolumeNegativeTest-1378806597 tempest-AttachVolumeNegativeTest-1378806597-project] Lock "1daf4f4c-0e4a-4779-b53a-78c48397ea2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120740) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 18:12:47.123413 dv-cinder-852009-8-iscsi devstack@n-api.service[120740]: DEBUG oslo_concurrency.lockutils [None req-471f9a23-d3df-45c9-9ad6-800bb4da29d2 tempest-AttachVolumeNegativeTest-1378806597 tempest-AttachVolumeNegativeTest-1378806597-project] Lock "1daf4f4c-0e4a-4779-b53a-78c48397ea2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120740) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 18:12:47.155799 dv-cinder-852009-8-iscsi devstack@n-api.service[120740]: INFO nova.api.openstack.requestlog [None req-471f9a23-d3df-45c9-9ad6-800bb4da29d2 tempest-AttachVolumeNegativeTest-1378806597 tempest-AttachVolumeNegativeTest-1378806597-project] 10.222.0.43 "GET /compute/v2.1/servers/1ad76e39-3a52-4014-8206-2b3863bce8b7/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.050164 Sep 13 18:12:47.156371 dv-cinder-852009-8-iscsi devstack@n-api.service[120740]: [pid: 120740|app: 0|req: 440/869] 10.222.0.43 () {58 vars in 1302 bytes} [Tue Sep 13 18:12:47 2022] GET /compute/v2.1/servers/1ad76e39-3a52-4014-8206-2b3863bce8b7/os-volume_attachments => generated 197 bytes in 52 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 13 18:12:48.174307 dv-cinder-852009-8-iscsi devstack@n-api.service[120741]: DEBUG nova.api.openstack.wsgi [None req-a7a017a2-a56e-4407-a900-bf3cdef63d97 tempest-AttachVolumeNegativeTest-1378806597 tempest-AttachVolumeNegativeTest-1378806597-project] Calling method '>' {{(pid=120741) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 18:12:48.178191 dv-cinder-852009-8-iscsi devstack@n-api.service[120741]: DEBUG nova.compute.api [None req-a7a017a2-a56e-4407-a900-bf3cdef63d97 tempest-AttachVolumeNegativeTest-1378806597 tempest-AttachVolumeNegativeTest-1378806597-project] [instance: 1ad76e39-3a52-4014-8206-2b3863bce8b7] Fetching instance by UUID {{(pid=120741) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 18:12:48.189029 dv-cinder-852009-8-iscsi devstack@n-api.service[120741]: DEBUG oslo_concurrency.lockutils [None req-a7a017a2-a56e-4407-a900-bf3cdef63d97 tempest-AttachVolumeNegativeTest-1378806597 tempest-AttachVolumeNegativeTest-1378806597-project] Acquiring lock "1daf4f4c-0e4a-4779-b53a-78c48397ea2f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120741) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 18:12:48.189819 dv-cinder-852009-8-iscsi devstack@n-api.service[120741]: DEBUG oslo_concurrency.lockutils [None req-a7a017a2-a56e-4407-a900-bf3cdef63d97 tempest-AttachVolumeNegativeTest-1378806597 tempest-AttachVolumeNegativeTest-1378806597-project] Lock "1daf4f4c-0e4a-4779-b53a-78c48397ea2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120741) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 18:12:48.190532 dv-cinder-852009-8-iscsi devstack@n-api.service[120741]: DEBUG oslo_concurrency.lockutils [None req-a7a017a2-a56e-4407-a900-bf3cdef63d97 tempest-AttachVolumeNegativeTest-1378806597 tempest-AttachVolumeNegativeTest-1378806597-project] Lock "1daf4f4c-0e4a-4779-b53a-78c48397ea2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120741) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 18:12:48.191663 dv-cinder-852009-8-iscsi devstack@n-api.service[120741]: DEBUG oslo_concurrency.lockutils [None req-a7a017a2-a56e-4407-a900-bf3cdef63d97 tempest-AttachVolumeNegativeTest-1378806597 tempest-AttachVolumeNegativeTest-1378806597-project] Acquiring lock "1daf4f4c-0e4a-4779-b53a-78c48397ea2f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120741) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 18:12:48.192409 dv-cinder-852009-8-iscsi devstack@n-api.service[120741]: DEBUG oslo_concurrency.lockutils [None req-a7a017a2-a56e-4407-a900-bf3cdef63d97 tempest-AttachVolumeNegativeTest-1378806597 tempest-AttachVolumeNegativeTest-1378806597-project] Lock "1daf4f4c-0e4a-4779-b53a-78c48397ea2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120741) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 18:12:48.193150 dv-cinder-852009-8-iscsi devstack@n-api.service[120741]: DEBUG oslo_concurrency.lockutils [None req-a7a017a2-a56e-4407-a900-bf3cdef63d97 tempest-AttachVolumeNegativeTest-1378806597 tempest-AttachVolumeNegativeTest-1378806597-project] Lock "1daf4f4c-0e4a-4779-b53a-78c48397ea2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120741) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 18:12:48.224919 dv-cinder-852009-8-iscsi devstack@n-api.service[120741]: INFO nova.api.openstack.requestlog [None req-a7a017a2-a56e-4407-a900-bf3cdef63d97 tempest-AttachVolumeNegativeTest-1378806597 tempest-AttachVolumeNegativeTest-1378806597-project] 10.222.0.43 "GET /compute/v2.1/servers/1ad76e39-3a52-4014-8206-2b3863bce8b7/os-volume_attachments" status: 200 len: 25 microversion: 2.1 time: 0.058645 Sep 13 18:12:48.225456 dv-cinder-852009-8-iscsi devstack@n-api.service[120741]: [pid: 120741|app: 0|req: 430/870] 10.222.0.43 () {58 vars in 1302 bytes} [Tue Sep 13 18:12:48 2022] GET /compute/v2.1/servers/1ad76e39-3a52-4014-8206-2b3863bce8b7/os-volume_attachments => generated 25 bytes in 61 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Sep 13 18:12:48.290306 dv-cinder-852009-8-iscsi devstack@n-api.service[120740]: DEBUG nova.api.openstack.wsgi [None req-9b66071b-46fb-449d-b0f6-7de059f3c19a tempest-AttachVolumeNegativeTest-1378806597 tempest-AttachVolumeNegativeTest-1378806597-project] Calling method '>' {{(pid=120740) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 18:12:48.290821 dv-cinder-852009-8-iscsi devstack@n-api.service[120740]: DEBUG nova.compute.api [None req-9b66071b-46fb-449d-b0f6-7de059f3c19a tempest-AttachVolumeNegativeTest-1378806597 tempest-AttachVolumeNegativeTest-1378806597-project] [instance: 1ad76e39-3a52-4014-8206-2b3863bce8b7] Fetching instance by UUID {{(pid=120740) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 18:12:48.297564 dv-cinder-852009-8-iscsi devstack@n-api.service[120740]: DEBUG oslo_concurrency.lockutils [None req-9b66071b-46fb-449d-b0f6-7de059f3c19a tempest-AttachVolumeNegativeTest-1378806597 tempest-AttachVolumeNegativeTest-1378806597-project] Acquiring lock "1daf4f4c-0e4a-4779-b53a-78c48397ea2f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120740) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 18:12:48.298037 dv-cinder-852009-8-iscsi devstack@n-api.service[120740]: DEBUG oslo_concurrency.lockutils [None req-9b66071b-46fb-449d-b0f6-7de059f3c19a tempest-AttachVolumeNegativeTest-1378806597 tempest-AttachVolumeNegativeTest-1378806597-project] Lock "1daf4f4c-0e4a-4779-b53a-78c48397ea2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120740) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 18:12:48.298464 dv-cinder-852009-8-iscsi devstack@n-api.service[120740]: DEBUG oslo_concurrency.lockutils [None req-9b66071b-46fb-449d-b0f6-7de059f3c19a tempest-AttachVolumeNegativeTest-1378806597 tempest-AttachVolumeNegativeTest-1378806597-project] Lock "1daf4f4c-0e4a-4779-b53a-78c48397ea2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120740) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 18:12:48.299143 dv-cinder-852009-8-iscsi devstack@n-api.service[120740]: DEBUG oslo_concurrency.lockutils [None req-9b66071b-46fb-449d-b0f6-7de059f3c19a tempest-AttachVolumeNegativeTest-1378806597 tempest-AttachVolumeNegativeTest-1378806597-project] Acquiring lock "1daf4f4c-0e4a-4779-b53a-78c48397ea2f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120740) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 18:12:48.299583 dv-cinder-852009-8-iscsi devstack@n-api.service[120740]: DEBUG oslo_concurrency.lockutils [None req-9b66071b-46fb-449d-b0f6-7de059f3c19a tempest-AttachVolumeNegativeTest-1378806597 tempest-AttachVolumeNegativeTest-1378806597-project] Lock "1daf4f4c-0e4a-4779-b53a-78c48397ea2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120740) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 18:12:48.299996 dv-cinder-852009-8-iscsi devstack@n-api.service[120740]: DEBUG oslo_concurrency.lockutils [None req-9b66071b-46fb-449d-b0f6-7de059f3c19a tempest-AttachVolumeNegativeTest-1378806597 tempest-AttachVolumeNegativeTest-1378806597-project] Lock "1daf4f4c-0e4a-4779-b53a-78c48397ea2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120740) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 18:12:48.327360 dv-cinder-852009-8-iscsi devstack@n-api.service[120740]: DEBUG nova.compute.api [None req-9b66071b-46fb-449d-b0f6-7de059f3c19a tempest-AttachVolumeNegativeTest-1378806597 tempest-AttachVolumeNegativeTest-1378806597-project] [instance: 1ad76e39-3a52-4014-8206-2b3863bce8b7] Going to try to terminate instance {{(pid=120740) delete /opt/stack/nova/nova/compute/api.py:2719}} Sep 13 18:12:48.571417 dv-cinder-852009-8-iscsi devstack@n-api.service[120740]: INFO nova.api.openstack.requestlog [None req-9b66071b-46fb-449d-b0f6-7de059f3c19a tempest-AttachVolumeNegativeTest-1378806597 tempest-AttachVolumeNegativeTest-1378806597-project] 10.222.0.43 "DELETE /compute/v2.1/servers/1ad76e39-3a52-4014-8206-2b3863bce8b7" status: 204 len: 0 microversion: 2.1 time: 0.284685 Sep 13 18:12:48.572104 dv-cinder-852009-8-iscsi devstack@n-api.service[120740]: [pid: 120740|app: 0|req: 441/871] 10.222.0.43 () {58 vars in 1239 bytes} [Tue Sep 13 18:12:48 2022] DELETE /compute/v2.1/servers/1ad76e39-3a52-4014-8206-2b3863bce8b7 => generated 0 bytes in 286 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Sep 13 18:12:48.580419 dv-cinder-852009-8-iscsi devstack@n-api.service[120741]: DEBUG nova.api.openstack.wsgi [None req-8355aad8-4c1f-483b-a76c-7668fcaa97fd tempest-AttachVolumeNegativeTest-1378806597 tempest-AttachVolumeNegativeTest-1378806597-project] Calling method '>' {{(pid=120741) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 18:12:48.581042 dv-cinder-852009-8-iscsi devstack@n-api.service[120741]: DEBUG nova.compute.api [None req-8355aad8-4c1f-483b-a76c-7668fcaa97fd tempest-AttachVolumeNegativeTest-1378806597 tempest-AttachVolumeNegativeTest-1378806597-project] [instance: 1ad76e39-3a52-4014-8206-2b3863bce8b7] Fetching instance by UUID {{(pid=120741) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 18:12:48.587072 dv-cinder-852009-8-iscsi devstack@n-api.service[120741]: DEBUG oslo_concurrency.lockutils [None req-8355aad8-4c1f-483b-a76c-7668fcaa97fd tempest-AttachVolumeNegativeTest-1378806597 tempest-AttachVolumeNegativeTest-1378806597-project] Acquiring lock "1daf4f4c-0e4a-4779-b53a-78c48397ea2f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120741) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 18:12:48.587558 dv-cinder-852009-8-iscsi devstack@n-api.service[120741]: DEBUG oslo_concurrency.lockutils [None req-8355aad8-4c1f-483b-a76c-7668fcaa97fd tempest-AttachVolumeNegativeTest-1378806597 tempest-AttachVolumeNegativeTest-1378806597-project] Lock "1daf4f4c-0e4a-4779-b53a-78c48397ea2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120741) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 18:12:48.587966 dv-cinder-852009-8-iscsi devstack@n-api.service[120741]: DEBUG oslo_concurrency.lockutils [None req-8355aad8-4c1f-483b-a76c-7668fcaa97fd tempest-AttachVolumeNegativeTest-1378806597 tempest-AttachVolumeNegativeTest-1378806597-project] Lock "1daf4f4c-0e4a-4779-b53a-78c48397ea2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120741) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 18:12:48.588670 dv-cinder-852009-8-iscsi devstack@n-api.service[120741]: DEBUG oslo_concurrency.lockutils [None req-8355aad8-4c1f-483b-a76c-7668fcaa97fd tempest-AttachVolumeNegativeTest-1378806597 tempest-AttachVolumeNegativeTest-1378806597-project] Acquiring lock "1daf4f4c-0e4a-4779-b53a-78c48397ea2f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120741) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 18:12:48.589108 dv-cinder-852009-8-iscsi devstack@n-api.service[120741]: DEBUG oslo_concurrency.lockutils [None req-8355aad8-4c1f-483b-a76c-7668fcaa97fd tempest-AttachVolumeNegativeTest-1378806597 tempest-AttachVolumeNegativeTest-1378806597-project] Lock "1daf4f4c-0e4a-4779-b53a-78c48397ea2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120741) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 18:12:48.589513 dv-cinder-852009-8-iscsi devstack@n-api.service[120741]: DEBUG oslo_concurrency.lockutils [None req-8355aad8-4c1f-483b-a76c-7668fcaa97fd tempest-AttachVolumeNegativeTest-1378806597 tempest-AttachVolumeNegativeTest-1378806597-project] Lock "1daf4f4c-0e4a-4779-b53a-78c48397ea2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120741) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 18:12:48.721417 dv-cinder-852009-8-iscsi devstack@n-api.service[120741]: DEBUG nova.policy [None req-8355aad8-4c1f-483b-a76c-7668fcaa97fd tempest-AttachVolumeNegativeTest-1378806597 tempest-AttachVolumeNegativeTest-1378806597-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '714cd09ba19b492f9a8c80343abcf6b9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '629311eda0584a5fbb7d8995cf27540c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120741) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 18:12:48.729416 dv-cinder-852009-8-iscsi devstack@n-api.service[120741]: INFO nova.api.openstack.requestlog [None req-8355aad8-4c1f-483b-a76c-7668fcaa97fd tempest-AttachVolumeNegativeTest-1378806597 tempest-AttachVolumeNegativeTest-1378806597-project] 10.222.0.43 "GET /compute/v2.1/servers/1ad76e39-3a52-4014-8206-2b3863bce8b7" status: 200 len: 1682 microversion: 2.1 time: 0.153014 Sep 13 18:12:48.730027 dv-cinder-852009-8-iscsi devstack@n-api.service[120741]: [pid: 120741|app: 0|req: 431/872] 10.222.0.43 () {58 vars in 1236 bytes} [Tue Sep 13 18:12:48 2022] GET /compute/v2.1/servers/1ad76e39-3a52-4014-8206-2b3863bce8b7 => generated 1682 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 13 18:12:49.753127 dv-cinder-852009-8-iscsi devstack@n-api.service[120740]: DEBUG nova.api.openstack.wsgi [None req-7f0d2420-9d7a-479f-9f4b-c54220a6cda1 tempest-AttachVolumeNegativeTest-1378806597 tempest-AttachVolumeNegativeTest-1378806597-project] Calling method '>' {{(pid=120740) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 18:12:49.753820 dv-cinder-852009-8-iscsi devstack@n-api.service[120740]: DEBUG nova.compute.api [None req-7f0d2420-9d7a-479f-9f4b-c54220a6cda1 tempest-AttachVolumeNegativeTest-1378806597 tempest-AttachVolumeNegativeTest-1378806597-project] [instance: 1ad76e39-3a52-4014-8206-2b3863bce8b7] Fetching instance by UUID {{(pid=120740) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 18:12:49.760660 dv-cinder-852009-8-iscsi devstack@n-api.service[120740]: DEBUG oslo_concurrency.lockutils [None req-7f0d2420-9d7a-479f-9f4b-c54220a6cda1 tempest-AttachVolumeNegativeTest-1378806597 tempest-AttachVolumeNegativeTest-1378806597-project] Acquiring lock "1daf4f4c-0e4a-4779-b53a-78c48397ea2f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120740) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 18:12:49.761143 dv-cinder-852009-8-iscsi devstack@n-api.service[120740]: DEBUG oslo_concurrency.lockutils [None req-7f0d2420-9d7a-479f-9f4b-c54220a6cda1 tempest-AttachVolumeNegativeTest-1378806597 tempest-AttachVolumeNegativeTest-1378806597-project] Lock "1daf4f4c-0e4a-4779-b53a-78c48397ea2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120740) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 18:12:49.761568 dv-cinder-852009-8-iscsi devstack@n-api.service[120740]: DEBUG oslo_concurrency.lockutils [None req-7f0d2420-9d7a-479f-9f4b-c54220a6cda1 tempest-AttachVolumeNegativeTest-1378806597 tempest-AttachVolumeNegativeTest-1378806597-project] Lock "1daf4f4c-0e4a-4779-b53a-78c48397ea2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120740) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 18:12:49.762257 dv-cinder-852009-8-iscsi devstack@n-api.service[120740]: DEBUG oslo_concurrency.lockutils [None req-7f0d2420-9d7a-479f-9f4b-c54220a6cda1 tempest-AttachVolumeNegativeTest-1378806597 tempest-AttachVolumeNegativeTest-1378806597-project] Acquiring lock "1daf4f4c-0e4a-4779-b53a-78c48397ea2f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120740) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 18:12:49.762729 dv-cinder-852009-8-iscsi devstack@n-api.service[120740]: DEBUG oslo_concurrency.lockutils [None req-7f0d2420-9d7a-479f-9f4b-c54220a6cda1 tempest-AttachVolumeNegativeTest-1378806597 tempest-AttachVolumeNegativeTest-1378806597-project] Lock "1daf4f4c-0e4a-4779-b53a-78c48397ea2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120740) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 18:12:49.763146 dv-cinder-852009-8-iscsi devstack@n-api.service[120740]: DEBUG oslo_concurrency.lockutils [None req-7f0d2420-9d7a-479f-9f4b-c54220a6cda1 tempest-AttachVolumeNegativeTest-1378806597 tempest-AttachVolumeNegativeTest-1378806597-project] Lock "1daf4f4c-0e4a-4779-b53a-78c48397ea2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120740) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 18:12:49.898350 dv-cinder-852009-8-iscsi devstack@n-api.service[120740]: DEBUG nova.policy [None req-7f0d2420-9d7a-479f-9f4b-c54220a6cda1 tempest-AttachVolumeNegativeTest-1378806597 tempest-AttachVolumeNegativeTest-1378806597-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '714cd09ba19b492f9a8c80343abcf6b9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '629311eda0584a5fbb7d8995cf27540c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120740) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 18:12:49.906593 dv-cinder-852009-8-iscsi devstack@n-api.service[120740]: INFO nova.api.openstack.requestlog [None req-7f0d2420-9d7a-479f-9f4b-c54220a6cda1 tempest-AttachVolumeNegativeTest-1378806597 tempest-AttachVolumeNegativeTest-1378806597-project] 10.222.0.43 "GET /compute/v2.1/servers/1ad76e39-3a52-4014-8206-2b3863bce8b7" status: 200 len: 1682 microversion: 2.1 time: 0.157749 Sep 13 18:12:49.907164 dv-cinder-852009-8-iscsi devstack@n-api.service[120740]: [pid: 120740|app: 0|req: 442/873] 10.222.0.43 () {58 vars in 1236 bytes} [Tue Sep 13 18:12:49 2022] GET /compute/v2.1/servers/1ad76e39-3a52-4014-8206-2b3863bce8b7 => generated 1682 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 13 18:12:50.931492 dv-cinder-852009-8-iscsi devstack@n-api.service[120741]: DEBUG nova.api.openstack.wsgi [None req-591f565f-a42e-43e1-84eb-16d5171295d7 tempest-AttachVolumeNegativeTest-1378806597 tempest-AttachVolumeNegativeTest-1378806597-project] Calling method '>' {{(pid=120741) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 18:12:50.933253 dv-cinder-852009-8-iscsi devstack@n-api.service[120741]: DEBUG nova.compute.api [None req-591f565f-a42e-43e1-84eb-16d5171295d7 tempest-AttachVolumeNegativeTest-1378806597 tempest-AttachVolumeNegativeTest-1378806597-project] [instance: 1ad76e39-3a52-4014-8206-2b3863bce8b7] Fetching instance by UUID {{(pid=120741) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 18:12:50.941115 dv-cinder-852009-8-iscsi devstack@n-api.service[120741]: DEBUG oslo_concurrency.lockutils [None req-591f565f-a42e-43e1-84eb-16d5171295d7 tempest-AttachVolumeNegativeTest-1378806597 tempest-AttachVolumeNegativeTest-1378806597-project] Acquiring lock "1daf4f4c-0e4a-4779-b53a-78c48397ea2f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120741) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 18:12:50.942020 dv-cinder-852009-8-iscsi devstack@n-api.service[120741]: DEBUG oslo_concurrency.lockutils [None req-591f565f-a42e-43e1-84eb-16d5171295d7 tempest-AttachVolumeNegativeTest-1378806597 tempest-AttachVolumeNegativeTest-1378806597-project] Lock "1daf4f4c-0e4a-4779-b53a-78c48397ea2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120741) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 18:12:50.943056 dv-cinder-852009-8-iscsi devstack@n-api.service[120741]: DEBUG oslo_concurrency.lockutils [None req-591f565f-a42e-43e1-84eb-16d5171295d7 tempest-AttachVolumeNegativeTest-1378806597 tempest-AttachVolumeNegativeTest-1378806597-project] Lock "1daf4f4c-0e4a-4779-b53a-78c48397ea2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120741) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 18:12:50.944130 dv-cinder-852009-8-iscsi devstack@n-api.service[120741]: DEBUG oslo_concurrency.lockutils [None req-591f565f-a42e-43e1-84eb-16d5171295d7 tempest-AttachVolumeNegativeTest-1378806597 tempest-AttachVolumeNegativeTest-1378806597-project] Acquiring lock "1daf4f4c-0e4a-4779-b53a-78c48397ea2f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120741) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 18:12:50.944866 dv-cinder-852009-8-iscsi devstack@n-api.service[120741]: DEBUG oslo_concurrency.lockutils [None req-591f565f-a42e-43e1-84eb-16d5171295d7 tempest-AttachVolumeNegativeTest-1378806597 tempest-AttachVolumeNegativeTest-1378806597-project] Lock "1daf4f4c-0e4a-4779-b53a-78c48397ea2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120741) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 18:12:50.945513 dv-cinder-852009-8-iscsi devstack@n-api.service[120741]: DEBUG oslo_concurrency.lockutils [None req-591f565f-a42e-43e1-84eb-16d5171295d7 tempest-AttachVolumeNegativeTest-1378806597 tempest-AttachVolumeNegativeTest-1378806597-project] Lock "1daf4f4c-0e4a-4779-b53a-78c48397ea2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120741) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 18:12:51.024107 dv-cinder-852009-8-iscsi devstack@n-api.service[120741]: DEBUG nova.policy [None req-591f565f-a42e-43e1-84eb-16d5171295d7 tempest-AttachVolumeNegativeTest-1378806597 tempest-AttachVolumeNegativeTest-1378806597-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '714cd09ba19b492f9a8c80343abcf6b9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '629311eda0584a5fbb7d8995cf27540c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120741) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 18:12:51.034997 dv-cinder-852009-8-iscsi devstack@n-api.service[120741]: INFO nova.api.openstack.requestlog [None req-591f565f-a42e-43e1-84eb-16d5171295d7 tempest-AttachVolumeNegativeTest-1378806597 tempest-AttachVolumeNegativeTest-1378806597-project] 10.222.0.43 "GET /compute/v2.1/servers/1ad76e39-3a52-4014-8206-2b3863bce8b7" status: 200 len: 1615 microversion: 2.1 time: 0.107731 Sep 13 18:12:51.043563 dv-cinder-852009-8-iscsi devstack@n-api.service[120741]: [pid: 120741|app: 0|req: 432/874] 10.222.0.43 () {58 vars in 1236 bytes} [Tue Sep 13 18:12:50 2022] GET /compute/v2.1/servers/1ad76e39-3a52-4014-8206-2b3863bce8b7 => generated 1615 bytes in 109 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 13 18:12:51.190875 dv-cinder-852009-8-iscsi devstack@n-api.service[120740]: DEBUG nova.api.openstack.wsgi [req-839be939-d142-49e0-a745-1def1a2d7b23 req-54020097-f0af-4dd2-b41d-bbb1f72c53d5 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "1ad76e39-3a52-4014-8206-2b3863bce8b7", "name": "network-vif-deleted", "tag": "995ef904-eae3-4b2e-a0b6-78d0f33276af"}]} {{(pid=120740) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 13 18:12:51.202797 dv-cinder-852009-8-iscsi devstack@n-api.service[120740]: DEBUG oslo_concurrency.lockutils [req-839be939-d142-49e0-a745-1def1a2d7b23 req-54020097-f0af-4dd2-b41d-bbb1f72c53d5 service nova] Acquiring lock "1daf4f4c-0e4a-4779-b53a-78c48397ea2f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120740) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 18:12:51.203323 dv-cinder-852009-8-iscsi devstack@n-api.service[120740]: DEBUG oslo_concurrency.lockutils [req-839be939-d142-49e0-a745-1def1a2d7b23 req-54020097-f0af-4dd2-b41d-bbb1f72c53d5 service nova] Lock "1daf4f4c-0e4a-4779-b53a-78c48397ea2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120740) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 18:12:51.203753 dv-cinder-852009-8-iscsi devstack@n-api.service[120740]: DEBUG oslo_concurrency.lockutils [req-839be939-d142-49e0-a745-1def1a2d7b23 req-54020097-f0af-4dd2-b41d-bbb1f72c53d5 service nova] Lock "1daf4f4c-0e4a-4779-b53a-78c48397ea2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120740) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 18:12:51.215275 dv-cinder-852009-8-iscsi devstack@n-api.service[120740]: INFO nova.api.openstack.compute.server_external_events [req-839be939-d142-49e0-a745-1def1a2d7b23 req-54020097-f0af-4dd2-b41d-bbb1f72c53d5 service nova] Creating event network-vif-deleted:995ef904-eae3-4b2e-a0b6-78d0f33276af for instance 1ad76e39-3a52-4014-8206-2b3863bce8b7 on hv-cinder-85200 Sep 13 18:12:51.219948 dv-cinder-852009-8-iscsi devstack@n-api.service[120740]: INFO nova.api.openstack.requestlog [req-839be939-d142-49e0-a745-1def1a2d7b23 req-54020097-f0af-4dd2-b41d-bbb1f72c53d5 service nova] 10.222.0.43 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.107252 Sep 13 18:12:51.220878 dv-cinder-852009-8-iscsi devstack@n-api.service[120740]: [pid: 120740|app: 0|req: 443/875] 10.222.0.43 () {64 vars in 1317 bytes} [Tue Sep 13 18:12:51 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 109 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 13 18:12:52.061144 dv-cinder-852009-8-iscsi devstack@n-api.service[120741]: DEBUG nova.api.openstack.wsgi [None req-be7fb0e2-14d4-429d-b3af-97b41db9e8cd tempest-AttachVolumeNegativeTest-1378806597 tempest-AttachVolumeNegativeTest-1378806597-project] Calling method '>' {{(pid=120741) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 18:12:52.061731 dv-cinder-852009-8-iscsi devstack@n-api.service[120741]: DEBUG nova.compute.api [None req-be7fb0e2-14d4-429d-b3af-97b41db9e8cd tempest-AttachVolumeNegativeTest-1378806597 tempest-AttachVolumeNegativeTest-1378806597-project] [instance: 1ad76e39-3a52-4014-8206-2b3863bce8b7] Fetching instance by UUID {{(pid=120741) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 18:12:52.067903 dv-cinder-852009-8-iscsi devstack@n-api.service[120741]: DEBUG oslo_concurrency.lockutils [None req-be7fb0e2-14d4-429d-b3af-97b41db9e8cd tempest-AttachVolumeNegativeTest-1378806597 tempest-AttachVolumeNegativeTest-1378806597-project] Acquiring lock "1daf4f4c-0e4a-4779-b53a-78c48397ea2f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120741) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 18:12:52.068369 dv-cinder-852009-8-iscsi devstack@n-api.service[120741]: DEBUG oslo_concurrency.lockutils [None req-be7fb0e2-14d4-429d-b3af-97b41db9e8cd tempest-AttachVolumeNegativeTest-1378806597 tempest-AttachVolumeNegativeTest-1378806597-project] Lock "1daf4f4c-0e4a-4779-b53a-78c48397ea2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120741) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 18:12:52.068853 dv-cinder-852009-8-iscsi devstack@n-api.service[120741]: DEBUG oslo_concurrency.lockutils [None req-be7fb0e2-14d4-429d-b3af-97b41db9e8cd tempest-AttachVolumeNegativeTest-1378806597 tempest-AttachVolumeNegativeTest-1378806597-project] Lock "1daf4f4c-0e4a-4779-b53a-78c48397ea2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120741) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 18:12:52.069574 dv-cinder-852009-8-iscsi devstack@n-api.service[120741]: DEBUG oslo_concurrency.lockutils [None req-be7fb0e2-14d4-429d-b3af-97b41db9e8cd tempest-AttachVolumeNegativeTest-1378806597 tempest-AttachVolumeNegativeTest-1378806597-project] Acquiring lock "1daf4f4c-0e4a-4779-b53a-78c48397ea2f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120741) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 18:12:52.070052 dv-cinder-852009-8-iscsi devstack@n-api.service[120741]: DEBUG oslo_concurrency.lockutils [None req-be7fb0e2-14d4-429d-b3af-97b41db9e8cd tempest-AttachVolumeNegativeTest-1378806597 tempest-AttachVolumeNegativeTest-1378806597-project] Lock "1daf4f4c-0e4a-4779-b53a-78c48397ea2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120741) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 18:12:52.071425 dv-cinder-852009-8-iscsi devstack@n-api.service[120741]: DEBUG oslo_concurrency.lockutils [None req-be7fb0e2-14d4-429d-b3af-97b41db9e8cd tempest-AttachVolumeNegativeTest-1378806597 tempest-AttachVolumeNegativeTest-1378806597-project] Lock "1daf4f4c-0e4a-4779-b53a-78c48397ea2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120741) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 18:12:52.088342 dv-cinder-852009-8-iscsi devstack@n-api.service[120741]: INFO nova.api.openstack.wsgi [None req-be7fb0e2-14d4-429d-b3af-97b41db9e8cd tempest-AttachVolumeNegativeTest-1378806597 tempest-AttachVolumeNegativeTest-1378806597-project] HTTP exception thrown: Instance 1ad76e39-3a52-4014-8206-2b3863bce8b7 could not be found. Sep 13 18:12:52.090183 dv-cinder-852009-8-iscsi devstack@n-api.service[120741]: DEBUG nova.api.openstack.wsgi [None req-be7fb0e2-14d4-429d-b3af-97b41db9e8cd tempest-AttachVolumeNegativeTest-1378806597 tempest-AttachVolumeNegativeTest-1378806597-project] Request method failure captured: Sep 13 18:12:52.090183 dv-cinder-852009-8-iscsi devstack@n-api.service[120741]: request: GET /compute/v2.1/servers/1ad76e39-3a52-4014-8206-2b3863bce8b7 HTTP/1.1 Sep 13 18:12:52.090183 dv-cinder-852009-8-iscsi devstack@n-api.service[120741]: Accept: application/json Sep 13 18:12:52.090183 dv-cinder-852009-8-iscsi devstack@n-api.service[120741]: Accept-Encoding: identity Sep 13 18:12:52.090183 dv-cinder-852009-8-iscsi devstack@n-api.service[120741]: Connection: close Sep 13 18:12:52.090183 dv-cinder-852009-8-iscsi devstack@n-api.service[120741]: Content-Length: 0 Sep 13 18:12:52.090183 dv-cinder-852009-8-iscsi devstack@n-api.service[120741]: Content-Type: application/json Sep 13 18:12:52.090183 dv-cinder-852009-8-iscsi devstack@n-api.service[120741]: Host: 10.222.0.43 Sep 13 18:12:52.090183 dv-cinder-852009-8-iscsi devstack@n-api.service[120741]: Openstack-System-Scope: None Sep 13 18:12:52.090183 dv-cinder-852009-8-iscsi devstack@n-api.service[120741]: User-Agent: python-urllib3/1.26.12 Sep 13 18:12:52.090183 dv-cinder-852009-8-iscsi devstack@n-api.service[120741]: X-Auth-Token: gAAAAABjIMciYi08KSU35iQHMuJ1d9BLU6OdnvTV0lQhD4NCYaw8no8S5_0xWB47N9lmu7akofQLpLV68heC7pPUCZsTXqIq6Y42WLp6VXHhyQNxgHSYkPKRLV6tG6CCOIlPDetRfNDVZw3BkXYviJ38fOivAdsSaqCGCQ-A5bO5QGkWPiqoF58 Sep 13 18:12:52.090183 dv-cinder-852009-8-iscsi devstack@n-api.service[120741]: X-Domain-Id: None Sep 13 18:12:52.090183 dv-cinder-852009-8-iscsi devstack@n-api.service[120741]: X-Domain-Name: None Sep 13 18:12:52.090183 dv-cinder-852009-8-iscsi devstack@n-api.service[120741]: X-Identity-Status: Confirmed Sep 13 18:12:52.090183 dv-cinder-852009-8-iscsi devstack@n-api.service[120741]: X-Is-Admin-Project: True Sep 13 18:12:52.090183 dv-cinder-852009-8-iscsi devstack@n-api.service[120741]: X-Project-Domain-Id: default Sep 13 18:12:52.090183 dv-cinder-852009-8-iscsi devstack@n-api.service[120741]: X-Project-Domain-Name: Default Sep 13 18:12:52.090183 dv-cinder-852009-8-iscsi devstack@n-api.service[120741]: X-Project-Id: 629311eda0584a5fbb7d8995cf27540c Sep 13 18:12:52.090183 dv-cinder-852009-8-iscsi devstack@n-api.service[120741]: X-Project-Name: tempest-AttachVolumeNegativeTest-1378806597 Sep 13 18:12:52.090183 dv-cinder-852009-8-iscsi devstack@n-api.service[120741]: X-Role: reader,member Sep 13 18:12:52.090183 dv-cinder-852009-8-iscsi devstack@n-api.service[120741]: X-Roles: reader,member Sep 13 18:12:52.091945 dv-cinder-852009-8-iscsi devstack@n-api.service[120741]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/identity"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/compute/v2/629311eda0584a5fbb7d8995cf27540c"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.43:8080", "publicURL": "http://10.222.0.43:8080/v1/AUTH_629311eda0584a5fbb7d8995cf27540c"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43:9696/networking"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/volume/v3/629311eda0584a5fbb7d8995cf27540c"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/compute/v2.1"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/placement"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/volume/v3/629311eda0584a5fbb7d8995cf27540c"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/image"}]}] Sep 13 18:12:52.091945 dv-cinder-852009-8-iscsi devstack@n-api.service[120741]: X-Tenant: tempest-AttachVolumeNegativeTest-1378806597 Sep 13 18:12:52.091945 dv-cinder-852009-8-iscsi devstack@n-api.service[120741]: X-Tenant-Id: 629311eda0584a5fbb7d8995cf27540c Sep 13 18:12:52.091945 dv-cinder-852009-8-iscsi devstack@n-api.service[120741]: X-Tenant-Name: tempest-AttachVolumeNegativeTest-1378806597 Sep 13 18:12:52.091945 dv-cinder-852009-8-iscsi devstack@n-api.service[120741]: X-User: tempest-AttachVolumeNegativeTest-1378806597-project Sep 13 18:12:52.091945 dv-cinder-852009-8-iscsi devstack@n-api.service[120741]: X-User-Domain-Id: default Sep 13 18:12:52.091945 dv-cinder-852009-8-iscsi devstack@n-api.service[120741]: X-User-Domain-Name: Default Sep 13 18:12:52.091945 dv-cinder-852009-8-iscsi devstack@n-api.service[120741]: X-User-Id: 714cd09ba19b492f9a8c80343abcf6b9 Sep 13 18:12:52.091945 dv-cinder-852009-8-iscsi devstack@n-api.service[120741]: X-User-Name: tempest-AttachVolumeNegativeTest-1378806597-project Sep 13 18:12:52.091945 dv-cinder-852009-8-iscsi devstack@n-api.service[120741]: method: > Sep 13 18:12:52.091945 dv-cinder-852009-8-iscsi devstack@n-api.service[120741]: exception: Instance 1ad76e39-3a52-4014-8206-2b3863bce8b7 could not be found. Sep 13 18:12:52.091945 dv-cinder-852009-8-iscsi devstack@n-api.service[120741]: action_args: {'id': '1ad76e39-3a52-4014-8206-2b3863bce8b7'} Sep 13 18:12:52.092904 dv-cinder-852009-8-iscsi devstack@n-api.service[120741]: {{(pid=120741) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 13 18:12:52.092904 dv-cinder-852009-8-iscsi devstack@n-api.service[120741]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 13 18:12:52.092904 dv-cinder-852009-8-iscsi devstack@n-api.service[120741]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Sep 13 18:12:52.092904 dv-cinder-852009-8-iscsi devstack@n-api.service[120741]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Sep 13 18:12:52.092904 dv-cinder-852009-8-iscsi devstack@n-api.service[120741]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Sep 13 18:12:52.092904 dv-cinder-852009-8-iscsi devstack@n-api.service[120741]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Sep 13 18:12:52.092904 dv-cinder-852009-8-iscsi devstack@n-api.service[120741]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Sep 13 18:12:52.092904 dv-cinder-852009-8-iscsi devstack@n-api.service[120741]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Sep 13 18:12:52.092904 dv-cinder-852009-8-iscsi devstack@n-api.service[120741]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Sep 13 18:12:52.092904 dv-cinder-852009-8-iscsi devstack@n-api.service[120741]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Sep 13 18:12:52.092904 dv-cinder-852009-8-iscsi devstack@n-api.service[120741]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 1ad76e39-3a52-4014-8206-2b3863bce8b7 could not be found. Sep 13 18:12:52.092904 dv-cinder-852009-8-iscsi devstack@n-api.service[120741]: ERROR nova.api.openstack.wsgi Sep 13 18:12:52.092904 dv-cinder-852009-8-iscsi devstack@n-api.service[120741]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 13 18:12:52.092904 dv-cinder-852009-8-iscsi devstack@n-api.service[120741]: ERROR nova.api.openstack.wsgi Sep 13 18:12:52.092904 dv-cinder-852009-8-iscsi devstack@n-api.service[120741]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 13 18:12:52.092904 dv-cinder-852009-8-iscsi devstack@n-api.service[120741]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 13 18:12:52.092904 dv-cinder-852009-8-iscsi devstack@n-api.service[120741]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 13 18:12:52.092904 dv-cinder-852009-8-iscsi devstack@n-api.service[120741]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 13 18:12:52.092904 dv-cinder-852009-8-iscsi devstack@n-api.service[120741]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 13 18:12:52.092904 dv-cinder-852009-8-iscsi devstack@n-api.service[120741]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 13 18:12:52.094387 dv-cinder-852009-8-iscsi devstack@n-api.service[120741]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 13 18:12:52.094387 dv-cinder-852009-8-iscsi devstack@n-api.service[120741]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Sep 13 18:12:52.094387 dv-cinder-852009-8-iscsi devstack@n-api.service[120741]: ERROR nova.api.openstack.wsgi instance = self._get_server( Sep 13 18:12:52.094387 dv-cinder-852009-8-iscsi devstack@n-api.service[120741]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Sep 13 18:12:52.094387 dv-cinder-852009-8-iscsi devstack@n-api.service[120741]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Sep 13 18:12:52.094387 dv-cinder-852009-8-iscsi devstack@n-api.service[120741]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Sep 13 18:12:52.094387 dv-cinder-852009-8-iscsi devstack@n-api.service[120741]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Sep 13 18:12:52.094387 dv-cinder-852009-8-iscsi devstack@n-api.service[120741]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 1ad76e39-3a52-4014-8206-2b3863bce8b7 could not be found. Sep 13 18:12:52.094387 dv-cinder-852009-8-iscsi devstack@n-api.service[120741]: ERROR nova.api.openstack.wsgi Sep 13 18:12:52.094387 dv-cinder-852009-8-iscsi devstack@n-api.service[120741]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 13 18:12:52.094387 dv-cinder-852009-8-iscsi devstack@n-api.service[120741]: ERROR nova.api.openstack.wsgi Sep 13 18:12:52.094387 dv-cinder-852009-8-iscsi devstack@n-api.service[120741]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 13 18:12:52.094387 dv-cinder-852009-8-iscsi devstack@n-api.service[120741]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 13 18:12:52.094387 dv-cinder-852009-8-iscsi devstack@n-api.service[120741]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 13 18:12:52.094387 dv-cinder-852009-8-iscsi devstack@n-api.service[120741]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 13 18:12:52.094387 dv-cinder-852009-8-iscsi devstack@n-api.service[120741]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 13 18:12:52.094387 dv-cinder-852009-8-iscsi devstack@n-api.service[120741]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 1ad76e39-3a52-4014-8206-2b3863bce8b7 could not be found. Sep 13 18:12:52.094387 dv-cinder-852009-8-iscsi devstack@n-api.service[120741]: ERROR nova.api.openstack.wsgi Sep 13 18:12:52.096158 dv-cinder-852009-8-iscsi devstack@n-api.service[120741]: DEBUG nova.api.openstack.wsgi [None req-be7fb0e2-14d4-429d-b3af-97b41db9e8cd tempest-AttachVolumeNegativeTest-1378806597 tempest-AttachVolumeNegativeTest-1378806597-project] Returning 404 to user: Instance 1ad76e39-3a52-4014-8206-2b3863bce8b7 could not be found. {{(pid=120741) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 13 18:12:52.096158 dv-cinder-852009-8-iscsi devstack@n-api.service[120741]: INFO nova.api.openstack.requestlog [None req-be7fb0e2-14d4-429d-b3af-97b41db9e8cd tempest-AttachVolumeNegativeTest-1378806597 tempest-AttachVolumeNegativeTest-1378806597-project] 10.222.0.43 "GET /compute/v2.1/servers/1ad76e39-3a52-4014-8206-2b3863bce8b7" status: 404 len: 111 microversion: 2.1 time: 0.035199 Sep 13 18:12:52.096158 dv-cinder-852009-8-iscsi devstack@n-api.service[120741]: [pid: 120741|app: 0|req: 433/876] 10.222.0.43 () {58 vars in 1236 bytes} [Tue Sep 13 18:12:52 2022] GET /compute/v2.1/servers/1ad76e39-3a52-4014-8206-2b3863bce8b7 => generated 111 bytes in 37 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Sep 13 18:12:52.101620 dv-cinder-852009-8-iscsi devstack@n-api.service[120740]: DEBUG nova.api.openstack.wsgi [None req-aeaea955-00de-4786-a707-abaf5093cde7 tempest-AttachVolumeNegativeTest-1378806597 tempest-AttachVolumeNegativeTest-1378806597-project] Calling method '.version_select at 0x7fa626abf820>' {{(pid=120740) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 18:12:52.121227 dv-cinder-852009-8-iscsi devstack@n-api.service[120740]: INFO nova.api.openstack.requestlog [None req-aeaea955-00de-4786-a707-abaf5093cde7 tempest-AttachVolumeNegativeTest-1378806597 tempest-AttachVolumeNegativeTest-1378806597-project] 10.222.0.43 "DELETE /compute/v2.1/os-keypairs/tempest-keypair-284252898" status: 202 len: 0 microversion: 2.1 time: 0.023780 Sep 13 18:12:52.121940 dv-cinder-852009-8-iscsi devstack@n-api.service[120740]: [pid: 120740|app: 0|req: 444/877] 10.222.0.43 () {58 vars in 1218 bytes} [Tue Sep 13 18:12:52 2022] DELETE /compute/v2.1/os-keypairs/tempest-keypair-284252898 => generated 0 bytes in 25 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Sep 13 18:12:53.900988 dv-cinder-852009-8-iscsi devstack@n-api.service[120741]: DEBUG nova.api.openstack.wsgi [None req-9bf9648e-608b-46b8-a9c8-7937fe9882aa tempest-AttachVolumeNegativeTest-1378806597 tempest-AttachVolumeNegativeTest-1378806597-project] Calling method '>' {{(pid=120741) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 18:12:53.901525 dv-cinder-852009-8-iscsi devstack@n-api.service[120741]: DEBUG nova.compute.api [None req-9bf9648e-608b-46b8-a9c8-7937fe9882aa tempest-AttachVolumeNegativeTest-1378806597 tempest-AttachVolumeNegativeTest-1378806597-project] [instance: 1ad76e39-3a52-4014-8206-2b3863bce8b7] Fetching instance by UUID {{(pid=120741) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 18:12:53.908312 dv-cinder-852009-8-iscsi devstack@n-api.service[120741]: DEBUG oslo_concurrency.lockutils [None req-9bf9648e-608b-46b8-a9c8-7937fe9882aa tempest-AttachVolumeNegativeTest-1378806597 tempest-AttachVolumeNegativeTest-1378806597-project] Acquiring lock "1daf4f4c-0e4a-4779-b53a-78c48397ea2f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120741) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 18:12:53.908842 dv-cinder-852009-8-iscsi devstack@n-api.service[120741]: DEBUG oslo_concurrency.lockutils [None req-9bf9648e-608b-46b8-a9c8-7937fe9882aa tempest-AttachVolumeNegativeTest-1378806597 tempest-AttachVolumeNegativeTest-1378806597-project] Lock "1daf4f4c-0e4a-4779-b53a-78c48397ea2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120741) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 18:12:53.909271 dv-cinder-852009-8-iscsi devstack@n-api.service[120741]: DEBUG oslo_concurrency.lockutils [None req-9bf9648e-608b-46b8-a9c8-7937fe9882aa tempest-AttachVolumeNegativeTest-1378806597 tempest-AttachVolumeNegativeTest-1378806597-project] Lock "1daf4f4c-0e4a-4779-b53a-78c48397ea2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120741) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 18:12:53.909962 dv-cinder-852009-8-iscsi devstack@n-api.service[120741]: DEBUG oslo_concurrency.lockutils [None req-9bf9648e-608b-46b8-a9c8-7937fe9882aa tempest-AttachVolumeNegativeTest-1378806597 tempest-AttachVolumeNegativeTest-1378806597-project] Acquiring lock "1daf4f4c-0e4a-4779-b53a-78c48397ea2f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120741) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 18:12:53.910421 dv-cinder-852009-8-iscsi devstack@n-api.service[120741]: DEBUG oslo_concurrency.lockutils [None req-9bf9648e-608b-46b8-a9c8-7937fe9882aa tempest-AttachVolumeNegativeTest-1378806597 tempest-AttachVolumeNegativeTest-1378806597-project] Lock "1daf4f4c-0e4a-4779-b53a-78c48397ea2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120741) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 18:12:53.910825 dv-cinder-852009-8-iscsi devstack@n-api.service[120741]: DEBUG oslo_concurrency.lockutils [None req-9bf9648e-608b-46b8-a9c8-7937fe9882aa tempest-AttachVolumeNegativeTest-1378806597 tempest-AttachVolumeNegativeTest-1378806597-project] Lock "1daf4f4c-0e4a-4779-b53a-78c48397ea2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120741) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 18:12:53.925221 dv-cinder-852009-8-iscsi devstack@n-api.service[120741]: INFO nova.api.openstack.wsgi [None req-9bf9648e-608b-46b8-a9c8-7937fe9882aa tempest-AttachVolumeNegativeTest-1378806597 tempest-AttachVolumeNegativeTest-1378806597-project] HTTP exception thrown: Instance 1ad76e39-3a52-4014-8206-2b3863bce8b7 could not be found. Sep 13 18:12:53.926764 dv-cinder-852009-8-iscsi devstack@n-api.service[120741]: DEBUG nova.api.openstack.wsgi [None req-9bf9648e-608b-46b8-a9c8-7937fe9882aa tempest-AttachVolumeNegativeTest-1378806597 tempest-AttachVolumeNegativeTest-1378806597-project] Request method failure captured: Sep 13 18:12:53.926764 dv-cinder-852009-8-iscsi devstack@n-api.service[120741]: request: DELETE /compute/v2.1/servers/1ad76e39-3a52-4014-8206-2b3863bce8b7 HTTP/1.1 Sep 13 18:12:53.926764 dv-cinder-852009-8-iscsi devstack@n-api.service[120741]: Accept: application/json Sep 13 18:12:53.926764 dv-cinder-852009-8-iscsi devstack@n-api.service[120741]: Accept-Encoding: identity Sep 13 18:12:53.926764 dv-cinder-852009-8-iscsi devstack@n-api.service[120741]: Connection: close Sep 13 18:12:53.926764 dv-cinder-852009-8-iscsi devstack@n-api.service[120741]: Content-Length: 0 Sep 13 18:12:53.926764 dv-cinder-852009-8-iscsi devstack@n-api.service[120741]: Content-Type: application/json Sep 13 18:12:53.926764 dv-cinder-852009-8-iscsi devstack@n-api.service[120741]: Host: 10.222.0.43 Sep 13 18:12:53.926764 dv-cinder-852009-8-iscsi devstack@n-api.service[120741]: Openstack-System-Scope: None Sep 13 18:12:53.926764 dv-cinder-852009-8-iscsi devstack@n-api.service[120741]: User-Agent: python-urllib3/1.26.12 Sep 13 18:12:53.926764 dv-cinder-852009-8-iscsi devstack@n-api.service[120741]: X-Auth-Token: gAAAAABjIMciYi08KSU35iQHMuJ1d9BLU6OdnvTV0lQhD4NCYaw8no8S5_0xWB47N9lmu7akofQLpLV68heC7pPUCZsTXqIq6Y42WLp6VXHhyQNxgHSYkPKRLV6tG6CCOIlPDetRfNDVZw3BkXYviJ38fOivAdsSaqCGCQ-A5bO5QGkWPiqoF58 Sep 13 18:12:53.926764 dv-cinder-852009-8-iscsi devstack@n-api.service[120741]: X-Domain-Id: None Sep 13 18:12:53.926764 dv-cinder-852009-8-iscsi devstack@n-api.service[120741]: X-Domain-Name: None Sep 13 18:12:53.926764 dv-cinder-852009-8-iscsi devstack@n-api.service[120741]: X-Identity-Status: Confirmed Sep 13 18:12:53.926764 dv-cinder-852009-8-iscsi devstack@n-api.service[120741]: X-Is-Admin-Project: True Sep 13 18:12:53.926764 dv-cinder-852009-8-iscsi devstack@n-api.service[120741]: X-Project-Domain-Id: default Sep 13 18:12:53.926764 dv-cinder-852009-8-iscsi devstack@n-api.service[120741]: X-Project-Domain-Name: Default Sep 13 18:12:53.926764 dv-cinder-852009-8-iscsi devstack@n-api.service[120741]: X-Project-Id: 629311eda0584a5fbb7d8995cf27540c Sep 13 18:12:53.926764 dv-cinder-852009-8-iscsi devstack@n-api.service[120741]: X-Project-Name: tempest-AttachVolumeNegativeTest-1378806597 Sep 13 18:12:53.926764 dv-cinder-852009-8-iscsi devstack@n-api.service[120741]: X-Role: reader,member Sep 13 18:12:53.926764 dv-cinder-852009-8-iscsi devstack@n-api.service[120741]: X-Roles: reader,member Sep 13 18:12:53.928347 dv-cinder-852009-8-iscsi devstack@n-api.service[120741]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/identity"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/compute/v2/629311eda0584a5fbb7d8995cf27540c"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.43:8080", "publicURL": "http://10.222.0.43:8080/v1/AUTH_629311eda0584a5fbb7d8995cf27540c"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43:9696/networking"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/volume/v3/629311eda0584a5fbb7d8995cf27540c"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/compute/v2.1"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/placement"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/volume/v3/629311eda0584a5fbb7d8995cf27540c"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/image"}]}] Sep 13 18:12:53.928347 dv-cinder-852009-8-iscsi devstack@n-api.service[120741]: X-Tenant: tempest-AttachVolumeNegativeTest-1378806597 Sep 13 18:12:53.928347 dv-cinder-852009-8-iscsi devstack@n-api.service[120741]: X-Tenant-Id: 629311eda0584a5fbb7d8995cf27540c Sep 13 18:12:53.928347 dv-cinder-852009-8-iscsi devstack@n-api.service[120741]: X-Tenant-Name: tempest-AttachVolumeNegativeTest-1378806597 Sep 13 18:12:53.928347 dv-cinder-852009-8-iscsi devstack@n-api.service[120741]: X-User: tempest-AttachVolumeNegativeTest-1378806597-project Sep 13 18:12:53.928347 dv-cinder-852009-8-iscsi devstack@n-api.service[120741]: X-User-Domain-Id: default Sep 13 18:12:53.928347 dv-cinder-852009-8-iscsi devstack@n-api.service[120741]: X-User-Domain-Name: Default Sep 13 18:12:53.928347 dv-cinder-852009-8-iscsi devstack@n-api.service[120741]: X-User-Id: 714cd09ba19b492f9a8c80343abcf6b9 Sep 13 18:12:53.928347 dv-cinder-852009-8-iscsi devstack@n-api.service[120741]: X-User-Name: tempest-AttachVolumeNegativeTest-1378806597-project Sep 13 18:12:53.928347 dv-cinder-852009-8-iscsi devstack@n-api.service[120741]: method: > Sep 13 18:12:53.928347 dv-cinder-852009-8-iscsi devstack@n-api.service[120741]: exception: Instance 1ad76e39-3a52-4014-8206-2b3863bce8b7 could not be found. Sep 13 18:12:53.928347 dv-cinder-852009-8-iscsi devstack@n-api.service[120741]: action_args: {'id': '1ad76e39-3a52-4014-8206-2b3863bce8b7'} Sep 13 18:12:53.929287 dv-cinder-852009-8-iscsi devstack@n-api.service[120741]: {{(pid=120741) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 13 18:12:53.929287 dv-cinder-852009-8-iscsi devstack@n-api.service[120741]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 13 18:12:53.929287 dv-cinder-852009-8-iscsi devstack@n-api.service[120741]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Sep 13 18:12:53.929287 dv-cinder-852009-8-iscsi devstack@n-api.service[120741]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Sep 13 18:12:53.929287 dv-cinder-852009-8-iscsi devstack@n-api.service[120741]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Sep 13 18:12:53.929287 dv-cinder-852009-8-iscsi devstack@n-api.service[120741]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Sep 13 18:12:53.929287 dv-cinder-852009-8-iscsi devstack@n-api.service[120741]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Sep 13 18:12:53.929287 dv-cinder-852009-8-iscsi devstack@n-api.service[120741]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Sep 13 18:12:53.929287 dv-cinder-852009-8-iscsi devstack@n-api.service[120741]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Sep 13 18:12:53.929287 dv-cinder-852009-8-iscsi devstack@n-api.service[120741]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Sep 13 18:12:53.929287 dv-cinder-852009-8-iscsi devstack@n-api.service[120741]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 1ad76e39-3a52-4014-8206-2b3863bce8b7 could not be found. Sep 13 18:12:53.929287 dv-cinder-852009-8-iscsi devstack@n-api.service[120741]: ERROR nova.api.openstack.wsgi Sep 13 18:12:53.929287 dv-cinder-852009-8-iscsi devstack@n-api.service[120741]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 13 18:12:53.929287 dv-cinder-852009-8-iscsi devstack@n-api.service[120741]: ERROR nova.api.openstack.wsgi Sep 13 18:12:53.929287 dv-cinder-852009-8-iscsi devstack@n-api.service[120741]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 13 18:12:53.929287 dv-cinder-852009-8-iscsi devstack@n-api.service[120741]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 13 18:12:53.929287 dv-cinder-852009-8-iscsi devstack@n-api.service[120741]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 13 18:12:53.929287 dv-cinder-852009-8-iscsi devstack@n-api.service[120741]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 13 18:12:53.929287 dv-cinder-852009-8-iscsi devstack@n-api.service[120741]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 13 18:12:53.929287 dv-cinder-852009-8-iscsi devstack@n-api.service[120741]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 13 18:12:53.930786 dv-cinder-852009-8-iscsi devstack@n-api.service[120741]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 13 18:12:53.930786 dv-cinder-852009-8-iscsi devstack@n-api.service[120741]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete Sep 13 18:12:53.930786 dv-cinder-852009-8-iscsi devstack@n-api.service[120741]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) Sep 13 18:12:53.930786 dv-cinder-852009-8-iscsi devstack@n-api.service[120741]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete Sep 13 18:12:53.930786 dv-cinder-852009-8-iscsi devstack@n-api.service[120741]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) Sep 13 18:12:53.930786 dv-cinder-852009-8-iscsi devstack@n-api.service[120741]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Sep 13 18:12:53.930786 dv-cinder-852009-8-iscsi devstack@n-api.service[120741]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Sep 13 18:12:53.930786 dv-cinder-852009-8-iscsi devstack@n-api.service[120741]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Sep 13 18:12:53.930786 dv-cinder-852009-8-iscsi devstack@n-api.service[120741]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Sep 13 18:12:53.930786 dv-cinder-852009-8-iscsi devstack@n-api.service[120741]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 1ad76e39-3a52-4014-8206-2b3863bce8b7 could not be found. Sep 13 18:12:53.930786 dv-cinder-852009-8-iscsi devstack@n-api.service[120741]: ERROR nova.api.openstack.wsgi Sep 13 18:12:53.930786 dv-cinder-852009-8-iscsi devstack@n-api.service[120741]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 13 18:12:53.930786 dv-cinder-852009-8-iscsi devstack@n-api.service[120741]: ERROR nova.api.openstack.wsgi Sep 13 18:12:53.930786 dv-cinder-852009-8-iscsi devstack@n-api.service[120741]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 13 18:12:53.930786 dv-cinder-852009-8-iscsi devstack@n-api.service[120741]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 13 18:12:53.930786 dv-cinder-852009-8-iscsi devstack@n-api.service[120741]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 13 18:12:53.930786 dv-cinder-852009-8-iscsi devstack@n-api.service[120741]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 13 18:12:53.930786 dv-cinder-852009-8-iscsi devstack@n-api.service[120741]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 13 18:12:53.930786 dv-cinder-852009-8-iscsi devstack@n-api.service[120741]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 1ad76e39-3a52-4014-8206-2b3863bce8b7 could not be found. Sep 13 18:12:53.930786 dv-cinder-852009-8-iscsi devstack@n-api.service[120741]: ERROR nova.api.openstack.wsgi Sep 13 18:12:53.932276 dv-cinder-852009-8-iscsi devstack@n-api.service[120741]: DEBUG nova.api.openstack.wsgi [None req-9bf9648e-608b-46b8-a9c8-7937fe9882aa tempest-AttachVolumeNegativeTest-1378806597 tempest-AttachVolumeNegativeTest-1378806597-project] Returning 404 to user: Instance 1ad76e39-3a52-4014-8206-2b3863bce8b7 could not be found. {{(pid=120741) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 13 18:12:53.932276 dv-cinder-852009-8-iscsi devstack@n-api.service[120741]: INFO nova.api.openstack.requestlog [None req-9bf9648e-608b-46b8-a9c8-7937fe9882aa tempest-AttachVolumeNegativeTest-1378806597 tempest-AttachVolumeNegativeTest-1378806597-project] 10.222.0.43 "DELETE /compute/v2.1/servers/1ad76e39-3a52-4014-8206-2b3863bce8b7" status: 404 len: 111 microversion: 2.1 time: 0.030967 Sep 13 18:12:53.932276 dv-cinder-852009-8-iscsi devstack@n-api.service[120741]: [pid: 120741|app: 0|req: 434/878] 10.222.0.43 () {58 vars in 1239 bytes} [Tue Sep 13 18:12:53 2022] DELETE /compute/v2.1/servers/1ad76e39-3a52-4014-8206-2b3863bce8b7 => generated 111 bytes in 32 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Sep 13 18:12:53.940025 dv-cinder-852009-8-iscsi devstack@n-api.service[120740]: DEBUG nova.api.openstack.wsgi [None req-ea8030af-b3a7-48e5-91db-2e150edc3682 tempest-AttachVolumeNegativeTest-1378806597 tempest-AttachVolumeNegativeTest-1378806597-project] Calling method '>' {{(pid=120740) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 18:12:53.940955 dv-cinder-852009-8-iscsi devstack@n-api.service[120740]: DEBUG nova.compute.api [None req-ea8030af-b3a7-48e5-91db-2e150edc3682 tempest-AttachVolumeNegativeTest-1378806597 tempest-AttachVolumeNegativeTest-1378806597-project] [instance: 1ad76e39-3a52-4014-8206-2b3863bce8b7] Fetching instance by UUID {{(pid=120740) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 18:12:53.949316 dv-cinder-852009-8-iscsi devstack@n-api.service[120740]: DEBUG oslo_concurrency.lockutils [None req-ea8030af-b3a7-48e5-91db-2e150edc3682 tempest-AttachVolumeNegativeTest-1378806597 tempest-AttachVolumeNegativeTest-1378806597-project] Acquiring lock "1daf4f4c-0e4a-4779-b53a-78c48397ea2f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120740) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 18:12:53.949800 dv-cinder-852009-8-iscsi devstack@n-api.service[120740]: DEBUG oslo_concurrency.lockutils [None req-ea8030af-b3a7-48e5-91db-2e150edc3682 tempest-AttachVolumeNegativeTest-1378806597 tempest-AttachVolumeNegativeTest-1378806597-project] Lock "1daf4f4c-0e4a-4779-b53a-78c48397ea2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120740) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 18:12:53.950231 dv-cinder-852009-8-iscsi devstack@n-api.service[120740]: DEBUG oslo_concurrency.lockutils [None req-ea8030af-b3a7-48e5-91db-2e150edc3682 tempest-AttachVolumeNegativeTest-1378806597 tempest-AttachVolumeNegativeTest-1378806597-project] Lock "1daf4f4c-0e4a-4779-b53a-78c48397ea2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120740) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 18:12:53.950936 dv-cinder-852009-8-iscsi devstack@n-api.service[120740]: DEBUG oslo_concurrency.lockutils [None req-ea8030af-b3a7-48e5-91db-2e150edc3682 tempest-AttachVolumeNegativeTest-1378806597 tempest-AttachVolumeNegativeTest-1378806597-project] Acquiring lock "1daf4f4c-0e4a-4779-b53a-78c48397ea2f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120740) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 18:12:53.951391 dv-cinder-852009-8-iscsi devstack@n-api.service[120740]: DEBUG oslo_concurrency.lockutils [None req-ea8030af-b3a7-48e5-91db-2e150edc3682 tempest-AttachVolumeNegativeTest-1378806597 tempest-AttachVolumeNegativeTest-1378806597-project] Lock "1daf4f4c-0e4a-4779-b53a-78c48397ea2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120740) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 18:12:53.951813 dv-cinder-852009-8-iscsi devstack@n-api.service[120740]: DEBUG oslo_concurrency.lockutils [None req-ea8030af-b3a7-48e5-91db-2e150edc3682 tempest-AttachVolumeNegativeTest-1378806597 tempest-AttachVolumeNegativeTest-1378806597-project] Lock "1daf4f4c-0e4a-4779-b53a-78c48397ea2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120740) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 18:12:53.972613 dv-cinder-852009-8-iscsi devstack@n-api.service[120740]: INFO nova.api.openstack.wsgi [None req-ea8030af-b3a7-48e5-91db-2e150edc3682 tempest-AttachVolumeNegativeTest-1378806597 tempest-AttachVolumeNegativeTest-1378806597-project] HTTP exception thrown: Instance 1ad76e39-3a52-4014-8206-2b3863bce8b7 could not be found. Sep 13 18:12:53.974277 dv-cinder-852009-8-iscsi devstack@n-api.service[120740]: DEBUG nova.api.openstack.wsgi [None req-ea8030af-b3a7-48e5-91db-2e150edc3682 tempest-AttachVolumeNegativeTest-1378806597 tempest-AttachVolumeNegativeTest-1378806597-project] Request method failure captured: Sep 13 18:12:53.974277 dv-cinder-852009-8-iscsi devstack@n-api.service[120740]: request: GET /compute/v2.1/servers/1ad76e39-3a52-4014-8206-2b3863bce8b7 HTTP/1.1 Sep 13 18:12:53.974277 dv-cinder-852009-8-iscsi devstack@n-api.service[120740]: Accept: application/json Sep 13 18:12:53.974277 dv-cinder-852009-8-iscsi devstack@n-api.service[120740]: Accept-Encoding: identity Sep 13 18:12:53.974277 dv-cinder-852009-8-iscsi devstack@n-api.service[120740]: Connection: close Sep 13 18:12:53.974277 dv-cinder-852009-8-iscsi devstack@n-api.service[120740]: Content-Length: 0 Sep 13 18:12:53.974277 dv-cinder-852009-8-iscsi devstack@n-api.service[120740]: Content-Type: application/json Sep 13 18:12:53.974277 dv-cinder-852009-8-iscsi devstack@n-api.service[120740]: Host: 10.222.0.43 Sep 13 18:12:53.974277 dv-cinder-852009-8-iscsi devstack@n-api.service[120740]: Openstack-System-Scope: None Sep 13 18:12:53.974277 dv-cinder-852009-8-iscsi devstack@n-api.service[120740]: User-Agent: python-urllib3/1.26.12 Sep 13 18:12:53.974277 dv-cinder-852009-8-iscsi devstack@n-api.service[120740]: X-Auth-Token: gAAAAABjIMciYi08KSU35iQHMuJ1d9BLU6OdnvTV0lQhD4NCYaw8no8S5_0xWB47N9lmu7akofQLpLV68heC7pPUCZsTXqIq6Y42WLp6VXHhyQNxgHSYkPKRLV6tG6CCOIlPDetRfNDVZw3BkXYviJ38fOivAdsSaqCGCQ-A5bO5QGkWPiqoF58 Sep 13 18:12:53.974277 dv-cinder-852009-8-iscsi devstack@n-api.service[120740]: X-Domain-Id: None Sep 13 18:12:53.974277 dv-cinder-852009-8-iscsi devstack@n-api.service[120740]: X-Domain-Name: None Sep 13 18:12:53.974277 dv-cinder-852009-8-iscsi devstack@n-api.service[120740]: X-Identity-Status: Confirmed Sep 13 18:12:53.974277 dv-cinder-852009-8-iscsi devstack@n-api.service[120740]: X-Is-Admin-Project: True Sep 13 18:12:53.974277 dv-cinder-852009-8-iscsi devstack@n-api.service[120740]: X-Project-Domain-Id: default Sep 13 18:12:53.974277 dv-cinder-852009-8-iscsi devstack@n-api.service[120740]: X-Project-Domain-Name: Default Sep 13 18:12:53.974277 dv-cinder-852009-8-iscsi devstack@n-api.service[120740]: X-Project-Id: 629311eda0584a5fbb7d8995cf27540c Sep 13 18:12:53.974277 dv-cinder-852009-8-iscsi devstack@n-api.service[120740]: X-Project-Name: tempest-AttachVolumeNegativeTest-1378806597 Sep 13 18:12:53.974277 dv-cinder-852009-8-iscsi devstack@n-api.service[120740]: X-Role: reader,member Sep 13 18:12:53.974277 dv-cinder-852009-8-iscsi devstack@n-api.service[120740]: X-Roles: reader,member Sep 13 18:12:53.975944 dv-cinder-852009-8-iscsi devstack@n-api.service[120740]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/identity"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/compute/v2/629311eda0584a5fbb7d8995cf27540c"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.43:8080", "publicURL": "http://10.222.0.43:8080/v1/AUTH_629311eda0584a5fbb7d8995cf27540c"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43:9696/networking"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/volume/v3/629311eda0584a5fbb7d8995cf27540c"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/compute/v2.1"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/placement"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/volume/v3/629311eda0584a5fbb7d8995cf27540c"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/image"}]}] Sep 13 18:12:53.975944 dv-cinder-852009-8-iscsi devstack@n-api.service[120740]: X-Tenant: tempest-AttachVolumeNegativeTest-1378806597 Sep 13 18:12:53.975944 dv-cinder-852009-8-iscsi devstack@n-api.service[120740]: X-Tenant-Id: 629311eda0584a5fbb7d8995cf27540c Sep 13 18:12:53.975944 dv-cinder-852009-8-iscsi devstack@n-api.service[120740]: X-Tenant-Name: tempest-AttachVolumeNegativeTest-1378806597 Sep 13 18:12:53.975944 dv-cinder-852009-8-iscsi devstack@n-api.service[120740]: X-User: tempest-AttachVolumeNegativeTest-1378806597-project Sep 13 18:12:53.975944 dv-cinder-852009-8-iscsi devstack@n-api.service[120740]: X-User-Domain-Id: default Sep 13 18:12:53.975944 dv-cinder-852009-8-iscsi devstack@n-api.service[120740]: X-User-Domain-Name: Default Sep 13 18:12:53.975944 dv-cinder-852009-8-iscsi devstack@n-api.service[120740]: X-User-Id: 714cd09ba19b492f9a8c80343abcf6b9 Sep 13 18:12:53.975944 dv-cinder-852009-8-iscsi devstack@n-api.service[120740]: X-User-Name: tempest-AttachVolumeNegativeTest-1378806597-project Sep 13 18:12:53.975944 dv-cinder-852009-8-iscsi devstack@n-api.service[120740]: method: > Sep 13 18:12:53.975944 dv-cinder-852009-8-iscsi devstack@n-api.service[120740]: exception: Instance 1ad76e39-3a52-4014-8206-2b3863bce8b7 could not be found. Sep 13 18:12:53.975944 dv-cinder-852009-8-iscsi devstack@n-api.service[120740]: action_args: {'id': '1ad76e39-3a52-4014-8206-2b3863bce8b7'} Sep 13 18:12:53.976952 dv-cinder-852009-8-iscsi devstack@n-api.service[120740]: {{(pid=120740) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 13 18:12:53.976952 dv-cinder-852009-8-iscsi devstack@n-api.service[120740]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 13 18:12:53.976952 dv-cinder-852009-8-iscsi devstack@n-api.service[120740]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Sep 13 18:12:53.976952 dv-cinder-852009-8-iscsi devstack@n-api.service[120740]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Sep 13 18:12:53.976952 dv-cinder-852009-8-iscsi devstack@n-api.service[120740]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Sep 13 18:12:53.976952 dv-cinder-852009-8-iscsi devstack@n-api.service[120740]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Sep 13 18:12:53.976952 dv-cinder-852009-8-iscsi devstack@n-api.service[120740]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Sep 13 18:12:53.976952 dv-cinder-852009-8-iscsi devstack@n-api.service[120740]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Sep 13 18:12:53.976952 dv-cinder-852009-8-iscsi devstack@n-api.service[120740]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Sep 13 18:12:53.976952 dv-cinder-852009-8-iscsi devstack@n-api.service[120740]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Sep 13 18:12:53.976952 dv-cinder-852009-8-iscsi devstack@n-api.service[120740]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 1ad76e39-3a52-4014-8206-2b3863bce8b7 could not be found. Sep 13 18:12:53.976952 dv-cinder-852009-8-iscsi devstack@n-api.service[120740]: ERROR nova.api.openstack.wsgi Sep 13 18:12:53.976952 dv-cinder-852009-8-iscsi devstack@n-api.service[120740]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 13 18:12:53.976952 dv-cinder-852009-8-iscsi devstack@n-api.service[120740]: ERROR nova.api.openstack.wsgi Sep 13 18:12:53.976952 dv-cinder-852009-8-iscsi devstack@n-api.service[120740]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 13 18:12:53.976952 dv-cinder-852009-8-iscsi devstack@n-api.service[120740]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 13 18:12:53.976952 dv-cinder-852009-8-iscsi devstack@n-api.service[120740]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 13 18:12:53.976952 dv-cinder-852009-8-iscsi devstack@n-api.service[120740]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 13 18:12:53.976952 dv-cinder-852009-8-iscsi devstack@n-api.service[120740]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 13 18:12:53.976952 dv-cinder-852009-8-iscsi devstack@n-api.service[120740]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 13 18:12:53.978469 dv-cinder-852009-8-iscsi devstack@n-api.service[120740]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 13 18:12:53.978469 dv-cinder-852009-8-iscsi devstack@n-api.service[120740]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Sep 13 18:12:53.978469 dv-cinder-852009-8-iscsi devstack@n-api.service[120740]: ERROR nova.api.openstack.wsgi instance = self._get_server( Sep 13 18:12:53.978469 dv-cinder-852009-8-iscsi devstack@n-api.service[120740]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Sep 13 18:12:53.978469 dv-cinder-852009-8-iscsi devstack@n-api.service[120740]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Sep 13 18:12:53.978469 dv-cinder-852009-8-iscsi devstack@n-api.service[120740]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Sep 13 18:12:53.978469 dv-cinder-852009-8-iscsi devstack@n-api.service[120740]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Sep 13 18:12:53.978469 dv-cinder-852009-8-iscsi devstack@n-api.service[120740]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 1ad76e39-3a52-4014-8206-2b3863bce8b7 could not be found. Sep 13 18:12:53.978469 dv-cinder-852009-8-iscsi devstack@n-api.service[120740]: ERROR nova.api.openstack.wsgi Sep 13 18:12:53.978469 dv-cinder-852009-8-iscsi devstack@n-api.service[120740]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 13 18:12:53.978469 dv-cinder-852009-8-iscsi devstack@n-api.service[120740]: ERROR nova.api.openstack.wsgi Sep 13 18:12:53.978469 dv-cinder-852009-8-iscsi devstack@n-api.service[120740]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 13 18:12:53.978469 dv-cinder-852009-8-iscsi devstack@n-api.service[120740]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 13 18:12:53.978469 dv-cinder-852009-8-iscsi devstack@n-api.service[120740]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 13 18:12:53.978469 dv-cinder-852009-8-iscsi devstack@n-api.service[120740]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 13 18:12:53.978469 dv-cinder-852009-8-iscsi devstack@n-api.service[120740]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 13 18:12:53.978469 dv-cinder-852009-8-iscsi devstack@n-api.service[120740]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 1ad76e39-3a52-4014-8206-2b3863bce8b7 could not be found. Sep 13 18:12:53.978469 dv-cinder-852009-8-iscsi devstack@n-api.service[120740]: ERROR nova.api.openstack.wsgi Sep 13 18:12:53.979767 dv-cinder-852009-8-iscsi devstack@n-api.service[120740]: DEBUG nova.api.openstack.wsgi [None req-ea8030af-b3a7-48e5-91db-2e150edc3682 tempest-AttachVolumeNegativeTest-1378806597 tempest-AttachVolumeNegativeTest-1378806597-project] Returning 404 to user: Instance 1ad76e39-3a52-4014-8206-2b3863bce8b7 could not be found. {{(pid=120740) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 13 18:12:53.979767 dv-cinder-852009-8-iscsi devstack@n-api.service[120740]: INFO nova.api.openstack.requestlog [None req-ea8030af-b3a7-48e5-91db-2e150edc3682 tempest-AttachVolumeNegativeTest-1378806597 tempest-AttachVolumeNegativeTest-1378806597-project] 10.222.0.43 "GET /compute/v2.1/servers/1ad76e39-3a52-4014-8206-2b3863bce8b7" status: 404 len: 111 microversion: 2.1 time: 0.042691 Sep 13 18:12:53.979767 dv-cinder-852009-8-iscsi devstack@n-api.service[120740]: [pid: 120740|app: 0|req: 445/879] 10.222.0.43 () {58 vars in 1236 bytes} [Tue Sep 13 18:12:53 2022] GET /compute/v2.1/servers/1ad76e39-3a52-4014-8206-2b3863bce8b7 => generated 111 bytes in 44 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Sep 13 18:12:55.130918 dv-cinder-852009-8-iscsi devstack@n-api.service[120741]: DEBUG nova.api.openstack.wsgi [None req-f26339bf-0e0b-478b-af50-d323daa20596 tempest-AttachVolumeNegativeTest-1378806597 tempest-AttachVolumeNegativeTest-1378806597-project] Calling method '>' {{(pid=120741) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 18:12:55.131439 dv-cinder-852009-8-iscsi devstack@n-api.service[120741]: DEBUG nova.compute.api [None req-f26339bf-0e0b-478b-af50-d323daa20596 tempest-AttachVolumeNegativeTest-1378806597 tempest-AttachVolumeNegativeTest-1378806597-project] [instance: ed450488-2c80-4d82-8621-b55727628db1] Fetching instance by UUID {{(pid=120741) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 18:12:55.138370 dv-cinder-852009-8-iscsi devstack@n-api.service[120741]: DEBUG oslo_concurrency.lockutils [None req-f26339bf-0e0b-478b-af50-d323daa20596 tempest-AttachVolumeNegativeTest-1378806597 tempest-AttachVolumeNegativeTest-1378806597-project] Acquiring lock "1daf4f4c-0e4a-4779-b53a-78c48397ea2f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120741) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 18:12:55.138895 dv-cinder-852009-8-iscsi devstack@n-api.service[120741]: DEBUG oslo_concurrency.lockutils [None req-f26339bf-0e0b-478b-af50-d323daa20596 tempest-AttachVolumeNegativeTest-1378806597 tempest-AttachVolumeNegativeTest-1378806597-project] Lock "1daf4f4c-0e4a-4779-b53a-78c48397ea2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120741) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 18:12:55.139327 dv-cinder-852009-8-iscsi devstack@n-api.service[120741]: DEBUG oslo_concurrency.lockutils [None req-f26339bf-0e0b-478b-af50-d323daa20596 tempest-AttachVolumeNegativeTest-1378806597 tempest-AttachVolumeNegativeTest-1378806597-project] Lock "1daf4f4c-0e4a-4779-b53a-78c48397ea2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120741) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 18:12:55.140030 dv-cinder-852009-8-iscsi devstack@n-api.service[120741]: DEBUG oslo_concurrency.lockutils [None req-f26339bf-0e0b-478b-af50-d323daa20596 tempest-AttachVolumeNegativeTest-1378806597 tempest-AttachVolumeNegativeTest-1378806597-project] Acquiring lock "1daf4f4c-0e4a-4779-b53a-78c48397ea2f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120741) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 18:12:55.140522 dv-cinder-852009-8-iscsi devstack@n-api.service[120741]: DEBUG oslo_concurrency.lockutils [None req-f26339bf-0e0b-478b-af50-d323daa20596 tempest-AttachVolumeNegativeTest-1378806597 tempest-AttachVolumeNegativeTest-1378806597-project] Lock "1daf4f4c-0e4a-4779-b53a-78c48397ea2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120741) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 18:12:55.140947 dv-cinder-852009-8-iscsi devstack@n-api.service[120741]: DEBUG oslo_concurrency.lockutils [None req-f26339bf-0e0b-478b-af50-d323daa20596 tempest-AttachVolumeNegativeTest-1378806597 tempest-AttachVolumeNegativeTest-1378806597-project] Lock "1daf4f4c-0e4a-4779-b53a-78c48397ea2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120741) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 18:12:55.154605 dv-cinder-852009-8-iscsi devstack@n-api.service[120741]: INFO nova.api.openstack.wsgi [None req-f26339bf-0e0b-478b-af50-d323daa20596 tempest-AttachVolumeNegativeTest-1378806597 tempest-AttachVolumeNegativeTest-1378806597-project] HTTP exception thrown: Instance ed450488-2c80-4d82-8621-b55727628db1 could not be found. Sep 13 18:12:55.156252 dv-cinder-852009-8-iscsi devstack@n-api.service[120741]: DEBUG nova.api.openstack.wsgi [None req-f26339bf-0e0b-478b-af50-d323daa20596 tempest-AttachVolumeNegativeTest-1378806597 tempest-AttachVolumeNegativeTest-1378806597-project] Request method failure captured: Sep 13 18:12:55.156252 dv-cinder-852009-8-iscsi devstack@n-api.service[120741]: request: DELETE /compute/v2.1/servers/ed450488-2c80-4d82-8621-b55727628db1 HTTP/1.1 Sep 13 18:12:55.156252 dv-cinder-852009-8-iscsi devstack@n-api.service[120741]: Accept: application/json Sep 13 18:12:55.156252 dv-cinder-852009-8-iscsi devstack@n-api.service[120741]: Accept-Encoding: identity Sep 13 18:12:55.156252 dv-cinder-852009-8-iscsi devstack@n-api.service[120741]: Connection: close Sep 13 18:12:55.156252 dv-cinder-852009-8-iscsi devstack@n-api.service[120741]: Content-Length: 0 Sep 13 18:12:55.156252 dv-cinder-852009-8-iscsi devstack@n-api.service[120741]: Content-Type: application/json Sep 13 18:12:55.156252 dv-cinder-852009-8-iscsi devstack@n-api.service[120741]: Host: 10.222.0.43 Sep 13 18:12:55.156252 dv-cinder-852009-8-iscsi devstack@n-api.service[120741]: Openstack-System-Scope: None Sep 13 18:12:55.156252 dv-cinder-852009-8-iscsi devstack@n-api.service[120741]: User-Agent: python-urllib3/1.26.12 Sep 13 18:12:55.156252 dv-cinder-852009-8-iscsi devstack@n-api.service[120741]: X-Auth-Token: gAAAAABjIMciYi08KSU35iQHMuJ1d9BLU6OdnvTV0lQhD4NCYaw8no8S5_0xWB47N9lmu7akofQLpLV68heC7pPUCZsTXqIq6Y42WLp6VXHhyQNxgHSYkPKRLV6tG6CCOIlPDetRfNDVZw3BkXYviJ38fOivAdsSaqCGCQ-A5bO5QGkWPiqoF58 Sep 13 18:12:55.156252 dv-cinder-852009-8-iscsi devstack@n-api.service[120741]: X-Domain-Id: None Sep 13 18:12:55.156252 dv-cinder-852009-8-iscsi devstack@n-api.service[120741]: X-Domain-Name: None Sep 13 18:12:55.156252 dv-cinder-852009-8-iscsi devstack@n-api.service[120741]: X-Identity-Status: Confirmed Sep 13 18:12:55.156252 dv-cinder-852009-8-iscsi devstack@n-api.service[120741]: X-Is-Admin-Project: True Sep 13 18:12:55.156252 dv-cinder-852009-8-iscsi devstack@n-api.service[120741]: X-Project-Domain-Id: default Sep 13 18:12:55.156252 dv-cinder-852009-8-iscsi devstack@n-api.service[120741]: X-Project-Domain-Name: Default Sep 13 18:12:55.156252 dv-cinder-852009-8-iscsi devstack@n-api.service[120741]: X-Project-Id: 629311eda0584a5fbb7d8995cf27540c Sep 13 18:12:55.156252 dv-cinder-852009-8-iscsi devstack@n-api.service[120741]: X-Project-Name: tempest-AttachVolumeNegativeTest-1378806597 Sep 13 18:12:55.156252 dv-cinder-852009-8-iscsi devstack@n-api.service[120741]: X-Role: reader,member Sep 13 18:12:55.156252 dv-cinder-852009-8-iscsi devstack@n-api.service[120741]: X-Roles: reader,member Sep 13 18:12:55.157813 dv-cinder-852009-8-iscsi devstack@n-api.service[120741]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/identity"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/compute/v2/629311eda0584a5fbb7d8995cf27540c"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.43:8080", "publicURL": "http://10.222.0.43:8080/v1/AUTH_629311eda0584a5fbb7d8995cf27540c"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43:9696/networking"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/volume/v3/629311eda0584a5fbb7d8995cf27540c"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/compute/v2.1"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/placement"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/volume/v3/629311eda0584a5fbb7d8995cf27540c"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/image"}]}] Sep 13 18:12:55.157813 dv-cinder-852009-8-iscsi devstack@n-api.service[120741]: X-Tenant: tempest-AttachVolumeNegativeTest-1378806597 Sep 13 18:12:55.157813 dv-cinder-852009-8-iscsi devstack@n-api.service[120741]: X-Tenant-Id: 629311eda0584a5fbb7d8995cf27540c Sep 13 18:12:55.157813 dv-cinder-852009-8-iscsi devstack@n-api.service[120741]: X-Tenant-Name: tempest-AttachVolumeNegativeTest-1378806597 Sep 13 18:12:55.157813 dv-cinder-852009-8-iscsi devstack@n-api.service[120741]: X-User: tempest-AttachVolumeNegativeTest-1378806597-project Sep 13 18:12:55.157813 dv-cinder-852009-8-iscsi devstack@n-api.service[120741]: X-User-Domain-Id: default Sep 13 18:12:55.157813 dv-cinder-852009-8-iscsi devstack@n-api.service[120741]: X-User-Domain-Name: Default Sep 13 18:12:55.157813 dv-cinder-852009-8-iscsi devstack@n-api.service[120741]: X-User-Id: 714cd09ba19b492f9a8c80343abcf6b9 Sep 13 18:12:55.157813 dv-cinder-852009-8-iscsi devstack@n-api.service[120741]: X-User-Name: tempest-AttachVolumeNegativeTest-1378806597-project Sep 13 18:12:55.157813 dv-cinder-852009-8-iscsi devstack@n-api.service[120741]: method: > Sep 13 18:12:55.157813 dv-cinder-852009-8-iscsi devstack@n-api.service[120741]: exception: Instance ed450488-2c80-4d82-8621-b55727628db1 could not be found. Sep 13 18:12:55.157813 dv-cinder-852009-8-iscsi devstack@n-api.service[120741]: action_args: {'id': 'ed450488-2c80-4d82-8621-b55727628db1'} Sep 13 18:12:55.161627 dv-cinder-852009-8-iscsi devstack@n-api.service[120741]: {{(pid=120741) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 13 18:12:55.161627 dv-cinder-852009-8-iscsi devstack@n-api.service[120741]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 13 18:12:55.161627 dv-cinder-852009-8-iscsi devstack@n-api.service[120741]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Sep 13 18:12:55.161627 dv-cinder-852009-8-iscsi devstack@n-api.service[120741]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Sep 13 18:12:55.161627 dv-cinder-852009-8-iscsi devstack@n-api.service[120741]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Sep 13 18:12:55.161627 dv-cinder-852009-8-iscsi devstack@n-api.service[120741]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Sep 13 18:12:55.161627 dv-cinder-852009-8-iscsi devstack@n-api.service[120741]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Sep 13 18:12:55.161627 dv-cinder-852009-8-iscsi devstack@n-api.service[120741]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Sep 13 18:12:55.161627 dv-cinder-852009-8-iscsi devstack@n-api.service[120741]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Sep 13 18:12:55.161627 dv-cinder-852009-8-iscsi devstack@n-api.service[120741]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Sep 13 18:12:55.161627 dv-cinder-852009-8-iscsi devstack@n-api.service[120741]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance ed450488-2c80-4d82-8621-b55727628db1 could not be found. Sep 13 18:12:55.161627 dv-cinder-852009-8-iscsi devstack@n-api.service[120741]: ERROR nova.api.openstack.wsgi Sep 13 18:12:55.161627 dv-cinder-852009-8-iscsi devstack@n-api.service[120741]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 13 18:12:55.161627 dv-cinder-852009-8-iscsi devstack@n-api.service[120741]: ERROR nova.api.openstack.wsgi Sep 13 18:12:55.161627 dv-cinder-852009-8-iscsi devstack@n-api.service[120741]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 13 18:12:55.161627 dv-cinder-852009-8-iscsi devstack@n-api.service[120741]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 13 18:12:55.161627 dv-cinder-852009-8-iscsi devstack@n-api.service[120741]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 13 18:12:55.161627 dv-cinder-852009-8-iscsi devstack@n-api.service[120741]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 13 18:12:55.161627 dv-cinder-852009-8-iscsi devstack@n-api.service[120741]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 13 18:12:55.161627 dv-cinder-852009-8-iscsi devstack@n-api.service[120741]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 13 18:12:55.163123 dv-cinder-852009-8-iscsi devstack@n-api.service[120741]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 13 18:12:55.163123 dv-cinder-852009-8-iscsi devstack@n-api.service[120741]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete Sep 13 18:12:55.163123 dv-cinder-852009-8-iscsi devstack@n-api.service[120741]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) Sep 13 18:12:55.163123 dv-cinder-852009-8-iscsi devstack@n-api.service[120741]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete Sep 13 18:12:55.163123 dv-cinder-852009-8-iscsi devstack@n-api.service[120741]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) Sep 13 18:12:55.163123 dv-cinder-852009-8-iscsi devstack@n-api.service[120741]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Sep 13 18:12:55.163123 dv-cinder-852009-8-iscsi devstack@n-api.service[120741]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Sep 13 18:12:55.163123 dv-cinder-852009-8-iscsi devstack@n-api.service[120741]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Sep 13 18:12:55.163123 dv-cinder-852009-8-iscsi devstack@n-api.service[120741]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Sep 13 18:12:55.163123 dv-cinder-852009-8-iscsi devstack@n-api.service[120741]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance ed450488-2c80-4d82-8621-b55727628db1 could not be found. Sep 13 18:12:55.163123 dv-cinder-852009-8-iscsi devstack@n-api.service[120741]: ERROR nova.api.openstack.wsgi Sep 13 18:12:55.163123 dv-cinder-852009-8-iscsi devstack@n-api.service[120741]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 13 18:12:55.163123 dv-cinder-852009-8-iscsi devstack@n-api.service[120741]: ERROR nova.api.openstack.wsgi Sep 13 18:12:55.163123 dv-cinder-852009-8-iscsi devstack@n-api.service[120741]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 13 18:12:55.163123 dv-cinder-852009-8-iscsi devstack@n-api.service[120741]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 13 18:12:55.163123 dv-cinder-852009-8-iscsi devstack@n-api.service[120741]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 13 18:12:55.163123 dv-cinder-852009-8-iscsi devstack@n-api.service[120741]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 13 18:12:55.163123 dv-cinder-852009-8-iscsi devstack@n-api.service[120741]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 13 18:12:55.163123 dv-cinder-852009-8-iscsi devstack@n-api.service[120741]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance ed450488-2c80-4d82-8621-b55727628db1 could not be found. Sep 13 18:12:55.163123 dv-cinder-852009-8-iscsi devstack@n-api.service[120741]: ERROR nova.api.openstack.wsgi Sep 13 18:12:55.164603 dv-cinder-852009-8-iscsi devstack@n-api.service[120741]: DEBUG nova.api.openstack.wsgi [None req-f26339bf-0e0b-478b-af50-d323daa20596 tempest-AttachVolumeNegativeTest-1378806597 tempest-AttachVolumeNegativeTest-1378806597-project] Returning 404 to user: Instance ed450488-2c80-4d82-8621-b55727628db1 could not be found. {{(pid=120741) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 13 18:12:55.164603 dv-cinder-852009-8-iscsi devstack@n-api.service[120741]: INFO nova.api.openstack.requestlog [None req-f26339bf-0e0b-478b-af50-d323daa20596 tempest-AttachVolumeNegativeTest-1378806597 tempest-AttachVolumeNegativeTest-1378806597-project] 10.222.0.43 "DELETE /compute/v2.1/servers/ed450488-2c80-4d82-8621-b55727628db1" status: 404 len: 111 microversion: 2.1 time: 0.030661 Sep 13 18:12:55.164603 dv-cinder-852009-8-iscsi devstack@n-api.service[120741]: [pid: 120741|app: 0|req: 435/880] 10.222.0.43 () {58 vars in 1239 bytes} [Tue Sep 13 18:12:55 2022] DELETE /compute/v2.1/servers/ed450488-2c80-4d82-8621-b55727628db1 => generated 111 bytes in 32 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Sep 13 18:12:55.166171 dv-cinder-852009-8-iscsi devstack@n-api.service[120740]: DEBUG nova.api.openstack.wsgi [None req-2365dcb9-272a-4d5c-8030-497ed31163dd tempest-AttachVolumeNegativeTest-1378806597 tempest-AttachVolumeNegativeTest-1378806597-project] Calling method '>' {{(pid=120740) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 18:12:55.166776 dv-cinder-852009-8-iscsi devstack@n-api.service[120740]: DEBUG nova.compute.api [None req-2365dcb9-272a-4d5c-8030-497ed31163dd tempest-AttachVolumeNegativeTest-1378806597 tempest-AttachVolumeNegativeTest-1378806597-project] [instance: ed450488-2c80-4d82-8621-b55727628db1] Fetching instance by UUID {{(pid=120740) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 18:12:55.173437 dv-cinder-852009-8-iscsi devstack@n-api.service[120740]: DEBUG oslo_concurrency.lockutils [None req-2365dcb9-272a-4d5c-8030-497ed31163dd tempest-AttachVolumeNegativeTest-1378806597 tempest-AttachVolumeNegativeTest-1378806597-project] Acquiring lock "1daf4f4c-0e4a-4779-b53a-78c48397ea2f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120740) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 18:12:55.173911 dv-cinder-852009-8-iscsi devstack@n-api.service[120740]: DEBUG oslo_concurrency.lockutils [None req-2365dcb9-272a-4d5c-8030-497ed31163dd tempest-AttachVolumeNegativeTest-1378806597 tempest-AttachVolumeNegativeTest-1378806597-project] Lock "1daf4f4c-0e4a-4779-b53a-78c48397ea2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120740) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 18:12:55.174340 dv-cinder-852009-8-iscsi devstack@n-api.service[120740]: DEBUG oslo_concurrency.lockutils [None req-2365dcb9-272a-4d5c-8030-497ed31163dd tempest-AttachVolumeNegativeTest-1378806597 tempest-AttachVolumeNegativeTest-1378806597-project] Lock "1daf4f4c-0e4a-4779-b53a-78c48397ea2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120740) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 18:12:55.175076 dv-cinder-852009-8-iscsi devstack@n-api.service[120740]: DEBUG oslo_concurrency.lockutils [None req-2365dcb9-272a-4d5c-8030-497ed31163dd tempest-AttachVolumeNegativeTest-1378806597 tempest-AttachVolumeNegativeTest-1378806597-project] Acquiring lock "1daf4f4c-0e4a-4779-b53a-78c48397ea2f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120740) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 18:12:55.175536 dv-cinder-852009-8-iscsi devstack@n-api.service[120740]: DEBUG oslo_concurrency.lockutils [None req-2365dcb9-272a-4d5c-8030-497ed31163dd tempest-AttachVolumeNegativeTest-1378806597 tempest-AttachVolumeNegativeTest-1378806597-project] Lock "1daf4f4c-0e4a-4779-b53a-78c48397ea2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120740) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 18:12:55.175955 dv-cinder-852009-8-iscsi devstack@n-api.service[120740]: DEBUG oslo_concurrency.lockutils [None req-2365dcb9-272a-4d5c-8030-497ed31163dd tempest-AttachVolumeNegativeTest-1378806597 tempest-AttachVolumeNegativeTest-1378806597-project] Lock "1daf4f4c-0e4a-4779-b53a-78c48397ea2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120740) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 18:12:55.189420 dv-cinder-852009-8-iscsi devstack@n-api.service[120740]: INFO nova.api.openstack.wsgi [None req-2365dcb9-272a-4d5c-8030-497ed31163dd tempest-AttachVolumeNegativeTest-1378806597 tempest-AttachVolumeNegativeTest-1378806597-project] HTTP exception thrown: Instance ed450488-2c80-4d82-8621-b55727628db1 could not be found. Sep 13 18:12:55.190939 dv-cinder-852009-8-iscsi devstack@n-api.service[120740]: DEBUG nova.api.openstack.wsgi [None req-2365dcb9-272a-4d5c-8030-497ed31163dd tempest-AttachVolumeNegativeTest-1378806597 tempest-AttachVolumeNegativeTest-1378806597-project] Request method failure captured: Sep 13 18:12:55.190939 dv-cinder-852009-8-iscsi devstack@n-api.service[120740]: request: GET /compute/v2.1/servers/ed450488-2c80-4d82-8621-b55727628db1 HTTP/1.1 Sep 13 18:12:55.190939 dv-cinder-852009-8-iscsi devstack@n-api.service[120740]: Accept: application/json Sep 13 18:12:55.190939 dv-cinder-852009-8-iscsi devstack@n-api.service[120740]: Accept-Encoding: identity Sep 13 18:12:55.190939 dv-cinder-852009-8-iscsi devstack@n-api.service[120740]: Connection: close Sep 13 18:12:55.190939 dv-cinder-852009-8-iscsi devstack@n-api.service[120740]: Content-Length: 0 Sep 13 18:12:55.190939 dv-cinder-852009-8-iscsi devstack@n-api.service[120740]: Content-Type: application/json Sep 13 18:12:55.190939 dv-cinder-852009-8-iscsi devstack@n-api.service[120740]: Host: 10.222.0.43 Sep 13 18:12:55.190939 dv-cinder-852009-8-iscsi devstack@n-api.service[120740]: Openstack-System-Scope: None Sep 13 18:12:55.190939 dv-cinder-852009-8-iscsi devstack@n-api.service[120740]: User-Agent: python-urllib3/1.26.12 Sep 13 18:12:55.190939 dv-cinder-852009-8-iscsi devstack@n-api.service[120740]: X-Auth-Token: gAAAAABjIMciYi08KSU35iQHMuJ1d9BLU6OdnvTV0lQhD4NCYaw8no8S5_0xWB47N9lmu7akofQLpLV68heC7pPUCZsTXqIq6Y42WLp6VXHhyQNxgHSYkPKRLV6tG6CCOIlPDetRfNDVZw3BkXYviJ38fOivAdsSaqCGCQ-A5bO5QGkWPiqoF58 Sep 13 18:12:55.190939 dv-cinder-852009-8-iscsi devstack@n-api.service[120740]: X-Domain-Id: None Sep 13 18:12:55.190939 dv-cinder-852009-8-iscsi devstack@n-api.service[120740]: X-Domain-Name: None Sep 13 18:12:55.190939 dv-cinder-852009-8-iscsi devstack@n-api.service[120740]: X-Identity-Status: Confirmed Sep 13 18:12:55.190939 dv-cinder-852009-8-iscsi devstack@n-api.service[120740]: X-Is-Admin-Project: True Sep 13 18:12:55.190939 dv-cinder-852009-8-iscsi devstack@n-api.service[120740]: X-Project-Domain-Id: default Sep 13 18:12:55.190939 dv-cinder-852009-8-iscsi devstack@n-api.service[120740]: X-Project-Domain-Name: Default Sep 13 18:12:55.190939 dv-cinder-852009-8-iscsi devstack@n-api.service[120740]: X-Project-Id: 629311eda0584a5fbb7d8995cf27540c Sep 13 18:12:55.190939 dv-cinder-852009-8-iscsi devstack@n-api.service[120740]: X-Project-Name: tempest-AttachVolumeNegativeTest-1378806597 Sep 13 18:12:55.190939 dv-cinder-852009-8-iscsi devstack@n-api.service[120740]: X-Role: reader,member Sep 13 18:12:55.190939 dv-cinder-852009-8-iscsi devstack@n-api.service[120740]: X-Roles: reader,member Sep 13 18:12:55.192550 dv-cinder-852009-8-iscsi devstack@n-api.service[120740]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/identity"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/compute/v2/629311eda0584a5fbb7d8995cf27540c"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.43:8080", "publicURL": "http://10.222.0.43:8080/v1/AUTH_629311eda0584a5fbb7d8995cf27540c"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43:9696/networking"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/volume/v3/629311eda0584a5fbb7d8995cf27540c"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/compute/v2.1"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/placement"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/volume/v3/629311eda0584a5fbb7d8995cf27540c"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/image"}]}] Sep 13 18:12:55.192550 dv-cinder-852009-8-iscsi devstack@n-api.service[120740]: X-Tenant: tempest-AttachVolumeNegativeTest-1378806597 Sep 13 18:12:55.192550 dv-cinder-852009-8-iscsi devstack@n-api.service[120740]: X-Tenant-Id: 629311eda0584a5fbb7d8995cf27540c Sep 13 18:12:55.192550 dv-cinder-852009-8-iscsi devstack@n-api.service[120740]: X-Tenant-Name: tempest-AttachVolumeNegativeTest-1378806597 Sep 13 18:12:55.192550 dv-cinder-852009-8-iscsi devstack@n-api.service[120740]: X-User: tempest-AttachVolumeNegativeTest-1378806597-project Sep 13 18:12:55.192550 dv-cinder-852009-8-iscsi devstack@n-api.service[120740]: X-User-Domain-Id: default Sep 13 18:12:55.192550 dv-cinder-852009-8-iscsi devstack@n-api.service[120740]: X-User-Domain-Name: Default Sep 13 18:12:55.192550 dv-cinder-852009-8-iscsi devstack@n-api.service[120740]: X-User-Id: 714cd09ba19b492f9a8c80343abcf6b9 Sep 13 18:12:55.192550 dv-cinder-852009-8-iscsi devstack@n-api.service[120740]: X-User-Name: tempest-AttachVolumeNegativeTest-1378806597-project Sep 13 18:12:55.192550 dv-cinder-852009-8-iscsi devstack@n-api.service[120740]: method: > Sep 13 18:12:55.192550 dv-cinder-852009-8-iscsi devstack@n-api.service[120740]: exception: Instance ed450488-2c80-4d82-8621-b55727628db1 could not be found. Sep 13 18:12:55.192550 dv-cinder-852009-8-iscsi devstack@n-api.service[120740]: action_args: {'id': 'ed450488-2c80-4d82-8621-b55727628db1'} Sep 13 18:12:55.193585 dv-cinder-852009-8-iscsi devstack@n-api.service[120740]: {{(pid=120740) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 13 18:12:55.193585 dv-cinder-852009-8-iscsi devstack@n-api.service[120740]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 13 18:12:55.193585 dv-cinder-852009-8-iscsi devstack@n-api.service[120740]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Sep 13 18:12:55.193585 dv-cinder-852009-8-iscsi devstack@n-api.service[120740]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Sep 13 18:12:55.193585 dv-cinder-852009-8-iscsi devstack@n-api.service[120740]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Sep 13 18:12:55.193585 dv-cinder-852009-8-iscsi devstack@n-api.service[120740]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Sep 13 18:12:55.193585 dv-cinder-852009-8-iscsi devstack@n-api.service[120740]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Sep 13 18:12:55.193585 dv-cinder-852009-8-iscsi devstack@n-api.service[120740]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Sep 13 18:12:55.193585 dv-cinder-852009-8-iscsi devstack@n-api.service[120740]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Sep 13 18:12:55.193585 dv-cinder-852009-8-iscsi devstack@n-api.service[120740]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Sep 13 18:12:55.193585 dv-cinder-852009-8-iscsi devstack@n-api.service[120740]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance ed450488-2c80-4d82-8621-b55727628db1 could not be found. Sep 13 18:12:55.193585 dv-cinder-852009-8-iscsi devstack@n-api.service[120740]: ERROR nova.api.openstack.wsgi Sep 13 18:12:55.193585 dv-cinder-852009-8-iscsi devstack@n-api.service[120740]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 13 18:12:55.193585 dv-cinder-852009-8-iscsi devstack@n-api.service[120740]: ERROR nova.api.openstack.wsgi Sep 13 18:12:55.193585 dv-cinder-852009-8-iscsi devstack@n-api.service[120740]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 13 18:12:55.193585 dv-cinder-852009-8-iscsi devstack@n-api.service[120740]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 13 18:12:55.193585 dv-cinder-852009-8-iscsi devstack@n-api.service[120740]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 13 18:12:55.193585 dv-cinder-852009-8-iscsi devstack@n-api.service[120740]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 13 18:12:55.193585 dv-cinder-852009-8-iscsi devstack@n-api.service[120740]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 13 18:12:55.193585 dv-cinder-852009-8-iscsi devstack@n-api.service[120740]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 13 18:12:55.195072 dv-cinder-852009-8-iscsi devstack@n-api.service[120740]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 13 18:12:55.195072 dv-cinder-852009-8-iscsi devstack@n-api.service[120740]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Sep 13 18:12:55.195072 dv-cinder-852009-8-iscsi devstack@n-api.service[120740]: ERROR nova.api.openstack.wsgi instance = self._get_server( Sep 13 18:12:55.195072 dv-cinder-852009-8-iscsi devstack@n-api.service[120740]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Sep 13 18:12:55.195072 dv-cinder-852009-8-iscsi devstack@n-api.service[120740]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Sep 13 18:12:55.195072 dv-cinder-852009-8-iscsi devstack@n-api.service[120740]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Sep 13 18:12:55.195072 dv-cinder-852009-8-iscsi devstack@n-api.service[120740]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Sep 13 18:12:55.195072 dv-cinder-852009-8-iscsi devstack@n-api.service[120740]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance ed450488-2c80-4d82-8621-b55727628db1 could not be found. Sep 13 18:12:55.195072 dv-cinder-852009-8-iscsi devstack@n-api.service[120740]: ERROR nova.api.openstack.wsgi Sep 13 18:12:55.195072 dv-cinder-852009-8-iscsi devstack@n-api.service[120740]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 13 18:12:55.195072 dv-cinder-852009-8-iscsi devstack@n-api.service[120740]: ERROR nova.api.openstack.wsgi Sep 13 18:12:55.195072 dv-cinder-852009-8-iscsi devstack@n-api.service[120740]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 13 18:12:55.195072 dv-cinder-852009-8-iscsi devstack@n-api.service[120740]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 13 18:12:55.195072 dv-cinder-852009-8-iscsi devstack@n-api.service[120740]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 13 18:12:55.195072 dv-cinder-852009-8-iscsi devstack@n-api.service[120740]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 13 18:12:55.195072 dv-cinder-852009-8-iscsi devstack@n-api.service[120740]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 13 18:12:55.195072 dv-cinder-852009-8-iscsi devstack@n-api.service[120740]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance ed450488-2c80-4d82-8621-b55727628db1 could not be found. Sep 13 18:12:55.195072 dv-cinder-852009-8-iscsi devstack@n-api.service[120740]: ERROR nova.api.openstack.wsgi Sep 13 18:12:55.196467 dv-cinder-852009-8-iscsi devstack@n-api.service[120740]: DEBUG nova.api.openstack.wsgi [None req-2365dcb9-272a-4d5c-8030-497ed31163dd tempest-AttachVolumeNegativeTest-1378806597 tempest-AttachVolumeNegativeTest-1378806597-project] Returning 404 to user: Instance ed450488-2c80-4d82-8621-b55727628db1 could not be found. {{(pid=120740) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 13 18:12:55.196467 dv-cinder-852009-8-iscsi devstack@n-api.service[120740]: INFO nova.api.openstack.requestlog [None req-2365dcb9-272a-4d5c-8030-497ed31163dd tempest-AttachVolumeNegativeTest-1378806597 tempest-AttachVolumeNegativeTest-1378806597-project] 10.222.0.43 "GET /compute/v2.1/servers/ed450488-2c80-4d82-8621-b55727628db1" status: 404 len: 111 microversion: 2.1 time: 0.030020 Sep 13 18:12:55.196467 dv-cinder-852009-8-iscsi devstack@n-api.service[120740]: [pid: 120740|app: 0|req: 446/881] 10.222.0.43 () {58 vars in 1236 bytes} [Tue Sep 13 18:12:55 2022] GET /compute/v2.1/servers/ed450488-2c80-4d82-8621-b55727628db1 => generated 111 bytes in 31 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Sep 13 18:12:55.200886 dv-cinder-852009-8-iscsi devstack@n-api.service[120741]: DEBUG nova.api.openstack.wsgi [None req-bd2b8611-acff-4b91-836a-bbe8fe17507f tempest-AttachVolumeNegativeTest-1378806597 tempest-AttachVolumeNegativeTest-1378806597-project] Calling method '>' {{(pid=120741) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 18:12:55.201417 dv-cinder-852009-8-iscsi devstack@n-api.service[120741]: DEBUG nova.compute.api [None req-bd2b8611-acff-4b91-836a-bbe8fe17507f tempest-AttachVolumeNegativeTest-1378806597 tempest-AttachVolumeNegativeTest-1378806597-project] [instance: b6be21a8-a1fd-44ff-9fca-88e979974510] Fetching instance by UUID {{(pid=120741) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 18:12:55.207516 dv-cinder-852009-8-iscsi devstack@n-api.service[120741]: DEBUG oslo_concurrency.lockutils [None req-bd2b8611-acff-4b91-836a-bbe8fe17507f tempest-AttachVolumeNegativeTest-1378806597 tempest-AttachVolumeNegativeTest-1378806597-project] Acquiring lock "1daf4f4c-0e4a-4779-b53a-78c48397ea2f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120741) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 18:12:55.208005 dv-cinder-852009-8-iscsi devstack@n-api.service[120741]: DEBUG oslo_concurrency.lockutils [None req-bd2b8611-acff-4b91-836a-bbe8fe17507f tempest-AttachVolumeNegativeTest-1378806597 tempest-AttachVolumeNegativeTest-1378806597-project] Lock "1daf4f4c-0e4a-4779-b53a-78c48397ea2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120741) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 18:12:55.208470 dv-cinder-852009-8-iscsi devstack@n-api.service[120741]: DEBUG oslo_concurrency.lockutils [None req-bd2b8611-acff-4b91-836a-bbe8fe17507f tempest-AttachVolumeNegativeTest-1378806597 tempest-AttachVolumeNegativeTest-1378806597-project] Lock "1daf4f4c-0e4a-4779-b53a-78c48397ea2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120741) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 18:12:55.209152 dv-cinder-852009-8-iscsi devstack@n-api.service[120741]: DEBUG oslo_concurrency.lockutils [None req-bd2b8611-acff-4b91-836a-bbe8fe17507f tempest-AttachVolumeNegativeTest-1378806597 tempest-AttachVolumeNegativeTest-1378806597-project] Acquiring lock "1daf4f4c-0e4a-4779-b53a-78c48397ea2f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120741) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 18:12:55.209602 dv-cinder-852009-8-iscsi devstack@n-api.service[120741]: DEBUG oslo_concurrency.lockutils [None req-bd2b8611-acff-4b91-836a-bbe8fe17507f tempest-AttachVolumeNegativeTest-1378806597 tempest-AttachVolumeNegativeTest-1378806597-project] Lock "1daf4f4c-0e4a-4779-b53a-78c48397ea2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120741) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 18:12:55.210024 dv-cinder-852009-8-iscsi devstack@n-api.service[120741]: DEBUG oslo_concurrency.lockutils [None req-bd2b8611-acff-4b91-836a-bbe8fe17507f tempest-AttachVolumeNegativeTest-1378806597 tempest-AttachVolumeNegativeTest-1378806597-project] Lock "1daf4f4c-0e4a-4779-b53a-78c48397ea2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120741) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 18:12:55.223722 dv-cinder-852009-8-iscsi devstack@n-api.service[120741]: INFO nova.api.openstack.wsgi [None req-bd2b8611-acff-4b91-836a-bbe8fe17507f tempest-AttachVolumeNegativeTest-1378806597 tempest-AttachVolumeNegativeTest-1378806597-project] HTTP exception thrown: Instance b6be21a8-a1fd-44ff-9fca-88e979974510 could not be found. Sep 13 18:12:55.225327 dv-cinder-852009-8-iscsi devstack@n-api.service[120741]: DEBUG nova.api.openstack.wsgi [None req-bd2b8611-acff-4b91-836a-bbe8fe17507f tempest-AttachVolumeNegativeTest-1378806597 tempest-AttachVolumeNegativeTest-1378806597-project] Request method failure captured: Sep 13 18:12:55.225327 dv-cinder-852009-8-iscsi devstack@n-api.service[120741]: request: DELETE /compute/v2.1/servers/b6be21a8-a1fd-44ff-9fca-88e979974510 HTTP/1.1 Sep 13 18:12:55.225327 dv-cinder-852009-8-iscsi devstack@n-api.service[120741]: Accept: application/json Sep 13 18:12:55.225327 dv-cinder-852009-8-iscsi devstack@n-api.service[120741]: Accept-Encoding: identity Sep 13 18:12:55.225327 dv-cinder-852009-8-iscsi devstack@n-api.service[120741]: Connection: close Sep 13 18:12:55.225327 dv-cinder-852009-8-iscsi devstack@n-api.service[120741]: Content-Length: 0 Sep 13 18:12:55.225327 dv-cinder-852009-8-iscsi devstack@n-api.service[120741]: Content-Type: application/json Sep 13 18:12:55.225327 dv-cinder-852009-8-iscsi devstack@n-api.service[120741]: Host: 10.222.0.43 Sep 13 18:12:55.225327 dv-cinder-852009-8-iscsi devstack@n-api.service[120741]: Openstack-System-Scope: None Sep 13 18:12:55.225327 dv-cinder-852009-8-iscsi devstack@n-api.service[120741]: User-Agent: python-urllib3/1.26.12 Sep 13 18:12:55.225327 dv-cinder-852009-8-iscsi devstack@n-api.service[120741]: X-Auth-Token: gAAAAABjIMciYi08KSU35iQHMuJ1d9BLU6OdnvTV0lQhD4NCYaw8no8S5_0xWB47N9lmu7akofQLpLV68heC7pPUCZsTXqIq6Y42WLp6VXHhyQNxgHSYkPKRLV6tG6CCOIlPDetRfNDVZw3BkXYviJ38fOivAdsSaqCGCQ-A5bO5QGkWPiqoF58 Sep 13 18:12:55.225327 dv-cinder-852009-8-iscsi devstack@n-api.service[120741]: X-Domain-Id: None Sep 13 18:12:55.225327 dv-cinder-852009-8-iscsi devstack@n-api.service[120741]: X-Domain-Name: None Sep 13 18:12:55.225327 dv-cinder-852009-8-iscsi devstack@n-api.service[120741]: X-Identity-Status: Confirmed Sep 13 18:12:55.225327 dv-cinder-852009-8-iscsi devstack@n-api.service[120741]: X-Is-Admin-Project: True Sep 13 18:12:55.225327 dv-cinder-852009-8-iscsi devstack@n-api.service[120741]: X-Project-Domain-Id: default Sep 13 18:12:55.225327 dv-cinder-852009-8-iscsi devstack@n-api.service[120741]: X-Project-Domain-Name: Default Sep 13 18:12:55.225327 dv-cinder-852009-8-iscsi devstack@n-api.service[120741]: X-Project-Id: 629311eda0584a5fbb7d8995cf27540c Sep 13 18:12:55.225327 dv-cinder-852009-8-iscsi devstack@n-api.service[120741]: X-Project-Name: tempest-AttachVolumeNegativeTest-1378806597 Sep 13 18:12:55.225327 dv-cinder-852009-8-iscsi devstack@n-api.service[120741]: X-Role: reader,member Sep 13 18:12:55.225327 dv-cinder-852009-8-iscsi devstack@n-api.service[120741]: X-Roles: reader,member Sep 13 18:12:55.227011 dv-cinder-852009-8-iscsi devstack@n-api.service[120741]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/identity"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/compute/v2/629311eda0584a5fbb7d8995cf27540c"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.43:8080", "publicURL": "http://10.222.0.43:8080/v1/AUTH_629311eda0584a5fbb7d8995cf27540c"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43:9696/networking"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/volume/v3/629311eda0584a5fbb7d8995cf27540c"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/compute/v2.1"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/placement"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/volume/v3/629311eda0584a5fbb7d8995cf27540c"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/image"}]}] Sep 13 18:12:55.227011 dv-cinder-852009-8-iscsi devstack@n-api.service[120741]: X-Tenant: tempest-AttachVolumeNegativeTest-1378806597 Sep 13 18:12:55.227011 dv-cinder-852009-8-iscsi devstack@n-api.service[120741]: X-Tenant-Id: 629311eda0584a5fbb7d8995cf27540c Sep 13 18:12:55.227011 dv-cinder-852009-8-iscsi devstack@n-api.service[120741]: X-Tenant-Name: tempest-AttachVolumeNegativeTest-1378806597 Sep 13 18:12:55.227011 dv-cinder-852009-8-iscsi devstack@n-api.service[120741]: X-User: tempest-AttachVolumeNegativeTest-1378806597-project Sep 13 18:12:55.227011 dv-cinder-852009-8-iscsi devstack@n-api.service[120741]: X-User-Domain-Id: default Sep 13 18:12:55.227011 dv-cinder-852009-8-iscsi devstack@n-api.service[120741]: X-User-Domain-Name: Default Sep 13 18:12:55.227011 dv-cinder-852009-8-iscsi devstack@n-api.service[120741]: X-User-Id: 714cd09ba19b492f9a8c80343abcf6b9 Sep 13 18:12:55.227011 dv-cinder-852009-8-iscsi devstack@n-api.service[120741]: X-User-Name: tempest-AttachVolumeNegativeTest-1378806597-project Sep 13 18:12:55.227011 dv-cinder-852009-8-iscsi devstack@n-api.service[120741]: method: > Sep 13 18:12:55.227011 dv-cinder-852009-8-iscsi devstack@n-api.service[120741]: exception: Instance b6be21a8-a1fd-44ff-9fca-88e979974510 could not be found. Sep 13 18:12:55.227011 dv-cinder-852009-8-iscsi devstack@n-api.service[120741]: action_args: {'id': 'b6be21a8-a1fd-44ff-9fca-88e979974510'} Sep 13 18:12:55.228033 dv-cinder-852009-8-iscsi devstack@n-api.service[120741]: {{(pid=120741) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 13 18:12:55.228033 dv-cinder-852009-8-iscsi devstack@n-api.service[120741]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 13 18:12:55.228033 dv-cinder-852009-8-iscsi devstack@n-api.service[120741]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Sep 13 18:12:55.228033 dv-cinder-852009-8-iscsi devstack@n-api.service[120741]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Sep 13 18:12:55.228033 dv-cinder-852009-8-iscsi devstack@n-api.service[120741]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Sep 13 18:12:55.228033 dv-cinder-852009-8-iscsi devstack@n-api.service[120741]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Sep 13 18:12:55.228033 dv-cinder-852009-8-iscsi devstack@n-api.service[120741]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Sep 13 18:12:55.228033 dv-cinder-852009-8-iscsi devstack@n-api.service[120741]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Sep 13 18:12:55.228033 dv-cinder-852009-8-iscsi devstack@n-api.service[120741]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Sep 13 18:12:55.228033 dv-cinder-852009-8-iscsi devstack@n-api.service[120741]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Sep 13 18:12:55.228033 dv-cinder-852009-8-iscsi devstack@n-api.service[120741]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance b6be21a8-a1fd-44ff-9fca-88e979974510 could not be found. Sep 13 18:12:55.228033 dv-cinder-852009-8-iscsi devstack@n-api.service[120741]: ERROR nova.api.openstack.wsgi Sep 13 18:12:55.228033 dv-cinder-852009-8-iscsi devstack@n-api.service[120741]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 13 18:12:55.228033 dv-cinder-852009-8-iscsi devstack@n-api.service[120741]: ERROR nova.api.openstack.wsgi Sep 13 18:12:55.228033 dv-cinder-852009-8-iscsi devstack@n-api.service[120741]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 13 18:12:55.228033 dv-cinder-852009-8-iscsi devstack@n-api.service[120741]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 13 18:12:55.228033 dv-cinder-852009-8-iscsi devstack@n-api.service[120741]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 13 18:12:55.228033 dv-cinder-852009-8-iscsi devstack@n-api.service[120741]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 13 18:12:55.228033 dv-cinder-852009-8-iscsi devstack@n-api.service[120741]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 13 18:12:55.228033 dv-cinder-852009-8-iscsi devstack@n-api.service[120741]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 13 18:12:55.229382 dv-cinder-852009-8-iscsi devstack@n-api.service[120741]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 13 18:12:55.229382 dv-cinder-852009-8-iscsi devstack@n-api.service[120741]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete Sep 13 18:12:55.229382 dv-cinder-852009-8-iscsi devstack@n-api.service[120741]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) Sep 13 18:12:55.229382 dv-cinder-852009-8-iscsi devstack@n-api.service[120741]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete Sep 13 18:12:55.229382 dv-cinder-852009-8-iscsi devstack@n-api.service[120741]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) Sep 13 18:12:55.229382 dv-cinder-852009-8-iscsi devstack@n-api.service[120741]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Sep 13 18:12:55.229382 dv-cinder-852009-8-iscsi devstack@n-api.service[120741]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Sep 13 18:12:55.229382 dv-cinder-852009-8-iscsi devstack@n-api.service[120741]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Sep 13 18:12:55.229382 dv-cinder-852009-8-iscsi devstack@n-api.service[120741]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Sep 13 18:12:55.229382 dv-cinder-852009-8-iscsi devstack@n-api.service[120741]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance b6be21a8-a1fd-44ff-9fca-88e979974510 could not be found. Sep 13 18:12:55.229382 dv-cinder-852009-8-iscsi devstack@n-api.service[120741]: ERROR nova.api.openstack.wsgi Sep 13 18:12:55.229382 dv-cinder-852009-8-iscsi devstack@n-api.service[120741]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 13 18:12:55.229382 dv-cinder-852009-8-iscsi devstack@n-api.service[120741]: ERROR nova.api.openstack.wsgi Sep 13 18:12:55.229382 dv-cinder-852009-8-iscsi devstack@n-api.service[120741]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 13 18:12:55.229382 dv-cinder-852009-8-iscsi devstack@n-api.service[120741]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 13 18:12:55.229382 dv-cinder-852009-8-iscsi devstack@n-api.service[120741]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 13 18:12:55.229382 dv-cinder-852009-8-iscsi devstack@n-api.service[120741]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 13 18:12:55.229382 dv-cinder-852009-8-iscsi devstack@n-api.service[120741]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 13 18:12:55.229382 dv-cinder-852009-8-iscsi devstack@n-api.service[120741]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance b6be21a8-a1fd-44ff-9fca-88e979974510 could not be found. Sep 13 18:12:55.229382 dv-cinder-852009-8-iscsi devstack@n-api.service[120741]: ERROR nova.api.openstack.wsgi Sep 13 18:12:55.232582 dv-cinder-852009-8-iscsi devstack@n-api.service[120741]: DEBUG nova.api.openstack.wsgi [None req-bd2b8611-acff-4b91-836a-bbe8fe17507f tempest-AttachVolumeNegativeTest-1378806597 tempest-AttachVolumeNegativeTest-1378806597-project] Returning 404 to user: Instance b6be21a8-a1fd-44ff-9fca-88e979974510 could not be found. {{(pid=120741) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 13 18:12:55.232582 dv-cinder-852009-8-iscsi devstack@n-api.service[120741]: INFO nova.api.openstack.requestlog [None req-bd2b8611-acff-4b91-836a-bbe8fe17507f tempest-AttachVolumeNegativeTest-1378806597 tempest-AttachVolumeNegativeTest-1378806597-project] 10.222.0.43 "DELETE /compute/v2.1/servers/b6be21a8-a1fd-44ff-9fca-88e979974510" status: 404 len: 111 microversion: 2.1 time: 0.029818 Sep 13 18:12:55.232582 dv-cinder-852009-8-iscsi devstack@n-api.service[120741]: [pid: 120741|app: 0|req: 436/882] 10.222.0.43 () {58 vars in 1239 bytes} [Tue Sep 13 18:12:55 2022] DELETE /compute/v2.1/servers/b6be21a8-a1fd-44ff-9fca-88e979974510 => generated 111 bytes in 31 msecs (HTTP/1.1 404) 9 headers in 379 bytes (2 switches on core 0) Sep 13 18:12:55.235189 dv-cinder-852009-8-iscsi devstack@n-api.service[120740]: DEBUG nova.api.openstack.wsgi [None req-07623ec3-a680-4ce3-b162-42372d715d99 tempest-AttachVolumeNegativeTest-1378806597 tempest-AttachVolumeNegativeTest-1378806597-project] Calling method '>' {{(pid=120740) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 18:12:55.235842 dv-cinder-852009-8-iscsi devstack@n-api.service[120740]: DEBUG nova.compute.api [None req-07623ec3-a680-4ce3-b162-42372d715d99 tempest-AttachVolumeNegativeTest-1378806597 tempest-AttachVolumeNegativeTest-1378806597-project] [instance: b6be21a8-a1fd-44ff-9fca-88e979974510] Fetching instance by UUID {{(pid=120740) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 18:12:55.242014 dv-cinder-852009-8-iscsi devstack@n-api.service[120740]: DEBUG oslo_concurrency.lockutils [None req-07623ec3-a680-4ce3-b162-42372d715d99 tempest-AttachVolumeNegativeTest-1378806597 tempest-AttachVolumeNegativeTest-1378806597-project] Acquiring lock "1daf4f4c-0e4a-4779-b53a-78c48397ea2f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120740) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 18:12:55.242612 dv-cinder-852009-8-iscsi devstack@n-api.service[120740]: DEBUG oslo_concurrency.lockutils [None req-07623ec3-a680-4ce3-b162-42372d715d99 tempest-AttachVolumeNegativeTest-1378806597 tempest-AttachVolumeNegativeTest-1378806597-project] Lock "1daf4f4c-0e4a-4779-b53a-78c48397ea2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120740) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 18:12:55.243049 dv-cinder-852009-8-iscsi devstack@n-api.service[120740]: DEBUG oslo_concurrency.lockutils [None req-07623ec3-a680-4ce3-b162-42372d715d99 tempest-AttachVolumeNegativeTest-1378806597 tempest-AttachVolumeNegativeTest-1378806597-project] Lock "1daf4f4c-0e4a-4779-b53a-78c48397ea2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120740) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 18:12:55.243733 dv-cinder-852009-8-iscsi devstack@n-api.service[120740]: DEBUG oslo_concurrency.lockutils [None req-07623ec3-a680-4ce3-b162-42372d715d99 tempest-AttachVolumeNegativeTest-1378806597 tempest-AttachVolumeNegativeTest-1378806597-project] Acquiring lock "1daf4f4c-0e4a-4779-b53a-78c48397ea2f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120740) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 18:12:55.244190 dv-cinder-852009-8-iscsi devstack@n-api.service[120740]: DEBUG oslo_concurrency.lockutils [None req-07623ec3-a680-4ce3-b162-42372d715d99 tempest-AttachVolumeNegativeTest-1378806597 tempest-AttachVolumeNegativeTest-1378806597-project] Lock "1daf4f4c-0e4a-4779-b53a-78c48397ea2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120740) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 18:12:55.244645 dv-cinder-852009-8-iscsi devstack@n-api.service[120740]: DEBUG oslo_concurrency.lockutils [None req-07623ec3-a680-4ce3-b162-42372d715d99 tempest-AttachVolumeNegativeTest-1378806597 tempest-AttachVolumeNegativeTest-1378806597-project] Lock "1daf4f4c-0e4a-4779-b53a-78c48397ea2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120740) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 18:12:55.258408 dv-cinder-852009-8-iscsi devstack@n-api.service[120740]: INFO nova.api.openstack.wsgi [None req-07623ec3-a680-4ce3-b162-42372d715d99 tempest-AttachVolumeNegativeTest-1378806597 tempest-AttachVolumeNegativeTest-1378806597-project] HTTP exception thrown: Instance b6be21a8-a1fd-44ff-9fca-88e979974510 could not be found. Sep 13 18:12:55.259926 dv-cinder-852009-8-iscsi devstack@n-api.service[120740]: DEBUG nova.api.openstack.wsgi [None req-07623ec3-a680-4ce3-b162-42372d715d99 tempest-AttachVolumeNegativeTest-1378806597 tempest-AttachVolumeNegativeTest-1378806597-project] Request method failure captured: Sep 13 18:12:55.259926 dv-cinder-852009-8-iscsi devstack@n-api.service[120740]: request: GET /compute/v2.1/servers/b6be21a8-a1fd-44ff-9fca-88e979974510 HTTP/1.1 Sep 13 18:12:55.259926 dv-cinder-852009-8-iscsi devstack@n-api.service[120740]: Accept: application/json Sep 13 18:12:55.259926 dv-cinder-852009-8-iscsi devstack@n-api.service[120740]: Accept-Encoding: identity Sep 13 18:12:55.259926 dv-cinder-852009-8-iscsi devstack@n-api.service[120740]: Connection: close Sep 13 18:12:55.259926 dv-cinder-852009-8-iscsi devstack@n-api.service[120740]: Content-Length: 0 Sep 13 18:12:55.259926 dv-cinder-852009-8-iscsi devstack@n-api.service[120740]: Content-Type: application/json Sep 13 18:12:55.259926 dv-cinder-852009-8-iscsi devstack@n-api.service[120740]: Host: 10.222.0.43 Sep 13 18:12:55.259926 dv-cinder-852009-8-iscsi devstack@n-api.service[120740]: Openstack-System-Scope: None Sep 13 18:12:55.259926 dv-cinder-852009-8-iscsi devstack@n-api.service[120740]: User-Agent: python-urllib3/1.26.12 Sep 13 18:12:55.259926 dv-cinder-852009-8-iscsi devstack@n-api.service[120740]: X-Auth-Token: gAAAAABjIMciYi08KSU35iQHMuJ1d9BLU6OdnvTV0lQhD4NCYaw8no8S5_0xWB47N9lmu7akofQLpLV68heC7pPUCZsTXqIq6Y42WLp6VXHhyQNxgHSYkPKRLV6tG6CCOIlPDetRfNDVZw3BkXYviJ38fOivAdsSaqCGCQ-A5bO5QGkWPiqoF58 Sep 13 18:12:55.259926 dv-cinder-852009-8-iscsi devstack@n-api.service[120740]: X-Domain-Id: None Sep 13 18:12:55.259926 dv-cinder-852009-8-iscsi devstack@n-api.service[120740]: X-Domain-Name: None Sep 13 18:12:55.259926 dv-cinder-852009-8-iscsi devstack@n-api.service[120740]: X-Identity-Status: Confirmed Sep 13 18:12:55.259926 dv-cinder-852009-8-iscsi devstack@n-api.service[120740]: X-Is-Admin-Project: True Sep 13 18:12:55.259926 dv-cinder-852009-8-iscsi devstack@n-api.service[120740]: X-Project-Domain-Id: default Sep 13 18:12:55.259926 dv-cinder-852009-8-iscsi devstack@n-api.service[120740]: X-Project-Domain-Name: Default Sep 13 18:12:55.259926 dv-cinder-852009-8-iscsi devstack@n-api.service[120740]: X-Project-Id: 629311eda0584a5fbb7d8995cf27540c Sep 13 18:12:55.259926 dv-cinder-852009-8-iscsi devstack@n-api.service[120740]: X-Project-Name: tempest-AttachVolumeNegativeTest-1378806597 Sep 13 18:12:55.259926 dv-cinder-852009-8-iscsi devstack@n-api.service[120740]: X-Role: reader,member Sep 13 18:12:55.259926 dv-cinder-852009-8-iscsi devstack@n-api.service[120740]: X-Roles: reader,member Sep 13 18:12:55.263593 dv-cinder-852009-8-iscsi devstack@n-api.service[120740]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/identity"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/compute/v2/629311eda0584a5fbb7d8995cf27540c"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.43:8080", "publicURL": "http://10.222.0.43:8080/v1/AUTH_629311eda0584a5fbb7d8995cf27540c"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43:9696/networking"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/volume/v3/629311eda0584a5fbb7d8995cf27540c"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/compute/v2.1"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/placement"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/volume/v3/629311eda0584a5fbb7d8995cf27540c"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/image"}]}] Sep 13 18:12:55.263593 dv-cinder-852009-8-iscsi devstack@n-api.service[120740]: X-Tenant: tempest-AttachVolumeNegativeTest-1378806597 Sep 13 18:12:55.263593 dv-cinder-852009-8-iscsi devstack@n-api.service[120740]: X-Tenant-Id: 629311eda0584a5fbb7d8995cf27540c Sep 13 18:12:55.263593 dv-cinder-852009-8-iscsi devstack@n-api.service[120740]: X-Tenant-Name: tempest-AttachVolumeNegativeTest-1378806597 Sep 13 18:12:55.263593 dv-cinder-852009-8-iscsi devstack@n-api.service[120740]: X-User: tempest-AttachVolumeNegativeTest-1378806597-project Sep 13 18:12:55.263593 dv-cinder-852009-8-iscsi devstack@n-api.service[120740]: X-User-Domain-Id: default Sep 13 18:12:55.263593 dv-cinder-852009-8-iscsi devstack@n-api.service[120740]: X-User-Domain-Name: Default Sep 13 18:12:55.263593 dv-cinder-852009-8-iscsi devstack@n-api.service[120740]: X-User-Id: 714cd09ba19b492f9a8c80343abcf6b9 Sep 13 18:12:55.263593 dv-cinder-852009-8-iscsi devstack@n-api.service[120740]: X-User-Name: tempest-AttachVolumeNegativeTest-1378806597-project Sep 13 18:12:55.263593 dv-cinder-852009-8-iscsi devstack@n-api.service[120740]: method: > Sep 13 18:12:55.263593 dv-cinder-852009-8-iscsi devstack@n-api.service[120740]: exception: Instance b6be21a8-a1fd-44ff-9fca-88e979974510 could not be found. Sep 13 18:12:55.263593 dv-cinder-852009-8-iscsi devstack@n-api.service[120740]: action_args: {'id': 'b6be21a8-a1fd-44ff-9fca-88e979974510'} Sep 13 18:12:55.264530 dv-cinder-852009-8-iscsi devstack@n-api.service[120740]: {{(pid=120740) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 13 18:12:55.264530 dv-cinder-852009-8-iscsi devstack@n-api.service[120740]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 13 18:12:55.264530 dv-cinder-852009-8-iscsi devstack@n-api.service[120740]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Sep 13 18:12:55.264530 dv-cinder-852009-8-iscsi devstack@n-api.service[120740]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Sep 13 18:12:55.264530 dv-cinder-852009-8-iscsi devstack@n-api.service[120740]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Sep 13 18:12:55.264530 dv-cinder-852009-8-iscsi devstack@n-api.service[120740]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Sep 13 18:12:55.264530 dv-cinder-852009-8-iscsi devstack@n-api.service[120740]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Sep 13 18:12:55.264530 dv-cinder-852009-8-iscsi devstack@n-api.service[120740]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Sep 13 18:12:55.264530 dv-cinder-852009-8-iscsi devstack@n-api.service[120740]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Sep 13 18:12:55.264530 dv-cinder-852009-8-iscsi devstack@n-api.service[120740]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Sep 13 18:12:55.264530 dv-cinder-852009-8-iscsi devstack@n-api.service[120740]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance b6be21a8-a1fd-44ff-9fca-88e979974510 could not be found. Sep 13 18:12:55.264530 dv-cinder-852009-8-iscsi devstack@n-api.service[120740]: ERROR nova.api.openstack.wsgi Sep 13 18:12:55.264530 dv-cinder-852009-8-iscsi devstack@n-api.service[120740]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 13 18:12:55.264530 dv-cinder-852009-8-iscsi devstack@n-api.service[120740]: ERROR nova.api.openstack.wsgi Sep 13 18:12:55.264530 dv-cinder-852009-8-iscsi devstack@n-api.service[120740]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 13 18:12:55.264530 dv-cinder-852009-8-iscsi devstack@n-api.service[120740]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 13 18:12:55.264530 dv-cinder-852009-8-iscsi devstack@n-api.service[120740]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 13 18:12:55.264530 dv-cinder-852009-8-iscsi devstack@n-api.service[120740]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 13 18:12:55.264530 dv-cinder-852009-8-iscsi devstack@n-api.service[120740]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 13 18:12:55.264530 dv-cinder-852009-8-iscsi devstack@n-api.service[120740]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 13 18:12:55.266127 dv-cinder-852009-8-iscsi devstack@n-api.service[120740]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 13 18:12:55.266127 dv-cinder-852009-8-iscsi devstack@n-api.service[120740]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Sep 13 18:12:55.266127 dv-cinder-852009-8-iscsi devstack@n-api.service[120740]: ERROR nova.api.openstack.wsgi instance = self._get_server( Sep 13 18:12:55.266127 dv-cinder-852009-8-iscsi devstack@n-api.service[120740]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Sep 13 18:12:55.266127 dv-cinder-852009-8-iscsi devstack@n-api.service[120740]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Sep 13 18:12:55.266127 dv-cinder-852009-8-iscsi devstack@n-api.service[120740]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Sep 13 18:12:55.266127 dv-cinder-852009-8-iscsi devstack@n-api.service[120740]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Sep 13 18:12:55.266127 dv-cinder-852009-8-iscsi devstack@n-api.service[120740]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance b6be21a8-a1fd-44ff-9fca-88e979974510 could not be found. Sep 13 18:12:55.266127 dv-cinder-852009-8-iscsi devstack@n-api.service[120740]: ERROR nova.api.openstack.wsgi Sep 13 18:12:55.266127 dv-cinder-852009-8-iscsi devstack@n-api.service[120740]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 13 18:12:55.266127 dv-cinder-852009-8-iscsi devstack@n-api.service[120740]: ERROR nova.api.openstack.wsgi Sep 13 18:12:55.266127 dv-cinder-852009-8-iscsi devstack@n-api.service[120740]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 13 18:12:55.266127 dv-cinder-852009-8-iscsi devstack@n-api.service[120740]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 13 18:12:55.266127 dv-cinder-852009-8-iscsi devstack@n-api.service[120740]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 13 18:12:55.266127 dv-cinder-852009-8-iscsi devstack@n-api.service[120740]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 13 18:12:55.266127 dv-cinder-852009-8-iscsi devstack@n-api.service[120740]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 13 18:12:55.266127 dv-cinder-852009-8-iscsi devstack@n-api.service[120740]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance b6be21a8-a1fd-44ff-9fca-88e979974510 could not be found. Sep 13 18:12:55.266127 dv-cinder-852009-8-iscsi devstack@n-api.service[120740]: ERROR nova.api.openstack.wsgi Sep 13 18:12:55.267345 dv-cinder-852009-8-iscsi devstack@n-api.service[120740]: DEBUG nova.api.openstack.wsgi [None req-07623ec3-a680-4ce3-b162-42372d715d99 tempest-AttachVolumeNegativeTest-1378806597 tempest-AttachVolumeNegativeTest-1378806597-project] Returning 404 to user: Instance b6be21a8-a1fd-44ff-9fca-88e979974510 could not be found. {{(pid=120740) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 13 18:12:55.267345 dv-cinder-852009-8-iscsi devstack@n-api.service[120740]: INFO nova.api.openstack.requestlog [None req-07623ec3-a680-4ce3-b162-42372d715d99 tempest-AttachVolumeNegativeTest-1378806597 tempest-AttachVolumeNegativeTest-1378806597-project] 10.222.0.43 "GET /compute/v2.1/servers/b6be21a8-a1fd-44ff-9fca-88e979974510" status: 404 len: 111 microversion: 2.1 time: 0.030204 Sep 13 18:12:55.267345 dv-cinder-852009-8-iscsi devstack@n-api.service[120740]: [pid: 120740|app: 0|req: 447/883] 10.222.0.43 () {58 vars in 1236 bytes} [Tue Sep 13 18:12:55 2022] GET /compute/v2.1/servers/b6be21a8-a1fd-44ff-9fca-88e979974510 => generated 111 bytes in 31 msecs (HTTP/1.1 404) 9 headers in 379 bytes (2 switches on core 0) Sep 13 18:12:56.417472 dv-cinder-852009-8-iscsi devstack@n-api.service[120741]: DEBUG nova.api.openstack.wsgi [None req-d3800ca9-aadd-4611-b7c7-e9c6aa213101 tempest-AttachVolumeNegativeTest-1378806597 tempest-AttachVolumeNegativeTest-1378806597-project] Calling method '>' {{(pid=120741) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 18:12:56.418175 dv-cinder-852009-8-iscsi devstack@n-api.service[120741]: DEBUG nova.compute.api [None req-d3800ca9-aadd-4611-b7c7-e9c6aa213101 tempest-AttachVolumeNegativeTest-1378806597 tempest-AttachVolumeNegativeTest-1378806597-project] [instance: 75289327-97d1-42bd-a6c7-6f2b1aa3236a] Fetching instance by UUID {{(pid=120741) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 18:12:56.424924 dv-cinder-852009-8-iscsi devstack@n-api.service[120741]: DEBUG oslo_concurrency.lockutils [None req-d3800ca9-aadd-4611-b7c7-e9c6aa213101 tempest-AttachVolumeNegativeTest-1378806597 tempest-AttachVolumeNegativeTest-1378806597-project] Acquiring lock "1daf4f4c-0e4a-4779-b53a-78c48397ea2f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120741) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 18:12:56.425419 dv-cinder-852009-8-iscsi devstack@n-api.service[120741]: DEBUG oslo_concurrency.lockutils [None req-d3800ca9-aadd-4611-b7c7-e9c6aa213101 tempest-AttachVolumeNegativeTest-1378806597 tempest-AttachVolumeNegativeTest-1378806597-project] Lock "1daf4f4c-0e4a-4779-b53a-78c48397ea2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120741) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 18:12:56.425855 dv-cinder-852009-8-iscsi devstack@n-api.service[120741]: DEBUG oslo_concurrency.lockutils [None req-d3800ca9-aadd-4611-b7c7-e9c6aa213101 tempest-AttachVolumeNegativeTest-1378806597 tempest-AttachVolumeNegativeTest-1378806597-project] Lock "1daf4f4c-0e4a-4779-b53a-78c48397ea2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120741) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 18:12:56.426579 dv-cinder-852009-8-iscsi devstack@n-api.service[120741]: DEBUG oslo_concurrency.lockutils [None req-d3800ca9-aadd-4611-b7c7-e9c6aa213101 tempest-AttachVolumeNegativeTest-1378806597 tempest-AttachVolumeNegativeTest-1378806597-project] Acquiring lock "1daf4f4c-0e4a-4779-b53a-78c48397ea2f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120741) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 18:12:56.427035 dv-cinder-852009-8-iscsi devstack@n-api.service[120741]: DEBUG oslo_concurrency.lockutils [None req-d3800ca9-aadd-4611-b7c7-e9c6aa213101 tempest-AttachVolumeNegativeTest-1378806597 tempest-AttachVolumeNegativeTest-1378806597-project] Lock "1daf4f4c-0e4a-4779-b53a-78c48397ea2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120741) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 18:12:56.427459 dv-cinder-852009-8-iscsi devstack@n-api.service[120741]: DEBUG oslo_concurrency.lockutils [None req-d3800ca9-aadd-4611-b7c7-e9c6aa213101 tempest-AttachVolumeNegativeTest-1378806597 tempest-AttachVolumeNegativeTest-1378806597-project] Lock "1daf4f4c-0e4a-4779-b53a-78c48397ea2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120741) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 18:12:56.441337 dv-cinder-852009-8-iscsi devstack@n-api.service[120741]: INFO nova.api.openstack.wsgi [None req-d3800ca9-aadd-4611-b7c7-e9c6aa213101 tempest-AttachVolumeNegativeTest-1378806597 tempest-AttachVolumeNegativeTest-1378806597-project] HTTP exception thrown: Instance 75289327-97d1-42bd-a6c7-6f2b1aa3236a could not be found. Sep 13 18:12:56.442897 dv-cinder-852009-8-iscsi devstack@n-api.service[120741]: DEBUG nova.api.openstack.wsgi [None req-d3800ca9-aadd-4611-b7c7-e9c6aa213101 tempest-AttachVolumeNegativeTest-1378806597 tempest-AttachVolumeNegativeTest-1378806597-project] Request method failure captured: Sep 13 18:12:56.442897 dv-cinder-852009-8-iscsi devstack@n-api.service[120741]: request: DELETE /compute/v2.1/servers/75289327-97d1-42bd-a6c7-6f2b1aa3236a HTTP/1.1 Sep 13 18:12:56.442897 dv-cinder-852009-8-iscsi devstack@n-api.service[120741]: Accept: application/json Sep 13 18:12:56.442897 dv-cinder-852009-8-iscsi devstack@n-api.service[120741]: Accept-Encoding: identity Sep 13 18:12:56.442897 dv-cinder-852009-8-iscsi devstack@n-api.service[120741]: Connection: close Sep 13 18:12:56.442897 dv-cinder-852009-8-iscsi devstack@n-api.service[120741]: Content-Length: 0 Sep 13 18:12:56.442897 dv-cinder-852009-8-iscsi devstack@n-api.service[120741]: Content-Type: application/json Sep 13 18:12:56.442897 dv-cinder-852009-8-iscsi devstack@n-api.service[120741]: Host: 10.222.0.43 Sep 13 18:12:56.442897 dv-cinder-852009-8-iscsi devstack@n-api.service[120741]: Openstack-System-Scope: None Sep 13 18:12:56.442897 dv-cinder-852009-8-iscsi devstack@n-api.service[120741]: User-Agent: python-urllib3/1.26.12 Sep 13 18:12:56.442897 dv-cinder-852009-8-iscsi devstack@n-api.service[120741]: X-Auth-Token: gAAAAABjIMciYi08KSU35iQHMuJ1d9BLU6OdnvTV0lQhD4NCYaw8no8S5_0xWB47N9lmu7akofQLpLV68heC7pPUCZsTXqIq6Y42WLp6VXHhyQNxgHSYkPKRLV6tG6CCOIlPDetRfNDVZw3BkXYviJ38fOivAdsSaqCGCQ-A5bO5QGkWPiqoF58 Sep 13 18:12:56.442897 dv-cinder-852009-8-iscsi devstack@n-api.service[120741]: X-Domain-Id: None Sep 13 18:12:56.442897 dv-cinder-852009-8-iscsi devstack@n-api.service[120741]: X-Domain-Name: None Sep 13 18:12:56.442897 dv-cinder-852009-8-iscsi devstack@n-api.service[120741]: X-Identity-Status: Confirmed Sep 13 18:12:56.442897 dv-cinder-852009-8-iscsi devstack@n-api.service[120741]: X-Is-Admin-Project: True Sep 13 18:12:56.442897 dv-cinder-852009-8-iscsi devstack@n-api.service[120741]: X-Project-Domain-Id: default Sep 13 18:12:56.442897 dv-cinder-852009-8-iscsi devstack@n-api.service[120741]: X-Project-Domain-Name: Default Sep 13 18:12:56.442897 dv-cinder-852009-8-iscsi devstack@n-api.service[120741]: X-Project-Id: 629311eda0584a5fbb7d8995cf27540c Sep 13 18:12:56.442897 dv-cinder-852009-8-iscsi devstack@n-api.service[120741]: X-Project-Name: tempest-AttachVolumeNegativeTest-1378806597 Sep 13 18:12:56.442897 dv-cinder-852009-8-iscsi devstack@n-api.service[120741]: X-Role: reader,member Sep 13 18:12:56.442897 dv-cinder-852009-8-iscsi devstack@n-api.service[120741]: X-Roles: reader,member Sep 13 18:12:56.445003 dv-cinder-852009-8-iscsi devstack@n-api.service[120741]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/identity"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/compute/v2/629311eda0584a5fbb7d8995cf27540c"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.43:8080", "publicURL": "http://10.222.0.43:8080/v1/AUTH_629311eda0584a5fbb7d8995cf27540c"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43:9696/networking"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/volume/v3/629311eda0584a5fbb7d8995cf27540c"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/compute/v2.1"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/placement"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/volume/v3/629311eda0584a5fbb7d8995cf27540c"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/image"}]}] Sep 13 18:12:56.445003 dv-cinder-852009-8-iscsi devstack@n-api.service[120741]: X-Tenant: tempest-AttachVolumeNegativeTest-1378806597 Sep 13 18:12:56.445003 dv-cinder-852009-8-iscsi devstack@n-api.service[120741]: X-Tenant-Id: 629311eda0584a5fbb7d8995cf27540c Sep 13 18:12:56.445003 dv-cinder-852009-8-iscsi devstack@n-api.service[120741]: X-Tenant-Name: tempest-AttachVolumeNegativeTest-1378806597 Sep 13 18:12:56.445003 dv-cinder-852009-8-iscsi devstack@n-api.service[120741]: X-User: tempest-AttachVolumeNegativeTest-1378806597-project Sep 13 18:12:56.445003 dv-cinder-852009-8-iscsi devstack@n-api.service[120741]: X-User-Domain-Id: default Sep 13 18:12:56.445003 dv-cinder-852009-8-iscsi devstack@n-api.service[120741]: X-User-Domain-Name: Default Sep 13 18:12:56.445003 dv-cinder-852009-8-iscsi devstack@n-api.service[120741]: X-User-Id: 714cd09ba19b492f9a8c80343abcf6b9 Sep 13 18:12:56.445003 dv-cinder-852009-8-iscsi devstack@n-api.service[120741]: X-User-Name: tempest-AttachVolumeNegativeTest-1378806597-project Sep 13 18:12:56.445003 dv-cinder-852009-8-iscsi devstack@n-api.service[120741]: method: > Sep 13 18:12:56.445003 dv-cinder-852009-8-iscsi devstack@n-api.service[120741]: exception: Instance 75289327-97d1-42bd-a6c7-6f2b1aa3236a could not be found. Sep 13 18:12:56.445003 dv-cinder-852009-8-iscsi devstack@n-api.service[120741]: action_args: {'id': '75289327-97d1-42bd-a6c7-6f2b1aa3236a'} Sep 13 18:12:56.446257 dv-cinder-852009-8-iscsi devstack@n-api.service[120741]: {{(pid=120741) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 13 18:12:56.446257 dv-cinder-852009-8-iscsi devstack@n-api.service[120741]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 13 18:12:56.446257 dv-cinder-852009-8-iscsi devstack@n-api.service[120741]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Sep 13 18:12:56.446257 dv-cinder-852009-8-iscsi devstack@n-api.service[120741]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Sep 13 18:12:56.446257 dv-cinder-852009-8-iscsi devstack@n-api.service[120741]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Sep 13 18:12:56.446257 dv-cinder-852009-8-iscsi devstack@n-api.service[120741]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Sep 13 18:12:56.446257 dv-cinder-852009-8-iscsi devstack@n-api.service[120741]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Sep 13 18:12:56.446257 dv-cinder-852009-8-iscsi devstack@n-api.service[120741]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Sep 13 18:12:56.446257 dv-cinder-852009-8-iscsi devstack@n-api.service[120741]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Sep 13 18:12:56.446257 dv-cinder-852009-8-iscsi devstack@n-api.service[120741]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Sep 13 18:12:56.446257 dv-cinder-852009-8-iscsi devstack@n-api.service[120741]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 75289327-97d1-42bd-a6c7-6f2b1aa3236a could not be found. Sep 13 18:12:56.446257 dv-cinder-852009-8-iscsi devstack@n-api.service[120741]: ERROR nova.api.openstack.wsgi Sep 13 18:12:56.446257 dv-cinder-852009-8-iscsi devstack@n-api.service[120741]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 13 18:12:56.446257 dv-cinder-852009-8-iscsi devstack@n-api.service[120741]: ERROR nova.api.openstack.wsgi Sep 13 18:12:56.446257 dv-cinder-852009-8-iscsi devstack@n-api.service[120741]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 13 18:12:56.446257 dv-cinder-852009-8-iscsi devstack@n-api.service[120741]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 13 18:12:56.446257 dv-cinder-852009-8-iscsi devstack@n-api.service[120741]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 13 18:12:56.446257 dv-cinder-852009-8-iscsi devstack@n-api.service[120741]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 13 18:12:56.446257 dv-cinder-852009-8-iscsi devstack@n-api.service[120741]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 13 18:12:56.446257 dv-cinder-852009-8-iscsi devstack@n-api.service[120741]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 13 18:12:56.447721 dv-cinder-852009-8-iscsi devstack@n-api.service[120741]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 13 18:12:56.447721 dv-cinder-852009-8-iscsi devstack@n-api.service[120741]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete Sep 13 18:12:56.447721 dv-cinder-852009-8-iscsi devstack@n-api.service[120741]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) Sep 13 18:12:56.447721 dv-cinder-852009-8-iscsi devstack@n-api.service[120741]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete Sep 13 18:12:56.447721 dv-cinder-852009-8-iscsi devstack@n-api.service[120741]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) Sep 13 18:12:56.447721 dv-cinder-852009-8-iscsi devstack@n-api.service[120741]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Sep 13 18:12:56.447721 dv-cinder-852009-8-iscsi devstack@n-api.service[120741]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Sep 13 18:12:56.447721 dv-cinder-852009-8-iscsi devstack@n-api.service[120741]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Sep 13 18:12:56.447721 dv-cinder-852009-8-iscsi devstack@n-api.service[120741]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Sep 13 18:12:56.447721 dv-cinder-852009-8-iscsi devstack@n-api.service[120741]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 75289327-97d1-42bd-a6c7-6f2b1aa3236a could not be found. Sep 13 18:12:56.447721 dv-cinder-852009-8-iscsi devstack@n-api.service[120741]: ERROR nova.api.openstack.wsgi Sep 13 18:12:56.447721 dv-cinder-852009-8-iscsi devstack@n-api.service[120741]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 13 18:12:56.447721 dv-cinder-852009-8-iscsi devstack@n-api.service[120741]: ERROR nova.api.openstack.wsgi Sep 13 18:12:56.447721 dv-cinder-852009-8-iscsi devstack@n-api.service[120741]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 13 18:12:56.447721 dv-cinder-852009-8-iscsi devstack@n-api.service[120741]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 13 18:12:56.447721 dv-cinder-852009-8-iscsi devstack@n-api.service[120741]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 13 18:12:56.447721 dv-cinder-852009-8-iscsi devstack@n-api.service[120741]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 13 18:12:56.447721 dv-cinder-852009-8-iscsi devstack@n-api.service[120741]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 13 18:12:56.447721 dv-cinder-852009-8-iscsi devstack@n-api.service[120741]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 75289327-97d1-42bd-a6c7-6f2b1aa3236a could not be found. Sep 13 18:12:56.447721 dv-cinder-852009-8-iscsi devstack@n-api.service[120741]: ERROR nova.api.openstack.wsgi Sep 13 18:12:56.449568 dv-cinder-852009-8-iscsi devstack@n-api.service[120741]: DEBUG nova.api.openstack.wsgi [None req-d3800ca9-aadd-4611-b7c7-e9c6aa213101 tempest-AttachVolumeNegativeTest-1378806597 tempest-AttachVolumeNegativeTest-1378806597-project] Returning 404 to user: Instance 75289327-97d1-42bd-a6c7-6f2b1aa3236a could not be found. {{(pid=120741) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 13 18:12:56.449568 dv-cinder-852009-8-iscsi devstack@n-api.service[120741]: INFO nova.api.openstack.requestlog [None req-d3800ca9-aadd-4611-b7c7-e9c6aa213101 tempest-AttachVolumeNegativeTest-1378806597 tempest-AttachVolumeNegativeTest-1378806597-project] 10.222.0.43 "DELETE /compute/v2.1/servers/75289327-97d1-42bd-a6c7-6f2b1aa3236a" status: 404 len: 111 microversion: 2.1 time: 0.030941 Sep 13 18:12:56.449568 dv-cinder-852009-8-iscsi devstack@n-api.service[120741]: [pid: 120741|app: 0|req: 437/884] 10.222.0.43 () {58 vars in 1239 bytes} [Tue Sep 13 18:12:56 2022] DELETE /compute/v2.1/servers/75289327-97d1-42bd-a6c7-6f2b1aa3236a => generated 111 bytes in 32 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Sep 13 18:12:56.453237 dv-cinder-852009-8-iscsi devstack@n-api.service[120740]: DEBUG nova.api.openstack.wsgi [None req-0ff3d8d2-3ca5-4d0a-9966-71cbfdaa92a7 tempest-AttachVolumeNegativeTest-1378806597 tempest-AttachVolumeNegativeTest-1378806597-project] Calling method '>' {{(pid=120740) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 18:12:56.453842 dv-cinder-852009-8-iscsi devstack@n-api.service[120740]: DEBUG nova.compute.api [None req-0ff3d8d2-3ca5-4d0a-9966-71cbfdaa92a7 tempest-AttachVolumeNegativeTest-1378806597 tempest-AttachVolumeNegativeTest-1378806597-project] [instance: 75289327-97d1-42bd-a6c7-6f2b1aa3236a] Fetching instance by UUID {{(pid=120740) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 18:12:56.460372 dv-cinder-852009-8-iscsi devstack@n-api.service[120740]: DEBUG oslo_concurrency.lockutils [None req-0ff3d8d2-3ca5-4d0a-9966-71cbfdaa92a7 tempest-AttachVolumeNegativeTest-1378806597 tempest-AttachVolumeNegativeTest-1378806597-project] Acquiring lock "1daf4f4c-0e4a-4779-b53a-78c48397ea2f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120740) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 18:12:56.460907 dv-cinder-852009-8-iscsi devstack@n-api.service[120740]: DEBUG oslo_concurrency.lockutils [None req-0ff3d8d2-3ca5-4d0a-9966-71cbfdaa92a7 tempest-AttachVolumeNegativeTest-1378806597 tempest-AttachVolumeNegativeTest-1378806597-project] Lock "1daf4f4c-0e4a-4779-b53a-78c48397ea2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120740) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 18:12:56.461340 dv-cinder-852009-8-iscsi devstack@n-api.service[120740]: DEBUG oslo_concurrency.lockutils [None req-0ff3d8d2-3ca5-4d0a-9966-71cbfdaa92a7 tempest-AttachVolumeNegativeTest-1378806597 tempest-AttachVolumeNegativeTest-1378806597-project] Lock "1daf4f4c-0e4a-4779-b53a-78c48397ea2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120740) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 18:12:56.462105 dv-cinder-852009-8-iscsi devstack@n-api.service[120740]: DEBUG oslo_concurrency.lockutils [None req-0ff3d8d2-3ca5-4d0a-9966-71cbfdaa92a7 tempest-AttachVolumeNegativeTest-1378806597 tempest-AttachVolumeNegativeTest-1378806597-project] Acquiring lock "1daf4f4c-0e4a-4779-b53a-78c48397ea2f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120740) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 18:12:56.462562 dv-cinder-852009-8-iscsi devstack@n-api.service[120740]: DEBUG oslo_concurrency.lockutils [None req-0ff3d8d2-3ca5-4d0a-9966-71cbfdaa92a7 tempest-AttachVolumeNegativeTest-1378806597 tempest-AttachVolumeNegativeTest-1378806597-project] Lock "1daf4f4c-0e4a-4779-b53a-78c48397ea2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120740) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 18:12:56.462979 dv-cinder-852009-8-iscsi devstack@n-api.service[120740]: DEBUG oslo_concurrency.lockutils [None req-0ff3d8d2-3ca5-4d0a-9966-71cbfdaa92a7 tempest-AttachVolumeNegativeTest-1378806597 tempest-AttachVolumeNegativeTest-1378806597-project] Lock "1daf4f4c-0e4a-4779-b53a-78c48397ea2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120740) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 18:12:56.476649 dv-cinder-852009-8-iscsi devstack@n-api.service[120740]: INFO nova.api.openstack.wsgi [None req-0ff3d8d2-3ca5-4d0a-9966-71cbfdaa92a7 tempest-AttachVolumeNegativeTest-1378806597 tempest-AttachVolumeNegativeTest-1378806597-project] HTTP exception thrown: Instance 75289327-97d1-42bd-a6c7-6f2b1aa3236a could not be found. Sep 13 18:12:56.478324 dv-cinder-852009-8-iscsi devstack@n-api.service[120740]: DEBUG nova.api.openstack.wsgi [None req-0ff3d8d2-3ca5-4d0a-9966-71cbfdaa92a7 tempest-AttachVolumeNegativeTest-1378806597 tempest-AttachVolumeNegativeTest-1378806597-project] Request method failure captured: Sep 13 18:12:56.478324 dv-cinder-852009-8-iscsi devstack@n-api.service[120740]: request: GET /compute/v2.1/servers/75289327-97d1-42bd-a6c7-6f2b1aa3236a HTTP/1.1 Sep 13 18:12:56.478324 dv-cinder-852009-8-iscsi devstack@n-api.service[120740]: Accept: application/json Sep 13 18:12:56.478324 dv-cinder-852009-8-iscsi devstack@n-api.service[120740]: Accept-Encoding: identity Sep 13 18:12:56.478324 dv-cinder-852009-8-iscsi devstack@n-api.service[120740]: Connection: close Sep 13 18:12:56.478324 dv-cinder-852009-8-iscsi devstack@n-api.service[120740]: Content-Length: 0 Sep 13 18:12:56.478324 dv-cinder-852009-8-iscsi devstack@n-api.service[120740]: Content-Type: application/json Sep 13 18:12:56.478324 dv-cinder-852009-8-iscsi devstack@n-api.service[120740]: Host: 10.222.0.43 Sep 13 18:12:56.478324 dv-cinder-852009-8-iscsi devstack@n-api.service[120740]: Openstack-System-Scope: None Sep 13 18:12:56.478324 dv-cinder-852009-8-iscsi devstack@n-api.service[120740]: User-Agent: python-urllib3/1.26.12 Sep 13 18:12:56.478324 dv-cinder-852009-8-iscsi devstack@n-api.service[120740]: X-Auth-Token: gAAAAABjIMciYi08KSU35iQHMuJ1d9BLU6OdnvTV0lQhD4NCYaw8no8S5_0xWB47N9lmu7akofQLpLV68heC7pPUCZsTXqIq6Y42WLp6VXHhyQNxgHSYkPKRLV6tG6CCOIlPDetRfNDVZw3BkXYviJ38fOivAdsSaqCGCQ-A5bO5QGkWPiqoF58 Sep 13 18:12:56.478324 dv-cinder-852009-8-iscsi devstack@n-api.service[120740]: X-Domain-Id: None Sep 13 18:12:56.478324 dv-cinder-852009-8-iscsi devstack@n-api.service[120740]: X-Domain-Name: None Sep 13 18:12:56.478324 dv-cinder-852009-8-iscsi devstack@n-api.service[120740]: X-Identity-Status: Confirmed Sep 13 18:12:56.478324 dv-cinder-852009-8-iscsi devstack@n-api.service[120740]: X-Is-Admin-Project: True Sep 13 18:12:56.478324 dv-cinder-852009-8-iscsi devstack@n-api.service[120740]: X-Project-Domain-Id: default Sep 13 18:12:56.478324 dv-cinder-852009-8-iscsi devstack@n-api.service[120740]: X-Project-Domain-Name: Default Sep 13 18:12:56.478324 dv-cinder-852009-8-iscsi devstack@n-api.service[120740]: X-Project-Id: 629311eda0584a5fbb7d8995cf27540c Sep 13 18:12:56.478324 dv-cinder-852009-8-iscsi devstack@n-api.service[120740]: X-Project-Name: tempest-AttachVolumeNegativeTest-1378806597 Sep 13 18:12:56.478324 dv-cinder-852009-8-iscsi devstack@n-api.service[120740]: X-Role: reader,member Sep 13 18:12:56.478324 dv-cinder-852009-8-iscsi devstack@n-api.service[120740]: X-Roles: reader,member Sep 13 18:12:56.480719 dv-cinder-852009-8-iscsi devstack@n-api.service[120740]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/identity"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/compute/v2/629311eda0584a5fbb7d8995cf27540c"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.43:8080", "publicURL": "http://10.222.0.43:8080/v1/AUTH_629311eda0584a5fbb7d8995cf27540c"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43:9696/networking"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/volume/v3/629311eda0584a5fbb7d8995cf27540c"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/compute/v2.1"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/placement"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/volume/v3/629311eda0584a5fbb7d8995cf27540c"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/image"}]}] Sep 13 18:12:56.480719 dv-cinder-852009-8-iscsi devstack@n-api.service[120740]: X-Tenant: tempest-AttachVolumeNegativeTest-1378806597 Sep 13 18:12:56.480719 dv-cinder-852009-8-iscsi devstack@n-api.service[120740]: X-Tenant-Id: 629311eda0584a5fbb7d8995cf27540c Sep 13 18:12:56.480719 dv-cinder-852009-8-iscsi devstack@n-api.service[120740]: X-Tenant-Name: tempest-AttachVolumeNegativeTest-1378806597 Sep 13 18:12:56.480719 dv-cinder-852009-8-iscsi devstack@n-api.service[120740]: X-User: tempest-AttachVolumeNegativeTest-1378806597-project Sep 13 18:12:56.480719 dv-cinder-852009-8-iscsi devstack@n-api.service[120740]: X-User-Domain-Id: default Sep 13 18:12:56.480719 dv-cinder-852009-8-iscsi devstack@n-api.service[120740]: X-User-Domain-Name: Default Sep 13 18:12:56.480719 dv-cinder-852009-8-iscsi devstack@n-api.service[120740]: X-User-Id: 714cd09ba19b492f9a8c80343abcf6b9 Sep 13 18:12:56.480719 dv-cinder-852009-8-iscsi devstack@n-api.service[120740]: X-User-Name: tempest-AttachVolumeNegativeTest-1378806597-project Sep 13 18:12:56.480719 dv-cinder-852009-8-iscsi devstack@n-api.service[120740]: method: > Sep 13 18:12:56.480719 dv-cinder-852009-8-iscsi devstack@n-api.service[120740]: exception: Instance 75289327-97d1-42bd-a6c7-6f2b1aa3236a could not be found. Sep 13 18:12:56.480719 dv-cinder-852009-8-iscsi devstack@n-api.service[120740]: action_args: {'id': '75289327-97d1-42bd-a6c7-6f2b1aa3236a'} Sep 13 18:12:56.481709 dv-cinder-852009-8-iscsi devstack@n-api.service[120740]: {{(pid=120740) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 13 18:12:56.481709 dv-cinder-852009-8-iscsi devstack@n-api.service[120740]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 13 18:12:56.481709 dv-cinder-852009-8-iscsi devstack@n-api.service[120740]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Sep 13 18:12:56.481709 dv-cinder-852009-8-iscsi devstack@n-api.service[120740]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Sep 13 18:12:56.481709 dv-cinder-852009-8-iscsi devstack@n-api.service[120740]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Sep 13 18:12:56.481709 dv-cinder-852009-8-iscsi devstack@n-api.service[120740]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Sep 13 18:12:56.481709 dv-cinder-852009-8-iscsi devstack@n-api.service[120740]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Sep 13 18:12:56.481709 dv-cinder-852009-8-iscsi devstack@n-api.service[120740]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Sep 13 18:12:56.481709 dv-cinder-852009-8-iscsi devstack@n-api.service[120740]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Sep 13 18:12:56.481709 dv-cinder-852009-8-iscsi devstack@n-api.service[120740]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Sep 13 18:12:56.481709 dv-cinder-852009-8-iscsi devstack@n-api.service[120740]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 75289327-97d1-42bd-a6c7-6f2b1aa3236a could not be found. Sep 13 18:12:56.481709 dv-cinder-852009-8-iscsi devstack@n-api.service[120740]: ERROR nova.api.openstack.wsgi Sep 13 18:12:56.481709 dv-cinder-852009-8-iscsi devstack@n-api.service[120740]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 13 18:12:56.481709 dv-cinder-852009-8-iscsi devstack@n-api.service[120740]: ERROR nova.api.openstack.wsgi Sep 13 18:12:56.481709 dv-cinder-852009-8-iscsi devstack@n-api.service[120740]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 13 18:12:56.481709 dv-cinder-852009-8-iscsi devstack@n-api.service[120740]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 13 18:12:56.481709 dv-cinder-852009-8-iscsi devstack@n-api.service[120740]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 13 18:12:56.481709 dv-cinder-852009-8-iscsi devstack@n-api.service[120740]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 13 18:12:56.481709 dv-cinder-852009-8-iscsi devstack@n-api.service[120740]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 13 18:12:56.481709 dv-cinder-852009-8-iscsi devstack@n-api.service[120740]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 13 18:12:56.483179 dv-cinder-852009-8-iscsi devstack@n-api.service[120740]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 13 18:12:56.483179 dv-cinder-852009-8-iscsi devstack@n-api.service[120740]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Sep 13 18:12:56.483179 dv-cinder-852009-8-iscsi devstack@n-api.service[120740]: ERROR nova.api.openstack.wsgi instance = self._get_server( Sep 13 18:12:56.483179 dv-cinder-852009-8-iscsi devstack@n-api.service[120740]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Sep 13 18:12:56.483179 dv-cinder-852009-8-iscsi devstack@n-api.service[120740]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Sep 13 18:12:56.483179 dv-cinder-852009-8-iscsi devstack@n-api.service[120740]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Sep 13 18:12:56.483179 dv-cinder-852009-8-iscsi devstack@n-api.service[120740]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Sep 13 18:12:56.483179 dv-cinder-852009-8-iscsi devstack@n-api.service[120740]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 75289327-97d1-42bd-a6c7-6f2b1aa3236a could not be found. Sep 13 18:12:56.483179 dv-cinder-852009-8-iscsi devstack@n-api.service[120740]: ERROR nova.api.openstack.wsgi Sep 13 18:12:56.483179 dv-cinder-852009-8-iscsi devstack@n-api.service[120740]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 13 18:12:56.483179 dv-cinder-852009-8-iscsi devstack@n-api.service[120740]: ERROR nova.api.openstack.wsgi Sep 13 18:12:56.483179 dv-cinder-852009-8-iscsi devstack@n-api.service[120740]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 13 18:12:56.483179 dv-cinder-852009-8-iscsi devstack@n-api.service[120740]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 13 18:12:56.483179 dv-cinder-852009-8-iscsi devstack@n-api.service[120740]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 13 18:12:56.483179 dv-cinder-852009-8-iscsi devstack@n-api.service[120740]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 13 18:12:56.483179 dv-cinder-852009-8-iscsi devstack@n-api.service[120740]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 13 18:12:56.483179 dv-cinder-852009-8-iscsi devstack@n-api.service[120740]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 75289327-97d1-42bd-a6c7-6f2b1aa3236a could not be found. Sep 13 18:12:56.483179 dv-cinder-852009-8-iscsi devstack@n-api.service[120740]: ERROR nova.api.openstack.wsgi Sep 13 18:12:56.484750 dv-cinder-852009-8-iscsi devstack@n-api.service[120740]: DEBUG nova.api.openstack.wsgi [None req-0ff3d8d2-3ca5-4d0a-9966-71cbfdaa92a7 tempest-AttachVolumeNegativeTest-1378806597 tempest-AttachVolumeNegativeTest-1378806597-project] Returning 404 to user: Instance 75289327-97d1-42bd-a6c7-6f2b1aa3236a could not be found. {{(pid=120740) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 13 18:12:56.484750 dv-cinder-852009-8-iscsi devstack@n-api.service[120740]: INFO nova.api.openstack.requestlog [None req-0ff3d8d2-3ca5-4d0a-9966-71cbfdaa92a7 tempest-AttachVolumeNegativeTest-1378806597 tempest-AttachVolumeNegativeTest-1378806597-project] 10.222.0.43 "GET /compute/v2.1/servers/75289327-97d1-42bd-a6c7-6f2b1aa3236a" status: 404 len: 111 microversion: 2.1 time: 0.030328 Sep 13 18:12:56.484750 dv-cinder-852009-8-iscsi devstack@n-api.service[120740]: [pid: 120740|app: 0|req: 448/885] 10.222.0.43 () {58 vars in 1236 bytes} [Tue Sep 13 18:12:56 2022] GET /compute/v2.1/servers/75289327-97d1-42bd-a6c7-6f2b1aa3236a => generated 111 bytes in 31 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Sep 13 18:13:00.970972 dv-cinder-852009-8-iscsi devstack@n-api.service[120741]: DEBUG nova.api.openstack.wsgi [None req-24723661-b00d-4a59-8826-f574d07a8cd9 tempest-VolumesGetTestJSON-752884331 tempest-VolumesGetTestJSON-752884331-project] Action: 'create', calling method: .version_select at 0x7fa6268f99d0>, body: {"volume": {"size": 1, "display_name": "tempest-VolumesGetTestJSON-Volume-560997492", "metadata": {"Type": "work"}}} {{(pid=120741) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 13 18:13:01.271042 dv-cinder-852009-8-iscsi devstack@n-api.service[120741]: INFO nova.api.openstack.requestlog [None req-24723661-b00d-4a59-8826-f574d07a8cd9 tempest-VolumesGetTestJSON-752884331 tempest-VolumesGetTestJSON-752884331-project] 10.222.0.43 "POST /compute/v2.1/os-volumes" status: 200 len: 352 microversion: 2.1 time: 0.418405 Sep 13 18:13:01.271770 dv-cinder-852009-8-iscsi devstack@n-api.service[120741]: [pid: 120741|app: 0|req: 438/886] 10.222.0.43 () {60 vars in 1156 bytes} [Tue Sep 13 18:13:00 2022] POST /compute/v2.1/os-volumes => generated 352 bytes in 420 msecs (HTTP/1.1 200) 10 headers in 448 bytes (1 switches on core 0) Sep 13 18:13:01.286690 dv-cinder-852009-8-iscsi devstack@n-api.service[120740]: DEBUG nova.api.openstack.wsgi [None req-38582dba-92e4-4a79-8fad-386bc14ac321 tempest-VolumesGetTestJSON-752884331 tempest-VolumesGetTestJSON-752884331-project] Calling method '.version_select at 0x7fa626aec280>' {{(pid=120740) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 18:13:01.335648 dv-cinder-852009-8-iscsi devstack@n-api.service[120740]: INFO nova.api.openstack.requestlog [None req-38582dba-92e4-4a79-8fad-386bc14ac321 tempest-VolumesGetTestJSON-752884331 tempest-VolumesGetTestJSON-752884331-project] 10.222.0.43 "GET /compute/v2.1/os-volumes/f80cb2a7-87a0-4e4f-af3b-d379ba2f7d4c" status: 200 len: 352 microversion: 2.1 time: 0.052641 Sep 13 18:13:01.336297 dv-cinder-852009-8-iscsi devstack@n-api.service[120740]: [pid: 120740|app: 0|req: 449/887] 10.222.0.43 () {58 vars in 1245 bytes} [Tue Sep 13 18:13:01 2022] GET /compute/v2.1/os-volumes/f80cb2a7-87a0-4e4f-af3b-d379ba2f7d4c => generated 352 bytes in 54 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 13 18:13:02.355290 dv-cinder-852009-8-iscsi devstack@n-api.service[120741]: DEBUG nova.api.openstack.wsgi [None req-b7d0a395-9461-46d9-b0c7-bd5bf01c98cb tempest-VolumesGetTestJSON-752884331 tempest-VolumesGetTestJSON-752884331-project] Calling method '.version_select at 0x7fa626ccfaf0>' {{(pid=120741) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 18:13:02.407072 dv-cinder-852009-8-iscsi devstack@n-api.service[120741]: INFO nova.api.openstack.requestlog [None req-b7d0a395-9461-46d9-b0c7-bd5bf01c98cb tempest-VolumesGetTestJSON-752884331 tempest-VolumesGetTestJSON-752884331-project] 10.222.0.43 "GET /compute/v2.1/os-volumes/f80cb2a7-87a0-4e4f-af3b-d379ba2f7d4c" status: 200 len: 353 microversion: 2.1 time: 0.056742 Sep 13 18:13:02.407646 dv-cinder-852009-8-iscsi devstack@n-api.service[120741]: [pid: 120741|app: 0|req: 439/888] 10.222.0.43 () {58 vars in 1245 bytes} [Tue Sep 13 18:13:02 2022] GET /compute/v2.1/os-volumes/f80cb2a7-87a0-4e4f-af3b-d379ba2f7d4c => generated 353 bytes in 58 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 13 18:13:02.421446 dv-cinder-852009-8-iscsi devstack@n-api.service[120740]: DEBUG nova.api.openstack.wsgi [None req-b651cf31-b9e2-4b4a-8690-975793f8d328 tempest-VolumesGetTestJSON-752884331 tempest-VolumesGetTestJSON-752884331-project] Calling method '.version_select at 0x7fa626c51430>' {{(pid=120740) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 18:13:02.467643 dv-cinder-852009-8-iscsi devstack@n-api.service[120740]: INFO nova.api.openstack.requestlog [None req-b651cf31-b9e2-4b4a-8690-975793f8d328 tempest-VolumesGetTestJSON-752884331 tempest-VolumesGetTestJSON-752884331-project] 10.222.0.43 "GET /compute/v2.1/os-volumes/f80cb2a7-87a0-4e4f-af3b-d379ba2f7d4c" status: 200 len: 353 microversion: 2.1 time: 0.050500 Sep 13 18:13:02.468200 dv-cinder-852009-8-iscsi devstack@n-api.service[120740]: [pid: 120740|app: 0|req: 450/889] 10.222.0.43 () {58 vars in 1245 bytes} [Tue Sep 13 18:13:02 2022] GET /compute/v2.1/os-volumes/f80cb2a7-87a0-4e4f-af3b-d379ba2f7d4c => generated 353 bytes in 52 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 13 18:13:02.481848 dv-cinder-852009-8-iscsi devstack@n-api.service[120741]: DEBUG nova.api.openstack.wsgi [None req-78949034-b74c-47c0-84a1-aeb827894cd4 tempest-VolumesGetTestJSON-752884331 tempest-VolumesGetTestJSON-752884331-project] Calling method '.version_select at 0x7fa626b904c0>' {{(pid=120741) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 18:13:02.548040 dv-cinder-852009-8-iscsi devstack@n-api.service[120741]: INFO nova.api.openstack.requestlog [None req-78949034-b74c-47c0-84a1-aeb827894cd4 tempest-VolumesGetTestJSON-752884331 tempest-VolumesGetTestJSON-752884331-project] 10.222.0.43 "DELETE /compute/v2.1/os-volumes/f80cb2a7-87a0-4e4f-af3b-d379ba2f7d4c" status: 202 len: 0 microversion: 2.1 time: 0.069704 Sep 13 18:13:02.548686 dv-cinder-852009-8-iscsi devstack@n-api.service[120741]: [pid: 120741|app: 0|req: 440/890] 10.222.0.43 () {58 vars in 1248 bytes} [Tue Sep 13 18:13:02 2022] DELETE /compute/v2.1/os-volumes/f80cb2a7-87a0-4e4f-af3b-d379ba2f7d4c => generated 0 bytes in 71 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Sep 13 18:13:02.559286 dv-cinder-852009-8-iscsi devstack@n-api.service[120740]: DEBUG nova.api.openstack.wsgi [None req-1fc7ace2-19b7-46d0-ba47-c5b8f234492b tempest-VolumesGetTestJSON-752884331 tempest-VolumesGetTestJSON-752884331-project] Calling method '.version_select at 0x7fa626c51e50>' {{(pid=120740) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 18:13:02.607728 dv-cinder-852009-8-iscsi devstack@n-api.service[120740]: INFO nova.api.openstack.requestlog [None req-1fc7ace2-19b7-46d0-ba47-c5b8f234492b tempest-VolumesGetTestJSON-752884331 tempest-VolumesGetTestJSON-752884331-project] 10.222.0.43 "GET /compute/v2.1/os-volumes/f80cb2a7-87a0-4e4f-af3b-d379ba2f7d4c" status: 200 len: 352 microversion: 2.1 time: 0.053364 Sep 13 18:13:02.608304 dv-cinder-852009-8-iscsi devstack@n-api.service[120740]: [pid: 120740|app: 0|req: 451/891] 10.222.0.43 () {58 vars in 1245 bytes} [Tue Sep 13 18:13:02 2022] GET /compute/v2.1/os-volumes/f80cb2a7-87a0-4e4f-af3b-d379ba2f7d4c => generated 352 bytes in 55 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 13 18:13:03.627637 dv-cinder-852009-8-iscsi devstack@n-api.service[120741]: DEBUG nova.api.openstack.wsgi [None req-579d5d9b-fe56-4c18-887b-51c8812ddb06 tempest-VolumesGetTestJSON-752884331 tempest-VolumesGetTestJSON-752884331-project] Calling method '.version_select at 0x7fa6268f9550>' {{(pid=120741) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 18:13:03.658941 dv-cinder-852009-8-iscsi devstack@n-api.service[120741]: INFO nova.api.openstack.wsgi [None req-579d5d9b-fe56-4c18-887b-51c8812ddb06 tempest-VolumesGetTestJSON-752884331 tempest-VolumesGetTestJSON-752884331-project] HTTP exception thrown: Volume f80cb2a7-87a0-4e4f-af3b-d379ba2f7d4c could not be found. Sep 13 18:13:03.660914 dv-cinder-852009-8-iscsi devstack@n-api.service[120741]: DEBUG nova.api.openstack.wsgi [None req-579d5d9b-fe56-4c18-887b-51c8812ddb06 tempest-VolumesGetTestJSON-752884331 tempest-VolumesGetTestJSON-752884331-project] Request method failure captured: Sep 13 18:13:03.660914 dv-cinder-852009-8-iscsi devstack@n-api.service[120741]: request: GET /compute/v2.1/os-volumes/f80cb2a7-87a0-4e4f-af3b-d379ba2f7d4c HTTP/1.1 Sep 13 18:13:03.660914 dv-cinder-852009-8-iscsi devstack@n-api.service[120741]: Accept: application/json Sep 13 18:13:03.660914 dv-cinder-852009-8-iscsi devstack@n-api.service[120741]: Accept-Encoding: identity Sep 13 18:13:03.660914 dv-cinder-852009-8-iscsi devstack@n-api.service[120741]: Connection: close Sep 13 18:13:03.660914 dv-cinder-852009-8-iscsi devstack@n-api.service[120741]: Content-Length: 0 Sep 13 18:13:03.660914 dv-cinder-852009-8-iscsi devstack@n-api.service[120741]: Content-Type: application/json Sep 13 18:13:03.660914 dv-cinder-852009-8-iscsi devstack@n-api.service[120741]: Host: 10.222.0.43 Sep 13 18:13:03.660914 dv-cinder-852009-8-iscsi devstack@n-api.service[120741]: Openstack-System-Scope: None Sep 13 18:13:03.660914 dv-cinder-852009-8-iscsi devstack@n-api.service[120741]: User-Agent: python-urllib3/1.26.12 Sep 13 18:13:03.660914 dv-cinder-852009-8-iscsi devstack@n-api.service[120741]: X-Auth-Token: gAAAAABjIMgsBZ6edxWhU9hv4x2Pwf-hVMXjrgwk11eu-GSDbborvBBnFm0joRmOasRIQEjnElE-C1j2a6ITbxh1Az_tPeW30SDKpIU1s2--Ox8V5aG5gr_1aOU1d5wfAxVtwMALRNRmyhXaCwTJ-GLTDUTRwtVTZGRWe9Gh6VQiEVqVQb6yusY Sep 13 18:13:03.660914 dv-cinder-852009-8-iscsi devstack@n-api.service[120741]: X-Domain-Id: None Sep 13 18:13:03.660914 dv-cinder-852009-8-iscsi devstack@n-api.service[120741]: X-Domain-Name: None Sep 13 18:13:03.660914 dv-cinder-852009-8-iscsi devstack@n-api.service[120741]: X-Identity-Status: Confirmed Sep 13 18:13:03.660914 dv-cinder-852009-8-iscsi devstack@n-api.service[120741]: X-Is-Admin-Project: True Sep 13 18:13:03.660914 dv-cinder-852009-8-iscsi devstack@n-api.service[120741]: X-Project-Domain-Id: default Sep 13 18:13:03.660914 dv-cinder-852009-8-iscsi devstack@n-api.service[120741]: X-Project-Domain-Name: Default Sep 13 18:13:03.660914 dv-cinder-852009-8-iscsi devstack@n-api.service[120741]: X-Project-Id: e6ef3304f1ff453aa1df84c39c5e1010 Sep 13 18:13:03.660914 dv-cinder-852009-8-iscsi devstack@n-api.service[120741]: X-Project-Name: tempest-VolumesGetTestJSON-752884331 Sep 13 18:13:03.660914 dv-cinder-852009-8-iscsi devstack@n-api.service[120741]: X-Role: reader,member Sep 13 18:13:03.660914 dv-cinder-852009-8-iscsi devstack@n-api.service[120741]: X-Roles: reader,member Sep 13 18:13:03.662494 dv-cinder-852009-8-iscsi devstack@n-api.service[120741]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/identity"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/compute/v2/e6ef3304f1ff453aa1df84c39c5e1010"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.43:8080", "publicURL": "http://10.222.0.43:8080/v1/AUTH_e6ef3304f1ff453aa1df84c39c5e1010"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43:9696/networking"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/volume/v3/e6ef3304f1ff453aa1df84c39c5e1010"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/compute/v2.1"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/placement"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/volume/v3/e6ef3304f1ff453aa1df84c39c5e1010"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/image"}]}] Sep 13 18:13:03.662494 dv-cinder-852009-8-iscsi devstack@n-api.service[120741]: X-Tenant: tempest-VolumesGetTestJSON-752884331 Sep 13 18:13:03.662494 dv-cinder-852009-8-iscsi devstack@n-api.service[120741]: X-Tenant-Id: e6ef3304f1ff453aa1df84c39c5e1010 Sep 13 18:13:03.662494 dv-cinder-852009-8-iscsi devstack@n-api.service[120741]: X-Tenant-Name: tempest-VolumesGetTestJSON-752884331 Sep 13 18:13:03.662494 dv-cinder-852009-8-iscsi devstack@n-api.service[120741]: X-User: tempest-VolumesGetTestJSON-752884331-project Sep 13 18:13:03.662494 dv-cinder-852009-8-iscsi devstack@n-api.service[120741]: X-User-Domain-Id: default Sep 13 18:13:03.662494 dv-cinder-852009-8-iscsi devstack@n-api.service[120741]: X-User-Domain-Name: Default Sep 13 18:13:03.662494 dv-cinder-852009-8-iscsi devstack@n-api.service[120741]: X-User-Id: b5f55ee333d2469b9a24061793b528b7 Sep 13 18:13:03.662494 dv-cinder-852009-8-iscsi devstack@n-api.service[120741]: X-User-Name: tempest-VolumesGetTestJSON-752884331-project Sep 13 18:13:03.662494 dv-cinder-852009-8-iscsi devstack@n-api.service[120741]: method: Sep 13 18:13:03.662494 dv-cinder-852009-8-iscsi devstack@n-api.service[120741]: exception: Volume f80cb2a7-87a0-4e4f-af3b-d379ba2f7d4c could not be found. Sep 13 18:13:03.662494 dv-cinder-852009-8-iscsi devstack@n-api.service[120741]: action_args: {'id': 'f80cb2a7-87a0-4e4f-af3b-d379ba2f7d4c'} Sep 13 18:13:03.662494 dv-cinder-852009-8-iscsi devstack@n-api.service[120741]: {{(pid=120741) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 13 18:13:03.663420 dv-cinder-852009-8-iscsi devstack@n-api.service[120741]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 13 18:13:03.663420 dv-cinder-852009-8-iscsi devstack@n-api.service[120741]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 433, in wrapper Sep 13 18:13:03.663420 dv-cinder-852009-8-iscsi devstack@n-api.service[120741]: ERROR nova.api.openstack.wsgi res = method(self, ctx, volume_id, *args, **kwargs) Sep 13 18:13:03.663420 dv-cinder-852009-8-iscsi devstack@n-api.service[120741]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 502, in get Sep 13 18:13:03.663420 dv-cinder-852009-8-iscsi devstack@n-api.service[120741]: ERROR nova.api.openstack.wsgi item = cinderclient( Sep 13 18:13:03.663420 dv-cinder-852009-8-iscsi devstack@n-api.service[120741]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volumes_base.py", line 202, in get Sep 13 18:13:03.663420 dv-cinder-852009-8-iscsi devstack@n-api.service[120741]: ERROR nova.api.openstack.wsgi return self._get("/volumes/%s" % volume_id, "volume") Sep 13 18:13:03.663420 dv-cinder-852009-8-iscsi devstack@n-api.service[120741]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/base.py", line 297, in _get Sep 13 18:13:03.663420 dv-cinder-852009-8-iscsi devstack@n-api.service[120741]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.get(url) Sep 13 18:13:03.663420 dv-cinder-852009-8-iscsi devstack@n-api.service[120741]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 224, in get Sep 13 18:13:03.663420 dv-cinder-852009-8-iscsi devstack@n-api.service[120741]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'GET', **kwargs) Sep 13 18:13:03.663420 dv-cinder-852009-8-iscsi devstack@n-api.service[120741]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 215, in _cs_request Sep 13 18:13:03.663420 dv-cinder-852009-8-iscsi devstack@n-api.service[120741]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) Sep 13 18:13:03.663420 dv-cinder-852009-8-iscsi devstack@n-api.service[120741]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 201, in request Sep 13 18:13:03.663420 dv-cinder-852009-8-iscsi devstack@n-api.service[120741]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) Sep 13 18:13:03.663420 dv-cinder-852009-8-iscsi devstack@n-api.service[120741]: ERROR nova.api.openstack.wsgi cinderclient.exceptions.NotFound: Volume f80cb2a7-87a0-4e4f-af3b-d379ba2f7d4c could not be found. (HTTP 404) (Request-ID: req-cd1a27df-e6d2-49b2-8754-ff9591704b05) Sep 13 18:13:03.663420 dv-cinder-852009-8-iscsi devstack@n-api.service[120741]: ERROR nova.api.openstack.wsgi Sep 13 18:13:03.663420 dv-cinder-852009-8-iscsi devstack@n-api.service[120741]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 13 18:13:03.663420 dv-cinder-852009-8-iscsi devstack@n-api.service[120741]: ERROR nova.api.openstack.wsgi Sep 13 18:13:03.664815 dv-cinder-852009-8-iscsi devstack@n-api.service[120741]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 13 18:13:03.664815 dv-cinder-852009-8-iscsi devstack@n-api.service[120741]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 120, in show Sep 13 18:13:03.664815 dv-cinder-852009-8-iscsi devstack@n-api.service[120741]: ERROR nova.api.openstack.wsgi vol = self.volume_api.get(context, id) Sep 13 18:13:03.664815 dv-cinder-852009-8-iscsi devstack@n-api.service[120741]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 395, in wrapper Sep 13 18:13:03.664815 dv-cinder-852009-8-iscsi devstack@n-api.service[120741]: ERROR nova.api.openstack.wsgi res = method(self, ctx, *args, **kwargs) Sep 13 18:13:03.664815 dv-cinder-852009-8-iscsi devstack@n-api.service[120741]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 435, in wrapper Sep 13 18:13:03.664815 dv-cinder-852009-8-iscsi devstack@n-api.service[120741]: ERROR nova.api.openstack.wsgi _reraise(exception.VolumeNotFound(volume_id=volume_id)) Sep 13 18:13:03.664815 dv-cinder-852009-8-iscsi devstack@n-api.service[120741]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 486, in _reraise Sep 13 18:13:03.664815 dv-cinder-852009-8-iscsi devstack@n-api.service[120741]: ERROR nova.api.openstack.wsgi raise desired_exc.with_traceback(sys.exc_info()[2]) Sep 13 18:13:03.664815 dv-cinder-852009-8-iscsi devstack@n-api.service[120741]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 433, in wrapper Sep 13 18:13:03.664815 dv-cinder-852009-8-iscsi devstack@n-api.service[120741]: ERROR nova.api.openstack.wsgi res = method(self, ctx, volume_id, *args, **kwargs) Sep 13 18:13:03.664815 dv-cinder-852009-8-iscsi devstack@n-api.service[120741]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 502, in get Sep 13 18:13:03.664815 dv-cinder-852009-8-iscsi devstack@n-api.service[120741]: ERROR nova.api.openstack.wsgi item = cinderclient( Sep 13 18:13:03.664815 dv-cinder-852009-8-iscsi devstack@n-api.service[120741]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volumes_base.py", line 202, in get Sep 13 18:13:03.664815 dv-cinder-852009-8-iscsi devstack@n-api.service[120741]: ERROR nova.api.openstack.wsgi return self._get("/volumes/%s" % volume_id, "volume") Sep 13 18:13:03.664815 dv-cinder-852009-8-iscsi devstack@n-api.service[120741]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/base.py", line 297, in _get Sep 13 18:13:03.664815 dv-cinder-852009-8-iscsi devstack@n-api.service[120741]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.get(url) Sep 13 18:13:03.664815 dv-cinder-852009-8-iscsi devstack@n-api.service[120741]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 224, in get Sep 13 18:13:03.664815 dv-cinder-852009-8-iscsi devstack@n-api.service[120741]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'GET', **kwargs) Sep 13 18:13:03.666662 dv-cinder-852009-8-iscsi devstack@n-api.service[120741]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 215, in _cs_request Sep 13 18:13:03.666662 dv-cinder-852009-8-iscsi devstack@n-api.service[120741]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) Sep 13 18:13:03.666662 dv-cinder-852009-8-iscsi devstack@n-api.service[120741]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 201, in request Sep 13 18:13:03.666662 dv-cinder-852009-8-iscsi devstack@n-api.service[120741]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) Sep 13 18:13:03.666662 dv-cinder-852009-8-iscsi devstack@n-api.service[120741]: ERROR nova.api.openstack.wsgi nova.exception.VolumeNotFound: Volume f80cb2a7-87a0-4e4f-af3b-d379ba2f7d4c could not be found. Sep 13 18:13:03.666662 dv-cinder-852009-8-iscsi devstack@n-api.service[120741]: ERROR nova.api.openstack.wsgi Sep 13 18:13:03.666662 dv-cinder-852009-8-iscsi devstack@n-api.service[120741]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 13 18:13:03.666662 dv-cinder-852009-8-iscsi devstack@n-api.service[120741]: ERROR nova.api.openstack.wsgi Sep 13 18:13:03.666662 dv-cinder-852009-8-iscsi devstack@n-api.service[120741]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 13 18:13:03.666662 dv-cinder-852009-8-iscsi devstack@n-api.service[120741]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 13 18:13:03.666662 dv-cinder-852009-8-iscsi devstack@n-api.service[120741]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 13 18:13:03.666662 dv-cinder-852009-8-iscsi devstack@n-api.service[120741]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 13 18:13:03.666662 dv-cinder-852009-8-iscsi devstack@n-api.service[120741]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 13 18:13:03.666662 dv-cinder-852009-8-iscsi devstack@n-api.service[120741]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Sep 13 18:13:03.666662 dv-cinder-852009-8-iscsi devstack@n-api.service[120741]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Sep 13 18:13:03.666662 dv-cinder-852009-8-iscsi devstack@n-api.service[120741]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 13 18:13:03.666662 dv-cinder-852009-8-iscsi devstack@n-api.service[120741]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 13 18:13:03.666662 dv-cinder-852009-8-iscsi devstack@n-api.service[120741]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 122, in show Sep 13 18:13:03.666662 dv-cinder-852009-8-iscsi devstack@n-api.service[120741]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Sep 13 18:13:03.668209 dv-cinder-852009-8-iscsi devstack@n-api.service[120741]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Volume f80cb2a7-87a0-4e4f-af3b-d379ba2f7d4c could not be found. Sep 13 18:13:03.668209 dv-cinder-852009-8-iscsi devstack@n-api.service[120741]: ERROR nova.api.openstack.wsgi Sep 13 18:13:03.668209 dv-cinder-852009-8-iscsi devstack@n-api.service[120741]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 13 18:13:03.668209 dv-cinder-852009-8-iscsi devstack@n-api.service[120741]: ERROR nova.api.openstack.wsgi Sep 13 18:13:03.668209 dv-cinder-852009-8-iscsi devstack@n-api.service[120741]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 13 18:13:03.668209 dv-cinder-852009-8-iscsi devstack@n-api.service[120741]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 13 18:13:03.668209 dv-cinder-852009-8-iscsi devstack@n-api.service[120741]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 13 18:13:03.668209 dv-cinder-852009-8-iscsi devstack@n-api.service[120741]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 13 18:13:03.668209 dv-cinder-852009-8-iscsi devstack@n-api.service[120741]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 13 18:13:03.668209 dv-cinder-852009-8-iscsi devstack@n-api.service[120741]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Volume f80cb2a7-87a0-4e4f-af3b-d379ba2f7d4c could not be found. Sep 13 18:13:03.668209 dv-cinder-852009-8-iscsi devstack@n-api.service[120741]: ERROR nova.api.openstack.wsgi Sep 13 18:13:03.668209 dv-cinder-852009-8-iscsi devstack@n-api.service[120741]: DEBUG nova.api.openstack.wsgi [None req-579d5d9b-fe56-4c18-887b-51c8812ddb06 tempest-VolumesGetTestJSON-752884331 tempest-VolumesGetTestJSON-752884331-project] Returning 404 to user: Volume f80cb2a7-87a0-4e4f-af3b-d379ba2f7d4c could not be found. {{(pid=120741) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 13 18:13:03.668209 dv-cinder-852009-8-iscsi devstack@n-api.service[120741]: INFO nova.api.openstack.requestlog [None req-579d5d9b-fe56-4c18-887b-51c8812ddb06 tempest-VolumesGetTestJSON-752884331 tempest-VolumesGetTestJSON-752884331-project] 10.222.0.43 "GET /compute/v2.1/os-volumes/f80cb2a7-87a0-4e4f-af3b-d379ba2f7d4c" status: 404 len: 109 microversion: 2.1 time: 0.042359 Sep 13 18:13:03.668209 dv-cinder-852009-8-iscsi devstack@n-api.service[120741]: [pid: 120741|app: 0|req: 441/892] 10.222.0.43 () {58 vars in 1245 bytes} [Tue Sep 13 18:13:03 2022] GET /compute/v2.1/os-volumes/f80cb2a7-87a0-4e4f-af3b-d379ba2f7d4c => generated 109 bytes in 44 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Sep 13 18:13:05.082502 dv-cinder-852009-8-iscsi devstack@n-api.service[120740]: DEBUG nova.api.openstack.wsgi [None req-e14dfc59-1bcb-4cf5-b257-771870cadedc tempest-VolumesNegativeTest-384994634 tempest-VolumesNegativeTest-384994634-project] Action: 'create', calling method: .version_select at 0x7fa626aec3a0>, body: {"volume": {"size": "#$%", "display_name": "tempest-VolumesNegativeTest-Volume-1539444257", "metadata": {"Type": "work"}}} {{(pid=120740) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 13 18:13:05.093523 dv-cinder-852009-8-iscsi devstack@n-api.service[120740]: DEBUG nova.api.openstack.wsgi [None req-e14dfc59-1bcb-4cf5-b257-771870cadedc tempest-VolumesNegativeTest-384994634 tempest-VolumesNegativeTest-384994634-project] Request method failure captured: Sep 13 18:13:05.093523 dv-cinder-852009-8-iscsi devstack@n-api.service[120740]: request: POST /compute/v2.1/os-volumes HTTP/1.1 Sep 13 18:13:05.093523 dv-cinder-852009-8-iscsi devstack@n-api.service[120740]: Accept: application/json Sep 13 18:13:05.093523 dv-cinder-852009-8-iscsi devstack@n-api.service[120740]: Accept-Encoding: identity Sep 13 18:13:05.093523 dv-cinder-852009-8-iscsi devstack@n-api.service[120740]: Connection: close Sep 13 18:13:05.093523 dv-cinder-852009-8-iscsi devstack@n-api.service[120740]: Content-Length: 122 Sep 13 18:13:05.093523 dv-cinder-852009-8-iscsi devstack@n-api.service[120740]: Content-Type: application/json Sep 13 18:13:05.093523 dv-cinder-852009-8-iscsi devstack@n-api.service[120740]: Host: 10.222.0.43 Sep 13 18:13:05.093523 dv-cinder-852009-8-iscsi devstack@n-api.service[120740]: Openstack-System-Scope: None Sep 13 18:13:05.093523 dv-cinder-852009-8-iscsi devstack@n-api.service[120740]: User-Agent: python-urllib3/1.26.12 Sep 13 18:13:05.093523 dv-cinder-852009-8-iscsi devstack@n-api.service[120740]: X-Auth-Token: gAAAAABjIMgweRYnpuHzgvWkcVyub5FUO9Yxm0fxKMQz6U9NAYkKeIm5OPrFLcxFBwgaPtdf4niuRLTX5nzMKSFVmvaBMDt8ejSTeWN3FPR9zXAo0VV5h--ojT3_qzTIH1pT7IS_xB5tC_YEgICZs2ROQsrqSnLizicxDVG2IUbZf3LsYhUJ3PQ Sep 13 18:13:05.093523 dv-cinder-852009-8-iscsi devstack@n-api.service[120740]: X-Domain-Id: None Sep 13 18:13:05.093523 dv-cinder-852009-8-iscsi devstack@n-api.service[120740]: X-Domain-Name: None Sep 13 18:13:05.093523 dv-cinder-852009-8-iscsi devstack@n-api.service[120740]: X-Identity-Status: Confirmed Sep 13 18:13:05.093523 dv-cinder-852009-8-iscsi devstack@n-api.service[120740]: X-Is-Admin-Project: True Sep 13 18:13:05.093523 dv-cinder-852009-8-iscsi devstack@n-api.service[120740]: X-Project-Domain-Id: default Sep 13 18:13:05.093523 dv-cinder-852009-8-iscsi devstack@n-api.service[120740]: X-Project-Domain-Name: Default Sep 13 18:13:05.093523 dv-cinder-852009-8-iscsi devstack@n-api.service[120740]: X-Project-Id: e3568338d5734cb1bc955838b2b067d4 Sep 13 18:13:05.093523 dv-cinder-852009-8-iscsi devstack@n-api.service[120740]: X-Project-Name: tempest-VolumesNegativeTest-384994634 Sep 13 18:13:05.093523 dv-cinder-852009-8-iscsi devstack@n-api.service[120740]: X-Role: reader,member Sep 13 18:13:05.093523 dv-cinder-852009-8-iscsi devstack@n-api.service[120740]: X-Roles: reader,member Sep 13 18:13:05.095223 dv-cinder-852009-8-iscsi devstack@n-api.service[120740]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/identity"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/compute/v2/e3568338d5734cb1bc955838b2b067d4"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.43:8080", "publicURL": "http://10.222.0.43:8080/v1/AUTH_e3568338d5734cb1bc955838b2b067d4"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43:9696/networking"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/volume/v3/e3568338d5734cb1bc955838b2b067d4"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/compute/v2.1"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/placement"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/volume/v3/e3568338d5734cb1bc955838b2b067d4"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/image"}]}] Sep 13 18:13:05.095223 dv-cinder-852009-8-iscsi devstack@n-api.service[120740]: X-Tenant: tempest-VolumesNegativeTest-384994634 Sep 13 18:13:05.095223 dv-cinder-852009-8-iscsi devstack@n-api.service[120740]: X-Tenant-Id: e3568338d5734cb1bc955838b2b067d4 Sep 13 18:13:05.095223 dv-cinder-852009-8-iscsi devstack@n-api.service[120740]: X-Tenant-Name: tempest-VolumesNegativeTest-384994634 Sep 13 18:13:05.095223 dv-cinder-852009-8-iscsi devstack@n-api.service[120740]: X-User: tempest-VolumesNegativeTest-384994634-project Sep 13 18:13:05.095223 dv-cinder-852009-8-iscsi devstack@n-api.service[120740]: X-User-Domain-Id: default Sep 13 18:13:05.095223 dv-cinder-852009-8-iscsi devstack@n-api.service[120740]: X-User-Domain-Name: Default Sep 13 18:13:05.095223 dv-cinder-852009-8-iscsi devstack@n-api.service[120740]: X-User-Id: adaf620deb034a46be1f6cdeb8257876 Sep 13 18:13:05.095223 dv-cinder-852009-8-iscsi devstack@n-api.service[120740]: X-User-Name: tempest-VolumesNegativeTest-384994634-project Sep 13 18:13:05.095223 dv-cinder-852009-8-iscsi devstack@n-api.service[120740]: Sep 13 18:13:05.095223 dv-cinder-852009-8-iscsi devstack@n-api.service[120740]: {"volume": {"size": "#$%", "display_name": "tempest-VolumesNegativeTest-Volume-1539444257", "metadata": {"Type": "work"}}} Sep 13 18:13:05.095223 dv-cinder-852009-8-iscsi devstack@n-api.service[120740]: method: Sep 13 18:13:05.095223 dv-cinder-852009-8-iscsi devstack@n-api.service[120740]: exception: Invalid input for field/attribute size. Value: #$%. '#$%' does not match '^[0-9]+$' Sep 13 18:13:05.096263 dv-cinder-852009-8-iscsi devstack@n-api.service[120740]: action_args: {'body': {'volume': {'size': '#$%', 'display_name': 'tempest-VolumesNegativeTest-Volume-1539444257', 'metadata': {'Type': 'work'}}}} Sep 13 18:13:05.096263 dv-cinder-852009-8-iscsi devstack@n-api.service[120740]: {{(pid=120740) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 13 18:13:05.096263 dv-cinder-852009-8-iscsi devstack@n-api.service[120740]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 13 18:13:05.096263 dv-cinder-852009-8-iscsi devstack@n-api.service[120740]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 302, in validate Sep 13 18:13:05.096263 dv-cinder-852009-8-iscsi devstack@n-api.service[120740]: ERROR nova.api.openstack.wsgi self.validator.validate(*args, **kwargs) Sep 13 18:13:05.096263 dv-cinder-852009-8-iscsi devstack@n-api.service[120740]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/jsonschema/validators.py", line 303, in validate Sep 13 18:13:05.096263 dv-cinder-852009-8-iscsi devstack@n-api.service[120740]: ERROR nova.api.openstack.wsgi raise error Sep 13 18:13:05.096263 dv-cinder-852009-8-iscsi devstack@n-api.service[120740]: ERROR nova.api.openstack.wsgi jsonschema.exceptions.ValidationError: '#$%' does not match '^[0-9]+$' Sep 13 18:13:05.096263 dv-cinder-852009-8-iscsi devstack@n-api.service[120740]: ERROR nova.api.openstack.wsgi Sep 13 18:13:05.096263 dv-cinder-852009-8-iscsi devstack@n-api.service[120740]: ERROR nova.api.openstack.wsgi Failed validating 'pattern' in schema['properties']['volume']['properties']['size']: Sep 13 18:13:05.096263 dv-cinder-852009-8-iscsi devstack@n-api.service[120740]: ERROR nova.api.openstack.wsgi {'minimum': 1, 'pattern': '^[0-9]+$', 'type': ['integer', 'string']} Sep 13 18:13:05.096263 dv-cinder-852009-8-iscsi devstack@n-api.service[120740]: ERROR nova.api.openstack.wsgi Sep 13 18:13:05.096263 dv-cinder-852009-8-iscsi devstack@n-api.service[120740]: ERROR nova.api.openstack.wsgi On instance['volume']: Sep 13 18:13:05.096263 dv-cinder-852009-8-iscsi devstack@n-api.service[120740]: ERROR nova.api.openstack.wsgi '#$%' Sep 13 18:13:05.096263 dv-cinder-852009-8-iscsi devstack@n-api.service[120740]: ERROR nova.api.openstack.wsgi Sep 13 18:13:05.096263 dv-cinder-852009-8-iscsi devstack@n-api.service[120740]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 13 18:13:05.096263 dv-cinder-852009-8-iscsi devstack@n-api.service[120740]: ERROR nova.api.openstack.wsgi Sep 13 18:13:05.096263 dv-cinder-852009-8-iscsi devstack@n-api.service[120740]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 13 18:13:05.096263 dv-cinder-852009-8-iscsi devstack@n-api.service[120740]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 13 18:13:05.096263 dv-cinder-852009-8-iscsi devstack@n-api.service[120740]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 13 18:13:05.096263 dv-cinder-852009-8-iscsi devstack@n-api.service[120740]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 13 18:13:05.096263 dv-cinder-852009-8-iscsi devstack@n-api.service[120740]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 13 18:13:05.098035 dv-cinder-852009-8-iscsi devstack@n-api.service[120740]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Sep 13 18:13:05.098035 dv-cinder-852009-8-iscsi devstack@n-api.service[120740]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Sep 13 18:13:05.098035 dv-cinder-852009-8-iscsi devstack@n-api.service[120740]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 13 18:13:05.098035 dv-cinder-852009-8-iscsi devstack@n-api.service[120740]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 13 18:13:05.098035 dv-cinder-852009-8-iscsi devstack@n-api.service[120740]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 107, in wrapper Sep 13 18:13:05.098035 dv-cinder-852009-8-iscsi devstack@n-api.service[120740]: ERROR nova.api.openstack.wsgi _schema_validation_helper(request_body_schema, kwargs['body'], Sep 13 18:13:05.098035 dv-cinder-852009-8-iscsi devstack@n-api.service[120740]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 88, in _schema_validation_helper Sep 13 18:13:05.098035 dv-cinder-852009-8-iscsi devstack@n-api.service[120740]: ERROR nova.api.openstack.wsgi schema_validator.validate(target) Sep 13 18:13:05.098035 dv-cinder-852009-8-iscsi devstack@n-api.service[120740]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 331, in validate Sep 13 18:13:05.098035 dv-cinder-852009-8-iscsi devstack@n-api.service[120740]: ERROR nova.api.openstack.wsgi raise exception.ValidationError(detail=detail) Sep 13 18:13:05.098035 dv-cinder-852009-8-iscsi devstack@n-api.service[120740]: ERROR nova.api.openstack.wsgi nova.exception.ValidationError: Invalid input for field/attribute size. Value: #$%. '#$%' does not match '^[0-9]+$' Sep 13 18:13:05.098035 dv-cinder-852009-8-iscsi devstack@n-api.service[120740]: ERROR nova.api.openstack.wsgi Sep 13 18:13:05.098035 dv-cinder-852009-8-iscsi devstack@n-api.service[120740]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 13 18:13:05.098035 dv-cinder-852009-8-iscsi devstack@n-api.service[120740]: ERROR nova.api.openstack.wsgi Sep 13 18:13:05.098035 dv-cinder-852009-8-iscsi devstack@n-api.service[120740]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 13 18:13:05.098035 dv-cinder-852009-8-iscsi devstack@n-api.service[120740]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 13 18:13:05.098035 dv-cinder-852009-8-iscsi devstack@n-api.service[120740]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 13 18:13:05.098035 dv-cinder-852009-8-iscsi devstack@n-api.service[120740]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 359, in __exit__ Sep 13 18:13:05.098035 dv-cinder-852009-8-iscsi devstack@n-api.service[120740]: ERROR nova.api.openstack.wsgi raise Fault(exception.ConvertedException( Sep 13 18:13:05.099982 dv-cinder-852009-8-iscsi devstack@n-api.service[120740]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Invalid input for field/attribute size. Value: #$%. '#$%' does not match '^[0-9]+$' Sep 13 18:13:05.099982 dv-cinder-852009-8-iscsi devstack@n-api.service[120740]: ERROR nova.api.openstack.wsgi Sep 13 18:13:05.099982 dv-cinder-852009-8-iscsi devstack@n-api.service[120740]: DEBUG nova.api.openstack.wsgi [None req-e14dfc59-1bcb-4cf5-b257-771870cadedc tempest-VolumesNegativeTest-384994634 tempest-VolumesNegativeTest-384994634-project] Returning 400 to user: Invalid input for field/attribute size. Value: #$%. '#$%' does not match '^[0-9]+$' {{(pid=120740) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 13 18:13:05.099982 dv-cinder-852009-8-iscsi devstack@n-api.service[120740]: INFO nova.api.openstack.requestlog [None req-e14dfc59-1bcb-4cf5-b257-771870cadedc tempest-VolumesNegativeTest-384994634 tempest-VolumesNegativeTest-384994634-project] 10.222.0.43 "POST /compute/v2.1/os-volumes" status: 400 len: 127 microversion: 2.1 time: 0.136114 Sep 13 18:13:05.099982 dv-cinder-852009-8-iscsi devstack@n-api.service[120740]: [pid: 120740|app: 0|req: 452/893] 10.222.0.43 () {60 vars in 1156 bytes} [Tue Sep 13 18:13:04 2022] POST /compute/v2.1/os-volumes => generated 127 bytes in 137 msecs (HTTP/1.1 400) 9 headers in 381 bytes (1 switches on core 0) Sep 13 18:13:05.106236 dv-cinder-852009-8-iscsi devstack@n-api.service[120741]: DEBUG nova.api.openstack.wsgi [None req-a8201c0a-a1ab-4387-a213-9345f5ac9963 tempest-VolumesNegativeTest-384994634 tempest-VolumesNegativeTest-384994634-project] Action: 'create', calling method: .version_select at 0x7fa626b5e160>, body: {"volume": {"size": "0", "display_name": "tempest-VolumesNegativeTest-Volume-965369874", "metadata": {"Type": "work"}}} {{(pid=120741) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 13 18:13:05.110888 dv-cinder-852009-8-iscsi devstack@n-api.service[120741]: DEBUG nova.api.openstack.wsgi [None req-a8201c0a-a1ab-4387-a213-9345f5ac9963 tempest-VolumesNegativeTest-384994634 tempest-VolumesNegativeTest-384994634-project] Request method failure captured: Sep 13 18:13:05.110888 dv-cinder-852009-8-iscsi devstack@n-api.service[120741]: request: POST /compute/v2.1/os-volumes HTTP/1.1 Sep 13 18:13:05.110888 dv-cinder-852009-8-iscsi devstack@n-api.service[120741]: Accept: application/json Sep 13 18:13:05.110888 dv-cinder-852009-8-iscsi devstack@n-api.service[120741]: Accept-Encoding: identity Sep 13 18:13:05.110888 dv-cinder-852009-8-iscsi devstack@n-api.service[120741]: Connection: close Sep 13 18:13:05.110888 dv-cinder-852009-8-iscsi devstack@n-api.service[120741]: Content-Length: 119 Sep 13 18:13:05.110888 dv-cinder-852009-8-iscsi devstack@n-api.service[120741]: Content-Type: application/json Sep 13 18:13:05.110888 dv-cinder-852009-8-iscsi devstack@n-api.service[120741]: Host: 10.222.0.43 Sep 13 18:13:05.110888 dv-cinder-852009-8-iscsi devstack@n-api.service[120741]: Openstack-System-Scope: None Sep 13 18:13:05.110888 dv-cinder-852009-8-iscsi devstack@n-api.service[120741]: User-Agent: python-urllib3/1.26.12 Sep 13 18:13:05.110888 dv-cinder-852009-8-iscsi devstack@n-api.service[120741]: X-Auth-Token: gAAAAABjIMgweRYnpuHzgvWkcVyub5FUO9Yxm0fxKMQz6U9NAYkKeIm5OPrFLcxFBwgaPtdf4niuRLTX5nzMKSFVmvaBMDt8ejSTeWN3FPR9zXAo0VV5h--ojT3_qzTIH1pT7IS_xB5tC_YEgICZs2ROQsrqSnLizicxDVG2IUbZf3LsYhUJ3PQ Sep 13 18:13:05.110888 dv-cinder-852009-8-iscsi devstack@n-api.service[120741]: X-Domain-Id: None Sep 13 18:13:05.110888 dv-cinder-852009-8-iscsi devstack@n-api.service[120741]: X-Domain-Name: None Sep 13 18:13:05.110888 dv-cinder-852009-8-iscsi devstack@n-api.service[120741]: X-Identity-Status: Confirmed Sep 13 18:13:05.110888 dv-cinder-852009-8-iscsi devstack@n-api.service[120741]: X-Is-Admin-Project: True Sep 13 18:13:05.110888 dv-cinder-852009-8-iscsi devstack@n-api.service[120741]: X-Project-Domain-Id: default Sep 13 18:13:05.110888 dv-cinder-852009-8-iscsi devstack@n-api.service[120741]: X-Project-Domain-Name: Default Sep 13 18:13:05.110888 dv-cinder-852009-8-iscsi devstack@n-api.service[120741]: X-Project-Id: e3568338d5734cb1bc955838b2b067d4 Sep 13 18:13:05.110888 dv-cinder-852009-8-iscsi devstack@n-api.service[120741]: X-Project-Name: tempest-VolumesNegativeTest-384994634 Sep 13 18:13:05.110888 dv-cinder-852009-8-iscsi devstack@n-api.service[120741]: X-Role: reader,member Sep 13 18:13:05.110888 dv-cinder-852009-8-iscsi devstack@n-api.service[120741]: X-Roles: reader,member Sep 13 18:13:05.112579 dv-cinder-852009-8-iscsi devstack@n-api.service[120741]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/identity"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/compute/v2/e3568338d5734cb1bc955838b2b067d4"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.43:8080", "publicURL": "http://10.222.0.43:8080/v1/AUTH_e3568338d5734cb1bc955838b2b067d4"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43:9696/networking"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/volume/v3/e3568338d5734cb1bc955838b2b067d4"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/compute/v2.1"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/placement"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/volume/v3/e3568338d5734cb1bc955838b2b067d4"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/image"}]}] Sep 13 18:13:05.112579 dv-cinder-852009-8-iscsi devstack@n-api.service[120741]: X-Tenant: tempest-VolumesNegativeTest-384994634 Sep 13 18:13:05.112579 dv-cinder-852009-8-iscsi devstack@n-api.service[120741]: X-Tenant-Id: e3568338d5734cb1bc955838b2b067d4 Sep 13 18:13:05.112579 dv-cinder-852009-8-iscsi devstack@n-api.service[120741]: X-Tenant-Name: tempest-VolumesNegativeTest-384994634 Sep 13 18:13:05.112579 dv-cinder-852009-8-iscsi devstack@n-api.service[120741]: X-User: tempest-VolumesNegativeTest-384994634-project Sep 13 18:13:05.112579 dv-cinder-852009-8-iscsi devstack@n-api.service[120741]: X-User-Domain-Id: default Sep 13 18:13:05.112579 dv-cinder-852009-8-iscsi devstack@n-api.service[120741]: X-User-Domain-Name: Default Sep 13 18:13:05.112579 dv-cinder-852009-8-iscsi devstack@n-api.service[120741]: X-User-Id: adaf620deb034a46be1f6cdeb8257876 Sep 13 18:13:05.112579 dv-cinder-852009-8-iscsi devstack@n-api.service[120741]: X-User-Name: tempest-VolumesNegativeTest-384994634-project Sep 13 18:13:05.112579 dv-cinder-852009-8-iscsi devstack@n-api.service[120741]: Sep 13 18:13:05.112579 dv-cinder-852009-8-iscsi devstack@n-api.service[120741]: {"volume": {"size": "0", "display_name": "tempest-VolumesNegativeTest-Volume-965369874", "metadata": {"Type": "work"}}} Sep 13 18:13:05.112579 dv-cinder-852009-8-iscsi devstack@n-api.service[120741]: method: Sep 13 18:13:05.112579 dv-cinder-852009-8-iscsi devstack@n-api.service[120741]: exception: Invalid input for field/attribute size. Value: 0. 0 is less than the minimum of 1 Sep 13 18:13:05.113811 dv-cinder-852009-8-iscsi devstack@n-api.service[120741]: action_args: {'body': {'volume': {'size': '0', 'display_name': 'tempest-VolumesNegativeTest-Volume-965369874', 'metadata': {'Type': 'work'}}}} Sep 13 18:13:05.113811 dv-cinder-852009-8-iscsi devstack@n-api.service[120741]: {{(pid=120741) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 13 18:13:05.113811 dv-cinder-852009-8-iscsi devstack@n-api.service[120741]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 13 18:13:05.113811 dv-cinder-852009-8-iscsi devstack@n-api.service[120741]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 302, in validate Sep 13 18:13:05.113811 dv-cinder-852009-8-iscsi devstack@n-api.service[120741]: ERROR nova.api.openstack.wsgi self.validator.validate(*args, **kwargs) Sep 13 18:13:05.113811 dv-cinder-852009-8-iscsi devstack@n-api.service[120741]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/jsonschema/validators.py", line 303, in validate Sep 13 18:13:05.113811 dv-cinder-852009-8-iscsi devstack@n-api.service[120741]: ERROR nova.api.openstack.wsgi raise error Sep 13 18:13:05.113811 dv-cinder-852009-8-iscsi devstack@n-api.service[120741]: ERROR nova.api.openstack.wsgi jsonschema.exceptions.ValidationError: 0 is less than the minimum of 1 Sep 13 18:13:05.113811 dv-cinder-852009-8-iscsi devstack@n-api.service[120741]: ERROR nova.api.openstack.wsgi Sep 13 18:13:05.113811 dv-cinder-852009-8-iscsi devstack@n-api.service[120741]: ERROR nova.api.openstack.wsgi Failed validating 'minimum' in schema['properties']['volume']['properties']['size']: Sep 13 18:13:05.113811 dv-cinder-852009-8-iscsi devstack@n-api.service[120741]: ERROR nova.api.openstack.wsgi {'minimum': 1, 'pattern': '^[0-9]+$', 'type': ['integer', 'string']} Sep 13 18:13:05.113811 dv-cinder-852009-8-iscsi devstack@n-api.service[120741]: ERROR nova.api.openstack.wsgi Sep 13 18:13:05.113811 dv-cinder-852009-8-iscsi devstack@n-api.service[120741]: ERROR nova.api.openstack.wsgi On instance['volume']: Sep 13 18:13:05.113811 dv-cinder-852009-8-iscsi devstack@n-api.service[120741]: ERROR nova.api.openstack.wsgi '0' Sep 13 18:13:05.113811 dv-cinder-852009-8-iscsi devstack@n-api.service[120741]: ERROR nova.api.openstack.wsgi Sep 13 18:13:05.113811 dv-cinder-852009-8-iscsi devstack@n-api.service[120741]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 13 18:13:05.113811 dv-cinder-852009-8-iscsi devstack@n-api.service[120741]: ERROR nova.api.openstack.wsgi Sep 13 18:13:05.113811 dv-cinder-852009-8-iscsi devstack@n-api.service[120741]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 13 18:13:05.113811 dv-cinder-852009-8-iscsi devstack@n-api.service[120741]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 13 18:13:05.113811 dv-cinder-852009-8-iscsi devstack@n-api.service[120741]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 13 18:13:05.113811 dv-cinder-852009-8-iscsi devstack@n-api.service[120741]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 13 18:13:05.113811 dv-cinder-852009-8-iscsi devstack@n-api.service[120741]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 13 18:13:05.115657 dv-cinder-852009-8-iscsi devstack@n-api.service[120741]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Sep 13 18:13:05.115657 dv-cinder-852009-8-iscsi devstack@n-api.service[120741]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Sep 13 18:13:05.115657 dv-cinder-852009-8-iscsi devstack@n-api.service[120741]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 13 18:13:05.115657 dv-cinder-852009-8-iscsi devstack@n-api.service[120741]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 13 18:13:05.115657 dv-cinder-852009-8-iscsi devstack@n-api.service[120741]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 107, in wrapper Sep 13 18:13:05.115657 dv-cinder-852009-8-iscsi devstack@n-api.service[120741]: ERROR nova.api.openstack.wsgi _schema_validation_helper(request_body_schema, kwargs['body'], Sep 13 18:13:05.115657 dv-cinder-852009-8-iscsi devstack@n-api.service[120741]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 88, in _schema_validation_helper Sep 13 18:13:05.115657 dv-cinder-852009-8-iscsi devstack@n-api.service[120741]: ERROR nova.api.openstack.wsgi schema_validator.validate(target) Sep 13 18:13:05.115657 dv-cinder-852009-8-iscsi devstack@n-api.service[120741]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 331, in validate Sep 13 18:13:05.115657 dv-cinder-852009-8-iscsi devstack@n-api.service[120741]: ERROR nova.api.openstack.wsgi raise exception.ValidationError(detail=detail) Sep 13 18:13:05.115657 dv-cinder-852009-8-iscsi devstack@n-api.service[120741]: ERROR nova.api.openstack.wsgi nova.exception.ValidationError: Invalid input for field/attribute size. Value: 0. 0 is less than the minimum of 1 Sep 13 18:13:05.115657 dv-cinder-852009-8-iscsi devstack@n-api.service[120741]: ERROR nova.api.openstack.wsgi Sep 13 18:13:05.115657 dv-cinder-852009-8-iscsi devstack@n-api.service[120741]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 13 18:13:05.115657 dv-cinder-852009-8-iscsi devstack@n-api.service[120741]: ERROR nova.api.openstack.wsgi Sep 13 18:13:05.115657 dv-cinder-852009-8-iscsi devstack@n-api.service[120741]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 13 18:13:05.115657 dv-cinder-852009-8-iscsi devstack@n-api.service[120741]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 13 18:13:05.115657 dv-cinder-852009-8-iscsi devstack@n-api.service[120741]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 13 18:13:05.115657 dv-cinder-852009-8-iscsi devstack@n-api.service[120741]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 359, in __exit__ Sep 13 18:13:05.115657 dv-cinder-852009-8-iscsi devstack@n-api.service[120741]: ERROR nova.api.openstack.wsgi raise Fault(exception.ConvertedException( Sep 13 18:13:05.117196 dv-cinder-852009-8-iscsi devstack@n-api.service[120741]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Invalid input for field/attribute size. Value: 0. 0 is less than the minimum of 1 Sep 13 18:13:05.117196 dv-cinder-852009-8-iscsi devstack@n-api.service[120741]: ERROR nova.api.openstack.wsgi Sep 13 18:13:05.117196 dv-cinder-852009-8-iscsi devstack@n-api.service[120741]: DEBUG nova.api.openstack.wsgi [None req-a8201c0a-a1ab-4387-a213-9345f5ac9963 tempest-VolumesNegativeTest-384994634 tempest-VolumesNegativeTest-384994634-project] Returning 400 to user: Invalid input for field/attribute size. Value: 0. 0 is less than the minimum of 1 {{(pid=120741) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 13 18:13:05.117196 dv-cinder-852009-8-iscsi devstack@n-api.service[120741]: INFO nova.api.openstack.requestlog [None req-a8201c0a-a1ab-4387-a213-9345f5ac9963 tempest-VolumesNegativeTest-384994634 tempest-VolumesNegativeTest-384994634-project] 10.222.0.43 "POST /compute/v2.1/os-volumes" status: 400 len: 125 microversion: 2.1 time: 0.011227 Sep 13 18:13:05.117196 dv-cinder-852009-8-iscsi devstack@n-api.service[120741]: [pid: 120741|app: 0|req: 442/894] 10.222.0.43 () {60 vars in 1156 bytes} [Tue Sep 13 18:13:05 2022] POST /compute/v2.1/os-volumes => generated 125 bytes in 12 msecs (HTTP/1.1 400) 9 headers in 381 bytes (1 switches on core 0) Sep 13 18:13:05.121537 dv-cinder-852009-8-iscsi devstack@n-api.service[120740]: DEBUG nova.api.openstack.wsgi [None req-2b3b3674-315c-4357-95d8-4b5b6ea8ee53 tempest-VolumesNegativeTest-384994634 tempest-VolumesNegativeTest-384994634-project] Action: 'create', calling method: .version_select at 0x7fa626c3f5e0>, body: {"volume": {"size": "", "display_name": "tempest-VolumesNegativeTest-Volume-906441187", "metadata": {"Type": "work"}}} {{(pid=120740) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 13 18:13:05.126199 dv-cinder-852009-8-iscsi devstack@n-api.service[120740]: DEBUG nova.api.openstack.wsgi [None req-2b3b3674-315c-4357-95d8-4b5b6ea8ee53 tempest-VolumesNegativeTest-384994634 tempest-VolumesNegativeTest-384994634-project] Request method failure captured: Sep 13 18:13:05.126199 dv-cinder-852009-8-iscsi devstack@n-api.service[120740]: request: POST /compute/v2.1/os-volumes HTTP/1.1 Sep 13 18:13:05.126199 dv-cinder-852009-8-iscsi devstack@n-api.service[120740]: Accept: application/json Sep 13 18:13:05.126199 dv-cinder-852009-8-iscsi devstack@n-api.service[120740]: Accept-Encoding: identity Sep 13 18:13:05.126199 dv-cinder-852009-8-iscsi devstack@n-api.service[120740]: Connection: close Sep 13 18:13:05.126199 dv-cinder-852009-8-iscsi devstack@n-api.service[120740]: Content-Length: 118 Sep 13 18:13:05.126199 dv-cinder-852009-8-iscsi devstack@n-api.service[120740]: Content-Type: application/json Sep 13 18:13:05.126199 dv-cinder-852009-8-iscsi devstack@n-api.service[120740]: Host: 10.222.0.43 Sep 13 18:13:05.126199 dv-cinder-852009-8-iscsi devstack@n-api.service[120740]: Openstack-System-Scope: None Sep 13 18:13:05.126199 dv-cinder-852009-8-iscsi devstack@n-api.service[120740]: User-Agent: python-urllib3/1.26.12 Sep 13 18:13:05.126199 dv-cinder-852009-8-iscsi devstack@n-api.service[120740]: X-Auth-Token: gAAAAABjIMgweRYnpuHzgvWkcVyub5FUO9Yxm0fxKMQz6U9NAYkKeIm5OPrFLcxFBwgaPtdf4niuRLTX5nzMKSFVmvaBMDt8ejSTeWN3FPR9zXAo0VV5h--ojT3_qzTIH1pT7IS_xB5tC_YEgICZs2ROQsrqSnLizicxDVG2IUbZf3LsYhUJ3PQ Sep 13 18:13:05.126199 dv-cinder-852009-8-iscsi devstack@n-api.service[120740]: X-Domain-Id: None Sep 13 18:13:05.126199 dv-cinder-852009-8-iscsi devstack@n-api.service[120740]: X-Domain-Name: None Sep 13 18:13:05.126199 dv-cinder-852009-8-iscsi devstack@n-api.service[120740]: X-Identity-Status: Confirmed Sep 13 18:13:05.126199 dv-cinder-852009-8-iscsi devstack@n-api.service[120740]: X-Is-Admin-Project: True Sep 13 18:13:05.126199 dv-cinder-852009-8-iscsi devstack@n-api.service[120740]: X-Project-Domain-Id: default Sep 13 18:13:05.126199 dv-cinder-852009-8-iscsi devstack@n-api.service[120740]: X-Project-Domain-Name: Default Sep 13 18:13:05.126199 dv-cinder-852009-8-iscsi devstack@n-api.service[120740]: X-Project-Id: e3568338d5734cb1bc955838b2b067d4 Sep 13 18:13:05.126199 dv-cinder-852009-8-iscsi devstack@n-api.service[120740]: X-Project-Name: tempest-VolumesNegativeTest-384994634 Sep 13 18:13:05.126199 dv-cinder-852009-8-iscsi devstack@n-api.service[120740]: X-Role: reader,member Sep 13 18:13:05.126199 dv-cinder-852009-8-iscsi devstack@n-api.service[120740]: X-Roles: reader,member Sep 13 18:13:05.127952 dv-cinder-852009-8-iscsi devstack@n-api.service[120740]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/identity"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/compute/v2/e3568338d5734cb1bc955838b2b067d4"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.43:8080", "publicURL": "http://10.222.0.43:8080/v1/AUTH_e3568338d5734cb1bc955838b2b067d4"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43:9696/networking"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/volume/v3/e3568338d5734cb1bc955838b2b067d4"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/compute/v2.1"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/placement"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/volume/v3/e3568338d5734cb1bc955838b2b067d4"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/image"}]}] Sep 13 18:13:05.127952 dv-cinder-852009-8-iscsi devstack@n-api.service[120740]: X-Tenant: tempest-VolumesNegativeTest-384994634 Sep 13 18:13:05.127952 dv-cinder-852009-8-iscsi devstack@n-api.service[120740]: X-Tenant-Id: e3568338d5734cb1bc955838b2b067d4 Sep 13 18:13:05.127952 dv-cinder-852009-8-iscsi devstack@n-api.service[120740]: X-Tenant-Name: tempest-VolumesNegativeTest-384994634 Sep 13 18:13:05.127952 dv-cinder-852009-8-iscsi devstack@n-api.service[120740]: X-User: tempest-VolumesNegativeTest-384994634-project Sep 13 18:13:05.127952 dv-cinder-852009-8-iscsi devstack@n-api.service[120740]: X-User-Domain-Id: default Sep 13 18:13:05.127952 dv-cinder-852009-8-iscsi devstack@n-api.service[120740]: X-User-Domain-Name: Default Sep 13 18:13:05.127952 dv-cinder-852009-8-iscsi devstack@n-api.service[120740]: X-User-Id: adaf620deb034a46be1f6cdeb8257876 Sep 13 18:13:05.127952 dv-cinder-852009-8-iscsi devstack@n-api.service[120740]: X-User-Name: tempest-VolumesNegativeTest-384994634-project Sep 13 18:13:05.127952 dv-cinder-852009-8-iscsi devstack@n-api.service[120740]: Sep 13 18:13:05.127952 dv-cinder-852009-8-iscsi devstack@n-api.service[120740]: {"volume": {"size": "", "display_name": "tempest-VolumesNegativeTest-Volume-906441187", "metadata": {"Type": "work"}}} Sep 13 18:13:05.127952 dv-cinder-852009-8-iscsi devstack@n-api.service[120740]: method: Sep 13 18:13:05.127952 dv-cinder-852009-8-iscsi devstack@n-api.service[120740]: exception: Invalid input for field/attribute size. Value: . '' does not match '^[0-9]+$' Sep 13 18:13:05.129013 dv-cinder-852009-8-iscsi devstack@n-api.service[120740]: action_args: {'body': {'volume': {'size': '', 'display_name': 'tempest-VolumesNegativeTest-Volume-906441187', 'metadata': {'Type': 'work'}}}} Sep 13 18:13:05.129013 dv-cinder-852009-8-iscsi devstack@n-api.service[120740]: {{(pid=120740) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 13 18:13:05.129013 dv-cinder-852009-8-iscsi devstack@n-api.service[120740]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 13 18:13:05.129013 dv-cinder-852009-8-iscsi devstack@n-api.service[120740]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 302, in validate Sep 13 18:13:05.129013 dv-cinder-852009-8-iscsi devstack@n-api.service[120740]: ERROR nova.api.openstack.wsgi self.validator.validate(*args, **kwargs) Sep 13 18:13:05.129013 dv-cinder-852009-8-iscsi devstack@n-api.service[120740]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/jsonschema/validators.py", line 303, in validate Sep 13 18:13:05.129013 dv-cinder-852009-8-iscsi devstack@n-api.service[120740]: ERROR nova.api.openstack.wsgi raise error Sep 13 18:13:05.129013 dv-cinder-852009-8-iscsi devstack@n-api.service[120740]: ERROR nova.api.openstack.wsgi jsonschema.exceptions.ValidationError: '' does not match '^[0-9]+$' Sep 13 18:13:05.129013 dv-cinder-852009-8-iscsi devstack@n-api.service[120740]: ERROR nova.api.openstack.wsgi Sep 13 18:13:05.129013 dv-cinder-852009-8-iscsi devstack@n-api.service[120740]: ERROR nova.api.openstack.wsgi Failed validating 'pattern' in schema['properties']['volume']['properties']['size']: Sep 13 18:13:05.129013 dv-cinder-852009-8-iscsi devstack@n-api.service[120740]: ERROR nova.api.openstack.wsgi {'minimum': 1, 'pattern': '^[0-9]+$', 'type': ['integer', 'string']} Sep 13 18:13:05.129013 dv-cinder-852009-8-iscsi devstack@n-api.service[120740]: ERROR nova.api.openstack.wsgi Sep 13 18:13:05.129013 dv-cinder-852009-8-iscsi devstack@n-api.service[120740]: ERROR nova.api.openstack.wsgi On instance['volume']: Sep 13 18:13:05.129013 dv-cinder-852009-8-iscsi devstack@n-api.service[120740]: ERROR nova.api.openstack.wsgi '' Sep 13 18:13:05.129013 dv-cinder-852009-8-iscsi devstack@n-api.service[120740]: ERROR nova.api.openstack.wsgi Sep 13 18:13:05.129013 dv-cinder-852009-8-iscsi devstack@n-api.service[120740]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 13 18:13:05.129013 dv-cinder-852009-8-iscsi devstack@n-api.service[120740]: ERROR nova.api.openstack.wsgi Sep 13 18:13:05.129013 dv-cinder-852009-8-iscsi devstack@n-api.service[120740]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 13 18:13:05.129013 dv-cinder-852009-8-iscsi devstack@n-api.service[120740]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 13 18:13:05.129013 dv-cinder-852009-8-iscsi devstack@n-api.service[120740]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 13 18:13:05.129013 dv-cinder-852009-8-iscsi devstack@n-api.service[120740]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 13 18:13:05.129013 dv-cinder-852009-8-iscsi devstack@n-api.service[120740]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 13 18:13:05.130802 dv-cinder-852009-8-iscsi devstack@n-api.service[120740]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Sep 13 18:13:05.130802 dv-cinder-852009-8-iscsi devstack@n-api.service[120740]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Sep 13 18:13:05.130802 dv-cinder-852009-8-iscsi devstack@n-api.service[120740]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 13 18:13:05.130802 dv-cinder-852009-8-iscsi devstack@n-api.service[120740]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 13 18:13:05.130802 dv-cinder-852009-8-iscsi devstack@n-api.service[120740]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 107, in wrapper Sep 13 18:13:05.130802 dv-cinder-852009-8-iscsi devstack@n-api.service[120740]: ERROR nova.api.openstack.wsgi _schema_validation_helper(request_body_schema, kwargs['body'], Sep 13 18:13:05.130802 dv-cinder-852009-8-iscsi devstack@n-api.service[120740]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 88, in _schema_validation_helper Sep 13 18:13:05.130802 dv-cinder-852009-8-iscsi devstack@n-api.service[120740]: ERROR nova.api.openstack.wsgi schema_validator.validate(target) Sep 13 18:13:05.130802 dv-cinder-852009-8-iscsi devstack@n-api.service[120740]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 331, in validate Sep 13 18:13:05.130802 dv-cinder-852009-8-iscsi devstack@n-api.service[120740]: ERROR nova.api.openstack.wsgi raise exception.ValidationError(detail=detail) Sep 13 18:13:05.130802 dv-cinder-852009-8-iscsi devstack@n-api.service[120740]: ERROR nova.api.openstack.wsgi nova.exception.ValidationError: Invalid input for field/attribute size. Value: . '' does not match '^[0-9]+$' Sep 13 18:13:05.130802 dv-cinder-852009-8-iscsi devstack@n-api.service[120740]: ERROR nova.api.openstack.wsgi Sep 13 18:13:05.130802 dv-cinder-852009-8-iscsi devstack@n-api.service[120740]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 13 18:13:05.130802 dv-cinder-852009-8-iscsi devstack@n-api.service[120740]: ERROR nova.api.openstack.wsgi Sep 13 18:13:05.130802 dv-cinder-852009-8-iscsi devstack@n-api.service[120740]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 13 18:13:05.130802 dv-cinder-852009-8-iscsi devstack@n-api.service[120740]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 13 18:13:05.130802 dv-cinder-852009-8-iscsi devstack@n-api.service[120740]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 13 18:13:05.130802 dv-cinder-852009-8-iscsi devstack@n-api.service[120740]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 359, in __exit__ Sep 13 18:13:05.130802 dv-cinder-852009-8-iscsi devstack@n-api.service[120740]: ERROR nova.api.openstack.wsgi raise Fault(exception.ConvertedException( Sep 13 18:13:05.132692 dv-cinder-852009-8-iscsi devstack@n-api.service[120740]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Invalid input for field/attribute size. Value: . '' does not match '^[0-9]+$' Sep 13 18:13:05.132692 dv-cinder-852009-8-iscsi devstack@n-api.service[120740]: ERROR nova.api.openstack.wsgi Sep 13 18:13:05.132692 dv-cinder-852009-8-iscsi devstack@n-api.service[120740]: DEBUG nova.api.openstack.wsgi [None req-2b3b3674-315c-4357-95d8-4b5b6ea8ee53 tempest-VolumesNegativeTest-384994634 tempest-VolumesNegativeTest-384994634-project] Returning 400 to user: Invalid input for field/attribute size. Value: . '' does not match '^[0-9]+$' {{(pid=120740) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 13 18:13:05.132692 dv-cinder-852009-8-iscsi devstack@n-api.service[120740]: INFO nova.api.openstack.requestlog [None req-2b3b3674-315c-4357-95d8-4b5b6ea8ee53 tempest-VolumesNegativeTest-384994634 tempest-VolumesNegativeTest-384994634-project] 10.222.0.43 "POST /compute/v2.1/os-volumes" status: 400 len: 121 microversion: 2.1 time: 0.009800 Sep 13 18:13:05.132692 dv-cinder-852009-8-iscsi devstack@n-api.service[120740]: [pid: 120740|app: 0|req: 453/895] 10.222.0.43 () {60 vars in 1156 bytes} [Tue Sep 13 18:13:05 2022] POST /compute/v2.1/os-volumes => generated 121 bytes in 11 msecs (HTTP/1.1 400) 9 headers in 381 bytes (2 switches on core 0) Sep 13 18:13:05.136762 dv-cinder-852009-8-iscsi devstack@n-api.service[120741]: DEBUG nova.api.openstack.wsgi [None req-f8cc4ef3-c8ee-45d6-94d3-a78f2d1ee119 tempest-VolumesNegativeTest-384994634 tempest-VolumesNegativeTest-384994634-project] Calling method '.version_select at 0x7fa626ccf430>' {{(pid=120741) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 18:13:05.164874 dv-cinder-852009-8-iscsi devstack@n-api.service[120741]: INFO nova.api.openstack.wsgi [None req-f8cc4ef3-c8ee-45d6-94d3-a78f2d1ee119 tempest-VolumesNegativeTest-384994634 tempest-VolumesNegativeTest-384994634-project] HTTP exception thrown: Volume tempest-invalid-2038687077 could not be found. Sep 13 18:13:05.166869 dv-cinder-852009-8-iscsi devstack@n-api.service[120741]: DEBUG nova.api.openstack.wsgi [None req-f8cc4ef3-c8ee-45d6-94d3-a78f2d1ee119 tempest-VolumesNegativeTest-384994634 tempest-VolumesNegativeTest-384994634-project] Request method failure captured: Sep 13 18:13:05.166869 dv-cinder-852009-8-iscsi devstack@n-api.service[120741]: request: DELETE /compute/v2.1/os-volumes/tempest-invalid-2038687077 HTTP/1.1 Sep 13 18:13:05.166869 dv-cinder-852009-8-iscsi devstack@n-api.service[120741]: Accept: application/json Sep 13 18:13:05.166869 dv-cinder-852009-8-iscsi devstack@n-api.service[120741]: Accept-Encoding: identity Sep 13 18:13:05.166869 dv-cinder-852009-8-iscsi devstack@n-api.service[120741]: Connection: close Sep 13 18:13:05.166869 dv-cinder-852009-8-iscsi devstack@n-api.service[120741]: Content-Length: 0 Sep 13 18:13:05.166869 dv-cinder-852009-8-iscsi devstack@n-api.service[120741]: Content-Type: application/json Sep 13 18:13:05.166869 dv-cinder-852009-8-iscsi devstack@n-api.service[120741]: Host: 10.222.0.43 Sep 13 18:13:05.166869 dv-cinder-852009-8-iscsi devstack@n-api.service[120741]: Openstack-System-Scope: None Sep 13 18:13:05.166869 dv-cinder-852009-8-iscsi devstack@n-api.service[120741]: User-Agent: python-urllib3/1.26.12 Sep 13 18:13:05.166869 dv-cinder-852009-8-iscsi devstack@n-api.service[120741]: X-Auth-Token: gAAAAABjIMgweRYnpuHzgvWkcVyub5FUO9Yxm0fxKMQz6U9NAYkKeIm5OPrFLcxFBwgaPtdf4niuRLTX5nzMKSFVmvaBMDt8ejSTeWN3FPR9zXAo0VV5h--ojT3_qzTIH1pT7IS_xB5tC_YEgICZs2ROQsrqSnLizicxDVG2IUbZf3LsYhUJ3PQ Sep 13 18:13:05.166869 dv-cinder-852009-8-iscsi devstack@n-api.service[120741]: X-Domain-Id: None Sep 13 18:13:05.166869 dv-cinder-852009-8-iscsi devstack@n-api.service[120741]: X-Domain-Name: None Sep 13 18:13:05.166869 dv-cinder-852009-8-iscsi devstack@n-api.service[120741]: X-Identity-Status: Confirmed Sep 13 18:13:05.166869 dv-cinder-852009-8-iscsi devstack@n-api.service[120741]: X-Is-Admin-Project: True Sep 13 18:13:05.166869 dv-cinder-852009-8-iscsi devstack@n-api.service[120741]: X-Project-Domain-Id: default Sep 13 18:13:05.166869 dv-cinder-852009-8-iscsi devstack@n-api.service[120741]: X-Project-Domain-Name: Default Sep 13 18:13:05.166869 dv-cinder-852009-8-iscsi devstack@n-api.service[120741]: X-Project-Id: e3568338d5734cb1bc955838b2b067d4 Sep 13 18:13:05.166869 dv-cinder-852009-8-iscsi devstack@n-api.service[120741]: X-Project-Name: tempest-VolumesNegativeTest-384994634 Sep 13 18:13:05.166869 dv-cinder-852009-8-iscsi devstack@n-api.service[120741]: X-Role: reader,member Sep 13 18:13:05.166869 dv-cinder-852009-8-iscsi devstack@n-api.service[120741]: X-Roles: reader,member Sep 13 18:13:05.168319 dv-cinder-852009-8-iscsi devstack@n-api.service[120741]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/identity"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/compute/v2/e3568338d5734cb1bc955838b2b067d4"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.43:8080", "publicURL": "http://10.222.0.43:8080/v1/AUTH_e3568338d5734cb1bc955838b2b067d4"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43:9696/networking"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/volume/v3/e3568338d5734cb1bc955838b2b067d4"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/compute/v2.1"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/placement"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/volume/v3/e3568338d5734cb1bc955838b2b067d4"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/image"}]}] Sep 13 18:13:05.168319 dv-cinder-852009-8-iscsi devstack@n-api.service[120741]: X-Tenant: tempest-VolumesNegativeTest-384994634 Sep 13 18:13:05.168319 dv-cinder-852009-8-iscsi devstack@n-api.service[120741]: X-Tenant-Id: e3568338d5734cb1bc955838b2b067d4 Sep 13 18:13:05.168319 dv-cinder-852009-8-iscsi devstack@n-api.service[120741]: X-Tenant-Name: tempest-VolumesNegativeTest-384994634 Sep 13 18:13:05.168319 dv-cinder-852009-8-iscsi devstack@n-api.service[120741]: X-User: tempest-VolumesNegativeTest-384994634-project Sep 13 18:13:05.168319 dv-cinder-852009-8-iscsi devstack@n-api.service[120741]: X-User-Domain-Id: default Sep 13 18:13:05.168319 dv-cinder-852009-8-iscsi devstack@n-api.service[120741]: X-User-Domain-Name: Default Sep 13 18:13:05.168319 dv-cinder-852009-8-iscsi devstack@n-api.service[120741]: X-User-Id: adaf620deb034a46be1f6cdeb8257876 Sep 13 18:13:05.168319 dv-cinder-852009-8-iscsi devstack@n-api.service[120741]: X-User-Name: tempest-VolumesNegativeTest-384994634-project Sep 13 18:13:05.168319 dv-cinder-852009-8-iscsi devstack@n-api.service[120741]: method: Sep 13 18:13:05.168319 dv-cinder-852009-8-iscsi devstack@n-api.service[120741]: exception: Volume tempest-invalid-2038687077 could not be found. Sep 13 18:13:05.168319 dv-cinder-852009-8-iscsi devstack@n-api.service[120741]: action_args: {'id': 'tempest-invalid-2038687077'} Sep 13 18:13:05.168319 dv-cinder-852009-8-iscsi devstack@n-api.service[120741]: {{(pid=120741) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 13 18:13:05.169189 dv-cinder-852009-8-iscsi devstack@n-api.service[120741]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 13 18:13:05.169189 dv-cinder-852009-8-iscsi devstack@n-api.service[120741]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 433, in wrapper Sep 13 18:13:05.169189 dv-cinder-852009-8-iscsi devstack@n-api.service[120741]: ERROR nova.api.openstack.wsgi res = method(self, ctx, volume_id, *args, **kwargs) Sep 13 18:13:05.169189 dv-cinder-852009-8-iscsi devstack@n-api.service[120741]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 676, in delete Sep 13 18:13:05.169189 dv-cinder-852009-8-iscsi devstack@n-api.service[120741]: ERROR nova.api.openstack.wsgi cinderclient(context).volumes.delete(volume_id) Sep 13 18:13:05.169189 dv-cinder-852009-8-iscsi devstack@n-api.service[120741]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volumes_base.py", line 235, in delete Sep 13 18:13:05.169189 dv-cinder-852009-8-iscsi devstack@n-api.service[120741]: ERROR nova.api.openstack.wsgi return self._delete(loc) Sep 13 18:13:05.169189 dv-cinder-852009-8-iscsi devstack@n-api.service[120741]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/base.py", line 313, in _delete Sep 13 18:13:05.169189 dv-cinder-852009-8-iscsi devstack@n-api.service[120741]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.delete(url) Sep 13 18:13:05.169189 dv-cinder-852009-8-iscsi devstack@n-api.service[120741]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 233, in delete Sep 13 18:13:05.169189 dv-cinder-852009-8-iscsi devstack@n-api.service[120741]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'DELETE', **kwargs) Sep 13 18:13:05.169189 dv-cinder-852009-8-iscsi devstack@n-api.service[120741]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 215, in _cs_request Sep 13 18:13:05.169189 dv-cinder-852009-8-iscsi devstack@n-api.service[120741]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) Sep 13 18:13:05.169189 dv-cinder-852009-8-iscsi devstack@n-api.service[120741]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 201, in request Sep 13 18:13:05.169189 dv-cinder-852009-8-iscsi devstack@n-api.service[120741]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) Sep 13 18:13:05.169189 dv-cinder-852009-8-iscsi devstack@n-api.service[120741]: ERROR nova.api.openstack.wsgi cinderclient.exceptions.NotFound: Volume tempest-invalid-2038687077 could not be found. (HTTP 404) (Request-ID: req-a72f6ecf-138f-4b86-85b8-139721220386) Sep 13 18:13:05.169189 dv-cinder-852009-8-iscsi devstack@n-api.service[120741]: ERROR nova.api.openstack.wsgi Sep 13 18:13:05.169189 dv-cinder-852009-8-iscsi devstack@n-api.service[120741]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 13 18:13:05.169189 dv-cinder-852009-8-iscsi devstack@n-api.service[120741]: ERROR nova.api.openstack.wsgi Sep 13 18:13:05.170438 dv-cinder-852009-8-iscsi devstack@n-api.service[120741]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 13 18:13:05.170438 dv-cinder-852009-8-iscsi devstack@n-api.service[120741]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 136, in delete Sep 13 18:13:05.170438 dv-cinder-852009-8-iscsi devstack@n-api.service[120741]: ERROR nova.api.openstack.wsgi self.volume_api.delete(context, id) Sep 13 18:13:05.170438 dv-cinder-852009-8-iscsi devstack@n-api.service[120741]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 395, in wrapper Sep 13 18:13:05.170438 dv-cinder-852009-8-iscsi devstack@n-api.service[120741]: ERROR nova.api.openstack.wsgi res = method(self, ctx, *args, **kwargs) Sep 13 18:13:05.170438 dv-cinder-852009-8-iscsi devstack@n-api.service[120741]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 435, in wrapper Sep 13 18:13:05.170438 dv-cinder-852009-8-iscsi devstack@n-api.service[120741]: ERROR nova.api.openstack.wsgi _reraise(exception.VolumeNotFound(volume_id=volume_id)) Sep 13 18:13:05.170438 dv-cinder-852009-8-iscsi devstack@n-api.service[120741]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 486, in _reraise Sep 13 18:13:05.170438 dv-cinder-852009-8-iscsi devstack@n-api.service[120741]: ERROR nova.api.openstack.wsgi raise desired_exc.with_traceback(sys.exc_info()[2]) Sep 13 18:13:05.170438 dv-cinder-852009-8-iscsi devstack@n-api.service[120741]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 433, in wrapper Sep 13 18:13:05.170438 dv-cinder-852009-8-iscsi devstack@n-api.service[120741]: ERROR nova.api.openstack.wsgi res = method(self, ctx, volume_id, *args, **kwargs) Sep 13 18:13:05.170438 dv-cinder-852009-8-iscsi devstack@n-api.service[120741]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 676, in delete Sep 13 18:13:05.170438 dv-cinder-852009-8-iscsi devstack@n-api.service[120741]: ERROR nova.api.openstack.wsgi cinderclient(context).volumes.delete(volume_id) Sep 13 18:13:05.170438 dv-cinder-852009-8-iscsi devstack@n-api.service[120741]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volumes_base.py", line 235, in delete Sep 13 18:13:05.170438 dv-cinder-852009-8-iscsi devstack@n-api.service[120741]: ERROR nova.api.openstack.wsgi return self._delete(loc) Sep 13 18:13:05.170438 dv-cinder-852009-8-iscsi devstack@n-api.service[120741]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/base.py", line 313, in _delete Sep 13 18:13:05.170438 dv-cinder-852009-8-iscsi devstack@n-api.service[120741]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.delete(url) Sep 13 18:13:05.170438 dv-cinder-852009-8-iscsi devstack@n-api.service[120741]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 233, in delete Sep 13 18:13:05.170438 dv-cinder-852009-8-iscsi devstack@n-api.service[120741]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'DELETE', **kwargs) Sep 13 18:13:05.171626 dv-cinder-852009-8-iscsi devstack@n-api.service[120741]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 215, in _cs_request Sep 13 18:13:05.171626 dv-cinder-852009-8-iscsi devstack@n-api.service[120741]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) Sep 13 18:13:05.171626 dv-cinder-852009-8-iscsi devstack@n-api.service[120741]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 201, in request Sep 13 18:13:05.171626 dv-cinder-852009-8-iscsi devstack@n-api.service[120741]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) Sep 13 18:13:05.171626 dv-cinder-852009-8-iscsi devstack@n-api.service[120741]: ERROR nova.api.openstack.wsgi nova.exception.VolumeNotFound: Volume tempest-invalid-2038687077 could not be found. Sep 13 18:13:05.171626 dv-cinder-852009-8-iscsi devstack@n-api.service[120741]: ERROR nova.api.openstack.wsgi Sep 13 18:13:05.171626 dv-cinder-852009-8-iscsi devstack@n-api.service[120741]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 13 18:13:05.171626 dv-cinder-852009-8-iscsi devstack@n-api.service[120741]: ERROR nova.api.openstack.wsgi Sep 13 18:13:05.171626 dv-cinder-852009-8-iscsi devstack@n-api.service[120741]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 13 18:13:05.171626 dv-cinder-852009-8-iscsi devstack@n-api.service[120741]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 13 18:13:05.171626 dv-cinder-852009-8-iscsi devstack@n-api.service[120741]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 13 18:13:05.171626 dv-cinder-852009-8-iscsi devstack@n-api.service[120741]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 13 18:13:05.171626 dv-cinder-852009-8-iscsi devstack@n-api.service[120741]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 13 18:13:05.171626 dv-cinder-852009-8-iscsi devstack@n-api.service[120741]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Sep 13 18:13:05.171626 dv-cinder-852009-8-iscsi devstack@n-api.service[120741]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Sep 13 18:13:05.171626 dv-cinder-852009-8-iscsi devstack@n-api.service[120741]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 13 18:13:05.171626 dv-cinder-852009-8-iscsi devstack@n-api.service[120741]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 13 18:13:05.171626 dv-cinder-852009-8-iscsi devstack@n-api.service[120741]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 140, in delete Sep 13 18:13:05.171626 dv-cinder-852009-8-iscsi devstack@n-api.service[120741]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Sep 13 18:13:05.171626 dv-cinder-852009-8-iscsi devstack@n-api.service[120741]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Volume tempest-invalid-2038687077 could not be found. Sep 13 18:13:05.173376 dv-cinder-852009-8-iscsi devstack@n-api.service[120741]: ERROR nova.api.openstack.wsgi Sep 13 18:13:05.173376 dv-cinder-852009-8-iscsi devstack@n-api.service[120741]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 13 18:13:05.173376 dv-cinder-852009-8-iscsi devstack@n-api.service[120741]: ERROR nova.api.openstack.wsgi Sep 13 18:13:05.173376 dv-cinder-852009-8-iscsi devstack@n-api.service[120741]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 13 18:13:05.173376 dv-cinder-852009-8-iscsi devstack@n-api.service[120741]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 13 18:13:05.173376 dv-cinder-852009-8-iscsi devstack@n-api.service[120741]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 13 18:13:05.173376 dv-cinder-852009-8-iscsi devstack@n-api.service[120741]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 13 18:13:05.173376 dv-cinder-852009-8-iscsi devstack@n-api.service[120741]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 13 18:13:05.173376 dv-cinder-852009-8-iscsi devstack@n-api.service[120741]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Volume tempest-invalid-2038687077 could not be found. Sep 13 18:13:05.173376 dv-cinder-852009-8-iscsi devstack@n-api.service[120741]: ERROR nova.api.openstack.wsgi Sep 13 18:13:05.173376 dv-cinder-852009-8-iscsi devstack@n-api.service[120741]: DEBUG nova.api.openstack.wsgi [None req-f8cc4ef3-c8ee-45d6-94d3-a78f2d1ee119 tempest-VolumesNegativeTest-384994634 tempest-VolumesNegativeTest-384994634-project] Returning 404 to user: Volume tempest-invalid-2038687077 could not be found. {{(pid=120741) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 13 18:13:05.173376 dv-cinder-852009-8-iscsi devstack@n-api.service[120741]: INFO nova.api.openstack.requestlog [None req-f8cc4ef3-c8ee-45d6-94d3-a78f2d1ee119 tempest-VolumesNegativeTest-384994634 tempest-VolumesNegativeTest-384994634-project] 10.222.0.43 "DELETE /compute/v2.1/os-volumes/tempest-invalid-2038687077" status: 404 len: 99 microversion: 2.1 time: 0.035375 Sep 13 18:13:05.173376 dv-cinder-852009-8-iscsi devstack@n-api.service[120741]: [pid: 120741|app: 0|req: 443/896] 10.222.0.43 () {58 vars in 1218 bytes} [Tue Sep 13 18:13:05 2022] DELETE /compute/v2.1/os-volumes/tempest-invalid-2038687077 => generated 99 bytes in 36 msecs (HTTP/1.1 404) 9 headers in 378 bytes (2 switches on core 0) Sep 13 18:13:05.178169 dv-cinder-852009-8-iscsi devstack@n-api.service[120740]: INFO nova.api.openstack.requestlog [None req-bec39493-853c-4060-9cf7-97365bd30954 tempest-VolumesNegativeTest-384994634 tempest-VolumesNegativeTest-384994634-project] 10.222.0.43 "DELETE /compute/v2.1/os-volumes/" status: 404 len: 112 microversion: - time: 0.003920 Sep 13 18:13:05.178665 dv-cinder-852009-8-iscsi devstack@n-api.service[120740]: [pid: 120740|app: 0|req: 454/897] 10.222.0.43 () {58 vars in 1140 bytes} [Tue Sep 13 18:13:05 2022] DELETE /compute/v2.1/os-volumes/ => generated 112 bytes in 5 msecs (HTTP/1.1 404) 5 headers in 228 bytes (1 switches on core 0) Sep 13 18:13:05.187851 dv-cinder-852009-8-iscsi devstack@n-api.service[120741]: INFO nova.api.openstack.requestlog [None req-631e6c19-40d2-431b-845f-7f36e20cbc7e tempest-VolumesNegativeTest-384994634 tempest-VolumesNegativeTest-384994634-project] 10.222.0.43 "GET /compute/v2.1/os-volumes/" status: 404 len: 112 microversion: - time: 0.004567 Sep 13 18:13:05.188353 dv-cinder-852009-8-iscsi devstack@n-api.service[120741]: [pid: 120741|app: 0|req: 444/898] 10.222.0.43 () {58 vars in 1137 bytes} [Tue Sep 13 18:13:05 2022] GET /compute/v2.1/os-volumes/ => generated 112 bytes in 6 msecs (HTTP/1.1 404) 5 headers in 228 bytes (1 switches on core 0) Sep 13 18:13:05.196606 dv-cinder-852009-8-iscsi devstack@n-api.service[120740]: DEBUG nova.api.openstack.wsgi [None req-51794910-9f59-49dd-b34b-ef47962a0b7f tempest-VolumesNegativeTest-384994634 tempest-VolumesNegativeTest-384994634-project] Calling method '.version_select at 0x7fa626abfd30>' {{(pid=120740) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 18:13:05.225307 dv-cinder-852009-8-iscsi devstack@n-api.service[120740]: INFO nova.api.openstack.wsgi [None req-51794910-9f59-49dd-b34b-ef47962a0b7f tempest-VolumesNegativeTest-384994634 tempest-VolumesNegativeTest-384994634-project] HTTP exception thrown: Volume 99ca1f3b-4ca8-42ab-bff2-f9ca3c8f690c could not be found. Sep 13 18:13:05.227294 dv-cinder-852009-8-iscsi devstack@n-api.service[120740]: DEBUG nova.api.openstack.wsgi [None req-51794910-9f59-49dd-b34b-ef47962a0b7f tempest-VolumesNegativeTest-384994634 tempest-VolumesNegativeTest-384994634-project] Request method failure captured: Sep 13 18:13:05.227294 dv-cinder-852009-8-iscsi devstack@n-api.service[120740]: request: DELETE /compute/v2.1/os-volumes/99ca1f3b-4ca8-42ab-bff2-f9ca3c8f690c HTTP/1.1 Sep 13 18:13:05.227294 dv-cinder-852009-8-iscsi devstack@n-api.service[120740]: Accept: application/json Sep 13 18:13:05.227294 dv-cinder-852009-8-iscsi devstack@n-api.service[120740]: Accept-Encoding: identity Sep 13 18:13:05.227294 dv-cinder-852009-8-iscsi devstack@n-api.service[120740]: Connection: close Sep 13 18:13:05.227294 dv-cinder-852009-8-iscsi devstack@n-api.service[120740]: Content-Length: 0 Sep 13 18:13:05.227294 dv-cinder-852009-8-iscsi devstack@n-api.service[120740]: Content-Type: application/json Sep 13 18:13:05.227294 dv-cinder-852009-8-iscsi devstack@n-api.service[120740]: Host: 10.222.0.43 Sep 13 18:13:05.227294 dv-cinder-852009-8-iscsi devstack@n-api.service[120740]: Openstack-System-Scope: None Sep 13 18:13:05.227294 dv-cinder-852009-8-iscsi devstack@n-api.service[120740]: User-Agent: python-urllib3/1.26.12 Sep 13 18:13:05.227294 dv-cinder-852009-8-iscsi devstack@n-api.service[120740]: X-Auth-Token: gAAAAABjIMgweRYnpuHzgvWkcVyub5FUO9Yxm0fxKMQz6U9NAYkKeIm5OPrFLcxFBwgaPtdf4niuRLTX5nzMKSFVmvaBMDt8ejSTeWN3FPR9zXAo0VV5h--ojT3_qzTIH1pT7IS_xB5tC_YEgICZs2ROQsrqSnLizicxDVG2IUbZf3LsYhUJ3PQ Sep 13 18:13:05.227294 dv-cinder-852009-8-iscsi devstack@n-api.service[120740]: X-Domain-Id: None Sep 13 18:13:05.227294 dv-cinder-852009-8-iscsi devstack@n-api.service[120740]: X-Domain-Name: None Sep 13 18:13:05.227294 dv-cinder-852009-8-iscsi devstack@n-api.service[120740]: X-Identity-Status: Confirmed Sep 13 18:13:05.227294 dv-cinder-852009-8-iscsi devstack@n-api.service[120740]: X-Is-Admin-Project: True Sep 13 18:13:05.227294 dv-cinder-852009-8-iscsi devstack@n-api.service[120740]: X-Project-Domain-Id: default Sep 13 18:13:05.227294 dv-cinder-852009-8-iscsi devstack@n-api.service[120740]: X-Project-Domain-Name: Default Sep 13 18:13:05.227294 dv-cinder-852009-8-iscsi devstack@n-api.service[120740]: X-Project-Id: e3568338d5734cb1bc955838b2b067d4 Sep 13 18:13:05.227294 dv-cinder-852009-8-iscsi devstack@n-api.service[120740]: X-Project-Name: tempest-VolumesNegativeTest-384994634 Sep 13 18:13:05.227294 dv-cinder-852009-8-iscsi devstack@n-api.service[120740]: X-Role: reader,member Sep 13 18:13:05.227294 dv-cinder-852009-8-iscsi devstack@n-api.service[120740]: X-Roles: reader,member Sep 13 18:13:05.229008 dv-cinder-852009-8-iscsi devstack@n-api.service[120740]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/identity"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/compute/v2/e3568338d5734cb1bc955838b2b067d4"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.43:8080", "publicURL": "http://10.222.0.43:8080/v1/AUTH_e3568338d5734cb1bc955838b2b067d4"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43:9696/networking"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/volume/v3/e3568338d5734cb1bc955838b2b067d4"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/compute/v2.1"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/placement"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/volume/v3/e3568338d5734cb1bc955838b2b067d4"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/image"}]}] Sep 13 18:13:05.229008 dv-cinder-852009-8-iscsi devstack@n-api.service[120740]: X-Tenant: tempest-VolumesNegativeTest-384994634 Sep 13 18:13:05.229008 dv-cinder-852009-8-iscsi devstack@n-api.service[120740]: X-Tenant-Id: e3568338d5734cb1bc955838b2b067d4 Sep 13 18:13:05.229008 dv-cinder-852009-8-iscsi devstack@n-api.service[120740]: X-Tenant-Name: tempest-VolumesNegativeTest-384994634 Sep 13 18:13:05.229008 dv-cinder-852009-8-iscsi devstack@n-api.service[120740]: X-User: tempest-VolumesNegativeTest-384994634-project Sep 13 18:13:05.229008 dv-cinder-852009-8-iscsi devstack@n-api.service[120740]: X-User-Domain-Id: default Sep 13 18:13:05.229008 dv-cinder-852009-8-iscsi devstack@n-api.service[120740]: X-User-Domain-Name: Default Sep 13 18:13:05.229008 dv-cinder-852009-8-iscsi devstack@n-api.service[120740]: X-User-Id: adaf620deb034a46be1f6cdeb8257876 Sep 13 18:13:05.229008 dv-cinder-852009-8-iscsi devstack@n-api.service[120740]: X-User-Name: tempest-VolumesNegativeTest-384994634-project Sep 13 18:13:05.229008 dv-cinder-852009-8-iscsi devstack@n-api.service[120740]: method: Sep 13 18:13:05.229008 dv-cinder-852009-8-iscsi devstack@n-api.service[120740]: exception: Volume 99ca1f3b-4ca8-42ab-bff2-f9ca3c8f690c could not be found. Sep 13 18:13:05.229008 dv-cinder-852009-8-iscsi devstack@n-api.service[120740]: action_args: {'id': '99ca1f3b-4ca8-42ab-bff2-f9ca3c8f690c'} Sep 13 18:13:05.229008 dv-cinder-852009-8-iscsi devstack@n-api.service[120740]: {{(pid=120740) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 13 18:13:05.230019 dv-cinder-852009-8-iscsi devstack@n-api.service[120740]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 13 18:13:05.230019 dv-cinder-852009-8-iscsi devstack@n-api.service[120740]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 433, in wrapper Sep 13 18:13:05.230019 dv-cinder-852009-8-iscsi devstack@n-api.service[120740]: ERROR nova.api.openstack.wsgi res = method(self, ctx, volume_id, *args, **kwargs) Sep 13 18:13:05.230019 dv-cinder-852009-8-iscsi devstack@n-api.service[120740]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 676, in delete Sep 13 18:13:05.230019 dv-cinder-852009-8-iscsi devstack@n-api.service[120740]: ERROR nova.api.openstack.wsgi cinderclient(context).volumes.delete(volume_id) Sep 13 18:13:05.230019 dv-cinder-852009-8-iscsi devstack@n-api.service[120740]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volumes_base.py", line 235, in delete Sep 13 18:13:05.230019 dv-cinder-852009-8-iscsi devstack@n-api.service[120740]: ERROR nova.api.openstack.wsgi return self._delete(loc) Sep 13 18:13:05.230019 dv-cinder-852009-8-iscsi devstack@n-api.service[120740]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/base.py", line 313, in _delete Sep 13 18:13:05.230019 dv-cinder-852009-8-iscsi devstack@n-api.service[120740]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.delete(url) Sep 13 18:13:05.230019 dv-cinder-852009-8-iscsi devstack@n-api.service[120740]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 233, in delete Sep 13 18:13:05.230019 dv-cinder-852009-8-iscsi devstack@n-api.service[120740]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'DELETE', **kwargs) Sep 13 18:13:05.230019 dv-cinder-852009-8-iscsi devstack@n-api.service[120740]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 215, in _cs_request Sep 13 18:13:05.230019 dv-cinder-852009-8-iscsi devstack@n-api.service[120740]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) Sep 13 18:13:05.230019 dv-cinder-852009-8-iscsi devstack@n-api.service[120740]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 201, in request Sep 13 18:13:05.230019 dv-cinder-852009-8-iscsi devstack@n-api.service[120740]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) Sep 13 18:13:05.230019 dv-cinder-852009-8-iscsi devstack@n-api.service[120740]: ERROR nova.api.openstack.wsgi cinderclient.exceptions.NotFound: Volume 99ca1f3b-4ca8-42ab-bff2-f9ca3c8f690c could not be found. (HTTP 404) (Request-ID: req-cf94eb5c-9383-4a3f-8975-42535ea2ef1f) Sep 13 18:13:05.230019 dv-cinder-852009-8-iscsi devstack@n-api.service[120740]: ERROR nova.api.openstack.wsgi Sep 13 18:13:05.230019 dv-cinder-852009-8-iscsi devstack@n-api.service[120740]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 13 18:13:05.230019 dv-cinder-852009-8-iscsi devstack@n-api.service[120740]: ERROR nova.api.openstack.wsgi Sep 13 18:13:05.231236 dv-cinder-852009-8-iscsi devstack@n-api.service[120740]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 13 18:13:05.231236 dv-cinder-852009-8-iscsi devstack@n-api.service[120740]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 136, in delete Sep 13 18:13:05.231236 dv-cinder-852009-8-iscsi devstack@n-api.service[120740]: ERROR nova.api.openstack.wsgi self.volume_api.delete(context, id) Sep 13 18:13:05.231236 dv-cinder-852009-8-iscsi devstack@n-api.service[120740]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 395, in wrapper Sep 13 18:13:05.231236 dv-cinder-852009-8-iscsi devstack@n-api.service[120740]: ERROR nova.api.openstack.wsgi res = method(self, ctx, *args, **kwargs) Sep 13 18:13:05.231236 dv-cinder-852009-8-iscsi devstack@n-api.service[120740]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 435, in wrapper Sep 13 18:13:05.231236 dv-cinder-852009-8-iscsi devstack@n-api.service[120740]: ERROR nova.api.openstack.wsgi _reraise(exception.VolumeNotFound(volume_id=volume_id)) Sep 13 18:13:05.231236 dv-cinder-852009-8-iscsi devstack@n-api.service[120740]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 486, in _reraise Sep 13 18:13:05.231236 dv-cinder-852009-8-iscsi devstack@n-api.service[120740]: ERROR nova.api.openstack.wsgi raise desired_exc.with_traceback(sys.exc_info()[2]) Sep 13 18:13:05.231236 dv-cinder-852009-8-iscsi devstack@n-api.service[120740]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 433, in wrapper Sep 13 18:13:05.231236 dv-cinder-852009-8-iscsi devstack@n-api.service[120740]: ERROR nova.api.openstack.wsgi res = method(self, ctx, volume_id, *args, **kwargs) Sep 13 18:13:05.231236 dv-cinder-852009-8-iscsi devstack@n-api.service[120740]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 676, in delete Sep 13 18:13:05.231236 dv-cinder-852009-8-iscsi devstack@n-api.service[120740]: ERROR nova.api.openstack.wsgi cinderclient(context).volumes.delete(volume_id) Sep 13 18:13:05.231236 dv-cinder-852009-8-iscsi devstack@n-api.service[120740]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volumes_base.py", line 235, in delete Sep 13 18:13:05.231236 dv-cinder-852009-8-iscsi devstack@n-api.service[120740]: ERROR nova.api.openstack.wsgi return self._delete(loc) Sep 13 18:13:05.231236 dv-cinder-852009-8-iscsi devstack@n-api.service[120740]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/base.py", line 313, in _delete Sep 13 18:13:05.231236 dv-cinder-852009-8-iscsi devstack@n-api.service[120740]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.delete(url) Sep 13 18:13:05.231236 dv-cinder-852009-8-iscsi devstack@n-api.service[120740]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 233, in delete Sep 13 18:13:05.231236 dv-cinder-852009-8-iscsi devstack@n-api.service[120740]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'DELETE', **kwargs) Sep 13 18:13:05.232377 dv-cinder-852009-8-iscsi devstack@n-api.service[120740]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 215, in _cs_request Sep 13 18:13:05.232377 dv-cinder-852009-8-iscsi devstack@n-api.service[120740]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) Sep 13 18:13:05.232377 dv-cinder-852009-8-iscsi devstack@n-api.service[120740]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 201, in request Sep 13 18:13:05.232377 dv-cinder-852009-8-iscsi devstack@n-api.service[120740]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) Sep 13 18:13:05.232377 dv-cinder-852009-8-iscsi devstack@n-api.service[120740]: ERROR nova.api.openstack.wsgi nova.exception.VolumeNotFound: Volume 99ca1f3b-4ca8-42ab-bff2-f9ca3c8f690c could not be found. Sep 13 18:13:05.232377 dv-cinder-852009-8-iscsi devstack@n-api.service[120740]: ERROR nova.api.openstack.wsgi Sep 13 18:13:05.232377 dv-cinder-852009-8-iscsi devstack@n-api.service[120740]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 13 18:13:05.232377 dv-cinder-852009-8-iscsi devstack@n-api.service[120740]: ERROR nova.api.openstack.wsgi Sep 13 18:13:05.232377 dv-cinder-852009-8-iscsi devstack@n-api.service[120740]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 13 18:13:05.232377 dv-cinder-852009-8-iscsi devstack@n-api.service[120740]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 13 18:13:05.232377 dv-cinder-852009-8-iscsi devstack@n-api.service[120740]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 13 18:13:05.232377 dv-cinder-852009-8-iscsi devstack@n-api.service[120740]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 13 18:13:05.232377 dv-cinder-852009-8-iscsi devstack@n-api.service[120740]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 13 18:13:05.232377 dv-cinder-852009-8-iscsi devstack@n-api.service[120740]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Sep 13 18:13:05.232377 dv-cinder-852009-8-iscsi devstack@n-api.service[120740]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Sep 13 18:13:05.232377 dv-cinder-852009-8-iscsi devstack@n-api.service[120740]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 13 18:13:05.232377 dv-cinder-852009-8-iscsi devstack@n-api.service[120740]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 13 18:13:05.232377 dv-cinder-852009-8-iscsi devstack@n-api.service[120740]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 140, in delete Sep 13 18:13:05.232377 dv-cinder-852009-8-iscsi devstack@n-api.service[120740]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Sep 13 18:13:05.233581 dv-cinder-852009-8-iscsi devstack@n-api.service[120740]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Volume 99ca1f3b-4ca8-42ab-bff2-f9ca3c8f690c could not be found. Sep 13 18:13:05.233581 dv-cinder-852009-8-iscsi devstack@n-api.service[120740]: ERROR nova.api.openstack.wsgi Sep 13 18:13:05.233581 dv-cinder-852009-8-iscsi devstack@n-api.service[120740]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 13 18:13:05.233581 dv-cinder-852009-8-iscsi devstack@n-api.service[120740]: ERROR nova.api.openstack.wsgi Sep 13 18:13:05.233581 dv-cinder-852009-8-iscsi devstack@n-api.service[120740]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 13 18:13:05.233581 dv-cinder-852009-8-iscsi devstack@n-api.service[120740]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 13 18:13:05.233581 dv-cinder-852009-8-iscsi devstack@n-api.service[120740]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 13 18:13:05.233581 dv-cinder-852009-8-iscsi devstack@n-api.service[120740]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 13 18:13:05.233581 dv-cinder-852009-8-iscsi devstack@n-api.service[120740]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 13 18:13:05.233581 dv-cinder-852009-8-iscsi devstack@n-api.service[120740]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Volume 99ca1f3b-4ca8-42ab-bff2-f9ca3c8f690c could not be found. Sep 13 18:13:05.233581 dv-cinder-852009-8-iscsi devstack@n-api.service[120740]: ERROR nova.api.openstack.wsgi Sep 13 18:13:05.233581 dv-cinder-852009-8-iscsi devstack@n-api.service[120740]: DEBUG nova.api.openstack.wsgi [None req-51794910-9f59-49dd-b34b-ef47962a0b7f tempest-VolumesNegativeTest-384994634 tempest-VolumesNegativeTest-384994634-project] Returning 404 to user: Volume 99ca1f3b-4ca8-42ab-bff2-f9ca3c8f690c could not be found. {{(pid=120740) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 13 18:13:05.233581 dv-cinder-852009-8-iscsi devstack@n-api.service[120740]: INFO nova.api.openstack.requestlog [None req-51794910-9f59-49dd-b34b-ef47962a0b7f tempest-VolumesNegativeTest-384994634 tempest-VolumesNegativeTest-384994634-project] 10.222.0.43 "DELETE /compute/v2.1/os-volumes/99ca1f3b-4ca8-42ab-bff2-f9ca3c8f690c" status: 404 len: 109 microversion: 2.1 time: 0.035712 Sep 13 18:13:05.233581 dv-cinder-852009-8-iscsi devstack@n-api.service[120740]: [pid: 120740|app: 0|req: 455/899] 10.222.0.43 () {58 vars in 1248 bytes} [Tue Sep 13 18:13:05 2022] DELETE /compute/v2.1/os-volumes/99ca1f3b-4ca8-42ab-bff2-f9ca3c8f690c => generated 109 bytes in 37 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Sep 13 18:13:05.238785 dv-cinder-852009-8-iscsi devstack@n-api.service[120741]: DEBUG nova.api.openstack.wsgi [None req-b98f308f-d3ad-4934-8d5c-a127bd72f61b tempest-VolumesNegativeTest-384994634 tempest-VolumesNegativeTest-384994634-project] Calling method '.version_select at 0x7fa626d90b80>' {{(pid=120741) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 18:13:05.268009 dv-cinder-852009-8-iscsi devstack@n-api.service[120741]: INFO nova.api.openstack.wsgi [None req-b98f308f-d3ad-4934-8d5c-a127bd72f61b tempest-VolumesNegativeTest-384994634 tempest-VolumesNegativeTest-384994634-project] HTTP exception thrown: Volume 092da0af-d30d-4570-8c72-23aee0f7b353 could not be found. Sep 13 18:13:05.270414 dv-cinder-852009-8-iscsi devstack@n-api.service[120741]: DEBUG nova.api.openstack.wsgi [None req-b98f308f-d3ad-4934-8d5c-a127bd72f61b tempest-VolumesNegativeTest-384994634 tempest-VolumesNegativeTest-384994634-project] Request method failure captured: Sep 13 18:13:05.270414 dv-cinder-852009-8-iscsi devstack@n-api.service[120741]: request: GET /compute/v2.1/os-volumes/092da0af-d30d-4570-8c72-23aee0f7b353 HTTP/1.1 Sep 13 18:13:05.270414 dv-cinder-852009-8-iscsi devstack@n-api.service[120741]: Accept: application/json Sep 13 18:13:05.270414 dv-cinder-852009-8-iscsi devstack@n-api.service[120741]: Accept-Encoding: identity Sep 13 18:13:05.270414 dv-cinder-852009-8-iscsi devstack@n-api.service[120741]: Connection: close Sep 13 18:13:05.270414 dv-cinder-852009-8-iscsi devstack@n-api.service[120741]: Content-Length: 0 Sep 13 18:13:05.270414 dv-cinder-852009-8-iscsi devstack@n-api.service[120741]: Content-Type: application/json Sep 13 18:13:05.270414 dv-cinder-852009-8-iscsi devstack@n-api.service[120741]: Host: 10.222.0.43 Sep 13 18:13:05.270414 dv-cinder-852009-8-iscsi devstack@n-api.service[120741]: Openstack-System-Scope: None Sep 13 18:13:05.270414 dv-cinder-852009-8-iscsi devstack@n-api.service[120741]: User-Agent: python-urllib3/1.26.12 Sep 13 18:13:05.270414 dv-cinder-852009-8-iscsi devstack@n-api.service[120741]: X-Auth-Token: gAAAAABjIMgweRYnpuHzgvWkcVyub5FUO9Yxm0fxKMQz6U9NAYkKeIm5OPrFLcxFBwgaPtdf4niuRLTX5nzMKSFVmvaBMDt8ejSTeWN3FPR9zXAo0VV5h--ojT3_qzTIH1pT7IS_xB5tC_YEgICZs2ROQsrqSnLizicxDVG2IUbZf3LsYhUJ3PQ Sep 13 18:13:05.270414 dv-cinder-852009-8-iscsi devstack@n-api.service[120741]: X-Domain-Id: None Sep 13 18:13:05.270414 dv-cinder-852009-8-iscsi devstack@n-api.service[120741]: X-Domain-Name: None Sep 13 18:13:05.270414 dv-cinder-852009-8-iscsi devstack@n-api.service[120741]: X-Identity-Status: Confirmed Sep 13 18:13:05.270414 dv-cinder-852009-8-iscsi devstack@n-api.service[120741]: X-Is-Admin-Project: True Sep 13 18:13:05.270414 dv-cinder-852009-8-iscsi devstack@n-api.service[120741]: X-Project-Domain-Id: default Sep 13 18:13:05.270414 dv-cinder-852009-8-iscsi devstack@n-api.service[120741]: X-Project-Domain-Name: Default Sep 13 18:13:05.270414 dv-cinder-852009-8-iscsi devstack@n-api.service[120741]: X-Project-Id: e3568338d5734cb1bc955838b2b067d4 Sep 13 18:13:05.270414 dv-cinder-852009-8-iscsi devstack@n-api.service[120741]: X-Project-Name: tempest-VolumesNegativeTest-384994634 Sep 13 18:13:05.270414 dv-cinder-852009-8-iscsi devstack@n-api.service[120741]: X-Role: reader,member Sep 13 18:13:05.270414 dv-cinder-852009-8-iscsi devstack@n-api.service[120741]: X-Roles: reader,member Sep 13 18:13:05.272015 dv-cinder-852009-8-iscsi devstack@n-api.service[120741]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/identity"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/compute/v2/e3568338d5734cb1bc955838b2b067d4"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.43:8080", "publicURL": "http://10.222.0.43:8080/v1/AUTH_e3568338d5734cb1bc955838b2b067d4"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43:9696/networking"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/volume/v3/e3568338d5734cb1bc955838b2b067d4"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/compute/v2.1"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/placement"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/volume/v3/e3568338d5734cb1bc955838b2b067d4"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/image"}]}] Sep 13 18:13:05.272015 dv-cinder-852009-8-iscsi devstack@n-api.service[120741]: X-Tenant: tempest-VolumesNegativeTest-384994634 Sep 13 18:13:05.272015 dv-cinder-852009-8-iscsi devstack@n-api.service[120741]: X-Tenant-Id: e3568338d5734cb1bc955838b2b067d4 Sep 13 18:13:05.272015 dv-cinder-852009-8-iscsi devstack@n-api.service[120741]: X-Tenant-Name: tempest-VolumesNegativeTest-384994634 Sep 13 18:13:05.272015 dv-cinder-852009-8-iscsi devstack@n-api.service[120741]: X-User: tempest-VolumesNegativeTest-384994634-project Sep 13 18:13:05.272015 dv-cinder-852009-8-iscsi devstack@n-api.service[120741]: X-User-Domain-Id: default Sep 13 18:13:05.272015 dv-cinder-852009-8-iscsi devstack@n-api.service[120741]: X-User-Domain-Name: Default Sep 13 18:13:05.272015 dv-cinder-852009-8-iscsi devstack@n-api.service[120741]: X-User-Id: adaf620deb034a46be1f6cdeb8257876 Sep 13 18:13:05.272015 dv-cinder-852009-8-iscsi devstack@n-api.service[120741]: X-User-Name: tempest-VolumesNegativeTest-384994634-project Sep 13 18:13:05.272015 dv-cinder-852009-8-iscsi devstack@n-api.service[120741]: method: Sep 13 18:13:05.272015 dv-cinder-852009-8-iscsi devstack@n-api.service[120741]: exception: Volume 092da0af-d30d-4570-8c72-23aee0f7b353 could not be found. Sep 13 18:13:05.272015 dv-cinder-852009-8-iscsi devstack@n-api.service[120741]: action_args: {'id': '092da0af-d30d-4570-8c72-23aee0f7b353'} Sep 13 18:13:05.272015 dv-cinder-852009-8-iscsi devstack@n-api.service[120741]: {{(pid=120741) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 13 18:13:05.272978 dv-cinder-852009-8-iscsi devstack@n-api.service[120741]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 13 18:13:05.272978 dv-cinder-852009-8-iscsi devstack@n-api.service[120741]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 433, in wrapper Sep 13 18:13:05.272978 dv-cinder-852009-8-iscsi devstack@n-api.service[120741]: ERROR nova.api.openstack.wsgi res = method(self, ctx, volume_id, *args, **kwargs) Sep 13 18:13:05.272978 dv-cinder-852009-8-iscsi devstack@n-api.service[120741]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 502, in get Sep 13 18:13:05.272978 dv-cinder-852009-8-iscsi devstack@n-api.service[120741]: ERROR nova.api.openstack.wsgi item = cinderclient( Sep 13 18:13:05.272978 dv-cinder-852009-8-iscsi devstack@n-api.service[120741]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volumes_base.py", line 202, in get Sep 13 18:13:05.272978 dv-cinder-852009-8-iscsi devstack@n-api.service[120741]: ERROR nova.api.openstack.wsgi return self._get("/volumes/%s" % volume_id, "volume") Sep 13 18:13:05.272978 dv-cinder-852009-8-iscsi devstack@n-api.service[120741]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/base.py", line 297, in _get Sep 13 18:13:05.272978 dv-cinder-852009-8-iscsi devstack@n-api.service[120741]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.get(url) Sep 13 18:13:05.272978 dv-cinder-852009-8-iscsi devstack@n-api.service[120741]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 224, in get Sep 13 18:13:05.272978 dv-cinder-852009-8-iscsi devstack@n-api.service[120741]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'GET', **kwargs) Sep 13 18:13:05.272978 dv-cinder-852009-8-iscsi devstack@n-api.service[120741]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 215, in _cs_request Sep 13 18:13:05.272978 dv-cinder-852009-8-iscsi devstack@n-api.service[120741]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) Sep 13 18:13:05.272978 dv-cinder-852009-8-iscsi devstack@n-api.service[120741]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 201, in request Sep 13 18:13:05.272978 dv-cinder-852009-8-iscsi devstack@n-api.service[120741]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) Sep 13 18:13:05.272978 dv-cinder-852009-8-iscsi devstack@n-api.service[120741]: ERROR nova.api.openstack.wsgi cinderclient.exceptions.NotFound: Volume 092da0af-d30d-4570-8c72-23aee0f7b353 could not be found. (HTTP 404) (Request-ID: req-b22ffd0f-1803-460a-a4f2-9528e2e449d5) Sep 13 18:13:05.272978 dv-cinder-852009-8-iscsi devstack@n-api.service[120741]: ERROR nova.api.openstack.wsgi Sep 13 18:13:05.272978 dv-cinder-852009-8-iscsi devstack@n-api.service[120741]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 13 18:13:05.272978 dv-cinder-852009-8-iscsi devstack@n-api.service[120741]: ERROR nova.api.openstack.wsgi Sep 13 18:13:05.275643 dv-cinder-852009-8-iscsi devstack@n-api.service[120741]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 13 18:13:05.275643 dv-cinder-852009-8-iscsi devstack@n-api.service[120741]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 120, in show Sep 13 18:13:05.275643 dv-cinder-852009-8-iscsi devstack@n-api.service[120741]: ERROR nova.api.openstack.wsgi vol = self.volume_api.get(context, id) Sep 13 18:13:05.275643 dv-cinder-852009-8-iscsi devstack@n-api.service[120741]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 395, in wrapper Sep 13 18:13:05.275643 dv-cinder-852009-8-iscsi devstack@n-api.service[120741]: ERROR nova.api.openstack.wsgi res = method(self, ctx, *args, **kwargs) Sep 13 18:13:05.275643 dv-cinder-852009-8-iscsi devstack@n-api.service[120741]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 435, in wrapper Sep 13 18:13:05.275643 dv-cinder-852009-8-iscsi devstack@n-api.service[120741]: ERROR nova.api.openstack.wsgi _reraise(exception.VolumeNotFound(volume_id=volume_id)) Sep 13 18:13:05.275643 dv-cinder-852009-8-iscsi devstack@n-api.service[120741]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 486, in _reraise Sep 13 18:13:05.275643 dv-cinder-852009-8-iscsi devstack@n-api.service[120741]: ERROR nova.api.openstack.wsgi raise desired_exc.with_traceback(sys.exc_info()[2]) Sep 13 18:13:05.275643 dv-cinder-852009-8-iscsi devstack@n-api.service[120741]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 433, in wrapper Sep 13 18:13:05.275643 dv-cinder-852009-8-iscsi devstack@n-api.service[120741]: ERROR nova.api.openstack.wsgi res = method(self, ctx, volume_id, *args, **kwargs) Sep 13 18:13:05.275643 dv-cinder-852009-8-iscsi devstack@n-api.service[120741]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 502, in get Sep 13 18:13:05.275643 dv-cinder-852009-8-iscsi devstack@n-api.service[120741]: ERROR nova.api.openstack.wsgi item = cinderclient( Sep 13 18:13:05.275643 dv-cinder-852009-8-iscsi devstack@n-api.service[120741]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volumes_base.py", line 202, in get Sep 13 18:13:05.275643 dv-cinder-852009-8-iscsi devstack@n-api.service[120741]: ERROR nova.api.openstack.wsgi return self._get("/volumes/%s" % volume_id, "volume") Sep 13 18:13:05.275643 dv-cinder-852009-8-iscsi devstack@n-api.service[120741]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/base.py", line 297, in _get Sep 13 18:13:05.275643 dv-cinder-852009-8-iscsi devstack@n-api.service[120741]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.get(url) Sep 13 18:13:05.275643 dv-cinder-852009-8-iscsi devstack@n-api.service[120741]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 224, in get Sep 13 18:13:05.275643 dv-cinder-852009-8-iscsi devstack@n-api.service[120741]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'GET', **kwargs) Sep 13 18:13:05.276963 dv-cinder-852009-8-iscsi devstack@n-api.service[120741]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 215, in _cs_request Sep 13 18:13:05.276963 dv-cinder-852009-8-iscsi devstack@n-api.service[120741]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) Sep 13 18:13:05.276963 dv-cinder-852009-8-iscsi devstack@n-api.service[120741]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 201, in request Sep 13 18:13:05.276963 dv-cinder-852009-8-iscsi devstack@n-api.service[120741]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) Sep 13 18:13:05.276963 dv-cinder-852009-8-iscsi devstack@n-api.service[120741]: ERROR nova.api.openstack.wsgi nova.exception.VolumeNotFound: Volume 092da0af-d30d-4570-8c72-23aee0f7b353 could not be found. Sep 13 18:13:05.276963 dv-cinder-852009-8-iscsi devstack@n-api.service[120741]: ERROR nova.api.openstack.wsgi Sep 13 18:13:05.276963 dv-cinder-852009-8-iscsi devstack@n-api.service[120741]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 13 18:13:05.276963 dv-cinder-852009-8-iscsi devstack@n-api.service[120741]: ERROR nova.api.openstack.wsgi Sep 13 18:13:05.276963 dv-cinder-852009-8-iscsi devstack@n-api.service[120741]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 13 18:13:05.276963 dv-cinder-852009-8-iscsi devstack@n-api.service[120741]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 13 18:13:05.276963 dv-cinder-852009-8-iscsi devstack@n-api.service[120741]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 13 18:13:05.276963 dv-cinder-852009-8-iscsi devstack@n-api.service[120741]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 13 18:13:05.276963 dv-cinder-852009-8-iscsi devstack@n-api.service[120741]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 13 18:13:05.276963 dv-cinder-852009-8-iscsi devstack@n-api.service[120741]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Sep 13 18:13:05.276963 dv-cinder-852009-8-iscsi devstack@n-api.service[120741]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Sep 13 18:13:05.276963 dv-cinder-852009-8-iscsi devstack@n-api.service[120741]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 13 18:13:05.276963 dv-cinder-852009-8-iscsi devstack@n-api.service[120741]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 13 18:13:05.276963 dv-cinder-852009-8-iscsi devstack@n-api.service[120741]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 122, in show Sep 13 18:13:05.276963 dv-cinder-852009-8-iscsi devstack@n-api.service[120741]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Sep 13 18:13:05.278120 dv-cinder-852009-8-iscsi devstack@n-api.service[120741]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Volume 092da0af-d30d-4570-8c72-23aee0f7b353 could not be found. Sep 13 18:13:05.278120 dv-cinder-852009-8-iscsi devstack@n-api.service[120741]: ERROR nova.api.openstack.wsgi Sep 13 18:13:05.278120 dv-cinder-852009-8-iscsi devstack@n-api.service[120741]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 13 18:13:05.278120 dv-cinder-852009-8-iscsi devstack@n-api.service[120741]: ERROR nova.api.openstack.wsgi Sep 13 18:13:05.278120 dv-cinder-852009-8-iscsi devstack@n-api.service[120741]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 13 18:13:05.278120 dv-cinder-852009-8-iscsi devstack@n-api.service[120741]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 13 18:13:05.278120 dv-cinder-852009-8-iscsi devstack@n-api.service[120741]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 13 18:13:05.278120 dv-cinder-852009-8-iscsi devstack@n-api.service[120741]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 13 18:13:05.278120 dv-cinder-852009-8-iscsi devstack@n-api.service[120741]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 13 18:13:05.278120 dv-cinder-852009-8-iscsi devstack@n-api.service[120741]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Volume 092da0af-d30d-4570-8c72-23aee0f7b353 could not be found. Sep 13 18:13:05.278120 dv-cinder-852009-8-iscsi devstack@n-api.service[120741]: ERROR nova.api.openstack.wsgi Sep 13 18:13:05.278120 dv-cinder-852009-8-iscsi devstack@n-api.service[120741]: DEBUG nova.api.openstack.wsgi [None req-b98f308f-d3ad-4934-8d5c-a127bd72f61b tempest-VolumesNegativeTest-384994634 tempest-VolumesNegativeTest-384994634-project] Returning 404 to user: Volume 092da0af-d30d-4570-8c72-23aee0f7b353 could not be found. {{(pid=120741) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 13 18:13:05.278120 dv-cinder-852009-8-iscsi devstack@n-api.service[120741]: INFO nova.api.openstack.requestlog [None req-b98f308f-d3ad-4934-8d5c-a127bd72f61b tempest-VolumesNegativeTest-384994634 tempest-VolumesNegativeTest-384994634-project] 10.222.0.43 "GET /compute/v2.1/os-volumes/092da0af-d30d-4570-8c72-23aee0f7b353" status: 404 len: 109 microversion: 2.1 time: 0.037255 Sep 13 18:13:05.278120 dv-cinder-852009-8-iscsi devstack@n-api.service[120741]: [pid: 120741|app: 0|req: 445/900] 10.222.0.43 () {58 vars in 1245 bytes} [Tue Sep 13 18:13:05 2022] GET /compute/v2.1/os-volumes/092da0af-d30d-4570-8c72-23aee0f7b353 => generated 109 bytes in 39 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Sep 13 18:13:22.362228 dv-cinder-852009-8-iscsi devstack@n-api.service[120740]: DEBUG dbcounter [-] [120740] Writing DB stats nova_api:SELECT=26,nova_api:UPDATE=1,nova_api:DELETE=1 {{(pid=120740) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 18:13:22.362995 dv-cinder-852009-8-iscsi devstack@n-api.service[120740]: DEBUG dbcounter [-] [120740] Writing DB stats nova_cell1:SELECT=47,nova_cell1:UPDATE=3,nova_cell1:INSERT=2 {{(pid=120740) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 18:13:22.369660 dv-cinder-852009-8-iscsi devstack@n-api.service[120740]: DEBUG nova.api.openstack.wsgi [None req-0180388b-ae7b-42c8-8af1-c277af037ae1 tempest-VolumesActionsTest-1801161219 tempest-VolumesActionsTest-1801161219-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-VolumesActionsTest-instance-743519350", "imageRef": "33034e36-e6b2-4847-92a1-ff3188c05a4a", "flavorRef": "452", "networks": [{"uuid": "15190162-688f-4c19-9948-e86bc4326e8f"}]}} {{(pid=120740) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 13 18:13:22.424744 dv-cinder-852009-8-iscsi devstack@n-api.service[120740]: DEBUG nova.network.neutron [None req-0180388b-ae7b-42c8-8af1-c277af037ae1 tempest-VolumesActionsTest-1801161219 tempest-VolumesActionsTest-1801161219-project] validate_networks() for [('15190162-688f-4c19-9948-e86bc4326e8f', None, None, None, None, None)] {{(pid=120740) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Sep 13 18:13:22.836668 dv-cinder-852009-8-iscsi devstack@n-api.service[120740]: DEBUG nova.virt.hardware [None req-0180388b-ae7b-42c8-8af1-c277af037ae1 tempest-VolumesActionsTest-1801161219 tempest-VolumesActionsTest-1801161219-project] Flavor limits 0:0:0 {{(pid=120740) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Sep 13 18:13:22.837090 dv-cinder-852009-8-iscsi devstack@n-api.service[120740]: DEBUG nova.virt.hardware [None req-0180388b-ae7b-42c8-8af1-c277af037ae1 tempest-VolumesActionsTest-1801161219 tempest-VolumesActionsTest-1801161219-project] Image limits 0:0:0 {{(pid=120740) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Sep 13 18:13:22.837557 dv-cinder-852009-8-iscsi devstack@n-api.service[120740]: DEBUG nova.virt.hardware [None req-0180388b-ae7b-42c8-8af1-c277af037ae1 tempest-VolumesActionsTest-1801161219 tempest-VolumesActionsTest-1801161219-project] Flavor pref 0:0:0 {{(pid=120740) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Sep 13 18:13:22.837930 dv-cinder-852009-8-iscsi devstack@n-api.service[120740]: DEBUG nova.virt.hardware [None req-0180388b-ae7b-42c8-8af1-c277af037ae1 tempest-VolumesActionsTest-1801161219 tempest-VolumesActionsTest-1801161219-project] Image pref 0:0:0 {{(pid=120740) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Sep 13 18:13:22.838362 dv-cinder-852009-8-iscsi devstack@n-api.service[120740]: DEBUG nova.virt.hardware [None req-0180388b-ae7b-42c8-8af1-c277af037ae1 tempest-VolumesActionsTest-1801161219 tempest-VolumesActionsTest-1801161219-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=120740) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Sep 13 18:13:22.847992 dv-cinder-852009-8-iscsi devstack@n-api.service[120740]: DEBUG oslo_concurrency.lockutils [None req-0180388b-ae7b-42c8-8af1-c277af037ae1 tempest-VolumesActionsTest-1801161219 tempest-VolumesActionsTest-1801161219-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120740) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 18:13:22.848405 dv-cinder-852009-8-iscsi devstack@n-api.service[120740]: DEBUG oslo_concurrency.lockutils [None req-0180388b-ae7b-42c8-8af1-c277af037ae1 tempest-VolumesActionsTest-1801161219 tempest-VolumesActionsTest-1801161219-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120740) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 18:13:22.848876 dv-cinder-852009-8-iscsi devstack@n-api.service[120740]: DEBUG oslo_concurrency.lockutils [None req-0180388b-ae7b-42c8-8af1-c277af037ae1 tempest-VolumesActionsTest-1801161219 tempest-VolumesActionsTest-1801161219-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120740) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 18:13:22.849615 dv-cinder-852009-8-iscsi devstack@n-api.service[120740]: DEBUG oslo_concurrency.lockutils [None req-0180388b-ae7b-42c8-8af1-c277af037ae1 tempest-VolumesActionsTest-1801161219 tempest-VolumesActionsTest-1801161219-project] Acquiring lock "1daf4f4c-0e4a-4779-b53a-78c48397ea2f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120740) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 18:13:22.850061 dv-cinder-852009-8-iscsi devstack@n-api.service[120740]: DEBUG oslo_concurrency.lockutils [None req-0180388b-ae7b-42c8-8af1-c277af037ae1 tempest-VolumesActionsTest-1801161219 tempest-VolumesActionsTest-1801161219-project] Lock "1daf4f4c-0e4a-4779-b53a-78c48397ea2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120740) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 18:13:22.850479 dv-cinder-852009-8-iscsi devstack@n-api.service[120740]: DEBUG oslo_concurrency.lockutils [None req-0180388b-ae7b-42c8-8af1-c277af037ae1 tempest-VolumesActionsTest-1801161219 tempest-VolumesActionsTest-1801161219-project] Lock "1daf4f4c-0e4a-4779-b53a-78c48397ea2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120740) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 18:13:22.869118 dv-cinder-852009-8-iscsi devstack@n-api.service[120740]: DEBUG nova.quota [None req-0180388b-ae7b-42c8-8af1-c277af037ae1 tempest-VolumesActionsTest-1801161219 tempest-VolumesActionsTest-1801161219-project] Getting quotas for project b72151db182e445b9293d7b3b66884ef. Resources: {'cores', 'ram', 'instances'} {{(pid=120740) _get_quotas /opt/stack/nova/nova/quota.py:393}} Sep 13 18:13:22.873811 dv-cinder-852009-8-iscsi devstack@n-api.service[120740]: DEBUG nova.quota [None req-0180388b-ae7b-42c8-8af1-c277af037ae1 tempest-VolumesActionsTest-1801161219 tempest-VolumesActionsTest-1801161219-project] Getting quotas for user 2661182556d442cea0928f758fe3d57b and project b72151db182e445b9293d7b3b66884ef. Resources: {'cores', 'ram', 'instances'} {{(pid=120740) _get_quotas /opt/stack/nova/nova/quota.py:383}} Sep 13 18:13:22.886075 dv-cinder-852009-8-iscsi devstack@n-api.service[120740]: DEBUG nova.compute.api [None req-0180388b-ae7b-42c8-8af1-c277af037ae1 tempest-VolumesActionsTest-1801161219 tempest-VolumesActionsTest-1801161219-project] Going to run 1 instances... {{(pid=120740) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Sep 13 18:13:22.888379 dv-cinder-852009-8-iscsi devstack@n-api.service[120740]: DEBUG nova.compute.api [None req-0180388b-ae7b-42c8-8af1-c277af037ae1 tempest-VolumesActionsTest-1801161219 tempest-VolumesActionsTest-1801161219-project] [instance: 39daa748-6cb0-4b16-85d4-77e135544b9a] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='33034e36-e6b2-4847-92a1-ff3188c05a4a',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=120740) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Sep 13 18:13:22.936488 dv-cinder-852009-8-iscsi devstack@n-api.service[120740]: INFO nova.api.openstack.requestlog [None req-0180388b-ae7b-42c8-8af1-c277af037ae1 tempest-VolumesActionsTest-1801161219 tempest-VolumesActionsTest-1801161219-project] 10.222.0.43 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 0.575625 Sep 13 18:13:22.937486 dv-cinder-852009-8-iscsi devstack@n-api.service[120740]: [pid: 120740|app: 0|req: 456/901] 10.222.0.43 () {60 vars in 1147 bytes} [Tue Sep 13 18:13:22 2022] POST /compute/v2.1/servers => generated 380 bytes in 577 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Sep 13 18:13:22.945956 dv-cinder-852009-8-iscsi devstack@n-api.service[120741]: DEBUG dbcounter [-] [120741] Writing DB stats nova_api:SELECT=20 {{(pid=120741) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 18:13:22.946707 dv-cinder-852009-8-iscsi devstack@n-api.service[120741]: DEBUG dbcounter [-] [120741] Writing DB stats nova_cell1:SELECT=41,nova_cell1:INSERT=1 {{(pid=120741) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 18:13:22.950918 dv-cinder-852009-8-iscsi devstack@n-api.service[120741]: DEBUG nova.api.openstack.wsgi [None req-221301f5-130e-465f-b488-7fc9bfc16997 tempest-VolumesActionsTest-1801161219 tempest-VolumesActionsTest-1801161219-project] Calling method '>' {{(pid=120741) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 18:13:22.951525 dv-cinder-852009-8-iscsi devstack@n-api.service[120741]: DEBUG nova.compute.api [None req-221301f5-130e-465f-b488-7fc9bfc16997 tempest-VolumesActionsTest-1801161219 tempest-VolumesActionsTest-1801161219-project] [instance: 39daa748-6cb0-4b16-85d4-77e135544b9a] Fetching instance by UUID {{(pid=120741) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 18:13:23.010105 dv-cinder-852009-8-iscsi devstack@n-api.service[120741]: DEBUG nova.policy [None req-221301f5-130e-465f-b488-7fc9bfc16997 tempest-VolumesActionsTest-1801161219 tempest-VolumesActionsTest-1801161219-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2661182556d442cea0928f758fe3d57b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b72151db182e445b9293d7b3b66884ef', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120741) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 18:13:23.017616 dv-cinder-852009-8-iscsi devstack@n-api.service[120741]: INFO nova.api.openstack.requestlog [None req-221301f5-130e-465f-b488-7fc9bfc16997 tempest-VolumesActionsTest-1801161219 tempest-VolumesActionsTest-1801161219-project] 10.222.0.43 "GET /compute/v2.1/servers/39daa748-6cb0-4b16-85d4-77e135544b9a" status: 200 len: 1213 microversion: 2.1 time: 0.073012 Sep 13 18:13:23.018162 dv-cinder-852009-8-iscsi devstack@n-api.service[120741]: [pid: 120741|app: 0|req: 446/902] 10.222.0.43 () {58 vars in 1236 bytes} [Tue Sep 13 18:13:22 2022] GET /compute/v2.1/servers/39daa748-6cb0-4b16-85d4-77e135544b9a => generated 1213 bytes in 74 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 13 18:13:24.040484 dv-cinder-852009-8-iscsi devstack@n-api.service[120740]: DEBUG nova.api.openstack.wsgi [None req-3cab821e-3b87-4483-82e0-b7d609706a11 tempest-VolumesActionsTest-1801161219 tempest-VolumesActionsTest-1801161219-project] Calling method '>' {{(pid=120740) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 18:13:24.041126 dv-cinder-852009-8-iscsi devstack@n-api.service[120740]: DEBUG nova.compute.api [None req-3cab821e-3b87-4483-82e0-b7d609706a11 tempest-VolumesActionsTest-1801161219 tempest-VolumesActionsTest-1801161219-project] [instance: 39daa748-6cb0-4b16-85d4-77e135544b9a] Fetching instance by UUID {{(pid=120740) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 18:13:24.096556 dv-cinder-852009-8-iscsi devstack@n-api.service[120740]: DEBUG nova.policy [None req-3cab821e-3b87-4483-82e0-b7d609706a11 tempest-VolumesActionsTest-1801161219 tempest-VolumesActionsTest-1801161219-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2661182556d442cea0928f758fe3d57b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b72151db182e445b9293d7b3b66884ef', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120740) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 18:13:24.104012 dv-cinder-852009-8-iscsi devstack@n-api.service[120740]: INFO nova.api.openstack.requestlog [None req-3cab821e-3b87-4483-82e0-b7d609706a11 tempest-VolumesActionsTest-1801161219 tempest-VolumesActionsTest-1801161219-project] 10.222.0.43 "GET /compute/v2.1/servers/39daa748-6cb0-4b16-85d4-77e135544b9a" status: 200 len: 1213 microversion: 2.1 time: 0.067934 Sep 13 18:13:24.104591 dv-cinder-852009-8-iscsi devstack@n-api.service[120740]: [pid: 120740|app: 0|req: 457/903] 10.222.0.43 () {58 vars in 1236 bytes} [Tue Sep 13 18:13:24 2022] GET /compute/v2.1/servers/39daa748-6cb0-4b16-85d4-77e135544b9a => generated 1213 bytes in 69 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 13 18:13:25.130985 dv-cinder-852009-8-iscsi devstack@n-api.service[120741]: DEBUG nova.api.openstack.wsgi [None req-7e616bd2-1699-4aa8-9e95-0d3642ec8547 tempest-VolumesActionsTest-1801161219 tempest-VolumesActionsTest-1801161219-project] Calling method '>' {{(pid=120741) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 18:13:25.131930 dv-cinder-852009-8-iscsi devstack@n-api.service[120741]: DEBUG nova.compute.api [None req-7e616bd2-1699-4aa8-9e95-0d3642ec8547 tempest-VolumesActionsTest-1801161219 tempest-VolumesActionsTest-1801161219-project] [instance: 39daa748-6cb0-4b16-85d4-77e135544b9a] Fetching instance by UUID {{(pid=120741) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 18:13:25.194329 dv-cinder-852009-8-iscsi devstack@n-api.service[120741]: DEBUG nova.policy [None req-7e616bd2-1699-4aa8-9e95-0d3642ec8547 tempest-VolumesActionsTest-1801161219 tempest-VolumesActionsTest-1801161219-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2661182556d442cea0928f758fe3d57b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b72151db182e445b9293d7b3b66884ef', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120741) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 18:13:25.201812 dv-cinder-852009-8-iscsi devstack@n-api.service[120741]: INFO nova.api.openstack.requestlog [None req-7e616bd2-1699-4aa8-9e95-0d3642ec8547 tempest-VolumesActionsTest-1801161219 tempest-VolumesActionsTest-1801161219-project] 10.222.0.43 "GET /compute/v2.1/servers/39daa748-6cb0-4b16-85d4-77e135544b9a" status: 200 len: 1213 microversion: 2.1 time: 0.077527 Sep 13 18:13:25.202690 dv-cinder-852009-8-iscsi devstack@n-api.service[120741]: [pid: 120741|app: 0|req: 447/904] 10.222.0.43 () {58 vars in 1236 bytes} [Tue Sep 13 18:13:25 2022] GET /compute/v2.1/servers/39daa748-6cb0-4b16-85d4-77e135544b9a => generated 1213 bytes in 79 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 13 18:13:26.229315 dv-cinder-852009-8-iscsi devstack@n-api.service[120740]: DEBUG nova.api.openstack.wsgi [None req-c33b1189-735f-4039-8aa6-fe4770c0a9cc tempest-VolumesActionsTest-1801161219 tempest-VolumesActionsTest-1801161219-project] Calling method '>' {{(pid=120740) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 18:13:26.230314 dv-cinder-852009-8-iscsi devstack@n-api.service[120740]: DEBUG nova.compute.api [None req-c33b1189-735f-4039-8aa6-fe4770c0a9cc tempest-VolumesActionsTest-1801161219 tempest-VolumesActionsTest-1801161219-project] [instance: 39daa748-6cb0-4b16-85d4-77e135544b9a] Fetching instance by UUID {{(pid=120740) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 18:13:26.287455 dv-cinder-852009-8-iscsi devstack@n-api.service[120740]: DEBUG nova.policy [None req-c33b1189-735f-4039-8aa6-fe4770c0a9cc tempest-VolumesActionsTest-1801161219 tempest-VolumesActionsTest-1801161219-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2661182556d442cea0928f758fe3d57b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b72151db182e445b9293d7b3b66884ef', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120740) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 18:13:26.300080 dv-cinder-852009-8-iscsi devstack@n-api.service[120740]: INFO nova.api.openstack.requestlog [None req-c33b1189-735f-4039-8aa6-fe4770c0a9cc tempest-VolumesActionsTest-1801161219 tempest-VolumesActionsTest-1801161219-project] 10.222.0.43 "GET /compute/v2.1/servers/39daa748-6cb0-4b16-85d4-77e135544b9a" status: 200 len: 1213 microversion: 2.1 time: 0.077265 Sep 13 18:13:26.301439 dv-cinder-852009-8-iscsi devstack@n-api.service[120740]: [pid: 120740|app: 0|req: 458/905] 10.222.0.43 () {58 vars in 1236 bytes} [Tue Sep 13 18:13:26 2022] GET /compute/v2.1/servers/39daa748-6cb0-4b16-85d4-77e135544b9a => generated 1213 bytes in 80 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 13 18:13:27.328132 dv-cinder-852009-8-iscsi devstack@n-api.service[120741]: DEBUG nova.api.openstack.wsgi [None req-344b4e0f-ba25-4523-9aa9-27b0a878edf4 tempest-VolumesActionsTest-1801161219 tempest-VolumesActionsTest-1801161219-project] Calling method '>' {{(pid=120741) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 18:13:27.329172 dv-cinder-852009-8-iscsi devstack@n-api.service[120741]: DEBUG nova.compute.api [None req-344b4e0f-ba25-4523-9aa9-27b0a878edf4 tempest-VolumesActionsTest-1801161219 tempest-VolumesActionsTest-1801161219-project] [instance: 39daa748-6cb0-4b16-85d4-77e135544b9a] Fetching instance by UUID {{(pid=120741) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 18:13:27.341261 dv-cinder-852009-8-iscsi devstack@n-api.service[120741]: DEBUG oslo_concurrency.lockutils [None req-344b4e0f-ba25-4523-9aa9-27b0a878edf4 tempest-VolumesActionsTest-1801161219 tempest-VolumesActionsTest-1801161219-project] Acquiring lock "1daf4f4c-0e4a-4779-b53a-78c48397ea2f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120741) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 18:13:27.342075 dv-cinder-852009-8-iscsi devstack@n-api.service[120741]: DEBUG oslo_concurrency.lockutils [None req-344b4e0f-ba25-4523-9aa9-27b0a878edf4 tempest-VolumesActionsTest-1801161219 tempest-VolumesActionsTest-1801161219-project] Lock "1daf4f4c-0e4a-4779-b53a-78c48397ea2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120741) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 18:13:27.342810 dv-cinder-852009-8-iscsi devstack@n-api.service[120741]: DEBUG oslo_concurrency.lockutils [None req-344b4e0f-ba25-4523-9aa9-27b0a878edf4 tempest-VolumesActionsTest-1801161219 tempest-VolumesActionsTest-1801161219-project] Lock "1daf4f4c-0e4a-4779-b53a-78c48397ea2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120741) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 18:13:27.343958 dv-cinder-852009-8-iscsi devstack@n-api.service[120741]: DEBUG oslo_concurrency.lockutils [None req-344b4e0f-ba25-4523-9aa9-27b0a878edf4 tempest-VolumesActionsTest-1801161219 tempest-VolumesActionsTest-1801161219-project] Acquiring lock "1daf4f4c-0e4a-4779-b53a-78c48397ea2f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120741) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 18:13:27.344774 dv-cinder-852009-8-iscsi devstack@n-api.service[120741]: DEBUG oslo_concurrency.lockutils [None req-344b4e0f-ba25-4523-9aa9-27b0a878edf4 tempest-VolumesActionsTest-1801161219 tempest-VolumesActionsTest-1801161219-project] Lock "1daf4f4c-0e4a-4779-b53a-78c48397ea2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120741) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 18:13:27.345536 dv-cinder-852009-8-iscsi devstack@n-api.service[120741]: DEBUG oslo_concurrency.lockutils [None req-344b4e0f-ba25-4523-9aa9-27b0a878edf4 tempest-VolumesActionsTest-1801161219 tempest-VolumesActionsTest-1801161219-project] Lock "1daf4f4c-0e4a-4779-b53a-78c48397ea2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120741) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 18:13:27.411333 dv-cinder-852009-8-iscsi devstack@n-api.service[120741]: DEBUG nova.policy [None req-344b4e0f-ba25-4523-9aa9-27b0a878edf4 tempest-VolumesActionsTest-1801161219 tempest-VolumesActionsTest-1801161219-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2661182556d442cea0928f758fe3d57b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b72151db182e445b9293d7b3b66884ef', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120741) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 18:13:27.422362 dv-cinder-852009-8-iscsi devstack@n-api.service[120741]: INFO nova.api.openstack.requestlog [None req-344b4e0f-ba25-4523-9aa9-27b0a878edf4 tempest-VolumesActionsTest-1801161219 tempest-VolumesActionsTest-1801161219-project] 10.222.0.43 "GET /compute/v2.1/servers/39daa748-6cb0-4b16-85d4-77e135544b9a" status: 200 len: 1217 microversion: 2.1 time: 0.100548 Sep 13 18:13:27.423025 dv-cinder-852009-8-iscsi devstack@n-api.service[120741]: [pid: 120741|app: 0|req: 448/906] 10.222.0.43 () {58 vars in 1236 bytes} [Tue Sep 13 18:13:27 2022] GET /compute/v2.1/servers/39daa748-6cb0-4b16-85d4-77e135544b9a => generated 1217 bytes in 103 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 13 18:13:28.445170 dv-cinder-852009-8-iscsi devstack@n-api.service[120740]: DEBUG nova.api.openstack.wsgi [None req-9be055fb-aa82-4a59-9c51-99198574ee1a tempest-VolumesActionsTest-1801161219 tempest-VolumesActionsTest-1801161219-project] Calling method '>' {{(pid=120740) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 18:13:28.445976 dv-cinder-852009-8-iscsi devstack@n-api.service[120740]: DEBUG nova.compute.api [None req-9be055fb-aa82-4a59-9c51-99198574ee1a tempest-VolumesActionsTest-1801161219 tempest-VolumesActionsTest-1801161219-project] [instance: 39daa748-6cb0-4b16-85d4-77e135544b9a] Fetching instance by UUID {{(pid=120740) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 18:13:28.452839 dv-cinder-852009-8-iscsi devstack@n-api.service[120740]: DEBUG oslo_concurrency.lockutils [None req-9be055fb-aa82-4a59-9c51-99198574ee1a tempest-VolumesActionsTest-1801161219 tempest-VolumesActionsTest-1801161219-project] Acquiring lock "1daf4f4c-0e4a-4779-b53a-78c48397ea2f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120740) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 18:13:28.453313 dv-cinder-852009-8-iscsi devstack@n-api.service[120740]: DEBUG oslo_concurrency.lockutils [None req-9be055fb-aa82-4a59-9c51-99198574ee1a tempest-VolumesActionsTest-1801161219 tempest-VolumesActionsTest-1801161219-project] Lock "1daf4f4c-0e4a-4779-b53a-78c48397ea2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120740) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 18:13:28.453736 dv-cinder-852009-8-iscsi devstack@n-api.service[120740]: DEBUG oslo_concurrency.lockutils [None req-9be055fb-aa82-4a59-9c51-99198574ee1a tempest-VolumesActionsTest-1801161219 tempest-VolumesActionsTest-1801161219-project] Lock "1daf4f4c-0e4a-4779-b53a-78c48397ea2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120740) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 18:13:28.454412 dv-cinder-852009-8-iscsi devstack@n-api.service[120740]: DEBUG oslo_concurrency.lockutils [None req-9be055fb-aa82-4a59-9c51-99198574ee1a tempest-VolumesActionsTest-1801161219 tempest-VolumesActionsTest-1801161219-project] Acquiring lock "1daf4f4c-0e4a-4779-b53a-78c48397ea2f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120740) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 18:13:28.454965 dv-cinder-852009-8-iscsi devstack@n-api.service[120740]: DEBUG oslo_concurrency.lockutils [None req-9be055fb-aa82-4a59-9c51-99198574ee1a tempest-VolumesActionsTest-1801161219 tempest-VolumesActionsTest-1801161219-project] Lock "1daf4f4c-0e4a-4779-b53a-78c48397ea2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120740) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 18:13:28.455362 dv-cinder-852009-8-iscsi devstack@n-api.service[120740]: DEBUG oslo_concurrency.lockutils [None req-9be055fb-aa82-4a59-9c51-99198574ee1a tempest-VolumesActionsTest-1801161219 tempest-VolumesActionsTest-1801161219-project] Lock "1daf4f4c-0e4a-4779-b53a-78c48397ea2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120740) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 18:13:28.519372 dv-cinder-852009-8-iscsi devstack@n-api.service[120740]: DEBUG nova.policy [None req-9be055fb-aa82-4a59-9c51-99198574ee1a tempest-VolumesActionsTest-1801161219 tempest-VolumesActionsTest-1801161219-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2661182556d442cea0928f758fe3d57b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b72151db182e445b9293d7b3b66884ef', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120740) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 18:13:28.527670 dv-cinder-852009-8-iscsi devstack@n-api.service[120740]: INFO nova.api.openstack.requestlog [None req-9be055fb-aa82-4a59-9c51-99198574ee1a tempest-VolumesActionsTest-1801161219 tempest-VolumesActionsTest-1801161219-project] 10.222.0.43 "GET /compute/v2.1/servers/39daa748-6cb0-4b16-85d4-77e135544b9a" status: 200 len: 1271 microversion: 2.1 time: 0.086713 Sep 13 18:13:28.528626 dv-cinder-852009-8-iscsi devstack@n-api.service[120740]: [pid: 120740|app: 0|req: 459/907] 10.222.0.43 () {58 vars in 1236 bytes} [Tue Sep 13 18:13:28 2022] GET /compute/v2.1/servers/39daa748-6cb0-4b16-85d4-77e135544b9a => generated 1271 bytes in 88 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 13 18:13:29.472785 dv-cinder-852009-8-iscsi devstack@n-api.service[120741]: DEBUG nova.api.openstack.wsgi [req-64b5f8e7-7d5b-4729-b7d3-95cc442d5207 req-bcd9985e-a5ba-47f5-a817-3fead9efb790 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "39daa748-6cb0-4b16-85d4-77e135544b9a", "tag": "2291434b-09dc-4e1d-ac53-d8023018fbcb"}]} {{(pid=120741) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 13 18:13:29.484869 dv-cinder-852009-8-iscsi devstack@n-api.service[120741]: DEBUG oslo_concurrency.lockutils [req-64b5f8e7-7d5b-4729-b7d3-95cc442d5207 req-bcd9985e-a5ba-47f5-a817-3fead9efb790 service nova] Acquiring lock "1daf4f4c-0e4a-4779-b53a-78c48397ea2f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120741) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 18:13:29.485380 dv-cinder-852009-8-iscsi devstack@n-api.service[120741]: DEBUG oslo_concurrency.lockutils [req-64b5f8e7-7d5b-4729-b7d3-95cc442d5207 req-bcd9985e-a5ba-47f5-a817-3fead9efb790 service nova] Lock "1daf4f4c-0e4a-4779-b53a-78c48397ea2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120741) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 18:13:29.485835 dv-cinder-852009-8-iscsi devstack@n-api.service[120741]: DEBUG oslo_concurrency.lockutils [req-64b5f8e7-7d5b-4729-b7d3-95cc442d5207 req-bcd9985e-a5ba-47f5-a817-3fead9efb790 service nova] Lock "1daf4f4c-0e4a-4779-b53a-78c48397ea2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120741) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 18:13:29.499173 dv-cinder-852009-8-iscsi devstack@n-api.service[120741]: INFO nova.api.openstack.compute.server_external_events [req-64b5f8e7-7d5b-4729-b7d3-95cc442d5207 req-bcd9985e-a5ba-47f5-a817-3fead9efb790 service nova] Creating event network-changed:2291434b-09dc-4e1d-ac53-d8023018fbcb for instance 39daa748-6cb0-4b16-85d4-77e135544b9a on hv-cinder-85200 Sep 13 18:13:29.504336 dv-cinder-852009-8-iscsi devstack@n-api.service[120741]: INFO nova.api.openstack.requestlog [req-64b5f8e7-7d5b-4729-b7d3-95cc442d5207 req-bcd9985e-a5ba-47f5-a817-3fead9efb790 service nova] 10.222.0.43 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.035483 Sep 13 18:13:29.504976 dv-cinder-852009-8-iscsi devstack@n-api.service[120741]: [pid: 120741|app: 0|req: 449/908] 10.222.0.43 () {64 vars in 1317 bytes} [Tue Sep 13 18:13:29 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 37 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 13 18:13:29.552460 dv-cinder-852009-8-iscsi devstack@n-api.service[120740]: DEBUG nova.api.openstack.wsgi [None req-47c74cf8-f9ec-489f-a26e-8d2f05929211 tempest-VolumesActionsTest-1801161219 tempest-VolumesActionsTest-1801161219-project] Calling method '>' {{(pid=120740) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 18:13:29.553086 dv-cinder-852009-8-iscsi devstack@n-api.service[120740]: DEBUG nova.compute.api [None req-47c74cf8-f9ec-489f-a26e-8d2f05929211 tempest-VolumesActionsTest-1801161219 tempest-VolumesActionsTest-1801161219-project] [instance: 39daa748-6cb0-4b16-85d4-77e135544b9a] Fetching instance by UUID {{(pid=120740) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 18:13:29.560523 dv-cinder-852009-8-iscsi devstack@n-api.service[120740]: DEBUG oslo_concurrency.lockutils [None req-47c74cf8-f9ec-489f-a26e-8d2f05929211 tempest-VolumesActionsTest-1801161219 tempest-VolumesActionsTest-1801161219-project] Acquiring lock "1daf4f4c-0e4a-4779-b53a-78c48397ea2f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120740) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 18:13:29.560993 dv-cinder-852009-8-iscsi devstack@n-api.service[120740]: DEBUG oslo_concurrency.lockutils [None req-47c74cf8-f9ec-489f-a26e-8d2f05929211 tempest-VolumesActionsTest-1801161219 tempest-VolumesActionsTest-1801161219-project] Lock "1daf4f4c-0e4a-4779-b53a-78c48397ea2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120740) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 18:13:29.561412 dv-cinder-852009-8-iscsi devstack@n-api.service[120740]: DEBUG oslo_concurrency.lockutils [None req-47c74cf8-f9ec-489f-a26e-8d2f05929211 tempest-VolumesActionsTest-1801161219 tempest-VolumesActionsTest-1801161219-project] Lock "1daf4f4c-0e4a-4779-b53a-78c48397ea2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120740) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 18:13:29.562101 dv-cinder-852009-8-iscsi devstack@n-api.service[120740]: DEBUG oslo_concurrency.lockutils [None req-47c74cf8-f9ec-489f-a26e-8d2f05929211 tempest-VolumesActionsTest-1801161219 tempest-VolumesActionsTest-1801161219-project] Acquiring lock "1daf4f4c-0e4a-4779-b53a-78c48397ea2f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120740) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 18:13:29.562552 dv-cinder-852009-8-iscsi devstack@n-api.service[120740]: DEBUG oslo_concurrency.lockutils [None req-47c74cf8-f9ec-489f-a26e-8d2f05929211 tempest-VolumesActionsTest-1801161219 tempest-VolumesActionsTest-1801161219-project] Lock "1daf4f4c-0e4a-4779-b53a-78c48397ea2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120740) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 18:13:29.562973 dv-cinder-852009-8-iscsi devstack@n-api.service[120740]: DEBUG oslo_concurrency.lockutils [None req-47c74cf8-f9ec-489f-a26e-8d2f05929211 tempest-VolumesActionsTest-1801161219 tempest-VolumesActionsTest-1801161219-project] Lock "1daf4f4c-0e4a-4779-b53a-78c48397ea2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120740) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 18:13:29.700990 dv-cinder-852009-8-iscsi devstack@n-api.service[120740]: DEBUG nova.policy [None req-47c74cf8-f9ec-489f-a26e-8d2f05929211 tempest-VolumesActionsTest-1801161219 tempest-VolumesActionsTest-1801161219-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2661182556d442cea0928f758fe3d57b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b72151db182e445b9293d7b3b66884ef', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120740) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 18:13:29.709029 dv-cinder-852009-8-iscsi devstack@n-api.service[120740]: INFO nova.api.openstack.requestlog [None req-47c74cf8-f9ec-489f-a26e-8d2f05929211 tempest-VolumesActionsTest-1801161219 tempest-VolumesActionsTest-1801161219-project] 10.222.0.43 "GET /compute/v2.1/servers/39daa748-6cb0-4b16-85d4-77e135544b9a" status: 200 len: 1313 microversion: 2.1 time: 0.161531 Sep 13 18:13:29.709648 dv-cinder-852009-8-iscsi devstack@n-api.service[120740]: [pid: 120740|app: 0|req: 460/909] 10.222.0.43 () {58 vars in 1236 bytes} [Tue Sep 13 18:13:29 2022] GET /compute/v2.1/servers/39daa748-6cb0-4b16-85d4-77e135544b9a => generated 1313 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 13 18:13:30.734656 dv-cinder-852009-8-iscsi devstack@n-api.service[120741]: DEBUG nova.api.openstack.wsgi [None req-1de5d9f5-8906-42fe-a59b-179d7be56bad tempest-VolumesActionsTest-1801161219 tempest-VolumesActionsTest-1801161219-project] Calling method '>' {{(pid=120741) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 18:13:30.735415 dv-cinder-852009-8-iscsi devstack@n-api.service[120741]: DEBUG nova.compute.api [None req-1de5d9f5-8906-42fe-a59b-179d7be56bad tempest-VolumesActionsTest-1801161219 tempest-VolumesActionsTest-1801161219-project] [instance: 39daa748-6cb0-4b16-85d4-77e135544b9a] Fetching instance by UUID {{(pid=120741) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 18:13:30.743184 dv-cinder-852009-8-iscsi devstack@n-api.service[120741]: DEBUG oslo_concurrency.lockutils [None req-1de5d9f5-8906-42fe-a59b-179d7be56bad tempest-VolumesActionsTest-1801161219 tempest-VolumesActionsTest-1801161219-project] Acquiring lock "1daf4f4c-0e4a-4779-b53a-78c48397ea2f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120741) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 18:13:30.743851 dv-cinder-852009-8-iscsi devstack@n-api.service[120741]: DEBUG oslo_concurrency.lockutils [None req-1de5d9f5-8906-42fe-a59b-179d7be56bad tempest-VolumesActionsTest-1801161219 tempest-VolumesActionsTest-1801161219-project] Lock "1daf4f4c-0e4a-4779-b53a-78c48397ea2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120741) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 18:13:30.744280 dv-cinder-852009-8-iscsi devstack@n-api.service[120741]: DEBUG oslo_concurrency.lockutils [None req-1de5d9f5-8906-42fe-a59b-179d7be56bad tempest-VolumesActionsTest-1801161219 tempest-VolumesActionsTest-1801161219-project] Lock "1daf4f4c-0e4a-4779-b53a-78c48397ea2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120741) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 18:13:30.745017 dv-cinder-852009-8-iscsi devstack@n-api.service[120741]: DEBUG oslo_concurrency.lockutils [None req-1de5d9f5-8906-42fe-a59b-179d7be56bad tempest-VolumesActionsTest-1801161219 tempest-VolumesActionsTest-1801161219-project] Acquiring lock "1daf4f4c-0e4a-4779-b53a-78c48397ea2f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120741) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 18:13:30.745463 dv-cinder-852009-8-iscsi devstack@n-api.service[120741]: DEBUG oslo_concurrency.lockutils [None req-1de5d9f5-8906-42fe-a59b-179d7be56bad tempest-VolumesActionsTest-1801161219 tempest-VolumesActionsTest-1801161219-project] Lock "1daf4f4c-0e4a-4779-b53a-78c48397ea2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120741) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 18:13:30.746299 dv-cinder-852009-8-iscsi devstack@n-api.service[120741]: DEBUG oslo_concurrency.lockutils [None req-1de5d9f5-8906-42fe-a59b-179d7be56bad tempest-VolumesActionsTest-1801161219 tempest-VolumesActionsTest-1801161219-project] Lock "1daf4f4c-0e4a-4779-b53a-78c48397ea2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120741) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 18:13:30.875585 dv-cinder-852009-8-iscsi devstack@n-api.service[120741]: DEBUG nova.policy [None req-1de5d9f5-8906-42fe-a59b-179d7be56bad tempest-VolumesActionsTest-1801161219 tempest-VolumesActionsTest-1801161219-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2661182556d442cea0928f758fe3d57b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b72151db182e445b9293d7b3b66884ef', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120741) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 18:13:30.883559 dv-cinder-852009-8-iscsi devstack@n-api.service[120741]: INFO nova.api.openstack.requestlog [None req-1de5d9f5-8906-42fe-a59b-179d7be56bad tempest-VolumesActionsTest-1801161219 tempest-VolumesActionsTest-1801161219-project] 10.222.0.43 "GET /compute/v2.1/servers/39daa748-6cb0-4b16-85d4-77e135544b9a" status: 200 len: 1313 microversion: 2.1 time: 0.154487 Sep 13 18:13:30.884128 dv-cinder-852009-8-iscsi devstack@n-api.service[120741]: [pid: 120741|app: 0|req: 450/910] 10.222.0.43 () {58 vars in 1236 bytes} [Tue Sep 13 18:13:30 2022] GET /compute/v2.1/servers/39daa748-6cb0-4b16-85d4-77e135544b9a => generated 1313 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 13 18:13:31.907136 dv-cinder-852009-8-iscsi devstack@n-api.service[120740]: DEBUG nova.api.openstack.wsgi [None req-669a28a6-fbab-44de-b335-4587c170df50 tempest-VolumesActionsTest-1801161219 tempest-VolumesActionsTest-1801161219-project] Calling method '>' {{(pid=120740) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 18:13:31.907729 dv-cinder-852009-8-iscsi devstack@n-api.service[120740]: DEBUG nova.compute.api [None req-669a28a6-fbab-44de-b335-4587c170df50 tempest-VolumesActionsTest-1801161219 tempest-VolumesActionsTest-1801161219-project] [instance: 39daa748-6cb0-4b16-85d4-77e135544b9a] Fetching instance by UUID {{(pid=120740) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 18:13:31.914248 dv-cinder-852009-8-iscsi devstack@n-api.service[120740]: DEBUG oslo_concurrency.lockutils [None req-669a28a6-fbab-44de-b335-4587c170df50 tempest-VolumesActionsTest-1801161219 tempest-VolumesActionsTest-1801161219-project] Acquiring lock "1daf4f4c-0e4a-4779-b53a-78c48397ea2f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120740) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 18:13:31.914735 dv-cinder-852009-8-iscsi devstack@n-api.service[120740]: DEBUG oslo_concurrency.lockutils [None req-669a28a6-fbab-44de-b335-4587c170df50 tempest-VolumesActionsTest-1801161219 tempest-VolumesActionsTest-1801161219-project] Lock "1daf4f4c-0e4a-4779-b53a-78c48397ea2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120740) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 18:13:31.915164 dv-cinder-852009-8-iscsi devstack@n-api.service[120740]: DEBUG oslo_concurrency.lockutils [None req-669a28a6-fbab-44de-b335-4587c170df50 tempest-VolumesActionsTest-1801161219 tempest-VolumesActionsTest-1801161219-project] Lock "1daf4f4c-0e4a-4779-b53a-78c48397ea2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120740) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 18:13:31.915877 dv-cinder-852009-8-iscsi devstack@n-api.service[120740]: DEBUG oslo_concurrency.lockutils [None req-669a28a6-fbab-44de-b335-4587c170df50 tempest-VolumesActionsTest-1801161219 tempest-VolumesActionsTest-1801161219-project] Acquiring lock "1daf4f4c-0e4a-4779-b53a-78c48397ea2f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120740) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 18:13:31.916311 dv-cinder-852009-8-iscsi devstack@n-api.service[120740]: DEBUG oslo_concurrency.lockutils [None req-669a28a6-fbab-44de-b335-4587c170df50 tempest-VolumesActionsTest-1801161219 tempest-VolumesActionsTest-1801161219-project] Lock "1daf4f4c-0e4a-4779-b53a-78c48397ea2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120740) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 18:13:31.916751 dv-cinder-852009-8-iscsi devstack@n-api.service[120740]: DEBUG oslo_concurrency.lockutils [None req-669a28a6-fbab-44de-b335-4587c170df50 tempest-VolumesActionsTest-1801161219 tempest-VolumesActionsTest-1801161219-project] Lock "1daf4f4c-0e4a-4779-b53a-78c48397ea2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120740) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 18:13:32.053191 dv-cinder-852009-8-iscsi devstack@n-api.service[120740]: DEBUG nova.policy [None req-669a28a6-fbab-44de-b335-4587c170df50 tempest-VolumesActionsTest-1801161219 tempest-VolumesActionsTest-1801161219-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2661182556d442cea0928f758fe3d57b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b72151db182e445b9293d7b3b66884ef', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120740) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 18:13:32.061439 dv-cinder-852009-8-iscsi devstack@n-api.service[120740]: INFO nova.api.openstack.requestlog [None req-669a28a6-fbab-44de-b335-4587c170df50 tempest-VolumesActionsTest-1801161219 tempest-VolumesActionsTest-1801161219-project] 10.222.0.43 "GET /compute/v2.1/servers/39daa748-6cb0-4b16-85d4-77e135544b9a" status: 200 len: 1313 microversion: 2.1 time: 0.158101 Sep 13 18:13:32.062268 dv-cinder-852009-8-iscsi devstack@n-api.service[120740]: [pid: 120740|app: 0|req: 461/911] 10.222.0.43 () {58 vars in 1236 bytes} [Tue Sep 13 18:13:31 2022] GET /compute/v2.1/servers/39daa748-6cb0-4b16-85d4-77e135544b9a => generated 1313 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 13 18:13:33.088921 dv-cinder-852009-8-iscsi devstack@n-api.service[120741]: DEBUG nova.api.openstack.wsgi [None req-4097a087-76f7-4788-b5a3-832c7e2e9dca tempest-VolumesActionsTest-1801161219 tempest-VolumesActionsTest-1801161219-project] Calling method '>' {{(pid=120741) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 18:13:33.089925 dv-cinder-852009-8-iscsi devstack@n-api.service[120741]: DEBUG nova.compute.api [None req-4097a087-76f7-4788-b5a3-832c7e2e9dca tempest-VolumesActionsTest-1801161219 tempest-VolumesActionsTest-1801161219-project] [instance: 39daa748-6cb0-4b16-85d4-77e135544b9a] Fetching instance by UUID {{(pid=120741) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 18:13:33.099599 dv-cinder-852009-8-iscsi devstack@n-api.service[120741]: DEBUG oslo_concurrency.lockutils [None req-4097a087-76f7-4788-b5a3-832c7e2e9dca tempest-VolumesActionsTest-1801161219 tempest-VolumesActionsTest-1801161219-project] Acquiring lock "1daf4f4c-0e4a-4779-b53a-78c48397ea2f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120741) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 18:13:33.100089 dv-cinder-852009-8-iscsi devstack@n-api.service[120741]: DEBUG oslo_concurrency.lockutils [None req-4097a087-76f7-4788-b5a3-832c7e2e9dca tempest-VolumesActionsTest-1801161219 tempest-VolumesActionsTest-1801161219-project] Lock "1daf4f4c-0e4a-4779-b53a-78c48397ea2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120741) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 18:13:33.100557 dv-cinder-852009-8-iscsi devstack@n-api.service[120741]: DEBUG oslo_concurrency.lockutils [None req-4097a087-76f7-4788-b5a3-832c7e2e9dca tempest-VolumesActionsTest-1801161219 tempest-VolumesActionsTest-1801161219-project] Lock "1daf4f4c-0e4a-4779-b53a-78c48397ea2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120741) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 18:13:33.101258 dv-cinder-852009-8-iscsi devstack@n-api.service[120741]: DEBUG oslo_concurrency.lockutils [None req-4097a087-76f7-4788-b5a3-832c7e2e9dca tempest-VolumesActionsTest-1801161219 tempest-VolumesActionsTest-1801161219-project] Acquiring lock "1daf4f4c-0e4a-4779-b53a-78c48397ea2f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120741) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 18:13:33.101713 dv-cinder-852009-8-iscsi devstack@n-api.service[120741]: DEBUG oslo_concurrency.lockutils [None req-4097a087-76f7-4788-b5a3-832c7e2e9dca tempest-VolumesActionsTest-1801161219 tempest-VolumesActionsTest-1801161219-project] Lock "1daf4f4c-0e4a-4779-b53a-78c48397ea2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120741) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 18:13:33.102142 dv-cinder-852009-8-iscsi devstack@n-api.service[120741]: DEBUG oslo_concurrency.lockutils [None req-4097a087-76f7-4788-b5a3-832c7e2e9dca tempest-VolumesActionsTest-1801161219 tempest-VolumesActionsTest-1801161219-project] Lock "1daf4f4c-0e4a-4779-b53a-78c48397ea2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120741) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 18:13:33.238104 dv-cinder-852009-8-iscsi devstack@n-api.service[120741]: DEBUG nova.policy [None req-4097a087-76f7-4788-b5a3-832c7e2e9dca tempest-VolumesActionsTest-1801161219 tempest-VolumesActionsTest-1801161219-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2661182556d442cea0928f758fe3d57b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b72151db182e445b9293d7b3b66884ef', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120741) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 18:13:33.246712 dv-cinder-852009-8-iscsi devstack@n-api.service[120741]: INFO nova.api.openstack.requestlog [None req-4097a087-76f7-4788-b5a3-832c7e2e9dca tempest-VolumesActionsTest-1801161219 tempest-VolumesActionsTest-1801161219-project] 10.222.0.43 "GET /compute/v2.1/servers/39daa748-6cb0-4b16-85d4-77e135544b9a" status: 200 len: 1313 microversion: 2.1 time: 0.164030 Sep 13 18:13:33.247283 dv-cinder-852009-8-iscsi devstack@n-api.service[120741]: [pid: 120741|app: 0|req: 451/912] 10.222.0.43 () {58 vars in 1236 bytes} [Tue Sep 13 18:13:33 2022] GET /compute/v2.1/servers/39daa748-6cb0-4b16-85d4-77e135544b9a => generated 1313 bytes in 166 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 13 18:13:33.864875 dv-cinder-852009-8-iscsi devstack@n-api.service[120740]: DEBUG dbcounter [-] [120740] Writing DB stats nova_cell0:SELECT=2 {{(pid=120740) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 18:13:33.986640 dv-cinder-852009-8-iscsi devstack@n-api.service[120740]: DEBUG nova.api.openstack.wsgi [req-d03bb51c-497f-435e-acb3-03561ca5f399 req-0c76214e-fb20-4a68-8e78-084fe5137a2f service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "39daa748-6cb0-4b16-85d4-77e135544b9a", "name": "network-vif-plugged", "status": "completed", "tag": "2291434b-09dc-4e1d-ac53-d8023018fbcb"}]} {{(pid=120740) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 13 18:13:33.996660 dv-cinder-852009-8-iscsi devstack@n-api.service[120740]: DEBUG oslo_concurrency.lockutils [req-d03bb51c-497f-435e-acb3-03561ca5f399 req-0c76214e-fb20-4a68-8e78-084fe5137a2f service nova] Acquiring lock "1daf4f4c-0e4a-4779-b53a-78c48397ea2f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120740) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 18:13:33.997176 dv-cinder-852009-8-iscsi devstack@n-api.service[120740]: DEBUG oslo_concurrency.lockutils [req-d03bb51c-497f-435e-acb3-03561ca5f399 req-0c76214e-fb20-4a68-8e78-084fe5137a2f service nova] Lock "1daf4f4c-0e4a-4779-b53a-78c48397ea2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120740) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 18:13:33.997601 dv-cinder-852009-8-iscsi devstack@n-api.service[120740]: DEBUG oslo_concurrency.lockutils [req-d03bb51c-497f-435e-acb3-03561ca5f399 req-0c76214e-fb20-4a68-8e78-084fe5137a2f service nova] Lock "1daf4f4c-0e4a-4779-b53a-78c48397ea2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120740) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 18:13:34.008463 dv-cinder-852009-8-iscsi devstack@n-api.service[120740]: INFO nova.api.openstack.compute.server_external_events [req-d03bb51c-497f-435e-acb3-03561ca5f399 req-0c76214e-fb20-4a68-8e78-084fe5137a2f service nova] Creating event network-vif-plugged:2291434b-09dc-4e1d-ac53-d8023018fbcb for instance 39daa748-6cb0-4b16-85d4-77e135544b9a on hv-cinder-85200 Sep 13 18:13:34.013570 dv-cinder-852009-8-iscsi devstack@n-api.service[120740]: INFO nova.api.openstack.requestlog [req-d03bb51c-497f-435e-acb3-03561ca5f399 req-0c76214e-fb20-4a68-8e78-084fe5137a2f service nova] 10.222.0.43 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.153524 Sep 13 18:13:34.014122 dv-cinder-852009-8-iscsi devstack@n-api.service[120740]: [pid: 120740|app: 0|req: 462/913] 10.222.0.43 () {64 vars in 1317 bytes} [Tue Sep 13 18:13:33 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 13 18:13:34.270296 dv-cinder-852009-8-iscsi devstack@n-api.service[120741]: DEBUG nova.api.openstack.wsgi [None req-8652baa0-f1ab-4963-abbd-16cb1317411c tempest-VolumesActionsTest-1801161219 tempest-VolumesActionsTest-1801161219-project] Calling method '>' {{(pid=120741) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 18:13:34.270969 dv-cinder-852009-8-iscsi devstack@n-api.service[120741]: DEBUG nova.compute.api [None req-8652baa0-f1ab-4963-abbd-16cb1317411c tempest-VolumesActionsTest-1801161219 tempest-VolumesActionsTest-1801161219-project] [instance: 39daa748-6cb0-4b16-85d4-77e135544b9a] Fetching instance by UUID {{(pid=120741) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 18:13:34.277823 dv-cinder-852009-8-iscsi devstack@n-api.service[120741]: DEBUG oslo_concurrency.lockutils [None req-8652baa0-f1ab-4963-abbd-16cb1317411c tempest-VolumesActionsTest-1801161219 tempest-VolumesActionsTest-1801161219-project] Acquiring lock "1daf4f4c-0e4a-4779-b53a-78c48397ea2f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120741) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 18:13:34.278316 dv-cinder-852009-8-iscsi devstack@n-api.service[120741]: DEBUG oslo_concurrency.lockutils [None req-8652baa0-f1ab-4963-abbd-16cb1317411c tempest-VolumesActionsTest-1801161219 tempest-VolumesActionsTest-1801161219-project] Lock "1daf4f4c-0e4a-4779-b53a-78c48397ea2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120741) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 18:13:34.278743 dv-cinder-852009-8-iscsi devstack@n-api.service[120741]: DEBUG oslo_concurrency.lockutils [None req-8652baa0-f1ab-4963-abbd-16cb1317411c tempest-VolumesActionsTest-1801161219 tempest-VolumesActionsTest-1801161219-project] Lock "1daf4f4c-0e4a-4779-b53a-78c48397ea2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120741) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 18:13:34.279460 dv-cinder-852009-8-iscsi devstack@n-api.service[120741]: DEBUG oslo_concurrency.lockutils [None req-8652baa0-f1ab-4963-abbd-16cb1317411c tempest-VolumesActionsTest-1801161219 tempest-VolumesActionsTest-1801161219-project] Acquiring lock "1daf4f4c-0e4a-4779-b53a-78c48397ea2f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120741) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 18:13:34.279905 dv-cinder-852009-8-iscsi devstack@n-api.service[120741]: DEBUG oslo_concurrency.lockutils [None req-8652baa0-f1ab-4963-abbd-16cb1317411c tempest-VolumesActionsTest-1801161219 tempest-VolumesActionsTest-1801161219-project] Lock "1daf4f4c-0e4a-4779-b53a-78c48397ea2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120741) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 18:13:34.280348 dv-cinder-852009-8-iscsi devstack@n-api.service[120741]: DEBUG oslo_concurrency.lockutils [None req-8652baa0-f1ab-4963-abbd-16cb1317411c tempest-VolumesActionsTest-1801161219 tempest-VolumesActionsTest-1801161219-project] Lock "1daf4f4c-0e4a-4779-b53a-78c48397ea2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120741) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 18:13:34.416225 dv-cinder-852009-8-iscsi devstack@n-api.service[120741]: DEBUG nova.policy [None req-8652baa0-f1ab-4963-abbd-16cb1317411c tempest-VolumesActionsTest-1801161219 tempest-VolumesActionsTest-1801161219-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2661182556d442cea0928f758fe3d57b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b72151db182e445b9293d7b3b66884ef', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120741) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 18:13:34.427291 dv-cinder-852009-8-iscsi devstack@n-api.service[120741]: INFO nova.api.openstack.requestlog [None req-8652baa0-f1ab-4963-abbd-16cb1317411c tempest-VolumesActionsTest-1801161219 tempest-VolumesActionsTest-1801161219-project] 10.222.0.43 "GET /compute/v2.1/servers/39daa748-6cb0-4b16-85d4-77e135544b9a" status: 200 len: 1313 microversion: 2.1 time: 0.160684 Sep 13 18:13:34.428034 dv-cinder-852009-8-iscsi devstack@n-api.service[120741]: [pid: 120741|app: 0|req: 452/914] 10.222.0.43 () {58 vars in 1236 bytes} [Tue Sep 13 18:13:34 2022] GET /compute/v2.1/servers/39daa748-6cb0-4b16-85d4-77e135544b9a => generated 1313 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 13 18:13:35.461091 dv-cinder-852009-8-iscsi devstack@n-api.service[120740]: DEBUG nova.api.openstack.wsgi [None req-0e9106a8-8cdd-4196-9b70-e5ccf618c1b4 tempest-VolumesActionsTest-1801161219 tempest-VolumesActionsTest-1801161219-project] Calling method '>' {{(pid=120740) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 18:13:35.462097 dv-cinder-852009-8-iscsi devstack@n-api.service[120740]: DEBUG nova.compute.api [None req-0e9106a8-8cdd-4196-9b70-e5ccf618c1b4 tempest-VolumesActionsTest-1801161219 tempest-VolumesActionsTest-1801161219-project] [instance: 39daa748-6cb0-4b16-85d4-77e135544b9a] Fetching instance by UUID {{(pid=120740) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 18:13:35.473500 dv-cinder-852009-8-iscsi devstack@n-api.service[120740]: DEBUG oslo_concurrency.lockutils [None req-0e9106a8-8cdd-4196-9b70-e5ccf618c1b4 tempest-VolumesActionsTest-1801161219 tempest-VolumesActionsTest-1801161219-project] Acquiring lock "1daf4f4c-0e4a-4779-b53a-78c48397ea2f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120740) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 18:13:35.474201 dv-cinder-852009-8-iscsi devstack@n-api.service[120740]: DEBUG oslo_concurrency.lockutils [None req-0e9106a8-8cdd-4196-9b70-e5ccf618c1b4 tempest-VolumesActionsTest-1801161219 tempest-VolumesActionsTest-1801161219-project] Lock "1daf4f4c-0e4a-4779-b53a-78c48397ea2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120740) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 18:13:35.474634 dv-cinder-852009-8-iscsi devstack@n-api.service[120740]: DEBUG oslo_concurrency.lockutils [None req-0e9106a8-8cdd-4196-9b70-e5ccf618c1b4 tempest-VolumesActionsTest-1801161219 tempest-VolumesActionsTest-1801161219-project] Lock "1daf4f4c-0e4a-4779-b53a-78c48397ea2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120740) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 18:13:35.475334 dv-cinder-852009-8-iscsi devstack@n-api.service[120740]: DEBUG oslo_concurrency.lockutils [None req-0e9106a8-8cdd-4196-9b70-e5ccf618c1b4 tempest-VolumesActionsTest-1801161219 tempest-VolumesActionsTest-1801161219-project] Acquiring lock "1daf4f4c-0e4a-4779-b53a-78c48397ea2f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120740) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 18:13:35.475791 dv-cinder-852009-8-iscsi devstack@n-api.service[120740]: DEBUG oslo_concurrency.lockutils [None req-0e9106a8-8cdd-4196-9b70-e5ccf618c1b4 tempest-VolumesActionsTest-1801161219 tempest-VolumesActionsTest-1801161219-project] Lock "1daf4f4c-0e4a-4779-b53a-78c48397ea2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120740) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 18:13:35.476322 dv-cinder-852009-8-iscsi devstack@n-api.service[120740]: DEBUG oslo_concurrency.lockutils [None req-0e9106a8-8cdd-4196-9b70-e5ccf618c1b4 tempest-VolumesActionsTest-1801161219 tempest-VolumesActionsTest-1801161219-project] Lock "1daf4f4c-0e4a-4779-b53a-78c48397ea2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120740) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 18:13:35.609926 dv-cinder-852009-8-iscsi devstack@n-api.service[120740]: DEBUG nova.policy [None req-0e9106a8-8cdd-4196-9b70-e5ccf618c1b4 tempest-VolumesActionsTest-1801161219 tempest-VolumesActionsTest-1801161219-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2661182556d442cea0928f758fe3d57b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b72151db182e445b9293d7b3b66884ef', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120740) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 18:13:35.618250 dv-cinder-852009-8-iscsi devstack@n-api.service[120740]: INFO nova.api.openstack.requestlog [None req-0e9106a8-8cdd-4196-9b70-e5ccf618c1b4 tempest-VolumesActionsTest-1801161219 tempest-VolumesActionsTest-1801161219-project] 10.222.0.43 "GET /compute/v2.1/servers/39daa748-6cb0-4b16-85d4-77e135544b9a" status: 200 len: 1497 microversion: 2.1 time: 0.164552 Sep 13 18:13:35.618817 dv-cinder-852009-8-iscsi devstack@n-api.service[120740]: [pid: 120740|app: 0|req: 463/915] 10.222.0.43 () {58 vars in 1236 bytes} [Tue Sep 13 18:13:35 2022] GET /compute/v2.1/servers/39daa748-6cb0-4b16-85d4-77e135544b9a => generated 1497 bytes in 166 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 13 18:13:36.032911 dv-cinder-852009-8-iscsi devstack@n-api.service[120741]: DEBUG nova.api.openstack.wsgi [None req-f4eaa2e5-2687-4161-9d0d-f3fb7633abd7 tempest-VolumesActionsTest-1801161219 tempest-VolumesActionsTest-1801161219-project] Calling method '>' {{(pid=120741) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 18:13:36.033426 dv-cinder-852009-8-iscsi devstack@n-api.service[120741]: DEBUG nova.compute.api [None req-f4eaa2e5-2687-4161-9d0d-f3fb7633abd7 tempest-VolumesActionsTest-1801161219 tempest-VolumesActionsTest-1801161219-project] [instance: 39daa748-6cb0-4b16-85d4-77e135544b9a] Fetching instance by UUID {{(pid=120741) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 18:13:36.035366 dv-cinder-852009-8-iscsi devstack@n-api.service[120741]: DEBUG dbcounter [-] [120741] Writing DB stats nova_cell0:SELECT=4 {{(pid=120741) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 18:13:36.041787 dv-cinder-852009-8-iscsi devstack@n-api.service[120741]: DEBUG oslo_concurrency.lockutils [None req-f4eaa2e5-2687-4161-9d0d-f3fb7633abd7 tempest-VolumesActionsTest-1801161219 tempest-VolumesActionsTest-1801161219-project] Acquiring lock "1daf4f4c-0e4a-4779-b53a-78c48397ea2f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120741) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 18:13:36.042279 dv-cinder-852009-8-iscsi devstack@n-api.service[120741]: DEBUG oslo_concurrency.lockutils [None req-f4eaa2e5-2687-4161-9d0d-f3fb7633abd7 tempest-VolumesActionsTest-1801161219 tempest-VolumesActionsTest-1801161219-project] Lock "1daf4f4c-0e4a-4779-b53a-78c48397ea2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120741) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 18:13:36.042764 dv-cinder-852009-8-iscsi devstack@n-api.service[120741]: DEBUG oslo_concurrency.lockutils [None req-f4eaa2e5-2687-4161-9d0d-f3fb7633abd7 tempest-VolumesActionsTest-1801161219 tempest-VolumesActionsTest-1801161219-project] Lock "1daf4f4c-0e4a-4779-b53a-78c48397ea2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120741) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 18:13:36.043464 dv-cinder-852009-8-iscsi devstack@n-api.service[120741]: DEBUG oslo_concurrency.lockutils [None req-f4eaa2e5-2687-4161-9d0d-f3fb7633abd7 tempest-VolumesActionsTest-1801161219 tempest-VolumesActionsTest-1801161219-project] Acquiring lock "1daf4f4c-0e4a-4779-b53a-78c48397ea2f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120741) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 18:13:36.043915 dv-cinder-852009-8-iscsi devstack@n-api.service[120741]: DEBUG oslo_concurrency.lockutils [None req-f4eaa2e5-2687-4161-9d0d-f3fb7633abd7 tempest-VolumesActionsTest-1801161219 tempest-VolumesActionsTest-1801161219-project] Lock "1daf4f4c-0e4a-4779-b53a-78c48397ea2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120741) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 18:13:36.044335 dv-cinder-852009-8-iscsi devstack@n-api.service[120741]: DEBUG oslo_concurrency.lockutils [None req-f4eaa2e5-2687-4161-9d0d-f3fb7633abd7 tempest-VolumesActionsTest-1801161219 tempest-VolumesActionsTest-1801161219-project] Lock "1daf4f4c-0e4a-4779-b53a-78c48397ea2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120741) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 18:13:36.069438 dv-cinder-852009-8-iscsi devstack@n-api.service[120741]: DEBUG nova.compute.api [None req-f4eaa2e5-2687-4161-9d0d-f3fb7633abd7 tempest-VolumesActionsTest-1801161219 tempest-VolumesActionsTest-1801161219-project] [instance: 39daa748-6cb0-4b16-85d4-77e135544b9a] Going to try to terminate instance {{(pid=120741) delete /opt/stack/nova/nova/compute/api.py:2719}} Sep 13 18:13:36.149103 dv-cinder-852009-8-iscsi devstack@n-api.service[120741]: INFO nova.api.openstack.requestlog [None req-f4eaa2e5-2687-4161-9d0d-f3fb7633abd7 tempest-VolumesActionsTest-1801161219 tempest-VolumesActionsTest-1801161219-project] 10.222.0.43 "DELETE /compute/v2.1/servers/39daa748-6cb0-4b16-85d4-77e135544b9a" status: 204 len: 0 microversion: 2.1 time: 0.119746 Sep 13 18:13:36.149671 dv-cinder-852009-8-iscsi devstack@n-api.service[120741]: [pid: 120741|app: 0|req: 453/916] 10.222.0.43 () {58 vars in 1239 bytes} [Tue Sep 13 18:13:36 2022] DELETE /compute/v2.1/servers/39daa748-6cb0-4b16-85d4-77e135544b9a => generated 0 bytes in 121 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Sep 13 18:13:36.161531 dv-cinder-852009-8-iscsi devstack@n-api.service[120740]: DEBUG nova.api.openstack.wsgi [None req-1e975ab2-0e42-41b4-85a4-d0b1948e01bf tempest-VolumesActionsTest-1801161219 tempest-VolumesActionsTest-1801161219-project] Calling method '>' {{(pid=120740) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 18:13:36.163588 dv-cinder-852009-8-iscsi devstack@n-api.service[120740]: DEBUG nova.compute.api [None req-1e975ab2-0e42-41b4-85a4-d0b1948e01bf tempest-VolumesActionsTest-1801161219 tempest-VolumesActionsTest-1801161219-project] [instance: 39daa748-6cb0-4b16-85d4-77e135544b9a] Fetching instance by UUID {{(pid=120740) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 18:13:36.169776 dv-cinder-852009-8-iscsi devstack@n-api.service[120740]: DEBUG oslo_concurrency.lockutils [None req-1e975ab2-0e42-41b4-85a4-d0b1948e01bf tempest-VolumesActionsTest-1801161219 tempest-VolumesActionsTest-1801161219-project] Acquiring lock "1daf4f4c-0e4a-4779-b53a-78c48397ea2f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120740) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 18:13:36.170302 dv-cinder-852009-8-iscsi devstack@n-api.service[120740]: DEBUG oslo_concurrency.lockutils [None req-1e975ab2-0e42-41b4-85a4-d0b1948e01bf tempest-VolumesActionsTest-1801161219 tempest-VolumesActionsTest-1801161219-project] Lock "1daf4f4c-0e4a-4779-b53a-78c48397ea2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120740) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 18:13:36.170755 dv-cinder-852009-8-iscsi devstack@n-api.service[120740]: DEBUG oslo_concurrency.lockutils [None req-1e975ab2-0e42-41b4-85a4-d0b1948e01bf tempest-VolumesActionsTest-1801161219 tempest-VolumesActionsTest-1801161219-project] Lock "1daf4f4c-0e4a-4779-b53a-78c48397ea2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120740) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 18:13:36.171448 dv-cinder-852009-8-iscsi devstack@n-api.service[120740]: DEBUG oslo_concurrency.lockutils [None req-1e975ab2-0e42-41b4-85a4-d0b1948e01bf tempest-VolumesActionsTest-1801161219 tempest-VolumesActionsTest-1801161219-project] Acquiring lock "1daf4f4c-0e4a-4779-b53a-78c48397ea2f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120740) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 18:13:36.171928 dv-cinder-852009-8-iscsi devstack@n-api.service[120740]: DEBUG oslo_concurrency.lockutils [None req-1e975ab2-0e42-41b4-85a4-d0b1948e01bf tempest-VolumesActionsTest-1801161219 tempest-VolumesActionsTest-1801161219-project] Lock "1daf4f4c-0e4a-4779-b53a-78c48397ea2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120740) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 18:13:36.172344 dv-cinder-852009-8-iscsi devstack@n-api.service[120740]: DEBUG oslo_concurrency.lockutils [None req-1e975ab2-0e42-41b4-85a4-d0b1948e01bf tempest-VolumesActionsTest-1801161219 tempest-VolumesActionsTest-1801161219-project] Lock "1daf4f4c-0e4a-4779-b53a-78c48397ea2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120740) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 18:13:36.293981 dv-cinder-852009-8-iscsi devstack@n-api.service[120740]: DEBUG dbcounter [-] [120740] Writing DB stats nova_cell0:SELECT=10 {{(pid=120740) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 18:13:36.303813 dv-cinder-852009-8-iscsi devstack@n-api.service[120740]: DEBUG nova.policy [None req-1e975ab2-0e42-41b4-85a4-d0b1948e01bf tempest-VolumesActionsTest-1801161219 tempest-VolumesActionsTest-1801161219-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2661182556d442cea0928f758fe3d57b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b72151db182e445b9293d7b3b66884ef', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120740) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 18:13:36.311623 dv-cinder-852009-8-iscsi devstack@n-api.service[120740]: INFO nova.api.openstack.requestlog [None req-1e975ab2-0e42-41b4-85a4-d0b1948e01bf tempest-VolumesActionsTest-1801161219 tempest-VolumesActionsTest-1801161219-project] 10.222.0.43 "GET /compute/v2.1/servers/39daa748-6cb0-4b16-85d4-77e135544b9a" status: 200 len: 1503 microversion: 2.1 time: 0.157177 Sep 13 18:13:36.312187 dv-cinder-852009-8-iscsi devstack@n-api.service[120740]: [pid: 120740|app: 0|req: 464/917] 10.222.0.43 () {58 vars in 1236 bytes} [Tue Sep 13 18:13:36 2022] GET /compute/v2.1/servers/39daa748-6cb0-4b16-85d4-77e135544b9a => generated 1503 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 13 18:13:37.336198 dv-cinder-852009-8-iscsi devstack@n-api.service[120741]: DEBUG nova.api.openstack.wsgi [None req-7a288bd4-6b30-4c89-a0d6-32a2ea3780e5 tempest-VolumesActionsTest-1801161219 tempest-VolumesActionsTest-1801161219-project] Calling method '>' {{(pid=120741) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 18:13:37.336894 dv-cinder-852009-8-iscsi devstack@n-api.service[120741]: DEBUG nova.compute.api [None req-7a288bd4-6b30-4c89-a0d6-32a2ea3780e5 tempest-VolumesActionsTest-1801161219 tempest-VolumesActionsTest-1801161219-project] [instance: 39daa748-6cb0-4b16-85d4-77e135544b9a] Fetching instance by UUID {{(pid=120741) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 18:13:37.343756 dv-cinder-852009-8-iscsi devstack@n-api.service[120741]: DEBUG oslo_concurrency.lockutils [None req-7a288bd4-6b30-4c89-a0d6-32a2ea3780e5 tempest-VolumesActionsTest-1801161219 tempest-VolumesActionsTest-1801161219-project] Acquiring lock "1daf4f4c-0e4a-4779-b53a-78c48397ea2f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120741) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 18:13:37.344243 dv-cinder-852009-8-iscsi devstack@n-api.service[120741]: DEBUG oslo_concurrency.lockutils [None req-7a288bd4-6b30-4c89-a0d6-32a2ea3780e5 tempest-VolumesActionsTest-1801161219 tempest-VolumesActionsTest-1801161219-project] Lock "1daf4f4c-0e4a-4779-b53a-78c48397ea2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120741) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 18:13:37.344709 dv-cinder-852009-8-iscsi devstack@n-api.service[120741]: DEBUG oslo_concurrency.lockutils [None req-7a288bd4-6b30-4c89-a0d6-32a2ea3780e5 tempest-VolumesActionsTest-1801161219 tempest-VolumesActionsTest-1801161219-project] Lock "1daf4f4c-0e4a-4779-b53a-78c48397ea2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120741) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 18:13:37.345414 dv-cinder-852009-8-iscsi devstack@n-api.service[120741]: DEBUG oslo_concurrency.lockutils [None req-7a288bd4-6b30-4c89-a0d6-32a2ea3780e5 tempest-VolumesActionsTest-1801161219 tempest-VolumesActionsTest-1801161219-project] Acquiring lock "1daf4f4c-0e4a-4779-b53a-78c48397ea2f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120741) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 18:13:37.345863 dv-cinder-852009-8-iscsi devstack@n-api.service[120741]: DEBUG oslo_concurrency.lockutils [None req-7a288bd4-6b30-4c89-a0d6-32a2ea3780e5 tempest-VolumesActionsTest-1801161219 tempest-VolumesActionsTest-1801161219-project] Lock "1daf4f4c-0e4a-4779-b53a-78c48397ea2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120741) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 18:13:37.346290 dv-cinder-852009-8-iscsi devstack@n-api.service[120741]: DEBUG oslo_concurrency.lockutils [None req-7a288bd4-6b30-4c89-a0d6-32a2ea3780e5 tempest-VolumesActionsTest-1801161219 tempest-VolumesActionsTest-1801161219-project] Lock "1daf4f4c-0e4a-4779-b53a-78c48397ea2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120741) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 18:13:37.482649 dv-cinder-852009-8-iscsi devstack@n-api.service[120741]: DEBUG nova.policy [None req-7a288bd4-6b30-4c89-a0d6-32a2ea3780e5 tempest-VolumesActionsTest-1801161219 tempest-VolumesActionsTest-1801161219-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2661182556d442cea0928f758fe3d57b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b72151db182e445b9293d7b3b66884ef', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120741) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 18:13:37.490944 dv-cinder-852009-8-iscsi devstack@n-api.service[120741]: INFO nova.api.openstack.requestlog [None req-7a288bd4-6b30-4c89-a0d6-32a2ea3780e5 tempest-VolumesActionsTest-1801161219 tempest-VolumesActionsTest-1801161219-project] 10.222.0.43 "GET /compute/v2.1/servers/39daa748-6cb0-4b16-85d4-77e135544b9a" status: 200 len: 1503 microversion: 2.1 time: 0.159168 Sep 13 18:13:37.491557 dv-cinder-852009-8-iscsi devstack@n-api.service[120741]: [pid: 120741|app: 0|req: 454/918] 10.222.0.43 () {58 vars in 1236 bytes} [Tue Sep 13 18:13:37 2022] GET /compute/v2.1/servers/39daa748-6cb0-4b16-85d4-77e135544b9a => generated 1503 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 13 18:13:37.873979 dv-cinder-852009-8-iscsi devstack@n-api.service[120740]: DEBUG nova.api.openstack.wsgi [req-588e401f-0533-46d4-bb2a-7036fe332acf req-04313050-f519-40d2-9b01-779d1d945b0e service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "39daa748-6cb0-4b16-85d4-77e135544b9a", "name": "network-vif-deleted", "tag": "2291434b-09dc-4e1d-ac53-d8023018fbcb"}]} {{(pid=120740) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 13 18:13:37.884985 dv-cinder-852009-8-iscsi devstack@n-api.service[120740]: DEBUG oslo_concurrency.lockutils [req-588e401f-0533-46d4-bb2a-7036fe332acf req-04313050-f519-40d2-9b01-779d1d945b0e service nova] Acquiring lock "1daf4f4c-0e4a-4779-b53a-78c48397ea2f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120740) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 18:13:37.885552 dv-cinder-852009-8-iscsi devstack@n-api.service[120740]: DEBUG oslo_concurrency.lockutils [req-588e401f-0533-46d4-bb2a-7036fe332acf req-04313050-f519-40d2-9b01-779d1d945b0e service nova] Lock "1daf4f4c-0e4a-4779-b53a-78c48397ea2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120740) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 18:13:37.885999 dv-cinder-852009-8-iscsi devstack@n-api.service[120740]: DEBUG oslo_concurrency.lockutils [req-588e401f-0533-46d4-bb2a-7036fe332acf req-04313050-f519-40d2-9b01-779d1d945b0e service nova] Lock "1daf4f4c-0e4a-4779-b53a-78c48397ea2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120740) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 18:13:37.898294 dv-cinder-852009-8-iscsi devstack@n-api.service[120740]: INFO nova.api.openstack.compute.server_external_events [req-588e401f-0533-46d4-bb2a-7036fe332acf req-04313050-f519-40d2-9b01-779d1d945b0e service nova] Creating event network-vif-deleted:2291434b-09dc-4e1d-ac53-d8023018fbcb for instance 39daa748-6cb0-4b16-85d4-77e135544b9a on hv-cinder-85200 Sep 13 18:13:37.903260 dv-cinder-852009-8-iscsi devstack@n-api.service[120740]: INFO nova.api.openstack.requestlog [req-588e401f-0533-46d4-bb2a-7036fe332acf req-04313050-f519-40d2-9b01-779d1d945b0e service nova] 10.222.0.43 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.033289 Sep 13 18:13:37.903842 dv-cinder-852009-8-iscsi devstack@n-api.service[120740]: [pid: 120740|app: 0|req: 465/919] 10.222.0.43 () {64 vars in 1317 bytes} [Tue Sep 13 18:13:37 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 35 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 13 18:13:38.519125 dv-cinder-852009-8-iscsi devstack@n-api.service[120741]: DEBUG nova.api.openstack.wsgi [None req-52e130e2-9822-49da-aef0-3ee3aabd7f8b tempest-VolumesActionsTest-1801161219 tempest-VolumesActionsTest-1801161219-project] Calling method '>' {{(pid=120741) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 18:13:38.520046 dv-cinder-852009-8-iscsi devstack@n-api.service[120741]: DEBUG nova.compute.api [None req-52e130e2-9822-49da-aef0-3ee3aabd7f8b tempest-VolumesActionsTest-1801161219 tempest-VolumesActionsTest-1801161219-project] [instance: 39daa748-6cb0-4b16-85d4-77e135544b9a] Fetching instance by UUID {{(pid=120741) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 18:13:38.528271 dv-cinder-852009-8-iscsi devstack@n-api.service[120741]: DEBUG oslo_concurrency.lockutils [None req-52e130e2-9822-49da-aef0-3ee3aabd7f8b tempest-VolumesActionsTest-1801161219 tempest-VolumesActionsTest-1801161219-project] Acquiring lock "1daf4f4c-0e4a-4779-b53a-78c48397ea2f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120741) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 18:13:38.528717 dv-cinder-852009-8-iscsi devstack@n-api.service[120741]: DEBUG oslo_concurrency.lockutils [None req-52e130e2-9822-49da-aef0-3ee3aabd7f8b tempest-VolumesActionsTest-1801161219 tempest-VolumesActionsTest-1801161219-project] Lock "1daf4f4c-0e4a-4779-b53a-78c48397ea2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120741) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 18:13:38.529146 dv-cinder-852009-8-iscsi devstack@n-api.service[120741]: DEBUG oslo_concurrency.lockutils [None req-52e130e2-9822-49da-aef0-3ee3aabd7f8b tempest-VolumesActionsTest-1801161219 tempest-VolumesActionsTest-1801161219-project] Lock "1daf4f4c-0e4a-4779-b53a-78c48397ea2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120741) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 18:13:38.529833 dv-cinder-852009-8-iscsi devstack@n-api.service[120741]: DEBUG oslo_concurrency.lockutils [None req-52e130e2-9822-49da-aef0-3ee3aabd7f8b tempest-VolumesActionsTest-1801161219 tempest-VolumesActionsTest-1801161219-project] Acquiring lock "1daf4f4c-0e4a-4779-b53a-78c48397ea2f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120741) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 18:13:38.530285 dv-cinder-852009-8-iscsi devstack@n-api.service[120741]: DEBUG oslo_concurrency.lockutils [None req-52e130e2-9822-49da-aef0-3ee3aabd7f8b tempest-VolumesActionsTest-1801161219 tempest-VolumesActionsTest-1801161219-project] Lock "1daf4f4c-0e4a-4779-b53a-78c48397ea2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120741) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 18:13:38.530703 dv-cinder-852009-8-iscsi devstack@n-api.service[120741]: DEBUG oslo_concurrency.lockutils [None req-52e130e2-9822-49da-aef0-3ee3aabd7f8b tempest-VolumesActionsTest-1801161219 tempest-VolumesActionsTest-1801161219-project] Lock "1daf4f4c-0e4a-4779-b53a-78c48397ea2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120741) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 18:13:38.544109 dv-cinder-852009-8-iscsi devstack@n-api.service[120741]: INFO nova.api.openstack.wsgi [None req-52e130e2-9822-49da-aef0-3ee3aabd7f8b tempest-VolumesActionsTest-1801161219 tempest-VolumesActionsTest-1801161219-project] HTTP exception thrown: Instance 39daa748-6cb0-4b16-85d4-77e135544b9a could not be found. Sep 13 18:13:38.545780 dv-cinder-852009-8-iscsi devstack@n-api.service[120741]: DEBUG nova.api.openstack.wsgi [None req-52e130e2-9822-49da-aef0-3ee3aabd7f8b tempest-VolumesActionsTest-1801161219 tempest-VolumesActionsTest-1801161219-project] Request method failure captured: Sep 13 18:13:38.545780 dv-cinder-852009-8-iscsi devstack@n-api.service[120741]: request: GET /compute/v2.1/servers/39daa748-6cb0-4b16-85d4-77e135544b9a HTTP/1.1 Sep 13 18:13:38.545780 dv-cinder-852009-8-iscsi devstack@n-api.service[120741]: Accept: application/json Sep 13 18:13:38.545780 dv-cinder-852009-8-iscsi devstack@n-api.service[120741]: Accept-Encoding: identity Sep 13 18:13:38.545780 dv-cinder-852009-8-iscsi devstack@n-api.service[120741]: Connection: close Sep 13 18:13:38.545780 dv-cinder-852009-8-iscsi devstack@n-api.service[120741]: Content-Length: 0 Sep 13 18:13:38.545780 dv-cinder-852009-8-iscsi devstack@n-api.service[120741]: Content-Type: application/json Sep 13 18:13:38.545780 dv-cinder-852009-8-iscsi devstack@n-api.service[120741]: Host: 10.222.0.43 Sep 13 18:13:38.545780 dv-cinder-852009-8-iscsi devstack@n-api.service[120741]: Openstack-System-Scope: None Sep 13 18:13:38.545780 dv-cinder-852009-8-iscsi devstack@n-api.service[120741]: User-Agent: python-urllib3/1.26.12 Sep 13 18:13:38.545780 dv-cinder-852009-8-iscsi devstack@n-api.service[120741]: X-Auth-Token: gAAAAABjIMhAo6H_78_e3D42IAPooIrqsqUVKjUPNfGB_S0nmDi1kiBgW-rL2llgb3iKDlJ3zt7IvVVzI0klM7A4Edy571qcw_uothLo1Ve_kKkR_vLuLInsnkNkmNP6TjyGW-ZCUL57Bpu_ZvzkRb2xIAnQonn1AOdtZAEUszeghJcYhgzvGlo Sep 13 18:13:38.545780 dv-cinder-852009-8-iscsi devstack@n-api.service[120741]: X-Domain-Id: None Sep 13 18:13:38.545780 dv-cinder-852009-8-iscsi devstack@n-api.service[120741]: X-Domain-Name: None Sep 13 18:13:38.545780 dv-cinder-852009-8-iscsi devstack@n-api.service[120741]: X-Identity-Status: Confirmed Sep 13 18:13:38.545780 dv-cinder-852009-8-iscsi devstack@n-api.service[120741]: X-Is-Admin-Project: True Sep 13 18:13:38.545780 dv-cinder-852009-8-iscsi devstack@n-api.service[120741]: X-Project-Domain-Id: default Sep 13 18:13:38.545780 dv-cinder-852009-8-iscsi devstack@n-api.service[120741]: X-Project-Domain-Name: Default Sep 13 18:13:38.545780 dv-cinder-852009-8-iscsi devstack@n-api.service[120741]: X-Project-Id: b72151db182e445b9293d7b3b66884ef Sep 13 18:13:38.545780 dv-cinder-852009-8-iscsi devstack@n-api.service[120741]: X-Project-Name: tempest-VolumesActionsTest-1801161219 Sep 13 18:13:38.545780 dv-cinder-852009-8-iscsi devstack@n-api.service[120741]: X-Role: reader,member Sep 13 18:13:38.545780 dv-cinder-852009-8-iscsi devstack@n-api.service[120741]: X-Roles: reader,member Sep 13 18:13:38.547328 dv-cinder-852009-8-iscsi devstack@n-api.service[120741]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/identity"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/compute/v2/b72151db182e445b9293d7b3b66884ef"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.43:8080", "publicURL": "http://10.222.0.43:8080/v1/AUTH_b72151db182e445b9293d7b3b66884ef"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43:9696/networking"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/volume/v3/b72151db182e445b9293d7b3b66884ef"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/compute/v2.1"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/placement"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/volume/v3/b72151db182e445b9293d7b3b66884ef"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/image"}]}] Sep 13 18:13:38.547328 dv-cinder-852009-8-iscsi devstack@n-api.service[120741]: X-Tenant: tempest-VolumesActionsTest-1801161219 Sep 13 18:13:38.547328 dv-cinder-852009-8-iscsi devstack@n-api.service[120741]: X-Tenant-Id: b72151db182e445b9293d7b3b66884ef Sep 13 18:13:38.547328 dv-cinder-852009-8-iscsi devstack@n-api.service[120741]: X-Tenant-Name: tempest-VolumesActionsTest-1801161219 Sep 13 18:13:38.547328 dv-cinder-852009-8-iscsi devstack@n-api.service[120741]: X-User: tempest-VolumesActionsTest-1801161219-project Sep 13 18:13:38.547328 dv-cinder-852009-8-iscsi devstack@n-api.service[120741]: X-User-Domain-Id: default Sep 13 18:13:38.547328 dv-cinder-852009-8-iscsi devstack@n-api.service[120741]: X-User-Domain-Name: Default Sep 13 18:13:38.547328 dv-cinder-852009-8-iscsi devstack@n-api.service[120741]: X-User-Id: 2661182556d442cea0928f758fe3d57b Sep 13 18:13:38.547328 dv-cinder-852009-8-iscsi devstack@n-api.service[120741]: X-User-Name: tempest-VolumesActionsTest-1801161219-project Sep 13 18:13:38.547328 dv-cinder-852009-8-iscsi devstack@n-api.service[120741]: method: > Sep 13 18:13:38.547328 dv-cinder-852009-8-iscsi devstack@n-api.service[120741]: exception: Instance 39daa748-6cb0-4b16-85d4-77e135544b9a could not be found. Sep 13 18:13:38.547328 dv-cinder-852009-8-iscsi devstack@n-api.service[120741]: action_args: {'id': '39daa748-6cb0-4b16-85d4-77e135544b9a'} Sep 13 18:13:38.548222 dv-cinder-852009-8-iscsi devstack@n-api.service[120741]: {{(pid=120741) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 13 18:13:38.548222 dv-cinder-852009-8-iscsi devstack@n-api.service[120741]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 13 18:13:38.548222 dv-cinder-852009-8-iscsi devstack@n-api.service[120741]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Sep 13 18:13:38.548222 dv-cinder-852009-8-iscsi devstack@n-api.service[120741]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Sep 13 18:13:38.548222 dv-cinder-852009-8-iscsi devstack@n-api.service[120741]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Sep 13 18:13:38.548222 dv-cinder-852009-8-iscsi devstack@n-api.service[120741]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Sep 13 18:13:38.548222 dv-cinder-852009-8-iscsi devstack@n-api.service[120741]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Sep 13 18:13:38.548222 dv-cinder-852009-8-iscsi devstack@n-api.service[120741]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Sep 13 18:13:38.548222 dv-cinder-852009-8-iscsi devstack@n-api.service[120741]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Sep 13 18:13:38.548222 dv-cinder-852009-8-iscsi devstack@n-api.service[120741]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Sep 13 18:13:38.548222 dv-cinder-852009-8-iscsi devstack@n-api.service[120741]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 39daa748-6cb0-4b16-85d4-77e135544b9a could not be found. Sep 13 18:13:38.548222 dv-cinder-852009-8-iscsi devstack@n-api.service[120741]: ERROR nova.api.openstack.wsgi Sep 13 18:13:38.548222 dv-cinder-852009-8-iscsi devstack@n-api.service[120741]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 13 18:13:38.548222 dv-cinder-852009-8-iscsi devstack@n-api.service[120741]: ERROR nova.api.openstack.wsgi Sep 13 18:13:38.548222 dv-cinder-852009-8-iscsi devstack@n-api.service[120741]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 13 18:13:38.548222 dv-cinder-852009-8-iscsi devstack@n-api.service[120741]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 13 18:13:38.548222 dv-cinder-852009-8-iscsi devstack@n-api.service[120741]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 13 18:13:38.548222 dv-cinder-852009-8-iscsi devstack@n-api.service[120741]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 13 18:13:38.548222 dv-cinder-852009-8-iscsi devstack@n-api.service[120741]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 13 18:13:38.548222 dv-cinder-852009-8-iscsi devstack@n-api.service[120741]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 13 18:13:38.549800 dv-cinder-852009-8-iscsi devstack@n-api.service[120741]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 13 18:13:38.549800 dv-cinder-852009-8-iscsi devstack@n-api.service[120741]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Sep 13 18:13:38.549800 dv-cinder-852009-8-iscsi devstack@n-api.service[120741]: ERROR nova.api.openstack.wsgi instance = self._get_server( Sep 13 18:13:38.549800 dv-cinder-852009-8-iscsi devstack@n-api.service[120741]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Sep 13 18:13:38.549800 dv-cinder-852009-8-iscsi devstack@n-api.service[120741]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Sep 13 18:13:38.549800 dv-cinder-852009-8-iscsi devstack@n-api.service[120741]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Sep 13 18:13:38.549800 dv-cinder-852009-8-iscsi devstack@n-api.service[120741]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Sep 13 18:13:38.549800 dv-cinder-852009-8-iscsi devstack@n-api.service[120741]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 39daa748-6cb0-4b16-85d4-77e135544b9a could not be found. Sep 13 18:13:38.549800 dv-cinder-852009-8-iscsi devstack@n-api.service[120741]: ERROR nova.api.openstack.wsgi Sep 13 18:13:38.549800 dv-cinder-852009-8-iscsi devstack@n-api.service[120741]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 13 18:13:38.549800 dv-cinder-852009-8-iscsi devstack@n-api.service[120741]: ERROR nova.api.openstack.wsgi Sep 13 18:13:38.549800 dv-cinder-852009-8-iscsi devstack@n-api.service[120741]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 13 18:13:38.549800 dv-cinder-852009-8-iscsi devstack@n-api.service[120741]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 13 18:13:38.549800 dv-cinder-852009-8-iscsi devstack@n-api.service[120741]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 13 18:13:38.549800 dv-cinder-852009-8-iscsi devstack@n-api.service[120741]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 13 18:13:38.549800 dv-cinder-852009-8-iscsi devstack@n-api.service[120741]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 13 18:13:38.549800 dv-cinder-852009-8-iscsi devstack@n-api.service[120741]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 39daa748-6cb0-4b16-85d4-77e135544b9a could not be found. Sep 13 18:13:38.549800 dv-cinder-852009-8-iscsi devstack@n-api.service[120741]: ERROR nova.api.openstack.wsgi Sep 13 18:13:38.551162 dv-cinder-852009-8-iscsi devstack@n-api.service[120741]: DEBUG nova.api.openstack.wsgi [None req-52e130e2-9822-49da-aef0-3ee3aabd7f8b tempest-VolumesActionsTest-1801161219 tempest-VolumesActionsTest-1801161219-project] Returning 404 to user: Instance 39daa748-6cb0-4b16-85d4-77e135544b9a could not be found. {{(pid=120741) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 13 18:13:38.551162 dv-cinder-852009-8-iscsi devstack@n-api.service[120741]: INFO nova.api.openstack.requestlog [None req-52e130e2-9822-49da-aef0-3ee3aabd7f8b tempest-VolumesActionsTest-1801161219 tempest-VolumesActionsTest-1801161219-project] 10.222.0.43 "GET /compute/v2.1/servers/39daa748-6cb0-4b16-85d4-77e135544b9a" status: 404 len: 111 microversion: 2.1 time: 0.034702 Sep 13 18:13:38.551162 dv-cinder-852009-8-iscsi devstack@n-api.service[120741]: [pid: 120741|app: 0|req: 455/920] 10.222.0.43 () {58 vars in 1236 bytes} [Tue Sep 13 18:13:38 2022] GET /compute/v2.1/servers/39daa748-6cb0-4b16-85d4-77e135544b9a => generated 111 bytes in 36 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Sep 13 18:13:38.598744 dv-cinder-852009-8-iscsi devstack@n-api.service[120740]: DEBUG nova.api.openstack.wsgi [None req-26faab91-248c-4d95-af99-4ac36c5d6809 tempest-VolumesActionsTest-1801161219 tempest-VolumesActionsTest-1801161219-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-VolumesActionsTest-instance-612076179", "imageRef": "33034e36-e6b2-4847-92a1-ff3188c05a4a", "flavorRef": "452", "networks": [{"uuid": "15190162-688f-4c19-9948-e86bc4326e8f"}]}} {{(pid=120740) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 13 18:13:38.667565 dv-cinder-852009-8-iscsi devstack@n-api.service[120740]: DEBUG nova.network.neutron [None req-26faab91-248c-4d95-af99-4ac36c5d6809 tempest-VolumesActionsTest-1801161219 tempest-VolumesActionsTest-1801161219-project] validate_networks() for [('15190162-688f-4c19-9948-e86bc4326e8f', None, None, None, None, None)] {{(pid=120740) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Sep 13 18:13:39.017863 dv-cinder-852009-8-iscsi devstack@n-api.service[120740]: DEBUG nova.virt.hardware [None req-26faab91-248c-4d95-af99-4ac36c5d6809 tempest-VolumesActionsTest-1801161219 tempest-VolumesActionsTest-1801161219-project] Flavor limits 0:0:0 {{(pid=120740) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Sep 13 18:13:39.018475 dv-cinder-852009-8-iscsi devstack@n-api.service[120740]: DEBUG nova.virt.hardware [None req-26faab91-248c-4d95-af99-4ac36c5d6809 tempest-VolumesActionsTest-1801161219 tempest-VolumesActionsTest-1801161219-project] Image limits 0:0:0 {{(pid=120740) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Sep 13 18:13:39.018732 dv-cinder-852009-8-iscsi devstack@n-api.service[120740]: DEBUG nova.virt.hardware [None req-26faab91-248c-4d95-af99-4ac36c5d6809 tempest-VolumesActionsTest-1801161219 tempest-VolumesActionsTest-1801161219-project] Flavor pref 0:0:0 {{(pid=120740) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Sep 13 18:13:39.019131 dv-cinder-852009-8-iscsi devstack@n-api.service[120740]: DEBUG nova.virt.hardware [None req-26faab91-248c-4d95-af99-4ac36c5d6809 tempest-VolumesActionsTest-1801161219 tempest-VolumesActionsTest-1801161219-project] Image pref 0:0:0 {{(pid=120740) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Sep 13 18:13:39.019536 dv-cinder-852009-8-iscsi devstack@n-api.service[120740]: DEBUG nova.virt.hardware [None req-26faab91-248c-4d95-af99-4ac36c5d6809 tempest-VolumesActionsTest-1801161219 tempest-VolumesActionsTest-1801161219-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=120740) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Sep 13 18:13:39.029127 dv-cinder-852009-8-iscsi devstack@n-api.service[120740]: DEBUG oslo_concurrency.lockutils [None req-26faab91-248c-4d95-af99-4ac36c5d6809 tempest-VolumesActionsTest-1801161219 tempest-VolumesActionsTest-1801161219-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120740) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 18:13:39.029606 dv-cinder-852009-8-iscsi devstack@n-api.service[120740]: DEBUG oslo_concurrency.lockutils [None req-26faab91-248c-4d95-af99-4ac36c5d6809 tempest-VolumesActionsTest-1801161219 tempest-VolumesActionsTest-1801161219-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120740) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 18:13:39.030033 dv-cinder-852009-8-iscsi devstack@n-api.service[120740]: DEBUG oslo_concurrency.lockutils [None req-26faab91-248c-4d95-af99-4ac36c5d6809 tempest-VolumesActionsTest-1801161219 tempest-VolumesActionsTest-1801161219-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120740) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 18:13:39.030818 dv-cinder-852009-8-iscsi devstack@n-api.service[120740]: DEBUG oslo_concurrency.lockutils [None req-26faab91-248c-4d95-af99-4ac36c5d6809 tempest-VolumesActionsTest-1801161219 tempest-VolumesActionsTest-1801161219-project] Acquiring lock "1daf4f4c-0e4a-4779-b53a-78c48397ea2f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120740) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 18:13:39.031199 dv-cinder-852009-8-iscsi devstack@n-api.service[120740]: DEBUG oslo_concurrency.lockutils [None req-26faab91-248c-4d95-af99-4ac36c5d6809 tempest-VolumesActionsTest-1801161219 tempest-VolumesActionsTest-1801161219-project] Lock "1daf4f4c-0e4a-4779-b53a-78c48397ea2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120740) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 18:13:39.031614 dv-cinder-852009-8-iscsi devstack@n-api.service[120740]: DEBUG oslo_concurrency.lockutils [None req-26faab91-248c-4d95-af99-4ac36c5d6809 tempest-VolumesActionsTest-1801161219 tempest-VolumesActionsTest-1801161219-project] Lock "1daf4f4c-0e4a-4779-b53a-78c48397ea2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120740) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 18:13:39.048351 dv-cinder-852009-8-iscsi devstack@n-api.service[120740]: DEBUG nova.quota [None req-26faab91-248c-4d95-af99-4ac36c5d6809 tempest-VolumesActionsTest-1801161219 tempest-VolumesActionsTest-1801161219-project] Getting quotas for project b72151db182e445b9293d7b3b66884ef. Resources: {'cores', 'ram', 'instances'} {{(pid=120740) _get_quotas /opt/stack/nova/nova/quota.py:393}} Sep 13 18:13:39.052723 dv-cinder-852009-8-iscsi devstack@n-api.service[120740]: DEBUG nova.quota [None req-26faab91-248c-4d95-af99-4ac36c5d6809 tempest-VolumesActionsTest-1801161219 tempest-VolumesActionsTest-1801161219-project] Getting quotas for user 2661182556d442cea0928f758fe3d57b and project b72151db182e445b9293d7b3b66884ef. Resources: {'cores', 'ram', 'instances'} {{(pid=120740) _get_quotas /opt/stack/nova/nova/quota.py:383}} Sep 13 18:13:39.063615 dv-cinder-852009-8-iscsi devstack@n-api.service[120740]: DEBUG nova.compute.api [None req-26faab91-248c-4d95-af99-4ac36c5d6809 tempest-VolumesActionsTest-1801161219 tempest-VolumesActionsTest-1801161219-project] Going to run 1 instances... {{(pid=120740) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Sep 13 18:13:39.066022 dv-cinder-852009-8-iscsi devstack@n-api.service[120740]: DEBUG nova.compute.api [None req-26faab91-248c-4d95-af99-4ac36c5d6809 tempest-VolumesActionsTest-1801161219 tempest-VolumesActionsTest-1801161219-project] [instance: 27ffa62d-e611-4fee-a81d-f508d8d8f7e8] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='33034e36-e6b2-4847-92a1-ff3188c05a4a',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=120740) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Sep 13 18:13:39.112028 dv-cinder-852009-8-iscsi devstack@n-api.service[120740]: INFO nova.api.openstack.requestlog [None req-26faab91-248c-4d95-af99-4ac36c5d6809 tempest-VolumesActionsTest-1801161219 tempest-VolumesActionsTest-1801161219-project] 10.222.0.43 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 0.517537 Sep 13 18:13:39.112733 dv-cinder-852009-8-iscsi devstack@n-api.service[120740]: [pid: 120740|app: 0|req: 466/921] 10.222.0.43 () {60 vars in 1147 bytes} [Tue Sep 13 18:13:38 2022] POST /compute/v2.1/servers => generated 380 bytes in 519 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Sep 13 18:13:39.124381 dv-cinder-852009-8-iscsi devstack@n-api.service[120741]: DEBUG nova.api.openstack.wsgi [None req-cd2b1bdf-992a-4705-85d1-b1a506890282 tempest-VolumesActionsTest-1801161219 tempest-VolumesActionsTest-1801161219-project] Calling method '>' {{(pid=120741) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 18:13:39.125098 dv-cinder-852009-8-iscsi devstack@n-api.service[120741]: DEBUG nova.compute.api [None req-cd2b1bdf-992a-4705-85d1-b1a506890282 tempest-VolumesActionsTest-1801161219 tempest-VolumesActionsTest-1801161219-project] [instance: 27ffa62d-e611-4fee-a81d-f508d8d8f7e8] Fetching instance by UUID {{(pid=120741) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 18:13:39.177973 dv-cinder-852009-8-iscsi devstack@n-api.service[120741]: DEBUG nova.policy [None req-cd2b1bdf-992a-4705-85d1-b1a506890282 tempest-VolumesActionsTest-1801161219 tempest-VolumesActionsTest-1801161219-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2661182556d442cea0928f758fe3d57b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b72151db182e445b9293d7b3b66884ef', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120741) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 18:13:39.185193 dv-cinder-852009-8-iscsi devstack@n-api.service[120741]: INFO nova.api.openstack.requestlog [None req-cd2b1bdf-992a-4705-85d1-b1a506890282 tempest-VolumesActionsTest-1801161219 tempest-VolumesActionsTest-1801161219-project] 10.222.0.43 "GET /compute/v2.1/servers/27ffa62d-e611-4fee-a81d-f508d8d8f7e8" status: 200 len: 1213 microversion: 2.1 time: 0.065169 Sep 13 18:13:39.185790 dv-cinder-852009-8-iscsi devstack@n-api.service[120741]: [pid: 120741|app: 0|req: 456/922] 10.222.0.43 () {58 vars in 1236 bytes} [Tue Sep 13 18:13:39 2022] GET /compute/v2.1/servers/27ffa62d-e611-4fee-a81d-f508d8d8f7e8 => generated 1213 bytes in 66 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 13 18:13:40.208632 dv-cinder-852009-8-iscsi devstack@n-api.service[120740]: DEBUG nova.api.openstack.wsgi [None req-e902eb82-c652-4e7a-aebb-f5d3a0624ec2 tempest-VolumesActionsTest-1801161219 tempest-VolumesActionsTest-1801161219-project] Calling method '>' {{(pid=120740) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 18:13:40.209981 dv-cinder-852009-8-iscsi devstack@n-api.service[120740]: DEBUG nova.compute.api [None req-e902eb82-c652-4e7a-aebb-f5d3a0624ec2 tempest-VolumesActionsTest-1801161219 tempest-VolumesActionsTest-1801161219-project] [instance: 27ffa62d-e611-4fee-a81d-f508d8d8f7e8] Fetching instance by UUID {{(pid=120740) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 18:13:40.217598 dv-cinder-852009-8-iscsi devstack@n-api.service[120740]: DEBUG oslo_concurrency.lockutils [None req-e902eb82-c652-4e7a-aebb-f5d3a0624ec2 tempest-VolumesActionsTest-1801161219 tempest-VolumesActionsTest-1801161219-project] Acquiring lock "1daf4f4c-0e4a-4779-b53a-78c48397ea2f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120740) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 18:13:40.218096 dv-cinder-852009-8-iscsi devstack@n-api.service[120740]: DEBUG oslo_concurrency.lockutils [None req-e902eb82-c652-4e7a-aebb-f5d3a0624ec2 tempest-VolumesActionsTest-1801161219 tempest-VolumesActionsTest-1801161219-project] Lock "1daf4f4c-0e4a-4779-b53a-78c48397ea2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120740) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 18:13:40.218521 dv-cinder-852009-8-iscsi devstack@n-api.service[120740]: DEBUG oslo_concurrency.lockutils [None req-e902eb82-c652-4e7a-aebb-f5d3a0624ec2 tempest-VolumesActionsTest-1801161219 tempest-VolumesActionsTest-1801161219-project] Lock "1daf4f4c-0e4a-4779-b53a-78c48397ea2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120740) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 18:13:40.219351 dv-cinder-852009-8-iscsi devstack@n-api.service[120740]: DEBUG oslo_concurrency.lockutils [None req-e902eb82-c652-4e7a-aebb-f5d3a0624ec2 tempest-VolumesActionsTest-1801161219 tempest-VolumesActionsTest-1801161219-project] Acquiring lock "1daf4f4c-0e4a-4779-b53a-78c48397ea2f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120740) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 18:13:40.219806 dv-cinder-852009-8-iscsi devstack@n-api.service[120740]: DEBUG oslo_concurrency.lockutils [None req-e902eb82-c652-4e7a-aebb-f5d3a0624ec2 tempest-VolumesActionsTest-1801161219 tempest-VolumesActionsTest-1801161219-project] Lock "1daf4f4c-0e4a-4779-b53a-78c48397ea2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120740) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 18:13:40.220240 dv-cinder-852009-8-iscsi devstack@n-api.service[120740]: DEBUG oslo_concurrency.lockutils [None req-e902eb82-c652-4e7a-aebb-f5d3a0624ec2 tempest-VolumesActionsTest-1801161219 tempest-VolumesActionsTest-1801161219-project] Lock "1daf4f4c-0e4a-4779-b53a-78c48397ea2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120740) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 18:13:40.288522 dv-cinder-852009-8-iscsi devstack@n-api.service[120740]: DEBUG nova.policy [None req-e902eb82-c652-4e7a-aebb-f5d3a0624ec2 tempest-VolumesActionsTest-1801161219 tempest-VolumesActionsTest-1801161219-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2661182556d442cea0928f758fe3d57b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b72151db182e445b9293d7b3b66884ef', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120740) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 18:13:40.296399 dv-cinder-852009-8-iscsi devstack@n-api.service[120740]: INFO nova.api.openstack.requestlog [None req-e902eb82-c652-4e7a-aebb-f5d3a0624ec2 tempest-VolumesActionsTest-1801161219 tempest-VolumesActionsTest-1801161219-project] 10.222.0.43 "GET /compute/v2.1/servers/27ffa62d-e611-4fee-a81d-f508d8d8f7e8" status: 200 len: 1283 microversion: 2.1 time: 0.092613 Sep 13 18:13:40.296992 dv-cinder-852009-8-iscsi devstack@n-api.service[120740]: [pid: 120740|app: 0|req: 467/923] 10.222.0.43 () {58 vars in 1236 bytes} [Tue Sep 13 18:13:40 2022] GET /compute/v2.1/servers/27ffa62d-e611-4fee-a81d-f508d8d8f7e8 => generated 1283 bytes in 94 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 13 18:13:41.319420 dv-cinder-852009-8-iscsi devstack@n-api.service[120741]: DEBUG nova.api.openstack.wsgi [None req-55157c6a-6ea0-4f53-b202-297f7e73d933 tempest-VolumesActionsTest-1801161219 tempest-VolumesActionsTest-1801161219-project] Calling method '>' {{(pid=120741) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 18:13:41.320153 dv-cinder-852009-8-iscsi devstack@n-api.service[120741]: DEBUG nova.compute.api [None req-55157c6a-6ea0-4f53-b202-297f7e73d933 tempest-VolumesActionsTest-1801161219 tempest-VolumesActionsTest-1801161219-project] [instance: 27ffa62d-e611-4fee-a81d-f508d8d8f7e8] Fetching instance by UUID {{(pid=120741) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 18:13:41.328005 dv-cinder-852009-8-iscsi devstack@n-api.service[120741]: DEBUG oslo_concurrency.lockutils [None req-55157c6a-6ea0-4f53-b202-297f7e73d933 tempest-VolumesActionsTest-1801161219 tempest-VolumesActionsTest-1801161219-project] Acquiring lock "1daf4f4c-0e4a-4779-b53a-78c48397ea2f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120741) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 18:13:41.328583 dv-cinder-852009-8-iscsi devstack@n-api.service[120741]: DEBUG oslo_concurrency.lockutils [None req-55157c6a-6ea0-4f53-b202-297f7e73d933 tempest-VolumesActionsTest-1801161219 tempest-VolumesActionsTest-1801161219-project] Lock "1daf4f4c-0e4a-4779-b53a-78c48397ea2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120741) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 18:13:41.328954 dv-cinder-852009-8-iscsi devstack@n-api.service[120741]: DEBUG oslo_concurrency.lockutils [None req-55157c6a-6ea0-4f53-b202-297f7e73d933 tempest-VolumesActionsTest-1801161219 tempest-VolumesActionsTest-1801161219-project] Lock "1daf4f4c-0e4a-4779-b53a-78c48397ea2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120741) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 18:13:41.329864 dv-cinder-852009-8-iscsi devstack@n-api.service[120741]: DEBUG oslo_concurrency.lockutils [None req-55157c6a-6ea0-4f53-b202-297f7e73d933 tempest-VolumesActionsTest-1801161219 tempest-VolumesActionsTest-1801161219-project] Acquiring lock "1daf4f4c-0e4a-4779-b53a-78c48397ea2f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120741) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 18:13:41.330319 dv-cinder-852009-8-iscsi devstack@n-api.service[120741]: DEBUG oslo_concurrency.lockutils [None req-55157c6a-6ea0-4f53-b202-297f7e73d933 tempest-VolumesActionsTest-1801161219 tempest-VolumesActionsTest-1801161219-project] Lock "1daf4f4c-0e4a-4779-b53a-78c48397ea2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120741) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 18:13:41.330862 dv-cinder-852009-8-iscsi devstack@n-api.service[120741]: DEBUG oslo_concurrency.lockutils [None req-55157c6a-6ea0-4f53-b202-297f7e73d933 tempest-VolumesActionsTest-1801161219 tempest-VolumesActionsTest-1801161219-project] Lock "1daf4f4c-0e4a-4779-b53a-78c48397ea2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120741) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 18:13:41.468305 dv-cinder-852009-8-iscsi devstack@n-api.service[120741]: DEBUG nova.policy [None req-55157c6a-6ea0-4f53-b202-297f7e73d933 tempest-VolumesActionsTest-1801161219 tempest-VolumesActionsTest-1801161219-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2661182556d442cea0928f758fe3d57b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b72151db182e445b9293d7b3b66884ef', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120741) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 18:13:41.470829 dv-cinder-852009-8-iscsi devstack@n-api.service[120740]: DEBUG nova.api.openstack.wsgi [req-965cb3bc-458a-4764-ac76-715a371107a2 req-3add9214-d823-43ac-9708-0bef443f0143 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "27ffa62d-e611-4fee-a81d-f508d8d8f7e8", "tag": "f047c36d-958e-48ee-8ebb-396aefc343ba"}]} {{(pid=120740) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 13 18:13:41.477803 dv-cinder-852009-8-iscsi devstack@n-api.service[120741]: INFO nova.api.openstack.requestlog [None req-55157c6a-6ea0-4f53-b202-297f7e73d933 tempest-VolumesActionsTest-1801161219 tempest-VolumesActionsTest-1801161219-project] 10.222.0.43 "GET /compute/v2.1/servers/27ffa62d-e611-4fee-a81d-f508d8d8f7e8" status: 200 len: 1313 microversion: 2.1 time: 0.162246 Sep 13 18:13:41.478754 dv-cinder-852009-8-iscsi devstack@n-api.service[120741]: [pid: 120741|app: 0|req: 457/924] 10.222.0.43 () {58 vars in 1236 bytes} [Tue Sep 13 18:13:41 2022] GET /compute/v2.1/servers/27ffa62d-e611-4fee-a81d-f508d8d8f7e8 => generated 1313 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 13 18:13:41.484361 dv-cinder-852009-8-iscsi devstack@n-api.service[120740]: DEBUG oslo_concurrency.lockutils [req-965cb3bc-458a-4764-ac76-715a371107a2 req-3add9214-d823-43ac-9708-0bef443f0143 service nova] Acquiring lock "1daf4f4c-0e4a-4779-b53a-78c48397ea2f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120740) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 18:13:41.485137 dv-cinder-852009-8-iscsi devstack@n-api.service[120740]: DEBUG oslo_concurrency.lockutils [req-965cb3bc-458a-4764-ac76-715a371107a2 req-3add9214-d823-43ac-9708-0bef443f0143 service nova] Lock "1daf4f4c-0e4a-4779-b53a-78c48397ea2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120740) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 18:13:41.492848 dv-cinder-852009-8-iscsi devstack@n-api.service[120740]: DEBUG oslo_concurrency.lockutils [req-965cb3bc-458a-4764-ac76-715a371107a2 req-3add9214-d823-43ac-9708-0bef443f0143 service nova] Lock "1daf4f4c-0e4a-4779-b53a-78c48397ea2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=120740) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 18:13:41.509166 dv-cinder-852009-8-iscsi devstack@n-api.service[120740]: INFO nova.api.openstack.compute.server_external_events [req-965cb3bc-458a-4764-ac76-715a371107a2 req-3add9214-d823-43ac-9708-0bef443f0143 service nova] Creating event network-changed:f047c36d-958e-48ee-8ebb-396aefc343ba for instance 27ffa62d-e611-4fee-a81d-f508d8d8f7e8 on hv-cinder-85200 Sep 13 18:13:41.513928 dv-cinder-852009-8-iscsi devstack@n-api.service[120740]: INFO nova.api.openstack.requestlog [req-965cb3bc-458a-4764-ac76-715a371107a2 req-3add9214-d823-43ac-9708-0bef443f0143 service nova] 10.222.0.43 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.047070 Sep 13 18:13:41.514703 dv-cinder-852009-8-iscsi devstack@n-api.service[120740]: [pid: 120740|app: 0|req: 468/925] 10.222.0.43 () {64 vars in 1317 bytes} [Tue Sep 13 18:13:41 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 49 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 13 18:13:42.506025 dv-cinder-852009-8-iscsi devstack@n-api.service[120741]: DEBUG nova.api.openstack.wsgi [None req-20b6e228-0402-485d-b7e0-dfcd3034fb57 tempest-VolumesActionsTest-1801161219 tempest-VolumesActionsTest-1801161219-project] Calling method '>' {{(pid=120741) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 18:13:42.506983 dv-cinder-852009-8-iscsi devstack@n-api.service[120741]: DEBUG nova.compute.api [None req-20b6e228-0402-485d-b7e0-dfcd3034fb57 tempest-VolumesActionsTest-1801161219 tempest-VolumesActionsTest-1801161219-project] [instance: 27ffa62d-e611-4fee-a81d-f508d8d8f7e8] Fetching instance by UUID {{(pid=120741) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 18:13:42.517929 dv-cinder-852009-8-iscsi devstack@n-api.service[120741]: DEBUG oslo_concurrency.lockutils [None req-20b6e228-0402-485d-b7e0-dfcd3034fb57 tempest-VolumesActionsTest-1801161219 tempest-VolumesActionsTest-1801161219-project] Acquiring lock "1daf4f4c-0e4a-4779-b53a-78c48397ea2f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120741) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 18:13:42.518756 dv-cinder-852009-8-iscsi devstack@n-api.service[120741]: DEBUG oslo_concurrency.lockutils [None req-20b6e228-0402-485d-b7e0-dfcd3034fb57 tempest-VolumesActionsTest-1801161219 tempest-VolumesActionsTest-1801161219-project] Lock "1daf4f4c-0e4a-4779-b53a-78c48397ea2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120741) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 18:13:42.519499 dv-cinder-852009-8-iscsi devstack@n-api.service[120741]: DEBUG oslo_concurrency.lockutils [None req-20b6e228-0402-485d-b7e0-dfcd3034fb57 tempest-VolumesActionsTest-1801161219 tempest-VolumesActionsTest-1801161219-project] Lock "1daf4f4c-0e4a-4779-b53a-78c48397ea2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120741) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 18:13:42.520703 dv-cinder-852009-8-iscsi devstack@n-api.service[120741]: DEBUG oslo_concurrency.lockutils [None req-20b6e228-0402-485d-b7e0-dfcd3034fb57 tempest-VolumesActionsTest-1801161219 tempest-VolumesActionsTest-1801161219-project] Acquiring lock "1daf4f4c-0e4a-4779-b53a-78c48397ea2f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120741) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 18:13:42.521471 dv-cinder-852009-8-iscsi devstack@n-api.service[120741]: DEBUG oslo_concurrency.lockutils [None req-20b6e228-0402-485d-b7e0-dfcd3034fb57 tempest-VolumesActionsTest-1801161219 tempest-VolumesActionsTest-1801161219-project] Lock "1daf4f4c-0e4a-4779-b53a-78c48397ea2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120741) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 18:13:42.522173 dv-cinder-852009-8-iscsi devstack@n-api.service[120741]: DEBUG oslo_concurrency.lockutils [None req-20b6e228-0402-485d-b7e0-dfcd3034fb57 tempest-VolumesActionsTest-1801161219 tempest-VolumesActionsTest-1801161219-project] Lock "1daf4f4c-0e4a-4779-b53a-78c48397ea2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120741) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 18:13:42.650353 dv-cinder-852009-8-iscsi devstack@n-api.service[120741]: DEBUG nova.policy [None req-20b6e228-0402-485d-b7e0-dfcd3034fb57 tempest-VolumesActionsTest-1801161219 tempest-VolumesActionsTest-1801161219-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2661182556d442cea0928f758fe3d57b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b72151db182e445b9293d7b3b66884ef', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120741) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 18:13:42.658493 dv-cinder-852009-8-iscsi devstack@n-api.service[120741]: INFO nova.api.openstack.requestlog [None req-20b6e228-0402-485d-b7e0-dfcd3034fb57 tempest-VolumesActionsTest-1801161219 tempest-VolumesActionsTest-1801161219-project] 10.222.0.43 "GET /compute/v2.1/servers/27ffa62d-e611-4fee-a81d-f508d8d8f7e8" status: 200 len: 1313 microversion: 2.1 time: 0.159221 Sep 13 18:13:42.659076 dv-cinder-852009-8-iscsi devstack@n-api.service[120741]: [pid: 120741|app: 0|req: 458/926] 10.222.0.43 () {58 vars in 1236 bytes} [Tue Sep 13 18:13:42 2022] GET /compute/v2.1/servers/27ffa62d-e611-4fee-a81d-f508d8d8f7e8 => generated 1313 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 13 18:13:43.686698 dv-cinder-852009-8-iscsi devstack@n-api.service[120740]: DEBUG nova.api.openstack.wsgi [None req-eb13715e-bbc5-41b5-a66f-daaccfeadc38 tempest-VolumesActionsTest-1801161219 tempest-VolumesActionsTest-1801161219-project] Calling method '>' {{(pid=120740) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 18:13:43.688615 dv-cinder-852009-8-iscsi devstack@n-api.service[120740]: DEBUG nova.compute.api [None req-eb13715e-bbc5-41b5-a66f-daaccfeadc38 tempest-VolumesActionsTest-1801161219 tempest-VolumesActionsTest-1801161219-project] [instance: 27ffa62d-e611-4fee-a81d-f508d8d8f7e8] Fetching instance by UUID {{(pid=120740) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 18:13:43.699560 dv-cinder-852009-8-iscsi devstack@n-api.service[120740]: DEBUG oslo_concurrency.lockutils [None req-eb13715e-bbc5-41b5-a66f-daaccfeadc38 tempest-VolumesActionsTest-1801161219 tempest-VolumesActionsTest-1801161219-project] Acquiring lock "1daf4f4c-0e4a-4779-b53a-78c48397ea2f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120740) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 18:13:43.700465 dv-cinder-852009-8-iscsi devstack@n-api.service[120740]: DEBUG oslo_concurrency.lockutils [None req-eb13715e-bbc5-41b5-a66f-daaccfeadc38 tempest-VolumesActionsTest-1801161219 tempest-VolumesActionsTest-1801161219-project] Lock "1daf4f4c-0e4a-4779-b53a-78c48397ea2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120740) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 18:13:43.701235 dv-cinder-852009-8-iscsi devstack@n-api.service[120740]: DEBUG oslo_concurrency.lockutils [None req-eb13715e-bbc5-41b5-a66f-daaccfeadc38 tempest-VolumesActionsTest-1801161219 tempest-VolumesActionsTest-1801161219-project] Lock "1daf4f4c-0e4a-4779-b53a-78c48397ea2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120740) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 18:13:43.702464 dv-cinder-852009-8-iscsi devstack@n-api.service[120740]: DEBUG oslo_concurrency.lockutils [None req-eb13715e-bbc5-41b5-a66f-daaccfeadc38 tempest-VolumesActionsTest-1801161219 tempest-VolumesActionsTest-1801161219-project] Acquiring lock "1daf4f4c-0e4a-4779-b53a-78c48397ea2f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120740) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 18:13:43.703042 dv-cinder-852009-8-iscsi devstack@n-api.service[120740]: DEBUG oslo_concurrency.lockutils [None req-eb13715e-bbc5-41b5-a66f-daaccfeadc38 tempest-VolumesActionsTest-1801161219 tempest-VolumesActionsTest-1801161219-project] Lock "1daf4f4c-0e4a-4779-b53a-78c48397ea2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120740) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 18:13:43.703460 dv-cinder-852009-8-iscsi devstack@n-api.service[120740]: DEBUG oslo_concurrency.lockutils [None req-eb13715e-bbc5-41b5-a66f-daaccfeadc38 tempest-VolumesActionsTest-1801161219 tempest-VolumesActionsTest-1801161219-project] Lock "1daf4f4c-0e4a-4779-b53a-78c48397ea2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120740) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 18:13:43.837166 dv-cinder-852009-8-iscsi devstack@n-api.service[120740]: DEBUG nova.policy [None req-eb13715e-bbc5-41b5-a66f-daaccfeadc38 tempest-VolumesActionsTest-1801161219 tempest-VolumesActionsTest-1801161219-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2661182556d442cea0928f758fe3d57b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b72151db182e445b9293d7b3b66884ef', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120740) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 18:13:43.845021 dv-cinder-852009-8-iscsi devstack@n-api.service[120740]: INFO nova.api.openstack.requestlog [None req-eb13715e-bbc5-41b5-a66f-daaccfeadc38 tempest-VolumesActionsTest-1801161219 tempest-VolumesActionsTest-1801161219-project] 10.222.0.43 "GET /compute/v2.1/servers/27ffa62d-e611-4fee-a81d-f508d8d8f7e8" status: 200 len: 1313 microversion: 2.1 time: 0.165458 Sep 13 18:13:43.845577 dv-cinder-852009-8-iscsi devstack@n-api.service[120740]: [pid: 120740|app: 0|req: 469/927] 10.222.0.43 () {58 vars in 1236 bytes} [Tue Sep 13 18:13:43 2022] GET /compute/v2.1/servers/27ffa62d-e611-4fee-a81d-f508d8d8f7e8 => generated 1313 bytes in 167 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 13 18:13:44.873731 dv-cinder-852009-8-iscsi devstack@n-api.service[120741]: DEBUG nova.api.openstack.wsgi [None req-6cf2c980-2863-4755-b7f3-08ee11d609fe tempest-VolumesActionsTest-1801161219 tempest-VolumesActionsTest-1801161219-project] Calling method '>' {{(pid=120741) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 18:13:44.874770 dv-cinder-852009-8-iscsi devstack@n-api.service[120741]: DEBUG nova.compute.api [None req-6cf2c980-2863-4755-b7f3-08ee11d609fe tempest-VolumesActionsTest-1801161219 tempest-VolumesActionsTest-1801161219-project] [instance: 27ffa62d-e611-4fee-a81d-f508d8d8f7e8] Fetching instance by UUID {{(pid=120741) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 18:13:44.885334 dv-cinder-852009-8-iscsi devstack@n-api.service[120741]: DEBUG oslo_concurrency.lockutils [None req-6cf2c980-2863-4755-b7f3-08ee11d609fe tempest-VolumesActionsTest-1801161219 tempest-VolumesActionsTest-1801161219-project] Acquiring lock "1daf4f4c-0e4a-4779-b53a-78c48397ea2f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120741) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 18:13:44.885818 dv-cinder-852009-8-iscsi devstack@n-api.service[120741]: DEBUG oslo_concurrency.lockutils [None req-6cf2c980-2863-4755-b7f3-08ee11d609fe tempest-VolumesActionsTest-1801161219 tempest-VolumesActionsTest-1801161219-project] Lock "1daf4f4c-0e4a-4779-b53a-78c48397ea2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120741) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 18:13:44.886249 dv-cinder-852009-8-iscsi devstack@n-api.service[120741]: DEBUG oslo_concurrency.lockutils [None req-6cf2c980-2863-4755-b7f3-08ee11d609fe tempest-VolumesActionsTest-1801161219 tempest-VolumesActionsTest-1801161219-project] Lock "1daf4f4c-0e4a-4779-b53a-78c48397ea2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120741) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 18:13:44.886940 dv-cinder-852009-8-iscsi devstack@n-api.service[120741]: DEBUG oslo_concurrency.lockutils [None req-6cf2c980-2863-4755-b7f3-08ee11d609fe tempest-VolumesActionsTest-1801161219 tempest-VolumesActionsTest-1801161219-project] Acquiring lock "1daf4f4c-0e4a-4779-b53a-78c48397ea2f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120741) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 18:13:44.887389 dv-cinder-852009-8-iscsi devstack@n-api.service[120741]: DEBUG oslo_concurrency.lockutils [None req-6cf2c980-2863-4755-b7f3-08ee11d609fe tempest-VolumesActionsTest-1801161219 tempest-VolumesActionsTest-1801161219-project] Lock "1daf4f4c-0e4a-4779-b53a-78c48397ea2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120741) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 18:13:44.887808 dv-cinder-852009-8-iscsi devstack@n-api.service[120741]: DEBUG oslo_concurrency.lockutils [None req-6cf2c980-2863-4755-b7f3-08ee11d609fe tempest-VolumesActionsTest-1801161219 tempest-VolumesActionsTest-1801161219-project] Lock "1daf4f4c-0e4a-4779-b53a-78c48397ea2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120741) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 18:13:45.020565 dv-cinder-852009-8-iscsi devstack@n-api.service[120741]: DEBUG nova.policy [None req-6cf2c980-2863-4755-b7f3-08ee11d609fe tempest-VolumesActionsTest-1801161219 tempest-VolumesActionsTest-1801161219-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2661182556d442cea0928f758fe3d57b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b72151db182e445b9293d7b3b66884ef', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120741) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 18:13:45.028587 dv-cinder-852009-8-iscsi devstack@n-api.service[120741]: INFO nova.api.openstack.requestlog [None req-6cf2c980-2863-4755-b7f3-08ee11d609fe tempest-VolumesActionsTest-1801161219 tempest-VolumesActionsTest-1801161219-project] 10.222.0.43 "GET /compute/v2.1/servers/27ffa62d-e611-4fee-a81d-f508d8d8f7e8" status: 200 len: 1313 microversion: 2.1 time: 0.162502 Sep 13 18:13:45.029134 dv-cinder-852009-8-iscsi devstack@n-api.service[120741]: [pid: 120741|app: 0|req: 459/928] 10.222.0.43 () {58 vars in 1236 bytes} [Tue Sep 13 18:13:44 2022] GET /compute/v2.1/servers/27ffa62d-e611-4fee-a81d-f508d8d8f7e8 => generated 1313 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 13 18:13:45.927519 dv-cinder-852009-8-iscsi devstack@n-api.service[120740]: DEBUG nova.api.openstack.wsgi [req-733b6e63-21f3-4564-83e1-cab3622f564e req-eecae881-01f8-47e2-88bf-afe0d136586b service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "27ffa62d-e611-4fee-a81d-f508d8d8f7e8", "name": "network-vif-plugged", "status": "completed", "tag": "f047c36d-958e-48ee-8ebb-396aefc343ba"}]} {{(pid=120740) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 13 18:13:45.938014 dv-cinder-852009-8-iscsi devstack@n-api.service[120740]: DEBUG oslo_concurrency.lockutils [req-733b6e63-21f3-4564-83e1-cab3622f564e req-eecae881-01f8-47e2-88bf-afe0d136586b service nova] Acquiring lock "1daf4f4c-0e4a-4779-b53a-78c48397ea2f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120740) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 18:13:45.938608 dv-cinder-852009-8-iscsi devstack@n-api.service[120740]: DEBUG oslo_concurrency.lockutils [req-733b6e63-21f3-4564-83e1-cab3622f564e req-eecae881-01f8-47e2-88bf-afe0d136586b service nova] Lock "1daf4f4c-0e4a-4779-b53a-78c48397ea2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120740) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 18:13:45.939071 dv-cinder-852009-8-iscsi devstack@n-api.service[120740]: DEBUG oslo_concurrency.lockutils [req-733b6e63-21f3-4564-83e1-cab3622f564e req-eecae881-01f8-47e2-88bf-afe0d136586b service nova] Lock "1daf4f4c-0e4a-4779-b53a-78c48397ea2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120740) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 18:13:45.950770 dv-cinder-852009-8-iscsi devstack@n-api.service[120740]: INFO nova.api.openstack.compute.server_external_events [req-733b6e63-21f3-4564-83e1-cab3622f564e req-eecae881-01f8-47e2-88bf-afe0d136586b service nova] Creating event network-vif-plugged:f047c36d-958e-48ee-8ebb-396aefc343ba for instance 27ffa62d-e611-4fee-a81d-f508d8d8f7e8 on hv-cinder-85200 Sep 13 18:13:45.955599 dv-cinder-852009-8-iscsi devstack@n-api.service[120740]: INFO nova.api.openstack.requestlog [req-733b6e63-21f3-4564-83e1-cab3622f564e req-eecae881-01f8-47e2-88bf-afe0d136586b service nova] 10.222.0.43 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.031870 Sep 13 18:13:45.956210 dv-cinder-852009-8-iscsi devstack@n-api.service[120740]: [pid: 120740|app: 0|req: 470/929] 10.222.0.43 () {64 vars in 1317 bytes} [Tue Sep 13 18:13:45 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 33 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 13 18:13:46.051743 dv-cinder-852009-8-iscsi devstack@n-api.service[120741]: DEBUG nova.api.openstack.wsgi [None req-01b34050-00da-480e-993b-35cd19a9f013 tempest-VolumesActionsTest-1801161219 tempest-VolumesActionsTest-1801161219-project] Calling method '>' {{(pid=120741) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 18:13:46.052993 dv-cinder-852009-8-iscsi devstack@n-api.service[120741]: DEBUG nova.compute.api [None req-01b34050-00da-480e-993b-35cd19a9f013 tempest-VolumesActionsTest-1801161219 tempest-VolumesActionsTest-1801161219-project] [instance: 27ffa62d-e611-4fee-a81d-f508d8d8f7e8] Fetching instance by UUID {{(pid=120741) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 18:13:46.059820 dv-cinder-852009-8-iscsi devstack@n-api.service[120741]: DEBUG oslo_concurrency.lockutils [None req-01b34050-00da-480e-993b-35cd19a9f013 tempest-VolumesActionsTest-1801161219 tempest-VolumesActionsTest-1801161219-project] Acquiring lock "1daf4f4c-0e4a-4779-b53a-78c48397ea2f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120741) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 18:13:46.060312 dv-cinder-852009-8-iscsi devstack@n-api.service[120741]: DEBUG oslo_concurrency.lockutils [None req-01b34050-00da-480e-993b-35cd19a9f013 tempest-VolumesActionsTest-1801161219 tempest-VolumesActionsTest-1801161219-project] Lock "1daf4f4c-0e4a-4779-b53a-78c48397ea2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120741) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 18:13:46.060775 dv-cinder-852009-8-iscsi devstack@n-api.service[120741]: DEBUG oslo_concurrency.lockutils [None req-01b34050-00da-480e-993b-35cd19a9f013 tempest-VolumesActionsTest-1801161219 tempest-VolumesActionsTest-1801161219-project] Lock "1daf4f4c-0e4a-4779-b53a-78c48397ea2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120741) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 18:13:46.061482 dv-cinder-852009-8-iscsi devstack@n-api.service[120741]: DEBUG oslo_concurrency.lockutils [None req-01b34050-00da-480e-993b-35cd19a9f013 tempest-VolumesActionsTest-1801161219 tempest-VolumesActionsTest-1801161219-project] Acquiring lock "1daf4f4c-0e4a-4779-b53a-78c48397ea2f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120741) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 18:13:46.061937 dv-cinder-852009-8-iscsi devstack@n-api.service[120741]: DEBUG oslo_concurrency.lockutils [None req-01b34050-00da-480e-993b-35cd19a9f013 tempest-VolumesActionsTest-1801161219 tempest-VolumesActionsTest-1801161219-project] Lock "1daf4f4c-0e4a-4779-b53a-78c48397ea2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120741) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 18:13:46.062385 dv-cinder-852009-8-iscsi devstack@n-api.service[120741]: DEBUG oslo_concurrency.lockutils [None req-01b34050-00da-480e-993b-35cd19a9f013 tempest-VolumesActionsTest-1801161219 tempest-VolumesActionsTest-1801161219-project] Lock "1daf4f4c-0e4a-4779-b53a-78c48397ea2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120741) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 18:13:46.207041 dv-cinder-852009-8-iscsi devstack@n-api.service[120741]: DEBUG nova.policy [None req-01b34050-00da-480e-993b-35cd19a9f013 tempest-VolumesActionsTest-1801161219 tempest-VolumesActionsTest-1801161219-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2661182556d442cea0928f758fe3d57b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b72151db182e445b9293d7b3b66884ef', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120741) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 18:13:46.214906 dv-cinder-852009-8-iscsi devstack@n-api.service[120741]: INFO nova.api.openstack.requestlog [None req-01b34050-00da-480e-993b-35cd19a9f013 tempest-VolumesActionsTest-1801161219 tempest-VolumesActionsTest-1801161219-project] 10.222.0.43 "GET /compute/v2.1/servers/27ffa62d-e611-4fee-a81d-f508d8d8f7e8" status: 200 len: 1313 microversion: 2.1 time: 0.167161 Sep 13 18:13:46.215483 dv-cinder-852009-8-iscsi devstack@n-api.service[120741]: [pid: 120741|app: 0|req: 460/930] 10.222.0.43 () {58 vars in 1236 bytes} [Tue Sep 13 18:13:46 2022] GET /compute/v2.1/servers/27ffa62d-e611-4fee-a81d-f508d8d8f7e8 => generated 1313 bytes in 168 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 13 18:13:47.239511 dv-cinder-852009-8-iscsi devstack@n-api.service[120740]: DEBUG nova.api.openstack.wsgi [None req-96b634d8-e1c9-4771-a612-9d91451035e8 tempest-VolumesActionsTest-1801161219 tempest-VolumesActionsTest-1801161219-project] Calling method '>' {{(pid=120740) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 18:13:47.240203 dv-cinder-852009-8-iscsi devstack@n-api.service[120740]: DEBUG nova.compute.api [None req-96b634d8-e1c9-4771-a612-9d91451035e8 tempest-VolumesActionsTest-1801161219 tempest-VolumesActionsTest-1801161219-project] [instance: 27ffa62d-e611-4fee-a81d-f508d8d8f7e8] Fetching instance by UUID {{(pid=120740) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 18:13:47.247668 dv-cinder-852009-8-iscsi devstack@n-api.service[120740]: DEBUG oslo_concurrency.lockutils [None req-96b634d8-e1c9-4771-a612-9d91451035e8 tempest-VolumesActionsTest-1801161219 tempest-VolumesActionsTest-1801161219-project] Acquiring lock "1daf4f4c-0e4a-4779-b53a-78c48397ea2f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120740) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 18:13:47.248168 dv-cinder-852009-8-iscsi devstack@n-api.service[120740]: DEBUG oslo_concurrency.lockutils [None req-96b634d8-e1c9-4771-a612-9d91451035e8 tempest-VolumesActionsTest-1801161219 tempest-VolumesActionsTest-1801161219-project] Lock "1daf4f4c-0e4a-4779-b53a-78c48397ea2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120740) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 18:13:47.248655 dv-cinder-852009-8-iscsi devstack@n-api.service[120740]: DEBUG oslo_concurrency.lockutils [None req-96b634d8-e1c9-4771-a612-9d91451035e8 tempest-VolumesActionsTest-1801161219 tempest-VolumesActionsTest-1801161219-project] Lock "1daf4f4c-0e4a-4779-b53a-78c48397ea2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120740) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 18:13:47.249376 dv-cinder-852009-8-iscsi devstack@n-api.service[120740]: DEBUG oslo_concurrency.lockutils [None req-96b634d8-e1c9-4771-a612-9d91451035e8 tempest-VolumesActionsTest-1801161219 tempest-VolumesActionsTest-1801161219-project] Acquiring lock "1daf4f4c-0e4a-4779-b53a-78c48397ea2f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120740) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 18:13:47.249847 dv-cinder-852009-8-iscsi devstack@n-api.service[120740]: DEBUG oslo_concurrency.lockutils [None req-96b634d8-e1c9-4771-a612-9d91451035e8 tempest-VolumesActionsTest-1801161219 tempest-VolumesActionsTest-1801161219-project] Lock "1daf4f4c-0e4a-4779-b53a-78c48397ea2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120740) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 18:13:47.250289 dv-cinder-852009-8-iscsi devstack@n-api.service[120740]: DEBUG oslo_concurrency.lockutils [None req-96b634d8-e1c9-4771-a612-9d91451035e8 tempest-VolumesActionsTest-1801161219 tempest-VolumesActionsTest-1801161219-project] Lock "1daf4f4c-0e4a-4779-b53a-78c48397ea2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120740) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 18:13:47.384630 dv-cinder-852009-8-iscsi devstack@n-api.service[120740]: DEBUG nova.policy [None req-96b634d8-e1c9-4771-a612-9d91451035e8 tempest-VolumesActionsTest-1801161219 tempest-VolumesActionsTest-1801161219-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2661182556d442cea0928f758fe3d57b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b72151db182e445b9293d7b3b66884ef', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120740) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 18:13:47.392857 dv-cinder-852009-8-iscsi devstack@n-api.service[120740]: INFO nova.api.openstack.requestlog [None req-96b634d8-e1c9-4771-a612-9d91451035e8 tempest-VolumesActionsTest-1801161219 tempest-VolumesActionsTest-1801161219-project] 10.222.0.43 "GET /compute/v2.1/servers/27ffa62d-e611-4fee-a81d-f508d8d8f7e8" status: 200 len: 1313 microversion: 2.1 time: 0.158353 Sep 13 18:13:47.393455 dv-cinder-852009-8-iscsi devstack@n-api.service[120740]: [pid: 120740|app: 0|req: 471/931] 10.222.0.43 () {58 vars in 1236 bytes} [Tue Sep 13 18:13:47 2022] GET /compute/v2.1/servers/27ffa62d-e611-4fee-a81d-f508d8d8f7e8 => generated 1313 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 13 18:13:48.419599 dv-cinder-852009-8-iscsi devstack@n-api.service[120741]: DEBUG nova.api.openstack.wsgi [None req-b5bf0659-b561-41bf-9a77-f475ab590449 tempest-VolumesActionsTest-1801161219 tempest-VolumesActionsTest-1801161219-project] Calling method '>' {{(pid=120741) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 18:13:48.420678 dv-cinder-852009-8-iscsi devstack@n-api.service[120741]: DEBUG nova.compute.api [None req-b5bf0659-b561-41bf-9a77-f475ab590449 tempest-VolumesActionsTest-1801161219 tempest-VolumesActionsTest-1801161219-project] [instance: 27ffa62d-e611-4fee-a81d-f508d8d8f7e8] Fetching instance by UUID {{(pid=120741) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 18:13:48.431805 dv-cinder-852009-8-iscsi devstack@n-api.service[120741]: DEBUG oslo_concurrency.lockutils [None req-b5bf0659-b561-41bf-9a77-f475ab590449 tempest-VolumesActionsTest-1801161219 tempest-VolumesActionsTest-1801161219-project] Acquiring lock "1daf4f4c-0e4a-4779-b53a-78c48397ea2f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120741) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 18:13:48.432618 dv-cinder-852009-8-iscsi devstack@n-api.service[120741]: DEBUG oslo_concurrency.lockutils [None req-b5bf0659-b561-41bf-9a77-f475ab590449 tempest-VolumesActionsTest-1801161219 tempest-VolumesActionsTest-1801161219-project] Lock "1daf4f4c-0e4a-4779-b53a-78c48397ea2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120741) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 18:13:48.433055 dv-cinder-852009-8-iscsi devstack@n-api.service[120741]: DEBUG oslo_concurrency.lockutils [None req-b5bf0659-b561-41bf-9a77-f475ab590449 tempest-VolumesActionsTest-1801161219 tempest-VolumesActionsTest-1801161219-project] Lock "1daf4f4c-0e4a-4779-b53a-78c48397ea2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120741) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 18:13:48.433754 dv-cinder-852009-8-iscsi devstack@n-api.service[120741]: DEBUG oslo_concurrency.lockutils [None req-b5bf0659-b561-41bf-9a77-f475ab590449 tempest-VolumesActionsTest-1801161219 tempest-VolumesActionsTest-1801161219-project] Acquiring lock "1daf4f4c-0e4a-4779-b53a-78c48397ea2f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120741) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 18:13:48.434209 dv-cinder-852009-8-iscsi devstack@n-api.service[120741]: DEBUG oslo_concurrency.lockutils [None req-b5bf0659-b561-41bf-9a77-f475ab590449 tempest-VolumesActionsTest-1801161219 tempest-VolumesActionsTest-1801161219-project] Lock "1daf4f4c-0e4a-4779-b53a-78c48397ea2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120741) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 18:13:48.434634 dv-cinder-852009-8-iscsi devstack@n-api.service[120741]: DEBUG oslo_concurrency.lockutils [None req-b5bf0659-b561-41bf-9a77-f475ab590449 tempest-VolumesActionsTest-1801161219 tempest-VolumesActionsTest-1801161219-project] Lock "1daf4f4c-0e4a-4779-b53a-78c48397ea2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120741) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 18:13:48.566424 dv-cinder-852009-8-iscsi devstack@n-api.service[120741]: DEBUG nova.policy [None req-b5bf0659-b561-41bf-9a77-f475ab590449 tempest-VolumesActionsTest-1801161219 tempest-VolumesActionsTest-1801161219-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2661182556d442cea0928f758fe3d57b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b72151db182e445b9293d7b3b66884ef', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120741) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 18:13:48.577374 dv-cinder-852009-8-iscsi devstack@n-api.service[120741]: INFO nova.api.openstack.requestlog [None req-b5bf0659-b561-41bf-9a77-f475ab590449 tempest-VolumesActionsTest-1801161219 tempest-VolumesActionsTest-1801161219-project] 10.222.0.43 "GET /compute/v2.1/servers/27ffa62d-e611-4fee-a81d-f508d8d8f7e8" status: 200 len: 1496 microversion: 2.1 time: 0.164471 Sep 13 18:13:48.577946 dv-cinder-852009-8-iscsi devstack@n-api.service[120741]: [pid: 120741|app: 0|req: 461/932] 10.222.0.43 () {58 vars in 1236 bytes} [Tue Sep 13 18:13:48 2022] GET /compute/v2.1/servers/27ffa62d-e611-4fee-a81d-f508d8d8f7e8 => generated 1496 bytes in 166 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 13 18:13:49.026489 dv-cinder-852009-8-iscsi devstack@n-api.service[120740]: DEBUG nova.api.openstack.wsgi [None req-39687c63-ac95-4deb-85c3-f8f57a931911 tempest-VolumesActionsTest-1801161219 tempest-VolumesActionsTest-1801161219-project] Calling method '>' {{(pid=120740) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 18:13:49.027064 dv-cinder-852009-8-iscsi devstack@n-api.service[120740]: DEBUG nova.compute.api [None req-39687c63-ac95-4deb-85c3-f8f57a931911 tempest-VolumesActionsTest-1801161219 tempest-VolumesActionsTest-1801161219-project] [instance: 27ffa62d-e611-4fee-a81d-f508d8d8f7e8] Fetching instance by UUID {{(pid=120740) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 18:13:49.033675 dv-cinder-852009-8-iscsi devstack@n-api.service[120740]: DEBUG oslo_concurrency.lockutils [None req-39687c63-ac95-4deb-85c3-f8f57a931911 tempest-VolumesActionsTest-1801161219 tempest-VolumesActionsTest-1801161219-project] Acquiring lock "1daf4f4c-0e4a-4779-b53a-78c48397ea2f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120740) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 18:13:49.034160 dv-cinder-852009-8-iscsi devstack@n-api.service[120740]: DEBUG oslo_concurrency.lockutils [None req-39687c63-ac95-4deb-85c3-f8f57a931911 tempest-VolumesActionsTest-1801161219 tempest-VolumesActionsTest-1801161219-project] Lock "1daf4f4c-0e4a-4779-b53a-78c48397ea2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120740) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 18:13:49.034597 dv-cinder-852009-8-iscsi devstack@n-api.service[120740]: DEBUG oslo_concurrency.lockutils [None req-39687c63-ac95-4deb-85c3-f8f57a931911 tempest-VolumesActionsTest-1801161219 tempest-VolumesActionsTest-1801161219-project] Lock "1daf4f4c-0e4a-4779-b53a-78c48397ea2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120740) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 18:13:49.035266 dv-cinder-852009-8-iscsi devstack@n-api.service[120740]: DEBUG oslo_concurrency.lockutils [None req-39687c63-ac95-4deb-85c3-f8f57a931911 tempest-VolumesActionsTest-1801161219 tempest-VolumesActionsTest-1801161219-project] Acquiring lock "1daf4f4c-0e4a-4779-b53a-78c48397ea2f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120740) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 18:13:49.035735 dv-cinder-852009-8-iscsi devstack@n-api.service[120740]: DEBUG oslo_concurrency.lockutils [None req-39687c63-ac95-4deb-85c3-f8f57a931911 tempest-VolumesActionsTest-1801161219 tempest-VolumesActionsTest-1801161219-project] Lock "1daf4f4c-0e4a-4779-b53a-78c48397ea2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120740) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 18:13:49.036134 dv-cinder-852009-8-iscsi devstack@n-api.service[120740]: DEBUG oslo_concurrency.lockutils [None req-39687c63-ac95-4deb-85c3-f8f57a931911 tempest-VolumesActionsTest-1801161219 tempest-VolumesActionsTest-1801161219-project] Lock "1daf4f4c-0e4a-4779-b53a-78c48397ea2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120740) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 18:13:49.038804 dv-cinder-852009-8-iscsi devstack@n-api.service[120740]: DEBUG dbcounter [-] [120740] Writing DB stats nova_cell0:SELECT=2 {{(pid=120740) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 18:13:49.059784 dv-cinder-852009-8-iscsi devstack@n-api.service[120740]: DEBUG dbcounter [-] [120740] Writing DB stats nova_cell0:SELECT=6 {{(pid=120740) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 18:13:49.065200 dv-cinder-852009-8-iscsi devstack@n-api.service[120740]: DEBUG nova.compute.api [None req-39687c63-ac95-4deb-85c3-f8f57a931911 tempest-VolumesActionsTest-1801161219 tempest-VolumesActionsTest-1801161219-project] [instance: 27ffa62d-e611-4fee-a81d-f508d8d8f7e8] Going to try to terminate instance {{(pid=120740) delete /opt/stack/nova/nova/compute/api.py:2719}} Sep 13 18:13:49.147241 dv-cinder-852009-8-iscsi devstack@n-api.service[120740]: INFO nova.api.openstack.requestlog [None req-39687c63-ac95-4deb-85c3-f8f57a931911 tempest-VolumesActionsTest-1801161219 tempest-VolumesActionsTest-1801161219-project] 10.222.0.43 "DELETE /compute/v2.1/servers/27ffa62d-e611-4fee-a81d-f508d8d8f7e8" status: 204 len: 0 microversion: 2.1 time: 0.124180 Sep 13 18:13:49.147914 dv-cinder-852009-8-iscsi devstack@n-api.service[120740]: [pid: 120740|app: 0|req: 472/933] 10.222.0.43 () {58 vars in 1239 bytes} [Tue Sep 13 18:13:49 2022] DELETE /compute/v2.1/servers/27ffa62d-e611-4fee-a81d-f508d8d8f7e8 => generated 0 bytes in 126 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Sep 13 18:13:49.156865 dv-cinder-852009-8-iscsi devstack@n-api.service[120741]: DEBUG nova.api.openstack.wsgi [None req-e173ccf1-1c5c-4368-92e9-82ad86985193 tempest-VolumesActionsTest-1801161219 tempest-VolumesActionsTest-1801161219-project] Calling method '>' {{(pid=120741) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 18:13:49.157478 dv-cinder-852009-8-iscsi devstack@n-api.service[120741]: DEBUG nova.compute.api [None req-e173ccf1-1c5c-4368-92e9-82ad86985193 tempest-VolumesActionsTest-1801161219 tempest-VolumesActionsTest-1801161219-project] [instance: 27ffa62d-e611-4fee-a81d-f508d8d8f7e8] Fetching instance by UUID {{(pid=120741) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 18:13:49.163477 dv-cinder-852009-8-iscsi devstack@n-api.service[120741]: DEBUG oslo_concurrency.lockutils [None req-e173ccf1-1c5c-4368-92e9-82ad86985193 tempest-VolumesActionsTest-1801161219 tempest-VolumesActionsTest-1801161219-project] Acquiring lock "1daf4f4c-0e4a-4779-b53a-78c48397ea2f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120741) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 18:13:49.163943 dv-cinder-852009-8-iscsi devstack@n-api.service[120741]: DEBUG oslo_concurrency.lockutils [None req-e173ccf1-1c5c-4368-92e9-82ad86985193 tempest-VolumesActionsTest-1801161219 tempest-VolumesActionsTest-1801161219-project] Lock "1daf4f4c-0e4a-4779-b53a-78c48397ea2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120741) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 18:13:49.164365 dv-cinder-852009-8-iscsi devstack@n-api.service[120741]: DEBUG oslo_concurrency.lockutils [None req-e173ccf1-1c5c-4368-92e9-82ad86985193 tempest-VolumesActionsTest-1801161219 tempest-VolumesActionsTest-1801161219-project] Lock "1daf4f4c-0e4a-4779-b53a-78c48397ea2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120741) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 18:13:49.165065 dv-cinder-852009-8-iscsi devstack@n-api.service[120741]: DEBUG oslo_concurrency.lockutils [None req-e173ccf1-1c5c-4368-92e9-82ad86985193 tempest-VolumesActionsTest-1801161219 tempest-VolumesActionsTest-1801161219-project] Acquiring lock "1daf4f4c-0e4a-4779-b53a-78c48397ea2f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120741) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 18:13:49.165510 dv-cinder-852009-8-iscsi devstack@n-api.service[120741]: DEBUG oslo_concurrency.lockutils [None req-e173ccf1-1c5c-4368-92e9-82ad86985193 tempest-VolumesActionsTest-1801161219 tempest-VolumesActionsTest-1801161219-project] Lock "1daf4f4c-0e4a-4779-b53a-78c48397ea2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120741) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 18:13:49.165920 dv-cinder-852009-8-iscsi devstack@n-api.service[120741]: DEBUG oslo_concurrency.lockutils [None req-e173ccf1-1c5c-4368-92e9-82ad86985193 tempest-VolumesActionsTest-1801161219 tempest-VolumesActionsTest-1801161219-project] Lock "1daf4f4c-0e4a-4779-b53a-78c48397ea2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120741) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 18:13:49.183950 dv-cinder-852009-8-iscsi devstack@n-api.service[120741]: DEBUG dbcounter [-] [120741] Writing DB stats nova_cell0:SELECT=2 {{(pid=120741) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 18:13:49.311704 dv-cinder-852009-8-iscsi devstack@n-api.service[120741]: DEBUG nova.policy [None req-e173ccf1-1c5c-4368-92e9-82ad86985193 tempest-VolumesActionsTest-1801161219 tempest-VolumesActionsTest-1801161219-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2661182556d442cea0928f758fe3d57b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b72151db182e445b9293d7b3b66884ef', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120741) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 18:13:49.320092 dv-cinder-852009-8-iscsi devstack@n-api.service[120741]: INFO nova.api.openstack.requestlog [None req-e173ccf1-1c5c-4368-92e9-82ad86985193 tempest-VolumesActionsTest-1801161219 tempest-VolumesActionsTest-1801161219-project] 10.222.0.43 "GET /compute/v2.1/servers/27ffa62d-e611-4fee-a81d-f508d8d8f7e8" status: 200 len: 1502 microversion: 2.1 time: 0.167643 Sep 13 18:13:49.320783 dv-cinder-852009-8-iscsi devstack@n-api.service[120741]: [pid: 120741|app: 0|req: 462/934] 10.222.0.43 () {58 vars in 1236 bytes} [Tue Sep 13 18:13:49 2022] GET /compute/v2.1/servers/27ffa62d-e611-4fee-a81d-f508d8d8f7e8 => generated 1502 bytes in 169 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 13 18:13:50.346839 dv-cinder-852009-8-iscsi devstack@n-api.service[120740]: DEBUG nova.api.openstack.wsgi [None req-272913d7-bf17-4c3c-9ff3-87a93ece9800 tempest-VolumesActionsTest-1801161219 tempest-VolumesActionsTest-1801161219-project] Calling method '>' {{(pid=120740) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 18:13:50.348351 dv-cinder-852009-8-iscsi devstack@n-api.service[120740]: DEBUG nova.compute.api [None req-272913d7-bf17-4c3c-9ff3-87a93ece9800 tempest-VolumesActionsTest-1801161219 tempest-VolumesActionsTest-1801161219-project] [instance: 27ffa62d-e611-4fee-a81d-f508d8d8f7e8] Fetching instance by UUID {{(pid=120740) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 18:13:50.357152 dv-cinder-852009-8-iscsi devstack@n-api.service[120740]: DEBUG oslo_concurrency.lockutils [None req-272913d7-bf17-4c3c-9ff3-87a93ece9800 tempest-VolumesActionsTest-1801161219 tempest-VolumesActionsTest-1801161219-project] Acquiring lock "1daf4f4c-0e4a-4779-b53a-78c48397ea2f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120740) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 18:13:50.357839 dv-cinder-852009-8-iscsi devstack@n-api.service[120740]: DEBUG oslo_concurrency.lockutils [None req-272913d7-bf17-4c3c-9ff3-87a93ece9800 tempest-VolumesActionsTest-1801161219 tempest-VolumesActionsTest-1801161219-project] Lock "1daf4f4c-0e4a-4779-b53a-78c48397ea2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120740) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 18:13:50.358452 dv-cinder-852009-8-iscsi devstack@n-api.service[120740]: DEBUG oslo_concurrency.lockutils [None req-272913d7-bf17-4c3c-9ff3-87a93ece9800 tempest-VolumesActionsTest-1801161219 tempest-VolumesActionsTest-1801161219-project] Lock "1daf4f4c-0e4a-4779-b53a-78c48397ea2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120740) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 18:13:50.359433 dv-cinder-852009-8-iscsi devstack@n-api.service[120740]: DEBUG oslo_concurrency.lockutils [None req-272913d7-bf17-4c3c-9ff3-87a93ece9800 tempest-VolumesActionsTest-1801161219 tempest-VolumesActionsTest-1801161219-project] Acquiring lock "1daf4f4c-0e4a-4779-b53a-78c48397ea2f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120740) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 18:13:50.360072 dv-cinder-852009-8-iscsi devstack@n-api.service[120740]: DEBUG oslo_concurrency.lockutils [None req-272913d7-bf17-4c3c-9ff3-87a93ece9800 tempest-VolumesActionsTest-1801161219 tempest-VolumesActionsTest-1801161219-project] Lock "1daf4f4c-0e4a-4779-b53a-78c48397ea2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120740) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 18:13:50.360718 dv-cinder-852009-8-iscsi devstack@n-api.service[120740]: DEBUG oslo_concurrency.lockutils [None req-272913d7-bf17-4c3c-9ff3-87a93ece9800 tempest-VolumesActionsTest-1801161219 tempest-VolumesActionsTest-1801161219-project] Lock "1daf4f4c-0e4a-4779-b53a-78c48397ea2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120740) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 18:13:50.499854 dv-cinder-852009-8-iscsi devstack@n-api.service[120740]: DEBUG nova.policy [None req-272913d7-bf17-4c3c-9ff3-87a93ece9800 tempest-VolumesActionsTest-1801161219 tempest-VolumesActionsTest-1801161219-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2661182556d442cea0928f758fe3d57b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b72151db182e445b9293d7b3b66884ef', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120740) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 18:13:50.507973 dv-cinder-852009-8-iscsi devstack@n-api.service[120740]: INFO nova.api.openstack.requestlog [None req-272913d7-bf17-4c3c-9ff3-87a93ece9800 tempest-VolumesActionsTest-1801161219 tempest-VolumesActionsTest-1801161219-project] 10.222.0.43 "GET /compute/v2.1/servers/27ffa62d-e611-4fee-a81d-f508d8d8f7e8" status: 200 len: 1502 microversion: 2.1 time: 0.167353 Sep 13 18:13:50.508505 dv-cinder-852009-8-iscsi devstack@n-api.service[120740]: [pid: 120740|app: 0|req: 473/935] 10.222.0.43 () {58 vars in 1236 bytes} [Tue Sep 13 18:13:50 2022] GET /compute/v2.1/servers/27ffa62d-e611-4fee-a81d-f508d8d8f7e8 => generated 1502 bytes in 169 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 13 18:13:51.161899 dv-cinder-852009-8-iscsi devstack@n-api.service[120741]: DEBUG nova.api.openstack.wsgi [req-ffc64c8a-9786-4b28-b341-898725192b71 req-cec5e8dd-f716-40a0-8e8f-707809d9d3c3 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "27ffa62d-e611-4fee-a81d-f508d8d8f7e8", "name": "network-vif-deleted", "tag": "f047c36d-958e-48ee-8ebb-396aefc343ba"}]} {{(pid=120741) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 13 18:13:51.177607 dv-cinder-852009-8-iscsi devstack@n-api.service[120741]: DEBUG oslo_concurrency.lockutils [req-ffc64c8a-9786-4b28-b341-898725192b71 req-cec5e8dd-f716-40a0-8e8f-707809d9d3c3 service nova] Acquiring lock "1daf4f4c-0e4a-4779-b53a-78c48397ea2f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120741) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 18:13:51.178012 dv-cinder-852009-8-iscsi devstack@n-api.service[120741]: DEBUG oslo_concurrency.lockutils [req-ffc64c8a-9786-4b28-b341-898725192b71 req-cec5e8dd-f716-40a0-8e8f-707809d9d3c3 service nova] Lock "1daf4f4c-0e4a-4779-b53a-78c48397ea2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120741) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 18:13:51.178427 dv-cinder-852009-8-iscsi devstack@n-api.service[120741]: DEBUG oslo_concurrency.lockutils [req-ffc64c8a-9786-4b28-b341-898725192b71 req-cec5e8dd-f716-40a0-8e8f-707809d9d3c3 service nova] Lock "1daf4f4c-0e4a-4779-b53a-78c48397ea2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120741) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 18:13:51.189869 dv-cinder-852009-8-iscsi devstack@n-api.service[120741]: INFO nova.api.openstack.compute.server_external_events [req-ffc64c8a-9786-4b28-b341-898725192b71 req-cec5e8dd-f716-40a0-8e8f-707809d9d3c3 service nova] Creating event network-vif-deleted:f047c36d-958e-48ee-8ebb-396aefc343ba for instance 27ffa62d-e611-4fee-a81d-f508d8d8f7e8 on hv-cinder-85200 Sep 13 18:13:51.194992 dv-cinder-852009-8-iscsi devstack@n-api.service[120741]: INFO nova.api.openstack.requestlog [req-ffc64c8a-9786-4b28-b341-898725192b71 req-cec5e8dd-f716-40a0-8e8f-707809d9d3c3 service nova] 10.222.0.43 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.036883 Sep 13 18:13:51.195605 dv-cinder-852009-8-iscsi devstack@n-api.service[120741]: [pid: 120741|app: 0|req: 463/936] 10.222.0.43 () {64 vars in 1317 bytes} [Tue Sep 13 18:13:51 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 38 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 13 18:13:51.535467 dv-cinder-852009-8-iscsi devstack@n-api.service[120740]: DEBUG nova.api.openstack.wsgi [None req-a5e2e771-34b4-45ab-b592-55a035738bec tempest-VolumesActionsTest-1801161219 tempest-VolumesActionsTest-1801161219-project] Calling method '>' {{(pid=120740) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 18:13:51.536491 dv-cinder-852009-8-iscsi devstack@n-api.service[120740]: DEBUG nova.compute.api [None req-a5e2e771-34b4-45ab-b592-55a035738bec tempest-VolumesActionsTest-1801161219 tempest-VolumesActionsTest-1801161219-project] [instance: 27ffa62d-e611-4fee-a81d-f508d8d8f7e8] Fetching instance by UUID {{(pid=120740) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 18:13:51.547209 dv-cinder-852009-8-iscsi devstack@n-api.service[120740]: DEBUG oslo_concurrency.lockutils [None req-a5e2e771-34b4-45ab-b592-55a035738bec tempest-VolumesActionsTest-1801161219 tempest-VolumesActionsTest-1801161219-project] Acquiring lock "1daf4f4c-0e4a-4779-b53a-78c48397ea2f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120740) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 18:13:51.547704 dv-cinder-852009-8-iscsi devstack@n-api.service[120740]: DEBUG oslo_concurrency.lockutils [None req-a5e2e771-34b4-45ab-b592-55a035738bec tempest-VolumesActionsTest-1801161219 tempest-VolumesActionsTest-1801161219-project] Lock "1daf4f4c-0e4a-4779-b53a-78c48397ea2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120740) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 18:13:51.548934 dv-cinder-852009-8-iscsi devstack@n-api.service[120740]: DEBUG oslo_concurrency.lockutils [None req-a5e2e771-34b4-45ab-b592-55a035738bec tempest-VolumesActionsTest-1801161219 tempest-VolumesActionsTest-1801161219-project] Lock "1daf4f4c-0e4a-4779-b53a-78c48397ea2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120740) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 18:13:51.549700 dv-cinder-852009-8-iscsi devstack@n-api.service[120740]: DEBUG oslo_concurrency.lockutils [None req-a5e2e771-34b4-45ab-b592-55a035738bec tempest-VolumesActionsTest-1801161219 tempest-VolumesActionsTest-1801161219-project] Acquiring lock "1daf4f4c-0e4a-4779-b53a-78c48397ea2f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120740) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 18:13:51.550164 dv-cinder-852009-8-iscsi devstack@n-api.service[120740]: DEBUG oslo_concurrency.lockutils [None req-a5e2e771-34b4-45ab-b592-55a035738bec tempest-VolumesActionsTest-1801161219 tempest-VolumesActionsTest-1801161219-project] Lock "1daf4f4c-0e4a-4779-b53a-78c48397ea2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120740) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 18:13:51.550595 dv-cinder-852009-8-iscsi devstack@n-api.service[120740]: DEBUG oslo_concurrency.lockutils [None req-a5e2e771-34b4-45ab-b592-55a035738bec tempest-VolumesActionsTest-1801161219 tempest-VolumesActionsTest-1801161219-project] Lock "1daf4f4c-0e4a-4779-b53a-78c48397ea2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120740) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 18:13:51.582143 dv-cinder-852009-8-iscsi devstack@n-api.service[120740]: DEBUG oslo_concurrency.lockutils [None req-a5e2e771-34b4-45ab-b592-55a035738bec tempest-VolumesActionsTest-1801161219 tempest-VolumesActionsTest-1801161219-project] Acquiring lock "1daf4f4c-0e4a-4779-b53a-78c48397ea2f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120740) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 18:13:51.582618 dv-cinder-852009-8-iscsi devstack@n-api.service[120740]: DEBUG oslo_concurrency.lockutils [None req-a5e2e771-34b4-45ab-b592-55a035738bec tempest-VolumesActionsTest-1801161219 tempest-VolumesActionsTest-1801161219-project] Lock "1daf4f4c-0e4a-4779-b53a-78c48397ea2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120740) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 18:13:51.583052 dv-cinder-852009-8-iscsi devstack@n-api.service[120740]: DEBUG oslo_concurrency.lockutils [None req-a5e2e771-34b4-45ab-b592-55a035738bec tempest-VolumesActionsTest-1801161219 tempest-VolumesActionsTest-1801161219-project] Lock "1daf4f4c-0e4a-4779-b53a-78c48397ea2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120740) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 18:13:51.583496 dv-cinder-852009-8-iscsi devstack@n-api.service[120740]: DEBUG nova.objects.instance [None req-a5e2e771-34b4-45ab-b592-55a035738bec tempest-VolumesActionsTest-1801161219 tempest-VolumesActionsTest-1801161219-project] Lazy-loading 'fault' on Instance uuid 27ffa62d-e611-4fee-a81d-f508d8d8f7e8 {{(pid=120740) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Sep 13 18:13:51.625327 dv-cinder-852009-8-iscsi devstack@n-api.service[120740]: DEBUG nova.policy [None req-a5e2e771-34b4-45ab-b592-55a035738bec tempest-VolumesActionsTest-1801161219 tempest-VolumesActionsTest-1801161219-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2661182556d442cea0928f758fe3d57b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b72151db182e445b9293d7b3b66884ef', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120740) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 18:13:51.633152 dv-cinder-852009-8-iscsi devstack@n-api.service[120740]: INFO nova.api.openstack.requestlog [None req-a5e2e771-34b4-45ab-b592-55a035738bec tempest-VolumesActionsTest-1801161219 tempest-VolumesActionsTest-1801161219-project] 10.222.0.43 "GET /compute/v2.1/servers/27ffa62d-e611-4fee-a81d-f508d8d8f7e8" status: 200 len: 1303 microversion: 2.1 time: 0.104289 Sep 13 18:13:51.633671 dv-cinder-852009-8-iscsi devstack@n-api.service[120740]: [pid: 120740|app: 0|req: 474/937] 10.222.0.43 () {58 vars in 1236 bytes} [Tue Sep 13 18:13:51 2022] GET /compute/v2.1/servers/27ffa62d-e611-4fee-a81d-f508d8d8f7e8 => generated 1303 bytes in 106 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 13 18:13:52.658246 dv-cinder-852009-8-iscsi devstack@n-api.service[120741]: DEBUG nova.api.openstack.wsgi [None req-8a1ddaa3-3ca0-4b62-9ec7-fa11587f79a0 tempest-VolumesActionsTest-1801161219 tempest-VolumesActionsTest-1801161219-project] Calling method '>' {{(pid=120741) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 18:13:52.658849 dv-cinder-852009-8-iscsi devstack@n-api.service[120741]: DEBUG nova.compute.api [None req-8a1ddaa3-3ca0-4b62-9ec7-fa11587f79a0 tempest-VolumesActionsTest-1801161219 tempest-VolumesActionsTest-1801161219-project] [instance: 27ffa62d-e611-4fee-a81d-f508d8d8f7e8] Fetching instance by UUID {{(pid=120741) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 18:13:52.665856 dv-cinder-852009-8-iscsi devstack@n-api.service[120741]: DEBUG oslo_concurrency.lockutils [None req-8a1ddaa3-3ca0-4b62-9ec7-fa11587f79a0 tempest-VolumesActionsTest-1801161219 tempest-VolumesActionsTest-1801161219-project] Acquiring lock "1daf4f4c-0e4a-4779-b53a-78c48397ea2f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120741) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 18:13:52.666377 dv-cinder-852009-8-iscsi devstack@n-api.service[120741]: DEBUG oslo_concurrency.lockutils [None req-8a1ddaa3-3ca0-4b62-9ec7-fa11587f79a0 tempest-VolumesActionsTest-1801161219 tempest-VolumesActionsTest-1801161219-project] Lock "1daf4f4c-0e4a-4779-b53a-78c48397ea2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120741) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 18:13:52.666810 dv-cinder-852009-8-iscsi devstack@n-api.service[120741]: DEBUG oslo_concurrency.lockutils [None req-8a1ddaa3-3ca0-4b62-9ec7-fa11587f79a0 tempest-VolumesActionsTest-1801161219 tempest-VolumesActionsTest-1801161219-project] Lock "1daf4f4c-0e4a-4779-b53a-78c48397ea2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120741) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 18:13:52.667517 dv-cinder-852009-8-iscsi devstack@n-api.service[120741]: DEBUG oslo_concurrency.lockutils [None req-8a1ddaa3-3ca0-4b62-9ec7-fa11587f79a0 tempest-VolumesActionsTest-1801161219 tempest-VolumesActionsTest-1801161219-project] Acquiring lock "1daf4f4c-0e4a-4779-b53a-78c48397ea2f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120741) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 18:13:52.667970 dv-cinder-852009-8-iscsi devstack@n-api.service[120741]: DEBUG oslo_concurrency.lockutils [None req-8a1ddaa3-3ca0-4b62-9ec7-fa11587f79a0 tempest-VolumesActionsTest-1801161219 tempest-VolumesActionsTest-1801161219-project] Lock "1daf4f4c-0e4a-4779-b53a-78c48397ea2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120741) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 18:13:52.668394 dv-cinder-852009-8-iscsi devstack@n-api.service[120741]: DEBUG oslo_concurrency.lockutils [None req-8a1ddaa3-3ca0-4b62-9ec7-fa11587f79a0 tempest-VolumesActionsTest-1801161219 tempest-VolumesActionsTest-1801161219-project] Lock "1daf4f4c-0e4a-4779-b53a-78c48397ea2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120741) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 18:13:52.682072 dv-cinder-852009-8-iscsi devstack@n-api.service[120741]: INFO nova.api.openstack.wsgi [None req-8a1ddaa3-3ca0-4b62-9ec7-fa11587f79a0 tempest-VolumesActionsTest-1801161219 tempest-VolumesActionsTest-1801161219-project] HTTP exception thrown: Instance 27ffa62d-e611-4fee-a81d-f508d8d8f7e8 could not be found. Sep 13 18:13:52.683703 dv-cinder-852009-8-iscsi devstack@n-api.service[120741]: DEBUG nova.api.openstack.wsgi [None req-8a1ddaa3-3ca0-4b62-9ec7-fa11587f79a0 tempest-VolumesActionsTest-1801161219 tempest-VolumesActionsTest-1801161219-project] Request method failure captured: Sep 13 18:13:52.683703 dv-cinder-852009-8-iscsi devstack@n-api.service[120741]: request: GET /compute/v2.1/servers/27ffa62d-e611-4fee-a81d-f508d8d8f7e8 HTTP/1.1 Sep 13 18:13:52.683703 dv-cinder-852009-8-iscsi devstack@n-api.service[120741]: Accept: application/json Sep 13 18:13:52.683703 dv-cinder-852009-8-iscsi devstack@n-api.service[120741]: Accept-Encoding: identity Sep 13 18:13:52.683703 dv-cinder-852009-8-iscsi devstack@n-api.service[120741]: Connection: close Sep 13 18:13:52.683703 dv-cinder-852009-8-iscsi devstack@n-api.service[120741]: Content-Length: 0 Sep 13 18:13:52.683703 dv-cinder-852009-8-iscsi devstack@n-api.service[120741]: Content-Type: application/json Sep 13 18:13:52.683703 dv-cinder-852009-8-iscsi devstack@n-api.service[120741]: Host: 10.222.0.43 Sep 13 18:13:52.683703 dv-cinder-852009-8-iscsi devstack@n-api.service[120741]: Openstack-System-Scope: None Sep 13 18:13:52.683703 dv-cinder-852009-8-iscsi devstack@n-api.service[120741]: User-Agent: python-urllib3/1.26.12 Sep 13 18:13:52.683703 dv-cinder-852009-8-iscsi devstack@n-api.service[120741]: X-Auth-Token: gAAAAABjIMhAo6H_78_e3D42IAPooIrqsqUVKjUPNfGB_S0nmDi1kiBgW-rL2llgb3iKDlJ3zt7IvVVzI0klM7A4Edy571qcw_uothLo1Ve_kKkR_vLuLInsnkNkmNP6TjyGW-ZCUL57Bpu_ZvzkRb2xIAnQonn1AOdtZAEUszeghJcYhgzvGlo Sep 13 18:13:52.683703 dv-cinder-852009-8-iscsi devstack@n-api.service[120741]: X-Domain-Id: None Sep 13 18:13:52.683703 dv-cinder-852009-8-iscsi devstack@n-api.service[120741]: X-Domain-Name: None Sep 13 18:13:52.683703 dv-cinder-852009-8-iscsi devstack@n-api.service[120741]: X-Identity-Status: Confirmed Sep 13 18:13:52.683703 dv-cinder-852009-8-iscsi devstack@n-api.service[120741]: X-Is-Admin-Project: True Sep 13 18:13:52.683703 dv-cinder-852009-8-iscsi devstack@n-api.service[120741]: X-Project-Domain-Id: default Sep 13 18:13:52.683703 dv-cinder-852009-8-iscsi devstack@n-api.service[120741]: X-Project-Domain-Name: Default Sep 13 18:13:52.683703 dv-cinder-852009-8-iscsi devstack@n-api.service[120741]: X-Project-Id: b72151db182e445b9293d7b3b66884ef Sep 13 18:13:52.683703 dv-cinder-852009-8-iscsi devstack@n-api.service[120741]: X-Project-Name: tempest-VolumesActionsTest-1801161219 Sep 13 18:13:52.683703 dv-cinder-852009-8-iscsi devstack@n-api.service[120741]: X-Role: reader,member Sep 13 18:13:52.683703 dv-cinder-852009-8-iscsi devstack@n-api.service[120741]: X-Roles: reader,member Sep 13 18:13:52.685180 dv-cinder-852009-8-iscsi devstack@n-api.service[120741]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/identity"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/compute/v2/b72151db182e445b9293d7b3b66884ef"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.43:8080", "publicURL": "http://10.222.0.43:8080/v1/AUTH_b72151db182e445b9293d7b3b66884ef"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43:9696/networking"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/volume/v3/b72151db182e445b9293d7b3b66884ef"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/compute/v2.1"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/placement"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/volume/v3/b72151db182e445b9293d7b3b66884ef"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/image"}]}] Sep 13 18:13:52.685180 dv-cinder-852009-8-iscsi devstack@n-api.service[120741]: X-Tenant: tempest-VolumesActionsTest-1801161219 Sep 13 18:13:52.685180 dv-cinder-852009-8-iscsi devstack@n-api.service[120741]: X-Tenant-Id: b72151db182e445b9293d7b3b66884ef Sep 13 18:13:52.685180 dv-cinder-852009-8-iscsi devstack@n-api.service[120741]: X-Tenant-Name: tempest-VolumesActionsTest-1801161219 Sep 13 18:13:52.685180 dv-cinder-852009-8-iscsi devstack@n-api.service[120741]: X-User: tempest-VolumesActionsTest-1801161219-project Sep 13 18:13:52.685180 dv-cinder-852009-8-iscsi devstack@n-api.service[120741]: X-User-Domain-Id: default Sep 13 18:13:52.685180 dv-cinder-852009-8-iscsi devstack@n-api.service[120741]: X-User-Domain-Name: Default Sep 13 18:13:52.685180 dv-cinder-852009-8-iscsi devstack@n-api.service[120741]: X-User-Id: 2661182556d442cea0928f758fe3d57b Sep 13 18:13:52.685180 dv-cinder-852009-8-iscsi devstack@n-api.service[120741]: X-User-Name: tempest-VolumesActionsTest-1801161219-project Sep 13 18:13:52.685180 dv-cinder-852009-8-iscsi devstack@n-api.service[120741]: method: > Sep 13 18:13:52.685180 dv-cinder-852009-8-iscsi devstack@n-api.service[120741]: exception: Instance 27ffa62d-e611-4fee-a81d-f508d8d8f7e8 could not be found. Sep 13 18:13:52.685180 dv-cinder-852009-8-iscsi devstack@n-api.service[120741]: action_args: {'id': '27ffa62d-e611-4fee-a81d-f508d8d8f7e8'} Sep 13 18:13:52.685938 dv-cinder-852009-8-iscsi devstack@n-api.service[120741]: {{(pid=120741) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 13 18:13:52.685938 dv-cinder-852009-8-iscsi devstack@n-api.service[120741]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 13 18:13:52.685938 dv-cinder-852009-8-iscsi devstack@n-api.service[120741]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Sep 13 18:13:52.685938 dv-cinder-852009-8-iscsi devstack@n-api.service[120741]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Sep 13 18:13:52.685938 dv-cinder-852009-8-iscsi devstack@n-api.service[120741]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Sep 13 18:13:52.685938 dv-cinder-852009-8-iscsi devstack@n-api.service[120741]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Sep 13 18:13:52.685938 dv-cinder-852009-8-iscsi devstack@n-api.service[120741]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Sep 13 18:13:52.685938 dv-cinder-852009-8-iscsi devstack@n-api.service[120741]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Sep 13 18:13:52.685938 dv-cinder-852009-8-iscsi devstack@n-api.service[120741]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Sep 13 18:13:52.685938 dv-cinder-852009-8-iscsi devstack@n-api.service[120741]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Sep 13 18:13:52.685938 dv-cinder-852009-8-iscsi devstack@n-api.service[120741]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 27ffa62d-e611-4fee-a81d-f508d8d8f7e8 could not be found. Sep 13 18:13:52.685938 dv-cinder-852009-8-iscsi devstack@n-api.service[120741]: ERROR nova.api.openstack.wsgi Sep 13 18:13:52.685938 dv-cinder-852009-8-iscsi devstack@n-api.service[120741]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 13 18:13:52.685938 dv-cinder-852009-8-iscsi devstack@n-api.service[120741]: ERROR nova.api.openstack.wsgi Sep 13 18:13:52.685938 dv-cinder-852009-8-iscsi devstack@n-api.service[120741]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 13 18:13:52.685938 dv-cinder-852009-8-iscsi devstack@n-api.service[120741]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 13 18:13:52.685938 dv-cinder-852009-8-iscsi devstack@n-api.service[120741]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 13 18:13:52.685938 dv-cinder-852009-8-iscsi devstack@n-api.service[120741]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 13 18:13:52.685938 dv-cinder-852009-8-iscsi devstack@n-api.service[120741]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 13 18:13:52.685938 dv-cinder-852009-8-iscsi devstack@n-api.service[120741]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 13 18:13:52.687540 dv-cinder-852009-8-iscsi devstack@n-api.service[120741]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 13 18:13:52.687540 dv-cinder-852009-8-iscsi devstack@n-api.service[120741]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Sep 13 18:13:52.687540 dv-cinder-852009-8-iscsi devstack@n-api.service[120741]: ERROR nova.api.openstack.wsgi instance = self._get_server( Sep 13 18:13:52.687540 dv-cinder-852009-8-iscsi devstack@n-api.service[120741]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Sep 13 18:13:52.687540 dv-cinder-852009-8-iscsi devstack@n-api.service[120741]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Sep 13 18:13:52.687540 dv-cinder-852009-8-iscsi devstack@n-api.service[120741]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Sep 13 18:13:52.687540 dv-cinder-852009-8-iscsi devstack@n-api.service[120741]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Sep 13 18:13:52.687540 dv-cinder-852009-8-iscsi devstack@n-api.service[120741]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 27ffa62d-e611-4fee-a81d-f508d8d8f7e8 could not be found. Sep 13 18:13:52.687540 dv-cinder-852009-8-iscsi devstack@n-api.service[120741]: ERROR nova.api.openstack.wsgi Sep 13 18:13:52.687540 dv-cinder-852009-8-iscsi devstack@n-api.service[120741]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 13 18:13:52.687540 dv-cinder-852009-8-iscsi devstack@n-api.service[120741]: ERROR nova.api.openstack.wsgi Sep 13 18:13:52.687540 dv-cinder-852009-8-iscsi devstack@n-api.service[120741]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 13 18:13:52.687540 dv-cinder-852009-8-iscsi devstack@n-api.service[120741]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 13 18:13:52.687540 dv-cinder-852009-8-iscsi devstack@n-api.service[120741]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 13 18:13:52.687540 dv-cinder-852009-8-iscsi devstack@n-api.service[120741]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 13 18:13:52.687540 dv-cinder-852009-8-iscsi devstack@n-api.service[120741]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 13 18:13:52.687540 dv-cinder-852009-8-iscsi devstack@n-api.service[120741]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 27ffa62d-e611-4fee-a81d-f508d8d8f7e8 could not be found. Sep 13 18:13:52.687540 dv-cinder-852009-8-iscsi devstack@n-api.service[120741]: ERROR nova.api.openstack.wsgi Sep 13 18:13:52.688987 dv-cinder-852009-8-iscsi devstack@n-api.service[120741]: DEBUG nova.api.openstack.wsgi [None req-8a1ddaa3-3ca0-4b62-9ec7-fa11587f79a0 tempest-VolumesActionsTest-1801161219 tempest-VolumesActionsTest-1801161219-project] Returning 404 to user: Instance 27ffa62d-e611-4fee-a81d-f508d8d8f7e8 could not be found. {{(pid=120741) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 13 18:13:52.688987 dv-cinder-852009-8-iscsi devstack@n-api.service[120741]: INFO nova.api.openstack.requestlog [None req-8a1ddaa3-3ca0-4b62-9ec7-fa11587f79a0 tempest-VolumesActionsTest-1801161219 tempest-VolumesActionsTest-1801161219-project] 10.222.0.43 "GET /compute/v2.1/servers/27ffa62d-e611-4fee-a81d-f508d8d8f7e8" status: 404 len: 111 microversion: 2.1 time: 0.032113 Sep 13 18:13:52.688987 dv-cinder-852009-8-iscsi devstack@n-api.service[120741]: [pid: 120741|app: 0|req: 464/938] 10.222.0.43 () {58 vars in 1236 bytes} [Tue Sep 13 18:13:52 2022] GET /compute/v2.1/servers/27ffa62d-e611-4fee-a81d-f508d8d8f7e8 => generated 111 bytes in 33 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Sep 13 18:14:17.727365 dv-cinder-852009-8-iscsi devstack@n-api.service[120740]: DEBUG nova.api.openstack.wsgi [None req-4ecff5d3-8541-47ba-bdaa-6f5131ccbd7d tempest-VolumesNegativeTest-1707349420 tempest-VolumesNegativeTest-1707349420-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-VolumesNegativeTest-instance-1288230871", "imageRef": "33034e36-e6b2-4847-92a1-ff3188c05a4a", "flavorRef": "452"}} {{(pid=120740) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 13 18:14:17.734544 dv-cinder-852009-8-iscsi devstack@n-api.service[120740]: DEBUG dbcounter [-] [120740] Writing DB stats nova_api:SELECT=71,nova_api:INSERT=6,nova_api:UPDATE=1 {{(pid=120740) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 18:14:17.735161 dv-cinder-852009-8-iscsi devstack@n-api.service[120740]: DEBUG dbcounter [-] [120740] Writing DB stats nova_cell1:SELECT=88,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=120740) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 18:14:17.782461 dv-cinder-852009-8-iscsi devstack@n-api.service[120740]: DEBUG nova.network.neutron [None req-4ecff5d3-8541-47ba-bdaa-6f5131ccbd7d tempest-VolumesNegativeTest-1707349420 tempest-VolumesNegativeTest-1707349420-project] validate_networks() for None {{(pid=120740) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Sep 13 18:14:18.062996 dv-cinder-852009-8-iscsi devstack@n-api.service[120740]: DEBUG nova.virt.hardware [None req-4ecff5d3-8541-47ba-bdaa-6f5131ccbd7d tempest-VolumesNegativeTest-1707349420 tempest-VolumesNegativeTest-1707349420-project] Flavor limits 0:0:0 {{(pid=120740) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Sep 13 18:14:18.063415 dv-cinder-852009-8-iscsi devstack@n-api.service[120740]: DEBUG nova.virt.hardware [None req-4ecff5d3-8541-47ba-bdaa-6f5131ccbd7d tempest-VolumesNegativeTest-1707349420 tempest-VolumesNegativeTest-1707349420-project] Image limits 0:0:0 {{(pid=120740) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Sep 13 18:14:18.063873 dv-cinder-852009-8-iscsi devstack@n-api.service[120740]: DEBUG nova.virt.hardware [None req-4ecff5d3-8541-47ba-bdaa-6f5131ccbd7d tempest-VolumesNegativeTest-1707349420 tempest-VolumesNegativeTest-1707349420-project] Flavor pref 0:0:0 {{(pid=120740) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Sep 13 18:14:18.064274 dv-cinder-852009-8-iscsi devstack@n-api.service[120740]: DEBUG nova.virt.hardware [None req-4ecff5d3-8541-47ba-bdaa-6f5131ccbd7d tempest-VolumesNegativeTest-1707349420 tempest-VolumesNegativeTest-1707349420-project] Image pref 0:0:0 {{(pid=120740) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Sep 13 18:14:18.064722 dv-cinder-852009-8-iscsi devstack@n-api.service[120740]: DEBUG nova.virt.hardware [None req-4ecff5d3-8541-47ba-bdaa-6f5131ccbd7d tempest-VolumesNegativeTest-1707349420 tempest-VolumesNegativeTest-1707349420-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=120740) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Sep 13 18:14:18.075809 dv-cinder-852009-8-iscsi devstack@n-api.service[120740]: DEBUG oslo_concurrency.lockutils [None req-4ecff5d3-8541-47ba-bdaa-6f5131ccbd7d tempest-VolumesNegativeTest-1707349420 tempest-VolumesNegativeTest-1707349420-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120740) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 18:14:18.076288 dv-cinder-852009-8-iscsi devstack@n-api.service[120740]: DEBUG oslo_concurrency.lockutils [None req-4ecff5d3-8541-47ba-bdaa-6f5131ccbd7d tempest-VolumesNegativeTest-1707349420 tempest-VolumesNegativeTest-1707349420-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120740) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 18:14:18.076748 dv-cinder-852009-8-iscsi devstack@n-api.service[120740]: DEBUG oslo_concurrency.lockutils [None req-4ecff5d3-8541-47ba-bdaa-6f5131ccbd7d tempest-VolumesNegativeTest-1707349420 tempest-VolumesNegativeTest-1707349420-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120740) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 18:14:18.077470 dv-cinder-852009-8-iscsi devstack@n-api.service[120740]: DEBUG oslo_concurrency.lockutils [None req-4ecff5d3-8541-47ba-bdaa-6f5131ccbd7d tempest-VolumesNegativeTest-1707349420 tempest-VolumesNegativeTest-1707349420-project] Acquiring lock "1daf4f4c-0e4a-4779-b53a-78c48397ea2f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120740) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 18:14:18.077917 dv-cinder-852009-8-iscsi devstack@n-api.service[120740]: DEBUG oslo_concurrency.lockutils [None req-4ecff5d3-8541-47ba-bdaa-6f5131ccbd7d tempest-VolumesNegativeTest-1707349420 tempest-VolumesNegativeTest-1707349420-project] Lock "1daf4f4c-0e4a-4779-b53a-78c48397ea2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120740) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 18:14:18.078329 dv-cinder-852009-8-iscsi devstack@n-api.service[120740]: DEBUG oslo_concurrency.lockutils [None req-4ecff5d3-8541-47ba-bdaa-6f5131ccbd7d tempest-VolumesNegativeTest-1707349420 tempest-VolumesNegativeTest-1707349420-project] Lock "1daf4f4c-0e4a-4779-b53a-78c48397ea2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120740) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 18:14:18.095660 dv-cinder-852009-8-iscsi devstack@n-api.service[120740]: DEBUG nova.quota [None req-4ecff5d3-8541-47ba-bdaa-6f5131ccbd7d tempest-VolumesNegativeTest-1707349420 tempest-VolumesNegativeTest-1707349420-project] Getting quotas for project 655c0fd331c343fa8b451c98cc368f5d. Resources: {'cores', 'ram', 'instances'} {{(pid=120740) _get_quotas /opt/stack/nova/nova/quota.py:393}} Sep 13 18:14:18.099977 dv-cinder-852009-8-iscsi devstack@n-api.service[120740]: DEBUG nova.quota [None req-4ecff5d3-8541-47ba-bdaa-6f5131ccbd7d tempest-VolumesNegativeTest-1707349420 tempest-VolumesNegativeTest-1707349420-project] Getting quotas for user dd59ce3705d94670b825d5fdb03a9472 and project 655c0fd331c343fa8b451c98cc368f5d. Resources: {'cores', 'ram', 'instances'} {{(pid=120740) _get_quotas /opt/stack/nova/nova/quota.py:383}} Sep 13 18:14:18.111966 dv-cinder-852009-8-iscsi devstack@n-api.service[120740]: DEBUG nova.compute.api [None req-4ecff5d3-8541-47ba-bdaa-6f5131ccbd7d tempest-VolumesNegativeTest-1707349420 tempest-VolumesNegativeTest-1707349420-project] Going to run 1 instances... {{(pid=120740) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Sep 13 18:14:18.114290 dv-cinder-852009-8-iscsi devstack@n-api.service[120740]: DEBUG nova.compute.api [None req-4ecff5d3-8541-47ba-bdaa-6f5131ccbd7d tempest-VolumesNegativeTest-1707349420 tempest-VolumesNegativeTest-1707349420-project] [instance: bda192dc-177b-4666-a0d7-cdd2ccc7193b] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='33034e36-e6b2-4847-92a1-ff3188c05a4a',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=120740) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Sep 13 18:14:18.162794 dv-cinder-852009-8-iscsi devstack@n-api.service[120740]: INFO nova.api.openstack.requestlog [None req-4ecff5d3-8541-47ba-bdaa-6f5131ccbd7d tempest-VolumesNegativeTest-1707349420 tempest-VolumesNegativeTest-1707349420-project] 10.222.0.43 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 0.439458 Sep 13 18:14:18.163453 dv-cinder-852009-8-iscsi devstack@n-api.service[120740]: [pid: 120740|app: 0|req: 475/939] 10.222.0.43 () {60 vars in 1147 bytes} [Tue Sep 13 18:14:17 2022] POST /compute/v2.1/servers => generated 380 bytes in 441 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Sep 13 18:14:18.174648 dv-cinder-852009-8-iscsi devstack@n-api.service[120741]: DEBUG nova.api.openstack.wsgi [None req-034b839d-1192-4c3e-9724-b9d8185ca292 tempest-VolumesNegativeTest-1707349420 tempest-VolumesNegativeTest-1707349420-project] Calling method '>' {{(pid=120741) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 18:14:18.175245 dv-cinder-852009-8-iscsi devstack@n-api.service[120741]: DEBUG nova.compute.api [None req-034b839d-1192-4c3e-9724-b9d8185ca292 tempest-VolumesNegativeTest-1707349420 tempest-VolumesNegativeTest-1707349420-project] [instance: bda192dc-177b-4666-a0d7-cdd2ccc7193b] Fetching instance by UUID {{(pid=120741) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 18:14:18.177869 dv-cinder-852009-8-iscsi devstack@n-api.service[120741]: DEBUG dbcounter [-] [120741] Writing DB stats nova_api:SELECT=49,nova_api:UPDATE=1 {{(pid=120741) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 18:14:18.178509 dv-cinder-852009-8-iscsi devstack@n-api.service[120741]: DEBUG dbcounter [-] [120741] Writing DB stats nova_cell1:SELECT=88,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=120741) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 18:14:18.231713 dv-cinder-852009-8-iscsi devstack@n-api.service[120741]: DEBUG nova.policy [None req-034b839d-1192-4c3e-9724-b9d8185ca292 tempest-VolumesNegativeTest-1707349420 tempest-VolumesNegativeTest-1707349420-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dd59ce3705d94670b825d5fdb03a9472', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '655c0fd331c343fa8b451c98cc368f5d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120741) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 18:14:18.238895 dv-cinder-852009-8-iscsi devstack@n-api.service[120741]: INFO nova.api.openstack.requestlog [None req-034b839d-1192-4c3e-9724-b9d8185ca292 tempest-VolumesNegativeTest-1707349420 tempest-VolumesNegativeTest-1707349420-project] 10.222.0.43 "GET /compute/v2.1/servers/bda192dc-177b-4666-a0d7-cdd2ccc7193b" status: 200 len: 1215 microversion: 2.1 time: 0.068106 Sep 13 18:14:18.239439 dv-cinder-852009-8-iscsi devstack@n-api.service[120741]: [pid: 120741|app: 0|req: 465/940] 10.222.0.43 () {58 vars in 1236 bytes} [Tue Sep 13 18:14:18 2022] GET /compute/v2.1/servers/bda192dc-177b-4666-a0d7-cdd2ccc7193b => generated 1215 bytes in 69 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 13 18:14:19.261918 dv-cinder-852009-8-iscsi devstack@n-api.service[120740]: DEBUG nova.api.openstack.wsgi [None req-01c730b1-3d1f-4dd2-88be-97a2e9fe0d89 tempest-VolumesNegativeTest-1707349420 tempest-VolumesNegativeTest-1707349420-project] Calling method '>' {{(pid=120740) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 18:14:19.262854 dv-cinder-852009-8-iscsi devstack@n-api.service[120740]: DEBUG nova.compute.api [None req-01c730b1-3d1f-4dd2-88be-97a2e9fe0d89 tempest-VolumesNegativeTest-1707349420 tempest-VolumesNegativeTest-1707349420-project] [instance: bda192dc-177b-4666-a0d7-cdd2ccc7193b] Fetching instance by UUID {{(pid=120740) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 18:14:19.280964 dv-cinder-852009-8-iscsi devstack@n-api.service[120740]: DEBUG oslo_concurrency.lockutils [None req-01c730b1-3d1f-4dd2-88be-97a2e9fe0d89 tempest-VolumesNegativeTest-1707349420 tempest-VolumesNegativeTest-1707349420-project] Acquiring lock "1daf4f4c-0e4a-4779-b53a-78c48397ea2f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120740) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 18:14:19.281639 dv-cinder-852009-8-iscsi devstack@n-api.service[120740]: DEBUG oslo_concurrency.lockutils [None req-01c730b1-3d1f-4dd2-88be-97a2e9fe0d89 tempest-VolumesNegativeTest-1707349420 tempest-VolumesNegativeTest-1707349420-project] Lock "1daf4f4c-0e4a-4779-b53a-78c48397ea2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.011s {{(pid=120740) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 18:14:19.289508 dv-cinder-852009-8-iscsi devstack@n-api.service[120740]: DEBUG oslo_concurrency.lockutils [None req-01c730b1-3d1f-4dd2-88be-97a2e9fe0d89 tempest-VolumesNegativeTest-1707349420 tempest-VolumesNegativeTest-1707349420-project] Lock "1daf4f4c-0e4a-4779-b53a-78c48397ea2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.008s {{(pid=120740) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 18:14:19.290370 dv-cinder-852009-8-iscsi devstack@n-api.service[120740]: DEBUG oslo_concurrency.lockutils [None req-01c730b1-3d1f-4dd2-88be-97a2e9fe0d89 tempest-VolumesNegativeTest-1707349420 tempest-VolumesNegativeTest-1707349420-project] Acquiring lock "1daf4f4c-0e4a-4779-b53a-78c48397ea2f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120740) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 18:14:19.291085 dv-cinder-852009-8-iscsi devstack@n-api.service[120740]: DEBUG oslo_concurrency.lockutils [None req-01c730b1-3d1f-4dd2-88be-97a2e9fe0d89 tempest-VolumesNegativeTest-1707349420 tempest-VolumesNegativeTest-1707349420-project] Lock "1daf4f4c-0e4a-4779-b53a-78c48397ea2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120740) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 18:14:19.291615 dv-cinder-852009-8-iscsi devstack@n-api.service[120740]: DEBUG oslo_concurrency.lockutils [None req-01c730b1-3d1f-4dd2-88be-97a2e9fe0d89 tempest-VolumesNegativeTest-1707349420 tempest-VolumesNegativeTest-1707349420-project] Lock "1daf4f4c-0e4a-4779-b53a-78c48397ea2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120740) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 18:14:19.365742 dv-cinder-852009-8-iscsi devstack@n-api.service[120740]: DEBUG nova.policy [None req-01c730b1-3d1f-4dd2-88be-97a2e9fe0d89 tempest-VolumesNegativeTest-1707349420 tempest-VolumesNegativeTest-1707349420-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dd59ce3705d94670b825d5fdb03a9472', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '655c0fd331c343fa8b451c98cc368f5d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120740) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 18:14:19.374268 dv-cinder-852009-8-iscsi devstack@n-api.service[120740]: INFO nova.api.openstack.requestlog [None req-01c730b1-3d1f-4dd2-88be-97a2e9fe0d89 tempest-VolumesNegativeTest-1707349420 tempest-VolumesNegativeTest-1707349420-project] 10.222.0.43 "GET /compute/v2.1/servers/bda192dc-177b-4666-a0d7-cdd2ccc7193b" status: 200 len: 1285 microversion: 2.1 time: 0.116235 Sep 13 18:14:19.374838 dv-cinder-852009-8-iscsi devstack@n-api.service[120740]: [pid: 120740|app: 0|req: 476/941] 10.222.0.43 () {58 vars in 1236 bytes} [Tue Sep 13 18:14:19 2022] GET /compute/v2.1/servers/bda192dc-177b-4666-a0d7-cdd2ccc7193b => generated 1285 bytes in 118 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 13 18:14:20.397879 dv-cinder-852009-8-iscsi devstack@n-api.service[120741]: DEBUG nova.api.openstack.wsgi [None req-8f744dc6-c3db-4141-99f0-a04c843eb31a tempest-VolumesNegativeTest-1707349420 tempest-VolumesNegativeTest-1707349420-project] Calling method '>' {{(pid=120741) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 18:14:20.398430 dv-cinder-852009-8-iscsi devstack@n-api.service[120741]: DEBUG nova.compute.api [None req-8f744dc6-c3db-4141-99f0-a04c843eb31a tempest-VolumesNegativeTest-1707349420 tempest-VolumesNegativeTest-1707349420-project] [instance: bda192dc-177b-4666-a0d7-cdd2ccc7193b] Fetching instance by UUID {{(pid=120741) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 18:14:20.401663 dv-cinder-852009-8-iscsi devstack@n-api.service[120741]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Sep 13 18:14:20.401845 dv-cinder-852009-8-iscsi devstack@n-api.service[120741]: Tue Sep 13 18:14:20 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) on request /compute/v2.1/servers/bda192dc-177b-4666-a0d7-cdd2ccc7193b (ip 10.222.0.43) !!! Sep 13 18:14:20.409061 dv-cinder-852009-8-iscsi devstack@n-api.service[120741]: DEBUG oslo_concurrency.lockutils [None req-8f744dc6-c3db-4141-99f0-a04c843eb31a tempest-VolumesNegativeTest-1707349420 tempest-VolumesNegativeTest-1707349420-project] Acquiring lock "1daf4f4c-0e4a-4779-b53a-78c48397ea2f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120741) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 18:14:20.409541 dv-cinder-852009-8-iscsi devstack@n-api.service[120741]: DEBUG oslo_concurrency.lockutils [None req-8f744dc6-c3db-4141-99f0-a04c843eb31a tempest-VolumesNegativeTest-1707349420 tempest-VolumesNegativeTest-1707349420-project] Lock "1daf4f4c-0e4a-4779-b53a-78c48397ea2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120741) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 18:14:20.409964 dv-cinder-852009-8-iscsi devstack@n-api.service[120741]: DEBUG oslo_concurrency.lockutils [None req-8f744dc6-c3db-4141-99f0-a04c843eb31a tempest-VolumesNegativeTest-1707349420 tempest-VolumesNegativeTest-1707349420-project] Lock "1daf4f4c-0e4a-4779-b53a-78c48397ea2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120741) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 18:14:20.410636 dv-cinder-852009-8-iscsi devstack@n-api.service[120741]: DEBUG oslo_concurrency.lockutils [None req-8f744dc6-c3db-4141-99f0-a04c843eb31a tempest-VolumesNegativeTest-1707349420 tempest-VolumesNegativeTest-1707349420-project] Acquiring lock "1daf4f4c-0e4a-4779-b53a-78c48397ea2f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120741) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 18:14:20.411185 dv-cinder-852009-8-iscsi devstack@n-api.service[120741]: DEBUG oslo_concurrency.lockutils [None req-8f744dc6-c3db-4141-99f0-a04c843eb31a tempest-VolumesNegativeTest-1707349420 tempest-VolumesNegativeTest-1707349420-project] Lock "1daf4f4c-0e4a-4779-b53a-78c48397ea2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120741) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 18:14:20.411623 dv-cinder-852009-8-iscsi devstack@n-api.service[120741]: DEBUG oslo_concurrency.lockutils [None req-8f744dc6-c3db-4141-99f0-a04c843eb31a tempest-VolumesNegativeTest-1707349420 tempest-VolumesNegativeTest-1707349420-project] Lock "1daf4f4c-0e4a-4779-b53a-78c48397ea2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120741) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 18:14:20.541526 dv-cinder-852009-8-iscsi devstack@n-api.service[120741]: DEBUG nova.policy [None req-8f744dc6-c3db-4141-99f0-a04c843eb31a tempest-VolumesNegativeTest-1707349420 tempest-VolumesNegativeTest-1707349420-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dd59ce3705d94670b825d5fdb03a9472', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '655c0fd331c343fa8b451c98cc368f5d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120741) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 18:14:20.549920 dv-cinder-852009-8-iscsi devstack@n-api.service[120741]: INFO nova.api.openstack.requestlog [None req-8f744dc6-c3db-4141-99f0-a04c843eb31a tempest-VolumesNegativeTest-1707349420 tempest-VolumesNegativeTest-1707349420-project] 10.222.0.43 "GET /compute/v2.1/servers/bda192dc-177b-4666-a0d7-cdd2ccc7193b" status: 200 len: 1315 microversion: 2.1 time: 0.155943 Sep 13 18:14:20.550640 dv-cinder-852009-8-iscsi devstack@n-api.service[120741]: [pid: 120741|app: 0|req: 466/942] 10.222.0.43 () {58 vars in 1236 bytes} [Tue Sep 13 18:14:20 2022] GET /compute/v2.1/servers/bda192dc-177b-4666-a0d7-cdd2ccc7193b => generated 1315 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 13 18:14:20.763785 dv-cinder-852009-8-iscsi devstack@n-api.service[120740]: DEBUG nova.api.openstack.wsgi [req-5123c0aa-237a-46fd-8f39-137c6ae7502d req-d4e512ef-9813-4c22-b041-0107fd41ca2a service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "bda192dc-177b-4666-a0d7-cdd2ccc7193b", "tag": "8bfb214c-ca85-41fe-92c5-cafabdb851d8"}]} {{(pid=120740) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 13 18:14:20.775487 dv-cinder-852009-8-iscsi devstack@n-api.service[120740]: DEBUG oslo_concurrency.lockutils [req-5123c0aa-237a-46fd-8f39-137c6ae7502d req-d4e512ef-9813-4c22-b041-0107fd41ca2a service nova] Acquiring lock "1daf4f4c-0e4a-4779-b53a-78c48397ea2f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120740) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 18:14:20.775966 dv-cinder-852009-8-iscsi devstack@n-api.service[120740]: DEBUG oslo_concurrency.lockutils [req-5123c0aa-237a-46fd-8f39-137c6ae7502d req-d4e512ef-9813-4c22-b041-0107fd41ca2a service nova] Lock "1daf4f4c-0e4a-4779-b53a-78c48397ea2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120740) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 18:14:20.776411 dv-cinder-852009-8-iscsi devstack@n-api.service[120740]: DEBUG oslo_concurrency.lockutils [req-5123c0aa-237a-46fd-8f39-137c6ae7502d req-d4e512ef-9813-4c22-b041-0107fd41ca2a service nova] Lock "1daf4f4c-0e4a-4779-b53a-78c48397ea2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120740) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 18:14:20.787996 dv-cinder-852009-8-iscsi devstack@n-api.service[120740]: INFO nova.api.openstack.compute.server_external_events [req-5123c0aa-237a-46fd-8f39-137c6ae7502d req-d4e512ef-9813-4c22-b041-0107fd41ca2a service nova] Creating event network-changed:8bfb214c-ca85-41fe-92c5-cafabdb851d8 for instance bda192dc-177b-4666-a0d7-cdd2ccc7193b on hv-cinder-85200 Sep 13 18:14:20.793004 dv-cinder-852009-8-iscsi devstack@n-api.service[120740]: INFO nova.api.openstack.requestlog [req-5123c0aa-237a-46fd-8f39-137c6ae7502d req-d4e512ef-9813-4c22-b041-0107fd41ca2a service nova] 10.222.0.43 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.032940 Sep 13 18:14:20.793776 dv-cinder-852009-8-iscsi devstack@n-api.service[120740]: [pid: 120740|app: 0|req: 477/943] 10.222.0.43 () {64 vars in 1317 bytes} [Tue Sep 13 18:14:20 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 35 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 13 18:14:21.577941 dv-cinder-852009-8-iscsi devstack@n-api.service[120741]: DEBUG nova.api.openstack.wsgi [None req-e31efb74-6db4-4571-90d9-3cca710f3218 tempest-VolumesNegativeTest-1707349420 tempest-VolumesNegativeTest-1707349420-project] Calling method '>' {{(pid=120741) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 18:14:21.578848 dv-cinder-852009-8-iscsi devstack@n-api.service[120741]: DEBUG nova.compute.api [None req-e31efb74-6db4-4571-90d9-3cca710f3218 tempest-VolumesNegativeTest-1707349420 tempest-VolumesNegativeTest-1707349420-project] [instance: bda192dc-177b-4666-a0d7-cdd2ccc7193b] Fetching instance by UUID {{(pid=120741) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 18:14:21.586986 dv-cinder-852009-8-iscsi devstack@n-api.service[120741]: DEBUG oslo_concurrency.lockutils [None req-e31efb74-6db4-4571-90d9-3cca710f3218 tempest-VolumesNegativeTest-1707349420 tempest-VolumesNegativeTest-1707349420-project] Acquiring lock "1daf4f4c-0e4a-4779-b53a-78c48397ea2f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120741) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 18:14:21.587465 dv-cinder-852009-8-iscsi devstack@n-api.service[120741]: DEBUG oslo_concurrency.lockutils [None req-e31efb74-6db4-4571-90d9-3cca710f3218 tempest-VolumesNegativeTest-1707349420 tempest-VolumesNegativeTest-1707349420-project] Lock "1daf4f4c-0e4a-4779-b53a-78c48397ea2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120741) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 18:14:21.587890 dv-cinder-852009-8-iscsi devstack@n-api.service[120741]: DEBUG oslo_concurrency.lockutils [None req-e31efb74-6db4-4571-90d9-3cca710f3218 tempest-VolumesNegativeTest-1707349420 tempest-VolumesNegativeTest-1707349420-project] Lock "1daf4f4c-0e4a-4779-b53a-78c48397ea2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120741) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 18:14:21.588611 dv-cinder-852009-8-iscsi devstack@n-api.service[120741]: DEBUG oslo_concurrency.lockutils [None req-e31efb74-6db4-4571-90d9-3cca710f3218 tempest-VolumesNegativeTest-1707349420 tempest-VolumesNegativeTest-1707349420-project] Acquiring lock "1daf4f4c-0e4a-4779-b53a-78c48397ea2f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120741) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 18:14:21.589052 dv-cinder-852009-8-iscsi devstack@n-api.service[120741]: DEBUG oslo_concurrency.lockutils [None req-e31efb74-6db4-4571-90d9-3cca710f3218 tempest-VolumesNegativeTest-1707349420 tempest-VolumesNegativeTest-1707349420-project] Lock "1daf4f4c-0e4a-4779-b53a-78c48397ea2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120741) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 18:14:21.589474 dv-cinder-852009-8-iscsi devstack@n-api.service[120741]: DEBUG oslo_concurrency.lockutils [None req-e31efb74-6db4-4571-90d9-3cca710f3218 tempest-VolumesNegativeTest-1707349420 tempest-VolumesNegativeTest-1707349420-project] Lock "1daf4f4c-0e4a-4779-b53a-78c48397ea2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120741) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 18:14:21.730609 dv-cinder-852009-8-iscsi devstack@n-api.service[120741]: DEBUG nova.policy [None req-e31efb74-6db4-4571-90d9-3cca710f3218 tempest-VolumesNegativeTest-1707349420 tempest-VolumesNegativeTest-1707349420-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dd59ce3705d94670b825d5fdb03a9472', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '655c0fd331c343fa8b451c98cc368f5d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120741) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 18:14:21.738782 dv-cinder-852009-8-iscsi devstack@n-api.service[120741]: INFO nova.api.openstack.requestlog [None req-e31efb74-6db4-4571-90d9-3cca710f3218 tempest-VolumesNegativeTest-1707349420 tempest-VolumesNegativeTest-1707349420-project] 10.222.0.43 "GET /compute/v2.1/servers/bda192dc-177b-4666-a0d7-cdd2ccc7193b" status: 200 len: 1315 microversion: 2.1 time: 0.167457 Sep 13 18:14:21.739349 dv-cinder-852009-8-iscsi devstack@n-api.service[120741]: [pid: 120741|app: 0|req: 467/944] 10.222.0.43 () {58 vars in 1236 bytes} [Tue Sep 13 18:14:21 2022] GET /compute/v2.1/servers/bda192dc-177b-4666-a0d7-cdd2ccc7193b => generated 1315 bytes in 169 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 13 18:14:22.764363 dv-cinder-852009-8-iscsi devstack@n-api.service[120740]: DEBUG nova.api.openstack.wsgi [None req-98ab050d-f098-4520-85ac-3e584bb2759e tempest-VolumesNegativeTest-1707349420 tempest-VolumesNegativeTest-1707349420-project] Calling method '>' {{(pid=120740) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 18:14:22.765222 dv-cinder-852009-8-iscsi devstack@n-api.service[120740]: DEBUG nova.compute.api [None req-98ab050d-f098-4520-85ac-3e584bb2759e tempest-VolumesNegativeTest-1707349420 tempest-VolumesNegativeTest-1707349420-project] [instance: bda192dc-177b-4666-a0d7-cdd2ccc7193b] Fetching instance by UUID {{(pid=120740) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 18:14:22.772573 dv-cinder-852009-8-iscsi devstack@n-api.service[120740]: DEBUG oslo_concurrency.lockutils [None req-98ab050d-f098-4520-85ac-3e584bb2759e tempest-VolumesNegativeTest-1707349420 tempest-VolumesNegativeTest-1707349420-project] Acquiring lock "1daf4f4c-0e4a-4779-b53a-78c48397ea2f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120740) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 18:14:22.773064 dv-cinder-852009-8-iscsi devstack@n-api.service[120740]: DEBUG oslo_concurrency.lockutils [None req-98ab050d-f098-4520-85ac-3e584bb2759e tempest-VolumesNegativeTest-1707349420 tempest-VolumesNegativeTest-1707349420-project] Lock "1daf4f4c-0e4a-4779-b53a-78c48397ea2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120740) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 18:14:22.773498 dv-cinder-852009-8-iscsi devstack@n-api.service[120740]: DEBUG oslo_concurrency.lockutils [None req-98ab050d-f098-4520-85ac-3e584bb2759e tempest-VolumesNegativeTest-1707349420 tempest-VolumesNegativeTest-1707349420-project] Lock "1daf4f4c-0e4a-4779-b53a-78c48397ea2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120740) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 18:14:22.774189 dv-cinder-852009-8-iscsi devstack@n-api.service[120740]: DEBUG oslo_concurrency.lockutils [None req-98ab050d-f098-4520-85ac-3e584bb2759e tempest-VolumesNegativeTest-1707349420 tempest-VolumesNegativeTest-1707349420-project] Acquiring lock "1daf4f4c-0e4a-4779-b53a-78c48397ea2f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120740) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 18:14:22.774649 dv-cinder-852009-8-iscsi devstack@n-api.service[120740]: DEBUG oslo_concurrency.lockutils [None req-98ab050d-f098-4520-85ac-3e584bb2759e tempest-VolumesNegativeTest-1707349420 tempest-VolumesNegativeTest-1707349420-project] Lock "1daf4f4c-0e4a-4779-b53a-78c48397ea2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120740) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 18:14:22.775071 dv-cinder-852009-8-iscsi devstack@n-api.service[120740]: DEBUG oslo_concurrency.lockutils [None req-98ab050d-f098-4520-85ac-3e584bb2759e tempest-VolumesNegativeTest-1707349420 tempest-VolumesNegativeTest-1707349420-project] Lock "1daf4f4c-0e4a-4779-b53a-78c48397ea2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120740) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 18:14:22.911006 dv-cinder-852009-8-iscsi devstack@n-api.service[120740]: DEBUG nova.policy [None req-98ab050d-f098-4520-85ac-3e584bb2759e tempest-VolumesNegativeTest-1707349420 tempest-VolumesNegativeTest-1707349420-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dd59ce3705d94670b825d5fdb03a9472', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '655c0fd331c343fa8b451c98cc368f5d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120740) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 18:14:22.918948 dv-cinder-852009-8-iscsi devstack@n-api.service[120740]: INFO nova.api.openstack.requestlog [None req-98ab050d-f098-4520-85ac-3e584bb2759e tempest-VolumesNegativeTest-1707349420 tempest-VolumesNegativeTest-1707349420-project] 10.222.0.43 "GET /compute/v2.1/servers/bda192dc-177b-4666-a0d7-cdd2ccc7193b" status: 200 len: 1315 microversion: 2.1 time: 0.160233 Sep 13 18:14:22.919546 dv-cinder-852009-8-iscsi devstack@n-api.service[120740]: [pid: 120740|app: 0|req: 478/945] 10.222.0.43 () {58 vars in 1236 bytes} [Tue Sep 13 18:14:22 2022] GET /compute/v2.1/servers/bda192dc-177b-4666-a0d7-cdd2ccc7193b => generated 1315 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 13 18:14:23.944179 dv-cinder-852009-8-iscsi devstack@n-api.service[120741]: DEBUG nova.api.openstack.wsgi [None req-545fbd0f-76e8-4ca5-90e9-1133ecc83599 tempest-VolumesNegativeTest-1707349420 tempest-VolumesNegativeTest-1707349420-project] Calling method '>' {{(pid=120741) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 18:14:23.944819 dv-cinder-852009-8-iscsi devstack@n-api.service[120741]: DEBUG nova.compute.api [None req-545fbd0f-76e8-4ca5-90e9-1133ecc83599 tempest-VolumesNegativeTest-1707349420 tempest-VolumesNegativeTest-1707349420-project] [instance: bda192dc-177b-4666-a0d7-cdd2ccc7193b] Fetching instance by UUID {{(pid=120741) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 18:14:23.952264 dv-cinder-852009-8-iscsi devstack@n-api.service[120741]: DEBUG oslo_concurrency.lockutils [None req-545fbd0f-76e8-4ca5-90e9-1133ecc83599 tempest-VolumesNegativeTest-1707349420 tempest-VolumesNegativeTest-1707349420-project] Acquiring lock "1daf4f4c-0e4a-4779-b53a-78c48397ea2f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120741) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 18:14:23.952790 dv-cinder-852009-8-iscsi devstack@n-api.service[120741]: DEBUG oslo_concurrency.lockutils [None req-545fbd0f-76e8-4ca5-90e9-1133ecc83599 tempest-VolumesNegativeTest-1707349420 tempest-VolumesNegativeTest-1707349420-project] Lock "1daf4f4c-0e4a-4779-b53a-78c48397ea2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120741) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 18:14:23.953302 dv-cinder-852009-8-iscsi devstack@n-api.service[120741]: DEBUG oslo_concurrency.lockutils [None req-545fbd0f-76e8-4ca5-90e9-1133ecc83599 tempest-VolumesNegativeTest-1707349420 tempest-VolumesNegativeTest-1707349420-project] Lock "1daf4f4c-0e4a-4779-b53a-78c48397ea2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120741) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 18:14:23.954027 dv-cinder-852009-8-iscsi devstack@n-api.service[120741]: DEBUG oslo_concurrency.lockutils [None req-545fbd0f-76e8-4ca5-90e9-1133ecc83599 tempest-VolumesNegativeTest-1707349420 tempest-VolumesNegativeTest-1707349420-project] Acquiring lock "1daf4f4c-0e4a-4779-b53a-78c48397ea2f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120741) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 18:14:23.954469 dv-cinder-852009-8-iscsi devstack@n-api.service[120741]: DEBUG oslo_concurrency.lockutils [None req-545fbd0f-76e8-4ca5-90e9-1133ecc83599 tempest-VolumesNegativeTest-1707349420 tempest-VolumesNegativeTest-1707349420-project] Lock "1daf4f4c-0e4a-4779-b53a-78c48397ea2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120741) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 18:14:23.954913 dv-cinder-852009-8-iscsi devstack@n-api.service[120741]: DEBUG oslo_concurrency.lockutils [None req-545fbd0f-76e8-4ca5-90e9-1133ecc83599 tempest-VolumesNegativeTest-1707349420 tempest-VolumesNegativeTest-1707349420-project] Lock "1daf4f4c-0e4a-4779-b53a-78c48397ea2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120741) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 18:14:24.093164 dv-cinder-852009-8-iscsi devstack@n-api.service[120741]: DEBUG nova.policy [None req-545fbd0f-76e8-4ca5-90e9-1133ecc83599 tempest-VolumesNegativeTest-1707349420 tempest-VolumesNegativeTest-1707349420-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dd59ce3705d94670b825d5fdb03a9472', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '655c0fd331c343fa8b451c98cc368f5d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120741) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 18:14:24.101006 dv-cinder-852009-8-iscsi devstack@n-api.service[120741]: INFO nova.api.openstack.requestlog [None req-545fbd0f-76e8-4ca5-90e9-1133ecc83599 tempest-VolumesNegativeTest-1707349420 tempest-VolumesNegativeTest-1707349420-project] 10.222.0.43 "GET /compute/v2.1/servers/bda192dc-177b-4666-a0d7-cdd2ccc7193b" status: 200 len: 1315 microversion: 2.1 time: 0.162185 Sep 13 18:14:24.101549 dv-cinder-852009-8-iscsi devstack@n-api.service[120741]: [pid: 120741|app: 0|req: 468/946] 10.222.0.43 () {58 vars in 1236 bytes} [Tue Sep 13 18:14:23 2022] GET /compute/v2.1/servers/bda192dc-177b-4666-a0d7-cdd2ccc7193b => generated 1315 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 13 18:14:25.128488 dv-cinder-852009-8-iscsi devstack@n-api.service[120740]: DEBUG nova.api.openstack.wsgi [None req-60982691-4e92-4976-be78-f5fbd879a50d tempest-VolumesNegativeTest-1707349420 tempest-VolumesNegativeTest-1707349420-project] Calling method '>' {{(pid=120740) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 18:14:25.129471 dv-cinder-852009-8-iscsi devstack@n-api.service[120740]: DEBUG nova.compute.api [None req-60982691-4e92-4976-be78-f5fbd879a50d tempest-VolumesNegativeTest-1707349420 tempest-VolumesNegativeTest-1707349420-project] [instance: bda192dc-177b-4666-a0d7-cdd2ccc7193b] Fetching instance by UUID {{(pid=120740) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 18:14:25.139864 dv-cinder-852009-8-iscsi devstack@n-api.service[120740]: DEBUG oslo_concurrency.lockutils [None req-60982691-4e92-4976-be78-f5fbd879a50d tempest-VolumesNegativeTest-1707349420 tempest-VolumesNegativeTest-1707349420-project] Acquiring lock "1daf4f4c-0e4a-4779-b53a-78c48397ea2f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120740) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 18:14:25.140723 dv-cinder-852009-8-iscsi devstack@n-api.service[120740]: DEBUG oslo_concurrency.lockutils [None req-60982691-4e92-4976-be78-f5fbd879a50d tempest-VolumesNegativeTest-1707349420 tempest-VolumesNegativeTest-1707349420-project] Lock "1daf4f4c-0e4a-4779-b53a-78c48397ea2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120740) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 18:14:25.141432 dv-cinder-852009-8-iscsi devstack@n-api.service[120740]: DEBUG oslo_concurrency.lockutils [None req-60982691-4e92-4976-be78-f5fbd879a50d tempest-VolumesNegativeTest-1707349420 tempest-VolumesNegativeTest-1707349420-project] Lock "1daf4f4c-0e4a-4779-b53a-78c48397ea2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120740) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 18:14:25.142567 dv-cinder-852009-8-iscsi devstack@n-api.service[120740]: DEBUG oslo_concurrency.lockutils [None req-60982691-4e92-4976-be78-f5fbd879a50d tempest-VolumesNegativeTest-1707349420 tempest-VolumesNegativeTest-1707349420-project] Acquiring lock "1daf4f4c-0e4a-4779-b53a-78c48397ea2f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120740) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 18:14:25.143425 dv-cinder-852009-8-iscsi devstack@n-api.service[120740]: DEBUG oslo_concurrency.lockutils [None req-60982691-4e92-4976-be78-f5fbd879a50d tempest-VolumesNegativeTest-1707349420 tempest-VolumesNegativeTest-1707349420-project] Lock "1daf4f4c-0e4a-4779-b53a-78c48397ea2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120740) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 18:14:25.144135 dv-cinder-852009-8-iscsi devstack@n-api.service[120740]: DEBUG oslo_concurrency.lockutils [None req-60982691-4e92-4976-be78-f5fbd879a50d tempest-VolumesNegativeTest-1707349420 tempest-VolumesNegativeTest-1707349420-project] Lock "1daf4f4c-0e4a-4779-b53a-78c48397ea2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120740) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 18:14:25.288367 dv-cinder-852009-8-iscsi devstack@n-api.service[120740]: DEBUG nova.policy [None req-60982691-4e92-4976-be78-f5fbd879a50d tempest-VolumesNegativeTest-1707349420 tempest-VolumesNegativeTest-1707349420-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dd59ce3705d94670b825d5fdb03a9472', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '655c0fd331c343fa8b451c98cc368f5d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120740) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 18:14:25.297562 dv-cinder-852009-8-iscsi devstack@n-api.service[120740]: INFO nova.api.openstack.requestlog [None req-60982691-4e92-4976-be78-f5fbd879a50d tempest-VolumesNegativeTest-1707349420 tempest-VolumesNegativeTest-1707349420-project] 10.222.0.43 "GET /compute/v2.1/servers/bda192dc-177b-4666-a0d7-cdd2ccc7193b" status: 200 len: 1315 microversion: 2.1 time: 0.175599 Sep 13 18:14:25.298129 dv-cinder-852009-8-iscsi devstack@n-api.service[120740]: [pid: 120740|app: 0|req: 479/947] 10.222.0.43 () {58 vars in 1236 bytes} [Tue Sep 13 18:14:25 2022] GET /compute/v2.1/servers/bda192dc-177b-4666-a0d7-cdd2ccc7193b => generated 1315 bytes in 177 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 13 18:14:26.322275 dv-cinder-852009-8-iscsi devstack@n-api.service[120741]: DEBUG nova.api.openstack.wsgi [None req-480c3995-3807-4fa4-a5c7-eeaed4742c55 tempest-VolumesNegativeTest-1707349420 tempest-VolumesNegativeTest-1707349420-project] Calling method '>' {{(pid=120741) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 18:14:26.323009 dv-cinder-852009-8-iscsi devstack@n-api.service[120741]: DEBUG nova.compute.api [None req-480c3995-3807-4fa4-a5c7-eeaed4742c55 tempest-VolumesNegativeTest-1707349420 tempest-VolumesNegativeTest-1707349420-project] [instance: bda192dc-177b-4666-a0d7-cdd2ccc7193b] Fetching instance by UUID {{(pid=120741) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 18:14:26.331623 dv-cinder-852009-8-iscsi devstack@n-api.service[120741]: DEBUG oslo_concurrency.lockutils [None req-480c3995-3807-4fa4-a5c7-eeaed4742c55 tempest-VolumesNegativeTest-1707349420 tempest-VolumesNegativeTest-1707349420-project] Acquiring lock "1daf4f4c-0e4a-4779-b53a-78c48397ea2f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120741) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 18:14:26.332226 dv-cinder-852009-8-iscsi devstack@n-api.service[120741]: DEBUG oslo_concurrency.lockutils [None req-480c3995-3807-4fa4-a5c7-eeaed4742c55 tempest-VolumesNegativeTest-1707349420 tempest-VolumesNegativeTest-1707349420-project] Lock "1daf4f4c-0e4a-4779-b53a-78c48397ea2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120741) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 18:14:26.332844 dv-cinder-852009-8-iscsi devstack@n-api.service[120741]: DEBUG oslo_concurrency.lockutils [None req-480c3995-3807-4fa4-a5c7-eeaed4742c55 tempest-VolumesNegativeTest-1707349420 tempest-VolumesNegativeTest-1707349420-project] Lock "1daf4f4c-0e4a-4779-b53a-78c48397ea2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120741) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 18:14:26.333745 dv-cinder-852009-8-iscsi devstack@n-api.service[120741]: DEBUG oslo_concurrency.lockutils [None req-480c3995-3807-4fa4-a5c7-eeaed4742c55 tempest-VolumesNegativeTest-1707349420 tempest-VolumesNegativeTest-1707349420-project] Acquiring lock "1daf4f4c-0e4a-4779-b53a-78c48397ea2f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120741) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 18:14:26.334304 dv-cinder-852009-8-iscsi devstack@n-api.service[120741]: DEBUG oslo_concurrency.lockutils [None req-480c3995-3807-4fa4-a5c7-eeaed4742c55 tempest-VolumesNegativeTest-1707349420 tempest-VolumesNegativeTest-1707349420-project] Lock "1daf4f4c-0e4a-4779-b53a-78c48397ea2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120741) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 18:14:26.334842 dv-cinder-852009-8-iscsi devstack@n-api.service[120741]: DEBUG oslo_concurrency.lockutils [None req-480c3995-3807-4fa4-a5c7-eeaed4742c55 tempest-VolumesNegativeTest-1707349420 tempest-VolumesNegativeTest-1707349420-project] Lock "1daf4f4c-0e4a-4779-b53a-78c48397ea2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120741) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 18:14:26.470992 dv-cinder-852009-8-iscsi devstack@n-api.service[120741]: DEBUG nova.policy [None req-480c3995-3807-4fa4-a5c7-eeaed4742c55 tempest-VolumesNegativeTest-1707349420 tempest-VolumesNegativeTest-1707349420-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dd59ce3705d94670b825d5fdb03a9472', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '655c0fd331c343fa8b451c98cc368f5d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120741) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 18:14:26.479031 dv-cinder-852009-8-iscsi devstack@n-api.service[120741]: INFO nova.api.openstack.requestlog [None req-480c3995-3807-4fa4-a5c7-eeaed4742c55 tempest-VolumesNegativeTest-1707349420 tempest-VolumesNegativeTest-1707349420-project] 10.222.0.43 "GET /compute/v2.1/servers/bda192dc-177b-4666-a0d7-cdd2ccc7193b" status: 200 len: 1315 microversion: 2.1 time: 0.161855 Sep 13 18:14:26.479586 dv-cinder-852009-8-iscsi devstack@n-api.service[120741]: [pid: 120741|app: 0|req: 469/948] 10.222.0.43 () {58 vars in 1236 bytes} [Tue Sep 13 18:14:26 2022] GET /compute/v2.1/servers/bda192dc-177b-4666-a0d7-cdd2ccc7193b => generated 1315 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 13 18:14:26.529951 dv-cinder-852009-8-iscsi devstack@n-api.service[120740]: DEBUG nova.api.openstack.wsgi [req-81cf7591-8fd4-4a68-8a25-55cc1853c525 req-69237d28-3b66-4ec4-82b4-e93fd5959752 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "bda192dc-177b-4666-a0d7-cdd2ccc7193b", "name": "network-vif-plugged", "status": "completed", "tag": "8bfb214c-ca85-41fe-92c5-cafabdb851d8"}]} {{(pid=120740) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 13 18:14:26.540443 dv-cinder-852009-8-iscsi devstack@n-api.service[120740]: DEBUG oslo_concurrency.lockutils [req-81cf7591-8fd4-4a68-8a25-55cc1853c525 req-69237d28-3b66-4ec4-82b4-e93fd5959752 service nova] Acquiring lock "1daf4f4c-0e4a-4779-b53a-78c48397ea2f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120740) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 18:14:26.540972 dv-cinder-852009-8-iscsi devstack@n-api.service[120740]: DEBUG oslo_concurrency.lockutils [req-81cf7591-8fd4-4a68-8a25-55cc1853c525 req-69237d28-3b66-4ec4-82b4-e93fd5959752 service nova] Lock "1daf4f4c-0e4a-4779-b53a-78c48397ea2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120740) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 18:14:26.542170 dv-cinder-852009-8-iscsi devstack@n-api.service[120740]: DEBUG oslo_concurrency.lockutils [req-81cf7591-8fd4-4a68-8a25-55cc1853c525 req-69237d28-3b66-4ec4-82b4-e93fd5959752 service nova] Lock "1daf4f4c-0e4a-4779-b53a-78c48397ea2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120740) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 18:14:26.554017 dv-cinder-852009-8-iscsi devstack@n-api.service[120740]: INFO nova.api.openstack.compute.server_external_events [req-81cf7591-8fd4-4a68-8a25-55cc1853c525 req-69237d28-3b66-4ec4-82b4-e93fd5959752 service nova] Creating event network-vif-plugged:8bfb214c-ca85-41fe-92c5-cafabdb851d8 for instance bda192dc-177b-4666-a0d7-cdd2ccc7193b on hv-cinder-85200 Sep 13 18:14:26.559446 dv-cinder-852009-8-iscsi devstack@n-api.service[120740]: INFO nova.api.openstack.requestlog [req-81cf7591-8fd4-4a68-8a25-55cc1853c525 req-69237d28-3b66-4ec4-82b4-e93fd5959752 service nova] 10.222.0.43 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.033362 Sep 13 18:14:26.560044 dv-cinder-852009-8-iscsi devstack@n-api.service[120740]: [pid: 120740|app: 0|req: 480/949] 10.222.0.43 () {64 vars in 1317 bytes} [Tue Sep 13 18:14:26 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 35 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 13 18:14:27.506177 dv-cinder-852009-8-iscsi devstack@n-api.service[120741]: DEBUG nova.api.openstack.wsgi [None req-f13a3768-35e3-478d-a467-b9395a889303 tempest-VolumesNegativeTest-1707349420 tempest-VolumesNegativeTest-1707349420-project] Calling method '>' {{(pid=120741) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 18:14:27.507157 dv-cinder-852009-8-iscsi devstack@n-api.service[120741]: DEBUG nova.compute.api [None req-f13a3768-35e3-478d-a467-b9395a889303 tempest-VolumesNegativeTest-1707349420 tempest-VolumesNegativeTest-1707349420-project] [instance: bda192dc-177b-4666-a0d7-cdd2ccc7193b] Fetching instance by UUID {{(pid=120741) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 18:14:27.518057 dv-cinder-852009-8-iscsi devstack@n-api.service[120741]: DEBUG oslo_concurrency.lockutils [None req-f13a3768-35e3-478d-a467-b9395a889303 tempest-VolumesNegativeTest-1707349420 tempest-VolumesNegativeTest-1707349420-project] Acquiring lock "1daf4f4c-0e4a-4779-b53a-78c48397ea2f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120741) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 18:14:27.518862 dv-cinder-852009-8-iscsi devstack@n-api.service[120741]: DEBUG oslo_concurrency.lockutils [None req-f13a3768-35e3-478d-a467-b9395a889303 tempest-VolumesNegativeTest-1707349420 tempest-VolumesNegativeTest-1707349420-project] Lock "1daf4f4c-0e4a-4779-b53a-78c48397ea2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120741) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 18:14:27.519598 dv-cinder-852009-8-iscsi devstack@n-api.service[120741]: DEBUG oslo_concurrency.lockutils [None req-f13a3768-35e3-478d-a467-b9395a889303 tempest-VolumesNegativeTest-1707349420 tempest-VolumesNegativeTest-1707349420-project] Lock "1daf4f4c-0e4a-4779-b53a-78c48397ea2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120741) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 18:14:27.520608 dv-cinder-852009-8-iscsi devstack@n-api.service[120741]: DEBUG oslo_concurrency.lockutils [None req-f13a3768-35e3-478d-a467-b9395a889303 tempest-VolumesNegativeTest-1707349420 tempest-VolumesNegativeTest-1707349420-project] Acquiring lock "1daf4f4c-0e4a-4779-b53a-78c48397ea2f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120741) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 18:14:27.521093 dv-cinder-852009-8-iscsi devstack@n-api.service[120741]: DEBUG oslo_concurrency.lockutils [None req-f13a3768-35e3-478d-a467-b9395a889303 tempest-VolumesNegativeTest-1707349420 tempest-VolumesNegativeTest-1707349420-project] Lock "1daf4f4c-0e4a-4779-b53a-78c48397ea2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120741) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 18:14:27.521517 dv-cinder-852009-8-iscsi devstack@n-api.service[120741]: DEBUG oslo_concurrency.lockutils [None req-f13a3768-35e3-478d-a467-b9395a889303 tempest-VolumesNegativeTest-1707349420 tempest-VolumesNegativeTest-1707349420-project] Lock "1daf4f4c-0e4a-4779-b53a-78c48397ea2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120741) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 18:14:27.914468 dv-cinder-852009-8-iscsi devstack@n-api.service[120741]: DEBUG nova.policy [None req-f13a3768-35e3-478d-a467-b9395a889303 tempest-VolumesNegativeTest-1707349420 tempest-VolumesNegativeTest-1707349420-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dd59ce3705d94670b825d5fdb03a9472', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '655c0fd331c343fa8b451c98cc368f5d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120741) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 18:14:27.926415 dv-cinder-852009-8-iscsi devstack@n-api.service[120741]: INFO nova.api.openstack.requestlog [None req-f13a3768-35e3-478d-a467-b9395a889303 tempest-VolumesNegativeTest-1707349420 tempest-VolumesNegativeTest-1707349420-project] 10.222.0.43 "GET /compute/v2.1/servers/bda192dc-177b-4666-a0d7-cdd2ccc7193b" status: 200 len: 1315 microversion: 2.1 time: 0.426520 Sep 13 18:14:27.927274 dv-cinder-852009-8-iscsi devstack@n-api.service[120741]: [pid: 120741|app: 0|req: 470/950] 10.222.0.43 () {58 vars in 1236 bytes} [Tue Sep 13 18:14:27 2022] GET /compute/v2.1/servers/bda192dc-177b-4666-a0d7-cdd2ccc7193b => generated 1315 bytes in 429 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 13 18:14:28.959905 dv-cinder-852009-8-iscsi devstack@n-api.service[120740]: DEBUG nova.api.openstack.wsgi [None req-7af623fc-2cc6-4c3d-83ce-38198681c89b tempest-VolumesNegativeTest-1707349420 tempest-VolumesNegativeTest-1707349420-project] Calling method '>' {{(pid=120740) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 18:14:28.960739 dv-cinder-852009-8-iscsi devstack@n-api.service[120740]: DEBUG nova.compute.api [None req-7af623fc-2cc6-4c3d-83ce-38198681c89b tempest-VolumesNegativeTest-1707349420 tempest-VolumesNegativeTest-1707349420-project] [instance: bda192dc-177b-4666-a0d7-cdd2ccc7193b] Fetching instance by UUID {{(pid=120740) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 18:14:28.963457 dv-cinder-852009-8-iscsi devstack@n-api.service[120740]: DEBUG dbcounter [-] [120740] Writing DB stats nova_cell0:SELECT=2 {{(pid=120740) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 18:14:28.964337 dv-cinder-852009-8-iscsi devstack@n-api.service[120740]: DEBUG dbcounter [-] [120740] Writing DB stats nova_cell0:SELECT=6 {{(pid=120740) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 18:14:28.971398 dv-cinder-852009-8-iscsi devstack@n-api.service[120740]: DEBUG oslo_concurrency.lockutils [None req-7af623fc-2cc6-4c3d-83ce-38198681c89b tempest-VolumesNegativeTest-1707349420 tempest-VolumesNegativeTest-1707349420-project] Acquiring lock "1daf4f4c-0e4a-4779-b53a-78c48397ea2f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120740) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 18:14:28.971965 dv-cinder-852009-8-iscsi devstack@n-api.service[120740]: DEBUG oslo_concurrency.lockutils [None req-7af623fc-2cc6-4c3d-83ce-38198681c89b tempest-VolumesNegativeTest-1707349420 tempest-VolumesNegativeTest-1707349420-project] Lock "1daf4f4c-0e4a-4779-b53a-78c48397ea2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120740) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 18:14:28.972464 dv-cinder-852009-8-iscsi devstack@n-api.service[120740]: DEBUG oslo_concurrency.lockutils [None req-7af623fc-2cc6-4c3d-83ce-38198681c89b tempest-VolumesNegativeTest-1707349420 tempest-VolumesNegativeTest-1707349420-project] Lock "1daf4f4c-0e4a-4779-b53a-78c48397ea2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120740) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 18:14:28.973303 dv-cinder-852009-8-iscsi devstack@n-api.service[120740]: DEBUG oslo_concurrency.lockutils [None req-7af623fc-2cc6-4c3d-83ce-38198681c89b tempest-VolumesNegativeTest-1707349420 tempest-VolumesNegativeTest-1707349420-project] Acquiring lock "1daf4f4c-0e4a-4779-b53a-78c48397ea2f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120740) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 18:14:28.973803 dv-cinder-852009-8-iscsi devstack@n-api.service[120740]: DEBUG oslo_concurrency.lockutils [None req-7af623fc-2cc6-4c3d-83ce-38198681c89b tempest-VolumesNegativeTest-1707349420 tempest-VolumesNegativeTest-1707349420-project] Lock "1daf4f4c-0e4a-4779-b53a-78c48397ea2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120740) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 18:14:28.974293 dv-cinder-852009-8-iscsi devstack@n-api.service[120740]: DEBUG oslo_concurrency.lockutils [None req-7af623fc-2cc6-4c3d-83ce-38198681c89b tempest-VolumesNegativeTest-1707349420 tempest-VolumesNegativeTest-1707349420-project] Lock "1daf4f4c-0e4a-4779-b53a-78c48397ea2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120740) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 18:14:29.104819 dv-cinder-852009-8-iscsi devstack@n-api.service[120740]: DEBUG nova.policy [None req-7af623fc-2cc6-4c3d-83ce-38198681c89b tempest-VolumesNegativeTest-1707349420 tempest-VolumesNegativeTest-1707349420-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dd59ce3705d94670b825d5fdb03a9472', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '655c0fd331c343fa8b451c98cc368f5d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120740) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 18:14:29.112593 dv-cinder-852009-8-iscsi devstack@n-api.service[120740]: INFO nova.api.openstack.requestlog [None req-7af623fc-2cc6-4c3d-83ce-38198681c89b tempest-VolumesNegativeTest-1707349420 tempest-VolumesNegativeTest-1707349420-project] 10.222.0.43 "GET /compute/v2.1/servers/bda192dc-177b-4666-a0d7-cdd2ccc7193b" status: 200 len: 1464 microversion: 2.1 time: 0.159375 Sep 13 18:14:29.113159 dv-cinder-852009-8-iscsi devstack@n-api.service[120740]: [pid: 120740|app: 0|req: 481/951] 10.222.0.43 () {58 vars in 1236 bytes} [Tue Sep 13 18:14:28 2022] GET /compute/v2.1/servers/bda192dc-177b-4666-a0d7-cdd2ccc7193b => generated 1464 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 13 18:14:29.172134 dv-cinder-852009-8-iscsi devstack@n-api.service[120741]: DEBUG nova.api.openstack.wsgi [None req-ab2ce3b8-3883-4cad-bf3b-41140bcb1b85 tempest-VolumesNegativeTest-1707349420 tempest-VolumesNegativeTest-1707349420-project] Calling method '>' {{(pid=120741) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 18:14:29.172678 dv-cinder-852009-8-iscsi devstack@n-api.service[120741]: DEBUG nova.compute.api [None req-ab2ce3b8-3883-4cad-bf3b-41140bcb1b85 tempest-VolumesNegativeTest-1707349420 tempest-VolumesNegativeTest-1707349420-project] [instance: bda192dc-177b-4666-a0d7-cdd2ccc7193b] Fetching instance by UUID {{(pid=120741) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 18:14:29.174564 dv-cinder-852009-8-iscsi devstack@n-api.service[120741]: DEBUG dbcounter [-] [120741] Writing DB stats nova_cell0:SELECT=2 {{(pid=120741) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 18:14:29.180262 dv-cinder-852009-8-iscsi devstack@n-api.service[120741]: DEBUG oslo_concurrency.lockutils [None req-ab2ce3b8-3883-4cad-bf3b-41140bcb1b85 tempest-VolumesNegativeTest-1707349420 tempest-VolumesNegativeTest-1707349420-project] Acquiring lock "1daf4f4c-0e4a-4779-b53a-78c48397ea2f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120741) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 18:14:29.180772 dv-cinder-852009-8-iscsi devstack@n-api.service[120741]: DEBUG oslo_concurrency.lockutils [None req-ab2ce3b8-3883-4cad-bf3b-41140bcb1b85 tempest-VolumesNegativeTest-1707349420 tempest-VolumesNegativeTest-1707349420-project] Lock "1daf4f4c-0e4a-4779-b53a-78c48397ea2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120741) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 18:14:29.181200 dv-cinder-852009-8-iscsi devstack@n-api.service[120741]: DEBUG oslo_concurrency.lockutils [None req-ab2ce3b8-3883-4cad-bf3b-41140bcb1b85 tempest-VolumesNegativeTest-1707349420 tempest-VolumesNegativeTest-1707349420-project] Lock "1daf4f4c-0e4a-4779-b53a-78c48397ea2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120741) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 18:14:29.181880 dv-cinder-852009-8-iscsi devstack@n-api.service[120741]: DEBUG oslo_concurrency.lockutils [None req-ab2ce3b8-3883-4cad-bf3b-41140bcb1b85 tempest-VolumesNegativeTest-1707349420 tempest-VolumesNegativeTest-1707349420-project] Acquiring lock "1daf4f4c-0e4a-4779-b53a-78c48397ea2f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120741) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 18:14:29.182389 dv-cinder-852009-8-iscsi devstack@n-api.service[120741]: DEBUG oslo_concurrency.lockutils [None req-ab2ce3b8-3883-4cad-bf3b-41140bcb1b85 tempest-VolumesNegativeTest-1707349420 tempest-VolumesNegativeTest-1707349420-project] Lock "1daf4f4c-0e4a-4779-b53a-78c48397ea2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120741) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 18:14:29.182805 dv-cinder-852009-8-iscsi devstack@n-api.service[120741]: DEBUG oslo_concurrency.lockutils [None req-ab2ce3b8-3883-4cad-bf3b-41140bcb1b85 tempest-VolumesNegativeTest-1707349420 tempest-VolumesNegativeTest-1707349420-project] Lock "1daf4f4c-0e4a-4779-b53a-78c48397ea2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120741) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 18:14:29.208193 dv-cinder-852009-8-iscsi devstack@n-api.service[120741]: DEBUG nova.compute.api [None req-ab2ce3b8-3883-4cad-bf3b-41140bcb1b85 tempest-VolumesNegativeTest-1707349420 tempest-VolumesNegativeTest-1707349420-project] [instance: bda192dc-177b-4666-a0d7-cdd2ccc7193b] Going to try to terminate instance {{(pid=120741) delete /opt/stack/nova/nova/compute/api.py:2719}} Sep 13 18:14:29.287323 dv-cinder-852009-8-iscsi devstack@n-api.service[120741]: INFO nova.api.openstack.requestlog [None req-ab2ce3b8-3883-4cad-bf3b-41140bcb1b85 tempest-VolumesNegativeTest-1707349420 tempest-VolumesNegativeTest-1707349420-project] 10.222.0.43 "DELETE /compute/v2.1/servers/bda192dc-177b-4666-a0d7-cdd2ccc7193b" status: 204 len: 0 microversion: 2.1 time: 0.118754 Sep 13 18:14:29.288035 dv-cinder-852009-8-iscsi devstack@n-api.service[120741]: [pid: 120741|app: 0|req: 471/952] 10.222.0.43 () {58 vars in 1239 bytes} [Tue Sep 13 18:14:29 2022] DELETE /compute/v2.1/servers/bda192dc-177b-4666-a0d7-cdd2ccc7193b => generated 0 bytes in 120 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Sep 13 18:14:29.297005 dv-cinder-852009-8-iscsi devstack@n-api.service[120740]: DEBUG nova.api.openstack.wsgi [None req-941a0cb4-2165-49b7-a56d-9bf5e1d29fbc tempest-VolumesNegativeTest-1707349420 tempest-VolumesNegativeTest-1707349420-project] Calling method '>' {{(pid=120740) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 18:14:29.297606 dv-cinder-852009-8-iscsi devstack@n-api.service[120740]: DEBUG nova.compute.api [None req-941a0cb4-2165-49b7-a56d-9bf5e1d29fbc tempest-VolumesNegativeTest-1707349420 tempest-VolumesNegativeTest-1707349420-project] [instance: bda192dc-177b-4666-a0d7-cdd2ccc7193b] Fetching instance by UUID {{(pid=120740) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 18:14:29.303525 dv-cinder-852009-8-iscsi devstack@n-api.service[120740]: DEBUG oslo_concurrency.lockutils [None req-941a0cb4-2165-49b7-a56d-9bf5e1d29fbc tempest-VolumesNegativeTest-1707349420 tempest-VolumesNegativeTest-1707349420-project] Acquiring lock "1daf4f4c-0e4a-4779-b53a-78c48397ea2f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120740) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 18:14:29.304001 dv-cinder-852009-8-iscsi devstack@n-api.service[120740]: DEBUG oslo_concurrency.lockutils [None req-941a0cb4-2165-49b7-a56d-9bf5e1d29fbc tempest-VolumesNegativeTest-1707349420 tempest-VolumesNegativeTest-1707349420-project] Lock "1daf4f4c-0e4a-4779-b53a-78c48397ea2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120740) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 18:14:29.304472 dv-cinder-852009-8-iscsi devstack@n-api.service[120740]: DEBUG oslo_concurrency.lockutils [None req-941a0cb4-2165-49b7-a56d-9bf5e1d29fbc tempest-VolumesNegativeTest-1707349420 tempest-VolumesNegativeTest-1707349420-project] Lock "1daf4f4c-0e4a-4779-b53a-78c48397ea2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120740) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 18:14:29.305134 dv-cinder-852009-8-iscsi devstack@n-api.service[120740]: DEBUG oslo_concurrency.lockutils [None req-941a0cb4-2165-49b7-a56d-9bf5e1d29fbc tempest-VolumesNegativeTest-1707349420 tempest-VolumesNegativeTest-1707349420-project] Acquiring lock "1daf4f4c-0e4a-4779-b53a-78c48397ea2f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120740) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 18:14:29.305575 dv-cinder-852009-8-iscsi devstack@n-api.service[120740]: DEBUG oslo_concurrency.lockutils [None req-941a0cb4-2165-49b7-a56d-9bf5e1d29fbc tempest-VolumesNegativeTest-1707349420 tempest-VolumesNegativeTest-1707349420-project] Lock "1daf4f4c-0e4a-4779-b53a-78c48397ea2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120740) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 18:14:29.305994 dv-cinder-852009-8-iscsi devstack@n-api.service[120740]: DEBUG oslo_concurrency.lockutils [None req-941a0cb4-2165-49b7-a56d-9bf5e1d29fbc tempest-VolumesNegativeTest-1707349420 tempest-VolumesNegativeTest-1707349420-project] Lock "1daf4f4c-0e4a-4779-b53a-78c48397ea2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120740) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 18:14:29.434828 dv-cinder-852009-8-iscsi devstack@n-api.service[120740]: DEBUG nova.policy [None req-941a0cb4-2165-49b7-a56d-9bf5e1d29fbc tempest-VolumesNegativeTest-1707349420 tempest-VolumesNegativeTest-1707349420-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dd59ce3705d94670b825d5fdb03a9472', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '655c0fd331c343fa8b451c98cc368f5d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120740) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 18:14:29.442974 dv-cinder-852009-8-iscsi devstack@n-api.service[120740]: INFO nova.api.openstack.requestlog [None req-941a0cb4-2165-49b7-a56d-9bf5e1d29fbc tempest-VolumesNegativeTest-1707349420 tempest-VolumesNegativeTest-1707349420-project] 10.222.0.43 "GET /compute/v2.1/servers/bda192dc-177b-4666-a0d7-cdd2ccc7193b" status: 200 len: 1470 microversion: 2.1 time: 0.149750 Sep 13 18:14:29.443544 dv-cinder-852009-8-iscsi devstack@n-api.service[120740]: [pid: 120740|app: 0|req: 482/953] 10.222.0.43 () {58 vars in 1236 bytes} [Tue Sep 13 18:14:29 2022] GET /compute/v2.1/servers/bda192dc-177b-4666-a0d7-cdd2ccc7193b => generated 1470 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 13 18:14:30.471349 dv-cinder-852009-8-iscsi devstack@n-api.service[120741]: DEBUG nova.api.openstack.wsgi [None req-13a0c0dc-c068-4cfc-87bd-1e40cba04de0 tempest-VolumesNegativeTest-1707349420 tempest-VolumesNegativeTest-1707349420-project] Calling method '>' {{(pid=120741) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 18:14:30.472502 dv-cinder-852009-8-iscsi devstack@n-api.service[120741]: DEBUG nova.compute.api [None req-13a0c0dc-c068-4cfc-87bd-1e40cba04de0 tempest-VolumesNegativeTest-1707349420 tempest-VolumesNegativeTest-1707349420-project] [instance: bda192dc-177b-4666-a0d7-cdd2ccc7193b] Fetching instance by UUID {{(pid=120741) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 18:14:30.483375 dv-cinder-852009-8-iscsi devstack@n-api.service[120741]: DEBUG oslo_concurrency.lockutils [None req-13a0c0dc-c068-4cfc-87bd-1e40cba04de0 tempest-VolumesNegativeTest-1707349420 tempest-VolumesNegativeTest-1707349420-project] Acquiring lock "1daf4f4c-0e4a-4779-b53a-78c48397ea2f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120741) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 18:14:30.484172 dv-cinder-852009-8-iscsi devstack@n-api.service[120741]: DEBUG oslo_concurrency.lockutils [None req-13a0c0dc-c068-4cfc-87bd-1e40cba04de0 tempest-VolumesNegativeTest-1707349420 tempest-VolumesNegativeTest-1707349420-project] Lock "1daf4f4c-0e4a-4779-b53a-78c48397ea2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120741) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 18:14:30.484935 dv-cinder-852009-8-iscsi devstack@n-api.service[120741]: DEBUG oslo_concurrency.lockutils [None req-13a0c0dc-c068-4cfc-87bd-1e40cba04de0 tempest-VolumesNegativeTest-1707349420 tempest-VolumesNegativeTest-1707349420-project] Lock "1daf4f4c-0e4a-4779-b53a-78c48397ea2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120741) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 18:14:30.486067 dv-cinder-852009-8-iscsi devstack@n-api.service[120741]: DEBUG oslo_concurrency.lockutils [None req-13a0c0dc-c068-4cfc-87bd-1e40cba04de0 tempest-VolumesNegativeTest-1707349420 tempest-VolumesNegativeTest-1707349420-project] Acquiring lock "1daf4f4c-0e4a-4779-b53a-78c48397ea2f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120741) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 18:14:30.486814 dv-cinder-852009-8-iscsi devstack@n-api.service[120741]: DEBUG oslo_concurrency.lockutils [None req-13a0c0dc-c068-4cfc-87bd-1e40cba04de0 tempest-VolumesNegativeTest-1707349420 tempest-VolumesNegativeTest-1707349420-project] Lock "1daf4f4c-0e4a-4779-b53a-78c48397ea2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120741) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 18:14:30.487506 dv-cinder-852009-8-iscsi devstack@n-api.service[120741]: DEBUG oslo_concurrency.lockutils [None req-13a0c0dc-c068-4cfc-87bd-1e40cba04de0 tempest-VolumesNegativeTest-1707349420 tempest-VolumesNegativeTest-1707349420-project] Lock "1daf4f4c-0e4a-4779-b53a-78c48397ea2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120741) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 18:14:30.617820 dv-cinder-852009-8-iscsi devstack@n-api.service[120741]: DEBUG nova.policy [None req-13a0c0dc-c068-4cfc-87bd-1e40cba04de0 tempest-VolumesNegativeTest-1707349420 tempest-VolumesNegativeTest-1707349420-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dd59ce3705d94670b825d5fdb03a9472', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '655c0fd331c343fa8b451c98cc368f5d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120741) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 18:14:30.626055 dv-cinder-852009-8-iscsi devstack@n-api.service[120741]: INFO nova.api.openstack.requestlog [None req-13a0c0dc-c068-4cfc-87bd-1e40cba04de0 tempest-VolumesNegativeTest-1707349420 tempest-VolumesNegativeTest-1707349420-project] 10.222.0.43 "GET /compute/v2.1/servers/bda192dc-177b-4666-a0d7-cdd2ccc7193b" status: 200 len: 1470 microversion: 2.1 time: 0.161912 Sep 13 18:14:30.626625 dv-cinder-852009-8-iscsi devstack@n-api.service[120741]: [pid: 120741|app: 0|req: 472/954] 10.222.0.43 () {58 vars in 1236 bytes} [Tue Sep 13 18:14:30 2022] GET /compute/v2.1/servers/bda192dc-177b-4666-a0d7-cdd2ccc7193b => generated 1470 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 13 18:14:31.035821 dv-cinder-852009-8-iscsi devstack@n-api.service[120740]: DEBUG nova.api.openstack.wsgi [req-bd47dac9-a1c9-4584-9fad-bbde82cd9e58 req-03dcdcbc-3693-4e98-a072-5212aca33ccd service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "bda192dc-177b-4666-a0d7-cdd2ccc7193b", "name": "network-vif-deleted", "tag": "8bfb214c-ca85-41fe-92c5-cafabdb851d8"}]} {{(pid=120740) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 13 18:14:31.049096 dv-cinder-852009-8-iscsi devstack@n-api.service[120740]: DEBUG oslo_concurrency.lockutils [req-bd47dac9-a1c9-4584-9fad-bbde82cd9e58 req-03dcdcbc-3693-4e98-a072-5212aca33ccd service nova] Acquiring lock "1daf4f4c-0e4a-4779-b53a-78c48397ea2f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120740) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 18:14:31.049594 dv-cinder-852009-8-iscsi devstack@n-api.service[120740]: DEBUG oslo_concurrency.lockutils [req-bd47dac9-a1c9-4584-9fad-bbde82cd9e58 req-03dcdcbc-3693-4e98-a072-5212aca33ccd service nova] Lock "1daf4f4c-0e4a-4779-b53a-78c48397ea2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120740) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 18:14:31.050015 dv-cinder-852009-8-iscsi devstack@n-api.service[120740]: DEBUG oslo_concurrency.lockutils [req-bd47dac9-a1c9-4584-9fad-bbde82cd9e58 req-03dcdcbc-3693-4e98-a072-5212aca33ccd service nova] Lock "1daf4f4c-0e4a-4779-b53a-78c48397ea2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120740) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 18:14:31.065375 dv-cinder-852009-8-iscsi devstack@n-api.service[120740]: INFO nova.api.openstack.compute.server_external_events [req-bd47dac9-a1c9-4584-9fad-bbde82cd9e58 req-03dcdcbc-3693-4e98-a072-5212aca33ccd service nova] Creating event network-vif-deleted:8bfb214c-ca85-41fe-92c5-cafabdb851d8 for instance bda192dc-177b-4666-a0d7-cdd2ccc7193b on hv-cinder-85200 Sep 13 18:14:31.071628 dv-cinder-852009-8-iscsi devstack@n-api.service[120740]: INFO nova.api.openstack.requestlog [req-bd47dac9-a1c9-4584-9fad-bbde82cd9e58 req-03dcdcbc-3693-4e98-a072-5212aca33ccd service nova] 10.222.0.43 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.039325 Sep 13 18:14:31.072219 dv-cinder-852009-8-iscsi devstack@n-api.service[120740]: [pid: 120740|app: 0|req: 483/955] 10.222.0.43 () {64 vars in 1317 bytes} [Tue Sep 13 18:14:31 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 41 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 13 18:14:31.654136 dv-cinder-852009-8-iscsi devstack@n-api.service[120741]: DEBUG nova.api.openstack.wsgi [None req-858b9c9f-ef13-4c62-8d2a-c09339a397c6 tempest-VolumesNegativeTest-1707349420 tempest-VolumesNegativeTest-1707349420-project] Calling method '>' {{(pid=120741) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 18:14:31.655225 dv-cinder-852009-8-iscsi devstack@n-api.service[120741]: DEBUG nova.compute.api [None req-858b9c9f-ef13-4c62-8d2a-c09339a397c6 tempest-VolumesNegativeTest-1707349420 tempest-VolumesNegativeTest-1707349420-project] [instance: bda192dc-177b-4666-a0d7-cdd2ccc7193b] Fetching instance by UUID {{(pid=120741) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 18:14:31.664619 dv-cinder-852009-8-iscsi devstack@n-api.service[120741]: DEBUG oslo_concurrency.lockutils [None req-858b9c9f-ef13-4c62-8d2a-c09339a397c6 tempest-VolumesNegativeTest-1707349420 tempest-VolumesNegativeTest-1707349420-project] Acquiring lock "1daf4f4c-0e4a-4779-b53a-78c48397ea2f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120741) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 18:14:31.665130 dv-cinder-852009-8-iscsi devstack@n-api.service[120741]: DEBUG oslo_concurrency.lockutils [None req-858b9c9f-ef13-4c62-8d2a-c09339a397c6 tempest-VolumesNegativeTest-1707349420 tempest-VolumesNegativeTest-1707349420-project] Lock "1daf4f4c-0e4a-4779-b53a-78c48397ea2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120741) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 18:14:31.665786 dv-cinder-852009-8-iscsi devstack@n-api.service[120741]: DEBUG oslo_concurrency.lockutils [None req-858b9c9f-ef13-4c62-8d2a-c09339a397c6 tempest-VolumesNegativeTest-1707349420 tempest-VolumesNegativeTest-1707349420-project] Lock "1daf4f4c-0e4a-4779-b53a-78c48397ea2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120741) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 18:14:31.666542 dv-cinder-852009-8-iscsi devstack@n-api.service[120741]: DEBUG oslo_concurrency.lockutils [None req-858b9c9f-ef13-4c62-8d2a-c09339a397c6 tempest-VolumesNegativeTest-1707349420 tempest-VolumesNegativeTest-1707349420-project] Acquiring lock "1daf4f4c-0e4a-4779-b53a-78c48397ea2f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120741) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 18:14:31.666993 dv-cinder-852009-8-iscsi devstack@n-api.service[120741]: DEBUG oslo_concurrency.lockutils [None req-858b9c9f-ef13-4c62-8d2a-c09339a397c6 tempest-VolumesNegativeTest-1707349420 tempest-VolumesNegativeTest-1707349420-project] Lock "1daf4f4c-0e4a-4779-b53a-78c48397ea2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120741) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 18:14:31.667414 dv-cinder-852009-8-iscsi devstack@n-api.service[120741]: DEBUG oslo_concurrency.lockutils [None req-858b9c9f-ef13-4c62-8d2a-c09339a397c6 tempest-VolumesNegativeTest-1707349420 tempest-VolumesNegativeTest-1707349420-project] Lock "1daf4f4c-0e4a-4779-b53a-78c48397ea2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120741) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 18:14:31.680966 dv-cinder-852009-8-iscsi devstack@n-api.service[120741]: INFO nova.api.openstack.wsgi [None req-858b9c9f-ef13-4c62-8d2a-c09339a397c6 tempest-VolumesNegativeTest-1707349420 tempest-VolumesNegativeTest-1707349420-project] HTTP exception thrown: Instance bda192dc-177b-4666-a0d7-cdd2ccc7193b could not be found. Sep 13 18:14:31.682661 dv-cinder-852009-8-iscsi devstack@n-api.service[120741]: DEBUG nova.api.openstack.wsgi [None req-858b9c9f-ef13-4c62-8d2a-c09339a397c6 tempest-VolumesNegativeTest-1707349420 tempest-VolumesNegativeTest-1707349420-project] Request method failure captured: Sep 13 18:14:31.682661 dv-cinder-852009-8-iscsi devstack@n-api.service[120741]: request: GET /compute/v2.1/servers/bda192dc-177b-4666-a0d7-cdd2ccc7193b HTTP/1.1 Sep 13 18:14:31.682661 dv-cinder-852009-8-iscsi devstack@n-api.service[120741]: Accept: application/json Sep 13 18:14:31.682661 dv-cinder-852009-8-iscsi devstack@n-api.service[120741]: Accept-Encoding: identity Sep 13 18:14:31.682661 dv-cinder-852009-8-iscsi devstack@n-api.service[120741]: Connection: close Sep 13 18:14:31.682661 dv-cinder-852009-8-iscsi devstack@n-api.service[120741]: Content-Length: 0 Sep 13 18:14:31.682661 dv-cinder-852009-8-iscsi devstack@n-api.service[120741]: Content-Type: application/json Sep 13 18:14:31.682661 dv-cinder-852009-8-iscsi devstack@n-api.service[120741]: Host: 10.222.0.43 Sep 13 18:14:31.682661 dv-cinder-852009-8-iscsi devstack@n-api.service[120741]: Openstack-System-Scope: None Sep 13 18:14:31.682661 dv-cinder-852009-8-iscsi devstack@n-api.service[120741]: User-Agent: python-urllib3/1.26.12 Sep 13 18:14:31.682661 dv-cinder-852009-8-iscsi devstack@n-api.service[120741]: X-Auth-Token: gAAAAABjIMh4SZhswQ7Npurj3TeWvZTchOxjxRniWdl2-Ddc5wqXoPtiPzP4my0NGv3M6m90OWUCmIrHK4JUZpFrXi-cG6O6WGreS-XVDdv7anurEhlzc3MQ532r5_GwLYOGRrKtMBG-4Cb-KhvCq4x5GIprd4bfPvDlfeV6Ifo_SR3ALc-tOPA Sep 13 18:14:31.682661 dv-cinder-852009-8-iscsi devstack@n-api.service[120741]: X-Domain-Id: None Sep 13 18:14:31.682661 dv-cinder-852009-8-iscsi devstack@n-api.service[120741]: X-Domain-Name: None Sep 13 18:14:31.682661 dv-cinder-852009-8-iscsi devstack@n-api.service[120741]: X-Identity-Status: Confirmed Sep 13 18:14:31.682661 dv-cinder-852009-8-iscsi devstack@n-api.service[120741]: X-Is-Admin-Project: True Sep 13 18:14:31.682661 dv-cinder-852009-8-iscsi devstack@n-api.service[120741]: X-Project-Domain-Id: default Sep 13 18:14:31.682661 dv-cinder-852009-8-iscsi devstack@n-api.service[120741]: X-Project-Domain-Name: Default Sep 13 18:14:31.682661 dv-cinder-852009-8-iscsi devstack@n-api.service[120741]: X-Project-Id: 655c0fd331c343fa8b451c98cc368f5d Sep 13 18:14:31.682661 dv-cinder-852009-8-iscsi devstack@n-api.service[120741]: X-Project-Name: tempest-VolumesNegativeTest-1707349420 Sep 13 18:14:31.682661 dv-cinder-852009-8-iscsi devstack@n-api.service[120741]: X-Role: reader,member Sep 13 18:14:31.682661 dv-cinder-852009-8-iscsi devstack@n-api.service[120741]: X-Roles: reader,member Sep 13 18:14:31.684598 dv-cinder-852009-8-iscsi devstack@n-api.service[120741]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/identity"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/compute/v2/655c0fd331c343fa8b451c98cc368f5d"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.43:8080", "publicURL": "http://10.222.0.43:8080/v1/AUTH_655c0fd331c343fa8b451c98cc368f5d"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43:9696/networking"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/volume/v3/655c0fd331c343fa8b451c98cc368f5d"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/compute/v2.1"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/placement"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/volume/v3/655c0fd331c343fa8b451c98cc368f5d"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/image"}]}] Sep 13 18:14:31.684598 dv-cinder-852009-8-iscsi devstack@n-api.service[120741]: X-Tenant: tempest-VolumesNegativeTest-1707349420 Sep 13 18:14:31.684598 dv-cinder-852009-8-iscsi devstack@n-api.service[120741]: X-Tenant-Id: 655c0fd331c343fa8b451c98cc368f5d Sep 13 18:14:31.684598 dv-cinder-852009-8-iscsi devstack@n-api.service[120741]: X-Tenant-Name: tempest-VolumesNegativeTest-1707349420 Sep 13 18:14:31.684598 dv-cinder-852009-8-iscsi devstack@n-api.service[120741]: X-User: tempest-VolumesNegativeTest-1707349420-project Sep 13 18:14:31.684598 dv-cinder-852009-8-iscsi devstack@n-api.service[120741]: X-User-Domain-Id: default Sep 13 18:14:31.684598 dv-cinder-852009-8-iscsi devstack@n-api.service[120741]: X-User-Domain-Name: Default Sep 13 18:14:31.684598 dv-cinder-852009-8-iscsi devstack@n-api.service[120741]: X-User-Id: dd59ce3705d94670b825d5fdb03a9472 Sep 13 18:14:31.684598 dv-cinder-852009-8-iscsi devstack@n-api.service[120741]: X-User-Name: tempest-VolumesNegativeTest-1707349420-project Sep 13 18:14:31.684598 dv-cinder-852009-8-iscsi devstack@n-api.service[120741]: method: > Sep 13 18:14:31.684598 dv-cinder-852009-8-iscsi devstack@n-api.service[120741]: exception: Instance bda192dc-177b-4666-a0d7-cdd2ccc7193b could not be found. Sep 13 18:14:31.684598 dv-cinder-852009-8-iscsi devstack@n-api.service[120741]: action_args: {'id': 'bda192dc-177b-4666-a0d7-cdd2ccc7193b'} Sep 13 18:14:31.685741 dv-cinder-852009-8-iscsi devstack@n-api.service[120741]: {{(pid=120741) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 13 18:14:31.685741 dv-cinder-852009-8-iscsi devstack@n-api.service[120741]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 13 18:14:31.685741 dv-cinder-852009-8-iscsi devstack@n-api.service[120741]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Sep 13 18:14:31.685741 dv-cinder-852009-8-iscsi devstack@n-api.service[120741]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Sep 13 18:14:31.685741 dv-cinder-852009-8-iscsi devstack@n-api.service[120741]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Sep 13 18:14:31.685741 dv-cinder-852009-8-iscsi devstack@n-api.service[120741]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Sep 13 18:14:31.685741 dv-cinder-852009-8-iscsi devstack@n-api.service[120741]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Sep 13 18:14:31.685741 dv-cinder-852009-8-iscsi devstack@n-api.service[120741]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Sep 13 18:14:31.685741 dv-cinder-852009-8-iscsi devstack@n-api.service[120741]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Sep 13 18:14:31.685741 dv-cinder-852009-8-iscsi devstack@n-api.service[120741]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Sep 13 18:14:31.685741 dv-cinder-852009-8-iscsi devstack@n-api.service[120741]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance bda192dc-177b-4666-a0d7-cdd2ccc7193b could not be found. Sep 13 18:14:31.685741 dv-cinder-852009-8-iscsi devstack@n-api.service[120741]: ERROR nova.api.openstack.wsgi Sep 13 18:14:31.685741 dv-cinder-852009-8-iscsi devstack@n-api.service[120741]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 13 18:14:31.685741 dv-cinder-852009-8-iscsi devstack@n-api.service[120741]: ERROR nova.api.openstack.wsgi Sep 13 18:14:31.685741 dv-cinder-852009-8-iscsi devstack@n-api.service[120741]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 13 18:14:31.685741 dv-cinder-852009-8-iscsi devstack@n-api.service[120741]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 13 18:14:31.685741 dv-cinder-852009-8-iscsi devstack@n-api.service[120741]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 13 18:14:31.685741 dv-cinder-852009-8-iscsi devstack@n-api.service[120741]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 13 18:14:31.685741 dv-cinder-852009-8-iscsi devstack@n-api.service[120741]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 13 18:14:31.685741 dv-cinder-852009-8-iscsi devstack@n-api.service[120741]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 13 18:14:31.687317 dv-cinder-852009-8-iscsi devstack@n-api.service[120741]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 13 18:14:31.687317 dv-cinder-852009-8-iscsi devstack@n-api.service[120741]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Sep 13 18:14:31.687317 dv-cinder-852009-8-iscsi devstack@n-api.service[120741]: ERROR nova.api.openstack.wsgi instance = self._get_server( Sep 13 18:14:31.687317 dv-cinder-852009-8-iscsi devstack@n-api.service[120741]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Sep 13 18:14:31.687317 dv-cinder-852009-8-iscsi devstack@n-api.service[120741]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Sep 13 18:14:31.687317 dv-cinder-852009-8-iscsi devstack@n-api.service[120741]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Sep 13 18:14:31.687317 dv-cinder-852009-8-iscsi devstack@n-api.service[120741]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Sep 13 18:14:31.687317 dv-cinder-852009-8-iscsi devstack@n-api.service[120741]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance bda192dc-177b-4666-a0d7-cdd2ccc7193b could not be found. Sep 13 18:14:31.687317 dv-cinder-852009-8-iscsi devstack@n-api.service[120741]: ERROR nova.api.openstack.wsgi Sep 13 18:14:31.687317 dv-cinder-852009-8-iscsi devstack@n-api.service[120741]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 13 18:14:31.687317 dv-cinder-852009-8-iscsi devstack@n-api.service[120741]: ERROR nova.api.openstack.wsgi Sep 13 18:14:31.687317 dv-cinder-852009-8-iscsi devstack@n-api.service[120741]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 13 18:14:31.687317 dv-cinder-852009-8-iscsi devstack@n-api.service[120741]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 13 18:14:31.687317 dv-cinder-852009-8-iscsi devstack@n-api.service[120741]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 13 18:14:31.687317 dv-cinder-852009-8-iscsi devstack@n-api.service[120741]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 13 18:14:31.687317 dv-cinder-852009-8-iscsi devstack@n-api.service[120741]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 13 18:14:31.687317 dv-cinder-852009-8-iscsi devstack@n-api.service[120741]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance bda192dc-177b-4666-a0d7-cdd2ccc7193b could not be found. Sep 13 18:14:31.687317 dv-cinder-852009-8-iscsi devstack@n-api.service[120741]: ERROR nova.api.openstack.wsgi Sep 13 18:14:31.689142 dv-cinder-852009-8-iscsi devstack@n-api.service[120741]: DEBUG nova.api.openstack.wsgi [None req-858b9c9f-ef13-4c62-8d2a-c09339a397c6 tempest-VolumesNegativeTest-1707349420 tempest-VolumesNegativeTest-1707349420-project] Returning 404 to user: Instance bda192dc-177b-4666-a0d7-cdd2ccc7193b could not be found. {{(pid=120741) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 13 18:14:31.689142 dv-cinder-852009-8-iscsi devstack@n-api.service[120741]: INFO nova.api.openstack.requestlog [None req-858b9c9f-ef13-4c62-8d2a-c09339a397c6 tempest-VolumesNegativeTest-1707349420 tempest-VolumesNegativeTest-1707349420-project] 10.222.0.43 "GET /compute/v2.1/servers/bda192dc-177b-4666-a0d7-cdd2ccc7193b" status: 404 len: 111 microversion: 2.1 time: 0.036699 Sep 13 18:14:31.689142 dv-cinder-852009-8-iscsi devstack@n-api.service[120741]: [pid: 120741|app: 0|req: 473/956] 10.222.0.43 () {58 vars in 1236 bytes} [Tue Sep 13 18:14:31 2022] GET /compute/v2.1/servers/bda192dc-177b-4666-a0d7-cdd2ccc7193b => generated 111 bytes in 38 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Sep 13 18:14:46.247570 dv-cinder-852009-8-iscsi devstack@n-api.service[120740]: DEBUG dbcounter [-] [120740] Writing DB stats nova_api:SELECT=29,nova_api:INSERT=3 {{(pid=120740) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 18:14:46.248881 dv-cinder-852009-8-iscsi devstack@n-api.service[120740]: DEBUG dbcounter [-] [120740] Writing DB stats nova_cell1:SELECT=38 {{(pid=120740) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 18:14:46.430356 dv-cinder-852009-8-iscsi devstack@n-api.service[120740]: DEBUG nova.api.openstack.wsgi [None req-84313a0d-b80d-47a7-b54e-50cb90546040 tempest-TestVolumeBootPattern-701875022 tempest-TestVolumeBootPattern-701875022-project] Action: 'create', calling method: .version_select at 0x7fa626c3fee0>, body: {"keypair": {"name": "tempest-TestVolumeBootPattern-1941488628", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBKjssVpp7xGqJriQAOm+2c714kbwnMIK9bHm4SEyvOssrBand7VzxdigguZhbaYO4CPd4lrYGE9T7zgMAYv5MURHIukvN81kDEfvMjgRlnpraoyCyXPtH7i1cKm3VcbPVw=="}} {{(pid=120740) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 13 18:14:46.447934 dv-cinder-852009-8-iscsi devstack@n-api.service[120740]: DEBUG nova.quota [None req-84313a0d-b80d-47a7-b54e-50cb90546040 tempest-TestVolumeBootPattern-701875022 tempest-TestVolumeBootPattern-701875022-project] Getting quotas for project 0fcaaf852cd6415c96656b52df5ccef8. Resources: {'key_pairs'} {{(pid=120740) _get_quotas /opt/stack/nova/nova/quota.py:393}} Sep 13 18:14:46.452688 dv-cinder-852009-8-iscsi devstack@n-api.service[120740]: DEBUG nova.quota [None req-84313a0d-b80d-47a7-b54e-50cb90546040 tempest-TestVolumeBootPattern-701875022 tempest-TestVolumeBootPattern-701875022-project] Getting quotas for user 0a18300461ee48e8900f9d182fdc72c7 and project 0fcaaf852cd6415c96656b52df5ccef8. Resources: {'key_pairs'} {{(pid=120740) _get_quotas /opt/stack/nova/nova/quota.py:383}} Sep 13 18:14:46.477017 dv-cinder-852009-8-iscsi devstack@n-api.service[120740]: INFO nova.api.openstack.requestlog [None req-84313a0d-b80d-47a7-b54e-50cb90546040 tempest-TestVolumeBootPattern-701875022 tempest-TestVolumeBootPattern-701875022-project] 10.222.0.43 "POST /compute/v2.1/os-keypairs" status: 200 len: 400 microversion: 2.1 time: 0.235451 Sep 13 18:14:46.477621 dv-cinder-852009-8-iscsi devstack@n-api.service[120740]: [pid: 120740|app: 0|req: 484/957] 10.222.0.43 () {60 vars in 1159 bytes} [Tue Sep 13 18:14:46 2022] POST /compute/v2.1/os-keypairs => generated 400 bytes in 237 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 13 18:15:01.904414 dv-cinder-852009-8-iscsi devstack@n-api.service[120741]: DEBUG nova.api.openstack.wsgi [None req-f9976c0a-0e61-451e-abe9-6c4d82dedd90 tempest-TestVolumeBootPattern-701875022 tempest-TestVolumeBootPattern-701875022-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-TestVolumeBootPattern-server-1475039897", "imageRef": "", "flavorRef": "452", "key_name": "tempest-TestVolumeBootPattern-1941488628", "security_groups": [{"name": "tempest-secgroup-smoke-1644824250"}], "block_device_mapping_v2": [{"uuid": "590c7abd-1ecb-42b2-9fe5-619582da9e7f", "source_type": "volume", "destination_type": "volume", "boot_index": 0, "delete_on_termination": false}], "networks": [{"uuid": "fa48ba74-0f08-47d5-9def-35cf01e4c8d7"}]}} {{(pid=120741) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 13 18:15:01.915189 dv-cinder-852009-8-iscsi devstack@n-api.service[120741]: DEBUG dbcounter [-] [120741] Writing DB stats nova_api:SELECT=25,nova_api:UPDATE=1 {{(pid=120741) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 18:15:01.915839 dv-cinder-852009-8-iscsi devstack@n-api.service[120741]: DEBUG dbcounter [-] [120741] Writing DB stats nova_cell1:SELECT=52,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=120741) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 18:15:02.022281 dv-cinder-852009-8-iscsi devstack@n-api.service[120741]: DEBUG nova.network.neutron [None req-f9976c0a-0e61-451e-abe9-6c4d82dedd90 tempest-TestVolumeBootPattern-701875022 tempest-TestVolumeBootPattern-701875022-project] validate_networks() for [('fa48ba74-0f08-47d5-9def-35cf01e4c8d7', None, None, None, None, None)] {{(pid=120741) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Sep 13 18:15:11.930378 dv-cinder-852009-8-iscsi devstack@n-api.service[120741]: DEBUG dbcounter [-] [120741] Writing DB stats nova_api:SELECT=2 {{(pid=120741) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 18:16:03.301913 dv-cinder-852009-8-iscsi devstack@n-api.service[120740]: DEBUG dbcounter [-] [120740] Writing DB stats nova_cell0:SELECT=4 {{(pid=120740) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 18:16:03.303004 dv-cinder-852009-8-iscsi devstack@n-api.service[120740]: DEBUG dbcounter [-] [120740] Writing DB stats nova_api:SELECT=11,nova_api:INSERT=1 {{(pid=120740) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 18:16:03.308977 dv-cinder-852009-8-iscsi devstack@n-api.service[120740]: DEBUG nova.api.openstack.wsgi [None req-8920f935-0e3c-4c1c-bbca-cbe02a3beb5e tempest-TestVolumeBootPattern-701875022 tempest-TestVolumeBootPattern-701875022-project] Calling method '.version_select at 0x7fa626c518b0>' {{(pid=120740) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 18:16:03.333598 dv-cinder-852009-8-iscsi devstack@n-api.service[120740]: INFO nova.api.openstack.requestlog [None req-8920f935-0e3c-4c1c-bbca-cbe02a3beb5e tempest-TestVolumeBootPattern-701875022 tempest-TestVolumeBootPattern-701875022-project] 10.222.0.43 "DELETE /compute/v2.1/os-keypairs/tempest-TestVolumeBootPattern-1941488628" status: 202 len: 0 microversion: 2.1 time: 0.033738 Sep 13 18:16:03.334191 dv-cinder-852009-8-iscsi devstack@n-api.service[120740]: [pid: 120740|app: 0|req: 485/958] 10.222.0.43 () {58 vars in 1263 bytes} [Tue Sep 13 18:16:03 2022] DELETE /compute/v2.1/os-keypairs/tempest-TestVolumeBootPattern-1941488628 => generated 0 bytes in 35 msecs (HTTP/1.1 202) 9 headers in 361 bytes (2 switches on core 0) Sep 13 18:17:40.412064 dv-cinder-852009-8-iscsi devstack@n-api.service[120741]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Sep 13 18:17:40.413107 dv-cinder-852009-8-iscsi devstack@n-api.service[120741]: Tue Sep 13 18:17:40 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) on request /compute/v2.1/servers (ip 10.222.0.43) !!! Sep 13 18:17:40.414162 dv-cinder-852009-8-iscsi devstack@n-api.service[120741]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Sep 13 18:17:40.414408 dv-cinder-852009-8-iscsi devstack@n-api.service[120741]: Tue Sep 13 18:17:40 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) on request /compute/v2.1/servers (ip 10.222.0.43) !!! Sep 13 18:17:40.420872 dv-cinder-852009-8-iscsi devstack@n-api.service[120741]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Sep 13 18:17:40.421121 dv-cinder-852009-8-iscsi devstack@n-api.service[120741]: Tue Sep 13 18:17:40 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) on request /compute/v2.1/servers (ip 10.222.0.43) !!! Sep 13 18:21:00.435331 dv-cinder-852009-8-iscsi devstack@n-api.service[120741]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Sep 13 18:21:00.436256 dv-cinder-852009-8-iscsi devstack@n-api.service[120741]: Tue Sep 13 18:21:00 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) on request /compute/v2.1/servers (ip 10.222.0.43) !!! Sep 13 18:21:00.436966 dv-cinder-852009-8-iscsi devstack@n-api.service[120741]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Sep 13 18:21:00.437173 dv-cinder-852009-8-iscsi devstack@n-api.service[120741]: Tue Sep 13 18:21:00 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) on request /compute/v2.1/servers (ip 10.222.0.43) !!! Sep 13 18:21:00.439431 dv-cinder-852009-8-iscsi devstack@n-api.service[120741]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Sep 13 18:21:00.439658 dv-cinder-852009-8-iscsi devstack@n-api.service[120741]: Tue Sep 13 18:21:00 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) on request /compute/v2.1/servers (ip 10.222.0.43) !!!